225 lines
38 KiB
Plaintext
Raw Blame History

This file contains invisible Unicode characters

This file contains invisible Unicode characters that are indistinguishable to humans but may be processed differently by a computer. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

DEBUG  tests.conftest:conftest.py:51 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:57 Running test: test_large_message_payload_sync with id: 2026-03-13_04-41-28__a17b182a-5f92-460b-a9dd-c8e3d536d154
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node1_2026-03-13_04-41-28__a17b182a-5f92-460b-a9dd-c8e3d536d154__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node2_2026-03-13_04-41-28__a17b182a-5f92-460b-a9dd-c8e3d536d154__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node3_2026-03-13_04-41-28__a17b182a-5f92-460b-a9dd-c8e3d536d154__wakuorg_nwaku:latest.log
DEBUG  src.steps.store:store.py:31 Running fixture setup: store_setup
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.80.220
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['32190', '32191', '32192', '32193', '32194']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 32190:32190 -p 32191:32191 -p 32192:32192 -p 32193:32193 -p 32194:32194 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=32192 --rest-port=32190 --tcp-port=32191 --discv5-udp-port=32193 --rest-address=0.0.0.0 --nat=extip:172.18.80.220 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=289ce069d9eea01886dd3cddf83fa9bca003e53acd7b2392cd7fbc8d49a9dbbf --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=32194 --metrics-logging=true --store=true --relay=true
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container d6faabeb6d84. Exiting log stream.
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.80.220 waku c2512f9fa938c373e40bf663f451b2ca071af3316b91424c65486ce62c24d955
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID c2512f9fa938. Setting up logs at ./log/docker/node1_2026-03-13_04-41-28__a17b182a-5f92-460b-a9dd-c8e3d536d154__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 32190
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 6ac334d10149. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:32190/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:32190/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.80.220/tcp/32191/p2p/16Uiu2HAm3REwv1GYB1NQRup9pcpJhe9LVuExCyJNoJbXJRV39wep","/ip4/172.18.80.220/tcp/32192/ws/p2p/16Uiu2HAm3REwv1GYB1NQRup9pcpJhe9LVuExCyJNoJbXJRV39wep"],"enrUri":"enr:-L24QD51L0-KOQ1jS1Apg_ZRcqNKWZZ8L27FL1ht8JaYlg0PBM6hpOxrUmFqCtHD9R66OXdUVpwhwJnKoJ3pSF0w43oCgmlkgnY0gmlwhKwSUNyKbXVsdGlhZGRyc5YACASsElDcBn2_AAoErBJQ3AZ9wN0DgnJzhQADAQAAiXNlY3AyNTZrMaECdsEw8gjoXN1ekmajF1POXADU8qTjO8Ky5AfNGhJJVYmDdGNwgn2_g3VkcIJ9wYV3YWt1MgM"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.96.253
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['32281', '32282', '32283', '32284', '32285']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 32281:32281 -p 32282:32282 -p 32283:32283 -p 32284:32284 -p 32285:32285 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=32283 --rest-port=32281 --tcp-port=32282 --discv5-udp-port=32284 --rest-address=0.0.0.0 --nat=extip:172.18.96.253 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=5daea3d4eb20b16c8dea946e561d8e4a56fb0d9db34dfa42e79c81cb2bc8dc2f --store-sync=true --store=false --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=32285 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QD51L0-KOQ1jS1Apg_ZRcqNKWZZ8L27FL1ht8JaYlg0PBM6hpOxrUmFqCtHD9R66OXdUVpwhwJnKoJ3pSF0w43oCgmlkgnY0gmlwhKwSUNyKbXVsdGlhZGRyc5YACASsElDcBn2_AAoErBJQ3AZ9wN0DgnJzhQADAQAAiXNlY3AyNTZrMaECdsEw8gjoXN1ekmajF1POXADU8qTjO8Ky5AfNGhJJVYmDdGNwgn2_g3VkcIJ9wYV3YWt1MgM
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.96.253 waku ab331dd489f87cc3d5265d9d981dafe9a4deaf9564583108c6a7c3251c4229c7
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID ab331dd489f8. Setting up logs at ./log/docker/node2_2026-03-13_04-41-28__a17b182a-5f92-460b-a9dd-c8e3d536d154__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 32281
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:32281/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:32281/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.96.253/tcp/32282/p2p/16Uiu2HAmHgAZidzdv3FPasjFzbJ7g8f7y49Q2Z9ATMcDaZTAbTet","/ip4/172.18.96.253/tcp/32283/ws/p2p/16Uiu2HAmHgAZidzdv3FPasjFzbJ7g8f7y49Q2Z9ATMcDaZTAbTet"],"enrUri":"enr:-L24QFO4Q7MmR3t5o0v-1xyNgiQ3RYl7OGp4_W48AHLTbRogYHnfPVTgr-Ez9S296SOK2xFyP7n6LprXlw3VZN2Cz10CgmlkgnY0gmlwhKwSYP2KbXVsdGlhZGRyc5YACASsEmD9Bn4aAAoErBJg_QZ-G90DgnJzhQADAQAAiXNlY3AyNTZrMaEDSpeQlSK8Qp3GU9Tbb20vDpjLJcpota5PH9yqmH8YC92DdGNwgn4ag3VkcIJ-HIV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.139.171
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['30183', '30184', '30185', '30186', '30187']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 30183:30183 -p 30184:30184 -p 30185:30185 -p 30186:30186 -p 30187:30187 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=30185 --rest-port=30183 --tcp-port=30184 --discv5-udp-port=30186 --rest-address=0.0.0.0 --nat=extip:172.18.139.171 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=d013aed4b843237f22f1cf82817bee2f2ac4e57ce4a1e8fd1c10eb520dda2e9d --store-sync=true --store=false --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=30187 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QFO4Q7MmR3t5o0v-1xyNgiQ3RYl7OGp4_W48AHLTbRogYHnfPVTgr-Ez9S296SOK2xFyP7n6LprXlw3VZN2Cz10CgmlkgnY0gmlwhKwSYP2KbXVsdGlhZGRyc5YACASsEmD9Bn4aAAoErBJg_QZ-G90DgnJzhQADAQAAiXNlY3AyNTZrMaEDSpeQlSK8Qp3GU9Tbb20vDpjLJcpota5PH9yqmH8YC92DdGNwgn4ag3VkcIJ-HIV3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.139.171 waku 919b2197d8df8da574f6277551a56b157a7215230c082e59baafdb7dbaeb076b
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 919b2197d8df. Setting up logs at ./log/docker/node3_2026-03-13_04-41-28__a17b182a-5f92-460b-a9dd-c8e3d536d154__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 30183
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:30183/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:30183/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.139.171/tcp/30184/p2p/16Uiu2HAmLJWgv71Tz9nV9sz2mXGKve9W1NGDKs4SQsX7NoURdWr3","/ip4/172.18.139.171/tcp/30185/ws/p2p/16Uiu2HAmLJWgv71Tz9nV9sz2mXGKve9W1NGDKs4SQsX7NoURdWr3"],"enrUri":"enr:-L24QICQQNcuYmIeSNEFXbjYD5pvhJyK43D55U3JqUI9gUFzIfviCHOk_sI_8AOc-lNBdOoGiPX3isUDA1FNoLqZicwCgmlkgnY0gmlwhKwSi6uKbXVsdGlhZGRyc5YACASsEourBnXoAAoErBKLqwZ16d0DgnJzhQADAQAAiXNlY3AyNTZrMaEDcZ6aJjBhvjNHHZLtXSUewenidgppjuEY6u1_8TNCFTCDdGNwgnXog3VkcIJ16oV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:32281/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.80.220/tcp/32191/p2p/16Uiu2HAm3REwv1GYB1NQRup9pcpJhe9LVuExCyJNoJbXJRV39wep"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:30183/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.96.253/tcp/32282/p2p/16Uiu2HAmHgAZidzdv3FPasjFzbJ7g8f7y49Q2Z9ATMcDaZTAbTet"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:32190/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:32281/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:30183/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:custom_logger.py:10 Log line was discarded because it's longer than max_log_line_length=5000
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:custom_logger.py:10 Log line was discarded because it's longer than max_log_line_length=5000
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:custom_logger.py:10 Log line was discarded because it's longer than max_log_line_length=5000
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:custom_logger.py:10 Log line was discarded because it's longer than max_log_line_length=5000
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:custom_logger.py:10 Log line was discarded because it's longer than max_log_line_length=5000
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:custom_logger.py:10 Log line was discarded because it's longer than max_log_line_length=5000
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:custom_logger.py:10 Log line was discarded because it's longer than max_log_line_length=5000
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:custom_logger.py:10 Log line was discarded because it's longer than max_log_line_length=5000
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:custom_logger.py:10 Log line was discarded because it's longer than max_log_line_length=5000
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:custom_logger.py:10 Log line was discarded because it's longer than max_log_line_length=5000
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:custom_logger.py:10 Log line was discarded because it's longer than max_log_line_length=5000
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:custom_logger.py:10 Log line was discarded because it's longer than max_log_line_length=5000
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:custom_logger.py:10 Log line was discarded because it's longer than max_log_line_length=5000
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:custom_logger.py:10 Log line was discarded because it's longer than max_log_line_length=5000
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:custom_logger.py:10 Log line was discarded because it's longer than max_log_line_length=5000
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:custom_logger.py:10 Log line was discarded because it's longer than max_log_line_length=5000
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:custom_logger.py:10 Log line was discarded because it's longer than max_log_line_length=5000
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:custom_logger.py:10 Log line was discarded because it's longer than max_log_line_length=5000
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:custom_logger.py:10 Log line was discarded because it's longer than max_log_line_length=5000
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:custom_logger.py:10 Log line was discarded because it's longer than max_log_line_length=5000
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:custom_logger.py:10 Log line was discarded because it's longer than max_log_line_length=5000
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:custom_logger.py:10 Log line was discarded because it's longer than max_log_line_length=5000
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:custom_logger.py:10 Log line was discarded because it's longer than max_log_line_length=5000
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:custom_logger.py:10 Log line was discarded because it's longer than max_log_line_length=5000
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:custom_logger.py:10 Log line was discarded because it's longer than max_log_line_length=5000
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:custom_logger.py:10 Log line was discarded because it's longer than max_log_line_length=5000
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:custom_logger.py:10 Log line was discarded because it's longer than max_log_line_length=5000
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:custom_logger.py:10 Log line was discarded because it's longer than max_log_line_length=5000
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:custom_logger.py:10 Log line was discarded because it's longer than max_log_line_length=5000
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:custom_logger.py:10 Log line was discarded because it's longer than max_log_line_length=5000
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.libs.common:common.py:47 Sleeping for 10 seconds
DEBUG  src.steps.store:store.py:211 Checking that peer wakuorg/nwaku:latest can find the stored messages
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:32190/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x4376cd24819b7aa2d07c3f0d8ea4a4fa5494f0ddd6caf2875728f34a8540ec7e"},{"messageHash":"0x3472c9caa4e1a93f19aef320a966cc69352da9738d1cd11d6fe046e251c6b50c"},{"messageHash":"0xf94342979a48f1d3db3ac8d3b3f85e0ee2384aac6404a93160551a2fe285d4df"},{"messageHash":"0xf85c4d79756c61b09ac862ce739505506a28f8f10e3f45a2db1467ba1648f56a"},{"messageHash":"0x0f4f576e600d71895413039a87908c44a550ef24f1ff286b9b6cb97e26e74f16"},{"messageHash":"0x95b12cc200d8c889381a58dbcd63d6dcac8221acd0d916258614e589bc9e609a"},{"messageHash":"0x21b26a0ae2c5e8f461100170d16ea57b9c5d87a9474dedabeea2115942f2f527"},{"messageHash":"0x26b70c6005e1a216f2334648dfba497ff2b97c0249d6b8e2daac5759b72c10a6"},{"messageHash":"0xfe59bcccc85d3051da33697e2197ec3b83f33c2e281a69390ea400787ec2b78e"},{"messageHash":"0x36b2ce8f4378c4a3765a8af917881e1668db87085afedfb78c8b184a6721e57e"},{"messageHash":"0x63e164107ee83f85ecdd90f99864bf6d1c32d485692915830c08b39d1ee7434f"},{"messageHash":"0x529e9076a7b2177b9c3ce4e1cd4e2750b0e130d562dacf401eb00d27664645f1"},{"messageHash":"0x08f62eda2fc607755d76a053a5d276f2b746f29ad5cae1d8334e7189e3db6ea3"},{"messageHash":"0x53855e37a87ded6c1374fc0ad28e8a539492bcaa3b0e227da8e6ae7ffc860877"},{"messageHash":"0xfc0587e760e9423fa9b0805487b93a23c5891f7367b6a1f4c0ed4dbff21128b7"},{"messageHash":"0x4dba16502ba9df8daa4337d313670891b5cb0132dc54df4739ca0d13e8df745b"},{"messageHash":"0x8c172b7f0ec5ae0d024cd70962e8dd8533dd3500c85bb53d6e2ab2175633de4b"},{"messageHash":"0x7e50647dcce7b262cf189e07687bf971d8d4c05dda0ffed231fbc722a251f369"},{"messageHash":"0x9db9b407cb2669e7d61f3512e1f3738e1f1cafda2a19b6b413b8274cc5ed4555"},{"messageHash":"0x76c83beabcabb63205035ed9b00e613cb98457c44ba762d6402b9e2fa09e18af"},{"messageHash":"0x978c1d3022d3bf9219a1394d7869d3bfe7f452c90513229d12eebc14eefc7d08"},{"messageHash":"0x48c95c8c3eb63ec2d1bae3f79a62157fda59752b1ce2714b3069eb74b159b865"},{"messageHash":"0xd2421b8bb452004befda8c33fbee818c009eef91cb1629165f28a20d77745d2c"},{"messageHash":"0x826a3aaf5b70bdddd605a38ea06277ef447e87ac40ce34f16d81d54bb9e495cf"},{"messageHash":"0x3088b1c40644540563385c2c12d06130cb3cb8c498ad0678daedef5dfa6c87cd"},{"messageHash":"0xe8c6c34c77e53af2e2e3a35fc9dbee4f74bf801432ae398e99a25e03ae4e8a34"},{"messageHash":"0x405f0acd52319c2bda5271f62373e3c61620414720ae1630c512f10d1c51e611"},{"messageHash":"0x6dce5f0fdd6a803b0c057ffd30405a53007153adb06d682de2baf309e644edf0"},{"messageHash":"0xedd27fc2255a6f63c079fd9a6f8a8e6634311af5f9a3d0dd62adf0b49967a3fd"},{"messageHash":"0xa54a00d75109cc00fa90af29d2fc0c0f953dc97af1cedb4e1633de5b1d8f6ac6"}]}'
DEBUG  src.steps.store:store.py:228 messages length is 30
DEBUG  src.steps.store:store.py:211 Checking that peer wakuorg/nwaku:latest can find the stored messages
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:32281/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"requestId":"0033c5155ba338d0d46a","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x4376cd24819b7aa2d07c3f0d8ea4a4fa5494f0ddd6caf2875728f34a8540ec7e"},{"messageHash":"0x3472c9caa4e1a93f19aef320a966cc69352da9738d1cd11d6fe046e251c6b50c"},{"messageHash":"0xf94342979a48f1d3db3ac8d3b3f85e0ee2384aac6404a93160551a2fe285d4df"},{"messageHash":"0xf85c4d79756c61b09ac862ce739505506a28f8f10e3f45a2db1467ba1648f56a"},{"messageHash":"0x0f4f576e600d71895413039a87908c44a550ef24f1ff286b9b6cb97e26e74f16"},{"messageHash":"0x95b12cc200d8c889381a58dbcd63d6dcac8221acd0d916258614e589bc9e609a"},{"messageHash":"0x21b26a0ae2c5e8f461100170d16ea57b9c5d87a9474dedabeea2115942f2f527"},{"messageHash":"0x26b70c6005e1a216f2334648dfba497ff2b97c0249d6b8e2daac5759b72c10a6"},{"messageHash":"0xfe59bcccc85d3051da33697e2197ec3b83f33c2e281a69390ea400787ec2b78e"},{"messageHash":"0x36b2ce8f4378c4a3765a8af917881e1668db87085afedfb78c8b184a6721e57e"},{"messageHash":"0x63e164107ee83f85ecdd90f99864bf6d1c32d485692915830c08b39d1ee7434f"},{"messageHash":"0x529e9076a7b2177b9c3ce4e1cd4e2750b0e130d562dacf401eb00d27664645f1"},{"messageHash":"0x08f62eda2fc607755d76a053a5d276f2b746f29ad5cae1d8334e7189e3db6ea3"},{"messageHash":"0x53855e37a87ded6c1374fc0ad28e8a539492bcaa3b0e227da8e6ae7ffc860877"},{"messageHash":"0xfc0587e760e9423fa9b0805487b93a23c5891f7367b6a1f4c0ed4dbff21128b7"},{"messageHash":"0x4dba16502ba9df8daa4337d313670891b5cb0132dc54df4739ca0d13e8df745b"},{"messageHash":"0x8c172b7f0ec5ae0d024cd70962e8dd8533dd3500c85bb53d6e2ab2175633de4b"},{"messageHash":"0x7e50647dcce7b262cf189e07687bf971d8d4c05dda0ffed231fbc722a251f369"},{"messageHash":"0x9db9b407cb2669e7d61f3512e1f3738e1f1cafda2a19b6b413b8274cc5ed4555"},{"messageHash":"0x76c83beabcabb63205035ed9b00e613cb98457c44ba762d6402b9e2fa09e18af"},{"messageHash":"0x978c1d3022d3bf9219a1394d7869d3bfe7f452c90513229d12eebc14eefc7d08"},{"messageHash":"0x48c95c8c3eb63ec2d1bae3f79a62157fda59752b1ce2714b3069eb74b159b865"},{"messageHash":"0xd2421b8bb452004befda8c33fbee818c009eef91cb1629165f28a20d77745d2c"},{"messageHash":"0x826a3aaf5b70bdddd605a38ea06277ef447e87ac40ce34f16d81d54bb9e495cf"},{"messageHash":"0x3088b1c40644540563385c2c12d06130cb3cb8c498ad0678daedef5dfa6c87cd"},{"messageHash":"0xe8c6c34c77e53af2e2e3a35fc9dbee4f74bf801432ae398e99a25e03ae4e8a34"},{"messageHash":"0x405f0acd52319c2bda5271f62373e3c61620414720ae1630c512f10d1c51e611"},{"messageHash":"0x6dce5f0fdd6a803b0c057ffd30405a53007153adb06d682de2baf309e644edf0"},{"messageHash":"0xedd27fc2255a6f63c079fd9a6f8a8e6634311af5f9a3d0dd62adf0b49967a3fd"},{"messageHash":"0xa54a00d75109cc00fa90af29d2fc0c0f953dc97af1cedb4e1633de5b1d8f6ac6"}]}'
DEBUG  src.steps.store:store.py:228 messages length is 30
DEBUG  src.steps.store:store.py:211 Checking that peer wakuorg/nwaku:latest can find the stored messages
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:30183/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"requestId":"1a4934520aac9748398b","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x4376cd24819b7aa2d07c3f0d8ea4a4fa5494f0ddd6caf2875728f34a8540ec7e"},{"messageHash":"0x3472c9caa4e1a93f19aef320a966cc69352da9738d1cd11d6fe046e251c6b50c"},{"messageHash":"0xf94342979a48f1d3db3ac8d3b3f85e0ee2384aac6404a93160551a2fe285d4df"},{"messageHash":"0xf85c4d79756c61b09ac862ce739505506a28f8f10e3f45a2db1467ba1648f56a"},{"messageHash":"0x0f4f576e600d71895413039a87908c44a550ef24f1ff286b9b6cb97e26e74f16"},{"messageHash":"0x95b12cc200d8c889381a58dbcd63d6dcac8221acd0d916258614e589bc9e609a"},{"messageHash":"0x21b26a0ae2c5e8f461100170d16ea57b9c5d87a9474dedabeea2115942f2f527"},{"messageHash":"0x26b70c6005e1a216f2334648dfba497ff2b97c0249d6b8e2daac5759b72c10a6"},{"messageHash":"0xfe59bcccc85d3051da33697e2197ec3b83f33c2e281a69390ea400787ec2b78e"},{"messageHash":"0x36b2ce8f4378c4a3765a8af917881e1668db87085afedfb78c8b184a6721e57e"},{"messageHash":"0x63e164107ee83f85ecdd90f99864bf6d1c32d485692915830c08b39d1ee7434f"},{"messageHash":"0x529e9076a7b2177b9c3ce4e1cd4e2750b0e130d562dacf401eb00d27664645f1"},{"messageHash":"0x08f62eda2fc607755d76a053a5d276f2b746f29ad5cae1d8334e7189e3db6ea3"},{"messageHash":"0x53855e37a87ded6c1374fc0ad28e8a539492bcaa3b0e227da8e6ae7ffc860877"},{"messageHash":"0xfc0587e760e9423fa9b0805487b93a23c5891f7367b6a1f4c0ed4dbff21128b7"},{"messageHash":"0x4dba16502ba9df8daa4337d313670891b5cb0132dc54df4739ca0d13e8df745b"},{"messageHash":"0x8c172b7f0ec5ae0d024cd70962e8dd8533dd3500c85bb53d6e2ab2175633de4b"},{"messageHash":"0x7e50647dcce7b262cf189e07687bf971d8d4c05dda0ffed231fbc722a251f369"},{"messageHash":"0x9db9b407cb2669e7d61f3512e1f3738e1f1cafda2a19b6b413b8274cc5ed4555"},{"messageHash":"0x76c83beabcabb63205035ed9b00e613cb98457c44ba762d6402b9e2fa09e18af"},{"messageHash":"0x978c1d3022d3bf9219a1394d7869d3bfe7f452c90513229d12eebc14eefc7d08"},{"messageHash":"0x48c95c8c3eb63ec2d1bae3f79a62157fda59752b1ce2714b3069eb74b159b865"},{"messageHash":"0xd2421b8bb452004befda8c33fbee818c009eef91cb1629165f28a20d77745d2c"},{"messageHash":"0x826a3aaf5b70bdddd605a38ea06277ef447e87ac40ce34f16d81d54bb9e495cf"},{"messageHash":"0x3088b1c40644540563385c2c12d06130cb3cb8c498ad0678daedef5dfa6c87cd"},{"messageHash":"0xe8c6c34c77e53af2e2e3a35fc9dbee4f74bf801432ae398e99a25e03ae4e8a34"},{"messageHash":"0x405f0acd52319c2bda5271f62373e3c61620414720ae1630c512f10d1c51e611"},{"messageHash":"0x6dce5f0fdd6a803b0c057ffd30405a53007153adb06d682de2baf309e644edf0"},{"messageHash":"0xedd27fc2255a6f63c079fd9a6f8a8e6634311af5f9a3d0dd62adf0b49967a3fd"},{"messageHash":"0xa54a00d75109cc00fa90af29d2fc0c0f953dc97af1cedb4e1633de5b1d8f6ac6"}]}'
DEBUG  src.steps.store:store.py:228 messages length is 30
DEBUG  tests.conftest:conftest.py:59 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:83 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id c2512f9fa938
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id ab331dd489f8
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 919b2197d8df
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container c2512f9fa938. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  tests.conftest:conftest.py:98 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.