456 lines
84 KiB
Plaintext
Raw Blame History

This file contains invisible Unicode characters

This file contains invisible Unicode characters that are indistinguishable to humans but may be processed differently by a computer. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

DEBUG  tests.conftest:conftest.py:51 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:57 Running test: test_sync_with_nodes_restart__case2 with id: 2026-02-03_04-40-00__26771a8c-f481-40ff-975d-3a588705bae6
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node1_2026-02-03_04-40-00__26771a8c-f481-40ff-975d-3a588705bae6__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node2_2026-02-03_04-40-00__26771a8c-f481-40ff-975d-3a588705bae6__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node3_2026-02-03_04-40-00__26771a8c-f481-40ff-975d-3a588705bae6__wakuorg_nwaku:latest.log
DEBUG  src.steps.store:store.py:31 Running fixture setup: store_setup
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.143.142
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['31325', '31326', '31327', '31328', '31329']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 31325:31325 -p 31326:31326 -p 31327:31327 -p 31328:31328 -p 31329:31329 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=31327 --rest-port=31325 --tcp-port=31326 --discv5-udp-port=31328 --rest-address=0.0.0.0 --nat=extip:172.18.143.142 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=fe66a60c86cafa1cf308a2826d42a537a20dc999aaef48da9df6ec5dadba72f2 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=31329 --metrics-logging=true --store=true --relay=true
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.143.142 waku 5e7ebe07c733d460ac7557a39ab1a70b6a1a11228dba908a3db1bf40d17a2b7c
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 4f7a9ea92354. Exiting log stream.
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 5e7ebe07c733. Setting up logs at ./log/docker/node1_2026-02-03_04-40-00__26771a8c-f481-40ff-975d-3a588705bae6__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 31325
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 905c0c93bc29. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:31325/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:31325/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.143.142/tcp/31326/p2p/16Uiu2HAmGpjkkBFoU4CM1SavjNAzD4jykgLTMezy1Md5LkchCnmT","/ip4/172.18.143.142/tcp/31327/ws/p2p/16Uiu2HAmGpjkkBFoU4CM1SavjNAzD4jykgLTMezy1Md5LkchCnmT"],"enrUri":"enr:-L24QCE3FsPk1XHymxpkwyA4l2BkWtIYWhHehFPU88GiHvIcVFEiPeijH7fHAe2izkZsVWQTDKeEAhGLh8JGjXqEqpMCgmlkgnY0gmlwhKwSj46KbXVsdGlhZGRyc5YACASsEo-OBnpeAAoErBKPjgZ6X90DgnJzhQADAQAAiXNlY3AyNTZrMaEDPe4NcMPNylfM2V2tbZSYiHb7Lfaq_eHUHEQgzdthaL6DdGNwgnpeg3VkcIJ6YIV3YWt1MgM"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.85.194
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['34516', '34517', '34518', '34519', '34520']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 34516:34516 -p 34517:34517 -p 34518:34518 -p 34519:34519 -p 34520:34520 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=34518 --rest-port=34516 --tcp-port=34517 --discv5-udp-port=34519 --rest-address=0.0.0.0 --nat=extip:172.18.85.194 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=2b4fef982a31cf41ba20289af0a155ef1fbbd060f4c3e3860ea5c5e7d0feffe2 --store-sync=true --store=false --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=34520 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QCE3FsPk1XHymxpkwyA4l2BkWtIYWhHehFPU88GiHvIcVFEiPeijH7fHAe2izkZsVWQTDKeEAhGLh8JGjXqEqpMCgmlkgnY0gmlwhKwSj46KbXVsdGlhZGRyc5YACASsEo-OBnpeAAoErBKPjgZ6X90DgnJzhQADAQAAiXNlY3AyNTZrMaEDPe4NcMPNylfM2V2tbZSYiHb7Lfaq_eHUHEQgzdthaL6DdGNwgnpeg3VkcIJ6YIV3YWt1MgM
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.85.194 waku 9a7b0e65a4bf7b4da436c81b9ccd3a8684a79227ad9a80f9695ba796465a7d2a
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 9a7b0e65a4bf. Setting up logs at ./log/docker/node2_2026-02-03_04-40-00__26771a8c-f481-40ff-975d-3a588705bae6__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 34516
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:34516/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:34516/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.85.194/tcp/34517/p2p/16Uiu2HAmAhmZPkvQMYWXWZTkhyvxjnApckQb3YnTxrZUA71fA8Z5","/ip4/172.18.85.194/tcp/34518/ws/p2p/16Uiu2HAmAhmZPkvQMYWXWZTkhyvxjnApckQb3YnTxrZUA71fA8Z5"],"enrUri":"enr:-L24QHbUlOAg34oQbBd89uO679856vrZJrSZWkENBxKFk_Xkdin6h0XzQpeiGuvCSFicq4sqUok-zmYaocawwYJyWx4CgmlkgnY0gmlwhKwSVcKKbXVsdGlhZGRyc5YACASsElXCBobVAAoErBJVwgaG1t0DgnJzhQADAQAAiXNlY3AyNTZrMaEC4v7nxwCxsP-WpZP3WTAS9BTN2QtdmV-JTSUNa-_BegiDdGNwgobVg3VkcIKG14V3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.100.49
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['41873', '41874', '41875', '41876', '41877']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 41873:41873 -p 41874:41874 -p 41875:41875 -p 41876:41876 -p 41877:41877 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=41875 --rest-port=41873 --tcp-port=41874 --discv5-udp-port=41876 --rest-address=0.0.0.0 --nat=extip:172.18.100.49 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=c8dc5cbc4aede0cadb2f5ab8d828a392d3791baecacd1de7b5bb9c92dab7ee60 --store-sync=true --store=false --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=41877 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QHbUlOAg34oQbBd89uO679856vrZJrSZWkENBxKFk_Xkdin6h0XzQpeiGuvCSFicq4sqUok-zmYaocawwYJyWx4CgmlkgnY0gmlwhKwSVcKKbXVsdGlhZGRyc5YACASsElXCBobVAAoErBJVwgaG1t0DgnJzhQADAQAAiXNlY3AyNTZrMaEC4v7nxwCxsP-WpZP3WTAS9BTN2QtdmV-JTSUNa-_BegiDdGNwgobVg3VkcIKG14V3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.100.49 waku 9578d47f9b957ce728037b4e4a48c497d5162d08983f75337c989452d3848a98
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 9578d47f9b95. Setting up logs at ./log/docker/node3_2026-02-03_04-40-00__26771a8c-f481-40ff-975d-3a588705bae6__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 41873
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:41873/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:41873/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.100.49/tcp/41874/p2p/16Uiu2HAkzVb8QdVzcVQm7WuRGz8vArS2TzbwJYBmF7H2jwALyoHL","/ip4/172.18.100.49/tcp/41875/ws/p2p/16Uiu2HAkzVb8QdVzcVQm7WuRGz8vArS2TzbwJYBmF7H2jwALyoHL"],"enrUri":"enr:-L24QNmNHVm7zm6Z2sV7vizLE3-kpL9xrSXcNqG8mE-ABjEoaZfnqxSX3C2L21NeU2I82-SE9tuKK18DogijUWlREiICgmlkgnY0gmlwhKwSZDGKbXVsdGlhZGRyc5YACASsEmQxBqOSAAoErBJkMQajk90DgnJzhQADAQAAiXNlY3AyNTZrMaECS0tFtPlCxOVNWGq5QViZzLpGas5Hfx-NTy8Do8_0ZzuDdGNwgqOSg3VkcIKjlIV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:34516/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.143.142/tcp/31326/p2p/16Uiu2HAmGpjkkBFoU4CM1SavjNAzD4jykgLTMezy1Md5LkchCnmT"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:41873/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.85.194/tcp/34517/p2p/16Uiu2HAmAhmZPkvQMYWXWZTkhyvxjnApckQb3YnTxrZUA71fA8Z5"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:31325/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:34516/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:41873/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:31325/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:31325/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:31325/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:31325/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:31325/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:31325/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:31325/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:31325/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:31325/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:31325/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:34516/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:34516/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:34516/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:34516/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:34516/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:34516/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:34516/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:34516/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:34516/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:34516/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:41873/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:41873/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:41873/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:41873/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:41873/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:41873/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:41873/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:41873/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:41873/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:41873/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.node.waku_node:waku_node.py:257 Restarting container with id 9a7b0e65a4bf
DEBUG  src.libs.common:common.py:47 Sleeping for 5 seconds
DEBUG  src.steps.store:store.py:211 Checking that peer wakuorg/nwaku:latest can find the stored messages
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:31325/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x9abf5469ddf5c9def757193d9b36081c667ef46610e459dffd4e199c63ce85c9"},{"messageHash":"0x2aee8bd276a94945b199a261068c1708b336e4ac87dce3921bb0c7cba79cd1ce"},{"messageHash":"0x88f4ea668fe82cf3016aeb7f297456cb3f98fa609cb529a9bf1f16b3eee6c1d3"},{"messageHash":"0x69b55084a0e4b7f2bed717fcb0fcc1c187246c42091a26f2cb9cbfcd90a322ee"},{"messageHash":"0xc8fc80c8bed763778fdcc4662f1f1aae3a1c8bdd4de57b190e08a6e9f0473e50"},{"messageHash":"0x40edf9d13fe04ed1b9c8316f295c1d21f187acf86e84ac78cee4ff1146d874cf"},{"messageHash":"0x51099c650c46987606177d9b6031a176c4098ac1cddc6685b65fabebb6c5199b"},{"messageHash":"0xae898f7636ed0c959d16e259a9bf5eccf447566c9c76d2a022645508352074ea"},{"messageHash":"0x8b34ca90fc332c7ac43bc664213a0f09737987cc7d6c6664cfb337ceada7462e"},{"messageHash":"0x4d0f508c642f93637cc4a027f3a648e66db34cd22f8d3d4138e38eaab46b5587"},{"messageHash":"0x43ee112de437da3788381eaefb4be7259b65425fd020bfb449cc08b9e4c691cf"},{"messageHash":"0xbcd66f47e681243bb3ff8c54a537bd47cf8da4234cd7b1b81831ff1e365f8d50"},{"messageHash":"0x938e310311d92e914b752658012c5a0e9196636359c947211b4d55223eb47c48"},{"messageHash":"0x6a8dfa6685ccd9805769f82796ab0239319cf724d356431bb6876e71930c9f86"},{"messageHash":"0x41814efbf62256042bc881026c617cc4ce47c6e75d3fc41aee3e9b146f79f54a"},{"messageHash":"0xbf1d3dcd768907f8a8dcd5b784b3c24ce1c8d18d369c24d2ff7047f6fa819bfe"},{"messageHash":"0xccf28bd800c0aa6e56b9ad98b24831d29f4b5dc99f347ed3ecc547753402d318"},{"messageHash":"0xeab857b5eac691e135b11962a84505a05faa1e29ab31143781d7119dcbed7a10"},{"messageHash":"0x169ee3789973cc765da26531ad0088d1d84ccf5981abade0743b59f753e4ef3d"},{"messageHash":"0x758a369dd59dd121482e3645ad9357e62d3baea9093fe8fb60a9bacfd371706b"},{"messageHash":"0x1254eaeb9d5c643f72f6510b405bdd768465178c63fa8e8dc60e2a177b75050a"},{"messageHash":"0xbc5f766373e580bc25decb20340776d2f55961274253e6dc92850d40df8b1ef0"},{"messageHash":"0x06fefd99ded4271cc6d55cfade7efdde86db328e2177dbca8b07eb4af6963bdb"},{"messageHash":"0x69d4bcc186b6b99553115a3c829492143b0acddf55582675fef29b8d826107e3"},{"messageHash":"0x272459c97f3aad01bc833ff4f204f54da21ce9e2d95828c8ef69a4aeb99cee5d"},{"messageHash":"0x6493b9c128ea6e892aa2d4f18e8fff191e58843755c4d4837c9837f7ae00c406"},{"messageHash":"0x807c5ca0bbec142a5e1a2e602ca444f8225477a0c9cd89e8ddba45092afe69dc"},{"messageHash":"0xfa5d21db86ae231c7065ee30e151a3084ceeddd874d1467461325ae8e48f3bcb"},{"messageHash":"0x7965aaae400af3c5080d6c907f7d607e06e9755fa70c9685412e69afdd782069"},{"messageHash":"0xa9252543f367144b50c7b88fc97b6058dcacbca64c906140d1737a4d21fcbc77"}]}'
DEBUG  src.steps.store:store.py:228 messages length is 30
DEBUG  src.steps.store:store.py:211 Checking that peer wakuorg/nwaku:latest can find the stored messages
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:34516/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"requestId":"53bd05bc0b929f3dd3ee","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x9abf5469ddf5c9def757193d9b36081c667ef46610e459dffd4e199c63ce85c9"},{"messageHash":"0x2aee8bd276a94945b199a261068c1708b336e4ac87dce3921bb0c7cba79cd1ce"},{"messageHash":"0x88f4ea668fe82cf3016aeb7f297456cb3f98fa609cb529a9bf1f16b3eee6c1d3"},{"messageHash":"0x69b55084a0e4b7f2bed717fcb0fcc1c187246c42091a26f2cb9cbfcd90a322ee"},{"messageHash":"0xc8fc80c8bed763778fdcc4662f1f1aae3a1c8bdd4de57b190e08a6e9f0473e50"},{"messageHash":"0x40edf9d13fe04ed1b9c8316f295c1d21f187acf86e84ac78cee4ff1146d874cf"},{"messageHash":"0x51099c650c46987606177d9b6031a176c4098ac1cddc6685b65fabebb6c5199b"},{"messageHash":"0xae898f7636ed0c959d16e259a9bf5eccf447566c9c76d2a022645508352074ea"},{"messageHash":"0x8b34ca90fc332c7ac43bc664213a0f09737987cc7d6c6664cfb337ceada7462e"},{"messageHash":"0x4d0f508c642f93637cc4a027f3a648e66db34cd22f8d3d4138e38eaab46b5587"},{"messageHash":"0x43ee112de437da3788381eaefb4be7259b65425fd020bfb449cc08b9e4c691cf"},{"messageHash":"0xbcd66f47e681243bb3ff8c54a537bd47cf8da4234cd7b1b81831ff1e365f8d50"},{"messageHash":"0x938e310311d92e914b752658012c5a0e9196636359c947211b4d55223eb47c48"},{"messageHash":"0x6a8dfa6685ccd9805769f82796ab0239319cf724d356431bb6876e71930c9f86"},{"messageHash":"0x41814efbf62256042bc881026c617cc4ce47c6e75d3fc41aee3e9b146f79f54a"},{"messageHash":"0xbf1d3dcd768907f8a8dcd5b784b3c24ce1c8d18d369c24d2ff7047f6fa819bfe"},{"messageHash":"0xccf28bd800c0aa6e56b9ad98b24831d29f4b5dc99f347ed3ecc547753402d318"},{"messageHash":"0xeab857b5eac691e135b11962a84505a05faa1e29ab31143781d7119dcbed7a10"},{"messageHash":"0x169ee3789973cc765da26531ad0088d1d84ccf5981abade0743b59f753e4ef3d"},{"messageHash":"0x758a369dd59dd121482e3645ad9357e62d3baea9093fe8fb60a9bacfd371706b"},{"messageHash":"0x1254eaeb9d5c643f72f6510b405bdd768465178c63fa8e8dc60e2a177b75050a"},{"messageHash":"0xbc5f766373e580bc25decb20340776d2f55961274253e6dc92850d40df8b1ef0"},{"messageHash":"0x06fefd99ded4271cc6d55cfade7efdde86db328e2177dbca8b07eb4af6963bdb"},{"messageHash":"0x69d4bcc186b6b99553115a3c829492143b0acddf55582675fef29b8d826107e3"},{"messageHash":"0x272459c97f3aad01bc833ff4f204f54da21ce9e2d95828c8ef69a4aeb99cee5d"},{"messageHash":"0x6493b9c128ea6e892aa2d4f18e8fff191e58843755c4d4837c9837f7ae00c406"},{"messageHash":"0x807c5ca0bbec142a5e1a2e602ca444f8225477a0c9cd89e8ddba45092afe69dc"},{"messageHash":"0xfa5d21db86ae231c7065ee30e151a3084ceeddd874d1467461325ae8e48f3bcb"},{"messageHash":"0x7965aaae400af3c5080d6c907f7d607e06e9755fa70c9685412e69afdd782069"},{"messageHash":"0xa9252543f367144b50c7b88fc97b6058dcacbca64c906140d1737a4d21fcbc77"}]}'
DEBUG  src.steps.store:store.py:228 messages length is 30
DEBUG  src.steps.store:store.py:211 Checking that peer wakuorg/nwaku:latest can find the stored messages
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:41873/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
ERROR  src.node.api_clients.base_client:base_client.py:16 HTTP error occurred: 412 Client Error: Precondition Failed for url: http://127.0.0.1:41873/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true. Response content: b'No suitable service peer & none discovered'
DEBUG  tests.conftest:conftest.py:59 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:83 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 5e7ebe07c733
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 9a7b0e65a4bf
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 9578d47f9b95
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 5e7ebe07c733. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  tests.conftest:conftest.py:98 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  tests.conftest:conftest.py:73 Running fixture teardown: attach_logs_on_fail
DEBUG  tests.conftest:conftest.py:74 Test failed, attempting to attach logs to the allure reports
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/node3_2026-02-03_04-40-00__26771a8c-f481-40ff-975d-3a588705bae6__wakuorg_nwaku:latest.log
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/node1_2026-02-03_04-40-00__26771a8c-f481-40ff-975d-3a588705bae6__wakuorg_nwaku:latest.log
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/node2_2026-02-03_04-40-00__26771a8c-f481-40ff-975d-3a588705bae6__wakuorg_nwaku:latest.log
DEBUG  tests.conftest:conftest.py:51 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:57 Running test: test_sync_with_nodes_restart__case2 with id: 2026-02-03_04-40-12__30cc0a78-4810-4bd1-b067-3d1fd03f3a7b
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node1_2026-02-03_04-40-12__30cc0a78-4810-4bd1-b067-3d1fd03f3a7b__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node2_2026-02-03_04-40-12__30cc0a78-4810-4bd1-b067-3d1fd03f3a7b__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node3_2026-02-03_04-40-12__30cc0a78-4810-4bd1-b067-3d1fd03f3a7b__wakuorg_nwaku:latest.log
DEBUG  src.steps.store:store.py:31 Running fixture setup: store_setup
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.25.174
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['45628', '45629', '45630', '45631', '45632']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 45628:45628 -p 45629:45629 -p 45630:45630 -p 45631:45631 -p 45632:45632 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=45630 --rest-port=45628 --tcp-port=45629 --discv5-udp-port=45631 --rest-address=0.0.0.0 --nat=extip:172.18.25.174 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=e44d1fdb63dbc1dac9e2fab4aae50eefffb2ccd76a3120dca91d5c3cabc745e4 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=45632 --metrics-logging=true --store=true --relay=true
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 9a7b0e65a4bf. Exiting log stream.
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.25.174 waku 095045eb65dd6b162e71184516124ddfbd7c6059a6ace311780a12d49b06e23b
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 095045eb65dd. Setting up logs at ./log/docker/node1_2026-02-03_04-40-12__30cc0a78-4810-4bd1-b067-3d1fd03f3a7b__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 45628
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 9578d47f9b95. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:45628/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:45628/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.25.174/tcp/45629/p2p/16Uiu2HAm1acFz7P5QKJPK8wiqhRTz98eDNMvKfxUQmbizLnsG8M1","/ip4/172.18.25.174/tcp/45630/ws/p2p/16Uiu2HAm1acFz7P5QKJPK8wiqhRTz98eDNMvKfxUQmbizLnsG8M1"],"enrUri":"enr:-L24QN4QZZydGXma1XYK5i_28H1cgr_tJ9VLe4d82Xxz0CEqa2UHH2uY-jhrxV4FAiEaLIyiJmF2aSYEz1zejrmr2bMCgmlkgnY0gmlwhKwSGa6KbXVsdGlhZGRyc5YACASsEhmuBrI9AAoErBIZrgayPt0DgnJzhQADAQAAiXNlY3AyNTZrMaECW3AkRYRPSBcnJgmLXjoH_CoUnu98jU-Ukp3OjdwKZVyDdGNwgrI9g3VkcIKyP4V3YWt1MgM"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.207.254
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['17458', '17459', '17460', '17461', '17462']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 17458:17458 -p 17459:17459 -p 17460:17460 -p 17461:17461 -p 17462:17462 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=17460 --rest-port=17458 --tcp-port=17459 --discv5-udp-port=17461 --rest-address=0.0.0.0 --nat=extip:172.18.207.254 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=db4fbb4949ea2d7a6c9877ba29b9befe4cbd7edbc2e040c73d05d0fd3d3a0204 --store-sync=true --store=false --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=17462 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QN4QZZydGXma1XYK5i_28H1cgr_tJ9VLe4d82Xxz0CEqa2UHH2uY-jhrxV4FAiEaLIyiJmF2aSYEz1zejrmr2bMCgmlkgnY0gmlwhKwSGa6KbXVsdGlhZGRyc5YACASsEhmuBrI9AAoErBIZrgayPt0DgnJzhQADAQAAiXNlY3AyNTZrMaECW3AkRYRPSBcnJgmLXjoH_CoUnu98jU-Ukp3OjdwKZVyDdGNwgrI9g3VkcIKyP4V3YWt1MgM
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.207.254 waku 0d0089585f5cfa53855303a4ad45c9a967b459d00b88a7dbf2324b868db69d4e
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 0d0089585f5c. Setting up logs at ./log/docker/node2_2026-02-03_04-40-12__30cc0a78-4810-4bd1-b067-3d1fd03f3a7b__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 17458
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:17458/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:17458/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.207.254/tcp/17459/p2p/16Uiu2HAm9sSDjMigKHCCGbW6k3Y3LnecoARA6Lhwk74Ld5nWpzCv","/ip4/172.18.207.254/tcp/17460/ws/p2p/16Uiu2HAm9sSDjMigKHCCGbW6k3Y3LnecoARA6Lhwk74Ld5nWpzCv"],"enrUri":"enr:-L24QCEHEPtuYTe7vptBPI96CTOT5FfGozCad9AfOQF0b1CAXhXyOr5ypTY75QlH1OmXwvWuTtBn-q40o2MxiQI5gqECgmlkgnY0gmlwhKwSz_6KbXVsdGlhZGRyc5YACASsEs_-BkQzAAoErBLP_gZENN0DgnJzhQADAQAAiXNlY3AyNTZrMaEC1p0o7P_Fc9DTpC2N1W_qmv8nGM7j0q1If6LM5PtfCP-DdGNwgkQzg3VkcIJENYV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.64.147
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['30605', '30606', '30607', '30608', '30609']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 30605:30605 -p 30606:30606 -p 30607:30607 -p 30608:30608 -p 30609:30609 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=30607 --rest-port=30605 --tcp-port=30606 --discv5-udp-port=30608 --rest-address=0.0.0.0 --nat=extip:172.18.64.147 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=3159b02cc4d2df2eadeed7c84b9fd905ebdfdad1eccdf0cd6d6ba672f1f6070d --store-sync=true --store=false --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=30609 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QCEHEPtuYTe7vptBPI96CTOT5FfGozCad9AfOQF0b1CAXhXyOr5ypTY75QlH1OmXwvWuTtBn-q40o2MxiQI5gqECgmlkgnY0gmlwhKwSz_6KbXVsdGlhZGRyc5YACASsEs_-BkQzAAoErBLP_gZENN0DgnJzhQADAQAAiXNlY3AyNTZrMaEC1p0o7P_Fc9DTpC2N1W_qmv8nGM7j0q1If6LM5PtfCP-DdGNwgkQzg3VkcIJENYV3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.64.147 waku cdc256d095fcce3eadf6e449773b755c38ec12cc85ec9a81b4f7d8f58153d10f
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID cdc256d095fc. Setting up logs at ./log/docker/node3_2026-02-03_04-40-12__30cc0a78-4810-4bd1-b067-3d1fd03f3a7b__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 30605
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:30605/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:30605/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.64.147/tcp/30606/p2p/16Uiu2HAmAG89T5eg2JVu8UAjeGBhhQipg9qCLB6huTdS1eU95sTX","/ip4/172.18.64.147/tcp/30607/ws/p2p/16Uiu2HAmAG89T5eg2JVu8UAjeGBhhQipg9qCLB6huTdS1eU95sTX"],"enrUri":"enr:-L24QJW111T4uwsKcOmPWjSIohWovfauluGxZYOJvxGICBdOTKFfr3OlIo4kL6KhjNTpxAzzErv_H7EOdgBjDImGHbwCgmlkgnY0gmlwhKwSQJOKbXVsdGlhZGRyc5YACASsEkCTBneOAAoErBJAkwZ3j90DgnJzhQADAQAAiXNlY3AyNTZrMaEC3G0VFYRtK6K8wncNEzed5DaCPKa_iaogxH2oQtbTYEqDdGNwgneOg3VkcIJ3kIV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:17458/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.25.174/tcp/45629/p2p/16Uiu2HAm1acFz7P5QKJPK8wiqhRTz98eDNMvKfxUQmbizLnsG8M1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:30605/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.207.254/tcp/17459/p2p/16Uiu2HAm9sSDjMigKHCCGbW6k3Y3LnecoARA6Lhwk74Ld5nWpzCv"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:45628/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:17458/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:30605/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:45628/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:45628/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:45628/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:45628/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:45628/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:45628/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:45628/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:45628/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:45628/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:45628/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:17458/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:17458/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:17458/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:17458/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:17458/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:17458/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:17458/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:17458/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:17458/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:17458/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:30605/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:30605/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:30605/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:30605/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:30605/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:30605/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:30605/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:30605/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:30605/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:30605/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.01 seconds
DEBUG  src.node.waku_node:waku_node.py:257 Restarting container with id 0d0089585f5c
DEBUG  src.libs.common:common.py:47 Sleeping for 5 seconds
DEBUG  src.steps.store:store.py:211 Checking that peer wakuorg/nwaku:latest can find the stored messages
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:45628/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x3dbde3134dab968d81bce955e8b9db088c7fdc21b39a3a696e79574e894f2c18"},{"messageHash":"0x8c7fc980bdbb7c7650bc2fb3215c2a24f18f872c99efd61b20e32d6d3e50b792"},{"messageHash":"0x269682067a9b221d0bc7a530f85e4be2306727d768daeb140a36f404c887dc2f"},{"messageHash":"0xb09a074bc44c0da7058aab5f0af67876e062abc8bbd068b62e0149956a527af8"},{"messageHash":"0x996827357405042ef638e7bd844d9058200801b375f328087665a4b10cb9ced4"},{"messageHash":"0x7c4e57cf93d2d7f61b44dcad0226458e8ebfcf21a1f0ecb96dd11774f0679f25"},{"messageHash":"0x54fb98095d41a00834334c0eae277acb9f2d2315ab06d1518200466194cb1064"},{"messageHash":"0x2ea523c19a6d79cfaccfa696cb718ccce7042781174c41d942ce1e5be151c1a3"},{"messageHash":"0x6e61f32578622a1ef918e37e4f1e807de1a8ecd161dd93ad075d7dd63aaf08d1"},{"messageHash":"0x4f74734dc70b8840bce4adc43be8458d323a8aa387d922d02b34c049286efd54"},{"messageHash":"0x9278dcb52d2aef2ab5e82d710c37a54d3b2591f8cef3be0f32a097b6db94bbe7"},{"messageHash":"0x1d953a53a557ea1f04017a4a28f9086e0e7fae231cb4a7c398c38da50ef2e57c"},{"messageHash":"0x654dc7249db677c63f77212f6699d873a9b8f2f50baef8aaf09d5af51ed9e763"},{"messageHash":"0xb64542abc0411c3c326d99ee2e0e04854413d2196bde50218333c5d263bac713"},{"messageHash":"0x2d421515f56de503a6c0eff92d81e7d166604bbdaf6761b9092209299444cec9"},{"messageHash":"0x350043f75c3de0d18ab83b2466064f76f6bd093267c89b61e56514f5222ebb5d"},{"messageHash":"0x52942a2fcb7b8c9f841ae279ccb19932c70029ff86f18d102c85ca7e81c041fc"},{"messageHash":"0xc1fb835fde2fc7ad4932e4fe6772b07da892acb7a2deaa34dfc1a898b647b3c4"},{"messageHash":"0x915d15e9ec98c3c6d3c9fdb244f1a37c69cb7ab5f05294d4a815dcf68794f1d3"},{"messageHash":"0x5706a1fa9f2b2656bb13fa40676300e76d6d304999b9ea70d25cf9561386bc01"},{"messageHash":"0x1f72bdd7c7146cbb4b4f76a4e7d4f10aca0bec0824153096b55eaec91bc28562"},{"messageHash":"0x03c45910be0788dce97566ffe713a51fd41353eaccf320c190566b163ade0630"},{"messageHash":"0xec2c0e79fac3ce5f9c3a019ed977ed3d87668df4ec89f0fc38e841880e69d07c"},{"messageHash":"0x9a7945b4d494f7169c83d16b9aef58e2cc64b4964f920a8487ae3e2f657d37a2"},{"messageHash":"0x5077c0d3fe88ecc4ae34881935943a3be35028f1b9abe50525a08fe94f39f5f5"},{"messageHash":"0x05406cd1614009bd028868fde973731b10a4a1d19c6fcfc1490375ff3060770b"},{"messageHash":"0x2b5345569f67e00923172669f54d7a66c5a216edb21725edeed8b37ba8e9dd5f"},{"messageHash":"0x3e95842c06d30630f61b3b59d0fbfe4e30a923ddb5f80ef982bbc82d6f7fd8b1"},{"messageHash":"0x3d7c10530b932b3aa69eeb284e098285477ddf6fdf852c9e97e1890fa345295e"},{"messageHash":"0x6ab9cc6bbab3e7503a2a4566a329c835aa96b8f343621d9eacc01241b586bd70"}]}'
DEBUG  src.steps.store:store.py:228 messages length is 30
DEBUG  src.steps.store:store.py:211 Checking that peer wakuorg/nwaku:latest can find the stored messages
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:17458/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"requestId":"df622bb15125ce2b5521","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x3dbde3134dab968d81bce955e8b9db088c7fdc21b39a3a696e79574e894f2c18"},{"messageHash":"0x8c7fc980bdbb7c7650bc2fb3215c2a24f18f872c99efd61b20e32d6d3e50b792"},{"messageHash":"0x269682067a9b221d0bc7a530f85e4be2306727d768daeb140a36f404c887dc2f"},{"messageHash":"0xb09a074bc44c0da7058aab5f0af67876e062abc8bbd068b62e0149956a527af8"},{"messageHash":"0x996827357405042ef638e7bd844d9058200801b375f328087665a4b10cb9ced4"},{"messageHash":"0x7c4e57cf93d2d7f61b44dcad0226458e8ebfcf21a1f0ecb96dd11774f0679f25"},{"messageHash":"0x54fb98095d41a00834334c0eae277acb9f2d2315ab06d1518200466194cb1064"},{"messageHash":"0x2ea523c19a6d79cfaccfa696cb718ccce7042781174c41d942ce1e5be151c1a3"},{"messageHash":"0x6e61f32578622a1ef918e37e4f1e807de1a8ecd161dd93ad075d7dd63aaf08d1"},{"messageHash":"0x4f74734dc70b8840bce4adc43be8458d323a8aa387d922d02b34c049286efd54"},{"messageHash":"0x9278dcb52d2aef2ab5e82d710c37a54d3b2591f8cef3be0f32a097b6db94bbe7"},{"messageHash":"0x1d953a53a557ea1f04017a4a28f9086e0e7fae231cb4a7c398c38da50ef2e57c"},{"messageHash":"0x654dc7249db677c63f77212f6699d873a9b8f2f50baef8aaf09d5af51ed9e763"},{"messageHash":"0xb64542abc0411c3c326d99ee2e0e04854413d2196bde50218333c5d263bac713"},{"messageHash":"0x2d421515f56de503a6c0eff92d81e7d166604bbdaf6761b9092209299444cec9"},{"messageHash":"0x350043f75c3de0d18ab83b2466064f76f6bd093267c89b61e56514f5222ebb5d"},{"messageHash":"0x52942a2fcb7b8c9f841ae279ccb19932c70029ff86f18d102c85ca7e81c041fc"},{"messageHash":"0xc1fb835fde2fc7ad4932e4fe6772b07da892acb7a2deaa34dfc1a898b647b3c4"},{"messageHash":"0x915d15e9ec98c3c6d3c9fdb244f1a37c69cb7ab5f05294d4a815dcf68794f1d3"},{"messageHash":"0x5706a1fa9f2b2656bb13fa40676300e76d6d304999b9ea70d25cf9561386bc01"},{"messageHash":"0x1f72bdd7c7146cbb4b4f76a4e7d4f10aca0bec0824153096b55eaec91bc28562"},{"messageHash":"0x03c45910be0788dce97566ffe713a51fd41353eaccf320c190566b163ade0630"},{"messageHash":"0xec2c0e79fac3ce5f9c3a019ed977ed3d87668df4ec89f0fc38e841880e69d07c"},{"messageHash":"0x9a7945b4d494f7169c83d16b9aef58e2cc64b4964f920a8487ae3e2f657d37a2"},{"messageHash":"0x5077c0d3fe88ecc4ae34881935943a3be35028f1b9abe50525a08fe94f39f5f5"},{"messageHash":"0x05406cd1614009bd028868fde973731b10a4a1d19c6fcfc1490375ff3060770b"},{"messageHash":"0x2b5345569f67e00923172669f54d7a66c5a216edb21725edeed8b37ba8e9dd5f"},{"messageHash":"0x3e95842c06d30630f61b3b59d0fbfe4e30a923ddb5f80ef982bbc82d6f7fd8b1"},{"messageHash":"0x3d7c10530b932b3aa69eeb284e098285477ddf6fdf852c9e97e1890fa345295e"},{"messageHash":"0x6ab9cc6bbab3e7503a2a4566a329c835aa96b8f343621d9eacc01241b586bd70"}]}'
DEBUG  src.steps.store:store.py:228 messages length is 30
DEBUG  src.steps.store:store.py:211 Checking that peer wakuorg/nwaku:latest can find the stored messages
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:30605/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"requestId":"cb0211ec1e78dea2838f","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x3dbde3134dab968d81bce955e8b9db088c7fdc21b39a3a696e79574e894f2c18"},{"messageHash":"0x8c7fc980bdbb7c7650bc2fb3215c2a24f18f872c99efd61b20e32d6d3e50b792"},{"messageHash":"0x269682067a9b221d0bc7a530f85e4be2306727d768daeb140a36f404c887dc2f"},{"messageHash":"0xb09a074bc44c0da7058aab5f0af67876e062abc8bbd068b62e0149956a527af8"},{"messageHash":"0x996827357405042ef638e7bd844d9058200801b375f328087665a4b10cb9ced4"},{"messageHash":"0x7c4e57cf93d2d7f61b44dcad0226458e8ebfcf21a1f0ecb96dd11774f0679f25"},{"messageHash":"0x54fb98095d41a00834334c0eae277acb9f2d2315ab06d1518200466194cb1064"},{"messageHash":"0x2ea523c19a6d79cfaccfa696cb718ccce7042781174c41d942ce1e5be151c1a3"},{"messageHash":"0x6e61f32578622a1ef918e37e4f1e807de1a8ecd161dd93ad075d7dd63aaf08d1"},{"messageHash":"0x4f74734dc70b8840bce4adc43be8458d323a8aa387d922d02b34c049286efd54"},{"messageHash":"0x9278dcb52d2aef2ab5e82d710c37a54d3b2591f8cef3be0f32a097b6db94bbe7"},{"messageHash":"0x1d953a53a557ea1f04017a4a28f9086e0e7fae231cb4a7c398c38da50ef2e57c"},{"messageHash":"0x654dc7249db677c63f77212f6699d873a9b8f2f50baef8aaf09d5af51ed9e763"},{"messageHash":"0xb64542abc0411c3c326d99ee2e0e04854413d2196bde50218333c5d263bac713"},{"messageHash":"0x2d421515f56de503a6c0eff92d81e7d166604bbdaf6761b9092209299444cec9"},{"messageHash":"0x350043f75c3de0d18ab83b2466064f76f6bd093267c89b61e56514f5222ebb5d"},{"messageHash":"0x52942a2fcb7b8c9f841ae279ccb19932c70029ff86f18d102c85ca7e81c041fc"},{"messageHash":"0xc1fb835fde2fc7ad4932e4fe6772b07da892acb7a2deaa34dfc1a898b647b3c4"},{"messageHash":"0x915d15e9ec98c3c6d3c9fdb244f1a37c69cb7ab5f05294d4a815dcf68794f1d3"},{"messageHash":"0x5706a1fa9f2b2656bb13fa40676300e76d6d304999b9ea70d25cf9561386bc01"},{"messageHash":"0x1f72bdd7c7146cbb4b4f76a4e7d4f10aca0bec0824153096b55eaec91bc28562"},{"messageHash":"0x03c45910be0788dce97566ffe713a51fd41353eaccf320c190566b163ade0630"},{"messageHash":"0xec2c0e79fac3ce5f9c3a019ed977ed3d87668df4ec89f0fc38e841880e69d07c"},{"messageHash":"0x9a7945b4d494f7169c83d16b9aef58e2cc64b4964f920a8487ae3e2f657d37a2"},{"messageHash":"0x5077c0d3fe88ecc4ae34881935943a3be35028f1b9abe50525a08fe94f39f5f5"},{"messageHash":"0x05406cd1614009bd028868fde973731b10a4a1d19c6fcfc1490375ff3060770b"},{"messageHash":"0x2b5345569f67e00923172669f54d7a66c5a216edb21725edeed8b37ba8e9dd5f"},{"messageHash":"0x3e95842c06d30630f61b3b59d0fbfe4e30a923ddb5f80ef982bbc82d6f7fd8b1"},{"messageHash":"0x3d7c10530b932b3aa69eeb284e098285477ddf6fdf852c9e97e1890fa345295e"},{"messageHash":"0x6ab9cc6bbab3e7503a2a4566a329c835aa96b8f343621d9eacc01241b586bd70"}]}'
DEBUG  src.steps.store:store.py:228 messages length is 30
DEBUG  tests.conftest:conftest.py:59 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:83 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 095045eb65dd
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 0d0089585f5c
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id cdc256d095fc
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 095045eb65dd. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  tests.conftest:conftest.py:98 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.