229 lines
43 KiB
Plaintext

2026-03-19 04:40:32.722 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-19 04:40:32.722 DEBUG [tests.conftest] Running test: test_sync_with_nodes_restart__case1 with id: 2026-03-19_04-40-32__7a1a302f-d793-4e2c-af04-db375fc7c2de
2026-03-19 04:40:32.723 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-19 04:40:32.729 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-19 04:40:32.729 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-19_04-40-32__7a1a302f-d793-4e2c-af04-db375fc7c2de__wakuorg_nwaku:latest.log
2026-03-19 04:40:32.734 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-19 04:40:32.734 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-19_04-40-32__7a1a302f-d793-4e2c-af04-db375fc7c2de__wakuorg_nwaku:latest.log
2026-03-19 04:40:32.739 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-19 04:40:32.739 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-19_04-40-32__7a1a302f-d793-4e2c-af04-db375fc7c2de__wakuorg_nwaku:latest.log
2026-03-19 04:40:32.740 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-19 04:40:32.740 DEBUG [src.node.waku_node] Starting Node...
2026-03-19 04:40:32.740 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-19 04:40:32.742 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-19 04:40:32.742 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.232.243
2026-03-19 04:40:32.742 DEBUG [src.node.docker_mananger] Generated ports ['43900', '43901', '43902', '43903', '43904']
2026-03-19 04:40:32.742 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-19 04:40:32.742 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-19 04:40:32.742 DEBUG [src.node.waku_node] Using volumes []
2026-03-19 04:40:32.743 DEBUG [src.node.docker_mananger] docker run -i -t -p 43900:43900 -p 43901:43901 -p 43902:43902 -p 43903:43903 -p 43904:43904 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=43902 --rest-port=43900 --tcp-port=43901 --discv5-udp-port=43903 --rest-address=0.0.0.0 --nat=extip:172.18.232.243 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=de1755fe70fbd397956ddd7ccc6e97aebb37ffae7dab3ed6c1d0efef67abbf4b --store-sync=true --store=true --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=43904 --metrics-logging=true --relay=true
2026-03-19 04:40:32.899 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.232.243 waku df2a58e2ce02dbc65834bf1f81401b73c10241dd8bd8fcb49cb706e0f9f37226
2026-03-19 04:40:32.927 DEBUG [src.node.docker_mananger] Container started with ID df2a58e2ce02. Setting up logs at ./log/docker/node1_2026-03-19_04-40-32__7a1a302f-d793-4e2c-af04-db375fc7c2de__wakuorg_nwaku:latest.log
2026-03-19 04:40:32.927 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 43900
2026-03-19 04:40:32.928 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-19 04:40:33.043 ERROR [src.node.docker_mananger] Max retries reached for container cd01bb9119f4. Exiting log stream.
2026-03-19 04:40:33.519 ERROR [src.node.docker_mananger] Max retries reached for container 8e45682dea26. Exiting log stream.
2026-03-19 04:40:33.929 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43900/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:40:33.932 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-19 04:40:33.932 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-19 04:40:33.932 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43900/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:40:33.935 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.232.243/tcp/43901/p2p/16Uiu2HAmHTh93VYc5W99DUJtjvYW8rYkZiekCaDHCajJhU7UBQCG","/ip4/172.18.232.243/tcp/43902/ws/p2p/16Uiu2HAmHTh93VYc5W99DUJtjvYW8rYkZiekCaDHCajJhU7UBQCG"],"enrUri":"enr:-L24QL72buyycbhxAhCKSwEMoz7XFiPvOZ8zHxCLffk8qlpbIb8nmnkP-G_Kg74d2PFPUnbX3F3wgj3ujhI5ml5vI-UCgmlkgnY0gmlwhKwS6POKbXVsdGlhZGRyc5YACASsEujzBqt9AAoErBLo8warft0DgnJzhQADAQAAiXNlY3AyNTZrMaEDR2WVxNFhw6E9vteImo-hOwbGgTwBOBwJCVv3cC_D9omDdGNwgqt9g3VkcIKrf4V3YWt1MhM"}'
2026-03-19 04:40:33.935 INFO [src.node.waku_node] REST service is ready !!
2026-03-19 04:40:33.935 DEBUG [src.node.waku_node] Starting Node...
2026-03-19 04:40:33.935 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-19 04:40:33.937 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-19 04:40:33.937 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.209.50
2026-03-19 04:40:33.937 DEBUG [src.node.docker_mananger] Generated ports ['26095', '26096', '26097', '26098', '26099']
2026-03-19 04:40:33.937 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-19 04:40:33.937 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-19 04:40:33.937 DEBUG [src.node.waku_node] Using volumes []
2026-03-19 04:40:33.937 DEBUG [src.node.docker_mananger] docker run -i -t -p 26095:26095 -p 26096:26096 -p 26097:26097 -p 26098:26098 -p 26099:26099 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=26097 --rest-port=26095 --tcp-port=26096 --discv5-udp-port=26098 --rest-address=0.0.0.0 --nat=extip:172.18.209.50 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=bde893129a8a1fd94aa6b6cc9c5017bab9ad925ffeb38b0cc28608fdfeb8fae0 --store-sync=true --store=true --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=26099 --metrics-logging=true --relay=true --storenode=/ip4/172.18.232.243/tcp/43901/p2p/16Uiu2HAmHTh93VYc5W99DUJtjvYW8rYkZiekCaDHCajJhU7UBQCG --discv5-bootstrap-node=enr:-L24QL72buyycbhxAhCKSwEMoz7XFiPvOZ8zHxCLffk8qlpbIb8nmnkP-G_Kg74d2PFPUnbX3F3wgj3ujhI5ml5vI-UCgmlkgnY0gmlwhKwS6POKbXVsdGlhZGRyc5YACASsEujzBqt9AAoErBLo8warft0DgnJzhQADAQAAiXNlY3AyNTZrMaEDR2WVxNFhw6E9vteImo-hOwbGgTwBOBwJCVv3cC_D9omDdGNwgqt9g3VkcIKrf4V3YWt1MhM
2026-03-19 04:40:34.089 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.209.50 waku eb8dbdc288d99378e86995ddd11c032045046f2a70eae0893494ed6cf7200007
2026-03-19 04:40:34.118 DEBUG [src.node.docker_mananger] Container started with ID eb8dbdc288d9. Setting up logs at ./log/docker/node2_2026-03-19_04-40-32__7a1a302f-d793-4e2c-af04-db375fc7c2de__wakuorg_nwaku:latest.log
2026-03-19 04:40:34.118 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 26095
2026-03-19 04:40:34.118 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-19 04:40:35.119 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26095/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:40:35.121 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-19 04:40:35.122 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-19 04:40:35.122 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26095/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:40:35.124 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.209.50/tcp/26096/p2p/16Uiu2HAmUreXEAN2b65xZvX1ySzKTmU7M4GHpGEMMxfN2GAZo7T4","/ip4/172.18.209.50/tcp/26097/ws/p2p/16Uiu2HAmUreXEAN2b65xZvX1ySzKTmU7M4GHpGEMMxfN2GAZo7T4"],"enrUri":"enr:-L24QFEFzcAi6sjZYCzgkGZ2bs58PcAftYMvvfVhYuA1nwBwCJuliujmx8UFkITdYGeO-DgWpohLhK6d2uFAyLyI274CgmlkgnY0gmlwhKwS0TKKbXVsdGlhZGRyc5YACASsEtEyBmXwAAoErBLRMgZl8d0DgnJzhQADAQAAiXNlY3AyNTZrMaED8LeKSkg_2cxUPZjPYxgeqFrT_qk5wykNKkADchaZAc-DdGNwgmXwg3VkcIJl8oV3YWt1MhM"}'
2026-03-19 04:40:35.124 INFO [src.node.waku_node] REST service is ready !!
2026-03-19 04:40:35.125 DEBUG [src.node.waku_node] Starting Node...
2026-03-19 04:40:35.125 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-19 04:40:35.126 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-19 04:40:35.126 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.224.15
2026-03-19 04:40:35.126 DEBUG [src.node.docker_mananger] Generated ports ['36753', '36754', '36755', '36756', '36757']
2026-03-19 04:40:35.127 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-19 04:40:35.127 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-19 04:40:35.127 DEBUG [src.node.waku_node] Using volumes []
2026-03-19 04:40:35.127 DEBUG [src.node.docker_mananger] docker run -i -t -p 36753:36753 -p 36754:36754 -p 36755:36755 -p 36756:36756 -p 36757:36757 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=36755 --rest-port=36753 --tcp-port=36754 --discv5-udp-port=36756 --rest-address=0.0.0.0 --nat=extip:172.18.224.15 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ddce583ce7bddb50aec0fc07dadcfd64dec104e73e6b821bbac8ba36bcfacf53 --store-sync=true --store=false --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=36757 --metrics-logging=true --relay=true --storenode=/ip4/172.18.209.50/tcp/26096/p2p/16Uiu2HAmUreXEAN2b65xZvX1ySzKTmU7M4GHpGEMMxfN2GAZo7T4 --discv5-bootstrap-node=enr:-L24QFEFzcAi6sjZYCzgkGZ2bs58PcAftYMvvfVhYuA1nwBwCJuliujmx8UFkITdYGeO-DgWpohLhK6d2uFAyLyI274CgmlkgnY0gmlwhKwS0TKKbXVsdGlhZGRyc5YACASsEtEyBmXwAAoErBLRMgZl8d0DgnJzhQADAQAAiXNlY3AyNTZrMaED8LeKSkg_2cxUPZjPYxgeqFrT_qk5wykNKkADchaZAc-DdGNwgmXwg3VkcIJl8oV3YWt1MhM
2026-03-19 04:40:35.283 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.224.15 waku 482b30ae7eeec5e24e96a770f6c17d7b09bfc1d40e6adb2844cfdacd4f16988f
2026-03-19 04:40:35.309 DEBUG [src.node.docker_mananger] Container started with ID 482b30ae7eee. Setting up logs at ./log/docker/node3_2026-03-19_04-40-32__7a1a302f-d793-4e2c-af04-db375fc7c2de__wakuorg_nwaku:latest.log
2026-03-19 04:40:35.309 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 36753
2026-03-19 04:40:35.310 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-19 04:40:36.310 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:36753/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:40:36.327 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-19 04:40:36.330 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-19 04:40:36.330 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:36753/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:40:36.345 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.224.15/tcp/36754/p2p/16Uiu2HAkuWJojoCsmUwaPU1eQF769LKEwvD29GdAWDuXbvZFnZk5","/ip4/172.18.224.15/tcp/36755/ws/p2p/16Uiu2HAkuWJojoCsmUwaPU1eQF769LKEwvD29GdAWDuXbvZFnZk5"],"enrUri":"enr:-L24QF0AE48kZpJSyR6nsk4GQedJBTF4GeS1GAzmII1-ESyfC_WKHPURGgGXbgkez6_gGnJE6mjAIQiCSQnW5bhCdUsCgmlkgnY0gmlwhKwS4A-KbXVsdGlhZGRyc5YACASsEuAPBo-SAAoErBLgDwaPk90DgnJzhQADAQAAiXNlY3AyNTZrMaECAS_2l62EQ8H-A4N_erTaQlRBYPXpRtEkiBeqgXWoEGqDdGNwgo-Sg3VkcIKPlIV3YWt1MgE"}'
2026-03-19 04:40:36.346 INFO [src.node.waku_node] REST service is ready !!
2026-03-19 04:40:36.346 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26095/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.232.243/tcp/43901/p2p/16Uiu2HAmHTh93VYc5W99DUJtjvYW8rYkZiekCaDHCajJhU7UBQCG"]'
2026-03-19 04:40:36.349 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.349 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:36753/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.209.50/tcp/26096/p2p/16Uiu2HAmUreXEAN2b65xZvX1ySzKTmU7M4GHpGEMMxfN2GAZo7T4"]'
2026-03-19 04:40:36.351 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.352 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43900/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-19 04:40:36.354 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.354 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26095/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-19 04:40:36.356 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.356 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:36753/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-19 04:40:36.358 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.359 DEBUG [src.steps.store] Relaying message
2026-03-19 04:40:36.359 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43900/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:40:36.364 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.364 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-19 04:40:36.374 DEBUG [src.steps.store] Relaying message
2026-03-19 04:40:36.375 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43900/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:40:36.380 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.380 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-19 04:40:36.391 DEBUG [src.steps.store] Relaying message
2026-03-19 04:40:36.391 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43900/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:40:36.397 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.397 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-19 04:40:36.408 DEBUG [src.steps.store] Relaying message
2026-03-19 04:40:36.409 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43900/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:40:36.413 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.414 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-19 04:40:36.426 DEBUG [src.steps.store] Relaying message
2026-03-19 04:40:36.426 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43900/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:40:36.432 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.432 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-19 04:40:36.442 DEBUG [src.steps.store] Relaying message
2026-03-19 04:40:36.443 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43900/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:40:36.447 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.447 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-19 04:40:36.458 DEBUG [src.steps.store] Relaying message
2026-03-19 04:40:36.458 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43900/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:40:36.463 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.463 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-19 04:40:36.474 DEBUG [src.steps.store] Relaying message
2026-03-19 04:40:36.474 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43900/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:40:36.480 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.481 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-19 04:40:36.492 DEBUG [src.steps.store] Relaying message
2026-03-19 04:40:36.492 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43900/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:40:36.500 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.501 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-19 04:40:36.512 DEBUG [src.steps.store] Relaying message
2026-03-19 04:40:36.512 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43900/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:40:36.517 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.518 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-19 04:40:36.528 DEBUG [src.steps.store] Relaying message
2026-03-19 04:40:36.528 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26095/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:40:36.534 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.535 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-19 04:40:36.546 DEBUG [src.steps.store] Relaying message
2026-03-19 04:40:36.546 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26095/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:40:36.553 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.554 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-19 04:40:36.564 DEBUG [src.steps.store] Relaying message
2026-03-19 04:40:36.564 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26095/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:40:36.572 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.573 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-19 04:40:36.584 DEBUG [src.steps.store] Relaying message
2026-03-19 04:40:36.584 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26095/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:40:36.592 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.592 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-19 04:40:36.603 DEBUG [src.steps.store] Relaying message
2026-03-19 04:40:36.603 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26095/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:40:36.609 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.609 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-19 04:40:36.619 DEBUG [src.steps.store] Relaying message
2026-03-19 04:40:36.620 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26095/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:40:36.625 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.626 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-19 04:40:36.637 DEBUG [src.steps.store] Relaying message
2026-03-19 04:40:36.638 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26095/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:40:36.645 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.646 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-19 04:40:36.656 DEBUG [src.steps.store] Relaying message
2026-03-19 04:40:36.657 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26095/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:40:36.663 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.663 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-19 04:40:36.674 DEBUG [src.steps.store] Relaying message
2026-03-19 04:40:36.675 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26095/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:40:36.680 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.681 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-19 04:40:36.691 DEBUG [src.steps.store] Relaying message
2026-03-19 04:40:36.692 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26095/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:40:36.699 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.699 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-19 04:40:36.710 DEBUG [src.steps.store] Relaying message
2026-03-19 04:40:36.711 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:36753/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:40:36.719 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.719 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-19 04:40:36.731 DEBUG [src.steps.store] Relaying message
2026-03-19 04:40:36.731 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:36753/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:40:36.739 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.741 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-19 04:40:36.752 DEBUG [src.steps.store] Relaying message
2026-03-19 04:40:36.752 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:36753/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:40:36.759 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.759 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-19 04:40:36.770 DEBUG [src.steps.store] Relaying message
2026-03-19 04:40:36.770 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:36753/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:40:36.777 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.779 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-19 04:40:36.789 DEBUG [src.steps.store] Relaying message
2026-03-19 04:40:36.790 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:36753/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:40:36.797 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.797 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-19 04:40:36.808 DEBUG [src.steps.store] Relaying message
2026-03-19 04:40:36.809 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:36753/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:40:36.815 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.815 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-19 04:40:36.826 DEBUG [src.steps.store] Relaying message
2026-03-19 04:40:36.826 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:36753/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:40:36.830 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.831 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-19 04:40:36.841 DEBUG [src.steps.store] Relaying message
2026-03-19 04:40:36.842 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:36753/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:40:36.846 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.847 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-19 04:40:36.858 DEBUG [src.steps.store] Relaying message
2026-03-19 04:40:36.858 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:36753/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:40:36.863 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.864 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-19 04:40:36.875 DEBUG [src.steps.store] Relaying message
2026-03-19 04:40:36.875 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:36753/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:40:36.880 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:36.880 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-19 04:40:36.891 DEBUG [src.node.waku_node] Restarting container with id df2a58e2ce02
2026-03-19 04:40:37.562 DEBUG [src.node.waku_node] Restarting container with id eb8dbdc288d9
2026-03-19 04:40:38.504 DEBUG [src.node.waku_node] Restarting container with id 482b30ae7eee
2026-03-19 04:40:39.150 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-19 04:40:41.151 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-19 04:40:41.152 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43900/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:40:41.156 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x494f192cea9308c6593c3a9f9ea4e3444589f4ea0efc91f3a4b77905792e86ec"},{"messageHash":"0x4390805164cd63ad978e882cc7435b16f80094775a776a6ffe795726efc5d781"},{"messageHash":"0x1ad627cf416007386c2470c96dc3839618ea4c1944415c980df2b49bb36c76d6"},{"messageHash":"0x08c5a429743506ec25c5f30ed03bd9412595a2eb0c0c73e369ffa69c9eeecb29"},{"messageHash":"0xd14604d82791466d60eae2693fabf8db3e096a5dc48b87ba93f5e06012d7aba0"},{"messageHash":"0x4224ce0c7455ecfbcbc969b5aef0292ca350faed06c067bb170b3e579d68d0e5"},{"messageHash":"0xcd92fb443f60e33f93dfa09d1a76a6b1e6683d1053c3762c0e8cdf84d6fc905e"},{"messageHash":"0x1395ab1f72b6dfcc75a38d26543ce0889d355c681256a423b91d512637612cd6"},{"messageHash":"0x50c4ab021039dbc8d8fa726bb1a64bf82c480f32da00021e7f0ae087b91a8411"},{"messageHash":"0xb5a622391e1a35285cba3edbbe6d42558ee018772a80590272b0c3d3365b9748"},{"messageHash":"0xcd52a32377bccde44c1d251afb718ea60a70aa2d1a71a64faebdf02a68c97f1b"},{"messageHash":"0x2c10c0972258753c4c178f601cdd7a42ad81dae606c59ce8a0eab64dfee55b43"},{"messageHash":"0x332b990465bbba533ed53d051c8afca9d386fcdeb0584d0ba46aa1e7ca4b5f95"},{"messageHash":"0xd62eb10f3fc4a5210c73a99cbf8f4854038c7c477f79ac6ca60eca08e3997207"},{"messageHash":"0x649ce2b8e26802093f043f73247e9d71e7810a9eda3ab47b73a229ec94f56fa3"},{"messageHash":"0x2815655974f3a40c50a5ab5a990f505e1411b3621bc08e9a0db0635242f87787"},{"messageHash":"0xd7cff8b08ece8bffe89f27cd5ae4b14315ccef185484f63b6090ed5beb33e6da"},{"messageHash":"0xafc7e2382388d7d27cfbaa8de9fa78d2f94e4b6ea321c46121466bb88f0cb9d9"},{"messageHash":"0x2b051186ee24ec903e5cbe250b21cbd8f19525f9ecfab7463f2759bd2b55f9a3"},{"messageHash":"0xe5c83eb112f71d71bfc9fbcf8b43ce3c5665f0c9a4c6d72672508d4893b70388"},{"messageHash":"0x57ed377a417a911b81ccebd9737187fdbac551b881505619a69b907eca7e9ee5"},{"messageHash":"0xe4107c6ca889cbac6a82e6598189b632a57b7a9fb67572a91c3251dd84cf0d3c"},{"messageHash":"0xbfebe554f2d7e54e3c300e7924bbbf170ff902ff64aea236dbaa2f255e4180b3"},{"messageHash":"0x1c75faa247c7caa029c7e6e6ea15e144c571fea6fe69141cab54bca0a0833ff0"},{"messageHash":"0xd92643c194fdbd79fc3838e8577f1ea9cb5148f34e7d7cb84184c9132d57495b"},{"messageHash":"0x11926b0750b3bdea989b991208480134dbd18d63fd293fb4a08a8ce79bfd53d1"},{"messageHash":"0x3f65538cd4c14841e7e99315e226db815ef1e3eeed72794575524bd3b7de755e"},{"messageHash":"0xaf01d1d7b19ff375eb77943ca69c23e06c834e72989aecbc72ac136aad2ff1dd"},{"messageHash":"0x7425d4d92b1be0aee94474a7c1c0c76bdd4807bfb198b4af0c29b56edb8258e4"},{"messageHash":"0xd5ff3bdc168e10253d1a5bb40ccfc23514c4d6b8629df3b07b5e45bb04ef6f34"}]}'
2026-03-19 04:40:41.156 DEBUG [src.steps.store] messages length is 30
2026-03-19 04:40:41.160 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-19 04:40:41.161 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26095/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:40:41.165 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x494f192cea9308c6593c3a9f9ea4e3444589f4ea0efc91f3a4b77905792e86ec"},{"messageHash":"0x4390805164cd63ad978e882cc7435b16f80094775a776a6ffe795726efc5d781"},{"messageHash":"0x1ad627cf416007386c2470c96dc3839618ea4c1944415c980df2b49bb36c76d6"},{"messageHash":"0x08c5a429743506ec25c5f30ed03bd9412595a2eb0c0c73e369ffa69c9eeecb29"},{"messageHash":"0xd14604d82791466d60eae2693fabf8db3e096a5dc48b87ba93f5e06012d7aba0"},{"messageHash":"0x4224ce0c7455ecfbcbc969b5aef0292ca350faed06c067bb170b3e579d68d0e5"},{"messageHash":"0xcd92fb443f60e33f93dfa09d1a76a6b1e6683d1053c3762c0e8cdf84d6fc905e"},{"messageHash":"0x1395ab1f72b6dfcc75a38d26543ce0889d355c681256a423b91d512637612cd6"},{"messageHash":"0x50c4ab021039dbc8d8fa726bb1a64bf82c480f32da00021e7f0ae087b91a8411"},{"messageHash":"0xb5a622391e1a35285cba3edbbe6d42558ee018772a80590272b0c3d3365b9748"},{"messageHash":"0xcd52a32377bccde44c1d251afb718ea60a70aa2d1a71a64faebdf02a68c97f1b"},{"messageHash":"0x2c10c0972258753c4c178f601cdd7a42ad81dae606c59ce8a0eab64dfee55b43"},{"messageHash":"0x332b990465bbba533ed53d051c8afca9d386fcdeb0584d0ba46aa1e7ca4b5f95"},{"messageHash":"0xd62eb10f3fc4a5210c73a99cbf8f4854038c7c477f79ac6ca60eca08e3997207"},{"messageHash":"0x649ce2b8e26802093f043f73247e9d71e7810a9eda3ab47b73a229ec94f56fa3"},{"messageHash":"0x2815655974f3a40c50a5ab5a990f505e1411b3621bc08e9a0db0635242f87787"},{"messageHash":"0xd7cff8b08ece8bffe89f27cd5ae4b14315ccef185484f63b6090ed5beb33e6da"},{"messageHash":"0xafc7e2382388d7d27cfbaa8de9fa78d2f94e4b6ea321c46121466bb88f0cb9d9"},{"messageHash":"0x2b051186ee24ec903e5cbe250b21cbd8f19525f9ecfab7463f2759bd2b55f9a3"},{"messageHash":"0xe5c83eb112f71d71bfc9fbcf8b43ce3c5665f0c9a4c6d72672508d4893b70388"},{"messageHash":"0x57ed377a417a911b81ccebd9737187fdbac551b881505619a69b907eca7e9ee5"},{"messageHash":"0xe4107c6ca889cbac6a82e6598189b632a57b7a9fb67572a91c3251dd84cf0d3c"},{"messageHash":"0xbfebe554f2d7e54e3c300e7924bbbf170ff902ff64aea236dbaa2f255e4180b3"},{"messageHash":"0x1c75faa247c7caa029c7e6e6ea15e144c571fea6fe69141cab54bca0a0833ff0"},{"messageHash":"0xd92643c194fdbd79fc3838e8577f1ea9cb5148f34e7d7cb84184c9132d57495b"},{"messageHash":"0x11926b0750b3bdea989b991208480134dbd18d63fd293fb4a08a8ce79bfd53d1"},{"messageHash":"0x3f65538cd4c14841e7e99315e226db815ef1e3eeed72794575524bd3b7de755e"},{"messageHash":"0xaf01d1d7b19ff375eb77943ca69c23e06c834e72989aecbc72ac136aad2ff1dd"},{"messageHash":"0x7425d4d92b1be0aee94474a7c1c0c76bdd4807bfb198b4af0c29b56edb8258e4"},{"messageHash":"0xd5ff3bdc168e10253d1a5bb40ccfc23514c4d6b8629df3b07b5e45bb04ef6f34"}]}'
2026-03-19 04:40:41.165 DEBUG [src.steps.store] messages length is 30
2026-03-19 04:40:41.169 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-19 04:40:41.169 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:36753/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:40:41.179 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"53c78ab2491217d84b3a","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x494f192cea9308c6593c3a9f9ea4e3444589f4ea0efc91f3a4b77905792e86ec"},{"messageHash":"0x4390805164cd63ad978e882cc7435b16f80094775a776a6ffe795726efc5d781"},{"messageHash":"0x1ad627cf416007386c2470c96dc3839618ea4c1944415c980df2b49bb36c76d6"},{"messageHash":"0x08c5a429743506ec25c5f30ed03bd9412595a2eb0c0c73e369ffa69c9eeecb29"},{"messageHash":"0xd14604d82791466d60eae2693fabf8db3e096a5dc48b87ba93f5e06012d7aba0"},{"messageHash":"0x4224ce0c7455ecfbcbc969b5aef0292ca350faed06c067bb170b3e579d68d0e5"},{"messageHash":"0xcd92fb443f60e33f93dfa09d1a76a6b1e6683d1053c3762c0e8cdf84d6fc905e"},{"messageHash":"0x1395ab1f72b6dfcc75a38d26543ce0889d355c681256a423b91d512637612cd6"},{"messageHash":"0x50c4ab021039dbc8d8fa726bb1a64bf82c480f32da00021e7f0ae087b91a8411"},{"messageHash":"0xb5a622391e1a35285cba3edbbe6d42558ee018772a80590272b0c3d3365b9748"},{"messageHash":"0xcd52a32377bccde44c1d251afb718ea60a70aa2d1a71a64faebdf02a68c97f1b"},{"messageHash":"0x2c10c0972258753c4c178f601cdd7a42ad81dae606c59ce8a0eab64dfee55b43"},{"messageHash":"0x332b990465bbba533ed53d051c8afca9d386fcdeb0584d0ba46aa1e7ca4b5f95"},{"messageHash":"0xd62eb10f3fc4a5210c73a99cbf8f4854038c7c477f79ac6ca60eca08e3997207"},{"messageHash":"0x649ce2b8e26802093f043f73247e9d71e7810a9eda3ab47b73a229ec94f56fa3"},{"messageHash":"0x2815655974f3a40c50a5ab5a990f505e1411b3621bc08e9a0db0635242f87787"},{"messageHash":"0xd7cff8b08ece8bffe89f27cd5ae4b14315ccef185484f63b6090ed5beb33e6da"},{"messageHash":"0xafc7e2382388d7d27cfbaa8de9fa78d2f94e4b6ea321c46121466bb88f0cb9d9"},{"messageHash":"0x2b051186ee24ec903e5cbe250b21cbd8f19525f9ecfab7463f2759bd2b55f9a3"},{"messageHash":"0xe5c83eb112f71d71bfc9fbcf8b43ce3c5665f0c9a4c6d72672508d4893b70388"},{"messageHash":"0x57ed377a417a911b81ccebd9737187fdbac551b881505619a69b907eca7e9ee5"},{"messageHash":"0xe4107c6ca889cbac6a82e6598189b632a57b7a9fb67572a91c3251dd84cf0d3c"},{"messageHash":"0xbfebe554f2d7e54e3c300e7924bbbf170ff902ff64aea236dbaa2f255e4180b3"},{"messageHash":"0x1c75faa247c7caa029c7e6e6ea15e144c571fea6fe69141cab54bca0a0833ff0"},{"messageHash":"0xd92643c194fdbd79fc3838e8577f1ea9cb5148f34e7d7cb84184c9132d57495b"},{"messageHash":"0x11926b0750b3bdea989b991208480134dbd18d63fd293fb4a08a8ce79bfd53d1"},{"messageHash":"0x3f65538cd4c14841e7e99315e226db815ef1e3eeed72794575524bd3b7de755e"},{"messageHash":"0xaf01d1d7b19ff375eb77943ca69c23e06c834e72989aecbc72ac136aad2ff1dd"},{"messageHash":"0x7425d4d92b1be0aee94474a7c1c0c76bdd4807bfb198b4af0c29b56edb8258e4"},{"messageHash":"0xd5ff3bdc168e10253d1a5bb40ccfc23514c4d6b8629df3b07b5e45bb04ef6f34"}]}'
2026-03-19 04:40:41.180 DEBUG [src.steps.store] messages length is 30
2026-03-19 04:40:41.183 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-19 04:40:41.184 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-19 04:40:41.184 DEBUG [src.node.waku_node] Stopping container with id df2a58e2ce02
2026-03-19 04:40:41.686 DEBUG [src.node.waku_node] Container stopped.
2026-03-19 04:40:41.688 DEBUG [src.node.waku_node] Stopping container with id eb8dbdc288d9
2026-03-19 04:40:42.186 DEBUG [src.node.waku_node] Container stopped.
2026-03-19 04:40:42.188 DEBUG [src.node.waku_node] Stopping container with id 482b30ae7eee
2026-03-19 04:40:42.500 ERROR [src.node.docker_mananger] Max retries reached for container df2a58e2ce02. Exiting log stream.
2026-03-19 04:40:42.672 DEBUG [src.node.waku_node] Container stopped.
2026-03-19 04:40:42.673 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-19 04:40:42.714 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-19 04:40:42.767 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-19 04:40:42.801 DEBUG [src.node.docker_mananger] No errors found in the waku logs.