229 lines
43 KiB
Plaintext

2026-03-16 04:53:51.366 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-16 04:53:51.366 DEBUG [tests.conftest] Running test: test_sync_with_nodes_restart__case1 with id: 2026-03-16_04-53-51__76b3254b-82a3-4ba9-84af-607c781c1981
2026-03-16 04:53:51.367 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-16 04:53:51.373 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:53:51.374 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-16_04-53-51__76b3254b-82a3-4ba9-84af-607c781c1981__wakuorg_nwaku:latest.log
2026-03-16 04:53:51.380 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:53:51.380 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-16_04-53-51__76b3254b-82a3-4ba9-84af-607c781c1981__wakuorg_nwaku:latest.log
2026-03-16 04:53:51.386 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:53:51.387 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-16_04-53-51__76b3254b-82a3-4ba9-84af-607c781c1981__wakuorg_nwaku:latest.log
2026-03-16 04:53:51.387 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-16 04:53:51.388 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:53:51.388 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:53:51.390 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:53:51.390 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.150.113
2026-03-16 04:53:51.390 DEBUG [src.node.docker_mananger] Generated ports ['35804', '35805', '35806', '35807', '35808']
2026-03-16 04:53:51.390 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:53:51.390 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:53:51.390 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:53:51.391 DEBUG [src.node.docker_mananger] docker run -i -t -p 35804:35804 -p 35805:35805 -p 35806:35806 -p 35807:35807 -p 35808:35808 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=35806 --rest-port=35804 --tcp-port=35805 --discv5-udp-port=35807 --rest-address=0.0.0.0 --nat=extip:172.18.150.113 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=32bd2dfb308ab0753fc3d97a2af86f76df8c6a913bbbce9417d3e013df005664 --store-sync=true --store=true --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=35808 --metrics-logging=true --relay=true
2026-03-16 04:53:51.588 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.150.113 waku 17241f19b2eaca994b862187340677d8ad80654af4c5107ee470da31f5aacf9d
2026-03-16 04:53:51.604 ERROR [src.node.docker_mananger] Max retries reached for container 7643c21c7285. Exiting log stream.
2026-03-16 04:53:51.626 DEBUG [src.node.docker_mananger] Container started with ID 17241f19b2ea. Setting up logs at ./log/docker/node1_2026-03-16_04-53-51__76b3254b-82a3-4ba9-84af-607c781c1981__wakuorg_nwaku:latest.log
2026-03-16 04:53:51.626 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 35804
2026-03-16 04:53:51.627 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:53:52.167 ERROR [src.node.docker_mananger] Max retries reached for container b4b1fc73bb93. Exiting log stream.
2026-03-16 04:53:52.629 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35804/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:53:52.631 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:53:52.632 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:53:52.632 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35804/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:53:52.634 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.150.113/tcp/35805/p2p/16Uiu2HAm2uXT3aj4WsVnHrms9Lp7eKY3pCWx2fMDzMPLGYtZNtWw","/ip4/172.18.150.113/tcp/35806/ws/p2p/16Uiu2HAm2uXT3aj4WsVnHrms9Lp7eKY3pCWx2fMDzMPLGYtZNtWw"],"enrUri":"enr:-L24QDLd9N0ICxGmNgNHPqImMPVHZJY7uMczVQT5VOzlkZQmDXt0EeyLAJyqN8kHsnATPIuuswrTI7Ud1yI8nHZqJiUCgmlkgnY0gmlwhKwSlnGKbXVsdGlhZGRyc5YACASsEpZxBovdAAoErBKWcQaL3t0DgnJzhQADAQAAiXNlY3AyNTZrMaECbyRtE2OmGRy_K7ktC42xAtQPCkBowCz-yCL2ll22gVyDdGNwgovdg3VkcIKL34V3YWt1MhM"}'
2026-03-16 04:53:52.634 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:53:52.635 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:53:52.635 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:53:52.636 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:53:52.636 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.13.136
2026-03-16 04:53:52.636 DEBUG [src.node.docker_mananger] Generated ports ['9121', '9122', '9123', '9124', '9125']
2026-03-16 04:53:52.637 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:53:52.637 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:53:52.637 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:53:52.637 DEBUG [src.node.docker_mananger] docker run -i -t -p 9121:9121 -p 9122:9122 -p 9123:9123 -p 9124:9124 -p 9125:9125 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=9123 --rest-port=9121 --tcp-port=9122 --discv5-udp-port=9124 --rest-address=0.0.0.0 --nat=extip:172.18.13.136 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=6f32df5f943ba18f105c4cceec5cfb4edc28efbce04cc2da7f8e55c49bcaeaf2 --store-sync=true --store=true --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=9125 --metrics-logging=true --relay=true --storenode=/ip4/172.18.150.113/tcp/35805/p2p/16Uiu2HAm2uXT3aj4WsVnHrms9Lp7eKY3pCWx2fMDzMPLGYtZNtWw --discv5-bootstrap-node=enr:-L24QDLd9N0ICxGmNgNHPqImMPVHZJY7uMczVQT5VOzlkZQmDXt0EeyLAJyqN8kHsnATPIuuswrTI7Ud1yI8nHZqJiUCgmlkgnY0gmlwhKwSlnGKbXVsdGlhZGRyc5YACASsEpZxBovdAAoErBKWcQaL3t0DgnJzhQADAQAAiXNlY3AyNTZrMaECbyRtE2OmGRy_K7ktC42xAtQPCkBowCz-yCL2ll22gVyDdGNwgovdg3VkcIKL34V3YWt1MhM
2026-03-16 04:53:52.829 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.13.136 waku 81b3dc65113712fff1264a54a033ffd380a3da53d488ec0b10834c4f5199aec4
2026-03-16 04:53:52.867 DEBUG [src.node.docker_mananger] Container started with ID 81b3dc651137. Setting up logs at ./log/docker/node2_2026-03-16_04-53-51__76b3254b-82a3-4ba9-84af-607c781c1981__wakuorg_nwaku:latest.log
2026-03-16 04:53:52.867 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 9121
2026-03-16 04:53:52.868 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:53:53.869 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9121/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:53:53.872 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:53:53.872 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:53:53.873 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9121/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:53:53.875 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.13.136/tcp/9122/p2p/16Uiu2HAm133hNK27sew4JfkBrkJfDztAFe3AKGBjNFcD3Hd5vYxQ","/ip4/172.18.13.136/tcp/9123/ws/p2p/16Uiu2HAm133hNK27sew4JfkBrkJfDztAFe3AKGBjNFcD3Hd5vYxQ"],"enrUri":"enr:-L24QGz9WYiQv9XJBHPe2QMVBZL1IO5ZjVUeDJcXZ38cFUXxKOS66absoYJJLPana2QAvMA5yivf5o-j-NMRvYNJz8YCgmlkgnY0gmlwhKwSDYiKbXVsdGlhZGRyc5YACASsEg2IBiOiAAoErBINiAYjo90DgnJzhQADAQAAiXNlY3AyNTZrMaECU1pRdtm5u_CBjG_owl-9bE0x6cE_9tdPxqlK1mszf_GDdGNwgiOig3VkcIIjpIV3YWt1MhM"}'
2026-03-16 04:53:53.875 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:53:53.875 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:53:53.876 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:53:53.877 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:53:53.877 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.155.16
2026-03-16 04:53:53.878 DEBUG [src.node.docker_mananger] Generated ports ['37480', '37481', '37482', '37483', '37484']
2026-03-16 04:53:53.878 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:53:53.878 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:53:53.878 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:53:53.878 DEBUG [src.node.docker_mananger] docker run -i -t -p 37480:37480 -p 37481:37481 -p 37482:37482 -p 37483:37483 -p 37484:37484 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=37482 --rest-port=37480 --tcp-port=37481 --discv5-udp-port=37483 --rest-address=0.0.0.0 --nat=extip:172.18.155.16 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=dbb16df5a5ea8d6b15ecaffaaffe95c4dbb6e816db901dfff4dbc9bc06a77983 --store-sync=true --store=false --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=37484 --metrics-logging=true --relay=true --storenode=/ip4/172.18.13.136/tcp/9122/p2p/16Uiu2HAm133hNK27sew4JfkBrkJfDztAFe3AKGBjNFcD3Hd5vYxQ --discv5-bootstrap-node=enr:-L24QGz9WYiQv9XJBHPe2QMVBZL1IO5ZjVUeDJcXZ38cFUXxKOS66absoYJJLPana2QAvMA5yivf5o-j-NMRvYNJz8YCgmlkgnY0gmlwhKwSDYiKbXVsdGlhZGRyc5YACASsEg2IBiOiAAoErBINiAYjo90DgnJzhQADAQAAiXNlY3AyNTZrMaECU1pRdtm5u_CBjG_owl-9bE0x6cE_9tdPxqlK1mszf_GDdGNwgiOig3VkcIIjpIV3YWt1MhM
2026-03-16 04:53:54.076 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.155.16 waku a5d2a2cfbda18200aecab416058d7c63dd15d7e194c26cddd7d29c8178a65456
2026-03-16 04:53:54.112 DEBUG [src.node.docker_mananger] Container started with ID a5d2a2cfbda1. Setting up logs at ./log/docker/node3_2026-03-16_04-53-51__76b3254b-82a3-4ba9-84af-607c781c1981__wakuorg_nwaku:latest.log
2026-03-16 04:53:54.113 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 37480
2026-03-16 04:53:54.113 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:53:55.114 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37480/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:53:55.137 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:53:55.140 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:53:55.142 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37480/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:53:55.148 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.155.16/tcp/37481/p2p/16Uiu2HAmJTqcsbkQRL81FtFg4w8eM7Hp7JSuGkBDxBUvFgwCCfbo","/ip4/172.18.155.16/tcp/37482/ws/p2p/16Uiu2HAmJTqcsbkQRL81FtFg4w8eM7Hp7JSuGkBDxBUvFgwCCfbo"],"enrUri":"enr:-L24QALMsy7u1-Qt0FHjSBsM2Lm553Rwht77zgFhchUNdv1Ef4d_UPXPfwLPVKv8NEhTaBpNaMgpK4T6J94r6ruPilUCgmlkgnY0gmlwhKwSmxCKbXVsdGlhZGRyc5YACASsEpsQBpJpAAoErBKbEAaSat0DgnJzhQADAQAAiXNlY3AyNTZrMaEDVkrcMOkh_58okIM32-S-7KnzbLiFLjoTHKGIboqYFCKDdGNwgpJpg3VkcIKSa4V3YWt1MgE"}'
2026-03-16 04:53:55.148 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:53:55.149 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:9121/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.150.113/tcp/35805/p2p/16Uiu2HAm2uXT3aj4WsVnHrms9Lp7eKY3pCWx2fMDzMPLGYtZNtWw"]'
2026-03-16 04:53:55.153 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.153 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37480/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.13.136/tcp/9122/p2p/16Uiu2HAm133hNK27sew4JfkBrkJfDztAFe3AKGBjNFcD3Hd5vYxQ"]'
2026-03-16 04:53:55.156 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.156 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35804/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-16 04:53:55.158 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.159 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:9121/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-16 04:53:55.161 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.161 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37480/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-16 04:53:55.163 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.164 DEBUG [src.steps.store] Relaying message
2026-03-16 04:53:55.164 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35804/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:55.170 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.170 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 04:53:55.180 DEBUG [src.steps.store] Relaying message
2026-03-16 04:53:55.180 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35804/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:55.186 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.186 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 04:53:55.198 DEBUG [src.steps.store] Relaying message
2026-03-16 04:53:55.198 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35804/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:55.204 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.205 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 04:53:55.217 DEBUG [src.steps.store] Relaying message
2026-03-16 04:53:55.217 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35804/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:55.222 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.223 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 04:53:55.235 DEBUG [src.steps.store] Relaying message
2026-03-16 04:53:55.235 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35804/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:55.240 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.240 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 04:53:55.251 DEBUG [src.steps.store] Relaying message
2026-03-16 04:53:55.251 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35804/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:55.255 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.256 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 04:53:55.267 DEBUG [src.steps.store] Relaying message
2026-03-16 04:53:55.267 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35804/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:55.272 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.273 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 04:53:55.284 DEBUG [src.steps.store] Relaying message
2026-03-16 04:53:55.285 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35804/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:55.290 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.290 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 04:53:55.301 DEBUG [src.steps.store] Relaying message
2026-03-16 04:53:55.301 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35804/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:55.306 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.307 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 04:53:55.317 DEBUG [src.steps.store] Relaying message
2026-03-16 04:53:55.317 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35804/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:55.323 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.323 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 04:53:55.335 DEBUG [src.steps.store] Relaying message
2026-03-16 04:53:55.335 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:9121/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:55.342 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.342 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 04:53:55.354 DEBUG [src.steps.store] Relaying message
2026-03-16 04:53:55.354 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:9121/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:55.363 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.364 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 04:53:55.374 DEBUG [src.steps.store] Relaying message
2026-03-16 04:53:55.374 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:9121/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:55.381 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.381 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 04:53:55.392 DEBUG [src.steps.store] Relaying message
2026-03-16 04:53:55.392 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:9121/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:55.398 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.399 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 04:53:55.412 DEBUG [src.steps.store] Relaying message
2026-03-16 04:53:55.412 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:9121/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:55.417 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.418 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 04:53:55.429 DEBUG [src.steps.store] Relaying message
2026-03-16 04:53:55.429 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:9121/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:55.437 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.437 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 04:53:55.448 DEBUG [src.steps.store] Relaying message
2026-03-16 04:53:55.448 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:9121/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:55.456 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.456 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 04:53:55.467 DEBUG [src.steps.store] Relaying message
2026-03-16 04:53:55.467 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:9121/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:55.473 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.474 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 04:53:55.485 DEBUG [src.steps.store] Relaying message
2026-03-16 04:53:55.486 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:9121/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:55.492 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.495 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 04:53:55.505 DEBUG [src.steps.store] Relaying message
2026-03-16 04:53:55.505 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:9121/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:55.512 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.512 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 04:53:55.523 DEBUG [src.steps.store] Relaying message
2026-03-16 04:53:55.523 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37480/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:55.528 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.529 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 04:53:55.539 DEBUG [src.steps.store] Relaying message
2026-03-16 04:53:55.539 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37480/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:55.544 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.544 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 04:53:55.555 DEBUG [src.steps.store] Relaying message
2026-03-16 04:53:55.555 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37480/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:55.559 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.560 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 04:53:55.571 DEBUG [src.steps.store] Relaying message
2026-03-16 04:53:55.572 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37480/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:55.576 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.577 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 04:53:55.589 DEBUG [src.steps.store] Relaying message
2026-03-16 04:53:55.589 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37480/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:55.595 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.596 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 04:53:55.608 DEBUG [src.steps.store] Relaying message
2026-03-16 04:53:55.608 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37480/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:55.613 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.614 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 04:53:55.626 DEBUG [src.steps.store] Relaying message
2026-03-16 04:53:55.626 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37480/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:55.631 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.631 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 04:53:55.643 DEBUG [src.steps.store] Relaying message
2026-03-16 04:53:55.643 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37480/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:55.648 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.649 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 04:53:55.660 DEBUG [src.steps.store] Relaying message
2026-03-16 04:53:55.661 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37480/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:55.666 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.666 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 04:53:55.676 DEBUG [src.steps.store] Relaying message
2026-03-16 04:53:55.677 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37480/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:55.681 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:55.681 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 04:53:55.692 DEBUG [src.node.waku_node] Restarting container with id 17241f19b2ea
2026-03-16 04:53:56.487 DEBUG [src.node.waku_node] Restarting container with id 81b3dc651137
2026-03-16 04:53:57.269 DEBUG [src.node.waku_node] Restarting container with id a5d2a2cfbda1
2026-03-16 04:53:58.090 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-16 04:54:00.091 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-16 04:54:00.092 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35804/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:54:00.096 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x4c699ae6194f477713689b876c1fd175406115389c9beb4b5f167c8f4d7db30b"},{"messageHash":"0xe3165dffb5a22c35ec7fbdaff1a6e669f9e0545b08293d2531f0178335896295"},{"messageHash":"0xbfa151a4199944a9889a818f3e85af16eba4bc09d733b784f555cf9a3a899314"},{"messageHash":"0x2f8073f763b3ecb899ba32805580afc7eefff5c6c67a8aeafd7863eeb0383a60"},{"messageHash":"0xd081d46b47e00460539e9bf3f9461f0eaeed3c4f31176ae6ee42a47e2ab2a685"},{"messageHash":"0x3c4e02fd3bd0bd14a6d7022e69c3498089dd584d3dc31f4c28d3d12e34a6506c"},{"messageHash":"0x34741463a18558ae33ec4e0c5d682af6f543aa120b4d7c1cb02a24a9225ac947"},{"messageHash":"0xd7a7354f6c12cfbf188e1d15b0d7eee59627ed7f3063177a5443824f4a3a5689"},{"messageHash":"0x67487ea101edf54d66ca64ecbdb7d0d20baf15c7d0cb8f9fe2ad3e1c543cf4a6"},{"messageHash":"0x2f1417307b9795472b02a82134b86d75f093e534aeed33606dbf0c30198fef53"},{"messageHash":"0xeab3ed9960bc7754746c1f5e040c3ad472db0f9f6928b0ad288e6385f4508c9d"},{"messageHash":"0xc1ab2a7573dfc66d46c7ac44e2d4ec04dfef7f9aa87a26556c83ad203736920b"},{"messageHash":"0xbfb2673999a2de1354a48c33d76684233bf229e1ca97938275cce1dfae2ac133"},{"messageHash":"0x90ded9b8645cd37f1428b7c15aa97f31f4d0a327093f77e3d71fd25db0c050c2"},{"messageHash":"0x2161f29b3ef98e04673bca6351dfed75274cd3f1b1244285ee7ab9beed359fb1"},{"messageHash":"0x97ebcf71e9471bd9f332281dbaae25bf80dc7675bee214a225485be11b5da3e2"},{"messageHash":"0x8af8ba2666bec9b78889f932b871508e0877b5873e695a026e3f91e67a910897"},{"messageHash":"0xab92a1242764bdf8e2ccf4dcd56299b38b4000898bbe217b10823deaa03278de"},{"messageHash":"0x3346e790385067efca4ae6879faaa347b5bacfda1d08d82b14ca590cd0878c3b"},{"messageHash":"0x1226401bf9dc8cf3023e7521946191df2ba5395a1cd857d7ef48485173389a46"},{"messageHash":"0xca71a522d7d333afddf63ba43fbbb25448651530489c5884b9158ccb3f0e6ac7"},{"messageHash":"0xbd6d7bdcd60da5fb5beeb446f23b5ecbfc9644cfc1b39e8bafc6d5168279df58"},{"messageHash":"0x17035783c82e23f6a32043ced02caad068d2b07f0e36ad7558ed985c793e0716"},{"messageHash":"0x6342087531073c70dd32096f99b340d3d99f87a564ba37e68f8a3ea9dd8c8b4a"},{"messageHash":"0x2687b7782dd17c0550273f69bd924cc49687e4f62f820f39fafae73762c4fb1c"},{"messageHash":"0xd726ccf66d33c161697b239911d58c7a04e2739dd5b13096b44ea9c1e8b0b65b"},{"messageHash":"0xe76c838d25f8d00a373293947acc05940f090b6dbf15349f98cd1ee4769b51cb"},{"messageHash":"0x73ec715437c7b858e3314565e18f219203b1b51c3872f68c209dea02ca0c5564"},{"messageHash":"0xa72b44a75bc9ddb224fdedb3e19527931300b942ead7f1b9d46480821be73e6e"},{"messageHash":"0xd2b1a41c1d31853933b1fdcc16ceee053871de9b784b2e548af420f4863147ab"}]}'
2026-03-16 04:54:00.096 DEBUG [src.steps.store] messages length is 30
2026-03-16 04:54:00.099 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-16 04:54:00.099 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9121/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:54:00.103 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x4c699ae6194f477713689b876c1fd175406115389c9beb4b5f167c8f4d7db30b"},{"messageHash":"0xe3165dffb5a22c35ec7fbdaff1a6e669f9e0545b08293d2531f0178335896295"},{"messageHash":"0xbfa151a4199944a9889a818f3e85af16eba4bc09d733b784f555cf9a3a899314"},{"messageHash":"0x2f8073f763b3ecb899ba32805580afc7eefff5c6c67a8aeafd7863eeb0383a60"},{"messageHash":"0xd081d46b47e00460539e9bf3f9461f0eaeed3c4f31176ae6ee42a47e2ab2a685"},{"messageHash":"0x3c4e02fd3bd0bd14a6d7022e69c3498089dd584d3dc31f4c28d3d12e34a6506c"},{"messageHash":"0x34741463a18558ae33ec4e0c5d682af6f543aa120b4d7c1cb02a24a9225ac947"},{"messageHash":"0xd7a7354f6c12cfbf188e1d15b0d7eee59627ed7f3063177a5443824f4a3a5689"},{"messageHash":"0x67487ea101edf54d66ca64ecbdb7d0d20baf15c7d0cb8f9fe2ad3e1c543cf4a6"},{"messageHash":"0x2f1417307b9795472b02a82134b86d75f093e534aeed33606dbf0c30198fef53"},{"messageHash":"0xeab3ed9960bc7754746c1f5e040c3ad472db0f9f6928b0ad288e6385f4508c9d"},{"messageHash":"0xc1ab2a7573dfc66d46c7ac44e2d4ec04dfef7f9aa87a26556c83ad203736920b"},{"messageHash":"0xbfb2673999a2de1354a48c33d76684233bf229e1ca97938275cce1dfae2ac133"},{"messageHash":"0x90ded9b8645cd37f1428b7c15aa97f31f4d0a327093f77e3d71fd25db0c050c2"},{"messageHash":"0x2161f29b3ef98e04673bca6351dfed75274cd3f1b1244285ee7ab9beed359fb1"},{"messageHash":"0x97ebcf71e9471bd9f332281dbaae25bf80dc7675bee214a225485be11b5da3e2"},{"messageHash":"0x8af8ba2666bec9b78889f932b871508e0877b5873e695a026e3f91e67a910897"},{"messageHash":"0xab92a1242764bdf8e2ccf4dcd56299b38b4000898bbe217b10823deaa03278de"},{"messageHash":"0x3346e790385067efca4ae6879faaa347b5bacfda1d08d82b14ca590cd0878c3b"},{"messageHash":"0x1226401bf9dc8cf3023e7521946191df2ba5395a1cd857d7ef48485173389a46"},{"messageHash":"0xca71a522d7d333afddf63ba43fbbb25448651530489c5884b9158ccb3f0e6ac7"},{"messageHash":"0xbd6d7bdcd60da5fb5beeb446f23b5ecbfc9644cfc1b39e8bafc6d5168279df58"},{"messageHash":"0x17035783c82e23f6a32043ced02caad068d2b07f0e36ad7558ed985c793e0716"},{"messageHash":"0x6342087531073c70dd32096f99b340d3d99f87a564ba37e68f8a3ea9dd8c8b4a"},{"messageHash":"0x2687b7782dd17c0550273f69bd924cc49687e4f62f820f39fafae73762c4fb1c"},{"messageHash":"0xd726ccf66d33c161697b239911d58c7a04e2739dd5b13096b44ea9c1e8b0b65b"},{"messageHash":"0xe76c838d25f8d00a373293947acc05940f090b6dbf15349f98cd1ee4769b51cb"},{"messageHash":"0x73ec715437c7b858e3314565e18f219203b1b51c3872f68c209dea02ca0c5564"},{"messageHash":"0xa72b44a75bc9ddb224fdedb3e19527931300b942ead7f1b9d46480821be73e6e"},{"messageHash":"0xd2b1a41c1d31853933b1fdcc16ceee053871de9b784b2e548af420f4863147ab"}]}'
2026-03-16 04:54:00.103 DEBUG [src.steps.store] messages length is 30
2026-03-16 04:54:00.107 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-16 04:54:00.108 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37480/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:54:00.118 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"bc6ee114ca719bf48797","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x4c699ae6194f477713689b876c1fd175406115389c9beb4b5f167c8f4d7db30b"},{"messageHash":"0xe3165dffb5a22c35ec7fbdaff1a6e669f9e0545b08293d2531f0178335896295"},{"messageHash":"0xbfa151a4199944a9889a818f3e85af16eba4bc09d733b784f555cf9a3a899314"},{"messageHash":"0x2f8073f763b3ecb899ba32805580afc7eefff5c6c67a8aeafd7863eeb0383a60"},{"messageHash":"0xd081d46b47e00460539e9bf3f9461f0eaeed3c4f31176ae6ee42a47e2ab2a685"},{"messageHash":"0x3c4e02fd3bd0bd14a6d7022e69c3498089dd584d3dc31f4c28d3d12e34a6506c"},{"messageHash":"0x34741463a18558ae33ec4e0c5d682af6f543aa120b4d7c1cb02a24a9225ac947"},{"messageHash":"0xd7a7354f6c12cfbf188e1d15b0d7eee59627ed7f3063177a5443824f4a3a5689"},{"messageHash":"0x67487ea101edf54d66ca64ecbdb7d0d20baf15c7d0cb8f9fe2ad3e1c543cf4a6"},{"messageHash":"0x2f1417307b9795472b02a82134b86d75f093e534aeed33606dbf0c30198fef53"},{"messageHash":"0xeab3ed9960bc7754746c1f5e040c3ad472db0f9f6928b0ad288e6385f4508c9d"},{"messageHash":"0xc1ab2a7573dfc66d46c7ac44e2d4ec04dfef7f9aa87a26556c83ad203736920b"},{"messageHash":"0xbfb2673999a2de1354a48c33d76684233bf229e1ca97938275cce1dfae2ac133"},{"messageHash":"0x90ded9b8645cd37f1428b7c15aa97f31f4d0a327093f77e3d71fd25db0c050c2"},{"messageHash":"0x2161f29b3ef98e04673bca6351dfed75274cd3f1b1244285ee7ab9beed359fb1"},{"messageHash":"0x97ebcf71e9471bd9f332281dbaae25bf80dc7675bee214a225485be11b5da3e2"},{"messageHash":"0x8af8ba2666bec9b78889f932b871508e0877b5873e695a026e3f91e67a910897"},{"messageHash":"0xab92a1242764bdf8e2ccf4dcd56299b38b4000898bbe217b10823deaa03278de"},{"messageHash":"0x3346e790385067efca4ae6879faaa347b5bacfda1d08d82b14ca590cd0878c3b"},{"messageHash":"0x1226401bf9dc8cf3023e7521946191df2ba5395a1cd857d7ef48485173389a46"},{"messageHash":"0xca71a522d7d333afddf63ba43fbbb25448651530489c5884b9158ccb3f0e6ac7"},{"messageHash":"0xbd6d7bdcd60da5fb5beeb446f23b5ecbfc9644cfc1b39e8bafc6d5168279df58"},{"messageHash":"0x17035783c82e23f6a32043ced02caad068d2b07f0e36ad7558ed985c793e0716"},{"messageHash":"0x6342087531073c70dd32096f99b340d3d99f87a564ba37e68f8a3ea9dd8c8b4a"},{"messageHash":"0x2687b7782dd17c0550273f69bd924cc49687e4f62f820f39fafae73762c4fb1c"},{"messageHash":"0xd726ccf66d33c161697b239911d58c7a04e2739dd5b13096b44ea9c1e8b0b65b"},{"messageHash":"0xe76c838d25f8d00a373293947acc05940f090b6dbf15349f98cd1ee4769b51cb"},{"messageHash":"0x73ec715437c7b858e3314565e18f219203b1b51c3872f68c209dea02ca0c5564"},{"messageHash":"0xa72b44a75bc9ddb224fdedb3e19527931300b942ead7f1b9d46480821be73e6e"},{"messageHash":"0xd2b1a41c1d31853933b1fdcc16ceee053871de9b784b2e548af420f4863147ab"}]}'
2026-03-16 04:54:00.118 DEBUG [src.steps.store] messages length is 30
2026-03-16 04:54:00.122 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-16 04:54:00.123 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-16 04:54:00.123 DEBUG [src.node.waku_node] Stopping container with id 17241f19b2ea
2026-03-16 04:54:00.714 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:54:00.715 DEBUG [src.node.waku_node] Stopping container with id 81b3dc651137
2026-03-16 04:54:01.288 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:54:01.289 DEBUG [src.node.waku_node] Stopping container with id a5d2a2cfbda1
2026-03-16 04:54:01.591 ERROR [src.node.docker_mananger] Max retries reached for container 17241f19b2ea. Exiting log stream.
2026-03-16 04:54:01.840 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:54:01.841 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-16 04:54:01.900 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:54:01.978 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:54:02.011 DEBUG [src.node.docker_mananger] No errors found in the waku logs.