227 lines
42 KiB
Plaintext

2026-03-03 04:39:48.552 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-03 04:39:48.552 DEBUG [tests.conftest] Running test: test_sync_with_nodes_restart__case2 with id: 2026-03-03_04-39-48__b4ccf603-39f6-4e5f-8e89-36dbb3a4ac78
2026-03-03 04:39:48.552 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-03 04:39:48.559 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:39:48.559 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-03_04-39-48__b4ccf603-39f6-4e5f-8e89-36dbb3a4ac78__wakuorg_nwaku:latest.log
2026-03-03 04:39:48.565 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:39:48.565 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-03_04-39-48__b4ccf603-39f6-4e5f-8e89-36dbb3a4ac78__wakuorg_nwaku:latest.log
2026-03-03 04:39:48.571 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:39:48.572 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-03_04-39-48__b4ccf603-39f6-4e5f-8e89-36dbb3a4ac78__wakuorg_nwaku:latest.log
2026-03-03 04:39:48.572 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-03 04:39:48.572 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:39:48.573 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:39:48.574 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-03 04:39:48.574 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.142.153
2026-03-03 04:39:48.575 DEBUG [src.node.docker_mananger] Generated ports ['21833', '21834', '21835', '21836', '21837']
2026-03-03 04:39:48.575 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:39:48.575 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:39:48.575 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:39:48.575 DEBUG [src.node.docker_mananger] docker run -i -t -p 21833:21833 -p 21834:21834 -p 21835:21835 -p 21836:21836 -p 21837:21837 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=21835 --rest-port=21833 --tcp-port=21834 --discv5-udp-port=21836 --rest-address=0.0.0.0 --nat=extip:172.18.142.153 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=7c51ec96585bcefedefb48abee2de85bf3fb87d9bebf7c1f8770c6ef1f1380ff --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=21837 --metrics-logging=true --store=true --relay=true
2026-03-03 04:39:48.766 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.142.153 waku 7a7807a087bdb171a22c6ae0eee413f119863f0449059f9d5e3279ef3288065d
2026-03-03 04:39:48.766 ERROR [src.node.docker_mananger] Max retries reached for container a51fb5013342. Exiting log stream.
2026-03-03 04:39:48.801 DEBUG [src.node.docker_mananger] Container started with ID 7a7807a087bd. Setting up logs at ./log/docker/node1_2026-03-03_04-39-48__b4ccf603-39f6-4e5f-8e89-36dbb3a4ac78__wakuorg_nwaku:latest.log
2026-03-03 04:39:48.803 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 21833
2026-03-03 04:39:48.804 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:39:49.353 ERROR [src.node.docker_mananger] Max retries reached for container e3869c396831. Exiting log stream.
2026-03-03 04:39:49.806 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:21833/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:39:49.808 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:39:49.808 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:39:49.809 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:21833/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:39:49.811 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.142.153/tcp/21834/p2p/16Uiu2HAmDuQpZLRePgTUc2enVwz9ZJV7mdXTRQXJN93h7uGKC6e7","/ip4/172.18.142.153/tcp/21835/ws/p2p/16Uiu2HAmDuQpZLRePgTUc2enVwz9ZJV7mdXTRQXJN93h7uGKC6e7"],"enrUri":"enr:-L24QF0ZE0I2pqKmscFuGq6sjRQvhSg4QCIXJCHVzfzt-GmTP41EkNS0TZDouc_DMtfQLeZ6TxN7hDv6Mt6P9aSX1nACgmlkgnY0gmlwhKwSjpmKbXVsdGlhZGRyc5YACASsEo6ZBlVKAAoErBKOmQZVS90DgnJzhQADAQAAiXNlY3AyNTZrMaEDEo18mqxVJctRl0UNUirn8Y3VR9KzLc1FgQoceKnhMVSDdGNwglVKg3VkcIJVTIV3YWt1MgM"}'
2026-03-03 04:39:49.811 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:39:49.812 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:39:49.812 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:39:49.813 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-03 04:39:49.813 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.109.20
2026-03-03 04:39:49.814 DEBUG [src.node.docker_mananger] Generated ports ['5064', '5065', '5066', '5067', '5068']
2026-03-03 04:39:49.814 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:39:49.814 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:39:49.814 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:39:49.814 DEBUG [src.node.docker_mananger] docker run -i -t -p 5064:5064 -p 5065:5065 -p 5066:5066 -p 5067:5067 -p 5068:5068 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=5066 --rest-port=5064 --tcp-port=5065 --discv5-udp-port=5067 --rest-address=0.0.0.0 --nat=extip:172.18.109.20 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=7bbfa5fb274eb9eaca9d3fadd9e34eddaa2cb94d8fc855aa3e1fa66e46dc4272 --store-sync=true --store=false --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=5068 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QF0ZE0I2pqKmscFuGq6sjRQvhSg4QCIXJCHVzfzt-GmTP41EkNS0TZDouc_DMtfQLeZ6TxN7hDv6Mt6P9aSX1nACgmlkgnY0gmlwhKwSjpmKbXVsdGlhZGRyc5YACASsEo6ZBlVKAAoErBKOmQZVS90DgnJzhQADAQAAiXNlY3AyNTZrMaEDEo18mqxVJctRl0UNUirn8Y3VR9KzLc1FgQoceKnhMVSDdGNwglVKg3VkcIJVTIV3YWt1MgM
2026-03-03 04:39:50.008 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.109.20 waku 87ca91498ed0ed478db1cbbf9faffb5f87d584c263be426d60e9e455bf78c355
2026-03-03 04:39:50.043 DEBUG [src.node.docker_mananger] Container started with ID 87ca91498ed0. Setting up logs at ./log/docker/node2_2026-03-03_04-39-48__b4ccf603-39f6-4e5f-8e89-36dbb3a4ac78__wakuorg_nwaku:latest.log
2026-03-03 04:39:50.043 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 5064
2026-03-03 04:39:50.045 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:39:51.045 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:5064/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:39:51.067 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:39:51.068 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:39:51.069 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:5064/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:39:51.075 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.109.20/tcp/5065/p2p/16Uiu2HAm3sjZmCKym7nrF9Jb9MDcy1KCpuFCvxFGZvvxHaGtbiC6","/ip4/172.18.109.20/tcp/5066/ws/p2p/16Uiu2HAm3sjZmCKym7nrF9Jb9MDcy1KCpuFCvxFGZvvxHaGtbiC6"],"enrUri":"enr:-L24QPjd1eCW7C_MW94VQWZbaB8ZcItJEcH39w7NnAwx8qtkViDaaP7Y9DJiBuKk_6aCzmBF5uYQLoQ6y2QrtCivPM4CgmlkgnY0gmlwhKwSbRSKbXVsdGlhZGRyc5YACASsEm0UBhPJAAoErBJtFAYTyt0DgnJzhQADAQAAiXNlY3AyNTZrMaECfYqmmdoWAtEl1btbN9jlLoGQAr5EpXWuFcstbs-bSGeDdGNwghPJg3VkcIITy4V3YWt1MgE"}'
2026-03-03 04:39:51.077 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:39:51.077 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:39:51.078 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:39:51.080 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-03 04:39:51.080 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.15.72
2026-03-03 04:39:51.081 DEBUG [src.node.docker_mananger] Generated ports ['14251', '14252', '14253', '14254', '14255']
2026-03-03 04:39:51.081 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:39:51.081 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:39:51.081 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:39:51.081 DEBUG [src.node.docker_mananger] docker run -i -t -p 14251:14251 -p 14252:14252 -p 14253:14253 -p 14254:14254 -p 14255:14255 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=14253 --rest-port=14251 --tcp-port=14252 --discv5-udp-port=14254 --rest-address=0.0.0.0 --nat=extip:172.18.15.72 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=cfe4d58758a19f3ddecb36dd5aa5d2fafeed57db5c322b7a4bbd2ce6e5cd6f16 --store-sync=true --store=false --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=14255 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QPjd1eCW7C_MW94VQWZbaB8ZcItJEcH39w7NnAwx8qtkViDaaP7Y9DJiBuKk_6aCzmBF5uYQLoQ6y2QrtCivPM4CgmlkgnY0gmlwhKwSbRSKbXVsdGlhZGRyc5YACASsEm0UBhPJAAoErBJtFAYTyt0DgnJzhQADAQAAiXNlY3AyNTZrMaECfYqmmdoWAtEl1btbN9jlLoGQAr5EpXWuFcstbs-bSGeDdGNwghPJg3VkcIITy4V3YWt1MgE
2026-03-03 04:39:51.280 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.15.72 waku 3223254999aaba30db5795801c78e2625dbe710b415b6b897b98fdb3023fa370
2026-03-03 04:39:51.314 DEBUG [src.node.docker_mananger] Container started with ID 3223254999aa. Setting up logs at ./log/docker/node3_2026-03-03_04-39-48__b4ccf603-39f6-4e5f-8e89-36dbb3a4ac78__wakuorg_nwaku:latest.log
2026-03-03 04:39:51.314 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 14251
2026-03-03 04:39:51.315 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:39:52.316 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14251/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:39:52.333 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:39:52.336 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:39:52.336 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14251/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:39:52.343 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.15.72/tcp/14252/p2p/16Uiu2HAmNHcUGQ1NFzCsmdwgr37n9oaNdMAfehSUP6hM816MuNCb","/ip4/172.18.15.72/tcp/14253/ws/p2p/16Uiu2HAmNHcUGQ1NFzCsmdwgr37n9oaNdMAfehSUP6hM816MuNCb"],"enrUri":"enr:-L24QEspD5nN6NEcr5xYsRTM9a7ngEFfHCtP9lJQq-tJRQcgeQsr8ooAAmnNq5hIzqZ4BgXGiuURXUXV4SP3dZ6nIK8CgmlkgnY0gmlwhKwSD0iKbXVsdGlhZGRyc5YACASsEg9IBjesAAoErBIPSAY3rd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDjxruy9YN-_ncpwyonRz7aj59CTnPoK5BY8Se1E4TOZSDdGNwgjesg3VkcII3roV3YWt1MgE"}'
2026-03-03 04:39:52.343 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:39:52.343 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:5064/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.142.153/tcp/21834/p2p/16Uiu2HAmDuQpZLRePgTUc2enVwz9ZJV7mdXTRQXJN93h7uGKC6e7"]'
2026-03-03 04:39:52.346 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.346 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14251/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.109.20/tcp/5065/p2p/16Uiu2HAm3sjZmCKym7nrF9Jb9MDcy1KCpuFCvxFGZvvxHaGtbiC6"]'
2026-03-03 04:39:52.349 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.349 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21833/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-03 04:39:52.352 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.352 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:5064/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-03 04:39:52.354 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.354 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14251/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-03 04:39:52.356 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.357 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:52.357 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21833/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:52.362 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.363 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-03 04:39:52.375 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:52.375 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21833/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:52.380 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.381 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-03 04:39:52.393 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:52.393 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21833/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:52.398 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.400 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-03 04:39:52.412 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:52.412 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21833/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:52.418 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.419 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-03 04:39:52.431 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:52.431 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21833/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:52.436 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.436 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-03 04:39:52.447 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:52.447 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21833/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:52.453 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.453 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-03 04:39:52.464 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:52.464 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21833/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:52.469 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.470 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-03 04:39:52.481 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:52.481 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21833/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:52.486 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.487 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-03 04:39:52.497 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:52.498 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21833/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:52.502 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.503 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-03 04:39:52.513 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:52.513 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21833/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:52.518 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.519 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-03 04:39:52.529 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:52.529 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:5064/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:52.535 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.536 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-03 04:39:52.548 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:52.548 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:5064/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:52.555 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.555 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-03 04:39:52.566 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:52.566 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:5064/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:52.572 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.574 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-03 04:39:52.584 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:52.585 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:5064/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:52.591 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.592 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-03 04:39:52.602 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:52.602 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:5064/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:52.608 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.608 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-03 04:39:52.620 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:52.620 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:5064/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:52.626 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.626 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-03 04:39:52.637 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:52.637 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:5064/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:52.643 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.643 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-03 04:39:52.656 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:52.656 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:5064/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:52.661 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.662 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-03 04:39:52.673 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:52.673 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:5064/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:52.680 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.681 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-03 04:39:52.691 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:52.692 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:5064/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:52.697 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.698 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-03 04:39:52.709 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:52.709 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14251/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:52.713 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.714 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-03 04:39:52.725 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:52.725 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14251/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:52.730 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.730 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-03 04:39:52.741 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:52.741 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14251/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:52.747 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.747 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-03 04:39:52.758 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:52.758 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14251/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:52.763 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.764 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-03 04:39:52.774 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:52.775 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14251/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:52.778 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.779 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-03 04:39:52.790 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:52.790 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14251/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:52.794 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.795 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-03 04:39:52.805 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:52.805 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14251/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:52.810 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.810 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-03 04:39:52.822 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:52.822 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14251/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:52.827 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.827 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-03 04:39:52.838 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:52.838 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14251/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:52.842 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.843 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-03 04:39:52.854 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:52.854 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14251/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:52.858 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:52.860 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-03 04:39:52.871 DEBUG [src.node.waku_node] Restarting container with id 87ca91498ed0
2026-03-03 04:39:53.635 DEBUG [src.libs.common] Sleeping for 5 seconds
2026-03-03 04:39:58.636 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-03 04:39:58.636 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:21833/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:39:58.640 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x86ed7e37588e04b9b8d381fbcc51128d01641f6b4d2c800d7c44f37cc43a10aa"},{"messageHash":"0x6ec505196113310ad4cc8e1d61b2bc3e9213a7dfd171da6ac097e51f7c3dda90"},{"messageHash":"0xffd91c7e07ccb502eac08e5d429c0f9d338547f36167bd4cbdf7e2bde4c0c263"},{"messageHash":"0x24d068fd67afbc661d91423eb61d05a2ac5a83c60c4f6de592d996bdb0b233cc"},{"messageHash":"0x05383879edfd09a41c18dde1ca821f3fea1a3fe8b58e1f165294160106f6a9b8"},{"messageHash":"0xe9071b104ec06d1ce736e2e7ef6cf4b8cb9d3f7a328b5b8aa5c5e4a0faa3e465"},{"messageHash":"0x9996a7ba1cd401ad6b1ffb9b65473653cd5cd544c159d93e17f68a7e6b887ddb"},{"messageHash":"0x2b450b5fa8d9f30fe6cd234245cd0d371465bff021e8d343f927908fec7b26fc"},{"messageHash":"0xc1a463e3a4d722ca18eaaca1baf494b7202f975a89a65a96c10008bdf3d831f3"},{"messageHash":"0x60eeb0b9f709a9e1a6df48de1bf22c0b3f04c7ecc187aeb0454099cbf80d900f"},{"messageHash":"0x5f1b58a2c47c37bd6c05c759e2b9ab34f2748202decdf7283de848376a0ca125"},{"messageHash":"0x49f4e84a9969ecf27954a30b91b52b02b694adfc122b0f107252a1de2f88f65f"},{"messageHash":"0xf29de93c33ce1676a1a31a4d7a989dbc0f2a7e21efda700b09f446befe74959b"},{"messageHash":"0x6e67f69e86d0d5c45b5be48053026637f22a8b61d1e36736779f17f730a83474"},{"messageHash":"0xd2cf3db778a0c1e48f70fe83b4d9d9d5463c6a26bc603b6b6720530de1abf93b"},{"messageHash":"0x91e1b092bc762fcd0c13d4a7c9561e2a246427c475261695b3d23f522b64ba5a"},{"messageHash":"0x6ffbc56d2a9a7e6d7cc263feef3e77e04104b96c827a9176dc981441df2f1872"},{"messageHash":"0xc3ee66e92d18818fbfac610806f6869728f17c8c9367c66b4bd9494ad4620343"},{"messageHash":"0xbe9000dc5e1056a3a6ea6381dec30d89602286cc7945c7b176edae4036ee36ed"},{"messageHash":"0xbc1fde74d787e15a7fe70dc031491e334d67edbb013f82319ddfad28869a5f61"},{"messageHash":"0x6e623fae388988c2fd704eed51c7e81767014927586af715fe7a908122402fbf"},{"messageHash":"0x72a4f5c7a96462f61a557f05ff9da66f335c9bc9a0bd8d20ef78007cff14689e"},{"messageHash":"0xefc13982c90fb71488d243137b1ec674498227cb9482fbb0fd01ac1b75665754"},{"messageHash":"0x0f12bc91b62d8e7e937274e8bc2ec49ebdc2a1f1339c270943f442662234cf29"},{"messageHash":"0x3da2e833373d8e442a75389dc92134736335d47992a7f90f044900efd708a47e"},{"messageHash":"0x1042a088d0a278e60703e4780c213623e4660f283d316d24c2f248dc6950ca8e"},{"messageHash":"0x21bb5fc5e09acb59a12abd6d150b443dc106d042f96a6caa5a39c0bcc31e5305"},{"messageHash":"0xa81c0b6ab68e0c1c782620504a146c7dfe2e7498ff92c4cf913034e024a9cfdf"},{"messageHash":"0xefdeea2188d2537cbb24b09ef1896347dae4f703a8005433688373fd87720476"},{"messageHash":"0xee74065758b2408c9e7efd1d46d2937248aaec1e482ce08a90d8fabeea5ace88"}]}'
2026-03-03 04:39:58.640 DEBUG [src.steps.store] messages length is 30
2026-03-03 04:39:58.643 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-03 04:39:58.644 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:5064/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:39:58.654 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"191d93ba132fb6c9b6a2","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x86ed7e37588e04b9b8d381fbcc51128d01641f6b4d2c800d7c44f37cc43a10aa"},{"messageHash":"0x6ec505196113310ad4cc8e1d61b2bc3e9213a7dfd171da6ac097e51f7c3dda90"},{"messageHash":"0xffd91c7e07ccb502eac08e5d429c0f9d338547f36167bd4cbdf7e2bde4c0c263"},{"messageHash":"0x24d068fd67afbc661d91423eb61d05a2ac5a83c60c4f6de592d996bdb0b233cc"},{"messageHash":"0x05383879edfd09a41c18dde1ca821f3fea1a3fe8b58e1f165294160106f6a9b8"},{"messageHash":"0xe9071b104ec06d1ce736e2e7ef6cf4b8cb9d3f7a328b5b8aa5c5e4a0faa3e465"},{"messageHash":"0x9996a7ba1cd401ad6b1ffb9b65473653cd5cd544c159d93e17f68a7e6b887ddb"},{"messageHash":"0x2b450b5fa8d9f30fe6cd234245cd0d371465bff021e8d343f927908fec7b26fc"},{"messageHash":"0xc1a463e3a4d722ca18eaaca1baf494b7202f975a89a65a96c10008bdf3d831f3"},{"messageHash":"0x60eeb0b9f709a9e1a6df48de1bf22c0b3f04c7ecc187aeb0454099cbf80d900f"},{"messageHash":"0x5f1b58a2c47c37bd6c05c759e2b9ab34f2748202decdf7283de848376a0ca125"},{"messageHash":"0x49f4e84a9969ecf27954a30b91b52b02b694adfc122b0f107252a1de2f88f65f"},{"messageHash":"0xf29de93c33ce1676a1a31a4d7a989dbc0f2a7e21efda700b09f446befe74959b"},{"messageHash":"0x6e67f69e86d0d5c45b5be48053026637f22a8b61d1e36736779f17f730a83474"},{"messageHash":"0xd2cf3db778a0c1e48f70fe83b4d9d9d5463c6a26bc603b6b6720530de1abf93b"},{"messageHash":"0x91e1b092bc762fcd0c13d4a7c9561e2a246427c475261695b3d23f522b64ba5a"},{"messageHash":"0x6ffbc56d2a9a7e6d7cc263feef3e77e04104b96c827a9176dc981441df2f1872"},{"messageHash":"0xc3ee66e92d18818fbfac610806f6869728f17c8c9367c66b4bd9494ad4620343"},{"messageHash":"0xbe9000dc5e1056a3a6ea6381dec30d89602286cc7945c7b176edae4036ee36ed"},{"messageHash":"0xbc1fde74d787e15a7fe70dc031491e334d67edbb013f82319ddfad28869a5f61"},{"messageHash":"0x6e623fae388988c2fd704eed51c7e81767014927586af715fe7a908122402fbf"},{"messageHash":"0x72a4f5c7a96462f61a557f05ff9da66f335c9bc9a0bd8d20ef78007cff14689e"},{"messageHash":"0xefc13982c90fb71488d243137b1ec674498227cb9482fbb0fd01ac1b75665754"},{"messageHash":"0x0f12bc91b62d8e7e937274e8bc2ec49ebdc2a1f1339c270943f442662234cf29"},{"messageHash":"0x3da2e833373d8e442a75389dc92134736335d47992a7f90f044900efd708a47e"},{"messageHash":"0x1042a088d0a278e60703e4780c213623e4660f283d316d24c2f248dc6950ca8e"},{"messageHash":"0x21bb5fc5e09acb59a12abd6d150b443dc106d042f96a6caa5a39c0bcc31e5305"},{"messageHash":"0xa81c0b6ab68e0c1c782620504a146c7dfe2e7498ff92c4cf913034e024a9cfdf"},{"messageHash":"0xefdeea2188d2537cbb24b09ef1896347dae4f703a8005433688373fd87720476"},{"messageHash":"0xee74065758b2408c9e7efd1d46d2937248aaec1e482ce08a90d8fabeea5ace88"}]}'
2026-03-03 04:39:58.654 DEBUG [src.steps.store] messages length is 30
2026-03-03 04:39:58.657 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-03 04:39:58.657 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14251/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:39:58.695 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"3c0ac66ee3507268e8b6","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x86ed7e37588e04b9b8d381fbcc51128d01641f6b4d2c800d7c44f37cc43a10aa"},{"messageHash":"0x6ec505196113310ad4cc8e1d61b2bc3e9213a7dfd171da6ac097e51f7c3dda90"},{"messageHash":"0xffd91c7e07ccb502eac08e5d429c0f9d338547f36167bd4cbdf7e2bde4c0c263"},{"messageHash":"0x24d068fd67afbc661d91423eb61d05a2ac5a83c60c4f6de592d996bdb0b233cc"},{"messageHash":"0x05383879edfd09a41c18dde1ca821f3fea1a3fe8b58e1f165294160106f6a9b8"},{"messageHash":"0xe9071b104ec06d1ce736e2e7ef6cf4b8cb9d3f7a328b5b8aa5c5e4a0faa3e465"},{"messageHash":"0x9996a7ba1cd401ad6b1ffb9b65473653cd5cd544c159d93e17f68a7e6b887ddb"},{"messageHash":"0x2b450b5fa8d9f30fe6cd234245cd0d371465bff021e8d343f927908fec7b26fc"},{"messageHash":"0xc1a463e3a4d722ca18eaaca1baf494b7202f975a89a65a96c10008bdf3d831f3"},{"messageHash":"0x60eeb0b9f709a9e1a6df48de1bf22c0b3f04c7ecc187aeb0454099cbf80d900f"},{"messageHash":"0x5f1b58a2c47c37bd6c05c759e2b9ab34f2748202decdf7283de848376a0ca125"},{"messageHash":"0x49f4e84a9969ecf27954a30b91b52b02b694adfc122b0f107252a1de2f88f65f"},{"messageHash":"0xf29de93c33ce1676a1a31a4d7a989dbc0f2a7e21efda700b09f446befe74959b"},{"messageHash":"0x6e67f69e86d0d5c45b5be48053026637f22a8b61d1e36736779f17f730a83474"},{"messageHash":"0xd2cf3db778a0c1e48f70fe83b4d9d9d5463c6a26bc603b6b6720530de1abf93b"},{"messageHash":"0x91e1b092bc762fcd0c13d4a7c9561e2a246427c475261695b3d23f522b64ba5a"},{"messageHash":"0x6ffbc56d2a9a7e6d7cc263feef3e77e04104b96c827a9176dc981441df2f1872"},{"messageHash":"0xc3ee66e92d18818fbfac610806f6869728f17c8c9367c66b4bd9494ad4620343"},{"messageHash":"0xbe9000dc5e1056a3a6ea6381dec30d89602286cc7945c7b176edae4036ee36ed"},{"messageHash":"0xbc1fde74d787e15a7fe70dc031491e334d67edbb013f82319ddfad28869a5f61"},{"messageHash":"0x6e623fae388988c2fd704eed51c7e81767014927586af715fe7a908122402fbf"},{"messageHash":"0x72a4f5c7a96462f61a557f05ff9da66f335c9bc9a0bd8d20ef78007cff14689e"},{"messageHash":"0xefc13982c90fb71488d243137b1ec674498227cb9482fbb0fd01ac1b75665754"},{"messageHash":"0x0f12bc91b62d8e7e937274e8bc2ec49ebdc2a1f1339c270943f442662234cf29"},{"messageHash":"0x3da2e833373d8e442a75389dc92134736335d47992a7f90f044900efd708a47e"},{"messageHash":"0x1042a088d0a278e60703e4780c213623e4660f283d316d24c2f248dc6950ca8e"},{"messageHash":"0x21bb5fc5e09acb59a12abd6d150b443dc106d042f96a6caa5a39c0bcc31e5305"},{"messageHash":"0xa81c0b6ab68e0c1c782620504a146c7dfe2e7498ff92c4cf913034e024a9cfdf"},{"messageHash":"0xefdeea2188d2537cbb24b09ef1896347dae4f703a8005433688373fd87720476"},{"messageHash":"0xee74065758b2408c9e7efd1d46d2937248aaec1e482ce08a90d8fabeea5ace88"}]}'
2026-03-03 04:39:58.696 DEBUG [src.steps.store] messages length is 30
2026-03-03 04:39:58.705 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-03 04:39:58.707 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-03 04:39:58.707 DEBUG [src.node.waku_node] Stopping container with id 7a7807a087bd
2026-03-03 04:39:59.290 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:39:59.290 DEBUG [src.node.waku_node] Stopping container with id 87ca91498ed0
2026-03-03 04:39:59.842 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:39:59.844 DEBUG [src.node.waku_node] Stopping container with id 3223254999aa
2026-03-03 04:40:00.108 ERROR [src.node.docker_mananger] Max retries reached for container 7a7807a087bd. Exiting log stream.
2026-03-03 04:40:00.429 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:40:00.431 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-03 04:40:00.450 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-03 04:40:00.514 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-03 04:40:00.527 DEBUG [src.node.docker_mananger] No errors found in the waku logs.