146 lines
27 KiB
Plaintext

2026-03-03 04:39:56.852 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-03 04:39:56.852 DEBUG [tests.conftest] Running test: test_sync_flags with id: 2026-03-03_04-39-56__2977bcb4-577d-42e5-b0f4-79e59975f9ab
2026-03-03 04:39:56.853 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-03 04:39:56.859 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:39:56.860 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-03_04-39-56__2977bcb4-577d-42e5-b0f4-79e59975f9ab__wakuorg_nwaku:latest.log
2026-03-03 04:39:56.866 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:39:56.866 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-03_04-39-56__2977bcb4-577d-42e5-b0f4-79e59975f9ab__wakuorg_nwaku:latest.log
2026-03-03 04:39:56.872 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:39:56.872 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-03_04-39-56__2977bcb4-577d-42e5-b0f4-79e59975f9ab__wakuorg_nwaku:latest.log
2026-03-03 04:39:56.872 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-03 04:39:56.873 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:39:56.873 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:39:56.874 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-03 04:39:56.875 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.111.182
2026-03-03 04:39:56.875 DEBUG [src.node.docker_mananger] Generated ports ['45841', '45842', '45843', '45844', '45845']
2026-03-03 04:39:56.875 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:39:56.875 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:39:56.875 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:39:56.875 DEBUG [src.node.docker_mananger] docker run -i -t -p 45841:45841 -p 45842:45842 -p 45843:45843 -p 45844:45844 -p 45845:45845 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=45843 --rest-port=45841 --tcp-port=45842 --discv5-udp-port=45844 --rest-address=0.0.0.0 --nat=extip:172.18.111.182 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=6edd4de6eaad944d5f3ac8f1f8be59d75eca2a0abecaa5f9ace90f07ab0ec2eb --store-sync=true --store=true --store-sync-range=10 --store-sync-interval=1 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=45845 --metrics-logging=true --store-sync-relay-jitter=1 --relay=true
2026-03-03 04:39:57.048 ERROR [src.node.docker_mananger] Max retries reached for container a81bbef84ce9. Exiting log stream.
2026-03-03 04:39:57.071 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.111.182 waku 8e193e778d8c5c8a24031df0cea703070244263dfb0f8ffd2cdfa6026811001f
2026-03-03 04:39:57.104 DEBUG [src.node.docker_mananger] Container started with ID 8e193e778d8c. Setting up logs at ./log/docker/node1_2026-03-03_04-39-56__2977bcb4-577d-42e5-b0f4-79e59975f9ab__wakuorg_nwaku:latest.log
2026-03-03 04:39:57.104 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 45841
2026-03-03 04:39:57.105 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:39:57.625 ERROR [src.node.docker_mananger] Max retries reached for container 22ff0f1db891. Exiting log stream.
2026-03-03 04:39:58.106 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45841/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:39:58.109 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:39:58.109 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:39:58.109 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45841/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:39:58.111 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.111.182/tcp/45842/p2p/16Uiu2HAm3PVH61Uk1wJmrNDR2R8ZU2B6phQWQKjjgnzB1C8TdH97","/ip4/172.18.111.182/tcp/45843/ws/p2p/16Uiu2HAm3PVH61Uk1wJmrNDR2R8ZU2B6phQWQKjjgnzB1C8TdH97"],"enrUri":"enr:-L24QMFQyW7ELsap_sNXA-81FJoqGnuvrgEDQ6_QjupHuG9KJH7uO8Cwkvh9zBdG7mGrF2ezrA6NxYwva_z0d1bNwqICgmlkgnY0gmlwhKwSb7aKbXVsdGlhZGRyc5YACASsEm-2BrMSAAoErBJvtgazE90DgnJzhQADAQAAiXNlY3AyNTZrMaECdk47smQxr4g-8ATzU4yHC83qwrn9-LSgUHeAc3cl8XaDdGNwgrMSg3VkcIKzFIV3YWt1MhM"}'
2026-03-03 04:39:58.112 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:39:58.112 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:39:58.112 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:39:58.113 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-03 04:39:58.113 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.146.85
2026-03-03 04:39:58.114 DEBUG [src.node.docker_mananger] Generated ports ['28666', '28667', '28668', '28669', '28670']
2026-03-03 04:39:58.114 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:39:58.114 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:39:58.114 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:39:58.114 DEBUG [src.node.docker_mananger] docker run -i -t -p 28666:28666 -p 28667:28667 -p 28668:28668 -p 28669:28669 -p 28670:28670 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=28668 --rest-port=28666 --tcp-port=28667 --discv5-udp-port=28669 --rest-address=0.0.0.0 --nat=extip:172.18.146.85 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ae7772f0ba0dae1cd2db8643e8b1de27273b7d34d2ffd1b0033694cded4f6fdd --store-sync=true --store=false --store-sync-range=10 --store-sync-interval=1 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=28670 --metrics-logging=true --store-sync-relay-jitter=1 --relay=true --discv5-bootstrap-node=enr:-L24QMFQyW7ELsap_sNXA-81FJoqGnuvrgEDQ6_QjupHuG9KJH7uO8Cwkvh9zBdG7mGrF2ezrA6NxYwva_z0d1bNwqICgmlkgnY0gmlwhKwSb7aKbXVsdGlhZGRyc5YACASsEm-2BrMSAAoErBJvtgazE90DgnJzhQADAQAAiXNlY3AyNTZrMaECdk47smQxr4g-8ATzU4yHC83qwrn9-LSgUHeAc3cl8XaDdGNwgrMSg3VkcIKzFIV3YWt1MhM
2026-03-03 04:39:58.308 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.146.85 waku 335f181fc2232d75848d119bfdef9aa1d55e6163de8e4038d9aed1a343e40925
2026-03-03 04:39:58.344 DEBUG [src.node.docker_mananger] Container started with ID 335f181fc223. Setting up logs at ./log/docker/node2_2026-03-03_04-39-56__2977bcb4-577d-42e5-b0f4-79e59975f9ab__wakuorg_nwaku:latest.log
2026-03-03 04:39:58.344 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 28666
2026-03-03 04:39:58.344 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:39:59.345 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:28666/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:39:59.359 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:39:59.362 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:39:59.362 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:28666/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:39:59.369 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.146.85/tcp/28667/p2p/16Uiu2HAm2Aofaq5Kaxmh4YsgkEcwFvjtKh6b9i21kQysQfsUUN8M","/ip4/172.18.146.85/tcp/28668/ws/p2p/16Uiu2HAm2Aofaq5Kaxmh4YsgkEcwFvjtKh6b9i21kQysQfsUUN8M"],"enrUri":"enr:-L24QG3KAcR2jL0oXHg7p3z1F7ZNopb7kL2hi2JuskLhvr9_LKkV7aJyqkJ2oQCO8JMqA-Aiz5Tx4U_-lhQ2YddwcHQCgmlkgnY0gmlwhKwSklWKbXVsdGlhZGRyc5YACASsEpJVBm_7AAoErBKSVQZv_N0DgnJzhQADAQAAiXNlY3AyNTZrMaECZDLJd-tOzKjS1QXl9x3qH_8RI4nDi6-S8_m0lF7YpsaDdGNwgm_7g3VkcIJv_YV3YWt1MgE"}'
2026-03-03 04:39:59.370 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:39:59.370 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:39:59.370 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:39:59.372 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-03 04:39:59.372 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.153.85
2026-03-03 04:39:59.372 DEBUG [src.node.docker_mananger] Generated ports ['42132', '42133', '42134', '42135', '42136']
2026-03-03 04:39:59.373 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:39:59.373 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:39:59.373 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:39:59.373 DEBUG [src.node.docker_mananger] docker run -i -t -p 42132:42132 -p 42133:42133 -p 42134:42134 -p 42135:42135 -p 42136:42136 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=42134 --rest-port=42132 --tcp-port=42133 --discv5-udp-port=42135 --rest-address=0.0.0.0 --nat=extip:172.18.153.85 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=7357583f27d95ddf1b24cdeb5cacaafae0d3b697aeefc12492bd945de56dcccf --store-sync=true --store=false --store-sync-range=10 --store-sync-interval=1 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=42136 --metrics-logging=true --store-sync-relay-jitter=1 --relay=true --discv5-bootstrap-node=enr:-L24QG3KAcR2jL0oXHg7p3z1F7ZNopb7kL2hi2JuskLhvr9_LKkV7aJyqkJ2oQCO8JMqA-Aiz5Tx4U_-lhQ2YddwcHQCgmlkgnY0gmlwhKwSklWKbXVsdGlhZGRyc5YACASsEpJVBm_7AAoErBKSVQZv_N0DgnJzhQADAQAAiXNlY3AyNTZrMaECZDLJd-tOzKjS1QXl9x3qH_8RI4nDi6-S8_m0lF7YpsaDdGNwgm_7g3VkcIJv_YV3YWt1MgE
2026-03-03 04:39:59.581 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.153.85 waku 809af45b165ce18039e1dea3bcf6a10b3e32b9a6f7d08ddc2174c0c04bd06c27
2026-03-03 04:39:59.616 DEBUG [src.node.docker_mananger] Container started with ID 809af45b165c. Setting up logs at ./log/docker/node3_2026-03-03_04-39-56__2977bcb4-577d-42e5-b0f4-79e59975f9ab__wakuorg_nwaku:latest.log
2026-03-03 04:39:59.616 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 42132
2026-03-03 04:39:59.616 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:40:00.617 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42132/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:00.631 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:40:00.636 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:40:00.637 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42132/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:00.639 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.153.85/tcp/42133/p2p/16Uiu2HAmKNhPNCcJxPZeQVtSumSMyWVcentS74RWU2LHHBfighTk","/ip4/172.18.153.85/tcp/42134/ws/p2p/16Uiu2HAmKNhPNCcJxPZeQVtSumSMyWVcentS74RWU2LHHBfighTk"],"enrUri":"enr:-L24QOmz_u7OuLmJBORqJSHeYiWHJTvtD78jmquHWQbUwDQKYH5sA8uzJdno_OYOQDu329AiayM1E4E4MrlFYV04T-ACgmlkgnY0gmlwhKwSmVWKbXVsdGlhZGRyc5YACASsEplVBqSVAAoErBKZVQaklt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDY9VVhNkQmVy7vc-Els49yZ8F3BUEM62mai4vJmY0jZeDdGNwgqSVg3VkcIKkl4V3YWt1MgE"}'
2026-03-03 04:40:00.639 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:40:00.640 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:28666/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.111.182/tcp/45842/p2p/16Uiu2HAm3PVH61Uk1wJmrNDR2R8ZU2B6phQWQKjjgnzB1C8TdH97"]'
2026-03-03 04:40:00.642 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:00.643 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:42132/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.146.85/tcp/28667/p2p/16Uiu2HAm2Aofaq5Kaxmh4YsgkEcwFvjtKh6b9i21kQysQfsUUN8M"]'
2026-03-03 04:40:00.645 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:00.646 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45841/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-03 04:40:00.648 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:00.648 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:28666/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-03 04:40:00.651 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:00.651 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:42132/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-03 04:40:00.653 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:00.653 DEBUG [src.steps.store] Relaying message
2026-03-03 04:40:00.654 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45841/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:40:00.660 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:00.661 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-03 04:40:00.862 DEBUG [src.steps.store] Relaying message
2026-03-03 04:40:00.862 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45841/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:40:00.867 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:00.867 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-03 04:40:01.068 DEBUG [src.steps.store] Relaying message
2026-03-03 04:40:01.069 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45841/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:40:01.075 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:01.077 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-03 04:40:01.278 DEBUG [src.steps.store] Relaying message
2026-03-03 04:40:01.278 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45841/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:40:01.284 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:01.284 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-03 04:40:01.485 DEBUG [src.steps.store] Relaying message
2026-03-03 04:40:01.486 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45841/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:40:01.491 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:01.492 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-03 04:40:01.693 DEBUG [src.steps.store] Relaying message
2026-03-03 04:40:01.693 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45841/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:40:01.698 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:01.699 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-03 04:40:01.901 DEBUG [src.steps.store] Relaying message
2026-03-03 04:40:01.901 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45841/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:40:01.907 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:01.908 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-03 04:40:02.108 DEBUG [src.steps.store] Relaying message
2026-03-03 04:40:02.108 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45841/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:40:02.114 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:02.114 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-03 04:40:02.315 DEBUG [src.steps.store] Relaying message
2026-03-03 04:40:02.315 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45841/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:40:02.320 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:02.321 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-03 04:40:02.521 DEBUG [src.steps.store] Relaying message
2026-03-03 04:40:02.521 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45841/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:40:02.527 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:02.528 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-03 04:40:02.730 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-03 04:40:04.730 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-03 04:40:04.731 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45841/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:04.734 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0xd0ef72ee2d09fd0dacb125d50e926c27ce1c0a9ff8d032ae2c106972dd22c441"},{"messageHash":"0xb99895a9925b5c308f602a2f82a2e7010d0959276bdcbe9ae34bf348c636be5b"},{"messageHash":"0x7d596cecc15bcd978842583a963ad86088859e31951d70920c884996af6a55be"},{"messageHash":"0x91f65437100b0e0e5cdd0aec44765308c3a8a421be29e35816298b92ec2990fd"},{"messageHash":"0x0efffa4ba1de2764b0063dfbeb0b4765b9357306b1be115e4d95076ecd3e4fbe"},{"messageHash":"0xa621994c600e8eea68d6f7c6b1c3ca3e543fc97e735c1c1eab63d907a31df4be"},{"messageHash":"0x436c3f543e8a0c5518d6c3f8f8a6e66a1c0917f11321a6ae7ddf5fedb04183c6"},{"messageHash":"0x88929db8face6fb1971a3ed83bb0058d1c7ad4e3440059aa818a69c44cd46f07"},{"messageHash":"0x7a7a498ec5b63cc02948506ef8d196687dfa55c4b112b10910870e559adcbcfc"},{"messageHash":"0xf36e4eebe19a9f3635f439253543105dfa9df1da2151319eea02b0d33cddf1da"}]}'
2026-03-03 04:40:04.734 DEBUG [src.steps.store] messages length is 10
2026-03-03 04:40:04.735 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-03 04:40:04.736 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:28666/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:04.744 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"0cf5def2ccf6a92ab16a","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0xd0ef72ee2d09fd0dacb125d50e926c27ce1c0a9ff8d032ae2c106972dd22c441"},{"messageHash":"0xb99895a9925b5c308f602a2f82a2e7010d0959276bdcbe9ae34bf348c636be5b"},{"messageHash":"0x7d596cecc15bcd978842583a963ad86088859e31951d70920c884996af6a55be"},{"messageHash":"0x91f65437100b0e0e5cdd0aec44765308c3a8a421be29e35816298b92ec2990fd"},{"messageHash":"0x0efffa4ba1de2764b0063dfbeb0b4765b9357306b1be115e4d95076ecd3e4fbe"},{"messageHash":"0xa621994c600e8eea68d6f7c6b1c3ca3e543fc97e735c1c1eab63d907a31df4be"},{"messageHash":"0x436c3f543e8a0c5518d6c3f8f8a6e66a1c0917f11321a6ae7ddf5fedb04183c6"},{"messageHash":"0x88929db8face6fb1971a3ed83bb0058d1c7ad4e3440059aa818a69c44cd46f07"},{"messageHash":"0x7a7a498ec5b63cc02948506ef8d196687dfa55c4b112b10910870e559adcbcfc"},{"messageHash":"0xf36e4eebe19a9f3635f439253543105dfa9df1da2151319eea02b0d33cddf1da"}]}'
2026-03-03 04:40:04.744 DEBUG [src.steps.store] messages length is 10
2026-03-03 04:40:04.745 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-03 04:40:04.745 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42132/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:04.781 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"65431672438a29b166ad","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0xd0ef72ee2d09fd0dacb125d50e926c27ce1c0a9ff8d032ae2c106972dd22c441"},{"messageHash":"0xb99895a9925b5c308f602a2f82a2e7010d0959276bdcbe9ae34bf348c636be5b"},{"messageHash":"0x7d596cecc15bcd978842583a963ad86088859e31951d70920c884996af6a55be"},{"messageHash":"0x91f65437100b0e0e5cdd0aec44765308c3a8a421be29e35816298b92ec2990fd"},{"messageHash":"0x0efffa4ba1de2764b0063dfbeb0b4765b9357306b1be115e4d95076ecd3e4fbe"},{"messageHash":"0xa621994c600e8eea68d6f7c6b1c3ca3e543fc97e735c1c1eab63d907a31df4be"},{"messageHash":"0x436c3f543e8a0c5518d6c3f8f8a6e66a1c0917f11321a6ae7ddf5fedb04183c6"},{"messageHash":"0x88929db8face6fb1971a3ed83bb0058d1c7ad4e3440059aa818a69c44cd46f07"},{"messageHash":"0x7a7a498ec5b63cc02948506ef8d196687dfa55c4b112b10910870e559adcbcfc"},{"messageHash":"0xf36e4eebe19a9f3635f439253543105dfa9df1da2151319eea02b0d33cddf1da"}]}'
2026-03-03 04:40:04.781 DEBUG [src.steps.store] messages length is 10
2026-03-03 04:40:04.790 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-03 04:40:04.794 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-03 04:40:04.794 DEBUG [src.node.waku_node] Stopping container with id 8e193e778d8c
2026-03-03 04:40:05.355 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:40:05.355 DEBUG [src.node.waku_node] Stopping container with id 335f181fc223
2026-03-03 04:40:05.927 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:40:05.927 DEBUG [src.node.waku_node] Stopping container with id 809af45b165c
2026-03-03 04:40:06.168 ERROR [src.node.docker_mananger] Max retries reached for container 8e193e778d8c. Exiting log stream.
2026-03-03 04:40:06.489 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:40:06.490 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-03 04:40:06.502 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-03 04:40:06.514 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-03 04:40:06.527 DEBUG [src.node.docker_mananger] No errors found in the waku logs.