141 lines
26 KiB
Plaintext

2026-03-21 04:37:21.224 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-21 04:37:21.224 DEBUG [tests.conftest] Running test: test_sync_nodes_are_not_relay_and_have_storenode_set with id: 2026-03-21_04-37-21__65382320-5e1e-4a8f-b701-ca4921ce624c
2026-03-21 04:37:21.225 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-21 04:37:21.233 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-21 04:37:21.233 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-21_04-37-21__65382320-5e1e-4a8f-b701-ca4921ce624c__wakuorg_nwaku:latest.log
2026-03-21 04:37:21.240 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-21 04:37:21.240 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-21_04-37-21__65382320-5e1e-4a8f-b701-ca4921ce624c__wakuorg_nwaku:latest.log
2026-03-21 04:37:21.247 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-21 04:37:21.247 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-21_04-37-21__65382320-5e1e-4a8f-b701-ca4921ce624c__wakuorg_nwaku:latest.log
2026-03-21 04:37:21.248 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-21 04:37:21.248 DEBUG [src.node.waku_node] Starting Node...
2026-03-21 04:37:21.249 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-21 04:37:21.250 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-21 04:37:21.250 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.255.186
2026-03-21 04:37:21.250 DEBUG [src.node.docker_mananger] Generated ports ['14401', '14402', '14403', '14404', '14405']
2026-03-21 04:37:21.251 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-21 04:37:21.251 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-21 04:37:21.251 DEBUG [src.node.waku_node] Using volumes []
2026-03-21 04:37:21.251 DEBUG [src.node.docker_mananger] docker run -i -t -p 14401:14401 -p 14402:14402 -p 14403:14403 -p 14404:14404 -p 14405:14405 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=14403 --rest-port=14401 --tcp-port=14402 --discv5-udp-port=14404 --rest-address=0.0.0.0 --nat=extip:172.18.255.186 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=8d6e25fc70bc00d49199f2372aebfcc4b46e1ca1432f0fa6783b2ccb90b98bde --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=14405 --metrics-logging=true --store=true --relay=true
2026-03-21 04:37:21.431 ERROR [src.node.docker_mananger] Max retries reached for container f3d29751ec4a. Exiting log stream.
2026-03-21 04:37:21.452 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.255.186 waku f0b98b4aa62edb2b011bb3ac2f74990df72a31eafb708fb346ce1dfd1f0d6e66
2026-03-21 04:37:21.488 DEBUG [src.node.docker_mananger] Container started with ID f0b98b4aa62e. Setting up logs at ./log/docker/node1_2026-03-21_04-37-21__65382320-5e1e-4a8f-b701-ca4921ce624c__wakuorg_nwaku:latest.log
2026-03-21 04:37:21.489 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 14401
2026-03-21 04:37:21.491 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-21 04:37:22.006 ERROR [src.node.docker_mananger] Max retries reached for container 2998b358a926. Exiting log stream.
2026-03-21 04:37:22.492 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14401/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:37:22.495 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-21 04:37:22.496 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-21 04:37:22.496 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14401/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:37:22.499 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.255.186/tcp/14402/p2p/16Uiu2HAmE2nu62f1A2xM9Cv8VZeNApXjHuUf5j3DfeTujBvoJJoA","/ip4/172.18.255.186/tcp/14403/ws/p2p/16Uiu2HAmE2nu62f1A2xM9Cv8VZeNApXjHuUf5j3DfeTujBvoJJoA"],"enrUri":"enr:-L24QMXRQPxIXyDOZ_VbRI7nSlktpdASMBje24bsQeOVeMMPLnUSvamHtkMC3JSa8P2QukRiiVdBj_f19n3IICT5B_MCgmlkgnY0gmlwhKwS_7qKbXVsdGlhZGRyc5YACASsEv-6BjhCAAoErBL_ugY4Q90DgnJzhQADAQAAiXNlY3AyNTZrMaEDFHGEI_5apdpJLHyEQwO__-Bmy5KqrmZ2yqpY4f0SbQGDdGNwgjhCg3VkcII4RIV3YWt1MgM"}'
2026-03-21 04:37:22.499 INFO [src.node.waku_node] REST service is ready !!
2026-03-21 04:37:22.499 DEBUG [src.node.waku_node] Starting Node...
2026-03-21 04:37:22.499 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-21 04:37:22.501 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-21 04:37:22.501 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.255.40
2026-03-21 04:37:22.501 DEBUG [src.node.docker_mananger] Generated ports ['56319', '56320', '56321', '56322', '56323']
2026-03-21 04:37:22.501 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-21 04:37:22.502 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-21 04:37:22.502 DEBUG [src.node.waku_node] Using volumes []
2026-03-21 04:37:22.502 DEBUG [src.node.docker_mananger] docker run -i -t -p 56319:56319 -p 56320:56320 -p 56321:56321 -p 56322:56322 -p 56323:56323 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=56321 --rest-port=56319 --tcp-port=56320 --discv5-udp-port=56322 --rest-address=0.0.0.0 --nat=extip:172.18.255.40 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=d5dab7df7afcae4ca71eb4d3ae14dfe9c941bbaf5c9d5e7ff5c04b3a0acb2fa8 --store-sync=true --store=false --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=56323 --metrics-logging=true --relay=false --storenode=/ip4/172.18.255.186/tcp/14402/p2p/16Uiu2HAmE2nu62f1A2xM9Cv8VZeNApXjHuUf5j3DfeTujBvoJJoA --discv5-bootstrap-node=enr:-L24QMXRQPxIXyDOZ_VbRI7nSlktpdASMBje24bsQeOVeMMPLnUSvamHtkMC3JSa8P2QukRiiVdBj_f19n3IICT5B_MCgmlkgnY0gmlwhKwS_7qKbXVsdGlhZGRyc5YACASsEv-6BjhCAAoErBL_ugY4Q90DgnJzhQADAQAAiXNlY3AyNTZrMaEDFHGEI_5apdpJLHyEQwO__-Bmy5KqrmZ2yqpY4f0SbQGDdGNwgjhCg3VkcII4RIV3YWt1MgM
2026-03-21 04:37:22.710 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.255.40 waku d49c1db11b1b1baf1f01dbdd6212242233dffff37a7311aa5d8b74b1bf570676
2026-03-21 04:37:22.745 DEBUG [src.node.docker_mananger] Container started with ID d49c1db11b1b. Setting up logs at ./log/docker/node2_2026-03-21_04-37-21__65382320-5e1e-4a8f-b701-ca4921ce624c__wakuorg_nwaku:latest.log
2026-03-21 04:37:22.745 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 56319
2026-03-21 04:37:22.745 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-21 04:37:23.746 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56319/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:37:23.751 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-21 04:37:23.752 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-21 04:37:23.752 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56319/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:37:23.754 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.255.40/tcp/56320/p2p/16Uiu2HAkyh44BwhFYb1kQezuuAcqYapDzPXkDu8bEdKN1uWiCfJj","/ip4/172.18.255.40/tcp/56321/ws/p2p/16Uiu2HAkyh44BwhFYb1kQezuuAcqYapDzPXkDu8bEdKN1uWiCfJj"],"enrUri":"enr:-L24QMKU4HdfAdZQkYuYSMsBpKG44nMhDRaGrMi_2bCoOH3CaOGXCa86x-QyrXBSwmYfgDXT7zWWJE9iGZHXVwwK3dUCgmlkgnY0gmlwhKwS_yiKbXVsdGlhZGRyc5YACASsEv8oBtwAAAoErBL_KAbcAd0DgnJzhQADAQAAiXNlY3AyNTZrMaECP19rx_SJh8F9LhHc-7S8qAL_F-CIoGdxBOtYho44p8SDdGNwgtwAg3VkcILcAoV3YWt1MgA"}'
2026-03-21 04:37:23.754 INFO [src.node.waku_node] REST service is ready !!
2026-03-21 04:37:23.755 DEBUG [src.node.waku_node] Starting Node...
2026-03-21 04:37:23.755 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-21 04:37:23.756 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-21 04:37:23.756 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.75.51
2026-03-21 04:37:23.756 DEBUG [src.node.docker_mananger] Generated ports ['38282', '38283', '38284', '38285', '38286']
2026-03-21 04:37:23.756 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-21 04:37:23.757 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-21 04:37:23.757 DEBUG [src.node.waku_node] Using volumes []
2026-03-21 04:37:23.757 DEBUG [src.node.docker_mananger] docker run -i -t -p 38282:38282 -p 38283:38283 -p 38284:38284 -p 38285:38285 -p 38286:38286 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=38284 --rest-port=38282 --tcp-port=38283 --discv5-udp-port=38285 --rest-address=0.0.0.0 --nat=extip:172.18.75.51 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=2d1795ccae8edebbfba790ebb96e4fbb4a41eee341b9a09afada71d8aa74f1a7 --store-sync=true --store=false --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=38286 --metrics-logging=true --relay=false --storenode=/ip4/172.18.255.186/tcp/14402/p2p/16Uiu2HAmE2nu62f1A2xM9Cv8VZeNApXjHuUf5j3DfeTujBvoJJoA --discv5-bootstrap-node=enr:-L24QMKU4HdfAdZQkYuYSMsBpKG44nMhDRaGrMi_2bCoOH3CaOGXCa86x-QyrXBSwmYfgDXT7zWWJE9iGZHXVwwK3dUCgmlkgnY0gmlwhKwS_yiKbXVsdGlhZGRyc5YACASsEv8oBtwAAAoErBL_KAbcAd0DgnJzhQADAQAAiXNlY3AyNTZrMaECP19rx_SJh8F9LhHc-7S8qAL_F-CIoGdxBOtYho44p8SDdGNwgtwAg3VkcILcAoV3YWt1MgA
2026-03-21 04:37:23.954 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.75.51 waku bd3810ae1c5d0a626526e16a43e73dc4c8581317f8ef9ab6db9bb0a1c165e6f0
2026-03-21 04:37:23.986 DEBUG [src.node.docker_mananger] Container started with ID bd3810ae1c5d. Setting up logs at ./log/docker/node3_2026-03-21_04-37-21__65382320-5e1e-4a8f-b701-ca4921ce624c__wakuorg_nwaku:latest.log
2026-03-21 04:37:23.987 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 38282
2026-03-21 04:37:23.987 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-21 04:37:24.988 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38282/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:37:24.991 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-21 04:37:24.991 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-21 04:37:24.991 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38282/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:37:24.994 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.75.51/tcp/38283/p2p/16Uiu2HAmQuc5gY1EB39gHPsswZWCRteXV37gKsrmnRMgQcmacGvV","/ip4/172.18.75.51/tcp/38284/ws/p2p/16Uiu2HAmQuc5gY1EB39gHPsswZWCRteXV37gKsrmnRMgQcmacGvV"],"enrUri":"enr:-L24QE5VTtZW8Chi9UuCGVy3rvisjfqg9fowXk16uDOmUHi0WKBsJeLk-XgdDrdIEEW86a4xu5HNonmOrffpDbSc7fcCgmlkgnY0gmlwhKwSSzOKbXVsdGlhZGRyc5YACASsEkszBpWLAAoErBJLMwaVjN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDtgrGh7AbYYjkHcWoEeLD0nSUYMBMUfW_ExS7CoefboKDdGNwgpWLg3VkcIKVjYV3YWt1MgA"}'
2026-03-21 04:37:24.994 INFO [src.node.waku_node] REST service is ready !!
2026-03-21 04:37:24.994 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:56319/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.255.186/tcp/14402/p2p/16Uiu2HAmE2nu62f1A2xM9Cv8VZeNApXjHuUf5j3DfeTujBvoJJoA"]'
2026-03-21 04:37:25.031 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:37:25.034 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38282/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.255.40/tcp/56320/p2p/16Uiu2HAkyh44BwhFYb1kQezuuAcqYapDzPXkDu8bEdKN1uWiCfJj"]'
2026-03-21 04:37:25.079 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:37:25.081 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14401/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-21 04:37:25.088 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:37:25.088 DEBUG [src.steps.store] Relaying message
2026-03-21 04:37:25.089 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14401/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:37:25.095 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:37:25.095 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:37:25.295 DEBUG [src.steps.store] Relaying message
2026-03-21 04:37:25.296 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14401/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:37:25.300 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:37:25.300 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:37:25.501 DEBUG [src.steps.store] Relaying message
2026-03-21 04:37:25.501 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14401/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:37:25.505 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:37:25.505 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:37:25.706 DEBUG [src.steps.store] Relaying message
2026-03-21 04:37:25.706 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14401/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:37:25.710 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:37:25.710 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:37:25.911 DEBUG [src.steps.store] Relaying message
2026-03-21 04:37:25.911 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14401/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:37:25.915 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:37:25.915 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:37:26.116 DEBUG [src.steps.store] Relaying message
2026-03-21 04:37:26.116 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14401/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:37:26.120 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:37:26.120 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:37:26.321 DEBUG [src.steps.store] Relaying message
2026-03-21 04:37:26.321 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14401/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:37:26.325 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:37:26.325 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:37:26.526 DEBUG [src.steps.store] Relaying message
2026-03-21 04:37:26.526 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14401/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:37:26.530 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:37:26.530 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:37:26.731 DEBUG [src.steps.store] Relaying message
2026-03-21 04:37:26.731 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14401/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:37:26.735 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:37:26.735 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:37:26.936 DEBUG [src.steps.store] Relaying message
2026-03-21 04:37:26.936 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14401/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:37:26.940 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:37:26.941 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:37:27.141 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-21 04:37:27.142 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14401/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:37:27.145 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x52e0baeb85f27a84b80acc4b3a25e6311ae5c71d1b5ffd67fcf40f60ec9a5db5"},{"messageHash":"0x28a10f19d0f03b92d48a80e88777e7c12f1ce03ba5c98b61f745a2359c4796fa"},{"messageHash":"0xaf9e017df138a0b41aedf2d499463934b4a5c5dc39ca5de7b9705d2d52741023"},{"messageHash":"0x54122b4b59d2c861b3341af77905a089b9d9d536d177c80155a17aa0b8823a60"},{"messageHash":"0xccfaa40321670bf97ad26ceb297ee57ded426112394f2af7910ec69cd94d0f4d"},{"messageHash":"0x76c541617f6b4c83d5e319387fcb71466de028d254f44711e15c3f82e1753489"},{"messageHash":"0xc1d014149bb81177ffa12f416fb13fe08740f195976a41518c7c0442125992aa"},{"messageHash":"0xa2935ec823cacb3ae0a8509aba034e1347ad9a5deea2e6bfef59ad2e56e61ea8"},{"messageHash":"0xe7d6f02806728761780b1251712a999aa51097c366d225be06b1ab1c0c46cfac"},{"messageHash":"0x40b3c7998e442bacceca6df5cb749c4bf22908c1948a193b58b3b8918d45f88d"}]}'
2026-03-21 04:37:27.145 DEBUG [src.steps.store] messages length is 10
2026-03-21 04:37:27.147 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-21 04:37:27.147 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56319/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:37:27.156 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"6ed42fe6062bb17989ae","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x52e0baeb85f27a84b80acc4b3a25e6311ae5c71d1b5ffd67fcf40f60ec9a5db5"},{"messageHash":"0x28a10f19d0f03b92d48a80e88777e7c12f1ce03ba5c98b61f745a2359c4796fa"},{"messageHash":"0xaf9e017df138a0b41aedf2d499463934b4a5c5dc39ca5de7b9705d2d52741023"},{"messageHash":"0x54122b4b59d2c861b3341af77905a089b9d9d536d177c80155a17aa0b8823a60"},{"messageHash":"0xccfaa40321670bf97ad26ceb297ee57ded426112394f2af7910ec69cd94d0f4d"},{"messageHash":"0x76c541617f6b4c83d5e319387fcb71466de028d254f44711e15c3f82e1753489"},{"messageHash":"0xc1d014149bb81177ffa12f416fb13fe08740f195976a41518c7c0442125992aa"},{"messageHash":"0xa2935ec823cacb3ae0a8509aba034e1347ad9a5deea2e6bfef59ad2e56e61ea8"},{"messageHash":"0xe7d6f02806728761780b1251712a999aa51097c366d225be06b1ab1c0c46cfac"},{"messageHash":"0x40b3c7998e442bacceca6df5cb749c4bf22908c1948a193b58b3b8918d45f88d"}]}'
2026-03-21 04:37:27.156 DEBUG [src.steps.store] messages length is 10
2026-03-21 04:37:27.158 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-21 04:37:27.158 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38282/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:37:27.190 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"7b7f109c4a0f13658cc7","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x52e0baeb85f27a84b80acc4b3a25e6311ae5c71d1b5ffd67fcf40f60ec9a5db5"},{"messageHash":"0x28a10f19d0f03b92d48a80e88777e7c12f1ce03ba5c98b61f745a2359c4796fa"},{"messageHash":"0xaf9e017df138a0b41aedf2d499463934b4a5c5dc39ca5de7b9705d2d52741023"},{"messageHash":"0x54122b4b59d2c861b3341af77905a089b9d9d536d177c80155a17aa0b8823a60"},{"messageHash":"0xccfaa40321670bf97ad26ceb297ee57ded426112394f2af7910ec69cd94d0f4d"},{"messageHash":"0x76c541617f6b4c83d5e319387fcb71466de028d254f44711e15c3f82e1753489"},{"messageHash":"0xc1d014149bb81177ffa12f416fb13fe08740f195976a41518c7c0442125992aa"},{"messageHash":"0xa2935ec823cacb3ae0a8509aba034e1347ad9a5deea2e6bfef59ad2e56e61ea8"},{"messageHash":"0xe7d6f02806728761780b1251712a999aa51097c366d225be06b1ab1c0c46cfac"},{"messageHash":"0x40b3c7998e442bacceca6df5cb749c4bf22908c1948a193b58b3b8918d45f88d"}]}'
2026-03-21 04:37:27.191 DEBUG [src.steps.store] messages length is 10
2026-03-21 04:37:27.202 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-21 04:37:27.205 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-21 04:37:27.205 DEBUG [src.node.waku_node] Stopping container with id f0b98b4aa62e
2026-03-21 04:37:27.755 DEBUG [src.node.waku_node] Container stopped.
2026-03-21 04:37:27.757 DEBUG [src.node.waku_node] Stopping container with id d49c1db11b1b
2026-03-21 04:37:28.377 DEBUG [src.node.waku_node] Container stopped.
2026-03-21 04:37:28.378 DEBUG [src.node.waku_node] Stopping container with id bd3810ae1c5d
2026-03-21 04:37:28.572 ERROR [src.node.docker_mananger] Max retries reached for container f0b98b4aa62e. Exiting log stream.
2026-03-21 04:37:28.925 DEBUG [src.node.waku_node] Container stopped.
2026-03-21 04:37:28.925 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-21 04:37:28.937 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-21 04:37:28.950 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-21 04:37:28.956 DEBUG [src.node.docker_mananger] No errors found in the waku logs.