2026-01-02 04:48:27.133 DEBUG [tests.conftest] Running fixture setup: test_id
2026-01-02 04:48:27.133 DEBUG [tests.conftest] Running test: test_sync_with_one_node_with_delayed_start with id: 2026-01-02_04-48-27__da51a645-9ca9-43a7-844f-7679411d8db1
2026-01-02 04:48:27.134 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-01-02 04:48:27.140 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-01-02 04:48:27.140 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-01-02_04-48-27__da51a645-9ca9-43a7-844f-7679411d8db1__wakuorg_nwaku:latest.log
2026-01-02 04:48:27.146 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-01-02 04:48:27.146 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-01-02_04-48-27__da51a645-9ca9-43a7-844f-7679411d8db1__wakuorg_nwaku:latest.log
2026-01-02 04:48:27.152 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-01-02 04:48:27.152 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-01-02_04-48-27__da51a645-9ca9-43a7-844f-7679411d8db1__wakuorg_nwaku:latest.log
2026-01-02 04:48:27.152 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-01-02 04:48:27.153 DEBUG [src.node.waku_node] Starting Node...
2026-01-02 04:48:27.153 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-01-02 04:48:27.155 DEBUG [src.node.docker_mananger] Network waku already exists
2026-01-02 04:48:27.155 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.244.234
2026-01-02 04:48:27.155 DEBUG [src.node.docker_mananger] Generated ports ['11487', '11488', '11489', '11490', '11491']
2026-01-02 04:48:27.155 DEBUG [src.node.waku_node] RLN credentials were not set
2026-01-02 04:48:27.156 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-01-02 04:48:27.156 DEBUG [src.node.waku_node] Using volumes []
2026-01-02 04:48:27.156 DEBUG [src.node.docker_mananger] docker run -i -t -p 11487:11487 -p 11488:11488 -p 11489:11489 -p 11490:11490 -p 11491:11491 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=11489 --rest-port=11487 --tcp-port=11488 --discv5-udp-port=11490 --rest-address=0.0.0.0 --nat=extip:172.18.244.234 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=729baabcc00ad59acccb22ba02fe7de3ced3eebb0bfc325eed11d902d9cacdc3 --store-sync=true --store=true --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=11491 --metrics-logging=true --relay=true
2026-01-02 04:48:27.338 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.244.234 waku 9d7e3608fc46f15a1ce70275ef3c655281dcc30339c34181604f0e389a22047b
2026-01-02 04:48:27.367 DEBUG [src.node.docker_mananger] Container started with ID 9d7e3608fc46. Setting up logs at ./log/docker/node1_2026-01-02_04-48-27__da51a645-9ca9-43a7-844f-7679411d8db1__wakuorg_nwaku:latest.log
2026-01-02 04:48:27.367 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 11487
2026-01-02 04:48:27.367 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-01-02 04:48:27.384 ERROR [src.node.docker_mananger] Max retries reached for container 12bf45e6c297. Exiting log stream.
2026-01-02 04:48:27.933 ERROR [src.node.docker_mananger] Max retries reached for container c9c2d2c740e0. Exiting log stream.
2026-01-02 04:48:28.368 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11487/health" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:48:28.371 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-01-02 04:48:28.372 INFO [src.node.waku_node] Node protocols are initialized !!
2026-01-02 04:48:28.372 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11487/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:48:28.374 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.244.234/tcp/11488/p2p/16Uiu2HAm5SrJPiBWxoPz6QGpSaCAcPBL3N6f6NwxswDMgZfbbM2v","/ip4/172.18.244.234/tcp/11489/ws/p2p/16Uiu2HAm5SrJPiBWxoPz6QGpSaCAcPBL3N6f6NwxswDMgZfbbM2v"],"enrUri":"enr:-L24QDW3SYw-gJD_OrVh4ellYNWFN2R-T018ULAmJLI7kSjsMZsnbokImi0IjHHFqlsn0xMEkfRanJ_zfmNgL4zGTUQCgmlkgnY0gmlwhKwS9OqKbXVsdGlhZGRyc5YACASsEvTqBizgAAoErBL06gYs4d0DgnJzhQADAQAAiXNlY3AyNTZrMaEClOIepBU0F8P7D_EKQaYQZsoTFnAzNy_LLHILbhA-l--DdGNwgizgg3VkcIIs4oV3YWt1MhM"}'
2026-01-02 04:48:28.374 INFO [src.node.waku_node] REST service is ready !!
2026-01-02 04:48:28.374 DEBUG [src.node.waku_node] Starting Node...
2026-01-02 04:48:28.374 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-01-02 04:48:28.376 DEBUG [src.node.docker_mananger] Network waku already exists
2026-01-02 04:48:28.376 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.233.252
2026-01-02 04:48:28.376 DEBUG [src.node.docker_mananger] Generated ports ['13718', '13719', '13720', '13721', '13722']
2026-01-02 04:48:28.376 DEBUG [src.node.waku_node] RLN credentials were not set
2026-01-02 04:48:28.376 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-01-02 04:48:28.376 DEBUG [src.node.waku_node] Using volumes []
2026-01-02 04:48:28.377 DEBUG [src.node.docker_mananger] docker run -i -t -p 13718:13718 -p 13719:13719 -p 13720:13720 -p 13721:13721 -p 13722:13722 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=13720 --rest-port=13718 --tcp-port=13719 --discv5-udp-port=13721 --rest-address=0.0.0.0 --nat=extip:172.18.233.252 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=19f93fa7bddada1dd19cb07ab1df6e16ae86d4d48eaea4c1ff7b5282afbe10f1 --store-sync=true --store=true --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=13722 --metrics-logging=true --relay=true --storenode=/ip4/172.18.244.234/tcp/11488/p2p/16Uiu2HAm5SrJPiBWxoPz6QGpSaCAcPBL3N6f6NwxswDMgZfbbM2v --discv5-bootstrap-node=enr:-L24QDW3SYw-gJD_OrVh4ellYNWFN2R-T018ULAmJLI7kSjsMZsnbokImi0IjHHFqlsn0xMEkfRanJ_zfmNgL4zGTUQCgmlkgnY0gmlwhKwS9OqKbXVsdGlhZGRyc5YACASsEvTqBizgAAoErBL06gYs4d0DgnJzhQADAQAAiXNlY3AyNTZrMaEClOIepBU0F8P7D_EKQaYQZsoTFnAzNy_LLHILbhA-l--DdGNwgizgg3VkcIIs4oV3YWt1MhM
2026-01-02 04:48:28.573 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.233.252 waku 4618d47a3b0d4a60128eea50ccb2622344b9980d6fb7bfa5bcf0adcf5133e2ce
2026-01-02 04:48:28.605 DEBUG [src.node.docker_mananger] Container started with ID 4618d47a3b0d. Setting up logs at ./log/docker/node2_2026-01-02_04-48-27__da51a645-9ca9-43a7-844f-7679411d8db1__wakuorg_nwaku:latest.log
2026-01-02 04:48:28.605 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 13718
2026-01-02 04:48:28.607 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-01-02 04:48:29.607 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13718/health" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:48:29.611 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"READY"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"READY"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-01-02 04:48:29.612 INFO [src.node.waku_node] Node protocols are initialized !!
2026-01-02 04:48:29.612 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13718/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:48:29.614 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.233.252/tcp/13719/p2p/16Uiu2HAm5vWVuWNTXqZg2fiU8RcsVe92U7eJdQTcNXNBHQkyHmiS","/ip4/172.18.233.252/tcp/13720/ws/p2p/16Uiu2HAm5vWVuWNTXqZg2fiU8RcsVe92U7eJdQTcNXNBHQkyHmiS"],"enrUri":"enr:-L24QE-a-wa3aAvp5Cq-H-T1MDQpIagkEMkG3Ct9PSaY_cVlKUgzN2WLeKc3-JXbXbOVqZvMuGckyG90t1lGtylGryYCgmlkgnY0gmlwhKwS6fyKbXVsdGlhZGRyc5YACASsEun8BjWXAAoErBLp_AY1mN0DgnJzhQADAQAAiXNlY3AyNTZrMaECm_f-I7EZ1P8Ea4PPMpSS3ZmK8EIme0Zm9GFhv1rD3zODdGNwgjWXg3VkcII1mYV3YWt1MhM"}'
2026-01-02 04:48:29.614 INFO [src.node.waku_node] REST service is ready !!
2026-01-02 04:48:29.615 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13718/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.244.234/tcp/11488/p2p/16Uiu2HAm5SrJPiBWxoPz6QGpSaCAcPBL3N6f6NwxswDMgZfbbM2v"]'
2026-01-02 04:48:29.617 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:48:29.618 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11487/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-01-02 04:48:29.620 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:48:29.620 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13718/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-01-02 04:48:29.623 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:48:29.623 DEBUG [src.steps.store] Relaying message
2026-01-02 04:48:29.623 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11487/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:48:29.628 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:48:29.629 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:48:29.830 DEBUG [src.steps.store] Relaying message
2026-01-02 04:48:29.830 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11487/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:48:29.836 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:48:29.836 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:48:30.037 DEBUG [src.steps.store] Relaying message
2026-01-02 04:48:30.037 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11487/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:48:30.043 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:48:30.044 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:48:30.245 DEBUG [src.steps.store] Relaying message
2026-01-02 04:48:30.245 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11487/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:48:30.250 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:48:30.251 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:48:30.451 DEBUG [src.steps.store] Relaying message
2026-01-02 04:48:30.452 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11487/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:48:30.457 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:48:30.457 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:48:30.658 DEBUG [src.steps.store] Relaying message
2026-01-02 04:48:30.658 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11487/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:48:30.663 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:48:30.664 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:48:30.864 DEBUG [src.steps.store] Relaying message
2026-01-02 04:48:30.865 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11487/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:48:30.870 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:48:30.871 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:48:31.071 DEBUG [src.steps.store] Relaying message
2026-01-02 04:48:31.072 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11487/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:48:31.077 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:48:31.077 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:48:31.278 DEBUG [src.steps.store] Relaying message
2026-01-02 04:48:31.278 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11487/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:48:31.284 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:48:31.285 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:48:31.486 DEBUG [src.steps.store] Relaying message
2026-01-02 04:48:31.486 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11487/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:48:31.492 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:48:31.492 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:48:31.693 DEBUG [src.node.waku_node] Starting Node...
2026-01-02 04:48:31.693 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-01-02 04:48:31.695 DEBUG [src.node.docker_mananger] Network waku already exists
2026-01-02 04:48:31.695 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.22.214
2026-01-02 04:48:31.695 DEBUG [src.node.docker_mananger] Generated ports ['17494', '17495', '17496', '17497', '17498']
2026-01-02 04:48:31.696 DEBUG [src.node.waku_node] RLN credentials were not set
2026-01-02 04:48:31.696 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-01-02 04:48:31.696 DEBUG [src.node.waku_node] Using volumes []
2026-01-02 04:48:31.696 DEBUG [src.node.docker_mananger] docker run -i -t -p 17494:17494 -p 17495:17495 -p 17496:17496 -p 17497:17497 -p 17498:17498 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=17496 --rest-port=17494 --tcp-port=17495 --discv5-udp-port=17497 --rest-address=0.0.0.0 --nat=extip:172.18.22.214 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ccf5da19aa5fee2dc95d1ac35a0ccaaced7b1b419b38846edbc1bdcffd18e4a9 --store-sync=true --store=false --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=17498 --metrics-logging=true --relay=true --storenode=/ip4/172.18.233.252/tcp/13719/p2p/16Uiu2HAm5vWVuWNTXqZg2fiU8RcsVe92U7eJdQTcNXNBHQkyHmiS --discv5-bootstrap-node=enr:-L24QE-a-wa3aAvp5Cq-H-T1MDQpIagkEMkG3Ct9PSaY_cVlKUgzN2WLeKc3-JXbXbOVqZvMuGckyG90t1lGtylGryYCgmlkgnY0gmlwhKwS6fyKbXVsdGlhZGRyc5YACASsEun8BjWXAAoErBLp_AY1mN0DgnJzhQADAQAAiXNlY3AyNTZrMaECm_f-I7EZ1P8Ea4PPMpSS3ZmK8EIme0Zm9GFhv1rD3zODdGNwgjWXg3VkcII1mYV3YWt1MhM
2026-01-02 04:48:31.891 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.22.214 waku cd1c40063e16d4db616b8956ecdf2360dbe6bef30bc461165b6cb9a6296d83cd
2026-01-02 04:48:31.921 DEBUG [src.node.docker_mananger] Container started with ID cd1c40063e16. Setting up logs at ./log/docker/node3_2026-01-02_04-48-27__da51a645-9ca9-43a7-844f-7679411d8db1__wakuorg_nwaku:latest.log
2026-01-02 04:48:31.921 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 17494
2026-01-02 04:48:31.921 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-01-02 04:48:32.922 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17494/health" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:48:32.925 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"READY"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-01-02 04:48:32.925 INFO [src.node.waku_node] Node protocols are initialized !!
2026-01-02 04:48:32.926 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17494/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:48:32.928 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.22.214/tcp/17495/p2p/16Uiu2HAmCVR6F78mBvKBC5YZVbNG5g9xjeE6VfukKhvzjxNBX3it","/ip4/172.18.22.214/tcp/17496/ws/p2p/16Uiu2HAmCVR6F78mBvKBC5YZVbNG5g9xjeE6VfukKhvzjxNBX3it"],"enrUri":"enr:-L24QCYjWLsm1nulcw8Jw14jT6tMH_xqEOns0Fc39D0lX-EwEUM6Ha_QeSZGz6toSHJ8llNQm6Urwzc9nWthRj08DIkCgmlkgnY0gmlwhKwSFtaKbXVsdGlhZGRyc5YACASsEhbWBkRXAAoErBIW1gZEWN0DgnJzhQADAQAAiXNlY3AyNTZrMaEC_YwqiugToHRMAzNFHKbP9O7TmHdn5IgRNSZ_7PcqCPWDdGNwgkRXg3VkcIJEWYV3YWt1MgE"}'
2026-01-02 04:48:32.928 INFO [src.node.waku_node] REST service is ready !!
2026-01-02 04:48:32.928 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17494/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.233.252/tcp/13719/p2p/16Uiu2HAm5vWVuWNTXqZg2fiU8RcsVe92U7eJdQTcNXNBHQkyHmiS"]'
2026-01-02 04:48:32.965 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:48:32.967 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17494/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-01-02 04:48:32.971 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:48:32.971 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-01-02 04:48:33.972 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-01-02 04:48:33.973 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11487/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:48:33.976 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0xd0432a3a4419cd7ae986ba52eeaa402ec2de05cabde06b8196b679e3b0731f47"},{"messageHash":"0x0ab2b008ee62840efab046a960651ffd6dc4fae1bf3720906aab1ad54c234913"},{"messageHash":"0x5f0da74b53b4679ddc42989da852911d8b79236b380a902f64326583c1d9f049"},{"messageHash":"0xbf5f95f2bb190f3e7c95c51379b87c504d8aaacb9ecc0bb8f3716589f30a949a"},{"messageHash":"0xed84ebbf6644999570c68e3169d50116df7b14ac69c863601097f1617ea0379f"},{"messageHash":"0x33c55f31d79ce9c3c79469e8de1a74448fae9c4d1c2a287da45c4247e4fad0e0"},{"messageHash":"0xc343ce0bf76e243fe804b3f6bbf9d80a8dca0c971978c91f087a51ba64218cde"},{"messageHash":"0x67653be6657bce0d7ba226d669c3f5e24ee92b81421d226e8a654e78d632b505"},{"messageHash":"0x8dda136b88dacfb28fb5ba144dcaca563d3fb3bad70d92cc8eb743aeddc2b692"},{"messageHash":"0xdb0c76ce61cebff199cd0a41efc554a273dfbc4621cca9d577ebfafbe534a05f"}]}'
2026-01-02 04:48:33.976 DEBUG [src.steps.store] messages length is 10
2026-01-02 04:48:33.978 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-01-02 04:48:33.978 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13718/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:48:33.981 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0xd0432a3a4419cd7ae986ba52eeaa402ec2de05cabde06b8196b679e3b0731f47"},{"messageHash":"0x0ab2b008ee62840efab046a960651ffd6dc4fae1bf3720906aab1ad54c234913"},{"messageHash":"0x5f0da74b53b4679ddc42989da852911d8b79236b380a902f64326583c1d9f049"},{"messageHash":"0xbf5f95f2bb190f3e7c95c51379b87c504d8aaacb9ecc0bb8f3716589f30a949a"},{"messageHash":"0xed84ebbf6644999570c68e3169d50116df7b14ac69c863601097f1617ea0379f"},{"messageHash":"0x33c55f31d79ce9c3c79469e8de1a74448fae9c4d1c2a287da45c4247e4fad0e0"},{"messageHash":"0xc343ce0bf76e243fe804b3f6bbf9d80a8dca0c971978c91f087a51ba64218cde"},{"messageHash":"0x67653be6657bce0d7ba226d669c3f5e24ee92b81421d226e8a654e78d632b505"},{"messageHash":"0x8dda136b88dacfb28fb5ba144dcaca563d3fb3bad70d92cc8eb743aeddc2b692"},{"messageHash":"0xdb0c76ce61cebff199cd0a41efc554a273dfbc4621cca9d577ebfafbe534a05f"}]}'
2026-01-02 04:48:33.981 DEBUG [src.steps.store] messages length is 10
2026-01-02 04:48:33.983 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-01-02 04:48:33.983 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17494/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:48:33.991 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"8f4fc29f1c96a15373a8","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0xd0432a3a4419cd7ae986ba52eeaa402ec2de05cabde06b8196b679e3b0731f47"},{"messageHash":"0x0ab2b008ee62840efab046a960651ffd6dc4fae1bf3720906aab1ad54c234913"},{"messageHash":"0x5f0da74b53b4679ddc42989da852911d8b79236b380a902f64326583c1d9f049"},{"messageHash":"0xbf5f95f2bb190f3e7c95c51379b87c504d8aaacb9ecc0bb8f3716589f30a949a"},{"messageHash":"0xed84ebbf6644999570c68e3169d50116df7b14ac69c863601097f1617ea0379f"},{"messageHash":"0x33c55f31d79ce9c3c79469e8de1a74448fae9c4d1c2a287da45c4247e4fad0e0"},{"messageHash":"0xc343ce0bf76e243fe804b3f6bbf9d80a8dca0c971978c91f087a51ba64218cde"},{"messageHash":"0x67653be6657bce0d7ba226d669c3f5e24ee92b81421d226e8a654e78d632b505"},{"messageHash":"0x8dda136b88dacfb28fb5ba144dcaca563d3fb3bad70d92cc8eb743aeddc2b692"},{"messageHash":"0xdb0c76ce61cebff199cd0a41efc554a273dfbc4621cca9d577ebfafbe534a05f"}]}'
2026-01-02 04:48:33.992 DEBUG [src.steps.store] messages length is 10
2026-01-02 04:48:33.994 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-01-02 04:48:33.996 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-01-02 04:48:33.996 DEBUG [src.node.waku_node] Stopping container with id 9d7e3608fc46
2026-01-02 04:48:34.531 DEBUG [src.node.waku_node] Container stopped.
2026-01-02 04:48:34.532 DEBUG [src.node.waku_node] Stopping container with id 4618d47a3b0d
2026-01-02 04:48:35.104 DEBUG [src.node.waku_node] Container stopped.
2026-01-02 04:48:35.105 DEBUG [src.node.waku_node] Stopping container with id cd1c40063e16
2026-01-02 04:48:35.377 ERROR [src.node.docker_mananger] Max retries reached for container 9d7e3608fc46. Exiting log stream.
2026-01-02 04:48:35.624 DEBUG [src.node.waku_node] Container stopped.
2026-01-02 04:48:35.626 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-01-02 04:48:35.641 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-01-02 04:48:35.653 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-01-02 04:48:35.660 DEBUG [src.node.docker_mananger] No errors found in the waku logs.