269 lines
48 KiB
Plaintext

2026-02-27 04:42:56.273 DEBUG [tests.conftest] Running fixture setup: test_id
2026-02-27 04:42:56.273 DEBUG [tests.conftest] Running test: test_store_sync_long_chain with id: 2026-02-27_04-42-56__c2e3914e-aaea-4125-b956-1430e2284ec9
2026-02-27 04:42:56.273 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-02-27 04:42:56.280 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-27 04:42:56.280 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-02-27_04-42-56__c2e3914e-aaea-4125-b956-1430e2284ec9__wakuorg_nwaku:latest.log
2026-02-27 04:42:56.287 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-27 04:42:56.287 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-02-27_04-42-56__c2e3914e-aaea-4125-b956-1430e2284ec9__wakuorg_nwaku:latest.log
2026-02-27 04:42:56.293 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-27 04:42:56.293 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-02-27_04-42-56__c2e3914e-aaea-4125-b956-1430e2284ec9__wakuorg_nwaku:latest.log
2026-02-27 04:42:56.293 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-02-27 04:42:56.294 DEBUG [src.node.waku_node] Starting Node...
2026-02-27 04:42:56.294 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-27 04:42:56.296 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-27 04:42:56.296 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.58.87
2026-02-27 04:42:56.296 DEBUG [src.node.docker_mananger] Generated ports ['54130', '54131', '54132', '54133', '54134']
2026-02-27 04:42:56.296 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-27 04:42:56.296 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-27 04:42:56.297 DEBUG [src.node.waku_node] Using volumes []
2026-02-27 04:42:56.297 DEBUG [src.node.docker_mananger] docker run -i -t -p 54130:54130 -p 54131:54131 -p 54132:54132 -p 54133:54133 -p 54134:54134 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=54132 --rest-port=54130 --tcp-port=54131 --discv5-udp-port=54133 --rest-address=0.0.0.0 --nat=extip:172.18.58.87 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=0cdfa5a3ab0e6d46fd37ca4ae0d512d94a3d09bbd09eead7d5ecb5a1df64b51f --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=54134 --metrics-logging=true --store-sync-relay-jitter=0 --relay=true --dns-discovery=false
2026-02-27 04:42:56.498 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.58.87 waku 01a989cbdb0cba492a60bbbd798bab6a24d0c0a2100c8b3afa343826ca0245d5
2026-02-27 04:42:56.511 ERROR [src.node.docker_mananger] Max retries reached for container 7fa13e3f7c20. Exiting log stream.
2026-02-27 04:42:56.538 DEBUG [src.node.docker_mananger] Container started with ID 01a989cbdb0c. Setting up logs at ./log/docker/node1_2026-02-27_04-42-56__c2e3914e-aaea-4125-b956-1430e2284ec9__wakuorg_nwaku:latest.log
2026-02-27 04:42:56.539 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 54130
2026-02-27 04:42:56.541 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-27 04:42:57.071 ERROR [src.node.docker_mananger] Max retries reached for container 15397492fc7f. Exiting log stream.
2026-02-27 04:42:57.542 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54130/health" -H "Content-Type: application/json" -d 'None'
2026-02-27 04:42:57.545 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-27 04:42:57.545 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-27 04:42:57.545 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54130/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-27 04:42:57.547 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.58.87/tcp/54131/p2p/16Uiu2HAmRz2EmRVp7dPHiN9x67X2ycjRuUdG3L13U9SUZxyXoaU5","/ip4/172.18.58.87/tcp/54132/ws/p2p/16Uiu2HAmRz2EmRVp7dPHiN9x67X2ycjRuUdG3L13U9SUZxyXoaU5"],"enrUri":"enr:-L24QHir9cWaszxlARxBCv2B3gunJ299-VWcGjE_gkLAg4w8HMy0joP70YlNgYe2kOUDmPVj3gHJZvt9XXIH2p9oFtICgmlkgnY0gmlwhKwSOleKbXVsdGlhZGRyc5YACASsEjpXBtNzAAoErBI6VwbTdN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDxggZguyJl93alfPOY6itd3GEUywQrEpVq6QsQJO0UpaDdGNwgtNzg3VkcILTdYV3YWt1MhM"}'
2026-02-27 04:42:57.548 INFO [src.node.waku_node] REST service is ready !!
2026-02-27 04:42:57.548 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54130/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-02-27 04:42:57.565 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-27 04:42:57.572 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-27 04:42:57.572 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-02-27_04-42-56__c2e3914e-aaea-4125-b956-1430e2284ec9__wakuorg_nwaku:latest.log
2026-02-27 04:42:57.579 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-27 04:42:57.579 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-02-27_04-42-56__c2e3914e-aaea-4125-b956-1430e2284ec9__wakuorg_nwaku:latest.log
2026-02-27 04:42:57.585 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-27 04:42:57.585 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node6_2026-02-27_04-42-56__c2e3914e-aaea-4125-b956-1430e2284ec9__wakuorg_nwaku:latest.log
2026-02-27 04:42:57.591 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-27 04:42:57.591 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node7_2026-02-27_04-42-56__c2e3914e-aaea-4125-b956-1430e2284ec9__wakuorg_nwaku:latest.log
2026-02-27 04:42:57.597 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-27 04:42:57.597 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node8_2026-02-27_04-42-56__c2e3914e-aaea-4125-b956-1430e2284ec9__wakuorg_nwaku:latest.log
2026-02-27 04:42:57.597 DEBUG [src.node.waku_node] Starting Node...
2026-02-27 04:42:57.597 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-27 04:42:57.598 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-27 04:42:57.599 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.250.205
2026-02-27 04:42:57.599 DEBUG [src.node.docker_mananger] Generated ports ['6492', '6493', '6494', '6495', '6496']
2026-02-27 04:42:57.599 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-27 04:42:57.599 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-27 04:42:57.599 DEBUG [src.node.waku_node] Using volumes []
2026-02-27 04:42:57.599 DEBUG [src.node.docker_mananger] docker run -i -t -p 6492:6492 -p 6493:6493 -p 6494:6494 -p 6495:6495 -p 6496:6496 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=6494 --rest-port=6492 --tcp-port=6493 --discv5-udp-port=6495 --rest-address=0.0.0.0 --nat=extip:172.18.250.205 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=afd47ba53daedec86accab9aaecbc9accc7f7acbafccfdee912140ba2cd9e2ed --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=6496 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false
2026-02-27 04:42:57.789 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.250.205 waku 535d63eefea981f90d5899496859d71381d1620fd0b918cec59ecbc4a915247e
2026-02-27 04:42:57.823 DEBUG [src.node.docker_mananger] Container started with ID 535d63eefea9. Setting up logs at ./log/docker/node2_2026-02-27_04-42-56__c2e3914e-aaea-4125-b956-1430e2284ec9__wakuorg_nwaku:latest.log
2026-02-27 04:42:57.824 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 6492
2026-02-27 04:42:57.824 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-27 04:42:58.826 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6492/health" -H "Content-Type: application/json" -d 'None'
2026-02-27 04:42:58.828 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-27 04:42:58.829 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-27 04:42:58.829 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6492/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-27 04:42:58.831 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.250.205/tcp/6493/p2p/16Uiu2HAm5vLJ49iV2P39wi9QT6t1eF79HAKe6oRtVswPXcrgurV5","/ip4/172.18.250.205/tcp/6494/ws/p2p/16Uiu2HAm5vLJ49iV2P39wi9QT6t1eF79HAKe6oRtVswPXcrgurV5"],"enrUri":"enr:-L24QHWy_BqSpFC4M9yFn0YuzHarNgM6J_2y2goW_Yv_-lI3E5pEbYgHMwoBRJpGuF459o8oBu1syvbbmYF31Gl8wB4CgmlkgnY0gmlwhKwS-s2KbXVsdGlhZGRyc5YACASsEvrNBhldAAoErBL6zQYZXt0DgnJzhQADAQAAiXNlY3AyNTZrMaECm-x0ZMdaE9iMkNwk0PGgDHJLUSTLznHHy63yo85mWzCDdGNwghldg3VkcIIZX4V3YWt1MhI"}'
2026-02-27 04:42:58.831 INFO [src.node.waku_node] REST service is ready !!
2026-02-27 04:42:58.832 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:6492/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.58.87/tcp/54131/p2p/16Uiu2HAmRz2EmRVp7dPHiN9x67X2ycjRuUdG3L13U9SUZxyXoaU5"]'
2026-02-27 04:42:58.865 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-27 04:42:58.865 DEBUG [src.node.waku_node] Starting Node...
2026-02-27 04:42:58.866 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-27 04:42:58.875 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-27 04:42:58.875 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.21.186
2026-02-27 04:42:58.876 DEBUG [src.node.docker_mananger] Generated ports ['63912', '63913', '63914', '63915', '63916']
2026-02-27 04:42:58.881 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-27 04:42:58.881 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-27 04:42:58.881 DEBUG [src.node.waku_node] Using volumes []
2026-02-27 04:42:58.881 DEBUG [src.node.docker_mananger] docker run -i -t -p 63912:63912 -p 63913:63913 -p 63914:63914 -p 63915:63915 -p 63916:63916 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=63914 --rest-port=63912 --tcp-port=63913 --discv5-udp-port=63915 --rest-address=0.0.0.0 --nat=extip:172.18.21.186 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ed75d57c89fdfeaff5e140baae325dd92d3acc0f38fc8bcd73ef298fdcd84762 --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=63916 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false
2026-02-27 04:42:59.085 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.21.186 waku 0fa30550538c322c05a35f185492d0ac6e379e66abb29c55970576ed4be06c2e
2026-02-27 04:42:59.119 DEBUG [src.node.docker_mananger] Container started with ID 0fa30550538c. Setting up logs at ./log/docker/node3_2026-02-27_04-42-56__c2e3914e-aaea-4125-b956-1430e2284ec9__wakuorg_nwaku:latest.log
2026-02-27 04:42:59.120 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 63912
2026-02-27 04:42:59.120 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-27 04:43:00.121 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63912/health" -H "Content-Type: application/json" -d 'None'
2026-02-27 04:43:00.123 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-27 04:43:00.124 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-27 04:43:00.124 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63912/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-27 04:43:00.126 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.21.186/tcp/63913/p2p/16Uiu2HAmUW4g23ZgTEnJJxgRQD9chHGk9W4VdHUupLwS5xDNgF1n","/ip4/172.18.21.186/tcp/63914/ws/p2p/16Uiu2HAmUW4g23ZgTEnJJxgRQD9chHGk9W4VdHUupLwS5xDNgF1n"],"enrUri":"enr:-L24QPj_juaP7MtQemJAwbcCPWycM07fViA0Rr50Rq6p9_WRb51IktPFHOCpvdkMczgfknlLYn6-UYsSihGHAIR2GcACgmlkgnY0gmlwhKwSFbqKbXVsdGlhZGRyc5YACASsEhW6BvmpAAoErBIVugb5qt0DgnJzhQADAQAAiXNlY3AyNTZrMaED63GmxvCACVURIJrS0kldgNb-mFwkwQN203_7zDQWhM2DdGNwgvmpg3VkcIL5q4V3YWt1MhI"}'
2026-02-27 04:43:00.126 INFO [src.node.waku_node] REST service is ready !!
2026-02-27 04:43:00.127 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63912/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.250.205/tcp/6493/p2p/16Uiu2HAm5vLJ49iV2P39wi9QT6t1eF79HAKe6oRtVswPXcrgurV5"]'
2026-02-27 04:43:00.156 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-27 04:43:00.157 DEBUG [src.node.waku_node] Starting Node...
2026-02-27 04:43:00.161 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-27 04:43:00.165 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-27 04:43:00.166 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.232.154
2026-02-27 04:43:00.166 DEBUG [src.node.docker_mananger] Generated ports ['16078', '16079', '16080', '16081', '16082']
2026-02-27 04:43:00.166 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-27 04:43:00.167 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-27 04:43:00.167 DEBUG [src.node.waku_node] Using volumes []
2026-02-27 04:43:00.169 DEBUG [src.node.docker_mananger] docker run -i -t -p 16078:16078 -p 16079:16079 -p 16080:16080 -p 16081:16081 -p 16082:16082 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=16080 --rest-port=16078 --tcp-port=16079 --discv5-udp-port=16081 --rest-address=0.0.0.0 --nat=extip:172.18.232.154 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=2fc2344470417aabf7b57d3d6f8b589bab31f8fb91adffe4fcefe7e985d6e7a9 --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=16082 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false
2026-02-27 04:43:00.363 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.232.154 waku 78b6b375144bb2d4890f3a1348cc4adbcaeb00e39f8ce6db9bf558685b42a2a3
2026-02-27 04:43:00.401 DEBUG [src.node.docker_mananger] Container started with ID 78b6b375144b. Setting up logs at ./log/docker/node4_2026-02-27_04-42-56__c2e3914e-aaea-4125-b956-1430e2284ec9__wakuorg_nwaku:latest.log
2026-02-27 04:43:00.402 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 16078
2026-02-27 04:43:00.403 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-27 04:43:01.403 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:16078/health" -H "Content-Type: application/json" -d 'None'
2026-02-27 04:43:01.407 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-27 04:43:01.408 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-27 04:43:01.408 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:16078/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-27 04:43:01.410 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.232.154/tcp/16079/p2p/16Uiu2HAkzEJrepoHaVHK19MSUzCcSpJcFvTuAJeKQDzR1hNgobXg","/ip4/172.18.232.154/tcp/16080/ws/p2p/16Uiu2HAkzEJrepoHaVHK19MSUzCcSpJcFvTuAJeKQDzR1hNgobXg"],"enrUri":"enr:-L24QGBj01xvjD9ytTXfzCX-nRm6QqttDOD7D4a8kGnaOghyB5itc8TMlKuK1dO8QnQKNFyWb-NEq7WS9i-doN9i2mYCgmlkgnY0gmlwhKwS6JqKbXVsdGlhZGRyc5YACASsEuiaBj7PAAoErBLomgY-0N0DgnJzhQADAQAAiXNlY3AyNTZrMaECR2EpaJC1ZotQC1ZzDY85OpsYbFwBBR36rbIuQoM9AHuDdGNwgj7Pg3VkcII-0YV3YWt1MhI"}'
2026-02-27 04:43:01.410 INFO [src.node.waku_node] REST service is ready !!
2026-02-27 04:43:01.411 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:16078/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.21.186/tcp/63913/p2p/16Uiu2HAmUW4g23ZgTEnJJxgRQD9chHGk9W4VdHUupLwS5xDNgF1n"]'
2026-02-27 04:43:01.447 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-27 04:43:01.448 DEBUG [src.node.waku_node] Starting Node...
2026-02-27 04:43:01.449 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-27 04:43:01.452 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-27 04:43:01.452 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.45.196
2026-02-27 04:43:01.452 DEBUG [src.node.docker_mananger] Generated ports ['11197', '11198', '11199', '11200', '11201']
2026-02-27 04:43:01.452 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-27 04:43:01.453 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-27 04:43:01.453 DEBUG [src.node.waku_node] Using volumes []
2026-02-27 04:43:01.453 DEBUG [src.node.docker_mananger] docker run -i -t -p 11197:11197 -p 11198:11198 -p 11199:11199 -p 11200:11200 -p 11201:11201 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=11199 --rest-port=11197 --tcp-port=11198 --discv5-udp-port=11200 --rest-address=0.0.0.0 --nat=extip:172.18.45.196 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=f4fb2e6cbd356bc9f06cc74ee19aca9c7be3efdb6ed51391bed6deb4b7fcd70f --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=11201 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false
2026-02-27 04:43:01.649 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.45.196 waku bf47e063b599a900608ea14c75186c9086de4748775c68b21783cf8185546cd8
2026-02-27 04:43:01.683 DEBUG [src.node.docker_mananger] Container started with ID bf47e063b599. Setting up logs at ./log/docker/node5_2026-02-27_04-42-56__c2e3914e-aaea-4125-b956-1430e2284ec9__wakuorg_nwaku:latest.log
2026-02-27 04:43:01.683 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 11197
2026-02-27 04:43:01.685 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-27 04:43:02.686 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11197/health" -H "Content-Type: application/json" -d 'None'
2026-02-27 04:43:02.689 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-27 04:43:02.689 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-27 04:43:02.690 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11197/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-27 04:43:02.692 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.45.196/tcp/11198/p2p/16Uiu2HAmDSGtnpR6owaVZY5BYU5cTxDWf4RQrGktMZVj8F7vFkYC","/ip4/172.18.45.196/tcp/11199/ws/p2p/16Uiu2HAmDSGtnpR6owaVZY5BYU5cTxDWf4RQrGktMZVj8F7vFkYC"],"enrUri":"enr:-L24QBxa12I_AY9L-5Ic-UyeWd8xzB7seFLSyMCZHpDjvUwkPYHyA1t9RCYVGqM_BNJz8XivhoXfsvT15XPS0X0GQOoCgmlkgnY0gmlwhKwSLcSKbXVsdGlhZGRyc5YACASsEi3EBiu-AAoErBItxAYrv90DgnJzhQADAQAAiXNlY3AyNTZrMaEDC5nXfmhNbgEg01WfqDOVotY7vj8jwhf8NV14tvdWc12DdGNwgiu-g3VkcIIrwIV3YWt1MhI"}'
2026-02-27 04:43:02.692 INFO [src.node.waku_node] REST service is ready !!
2026-02-27 04:43:02.692 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11197/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.232.154/tcp/16079/p2p/16Uiu2HAkzEJrepoHaVHK19MSUzCcSpJcFvTuAJeKQDzR1hNgobXg"]'
2026-02-27 04:43:02.727 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-27 04:43:02.729 DEBUG [src.node.waku_node] Starting Node...
2026-02-27 04:43:02.729 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-27 04:43:02.734 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-27 04:43:02.736 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.76.2
2026-02-27 04:43:02.736 DEBUG [src.node.docker_mananger] Generated ports ['8187', '8188', '8189', '8190', '8191']
2026-02-27 04:43:02.737 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-27 04:43:02.737 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-27 04:43:02.737 DEBUG [src.node.waku_node] Using volumes []
2026-02-27 04:43:02.738 DEBUG [src.node.docker_mananger] docker run -i -t -p 8187:8187 -p 8188:8188 -p 8189:8189 -p 8190:8190 -p 8191:8191 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=8189 --rest-port=8187 --tcp-port=8188 --discv5-udp-port=8190 --rest-address=0.0.0.0 --nat=extip:172.18.76.2 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=f6d0baafbebbcfed5fbaf0fa29d27de93479e9b8f6c226c5fdbbffea50d4d9fb --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=8191 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false
2026-02-27 04:43:02.947 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.76.2 waku 20c263b4270cd26b1ee1bc2fc385a5221c6f8a73cc921b4819c4f6da29f576ed
2026-02-27 04:43:02.981 DEBUG [src.node.docker_mananger] Container started with ID 20c263b4270c. Setting up logs at ./log/docker/node6_2026-02-27_04-42-56__c2e3914e-aaea-4125-b956-1430e2284ec9__wakuorg_nwaku:latest.log
2026-02-27 04:43:02.983 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 8187
2026-02-27 04:43:02.983 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-27 04:43:03.984 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:8187/health" -H "Content-Type: application/json" -d 'None'
2026-02-27 04:43:03.987 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-27 04:43:03.987 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-27 04:43:03.987 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:8187/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-27 04:43:03.989 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.76.2/tcp/8188/p2p/16Uiu2HAmR99YDkNrDoPqgeqtwvD5DpvXruKoKtdxu6PBHZ7CstRu","/ip4/172.18.76.2/tcp/8189/ws/p2p/16Uiu2HAmR99YDkNrDoPqgeqtwvD5DpvXruKoKtdxu6PBHZ7CstRu"],"enrUri":"enr:-L24QFWo5oy7IYRbIn_BksyaQ03r3FUnem4tUX03pfklPDIpWZgM7VnFIIxtwduH5GBGf5pl0EDm7Q9GNLmscrcJNfwCgmlkgnY0gmlwhKwSTAKKbXVsdGlhZGRyc5YACASsEkwCBh_8AAoErBJMAgYf_d0DgnJzhQADAQAAiXNlY3AyNTZrMaEDuYLlK5ORNPQD9cVQAPcT48MRCUlPbpwQ_mEgjpTVaxCDdGNwgh_8g3VkcIIf_oV3YWt1MhI"}'
2026-02-27 04:43:03.990 INFO [src.node.waku_node] REST service is ready !!
2026-02-27 04:43:03.990 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:8187/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.45.196/tcp/11198/p2p/16Uiu2HAmDSGtnpR6owaVZY5BYU5cTxDWf4RQrGktMZVj8F7vFkYC"]'
2026-02-27 04:43:04.024 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-27 04:43:04.027 DEBUG [src.node.waku_node] Starting Node...
2026-02-27 04:43:04.028 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-27 04:43:04.031 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-27 04:43:04.031 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.28.118
2026-02-27 04:43:04.031 DEBUG [src.node.docker_mananger] Generated ports ['42975', '42976', '42977', '42978', '42979']
2026-02-27 04:43:04.032 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-27 04:43:04.032 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-27 04:43:04.033 DEBUG [src.node.waku_node] Using volumes []
2026-02-27 04:43:04.033 DEBUG [src.node.docker_mananger] docker run -i -t -p 42975:42975 -p 42976:42976 -p 42977:42977 -p 42978:42978 -p 42979:42979 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=42977 --rest-port=42975 --tcp-port=42976 --discv5-udp-port=42978 --rest-address=0.0.0.0 --nat=extip:172.18.28.118 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=c189fd29b9330c6efe3eb89f8c3a0aeb0b749e5eefec5daecb89eace0d2bf27c --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=42979 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false
2026-02-27 04:43:04.248 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.28.118 waku 92f1181747c6f768c09ca27b8805cd81961728aa68b308a12fb02426fcc7634a
2026-02-27 04:43:04.285 DEBUG [src.node.docker_mananger] Container started with ID 92f1181747c6. Setting up logs at ./log/docker/node7_2026-02-27_04-42-56__c2e3914e-aaea-4125-b956-1430e2284ec9__wakuorg_nwaku:latest.log
2026-02-27 04:43:04.286 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 42975
2026-02-27 04:43:04.286 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-27 04:43:05.287 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42975/health" -H "Content-Type: application/json" -d 'None'
2026-02-27 04:43:05.289 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-27 04:43:05.290 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-27 04:43:05.290 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42975/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-27 04:43:05.292 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.28.118/tcp/42976/p2p/16Uiu2HAmR41VLz18XYhveL7TnzHb5TJuAUTDHekpqL2ZoQop7NSZ","/ip4/172.18.28.118/tcp/42977/ws/p2p/16Uiu2HAmR41VLz18XYhveL7TnzHb5TJuAUTDHekpqL2ZoQop7NSZ"],"enrUri":"enr:-L24QMS9SGG2y4X7RG8-4ejl5bH3kNVE0v4xU_onLLXrkzOoS56chUOCkR4St7In1n82lW153qcJehbZ27AHb32XLKMCgmlkgnY0gmlwhKwSHHaKbXVsdGlhZGRyc5YACASsEhx2BqfgAAoErBIcdgan4d0DgnJzhQADAQAAiXNlY3AyNTZrMaEDuDHjtD72MEFynCNR7a7cfdQ-y5Rxl6LCP5ZqRSC4yB6DdGNwgqfgg3VkcIKn4oV3YWt1MhI"}'
2026-02-27 04:43:05.292 INFO [src.node.waku_node] REST service is ready !!
2026-02-27 04:43:05.293 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:42975/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.76.2/tcp/8188/p2p/16Uiu2HAmR99YDkNrDoPqgeqtwvD5DpvXruKoKtdxu6PBHZ7CstRu"]'
2026-02-27 04:43:05.326 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-27 04:43:05.327 DEBUG [src.node.waku_node] Starting Node...
2026-02-27 04:43:05.328 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-27 04:43:05.331 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-27 04:43:05.331 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.237.126
2026-02-27 04:43:05.332 DEBUG [src.node.docker_mananger] Generated ports ['6247', '6248', '6249', '6250', '6251']
2026-02-27 04:43:05.332 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-27 04:43:05.332 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-27 04:43:05.332 DEBUG [src.node.waku_node] Using volumes []
2026-02-27 04:43:05.333 DEBUG [src.node.docker_mananger] docker run -i -t -p 6247:6247 -p 6248:6248 -p 6249:6249 -p 6250:6250 -p 6251:6251 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=6249 --rest-port=6247 --tcp-port=6248 --discv5-udp-port=6250 --rest-address=0.0.0.0 --nat=extip:172.18.237.126 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=148aaebeadaff453f3a87a1d8ac387839efedadc3e5bbb0cf6fa83e842eacccf --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=6251 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false
2026-02-27 04:43:05.534 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.237.126 waku 9a0a09ef6924609215e6614ba1ba81a4c4d3ed6541a062d38b7007dde7cbe5c7
2026-02-27 04:43:05.570 DEBUG [src.node.docker_mananger] Container started with ID 9a0a09ef6924. Setting up logs at ./log/docker/node8_2026-02-27_04-42-56__c2e3914e-aaea-4125-b956-1430e2284ec9__wakuorg_nwaku:latest.log
2026-02-27 04:43:05.570 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 6247
2026-02-27 04:43:05.571 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-27 04:43:06.571 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6247/health" -H "Content-Type: application/json" -d 'None'
2026-02-27 04:43:06.574 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-27 04:43:06.574 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-27 04:43:06.574 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6247/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-27 04:43:06.576 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.237.126/tcp/6248/p2p/16Uiu2HAkwaaJUUdhniL9TZEp4R5uqAeWeJqa2N6ycTUg566gmPTy","/ip4/172.18.237.126/tcp/6249/ws/p2p/16Uiu2HAkwaaJUUdhniL9TZEp4R5uqAeWeJqa2N6ycTUg566gmPTy"],"enrUri":"enr:-L24QG4SBgm2iBbM4lIUZ31Bdq2f8Idx-Q0ea63bQRpWXx-bdUMkEMU7UsxygFvUYxIkWde40Q6_Od9XV2hAELkrowcCgmlkgnY0gmlwhKwS7X6KbXVsdGlhZGRyc5YACASsEu1-BhhoAAoErBLtfgYYad0DgnJzhQADAQAAiXNlY3AyNTZrMaECH_8uXGYDDKYWXasgctaZG1hm2-YLZGiKfVEKqvEO3eSDdGNwghhog3VkcIIYaoV3YWt1MhI"}'
2026-02-27 04:43:06.576 INFO [src.node.waku_node] REST service is ready !!
2026-02-27 04:43:06.577 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:6247/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.28.118/tcp/42976/p2p/16Uiu2HAmR41VLz18XYhveL7TnzHb5TJuAUTDHekpqL2ZoQop7NSZ"]'
2026-02-27 04:43:06.611 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-27 04:43:06.611 DEBUG [src.steps.store] Relaying message
2026-02-27 04:43:06.612 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54130/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-27 04:43:06.619 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-27 04:43:06.620 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-27 04:43:06.820 DEBUG [src.steps.store] Relaying message
2026-02-27 04:43:06.820 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54130/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-27 04:43:06.825 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-27 04:43:06.825 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-27 04:43:07.025 DEBUG [src.steps.store] Relaying message
2026-02-27 04:43:07.026 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54130/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-27 04:43:07.031 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-27 04:43:07.031 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-27 04:43:07.232 DEBUG [src.steps.store] Relaying message
2026-02-27 04:43:07.232 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54130/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-27 04:43:07.236 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-27 04:43:07.237 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-27 04:43:07.437 DEBUG [src.steps.store] Relaying message
2026-02-27 04:43:07.437 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54130/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-27 04:43:07.441 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-27 04:43:07.441 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-27 04:43:07.642 DEBUG [src.steps.store] Relaying message
2026-02-27 04:43:07.642 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54130/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-27 04:43:07.647 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-27 04:43:07.647 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-27 04:43:07.849 DEBUG [src.steps.store] Relaying message
2026-02-27 04:43:07.852 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54130/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-27 04:43:07.858 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-27 04:43:07.859 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-27 04:43:08.060 DEBUG [src.steps.store] Relaying message
2026-02-27 04:43:08.061 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54130/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-27 04:43:08.065 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-27 04:43:08.065 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-27 04:43:08.266 DEBUG [src.steps.store] Relaying message
2026-02-27 04:43:08.266 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54130/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-27 04:43:08.271 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-27 04:43:08.271 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-27 04:43:08.471 DEBUG [src.steps.store] Relaying message
2026-02-27 04:43:08.472 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54130/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-27 04:43:08.476 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-27 04:43:08.476 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-27 04:43:08.676 DEBUG [src.libs.common] Sleeping for 90 seconds
2026-02-27 04:44:38.677 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-02-27 04:44:38.677 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6247/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-02-27 04:44:38.681 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x38e18501eeeba6ec99c03627dd373a049d37eb48be267414940630ff9a03ae9c"},{"messageHash":"0xb2b5921a42e1ccd5ee4c4068f682e17caac54dfc7ab44f0ed92596e210ec8835"},{"messageHash":"0x60554e1d73b1e286b016aea30eb87f92eb4eecb40a462572f893c75066eaf6db"},{"messageHash":"0x0369656a9ea59554bc11e5c191d413c7e2d51badad16a51e0eb49f0c2992ef39"},{"messageHash":"0x88d78857e4f715a963cd998f4e8e560d4afeb69d79c891ed6d9317d6e7c56fdb"},{"messageHash":"0x0d014d42bea287b3ebe4014fda4ae1c7fabb0cd65a1b8b97032c0a60823abecb"},{"messageHash":"0xc776ce26355e06977ca398211fe09c1d1870cf433d3e22d277764ce905474d04"},{"messageHash":"0xd63575007181cbb926f8000a1a43994e87bdb5eea90530ab0b6d196567b3e13c"},{"messageHash":"0x7bb68d5100de9d1208ef553a1aa9647a4576549b74dac99e47b715079fd477c8"},{"messageHash":"0x25bbe143672aba1494eebb8f459aadd9bd6039c5c722af945d6375c168c2b880"}]}'
2026-02-27 04:44:38.681 DEBUG [src.steps.store] messages length is 10
2026-02-27 04:44:38.684 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-02-27 04:44:38.685 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-02-27 04:44:38.685 DEBUG [src.node.waku_node] Stopping container with id 01a989cbdb0c
2026-02-27 04:44:39.300 DEBUG [src.node.waku_node] Container stopped.
2026-02-27 04:44:39.301 DEBUG [src.node.waku_node] Stopping container with id 535d63eefea9
2026-02-27 04:44:39.888 DEBUG [src.node.waku_node] Container stopped.
2026-02-27 04:44:39.889 DEBUG [src.node.waku_node] Stopping container with id 0fa30550538c
2026-02-27 04:44:40.242 ERROR [src.node.docker_mananger] Max retries reached for container 01a989cbdb0c. Exiting log stream.
2026-02-27 04:44:40.481 DEBUG [src.node.waku_node] Container stopped.
2026-02-27 04:44:40.483 DEBUG [src.node.waku_node] Stopping container with id 78b6b375144b
2026-02-27 04:44:40.894 ERROR [src.node.docker_mananger] Max retries reached for container 535d63eefea9. Exiting log stream.
2026-02-27 04:44:41.042 DEBUG [src.node.waku_node] Container stopped.
2026-02-27 04:44:41.043 DEBUG [src.node.waku_node] Stopping container with id bf47e063b599
2026-02-27 04:44:41.465 ERROR [src.node.docker_mananger] Max retries reached for container 0fa30550538c. Exiting log stream.
2026-02-27 04:44:41.610 DEBUG [src.node.waku_node] Container stopped.
2026-02-27 04:44:41.612 DEBUG [src.node.waku_node] Stopping container with id 20c263b4270c
2026-02-27 04:44:41.858 ERROR [src.node.docker_mananger] Max retries reached for container 78b6b375144b. Exiting log stream.
2026-02-27 04:44:42.173 DEBUG [src.node.waku_node] Container stopped.
2026-02-27 04:44:42.177 DEBUG [src.node.waku_node] Stopping container with id 92f1181747c6
2026-02-27 04:44:42.424 ERROR [src.node.docker_mananger] Max retries reached for container bf47e063b599. Exiting log stream.
2026-02-27 04:44:42.723 DEBUG [src.node.waku_node] Container stopped.
2026-02-27 04:44:42.724 DEBUG [src.node.waku_node] Stopping container with id 9a0a09ef6924
2026-02-27 04:44:42.992 ERROR [src.node.docker_mananger] Max retries reached for container 20c263b4270c. Exiting log stream.
2026-02-27 04:44:43.296 DEBUG [src.node.waku_node] Container stopped.
2026-02-27 04:44:43.299 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-02-27 04:44:43.371 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-27 04:44:43.475 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-27 04:44:43.567 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-27 04:44:43.609 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-27 04:44:43.651 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-27 04:44:43.695 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-27 04:44:43.793 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-27 04:44:43.822 DEBUG [src.node.docker_mananger] No errors found in the waku logs.