2026-02-25 15:39:14 +00:00

296 lines
58 KiB
Plaintext
Raw Blame History

This file contains invisible Unicode characters

This file contains invisible Unicode characters that are indistinguishable to humans but may be processed differently by a computer. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

DEBUG  tests.conftest:conftest.py:51 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:57 Running test: test_auto_shard_relay_10_nwaku_nodes with id: 2026-02-25_15-26-31__1929b0b0-7c50-4bd8-9065-eed3f0093a35
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.steps.relay:relay.py:28 Running fixture setup: relay_setup
DEBUG  src.steps.sharding:sharding.py:30 Running fixture setup: sharding_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node1_2026-02-25_15-26-31__1929b0b0-7c50-4bd8-9065-eed3f0093a35__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.98.22
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['54364', '54365', '54366', '54367', '54368']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 54364:54364 -p 54365:54365 -p 54366:54366 -p 54367:54367 -p 54368:54368 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=54366 --rest-port=54364 --tcp-port=54365 --discv5-udp-port=54367 --rest-address=0.0.0.0 --nat=extip:172.18.98.22 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=cbf799e6daed9caaeac8128072b13b497dea0f329c83f0da45309473f106dc7e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=54368 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.98.22 waku 85e70470ab9690880a623a5a3ce0147fc3d2a2505d144e33fe78de349528e613
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 85e70470ab96. Setting up logs at ./log/docker/node1_2026-02-25_15-26-31__1929b0b0-7c50-4bd8-9065-eed3f0093a35__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 54364
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 8c5fbe7db921. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:54364/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:54364/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.98.22/tcp/54365/p2p/16Uiu2HAmJobtCstPyR4drZg8jXfCGUFVfEf2MDvbYVpbZPQTcz8J","/ip4/172.18.98.22/tcp/54366/ws/p2p/16Uiu2HAmJobtCstPyR4drZg8jXfCGUFVfEf2MDvbYVpbZPQTcz8J"],"enrUri":"enr:-L24QNgM0joC3cAHC4YpXZk28hM9Thw94pzMHHfxg9_xpR8WHI1iMCjsp8xavNxmIpPqYAVPVBhYt5bmf1OxMm6o9m8CgmlkgnY0gmlwhKwSYhaKbXVsdGlhZGRyc5YACASsEmIWBtRdAAoErBJiFgbUXt0DgnJzhQACAQAAiXNlY3AyNTZrMaEDW1ryAtEFDjYftlJ37gF7lQNZwsd9fc8S3G6-LyUi8KODdGNwgtRdg3VkcILUX4V3YWt1MgU"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node3_2026-02-25_15-26-31__1929b0b0-7c50-4bd8-9065-eed3f0093a35__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.121.213
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['17460', '17461', '17462', '17463', '17464']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 17460:17460 -p 17461:17461 -p 17462:17462 -p 17463:17463 -p 17464:17464 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=17462 --rest-port=17460 --tcp-port=17461 --discv5-udp-port=17463 --rest-address=0.0.0.0 --nat=extip:172.18.121.213 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=49d1a2ce3fd0c5031f6e2cecdc847edae5f7aaa302f9ba2b53a9555be52d79f8 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=17464 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QNgM0joC3cAHC4YpXZk28hM9Thw94pzMHHfxg9_xpR8WHI1iMCjsp8xavNxmIpPqYAVPVBhYt5bmf1OxMm6o9m8CgmlkgnY0gmlwhKwSYhaKbXVsdGlhZGRyc5YACASsEmIWBtRdAAoErBJiFgbUXt0DgnJzhQACAQAAiXNlY3AyNTZrMaEDW1ryAtEFDjYftlJ37gF7lQNZwsd9fc8S3G6-LyUi8KODdGNwgtRdg3VkcILUX4V3YWt1MgU --content-topic=/myapp/1/latest/proto
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.121.213 waku d0c950658304bd59528a964fc8da9613e605034416b3dd844669d02f31c92138
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID d0c950658304. Setting up logs at ./log/docker/node3_2026-02-25_15-26-31__1929b0b0-7c50-4bd8-9065-eed3f0093a35__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 17460
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:17460/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:17460/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.121.213/tcp/17461/p2p/16Uiu2HAmG1DRjGRbF6Wo3QD4KrxTGLhL339vifehgsZqjSFaSAmz","/ip4/172.18.121.213/tcp/17462/ws/p2p/16Uiu2HAmG1DRjGRbF6Wo3QD4KrxTGLhL339vifehgsZqjSFaSAmz"],"enrUri":"enr:-L24QPskJBkuBnnRuLbZR42lRM3Rm5INxrSapzNBjaYfA0gIYKsimvJbe_nOGR-oK3QdeRWIQYcD6lE26m_WYTJais4CgmlkgnY0gmlwhKwSedWKbXVsdGlhZGRyc5YACASsEnnVBkQ1AAoErBJ51QZENt0DgnJzhQACAQAAiXNlY3AyNTZrMaEDMcF2cMP8i90-h8ywBXmOlamqvhb0z-h8x1zbBmAiEW2DdGNwgkQ1g3VkcIJEN4V3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:17460/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.98.22/tcp/54365/p2p/16Uiu2HAmJobtCstPyR4drZg8jXfCGUFVfEf2MDvbYVpbZPQTcz8J"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node4_2026-02-25_15-26-31__1929b0b0-7c50-4bd8-9065-eed3f0093a35__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.91.159
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['24473', '24474', '24475', '24476', '24477']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 24473:24473 -p 24474:24474 -p 24475:24475 -p 24476:24476 -p 24477:24477 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=24475 --rest-port=24473 --tcp-port=24474 --discv5-udp-port=24476 --rest-address=0.0.0.0 --nat=extip:172.18.91.159 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=00535e73ba67a4cb2dd5cd3cfcdb12968e78a81dfba5ad8ddbafc019499dcdf4 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=24477 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QNgM0joC3cAHC4YpXZk28hM9Thw94pzMHHfxg9_xpR8WHI1iMCjsp8xavNxmIpPqYAVPVBhYt5bmf1OxMm6o9m8CgmlkgnY0gmlwhKwSYhaKbXVsdGlhZGRyc5YACASsEmIWBtRdAAoErBJiFgbUXt0DgnJzhQACAQAAiXNlY3AyNTZrMaEDW1ryAtEFDjYftlJ37gF7lQNZwsd9fc8S3G6-LyUi8KODdGNwgtRdg3VkcILUX4V3YWt1MgU --content-topic=/myapp/1/latest/proto
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.91.159 waku ffe868863a4bb3df775343512c9360f9f32294cdc3ad3ea4589262282e47f4d4
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID ffe868863a4b. Setting up logs at ./log/docker/node4_2026-02-25_15-26-31__1929b0b0-7c50-4bd8-9065-eed3f0093a35__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 24473
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:24473/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:24473/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.91.159/tcp/24474/p2p/16Uiu2HAmMytqFJa1XfP5B7nA6bxUAQ3A9J92dzKFj35ALzVTPjQ5","/ip4/172.18.91.159/tcp/24475/ws/p2p/16Uiu2HAmMytqFJa1XfP5B7nA6bxUAQ3A9J92dzKFj35ALzVTPjQ5"],"enrUri":"enr:-L24QI8K5_szt29ss0xpoTwxdj3B9j8wv8v0CjgaJkMlEGyfOWxW-2siXDOY9bIItydWGbvKIY6pXnhYTBUi-qRDJ1wCgmlkgnY0gmlwhKwSW5-KbXVsdGlhZGRyc5YACASsElufBl-aAAoErBJbnwZfm90DgnJzhQACAQAAiXNlY3AyNTZrMaEDipD6gBn-FJtUlCK34_4m-qoTRntbteglEMalvfRPEnKDdGNwgl-ag3VkcIJfnIV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:24473/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.98.22/tcp/54365/p2p/16Uiu2HAmJobtCstPyR4drZg8jXfCGUFVfEf2MDvbYVpbZPQTcz8J"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node5_2026-02-25_15-26-31__1929b0b0-7c50-4bd8-9065-eed3f0093a35__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.237.10
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['23789', '23790', '23791', '23792', '23793']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 23789:23789 -p 23790:23790 -p 23791:23791 -p 23792:23792 -p 23793:23793 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=23791 --rest-port=23789 --tcp-port=23790 --discv5-udp-port=23792 --rest-address=0.0.0.0 --nat=extip:172.18.237.10 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=e4a3f1c40ece646bcfad6cdf2ddf3cdbcdac333d0aa3bb2bd5376b09bd2e8afe --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=23793 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QNgM0joC3cAHC4YpXZk28hM9Thw94pzMHHfxg9_xpR8WHI1iMCjsp8xavNxmIpPqYAVPVBhYt5bmf1OxMm6o9m8CgmlkgnY0gmlwhKwSYhaKbXVsdGlhZGRyc5YACASsEmIWBtRdAAoErBJiFgbUXt0DgnJzhQACAQAAiXNlY3AyNTZrMaEDW1ryAtEFDjYftlJ37gF7lQNZwsd9fc8S3G6-LyUi8KODdGNwgtRdg3VkcILUX4V3YWt1MgU --content-topic=/myapp/1/latest/proto
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.237.10 waku 20c353f6eda2058f21de04123aa237622a7b83af683ed0e4b1e3d327304eae2a
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 20c353f6eda2. Setting up logs at ./log/docker/node5_2026-02-25_15-26-31__1929b0b0-7c50-4bd8-9065-eed3f0093a35__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 23789
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:23789/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:23789/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.237.10/tcp/23790/p2p/16Uiu2HAkybd7vtSskfJwuVLmrQ1HUqG4ZRGCFpU9V1ZFrZgvrKMM","/ip4/172.18.237.10/tcp/23791/ws/p2p/16Uiu2HAkybd7vtSskfJwuVLmrQ1HUqG4ZRGCFpU9V1ZFrZgvrKMM"],"enrUri":"enr:-L24QAO3CiwInjQosX_nnCT78EfwpAoffvm2xyU5KjevaUBJHrKevTHnHQJm12n142TrPVkkOpiZvgFWlj796hVJC1wCgmlkgnY0gmlwhKwS7QqKbXVsdGlhZGRyc5YACASsEu0KBlzuAAoErBLtCgZc790DgnJzhQACAQAAiXNlY3AyNTZrMaECPftSgnfZQjQ1iEpd4iTDEdMz8KEFAIeVrukcHc8nyvyDdGNwglzug3VkcIJc8IV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:23789/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.98.22/tcp/54365/p2p/16Uiu2HAmJobtCstPyR4drZg8jXfCGUFVfEf2MDvbYVpbZPQTcz8J"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node6_2026-02-25_15-26-31__1929b0b0-7c50-4bd8-9065-eed3f0093a35__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.184.185
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['2285', '2286', '2287', '2288', '2289']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 2285:2285 -p 2286:2286 -p 2287:2287 -p 2288:2288 -p 2289:2289 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=2287 --rest-port=2285 --tcp-port=2286 --discv5-udp-port=2288 --rest-address=0.0.0.0 --nat=extip:172.18.184.185 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=ea9bdc57554bc7cdcefc24157b3acefc9b7f4ee235d62777d7cbaec4197bbca2 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=2289 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QNgM0joC3cAHC4YpXZk28hM9Thw94pzMHHfxg9_xpR8WHI1iMCjsp8xavNxmIpPqYAVPVBhYt5bmf1OxMm6o9m8CgmlkgnY0gmlwhKwSYhaKbXVsdGlhZGRyc5YACASsEmIWBtRdAAoErBJiFgbUXt0DgnJzhQACAQAAiXNlY3AyNTZrMaEDW1ryAtEFDjYftlJ37gF7lQNZwsd9fc8S3G6-LyUi8KODdGNwgtRdg3VkcILUX4V3YWt1MgU --content-topic=/myapp/1/latest/proto
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.184.185 waku eef96b7fb56715479e55919bb3f67127acbf31b9b5f6dbf06025efb38b02c18a
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID eef96b7fb567. Setting up logs at ./log/docker/node6_2026-02-25_15-26-31__1929b0b0-7c50-4bd8-9065-eed3f0093a35__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 2285
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:2285/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:2285/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.184.185/tcp/2286/p2p/16Uiu2HAmN1VfMUjYSL64uGZVUguf5cdyJZDB9XXnxrMqdChUp8Qy","/ip4/172.18.184.185/tcp/2287/ws/p2p/16Uiu2HAmN1VfMUjYSL64uGZVUguf5cdyJZDB9XXnxrMqdChUp8Qy"],"enrUri":"enr:-L24QM3QcRhHHToU9KA2UOFyF-5HUCTpCT7WRNZLfZ-YZYqRcxZLAOhE3xZK85hzcZ1WIXm7-g4om4pqcRJms90T8HACgmlkgnY0gmlwhKwSuLmKbXVsdGlhZGRyc5YACASsEri5BgjuAAoErBK4uQYI790DgnJzhQACAQAAiXNlY3AyNTZrMaEDivnw6o_qTd0smGSimd_3oqIFpWB-K_iCRpmCg9HqUzKDdGNwggjug3VkcIII8IV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:2285/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.98.22/tcp/54365/p2p/16Uiu2HAmJobtCstPyR4drZg8jXfCGUFVfEf2MDvbYVpbZPQTcz8J"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node7_2026-02-25_15-26-31__1929b0b0-7c50-4bd8-9065-eed3f0093a35__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.187.77
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['28987', '28988', '28989', '28990', '28991']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 28987:28987 -p 28988:28988 -p 28989:28989 -p 28990:28990 -p 28991:28991 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=28989 --rest-port=28987 --tcp-port=28988 --discv5-udp-port=28990 --rest-address=0.0.0.0 --nat=extip:172.18.187.77 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=85ae5f46ded6ef38e46ea123deb84c5e5b9f4c59aafad6ccf9be8c1dd2fcfdf1 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=28991 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QNgM0joC3cAHC4YpXZk28hM9Thw94pzMHHfxg9_xpR8WHI1iMCjsp8xavNxmIpPqYAVPVBhYt5bmf1OxMm6o9m8CgmlkgnY0gmlwhKwSYhaKbXVsdGlhZGRyc5YACASsEmIWBtRdAAoErBJiFgbUXt0DgnJzhQACAQAAiXNlY3AyNTZrMaEDW1ryAtEFDjYftlJ37gF7lQNZwsd9fc8S3G6-LyUi8KODdGNwgtRdg3VkcILUX4V3YWt1MgU --content-topic=/myapp/1/latest/proto
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.187.77 waku f969680210699b95b9d48982fe9aae93dbc235b0a74b4f27263f33bf0274b061
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID f96968021069. Setting up logs at ./log/docker/node7_2026-02-25_15-26-31__1929b0b0-7c50-4bd8-9065-eed3f0093a35__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 28987
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:28987/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:28987/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.187.77/tcp/28988/p2p/16Uiu2HAm4N5DwYKEV6MTHbuTk6LVnBey6fzxUfFfkVGB8DiqyTs9","/ip4/172.18.187.77/tcp/28989/ws/p2p/16Uiu2HAm4N5DwYKEV6MTHbuTk6LVnBey6fzxUfFfkVGB8DiqyTs9"],"enrUri":"enr:-L24QNLWGNhPhq4J8qKpNY9b1Gz_pPRt13Dcz3jpO5nFRgOUUBIiuewKS0AfV3_vEM6dJuAbMZWwbuR3Ba-FiiJ1yIwCgmlkgnY0gmlwhKwSu02KbXVsdGlhZGRyc5YACASsErtNBnE8AAoErBK7TQZxPd0DgnJzhQACAQAAiXNlY3AyNTZrMaEChM0kHoH7t2EK-f__vkuQk27Nlq-wT8bEs63MM7U-z-SDdGNwgnE8g3VkcIJxPoV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:28987/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.98.22/tcp/54365/p2p/16Uiu2HAmJobtCstPyR4drZg8jXfCGUFVfEf2MDvbYVpbZPQTcz8J"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node8_2026-02-25_15-26-31__1929b0b0-7c50-4bd8-9065-eed3f0093a35__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.98.31
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['56246', '56247', '56248', '56249', '56250']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 56246:56246 -p 56247:56247 -p 56248:56248 -p 56249:56249 -p 56250:56250 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=56248 --rest-port=56246 --tcp-port=56247 --discv5-udp-port=56249 --rest-address=0.0.0.0 --nat=extip:172.18.98.31 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=9dbcae6f9fd56dc397c1ad2ee006adfbb0ada3abd02ee2b6f2ace90bd3e76b5d --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=56250 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QNgM0joC3cAHC4YpXZk28hM9Thw94pzMHHfxg9_xpR8WHI1iMCjsp8xavNxmIpPqYAVPVBhYt5bmf1OxMm6o9m8CgmlkgnY0gmlwhKwSYhaKbXVsdGlhZGRyc5YACASsEmIWBtRdAAoErBJiFgbUXt0DgnJzhQACAQAAiXNlY3AyNTZrMaEDW1ryAtEFDjYftlJ37gF7lQNZwsd9fc8S3G6-LyUi8KODdGNwgtRdg3VkcILUX4V3YWt1MgU --content-topic=/myapp/1/latest/proto
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.98.31 waku 64c01bb947723ebd195f757c16d315551db459e3cd4893e4b37e911cebacd2f7
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 64c01bb94772. Setting up logs at ./log/docker/node8_2026-02-25_15-26-31__1929b0b0-7c50-4bd8-9065-eed3f0093a35__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 56246
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:56246/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:56246/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.98.31/tcp/56247/p2p/16Uiu2HAmJAtPUirLZycEfufUbVuCJT6FzNCvimWbPztMj47cQUaM","/ip4/172.18.98.31/tcp/56248/ws/p2p/16Uiu2HAmJAtPUirLZycEfufUbVuCJT6FzNCvimWbPztMj47cQUaM"],"enrUri":"enr:-L24QCx_bvK4_06EIzegD-mOtBO4CONCuF5xOGFj2YbIiE4mU9W_qBSx6wzT9GIQTsKVJRezWgQZ-1lVFj7xAb6FmC4CgmlkgnY0gmlwhKwSYh-KbXVsdGlhZGRyc5YACASsEmIfBtu3AAoErBJiHwbbuN0DgnJzhQACAQAAiXNlY3AyNTZrMaEDUfMeCvVtBDOv4jQ_v-IVsjCTL97S1gWOaYmJ1CsY0KKDdGNwgtu3g3VkcILbuYV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:56246/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.98.22/tcp/54365/p2p/16Uiu2HAmJobtCstPyR4drZg8jXfCGUFVfEf2MDvbYVpbZPQTcz8J"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node9_2026-02-25_15-26-31__1929b0b0-7c50-4bd8-9065-eed3f0093a35__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.192.221
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['7453', '7454', '7455', '7456', '7457']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 7453:7453 -p 7454:7454 -p 7455:7455 -p 7456:7456 -p 7457:7457 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=7455 --rest-port=7453 --tcp-port=7454 --discv5-udp-port=7456 --rest-address=0.0.0.0 --nat=extip:172.18.192.221 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=6a8cebaeaad78eceb5eb59ae983ee39d7dcdadf54ce4fb3d1ee7fb68365a3d9d --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=7457 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QNgM0joC3cAHC4YpXZk28hM9Thw94pzMHHfxg9_xpR8WHI1iMCjsp8xavNxmIpPqYAVPVBhYt5bmf1OxMm6o9m8CgmlkgnY0gmlwhKwSYhaKbXVsdGlhZGRyc5YACASsEmIWBtRdAAoErBJiFgbUXt0DgnJzhQACAQAAiXNlY3AyNTZrMaEDW1ryAtEFDjYftlJ37gF7lQNZwsd9fc8S3G6-LyUi8KODdGNwgtRdg3VkcILUX4V3YWt1MgU --content-topic=/myapp/1/latest/proto
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.192.221 waku 8e568357e215230469dcfaff6350e50e8e2d9da9ed07cb2831b4c2c72027898c
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 8e568357e215. Setting up logs at ./log/docker/node9_2026-02-25_15-26-31__1929b0b0-7c50-4bd8-9065-eed3f0093a35__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 7453
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:7453/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:7453/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.192.221/tcp/7454/p2p/16Uiu2HAkyjonxWL83RaQFnnX258w7uVNq1SSxuM3aDJAjGD7rtKF","/ip4/172.18.192.221/tcp/7455/ws/p2p/16Uiu2HAkyjonxWL83RaQFnnX258w7uVNq1SSxuM3aDJAjGD7rtKF"],"enrUri":"enr:-L24QOktesbCIN6atqZQqsDr5S2SmFQ4i5Q6BFwbVlqkJVN6d0gv2UVYNVIkpJJOdbZ6M4uLNBu63TtIIJBmf3pn9g0CgmlkgnY0gmlwhKwSwN2KbXVsdGlhZGRyc5YACASsEsDdBh0eAAoErBLA3QYdH90DgnJzhQACAQAAiXNlY3AyNTZrMaECQBQJYlVsxd9NstftCLTIydWZh-nDp_5cPyza_HNzB5aDdGNwgh0eg3VkcIIdIIV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:7453/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.98.22/tcp/54365/p2p/16Uiu2HAmJobtCstPyR4drZg8jXfCGUFVfEf2MDvbYVpbZPQTcz8J"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node10_2026-02-25_15-26-31__1929b0b0-7c50-4bd8-9065-eed3f0093a35__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.183.20
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['28288', '28289', '28290', '28291', '28292']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 28288:28288 -p 28289:28289 -p 28290:28290 -p 28291:28291 -p 28292:28292 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=28290 --rest-port=28288 --tcp-port=28289 --discv5-udp-port=28291 --rest-address=0.0.0.0 --nat=extip:172.18.183.20 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=ca421fdd88dd432d4755ccab348ed9b2fee71cbcfd0ff0a6a7beb9fedcfba771 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=28292 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QNgM0joC3cAHC4YpXZk28hM9Thw94pzMHHfxg9_xpR8WHI1iMCjsp8xavNxmIpPqYAVPVBhYt5bmf1OxMm6o9m8CgmlkgnY0gmlwhKwSYhaKbXVsdGlhZGRyc5YACASsEmIWBtRdAAoErBJiFgbUXt0DgnJzhQACAQAAiXNlY3AyNTZrMaEDW1ryAtEFDjYftlJ37gF7lQNZwsd9fc8S3G6-LyUi8KODdGNwgtRdg3VkcILUX4V3YWt1MgU --content-topic=/myapp/1/latest/proto
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.183.20 waku 782ba8b9150000ad002ea48acefb4054fdfeb638f389b886f197ab555691b63a
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 782ba8b91500. Setting up logs at ./log/docker/node10_2026-02-25_15-26-31__1929b0b0-7c50-4bd8-9065-eed3f0093a35__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 28288
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:28288/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:28288/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.183.20/tcp/28289/p2p/16Uiu2HAmDfcocYDPr1fLA2R7T2UTEY5Xeb31FWBdDNnS2KAnvps7","/ip4/172.18.183.20/tcp/28290/ws/p2p/16Uiu2HAmDfcocYDPr1fLA2R7T2UTEY5Xeb31FWBdDNnS2KAnvps7"],"enrUri":"enr:-L24QDRYBuuFW2Cq1EV0oUGJtEDrthCh6KK3rlDOJN1KszzxSpi5oGGHVR260yAZNIkKuAsnlqOAIE9AaRchgGy-XdcCgmlkgnY0gmlwhKwStxSKbXVsdGlhZGRyc5YACASsErcUBm6BAAoErBK3FAZugt0DgnJzhQACAQAAiXNlY3AyNTZrMaEDDwTnynb2NJlwkSq8iINICJHgFrLQy6xdUKhD9zMXJ66DdGNwgm6Bg3VkcIJug4V3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:28288/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.98.22/tcp/54365/p2p/16Uiu2HAmJobtCstPyR4drZg8jXfCGUFVfEf2MDvbYVpbZPQTcz8J"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:54364/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:17460/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:24473/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:23789/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:2285/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:28987/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:56246/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:7453/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:28288/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:54364/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.1 seconds
DEBUG  src.steps.sharding:sharding.py:158 Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:54364/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772033202633202229,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.sharding:sharding.py:158 Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:17460/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772033202633202229,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.sharding:sharding.py:158 Checking that peer NODE_3:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:24473/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772033202633202229,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.sharding:sharding.py:158 Checking that peer NODE_4:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:23789/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772033202633202229,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.sharding:sharding.py:158 Checking that peer NODE_5:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:2285/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772033202633202229,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.sharding:sharding.py:158 Checking that peer NODE_6:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:28987/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772033202633202229,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.sharding:sharding.py:158 Checking that peer NODE_7:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:56246/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772033202633202229,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.sharding:sharding.py:158 Checking that peer NODE_8:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:7453/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772033202633202229,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.sharding:sharding.py:158 Checking that peer NODE_9:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:28288/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772033202633202229,"ephemeral":false,"proof":""}]'
DEBUG  tests.conftest:conftest.py:59 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:83 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 85e70470ab96
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id d0c950658304
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id ffe868863a4b
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 85e70470ab96. Exiting log stream.
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container d0c950658304. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 20c353f6eda2
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container ffe868863a4b. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id eef96b7fb567
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id f96968021069
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 20c353f6eda2. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 64c01bb94772
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container eef96b7fb567. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 8e568357e215
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container f96968021069. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 782ba8b91500
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 64c01bb94772. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  tests.conftest:conftest.py:98 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.