311 lines
58 KiB
Plaintext
Raw Blame History

This file contains invisible Unicode characters

This file contains invisible Unicode characters that are indistinguishable to humans but may be processed differently by a computer. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

DEBUG  tests.conftest:conftest.py:51 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:57 Running test: test_auto_shard_relay_10_nwaku_nodes with id: 2026-03-26_04-52-25__f9f31a43-9b37-4555-9e15-d756a8e5b379
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.steps.relay:relay.py:28 Running fixture setup: relay_setup
DEBUG  src.steps.sharding:sharding.py:30 Running fixture setup: sharding_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node1_2026-03-26_04-52-25__f9f31a43-9b37-4555-9e15-d756a8e5b379__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.217.252
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['32719', '32720', '32721', '32722', '32723']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 32719:32719 -p 32720:32720 -p 32721:32721 -p 32722:32722 -p 32723:32723 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=32721 --rest-port=32719 --tcp-port=32720 --discv5-udp-port=32722 --rest-address=0.0.0.0 --nat=extip:172.18.217.252 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=fc3b8d4dbf0c147b99be1bbbf9dc1dec5bddb1c9550bd7eac437a27cd23457aa --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=32723 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.217.252 waku 536e1eca3b9e0dfaa095d0ddf4c56552efe623899ea4b61c6b29a28e4a51bd4f
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 536e1eca3b9e. Setting up logs at ./log/docker/node1_2026-03-26_04-52-25__f9f31a43-9b37-4555-9e15-d756a8e5b379__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 32719
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 56c1ea7b2276. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:32719/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:32719/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.217.252/tcp/32720/p2p/16Uiu2HAmQR8e391dLiaMXwDJSY8XnqsvQze8NATDvo41Dpn3cbN7","/ip4/172.18.217.252/tcp/32721/ws/p2p/16Uiu2HAmQR8e391dLiaMXwDJSY8XnqsvQze8NATDvo41Dpn3cbN7"],"enrUri":"enr:-L24QAz9WE8nBvvfLYLfK3pvgEaOArY-pC3dG6cILqHb01ASDZLEzgNg_Gtezp_OU0_eD76L3BofR2s19iBHm-A_Sk0CgmlkgnY0gmlwhKwS2fyKbXVsdGlhZGRyc5YACASsEtn8Bn_QAAoErBLZ_AZ_0d0DgnJzhQACAQAAiXNlY3AyNTZrMaEDrr974dQN4suZEwDQ79nTe76kWmEZ25ZQFdfN1YntsAiDdGNwgn_Qg3VkcIJ_0oV3YWt1MgU"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node3_2026-03-26_04-52-25__f9f31a43-9b37-4555-9e15-d756a8e5b379__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.82.174
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['34783', '34784', '34785', '34786', '34787']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 34783:34783 -p 34784:34784 -p 34785:34785 -p 34786:34786 -p 34787:34787 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=34785 --rest-port=34783 --tcp-port=34784 --discv5-udp-port=34786 --rest-address=0.0.0.0 --nat=extip:172.18.82.174 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=427c74910e06d6140c7dd6b79a501ccaaf72beab7becbffe5e525aabb1aba2fc --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=34787 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QAz9WE8nBvvfLYLfK3pvgEaOArY-pC3dG6cILqHb01ASDZLEzgNg_Gtezp_OU0_eD76L3BofR2s19iBHm-A_Sk0CgmlkgnY0gmlwhKwS2fyKbXVsdGlhZGRyc5YACASsEtn8Bn_QAAoErBLZ_AZ_0d0DgnJzhQACAQAAiXNlY3AyNTZrMaEDrr974dQN4suZEwDQ79nTe76kWmEZ25ZQFdfN1YntsAiDdGNwgn_Qg3VkcIJ_0oV3YWt1MgU --content-topic=/myapp/1/latest/proto
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.82.174 waku 3d613285462b67cdb1f6a7b85112d42b07a46f998530fff454620b635b541acb
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 3d613285462b. Setting up logs at ./log/docker/node3_2026-03-26_04-52-25__f9f31a43-9b37-4555-9e15-d756a8e5b379__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 34783
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:34783/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:34783/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.82.174/tcp/34784/p2p/16Uiu2HAmDv5KFLv8UzL9LHCqjTYjnVcEbYAhP4gdX9mGJwuvEafm","/ip4/172.18.82.174/tcp/34785/ws/p2p/16Uiu2HAmDv5KFLv8UzL9LHCqjTYjnVcEbYAhP4gdX9mGJwuvEafm"],"enrUri":"enr:-L24QGQ8jAYVcrzzy5aKWdnmUX00dzBzPgEpg72eXraDFS-7CTnlB6jeI7Y1rgDc96qPkUxANDQcDaRhgfQKZIboV4sCgmlkgnY0gmlwhKwSUq6KbXVsdGlhZGRyc5YACASsElKuBofgAAoErBJSrgaH4d0DgnJzhQACAQAAiXNlY3AyNTZrMaEDErkDRVQK4Khc2kvHGDHoOms0eB4033u30o5y3zl8IkSDdGNwgofgg3VkcIKH4oV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:34783/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.217.252/tcp/32720/p2p/16Uiu2HAmQR8e391dLiaMXwDJSY8XnqsvQze8NATDvo41Dpn3cbN7"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node4_2026-03-26_04-52-25__f9f31a43-9b37-4555-9e15-d756a8e5b379__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.128.224
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['18373', '18374', '18375', '18376', '18377']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 18373:18373 -p 18374:18374 -p 18375:18375 -p 18376:18376 -p 18377:18377 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=18375 --rest-port=18373 --tcp-port=18374 --discv5-udp-port=18376 --rest-address=0.0.0.0 --nat=extip:172.18.128.224 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=b80a5415bc7a5ea8c3a3ee525cdfa4cdd0d8378b1fa7dd3fdf519c8a63af1df8 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=18377 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QAz9WE8nBvvfLYLfK3pvgEaOArY-pC3dG6cILqHb01ASDZLEzgNg_Gtezp_OU0_eD76L3BofR2s19iBHm-A_Sk0CgmlkgnY0gmlwhKwS2fyKbXVsdGlhZGRyc5YACASsEtn8Bn_QAAoErBLZ_AZ_0d0DgnJzhQACAQAAiXNlY3AyNTZrMaEDrr974dQN4suZEwDQ79nTe76kWmEZ25ZQFdfN1YntsAiDdGNwgn_Qg3VkcIJ_0oV3YWt1MgU --content-topic=/myapp/1/latest/proto
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.128.224 waku e51b44de54184b856f0ea8b958da93a06db92b9a90695178b40527953e42ca6a
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID e51b44de5418. Setting up logs at ./log/docker/node4_2026-03-26_04-52-25__f9f31a43-9b37-4555-9e15-d756a8e5b379__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 18373
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:18373/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:18373/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.128.224/tcp/18374/p2p/16Uiu2HAmTKhh9hLJiLH9gDhXPLXkJLEattV7NoNuYk4X7mEKWidW","/ip4/172.18.128.224/tcp/18375/ws/p2p/16Uiu2HAmTKhh9hLJiLH9gDhXPLXkJLEattV7NoNuYk4X7mEKWidW"],"enrUri":"enr:-L24QKfbTPR7Wq16JN_HqOqEWMrQoH6VpmC5ifw033lsc5YYcbFKMuIMDmsr5FTkXtuVSQaVSpvRhBxuZIyFgaNikEcCgmlkgnY0gmlwhKwSgOCKbXVsdGlhZGRyc5YACASsEoDgBkfGAAoErBKA4AZHx90DgnJzhQACAQAAiXNlY3AyNTZrMaED2e5vCgj8LB2LK5DRJMKYqj9E_ifhVTD6Z1anA55i_9GDdGNwgkfGg3VkcIJHyIV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:18373/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.217.252/tcp/32720/p2p/16Uiu2HAmQR8e391dLiaMXwDJSY8XnqsvQze8NATDvo41Dpn3cbN7"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node5_2026-03-26_04-52-25__f9f31a43-9b37-4555-9e15-d756a8e5b379__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.239.146
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['60670', '60671', '60672', '60673', '60674']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 60670:60670 -p 60671:60671 -p 60672:60672 -p 60673:60673 -p 60674:60674 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=60672 --rest-port=60670 --tcp-port=60671 --discv5-udp-port=60673 --rest-address=0.0.0.0 --nat=extip:172.18.239.146 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=7f7d4a15cbeeee502ebdcf1e3d99a4fae486aae3a139d6adfbba749ff1ee00e8 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=60674 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QAz9WE8nBvvfLYLfK3pvgEaOArY-pC3dG6cILqHb01ASDZLEzgNg_Gtezp_OU0_eD76L3BofR2s19iBHm-A_Sk0CgmlkgnY0gmlwhKwS2fyKbXVsdGlhZGRyc5YACASsEtn8Bn_QAAoErBLZ_AZ_0d0DgnJzhQACAQAAiXNlY3AyNTZrMaEDrr974dQN4suZEwDQ79nTe76kWmEZ25ZQFdfN1YntsAiDdGNwgn_Qg3VkcIJ_0oV3YWt1MgU --content-topic=/myapp/1/latest/proto
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.239.146 waku 8199e22ac7b63f782f6b50b9553035cb632fb170542287be31430982a2b2377e
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 8199e22ac7b6. Setting up logs at ./log/docker/node5_2026-03-26_04-52-25__f9f31a43-9b37-4555-9e15-d756a8e5b379__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 60670
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:60670/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:60670/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.239.146/tcp/60671/p2p/16Uiu2HAm1fHe5LL9AM5Lris9N6ttvDqjScGNh32vJZH1AWHctutV","/ip4/172.18.239.146/tcp/60672/ws/p2p/16Uiu2HAm1fHe5LL9AM5Lris9N6ttvDqjScGNh32vJZH1AWHctutV"],"enrUri":"enr:-L24QM_9Q70jUyyU6KSqDnns-GI3dn5rQ9puYCE6Cv8bvwloZad2rNqZfZAGTrp5QmFv1ocscDrcVLSDQ5iMCJuOREgCgmlkgnY0gmlwhKwS75KKbXVsdGlhZGRyc5YACASsEu-SBuz_AAoErBLvkgbtAN0DgnJzhQACAQAAiXNlY3AyNTZrMaECXKL-NaF2I8QjWKvigDhPNP4jxIvefErgCrNDs9K7G-KDdGNwguz_g3VkcILtAYV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:60670/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.217.252/tcp/32720/p2p/16Uiu2HAmQR8e391dLiaMXwDJSY8XnqsvQze8NATDvo41Dpn3cbN7"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node6_2026-03-26_04-52-25__f9f31a43-9b37-4555-9e15-d756a8e5b379__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.178.196
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['41568', '41569', '41570', '41571', '41572']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 41568:41568 -p 41569:41569 -p 41570:41570 -p 41571:41571 -p 41572:41572 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=41570 --rest-port=41568 --tcp-port=41569 --discv5-udp-port=41571 --rest-address=0.0.0.0 --nat=extip:172.18.178.196 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=13dcb9c83d96bc79eeddcd91ebcfbb8affecdefbf15daeab91a981bfd723c7ff --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=41572 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QAz9WE8nBvvfLYLfK3pvgEaOArY-pC3dG6cILqHb01ASDZLEzgNg_Gtezp_OU0_eD76L3BofR2s19iBHm-A_Sk0CgmlkgnY0gmlwhKwS2fyKbXVsdGlhZGRyc5YACASsEtn8Bn_QAAoErBLZ_AZ_0d0DgnJzhQACAQAAiXNlY3AyNTZrMaEDrr974dQN4suZEwDQ79nTe76kWmEZ25ZQFdfN1YntsAiDdGNwgn_Qg3VkcIJ_0oV3YWt1MgU --content-topic=/myapp/1/latest/proto
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.178.196 waku c8ab49ac28d347b6195bc128b4231838004c5bb04eeb3a1f77d4d3e4bf18e37b
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID c8ab49ac28d3. Setting up logs at ./log/docker/node6_2026-03-26_04-52-25__f9f31a43-9b37-4555-9e15-d756a8e5b379__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 41568
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:41568/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:41568/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.178.196/tcp/41569/p2p/16Uiu2HAmG5RX4cUesZzn3EKjsZ5aYW4wmwNBQtzPDVNAqrc2xGSu","/ip4/172.18.178.196/tcp/41570/ws/p2p/16Uiu2HAmG5RX4cUesZzn3EKjsZ5aYW4wmwNBQtzPDVNAqrc2xGSu"],"enrUri":"enr:-L24QMYtqzzwHMn3Z9gezzZabwJ3Q-mHwVQF2QnTb7rczhK5aclqXm30a9dsoJxjpQ7zy_LwSPt3Q1D01j1EDNyhAJMCgmlkgnY0gmlwhKwSssSKbXVsdGlhZGRyc5YACASsErLEBqJhAAoErBKyxAaiYt0DgnJzhQACAQAAiXNlY3AyNTZrMaEDMtV1VBus1qzyusaoRJOOSdKJ0uk6G2lY5dHDH7-0kMKDdGNwgqJhg3VkcIKiY4V3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:41568/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.217.252/tcp/32720/p2p/16Uiu2HAmQR8e391dLiaMXwDJSY8XnqsvQze8NATDvo41Dpn3cbN7"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node7_2026-03-26_04-52-25__f9f31a43-9b37-4555-9e15-d756a8e5b379__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.162.33
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['55108', '55109', '55110', '55111', '55112']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 55108:55108 -p 55109:55109 -p 55110:55110 -p 55111:55111 -p 55112:55112 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=55110 --rest-port=55108 --tcp-port=55109 --discv5-udp-port=55111 --rest-address=0.0.0.0 --nat=extip:172.18.162.33 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=a5036fdfa47c1be9bee5c504f3c68cbba3a2e4669cffd15fcf74c6c0cdecd68c --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=55112 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QAz9WE8nBvvfLYLfK3pvgEaOArY-pC3dG6cILqHb01ASDZLEzgNg_Gtezp_OU0_eD76L3BofR2s19iBHm-A_Sk0CgmlkgnY0gmlwhKwS2fyKbXVsdGlhZGRyc5YACASsEtn8Bn_QAAoErBLZ_AZ_0d0DgnJzhQACAQAAiXNlY3AyNTZrMaEDrr974dQN4suZEwDQ79nTe76kWmEZ25ZQFdfN1YntsAiDdGNwgn_Qg3VkcIJ_0oV3YWt1MgU --content-topic=/myapp/1/latest/proto
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.162.33 waku aa65fecdd54163dedd1cd80dd61575aba5d571f112a98306c80ad759e7eb567e
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID aa65fecdd541. Setting up logs at ./log/docker/node7_2026-03-26_04-52-25__f9f31a43-9b37-4555-9e15-d756a8e5b379__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 55108
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:55108/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:55108/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.162.33/tcp/55109/p2p/16Uiu2HAm8LAJSS3FHfZcE9hELWDMcg9XWy7mQp2XGTcYhyBqethp","/ip4/172.18.162.33/tcp/55110/ws/p2p/16Uiu2HAm8LAJSS3FHfZcE9hELWDMcg9XWy7mQp2XGTcYhyBqethp"],"enrUri":"enr:-L24QMC7QSM_fVYRFfFXklZp2PZA9FIdAZBeEK_SNUl2ONbZGwvAb9eAHbmdnj7rPd354pGbGsqYjnOnd4x2lavxLz4CgmlkgnY0gmlwhKwSoiGKbXVsdGlhZGRyc5YACASsEqIhBtdFAAoErBKiIQbXRt0DgnJzhQACAQAAiXNlY3AyNTZrMaECv7536CxO57Tqm2PJI1mvP0wj8ziU2EdlszITe-oNSXODdGNwgtdFg3VkcILXR4V3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:55108/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.217.252/tcp/32720/p2p/16Uiu2HAmQR8e391dLiaMXwDJSY8XnqsvQze8NATDvo41Dpn3cbN7"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node8_2026-03-26_04-52-25__f9f31a43-9b37-4555-9e15-d756a8e5b379__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.188.155
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['33578', '33579', '33580', '33581', '33582']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 33578:33578 -p 33579:33579 -p 33580:33580 -p 33581:33581 -p 33582:33582 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=33580 --rest-port=33578 --tcp-port=33579 --discv5-udp-port=33581 --rest-address=0.0.0.0 --nat=extip:172.18.188.155 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=f5b829d3cc3cdd39d4fa6e681f0daad7a4baf956d62ebcf1453d1e4e22efbb9f --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=33582 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QAz9WE8nBvvfLYLfK3pvgEaOArY-pC3dG6cILqHb01ASDZLEzgNg_Gtezp_OU0_eD76L3BofR2s19iBHm-A_Sk0CgmlkgnY0gmlwhKwS2fyKbXVsdGlhZGRyc5YACASsEtn8Bn_QAAoErBLZ_AZ_0d0DgnJzhQACAQAAiXNlY3AyNTZrMaEDrr974dQN4suZEwDQ79nTe76kWmEZ25ZQFdfN1YntsAiDdGNwgn_Qg3VkcIJ_0oV3YWt1MgU --content-topic=/myapp/1/latest/proto
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.188.155 waku 728bb52c5288097209ec38700d704e91fa4989fda9fa8de441664fbef1614b1b
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 728bb52c5288. Setting up logs at ./log/docker/node8_2026-03-26_04-52-25__f9f31a43-9b37-4555-9e15-d756a8e5b379__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 33578
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:33578/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:33578/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:33578/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.188.155/tcp/33579/p2p/16Uiu2HAm3873mbwVzkPf3rUGw79NpVGnmJn3VU1itTLBD51gkLp1","/ip4/172.18.188.155/tcp/33580/ws/p2p/16Uiu2HAm3873mbwVzkPf3rUGw79NpVGnmJn3VU1itTLBD51gkLp1"],"enrUri":"enr:-L24QOYPprRN8VzJmGZL3kS9RERxEeT9eceTpcgMm0xcV86GFw_PrC0zVDh64Rjdb28Ejwo3zPgVBMQ3wNZtgt-6PawCgmlkgnY0gmlwhKwSvJuKbXVsdGlhZGRyc5YACASsErybBoMrAAoErBK8mwaDLN0DgnJzhQACAQAAiXNlY3AyNTZrMaECcl1izfZ07TPD1xxTXeYDZs7LzzYPFHpsytATH--LRXqDdGNwgoMrg3VkcIKDLYV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:33578/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.217.252/tcp/32720/p2p/16Uiu2HAmQR8e391dLiaMXwDJSY8XnqsvQze8NATDvo41Dpn3cbN7"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node9_2026-03-26_04-52-25__f9f31a43-9b37-4555-9e15-d756a8e5b379__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.101.69
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['33887', '33888', '33889', '33890', '33891']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 33887:33887 -p 33888:33888 -p 33889:33889 -p 33890:33890 -p 33891:33891 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=33889 --rest-port=33887 --tcp-port=33888 --discv5-udp-port=33890 --rest-address=0.0.0.0 --nat=extip:172.18.101.69 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=e23feee5f9e5393eb6ae2a6d48b9ad8c2efef1f6ecf4f45ea9b1f5bb6e53bfed --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=33891 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QAz9WE8nBvvfLYLfK3pvgEaOArY-pC3dG6cILqHb01ASDZLEzgNg_Gtezp_OU0_eD76L3BofR2s19iBHm-A_Sk0CgmlkgnY0gmlwhKwS2fyKbXVsdGlhZGRyc5YACASsEtn8Bn_QAAoErBLZ_AZ_0d0DgnJzhQACAQAAiXNlY3AyNTZrMaEDrr974dQN4suZEwDQ79nTe76kWmEZ25ZQFdfN1YntsAiDdGNwgn_Qg3VkcIJ_0oV3YWt1MgU --content-topic=/myapp/1/latest/proto
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.101.69 waku ce2e3ed67d8e449acbc2111a423031a962468192261debf4c58ebbc169334511
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID ce2e3ed67d8e. Setting up logs at ./log/docker/node9_2026-03-26_04-52-25__f9f31a43-9b37-4555-9e15-d756a8e5b379__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 33887
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:33887/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:33887/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.101.69/tcp/33888/p2p/16Uiu2HAmQzhqhsQQikXZSrhDbehw2fJyzRKnuf6rKVHhvzp98Ruz","/ip4/172.18.101.69/tcp/33889/ws/p2p/16Uiu2HAmQzhqhsQQikXZSrhDbehw2fJyzRKnuf6rKVHhvzp98Ruz"],"enrUri":"enr:-L24QIAOg_1SPWkhPCkxhRf5WKz8rlom1n2yCpyV_iukVbsyOpx7AbBi3O0FDTNNbhLbVolmt0uUQVC1tekwusxQpRICgmlkgnY0gmlwhKwSZUWKbXVsdGlhZGRyc5YACASsEmVFBoRgAAoErBJlRQaEYd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDt1kw-LXuHxDQ6v-7gffSecihHjRS58NaImbINGwSaBmDdGNwgoRgg3VkcIKEYoV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:33887/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.217.252/tcp/32720/p2p/16Uiu2HAmQR8e391dLiaMXwDJSY8XnqsvQze8NATDvo41Dpn3cbN7"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node10_2026-03-26_04-52-25__f9f31a43-9b37-4555-9e15-d756a8e5b379__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.29.58
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['28568', '28569', '28570', '28571', '28572']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 28568:28568 -p 28569:28569 -p 28570:28570 -p 28571:28571 -p 28572:28572 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=28570 --rest-port=28568 --tcp-port=28569 --discv5-udp-port=28571 --rest-address=0.0.0.0 --nat=extip:172.18.29.58 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=2dbbfdafd9ffac8c1d796d4625cb48dde1e204e9cb99d137c1dfdeb148d76bac --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=28572 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QAz9WE8nBvvfLYLfK3pvgEaOArY-pC3dG6cILqHb01ASDZLEzgNg_Gtezp_OU0_eD76L3BofR2s19iBHm-A_Sk0CgmlkgnY0gmlwhKwS2fyKbXVsdGlhZGRyc5YACASsEtn8Bn_QAAoErBLZ_AZ_0d0DgnJzhQACAQAAiXNlY3AyNTZrMaEDrr974dQN4suZEwDQ79nTe76kWmEZ25ZQFdfN1YntsAiDdGNwgn_Qg3VkcIJ_0oV3YWt1MgU --content-topic=/myapp/1/latest/proto
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.29.58 waku 96b3b55460c83995f2a03eeef70d339c78473e7413d7915799fd39e3d566c145
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 96b3b55460c8. Setting up logs at ./log/docker/node10_2026-03-26_04-52-25__f9f31a43-9b37-4555-9e15-d756a8e5b379__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 28568
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:28568/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:28568/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:28568/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:28568/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:28568/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:28568/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:28568/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:28568/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.29.58/tcp/28569/p2p/16Uiu2HAm7gwY46pGqMvrcws74MV36JUYan3TPyATpdef1ahN6vP1","/ip4/172.18.29.58/tcp/28570/ws/p2p/16Uiu2HAm7gwY46pGqMvrcws74MV36JUYan3TPyATpdef1ahN6vP1"],"enrUri":"enr:-L24QBB-8sAEvOAOONw7E9cdj4HpcnLqIaHrxCSs5oZQJxqmNHuRQIQ0qC9oDekmSGdF5Hrz1bzabPK9NLS8jg3orakCgmlkgnY0gmlwhKwSHTqKbXVsdGlhZGRyc5YACASsEh06Bm-ZAAoErBIdOgZvmt0DgnJzhQACAQAAiXNlY3AyNTZrMaECtjWLcy2iMtSOOUBhxxWVwlbckb2I5kri810luMjVUciDdGNwgm-Zg3VkcIJvm4V3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:28568/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.217.252/tcp/32720/p2p/16Uiu2HAmQR8e391dLiaMXwDJSY8XnqsvQze8NATDvo41Dpn3cbN7"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:32719/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:34783/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:18373/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:60670/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:41568/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:55108/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:33578/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:33887/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:28568/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:32719/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.1 seconds
DEBUG  src.steps.sharding:sharding.py:158 Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:32719/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774500758047332436,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.sharding:sharding.py:158 Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:34783/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774500758047332436,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.sharding:sharding.py:158 Checking that peer NODE_3:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:18373/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774500758047332436,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.sharding:sharding.py:158 Checking that peer NODE_4:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:60670/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774500758047332436,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.sharding:sharding.py:158 Checking that peer NODE_5:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:41568/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774500758047332436,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.sharding:sharding.py:158 Checking that peer NODE_6:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:55108/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774500758047332436,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.sharding:sharding.py:158 Checking that peer NODE_7:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:33578/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774500758047332436,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.sharding:sharding.py:158 Checking that peer NODE_8:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:33887/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774500758047332436,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.sharding:sharding.py:158 Checking that peer NODE_9:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:28568/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774500758047332436,"ephemeral":false,"proof":""}]'
DEBUG  tests.conftest:conftest.py:59 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:83 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 536e1eca3b9e
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 3d613285462b
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id e51b44de5418
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 536e1eca3b9e. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 8199e22ac7b6
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 3d613285462b. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id c8ab49ac28d3
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container e51b44de5418. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id aa65fecdd541
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 8199e22ac7b6. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 728bb52c5288
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container c8ab49ac28d3. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id ce2e3ed67d8e
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container aa65fecdd541. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 96b3b55460c8
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 728bb52c5288. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  tests.conftest:conftest.py:98 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container ce2e3ed67d8e. Exiting log stream.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.