155 lines
30 KiB
Plaintext

2026-02-28 04:25:45.727 DEBUG [tests.conftest] Running fixture setup: test_id
2026-02-28 04:25:45.728 DEBUG [tests.conftest] Running test: test_ping_only_some_nodes_have_subscriptions with id: 2026-02-28_04-25-45__5e005816-d0a5-43c8-9d85-3880000c5930
2026-02-28 04:25:45.730 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-02-28 04:25:45.730 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-02-28 04:25:45.731 DEBUG [src.steps.filter] Running fixture setup: setup_main_relay_node
2026-02-28 04:25:45.738 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-28 04:25:45.738 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-02-28_04-25-45__5e005816-d0a5-43c8-9d85-3880000c5930__wakuorg_nwaku:latest.log
2026-02-28 04:25:45.739 DEBUG [src.node.waku_node] Starting Node...
2026-02-28 04:25:45.739 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-28 04:25:45.743 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-28 04:25:45.744 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.11.146
2026-02-28 04:25:45.744 DEBUG [src.node.docker_mananger] Generated ports ['3822', '3823', '3824', '3825', '3826']
2026-02-28 04:25:45.745 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-28 04:25:45.746 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-28 04:25:45.746 DEBUG [src.node.waku_node] Using volumes []
2026-02-28 04:25:45.746 DEBUG [src.node.docker_mananger] docker run -i -t -p 3822:3822 -p 3823:3823 -p 3824:3824 -p 3825:3825 -p 3826:3826 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=3824 --rest-port=3822 --tcp-port=3823 --discv5-udp-port=3825 --rest-address=0.0.0.0 --nat=extip:172.18.11.146 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=deb42caffba166b3db5f8340bda98bab0e0bf3954a4fbb2ff0263a183f96ff88 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=3826 --metrics-logging=true --relay=true --filter=true
2026-02-28 04:25:45.930 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.11.146 waku 4b1fa1e9ed834aa371bb04f6ed06095bcb9b5204ae3212edcceffb6bb933dce6
2026-02-28 04:25:45.956 ERROR [src.node.docker_mananger] Max retries reached for container a5946f97a9f6. Exiting log stream.
2026-02-28 04:25:45.967 DEBUG [src.node.docker_mananger] Container started with ID 4b1fa1e9ed83. Setting up logs at ./log/docker/node1_2026-02-28_04-25-45__5e005816-d0a5-43c8-9d85-3880000c5930__wakuorg_nwaku:latest.log
2026-02-28 04:25:45.967 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 3822
2026-02-28 04:25:45.967 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-28 04:25:46.588 ERROR [src.node.docker_mananger] Max retries reached for container f7f93e31f6a7. Exiting log stream.
2026-02-28 04:25:46.969 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3822/health" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:25:46.971 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-28 04:25:46.972 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-28 04:25:46.972 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3822/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:25:46.974 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.11.146/tcp/3823/p2p/16Uiu2HAmP4URXKh7VBBA3xaqhv6mzq8GX9EDyorq8m2qWVduCi9A","/ip4/172.18.11.146/tcp/3824/ws/p2p/16Uiu2HAmP4URXKh7VBBA3xaqhv6mzq8GX9EDyorq8m2qWVduCi9A"],"enrUri":"enr:-L24QI5QSJBZduSODUEpcxQEzk_EH6V7-1sJsI4KID07EWQrd0IiWcD9C1jSJoVurPqD4U-wjoeNIoTFFGvuOis4dRYCgmlkgnY0gmlwhKwSC5KKbXVsdGlhZGRyc5YACASsEguSBg7vAAoErBILkgYO8N0DgnJzhQADAQAAiXNlY3AyNTZrMaEDmpj4WRedf7UQHbXVqXBk4iUnaAeMAuXl-96vzaCuH5WDdGNwgg7vg3VkcIIO8YV3YWt1MgU"}'
2026-02-28 04:25:46.974 INFO [src.node.waku_node] REST service is ready !!
2026-02-28 04:25:46.975 DEBUG [src.steps.filter] Running fixture setup: setup_main_filter_node
2026-02-28 04:25:46.981 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-28 04:25:46.981 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-02-28_04-25-45__5e005816-d0a5-43c8-9d85-3880000c5930__wakuorg_nwaku:latest.log
2026-02-28 04:25:46.981 DEBUG [src.node.waku_node] Starting Node...
2026-02-28 04:25:46.981 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-28 04:25:46.983 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-28 04:25:46.983 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.218.56
2026-02-28 04:25:46.983 DEBUG [src.node.docker_mananger] Generated ports ['28966', '28967', '28968', '28969', '28970']
2026-02-28 04:25:46.983 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-28 04:25:46.983 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-28 04:25:46.983 DEBUG [src.node.waku_node] Using volumes []
2026-02-28 04:25:46.983 DEBUG [src.node.docker_mananger] docker run -i -t -p 28966:28966 -p 28967:28967 -p 28968:28968 -p 28969:28969 -p 28970:28970 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=28968 --rest-port=28966 --tcp-port=28967 --discv5-udp-port=28969 --rest-address=0.0.0.0 --nat=extip:172.18.218.56 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=a00faacc20a7d32a9412dabe8defb22a50f7de25bbeb7fda5a0eaa0cc7ea06a3 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=28970 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QI5QSJBZduSODUEpcxQEzk_EH6V7-1sJsI4KID07EWQrd0IiWcD9C1jSJoVurPqD4U-wjoeNIoTFFGvuOis4dRYCgmlkgnY0gmlwhKwSC5KKbXVsdGlhZGRyc5YACASsEguSBg7vAAoErBILkgYO8N0DgnJzhQADAQAAiXNlY3AyNTZrMaEDmpj4WRedf7UQHbXVqXBk4iUnaAeMAuXl-96vzaCuH5WDdGNwgg7vg3VkcIIO8YV3YWt1MgU --filternode=/ip4/172.18.11.146/tcp/3823/p2p/16Uiu2HAmP4URXKh7VBBA3xaqhv6mzq8GX9EDyorq8m2qWVduCi9A
2026-02-28 04:25:47.169 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.218.56 waku 3a0a4d09762a793195e952f1667af75b6b66945b30cc037ab16d3c08571fa60c
2026-02-28 04:25:47.206 DEBUG [src.node.docker_mananger] Container started with ID 3a0a4d09762a. Setting up logs at ./log/docker/node2_2026-02-28_04-25-45__5e005816-d0a5-43c8-9d85-3880000c5930__wakuorg_nwaku:latest.log
2026-02-28 04:25:47.207 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 28966
2026-02-28 04:25:47.207 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-28 04:25:48.208 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:28966/health" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:25:48.211 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-28 04:25:48.211 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-28 04:25:48.212 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:28966/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:25:48.214 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.218.56/tcp/28967/p2p/16Uiu2HAmGycf5eFivLU2Ss6hsXGpiNb1mzHAkGN8A9ttw41rC5FQ","/ip4/172.18.218.56/tcp/28968/ws/p2p/16Uiu2HAmGycf5eFivLU2Ss6hsXGpiNb1mzHAkGN8A9ttw41rC5FQ"],"enrUri":"enr:-L24QPrceP29Bq81zLK3nFId3y_RbW1eYLquiFeynvuoezUFe4R1X7hs47ee2LiQ31fUx6j8jS6FoqLFhGOtLGjriSQCgmlkgnY0gmlwhKwS2jiKbXVsdGlhZGRyc5YACASsEto4BnEnAAoErBLaOAZxKN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDQDRBInALVwoRHaelD7XusIBg82H3yekVVlX6F7a-OluDdGNwgnEng3VkcIJxKYV3YWt1MgA"}'
2026-02-28 04:25:48.214 INFO [src.node.waku_node] REST service is ready !!
2026-02-28 04:25:48.214 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:28966/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.11.146/tcp/3823/p2p/16Uiu2HAmP4URXKh7VBBA3xaqhv6mzq8GX9EDyorq8m2qWVduCi9A"]'
2026-02-28 04:25:48.250 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:25:48.254 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3822/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-28 04:25:48.270 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:25:48.271 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:28966/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "20ed531c-b9ba-4d1f-9b9b-54ce8bf33976", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-02-28 04:25:48.284 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"20ed531c-b9ba-4d1f-9b9b-54ce8bf33976","statusDesc":"OK"}'
2026-02-28 04:25:48.292 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-28 04:25:48.293 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-02-28_04-25-45__5e005816-d0a5-43c8-9d85-3880000c5930__wakuorg_nwaku:latest.log
2026-02-28 04:25:48.293 DEBUG [src.node.waku_node] Starting Node...
2026-02-28 04:25:48.293 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-28 04:25:48.294 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-28 04:25:48.294 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.231.237
2026-02-28 04:25:48.294 DEBUG [src.node.docker_mananger] Generated ports ['3467', '3468', '3469', '3470', '3471']
2026-02-28 04:25:48.295 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-28 04:25:48.295 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-28 04:25:48.295 DEBUG [src.node.waku_node] Using volumes []
2026-02-28 04:25:48.295 DEBUG [src.node.docker_mananger] docker run -i -t -p 3467:3467 -p 3468:3468 -p 3469:3469 -p 3470:3470 -p 3471:3471 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=3469 --rest-port=3467 --tcp-port=3468 --discv5-udp-port=3470 --rest-address=0.0.0.0 --nat=extip:172.18.231.237 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=58bcb8404beeaf3ecfcaf99fb5a1fb8bf682c83e26c0fc5bd45ca6ee84ecb9c5 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=3471 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QI5QSJBZduSODUEpcxQEzk_EH6V7-1sJsI4KID07EWQrd0IiWcD9C1jSJoVurPqD4U-wjoeNIoTFFGvuOis4dRYCgmlkgnY0gmlwhKwSC5KKbXVsdGlhZGRyc5YACASsEguSBg7vAAoErBILkgYO8N0DgnJzhQADAQAAiXNlY3AyNTZrMaEDmpj4WRedf7UQHbXVqXBk4iUnaAeMAuXl-96vzaCuH5WDdGNwgg7vg3VkcIIO8YV3YWt1MgU --filternode=/ip4/172.18.11.146/tcp/3823/p2p/16Uiu2HAmP4URXKh7VBBA3xaqhv6mzq8GX9EDyorq8m2qWVduCi9A
2026-02-28 04:25:48.487 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.231.237 waku 379d5c6acb8b5b4efed8d4ed581074b01a32fe1a21d55737768e8ff138c169d0
2026-02-28 04:25:48.518 DEBUG [src.node.docker_mananger] Container started with ID 379d5c6acb8b. Setting up logs at ./log/docker/node3_2026-02-28_04-25-45__5e005816-d0a5-43c8-9d85-3880000c5930__wakuorg_nwaku:latest.log
2026-02-28 04:25:48.519 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 3467
2026-02-28 04:25:48.520 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-28 04:25:49.520 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3467/health" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:25:49.523 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-28 04:25:49.524 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-28 04:25:49.524 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3467/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:25:49.526 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.231.237/tcp/3468/p2p/16Uiu2HAmNopdPNZ1dZsQWmHvLTVEAce8zq9jgvrK5BU9C45FDQtC","/ip4/172.18.231.237/tcp/3469/ws/p2p/16Uiu2HAmNopdPNZ1dZsQWmHvLTVEAce8zq9jgvrK5BU9C45FDQtC"],"enrUri":"enr:-L24QKw-hy7xGtzhPhHqB5PwDXn4JJQeOanBQrFaW8ypFp3gc8rnebyIATskfPdn2jlal65Cp4f0MMkBnlmSrlzf3GICgmlkgnY0gmlwhKwS5-2KbXVsdGlhZGRyc5YACASsEuftBg2MAAoErBLn7QYNjd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDltgacqLmoBmWgBP7B9iCu5xdbHszBOJiV9ZlqaFtdVWDdGNwgg2Mg3VkcIINjoV3YWt1MgA"}'
2026-02-28 04:25:49.526 INFO [src.node.waku_node] REST service is ready !!
2026-02-28 04:25:49.526 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3467/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.11.146/tcp/3823/p2p/16Uiu2HAmP4URXKh7VBBA3xaqhv6mzq8GX9EDyorq8m2qWVduCi9A"]'
2026-02-28 04:25:49.565 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:25:49.578 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-28 04:25:49.579 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-02-28_04-25-45__5e005816-d0a5-43c8-9d85-3880000c5930__wakuorg_nwaku:latest.log
2026-02-28 04:25:49.579 DEBUG [src.node.waku_node] Starting Node...
2026-02-28 04:25:49.579 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-28 04:25:49.584 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-28 04:25:49.584 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.218.213
2026-02-28 04:25:49.584 DEBUG [src.node.docker_mananger] Generated ports ['24898', '24899', '24900', '24901', '24902']
2026-02-28 04:25:49.584 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-28 04:25:49.584 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-28 04:25:49.585 DEBUG [src.node.waku_node] Using volumes []
2026-02-28 04:25:49.585 DEBUG [src.node.docker_mananger] docker run -i -t -p 24898:24898 -p 24899:24899 -p 24900:24900 -p 24901:24901 -p 24902:24902 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=24900 --rest-port=24898 --tcp-port=24899 --discv5-udp-port=24901 --rest-address=0.0.0.0 --nat=extip:172.18.218.213 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=cb9fb99aee5c72bfcd0015e8fa5f1630c4f04f718bbc2eedbdf6b0cc8d4ddb54 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=24902 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QI5QSJBZduSODUEpcxQEzk_EH6V7-1sJsI4KID07EWQrd0IiWcD9C1jSJoVurPqD4U-wjoeNIoTFFGvuOis4dRYCgmlkgnY0gmlwhKwSC5KKbXVsdGlhZGRyc5YACASsEguSBg7vAAoErBILkgYO8N0DgnJzhQADAQAAiXNlY3AyNTZrMaEDmpj4WRedf7UQHbXVqXBk4iUnaAeMAuXl-96vzaCuH5WDdGNwgg7vg3VkcIIO8YV3YWt1MgU --filternode=/ip4/172.18.11.146/tcp/3823/p2p/16Uiu2HAmP4URXKh7VBBA3xaqhv6mzq8GX9EDyorq8m2qWVduCi9A
2026-02-28 04:25:49.771 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.218.213 waku 43a67c49068cc227d9cc23dca23a2fd72e3f173814ce227a3b3d257134c42fdf
2026-02-28 04:25:49.807 DEBUG [src.node.docker_mananger] Container started with ID 43a67c49068c. Setting up logs at ./log/docker/node4_2026-02-28_04-25-45__5e005816-d0a5-43c8-9d85-3880000c5930__wakuorg_nwaku:latest.log
2026-02-28 04:25:49.807 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 24898
2026-02-28 04:25:49.808 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-28 04:25:50.809 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24898/health" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:25:50.812 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-28 04:25:50.812 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-28 04:25:50.812 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24898/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:25:50.814 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.218.213/tcp/24899/p2p/16Uiu2HAmDjB7he732qJvZWZfFrEmjojxjVPXQJ2XUHqZEyT2hRNM","/ip4/172.18.218.213/tcp/24900/ws/p2p/16Uiu2HAmDjB7he732qJvZWZfFrEmjojxjVPXQJ2XUHqZEyT2hRNM"],"enrUri":"enr:-L24QKAtSFIRBnJ-92XY9u8OweKtOcYlx1nW7frgzqYUMP-xap6nXo6XWTSu2xb692Ti7bOYXcTsMDY1c7ZP753zAdgCgmlkgnY0gmlwhKwS2tWKbXVsdGlhZGRyc5YACASsEtrVBmFDAAoErBLa1QZhRN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDD-4u2PxRHzfHCThOrdQFQtnVK7qkr0M7OF00GIWjNEaDdGNwgmFDg3VkcIJhRYV3YWt1MgA"}'
2026-02-28 04:25:50.815 INFO [src.node.waku_node] REST service is ready !!
2026-02-28 04:25:50.815 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24898/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.11.146/tcp/3823/p2p/16Uiu2HAmP4URXKh7VBBA3xaqhv6mzq8GX9EDyorq8m2qWVduCi9A"]'
2026-02-28 04:25:50.854 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:25:50.866 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-28 04:25:50.867 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-02-28_04-25-45__5e005816-d0a5-43c8-9d85-3880000c5930__wakuorg_nwaku:latest.log
2026-02-28 04:25:50.867 DEBUG [src.node.waku_node] Starting Node...
2026-02-28 04:25:50.867 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-28 04:25:50.871 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-28 04:25:50.871 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.180.90
2026-02-28 04:25:50.871 DEBUG [src.node.docker_mananger] Generated ports ['18626', '18627', '18628', '18629', '18630']
2026-02-28 04:25:50.871 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-28 04:25:50.872 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-28 04:25:50.872 DEBUG [src.node.waku_node] Using volumes []
2026-02-28 04:25:50.872 DEBUG [src.node.docker_mananger] docker run -i -t -p 18626:18626 -p 18627:18627 -p 18628:18628 -p 18629:18629 -p 18630:18630 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=18628 --rest-port=18626 --tcp-port=18627 --discv5-udp-port=18629 --rest-address=0.0.0.0 --nat=extip:172.18.180.90 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=d320aa3dc4c1811dadd4fb14abbc64bfd5e4cea1beb5e932b6d36a4259feb3ec --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=18630 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QI5QSJBZduSODUEpcxQEzk_EH6V7-1sJsI4KID07EWQrd0IiWcD9C1jSJoVurPqD4U-wjoeNIoTFFGvuOis4dRYCgmlkgnY0gmlwhKwSC5KKbXVsdGlhZGRyc5YACASsEguSBg7vAAoErBILkgYO8N0DgnJzhQADAQAAiXNlY3AyNTZrMaEDmpj4WRedf7UQHbXVqXBk4iUnaAeMAuXl-96vzaCuH5WDdGNwgg7vg3VkcIIO8YV3YWt1MgU --filternode=/ip4/172.18.11.146/tcp/3823/p2p/16Uiu2HAmP4URXKh7VBBA3xaqhv6mzq8GX9EDyorq8m2qWVduCi9A
2026-02-28 04:25:51.070 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.180.90 waku 74aefacc606208133d9242db5d2b06e6c99939c5b1b5c4ff2e233825ca5dc0d9
2026-02-28 04:25:51.103 DEBUG [src.node.docker_mananger] Container started with ID 74aefacc6062. Setting up logs at ./log/docker/node5_2026-02-28_04-25-45__5e005816-d0a5-43c8-9d85-3880000c5930__wakuorg_nwaku:latest.log
2026-02-28 04:25:51.104 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 18626
2026-02-28 04:25:51.104 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-28 04:25:52.105 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18626/health" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:25:52.108 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-28 04:25:52.108 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-28 04:25:52.108 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18626/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:25:52.110 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.180.90/tcp/18627/p2p/16Uiu2HAmLQbNafqoneAViLF1ZAcgb77tuJVr3t67rZmkpXPHmhYM","/ip4/172.18.180.90/tcp/18628/ws/p2p/16Uiu2HAmLQbNafqoneAViLF1ZAcgb77tuJVr3t67rZmkpXPHmhYM"],"enrUri":"enr:-L24QB-Tfb_SKIn6YXmRkvZG6ViEzwO05UMHqxWtXOIeXlJdKNN8foIaHmhihx5F4Zy928R_TEHgoL_VLlvcfpqoQCsCgmlkgnY0gmlwhKwStFqKbXVsdGlhZGRyc5YACASsErRaBkjDAAoErBK0WgZIxN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDcy1iEV87LRhPoz0aHCbr6dKsjGTxFa7lX22nOmU-tFqDdGNwgkjDg3VkcIJIxYV3YWt1MgA"}'
2026-02-28 04:25:52.111 INFO [src.node.waku_node] REST service is ready !!
2026-02-28 04:25:52.111 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:18626/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.11.146/tcp/3823/p2p/16Uiu2HAmP4URXKh7VBBA3xaqhv6mzq8GX9EDyorq8m2qWVduCi9A"]'
2026-02-28 04:25:52.150 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:25:52.151 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:28966/filter/v2/subscriptions/1" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:25:52.170 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"1","statusDesc":"OK"}'
2026-02-28 04:25:52.171 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3467/filter/v2/subscriptions/12d19c7d-cca6-415c-be13-bf4ade008641" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:25:52.179 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:3467/filter/v2/subscriptions/12d19c7d-cca6-415c-be13-bf4ade008641. Response content: b'{"requestId":"12d19c7d-cca6-415c-be13-bf4ade008641","statusDesc":"NOT_FOUND: peer has no subscriptions"}'
2026-02-28 04:25:52.181 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24898/filter/v2/subscriptions/88954eb7-3e2c-47c6-9af9-1361755729e7" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:25:52.188 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:24898/filter/v2/subscriptions/88954eb7-3e2c-47c6-9af9-1361755729e7. Response content: b'{"requestId":"88954eb7-3e2c-47c6-9af9-1361755729e7","statusDesc":"NOT_FOUND: peer has no subscriptions"}'
2026-02-28 04:25:52.189 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18626/filter/v2/subscriptions/3199d7f7-9d0a-4557-9d59-6ca8fe54c8e8" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:25:52.198 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:18626/filter/v2/subscriptions/3199d7f7-9d0a-4557-9d59-6ca8fe54c8e8. Response content: b'{"requestId":"3199d7f7-9d0a-4557-9d59-6ca8fe54c8e8","statusDesc":"NOT_FOUND: peer has no subscriptions"}'
2026-02-28 04:25:52.201 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-02-28 04:25:52.201 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-02-28 04:25:52.202 DEBUG [src.node.waku_node] Stopping container with id 4b1fa1e9ed83
2026-02-28 04:25:52.803 DEBUG [src.node.waku_node] Container stopped.
2026-02-28 04:25:52.803 DEBUG [src.node.waku_node] Stopping container with id 3a0a4d09762a
2026-02-28 04:25:53.340 DEBUG [src.node.waku_node] Container stopped.
2026-02-28 04:25:53.343 DEBUG [src.node.waku_node] Stopping container with id 379d5c6acb8b
2026-02-28 04:25:53.616 ERROR [src.node.docker_mananger] Max retries reached for container 4b1fa1e9ed83. Exiting log stream.
2026-02-28 04:25:53.897 DEBUG [src.node.waku_node] Container stopped.
2026-02-28 04:25:53.899 DEBUG [src.node.waku_node] Stopping container with id 43a67c49068c
2026-02-28 04:25:54.175 ERROR [src.node.docker_mananger] Max retries reached for container 3a0a4d09762a. Exiting log stream.
2026-02-28 04:25:54.427 DEBUG [src.node.waku_node] Container stopped.
2026-02-28 04:25:54.428 DEBUG [src.node.waku_node] Stopping container with id 74aefacc6062
2026-02-28 04:25:54.732 ERROR [src.node.docker_mananger] Max retries reached for container 379d5c6acb8b. Exiting log stream.
2026-02-28 04:25:54.954 DEBUG [src.node.waku_node] Container stopped.
2026-02-28 04:25:54.956 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-02-28 04:25:54.970 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-28 04:25:54.980 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-28 04:25:54.988 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-28 04:25:54.997 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-28 04:25:55.003 DEBUG [src.node.docker_mananger] No errors found in the waku logs.