155 lines
30 KiB
Plaintext

2026-03-14 04:31:48.893 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-14 04:31:48.894 DEBUG [tests.conftest] Running test: test_ping_only_some_nodes_have_subscriptions with id: 2026-03-14_04-31-48__0caa4dac-1e04-483b-b938-667d1a2a9ab6
2026-03-14 04:31:48.895 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-14 04:31:48.895 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-03-14 04:31:48.895 DEBUG [src.steps.filter] Running fixture setup: setup_main_relay_node
2026-03-14 04:31:48.904 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-14 04:31:48.905 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-14_04-31-48__0caa4dac-1e04-483b-b938-667d1a2a9ab6__wakuorg_nwaku:latest.log
2026-03-14 04:31:48.905 DEBUG [src.node.waku_node] Starting Node...
2026-03-14 04:31:48.905 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-14 04:31:48.908 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-14 04:31:48.909 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.123.190
2026-03-14 04:31:48.910 DEBUG [src.node.docker_mananger] Generated ports ['61165', '61166', '61167', '61168', '61169']
2026-03-14 04:31:48.911 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-14 04:31:48.911 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-14 04:31:48.912 DEBUG [src.node.waku_node] Using volumes []
2026-03-14 04:31:48.912 DEBUG [src.node.docker_mananger] docker run -i -t -p 61165:61165 -p 61166:61166 -p 61167:61167 -p 61168:61168 -p 61169:61169 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=61167 --rest-port=61165 --tcp-port=61166 --discv5-udp-port=61168 --rest-address=0.0.0.0 --nat=extip:172.18.123.190 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ceaa36cb4161cc4f4c5fed6d9d713c466cbd866c1e9c4a3df85cb5c8c2654b56 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=61169 --metrics-logging=true --relay=true --filter=true
2026-03-14 04:31:49.115 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.123.190 waku de8397e3cce2110728904315d041df750590caf017014e89276204509773f749
2026-03-14 04:31:49.143 ERROR [src.node.docker_mananger] Max retries reached for container 9b45b027ca51. Exiting log stream.
2026-03-14 04:31:49.154 DEBUG [src.node.docker_mananger] Container started with ID de8397e3cce2. Setting up logs at ./log/docker/node1_2026-03-14_04-31-48__0caa4dac-1e04-483b-b938-667d1a2a9ab6__wakuorg_nwaku:latest.log
2026-03-14 04:31:49.154 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 61165
2026-03-14 04:31:49.155 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-14 04:31:49.762 ERROR [src.node.docker_mananger] Max retries reached for container f5392b9ace92. Exiting log stream.
2026-03-14 04:31:50.156 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61165/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:31:50.159 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-14 04:31:50.159 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-14 04:31:50.159 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61165/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:31:50.162 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.123.190/tcp/61166/p2p/16Uiu2HAm8c94RW21dg1mCRrJU4z9b1v9SGG37gipWM3DD7xsH3DD","/ip4/172.18.123.190/tcp/61167/ws/p2p/16Uiu2HAm8c94RW21dg1mCRrJU4z9b1v9SGG37gipWM3DD7xsH3DD"],"enrUri":"enr:-L24QI9vdwlAaCA3gA9R1D7T8jDSCVMODSRzwLHqk-IUqlKLKmOd9BgIzvEVgB24jg95AhcQ5Q9nJrOUI6WrYolXbAUCgmlkgnY0gmlwhKwSe76KbXVsdGlhZGRyc5YACASsEnu-Bu7uAAoErBJ7vgbu790DgnJzhQADAQAAiXNlY3AyNTZrMaECw9Zbfa6j8dHex3rWC1o9mKC-0Y9mhN-Mif5iLBDlHYyDdGNwgu7ug3VkcILu8IV3YWt1MgU"}'
2026-03-14 04:31:50.162 INFO [src.node.waku_node] REST service is ready !!
2026-03-14 04:31:50.162 DEBUG [src.steps.filter] Running fixture setup: setup_main_filter_node
2026-03-14 04:31:50.169 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-14 04:31:50.169 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-14_04-31-48__0caa4dac-1e04-483b-b938-667d1a2a9ab6__wakuorg_nwaku:latest.log
2026-03-14 04:31:50.169 DEBUG [src.node.waku_node] Starting Node...
2026-03-14 04:31:50.169 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-14 04:31:50.171 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-14 04:31:50.171 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.41.118
2026-03-14 04:31:50.171 DEBUG [src.node.docker_mananger] Generated ports ['9268', '9269', '9270', '9271', '9272']
2026-03-14 04:31:50.171 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-14 04:31:50.171 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-14 04:31:50.171 DEBUG [src.node.waku_node] Using volumes []
2026-03-14 04:31:50.172 DEBUG [src.node.docker_mananger] docker run -i -t -p 9268:9268 -p 9269:9269 -p 9270:9270 -p 9271:9271 -p 9272:9272 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=9270 --rest-port=9268 --tcp-port=9269 --discv5-udp-port=9271 --rest-address=0.0.0.0 --nat=extip:172.18.41.118 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=83facac04c722c65ac37858857ff5de213e4376afdb48d55f048eeadfaebdd5f --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=9272 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QI9vdwlAaCA3gA9R1D7T8jDSCVMODSRzwLHqk-IUqlKLKmOd9BgIzvEVgB24jg95AhcQ5Q9nJrOUI6WrYolXbAUCgmlkgnY0gmlwhKwSe76KbXVsdGlhZGRyc5YACASsEnu-Bu7uAAoErBJ7vgbu790DgnJzhQADAQAAiXNlY3AyNTZrMaECw9Zbfa6j8dHex3rWC1o9mKC-0Y9mhN-Mif5iLBDlHYyDdGNwgu7ug3VkcILu8IV3YWt1MgU --filternode=/ip4/172.18.123.190/tcp/61166/p2p/16Uiu2HAm8c94RW21dg1mCRrJU4z9b1v9SGG37gipWM3DD7xsH3DD
2026-03-14 04:31:50.361 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.41.118 waku 1fc91cfd3c1fb3a37e2102f87ffa10dbd33899a1c096ec61278fcf093f15a9a4
2026-03-14 04:31:50.392 DEBUG [src.node.docker_mananger] Container started with ID 1fc91cfd3c1f. Setting up logs at ./log/docker/node2_2026-03-14_04-31-48__0caa4dac-1e04-483b-b938-667d1a2a9ab6__wakuorg_nwaku:latest.log
2026-03-14 04:31:50.392 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 9268
2026-03-14 04:31:50.392 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-14 04:31:51.393 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9268/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:31:51.395 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-14 04:31:51.396 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-14 04:31:51.396 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9268/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:31:51.398 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.41.118/tcp/9269/p2p/16Uiu2HAkuhRp7vGssR24sRFBV3QGLdJ4eiP41bNZuBY9hFMJje1t","/ip4/172.18.41.118/tcp/9270/ws/p2p/16Uiu2HAkuhRp7vGssR24sRFBV3QGLdJ4eiP41bNZuBY9hFMJje1t"],"enrUri":"enr:-L24QNouD2Ri_2JbWJyw1rHZKWZB4sB9IH8sAJFZaFNqcM44fdQsXZIu_JZ0C1CbVWple04K_5FLS_ohb-50zA0s-YMCgmlkgnY0gmlwhKwSKXaKbXVsdGlhZGRyc5YACASsEil2BiQ1AAoErBIpdgYkNt0DgnJzhQADAQAAiXNlY3AyNTZrMaECBAlGRnR4j55Rma1W7fa6kVJLEydIkFX5goqDBpgHUQeDdGNwgiQ1g3VkcIIkN4V3YWt1MgA"}'
2026-03-14 04:31:51.399 INFO [src.node.waku_node] REST service is ready !!
2026-03-14 04:31:51.399 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:9268/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.123.190/tcp/61166/p2p/16Uiu2HAm8c94RW21dg1mCRrJU4z9b1v9SGG37gipWM3DD7xsH3DD"]'
2026-03-14 04:31:51.435 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:31:51.439 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61165/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-14 04:31:51.456 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:31:51.458 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:9268/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "153b6275-ebce-44da-806d-d0d6f7e3cfca", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-14 04:31:51.471 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"153b6275-ebce-44da-806d-d0d6f7e3cfca","statusDesc":"OK"}'
2026-03-14 04:31:51.478 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-14 04:31:51.478 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-14_04-31-48__0caa4dac-1e04-483b-b938-667d1a2a9ab6__wakuorg_nwaku:latest.log
2026-03-14 04:31:51.478 DEBUG [src.node.waku_node] Starting Node...
2026-03-14 04:31:51.479 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-14 04:31:51.480 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-14 04:31:51.480 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.55.192
2026-03-14 04:31:51.480 DEBUG [src.node.docker_mananger] Generated ports ['46127', '46128', '46129', '46130', '46131']
2026-03-14 04:31:51.480 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-14 04:31:51.481 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-14 04:31:51.481 DEBUG [src.node.waku_node] Using volumes []
2026-03-14 04:31:51.481 DEBUG [src.node.docker_mananger] docker run -i -t -p 46127:46127 -p 46128:46128 -p 46129:46129 -p 46130:46130 -p 46131:46131 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=46129 --rest-port=46127 --tcp-port=46128 --discv5-udp-port=46130 --rest-address=0.0.0.0 --nat=extip:172.18.55.192 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=1b9cad6a7c9485fce82aabf6f4569d38f2b4b59f27dad20c58a06bf8f03bb6ac --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=46131 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QI9vdwlAaCA3gA9R1D7T8jDSCVMODSRzwLHqk-IUqlKLKmOd9BgIzvEVgB24jg95AhcQ5Q9nJrOUI6WrYolXbAUCgmlkgnY0gmlwhKwSe76KbXVsdGlhZGRyc5YACASsEnu-Bu7uAAoErBJ7vgbu790DgnJzhQADAQAAiXNlY3AyNTZrMaECw9Zbfa6j8dHex3rWC1o9mKC-0Y9mhN-Mif5iLBDlHYyDdGNwgu7ug3VkcILu8IV3YWt1MgU --filternode=/ip4/172.18.123.190/tcp/61166/p2p/16Uiu2HAm8c94RW21dg1mCRrJU4z9b1v9SGG37gipWM3DD7xsH3DD
2026-03-14 04:31:51.682 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.55.192 waku ec9f3b234d350cc3de4683f341a27a7c63aff6580c79c91c36c7b20b5f4d7359
2026-03-14 04:31:51.715 DEBUG [src.node.docker_mananger] Container started with ID ec9f3b234d35. Setting up logs at ./log/docker/node3_2026-03-14_04-31-48__0caa4dac-1e04-483b-b938-667d1a2a9ab6__wakuorg_nwaku:latest.log
2026-03-14 04:31:51.716 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 46127
2026-03-14 04:31:51.716 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-14 04:31:52.717 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:46127/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:31:52.720 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-14 04:31:52.721 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-14 04:31:52.721 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:46127/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:31:52.723 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.55.192/tcp/46128/p2p/16Uiu2HAmFSJyepvK64netiwBQJabddipfgQ8kUDyYfNDCXTL88Hm","/ip4/172.18.55.192/tcp/46129/ws/p2p/16Uiu2HAmFSJyepvK64netiwBQJabddipfgQ8kUDyYfNDCXTL88Hm"],"enrUri":"enr:-L24QIPdD7nFMRA23UDjy1q4Yg-eq4iFmY15gm8gwZWmZmTGdcqrUESQCLxhW7DUQHFL7M6Wcp67P90n0WcWMzBROK8CgmlkgnY0gmlwhKwSN8CKbXVsdGlhZGRyc5YACASsEjfABrQwAAoErBI3wAa0Md0DgnJzhQADAQAAiXNlY3AyNTZrMaEDKVOSYtrZB-1nN4pXJno9UVKz9xFDNqoGqp_s_gSfTlCDdGNwgrQwg3VkcIK0MoV3YWt1MgA"}'
2026-03-14 04:31:52.723 INFO [src.node.waku_node] REST service is ready !!
2026-03-14 04:31:52.724 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:46127/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.123.190/tcp/61166/p2p/16Uiu2HAm8c94RW21dg1mCRrJU4z9b1v9SGG37gipWM3DD7xsH3DD"]'
2026-03-14 04:31:52.764 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:31:52.777 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-14 04:31:52.779 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-14_04-31-48__0caa4dac-1e04-483b-b938-667d1a2a9ab6__wakuorg_nwaku:latest.log
2026-03-14 04:31:52.779 DEBUG [src.node.waku_node] Starting Node...
2026-03-14 04:31:52.779 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-14 04:31:52.783 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-14 04:31:52.783 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.40.204
2026-03-14 04:31:52.783 DEBUG [src.node.docker_mananger] Generated ports ['45113', '45114', '45115', '45116', '45117']
2026-03-14 04:31:52.783 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-14 04:31:52.783 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-14 04:31:52.783 DEBUG [src.node.waku_node] Using volumes []
2026-03-14 04:31:52.784 DEBUG [src.node.docker_mananger] docker run -i -t -p 45113:45113 -p 45114:45114 -p 45115:45115 -p 45116:45116 -p 45117:45117 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=45115 --rest-port=45113 --tcp-port=45114 --discv5-udp-port=45116 --rest-address=0.0.0.0 --nat=extip:172.18.40.204 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=4799ebbe4be9debe62a0a55dc6fa1af48eb2b718c8e0db1bba0c80fbcdc0f8bf --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=45117 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QI9vdwlAaCA3gA9R1D7T8jDSCVMODSRzwLHqk-IUqlKLKmOd9BgIzvEVgB24jg95AhcQ5Q9nJrOUI6WrYolXbAUCgmlkgnY0gmlwhKwSe76KbXVsdGlhZGRyc5YACASsEnu-Bu7uAAoErBJ7vgbu790DgnJzhQADAQAAiXNlY3AyNTZrMaECw9Zbfa6j8dHex3rWC1o9mKC-0Y9mhN-Mif5iLBDlHYyDdGNwgu7ug3VkcILu8IV3YWt1MgU --filternode=/ip4/172.18.123.190/tcp/61166/p2p/16Uiu2HAm8c94RW21dg1mCRrJU4z9b1v9SGG37gipWM3DD7xsH3DD
2026-03-14 04:31:52.980 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.40.204 waku 16b5c2a3762998e564137a9e480a66860ac779d72b86e115f9056ef1da644598
2026-03-14 04:31:53.015 DEBUG [src.node.docker_mananger] Container started with ID 16b5c2a37629. Setting up logs at ./log/docker/node4_2026-03-14_04-31-48__0caa4dac-1e04-483b-b938-667d1a2a9ab6__wakuorg_nwaku:latest.log
2026-03-14 04:31:53.016 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 45113
2026-03-14 04:31:53.016 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-14 04:31:54.017 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45113/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:31:54.020 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-14 04:31:54.020 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-14 04:31:54.021 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45113/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:31:54.023 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.40.204/tcp/45114/p2p/16Uiu2HAmBwSuduNiBEx7c9djBpubNJbnpsmZYe5sU4VNwE1vnMww","/ip4/172.18.40.204/tcp/45115/ws/p2p/16Uiu2HAmBwSuduNiBEx7c9djBpubNJbnpsmZYe5sU4VNwE1vnMww"],"enrUri":"enr:-L24QB7bhhi0OgdZXufFAAdc_TKpDvqt50WbW3n6mfERxeFaNM7B53ipS787vNptB_HIw3jkJED6abY0H70-rSl6M4cCgmlkgnY0gmlwhKwSKMyKbXVsdGlhZGRyc5YACASsEijMBrA6AAoErBIozAawO90DgnJzhQADAQAAiXNlY3AyNTZrMaEC9VuiifaRsH_cOUrzcXC74zWYDIRSXwI__beb5AfL2dqDdGNwgrA6g3VkcIKwPIV3YWt1MgA"}'
2026-03-14 04:31:54.023 INFO [src.node.waku_node] REST service is ready !!
2026-03-14 04:31:54.024 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45113/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.123.190/tcp/61166/p2p/16Uiu2HAm8c94RW21dg1mCRrJU4z9b1v9SGG37gipWM3DD7xsH3DD"]'
2026-03-14 04:31:54.064 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:31:54.078 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-14 04:31:54.078 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-03-14_04-31-48__0caa4dac-1e04-483b-b938-667d1a2a9ab6__wakuorg_nwaku:latest.log
2026-03-14 04:31:54.078 DEBUG [src.node.waku_node] Starting Node...
2026-03-14 04:31:54.079 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-14 04:31:54.081 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-14 04:31:54.081 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.42.72
2026-03-14 04:31:54.081 DEBUG [src.node.docker_mananger] Generated ports ['48267', '48268', '48269', '48270', '48271']
2026-03-14 04:31:54.081 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-14 04:31:54.081 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-14 04:31:54.082 DEBUG [src.node.waku_node] Using volumes []
2026-03-14 04:31:54.082 DEBUG [src.node.docker_mananger] docker run -i -t -p 48267:48267 -p 48268:48268 -p 48269:48269 -p 48270:48270 -p 48271:48271 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=48269 --rest-port=48267 --tcp-port=48268 --discv5-udp-port=48270 --rest-address=0.0.0.0 --nat=extip:172.18.42.72 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=7db14c0fec3b994dddeda44f5166521b3f0139dcb9dc97ad7bfd68bb33a26517 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=48271 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QI9vdwlAaCA3gA9R1D7T8jDSCVMODSRzwLHqk-IUqlKLKmOd9BgIzvEVgB24jg95AhcQ5Q9nJrOUI6WrYolXbAUCgmlkgnY0gmlwhKwSe76KbXVsdGlhZGRyc5YACASsEnu-Bu7uAAoErBJ7vgbu790DgnJzhQADAQAAiXNlY3AyNTZrMaECw9Zbfa6j8dHex3rWC1o9mKC-0Y9mhN-Mif5iLBDlHYyDdGNwgu7ug3VkcILu8IV3YWt1MgU --filternode=/ip4/172.18.123.190/tcp/61166/p2p/16Uiu2HAm8c94RW21dg1mCRrJU4z9b1v9SGG37gipWM3DD7xsH3DD
2026-03-14 04:31:54.278 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.42.72 waku db93f4d496628e1e51fff7cfe71d4795265af7aa2bca56c1f820bec742593bcf
2026-03-14 04:31:54.313 DEBUG [src.node.docker_mananger] Container started with ID db93f4d49662. Setting up logs at ./log/docker/node5_2026-03-14_04-31-48__0caa4dac-1e04-483b-b938-667d1a2a9ab6__wakuorg_nwaku:latest.log
2026-03-14 04:31:54.314 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 48267
2026-03-14 04:31:54.314 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-14 04:31:55.315 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48267/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:31:55.318 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-14 04:31:55.318 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-14 04:31:55.318 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48267/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:31:55.321 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.42.72/tcp/48268/p2p/16Uiu2HAmE685hrVXbzRB9Uwvs1EkiyJr97Bqo9uia5f2TJVx3E52","/ip4/172.18.42.72/tcp/48269/ws/p2p/16Uiu2HAmE685hrVXbzRB9Uwvs1EkiyJr97Bqo9uia5f2TJVx3E52"],"enrUri":"enr:-L24QLocXlKBgVpE19nThYJ-towTVgmtwSKc9tZDlwbcrMDMB3H9hS0Pe4rx5Z_NhUKXzchd8-Lh8B4j3gMncWrjA0MCgmlkgnY0gmlwhKwSKkiKbXVsdGlhZGRyc5YACASsEipIBryMAAoErBIqSAa8jd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDFUvy7w5nGR12MmOk8YC5KCGVXlYa4EdjiPd2fi9mDD2DdGNwgryMg3VkcIK8joV3YWt1MgA"}'
2026-03-14 04:31:55.321 INFO [src.node.waku_node] REST service is ready !!
2026-03-14 04:31:55.321 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48267/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.123.190/tcp/61166/p2p/16Uiu2HAm8c94RW21dg1mCRrJU4z9b1v9SGG37gipWM3DD7xsH3DD"]'
2026-03-14 04:31:55.363 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:31:55.364 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9268/filter/v2/subscriptions/1" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:31:55.378 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"1","statusDesc":"OK"}'
2026-03-14 04:31:55.379 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:46127/filter/v2/subscriptions/46591a9a-2d7d-4228-a8e3-f42b80754b72" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:31:55.392 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:46127/filter/v2/subscriptions/46591a9a-2d7d-4228-a8e3-f42b80754b72. Response content: b'{"requestId":"46591a9a-2d7d-4228-a8e3-f42b80754b72","statusDesc":"NOT_FOUND: peer has no subscriptions"}'
2026-03-14 04:31:55.398 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45113/filter/v2/subscriptions/1e206b11-a4ff-4262-b85f-8518b01e5965" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:31:55.406 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:45113/filter/v2/subscriptions/1e206b11-a4ff-4262-b85f-8518b01e5965. Response content: b'{"requestId":"1e206b11-a4ff-4262-b85f-8518b01e5965","statusDesc":"NOT_FOUND: peer has no subscriptions"}'
2026-03-14 04:31:55.408 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48267/filter/v2/subscriptions/a447b44c-1363-4c88-a642-bc629b3e4005" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:31:55.416 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:48267/filter/v2/subscriptions/a447b44c-1363-4c88-a642-bc629b3e4005. Response content: b'{"requestId":"a447b44c-1363-4c88-a642-bc629b3e4005","statusDesc":"NOT_FOUND: peer has no subscriptions"}'
2026-03-14 04:31:55.419 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-14 04:31:55.420 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-14 04:31:55.420 DEBUG [src.node.waku_node] Stopping container with id de8397e3cce2
2026-03-14 04:31:55.990 DEBUG [src.node.waku_node] Container stopped.
2026-03-14 04:31:55.991 DEBUG [src.node.waku_node] Stopping container with id 1fc91cfd3c1f
2026-03-14 04:31:56.591 DEBUG [src.node.waku_node] Container stopped.
2026-03-14 04:31:56.593 DEBUG [src.node.waku_node] Stopping container with id ec9f3b234d35
2026-03-14 04:31:56.805 ERROR [src.node.docker_mananger] Max retries reached for container de8397e3cce2. Exiting log stream.
2026-03-14 04:31:57.178 DEBUG [src.node.waku_node] Container stopped.
2026-03-14 04:31:57.179 DEBUG [src.node.waku_node] Stopping container with id 16b5c2a37629
2026-03-14 04:31:57.429 ERROR [src.node.docker_mananger] Max retries reached for container 1fc91cfd3c1f. Exiting log stream.
2026-03-14 04:31:57.718 DEBUG [src.node.waku_node] Container stopped.
2026-03-14 04:31:57.718 DEBUG [src.node.waku_node] Stopping container with id db93f4d49662
2026-03-14 04:31:57.991 ERROR [src.node.docker_mananger] Max retries reached for container ec9f3b234d35. Exiting log stream.
2026-03-14 04:31:58.265 DEBUG [src.node.waku_node] Container stopped.
2026-03-14 04:31:58.266 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-14 04:31:58.281 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-14 04:31:58.294 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-14 04:31:58.299 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-14 04:31:58.306 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-14 04:31:58.311 DEBUG [src.node.docker_mananger] No errors found in the waku logs.