155 lines
30 KiB
Plaintext

2026-03-11 04:32:27.078 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-11 04:32:27.079 DEBUG [tests.conftest] Running test: test_ping_only_some_nodes_have_subscriptions with id: 2026-03-11_04-32-27__d3f52960-0f14-485c-a388-36bbb3749b22
2026-03-11 04:32:27.079 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-11 04:32:27.079 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-03-11 04:32:27.080 DEBUG [src.steps.filter] Running fixture setup: setup_main_relay_node
2026-03-11 04:32:27.086 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-11 04:32:27.086 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-11_04-32-27__d3f52960-0f14-485c-a388-36bbb3749b22__wakuorg_nwaku:latest.log
2026-03-11 04:32:27.086 DEBUG [src.node.waku_node] Starting Node...
2026-03-11 04:32:27.086 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-11 04:32:27.088 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-11 04:32:27.088 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.201.21
2026-03-11 04:32:27.088 DEBUG [src.node.docker_mananger] Generated ports ['58741', '58742', '58743', '58744', '58745']
2026-03-11 04:32:27.088 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-11 04:32:27.088 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-11 04:32:27.088 DEBUG [src.node.waku_node] Using volumes []
2026-03-11 04:32:27.089 DEBUG [src.node.docker_mananger] docker run -i -t -p 58741:58741 -p 58742:58742 -p 58743:58743 -p 58744:58744 -p 58745:58745 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=58743 --rest-port=58741 --tcp-port=58742 --discv5-udp-port=58744 --rest-address=0.0.0.0 --nat=extip:172.18.201.21 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=daedf1db783e23c54492ab4b17554c8ba6ebb645caa55efabcec7d5433d3d09d --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=58745 --metrics-logging=true --relay=true --filter=true
2026-03-11 04:32:27.281 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.201.21 waku e486137f4f6ce38bdf64cb5ba8b85d54a4392a01ed5dd224d5b81425ecfd8590
2026-03-11 04:32:27.314 DEBUG [src.node.docker_mananger] Container started with ID e486137f4f6c. Setting up logs at ./log/docker/node1_2026-03-11_04-32-27__d3f52960-0f14-485c-a388-36bbb3749b22__wakuorg_nwaku:latest.log
2026-03-11 04:32:27.315 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 58741
2026-03-11 04:32:27.316 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-11 04:32:27.342 ERROR [src.node.docker_mananger] Max retries reached for container 314298eb68dd. Exiting log stream.
2026-03-11 04:32:27.860 ERROR [src.node.docker_mananger] Max retries reached for container c93a85f81246. Exiting log stream.
2026-03-11 04:32:28.316 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58741/health" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:32:28.319 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-11 04:32:28.319 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-11 04:32:28.319 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58741/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:32:28.322 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.201.21/tcp/58742/p2p/16Uiu2HAkzVRfKjoAVNum8JckZdcbmPAi2ehurMSGcREzskaGyQGN","/ip4/172.18.201.21/tcp/58743/ws/p2p/16Uiu2HAkzVRfKjoAVNum8JckZdcbmPAi2ehurMSGcREzskaGyQGN"],"enrUri":"enr:-L24QBCvZl3dHfVJ2gtCC5ZybTibKqDQMGNSmZckGZOPuT_JCt30cZstb0hDlnQI-TgfnwPtvOXuD8gLtS4QZGoeKkoCgmlkgnY0gmlwhKwSyRWKbXVsdGlhZGRyc5YACASsEskVBuV2AAoErBLJFQbld90DgnJzhQADAQAAiXNlY3AyNTZrMaECS0CRZXDiW76ujQMKv6YhBCFKLtjLQUHSwK0ESybZpMeDdGNwguV2g3VkcILleIV3YWt1MgU"}'
2026-03-11 04:32:28.322 INFO [src.node.waku_node] REST service is ready !!
2026-03-11 04:32:28.322 DEBUG [src.steps.filter] Running fixture setup: setup_main_filter_node
2026-03-11 04:32:28.328 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-11 04:32:28.329 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-11_04-32-27__d3f52960-0f14-485c-a388-36bbb3749b22__wakuorg_nwaku:latest.log
2026-03-11 04:32:28.329 DEBUG [src.node.waku_node] Starting Node...
2026-03-11 04:32:28.329 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-11 04:32:28.330 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-11 04:32:28.330 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.166.135
2026-03-11 04:32:28.331 DEBUG [src.node.docker_mananger] Generated ports ['44315', '44316', '44317', '44318', '44319']
2026-03-11 04:32:28.331 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-11 04:32:28.331 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-11 04:32:28.331 DEBUG [src.node.waku_node] Using volumes []
2026-03-11 04:32:28.331 DEBUG [src.node.docker_mananger] docker run -i -t -p 44315:44315 -p 44316:44316 -p 44317:44317 -p 44318:44318 -p 44319:44319 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=44317 --rest-port=44315 --tcp-port=44316 --discv5-udp-port=44318 --rest-address=0.0.0.0 --nat=extip:172.18.166.135 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=dbcfbb8be2fccf2ea6a9aa9f22aa3ddc8dee514df1bddd14a54cfc31dd9b67df --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=44319 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QBCvZl3dHfVJ2gtCC5ZybTibKqDQMGNSmZckGZOPuT_JCt30cZstb0hDlnQI-TgfnwPtvOXuD8gLtS4QZGoeKkoCgmlkgnY0gmlwhKwSyRWKbXVsdGlhZGRyc5YACASsEskVBuV2AAoErBLJFQbld90DgnJzhQADAQAAiXNlY3AyNTZrMaECS0CRZXDiW76ujQMKv6YhBCFKLtjLQUHSwK0ESybZpMeDdGNwguV2g3VkcILleIV3YWt1MgU --filternode=/ip4/172.18.201.21/tcp/58742/p2p/16Uiu2HAkzVRfKjoAVNum8JckZdcbmPAi2ehurMSGcREzskaGyQGN
2026-03-11 04:32:28.516 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.166.135 waku 5c6fe63c606bfeea262e48a2b8700aa8037acf3c4a44b96bb5c233434a03472b
2026-03-11 04:32:28.549 DEBUG [src.node.docker_mananger] Container started with ID 5c6fe63c606b. Setting up logs at ./log/docker/node2_2026-03-11_04-32-27__d3f52960-0f14-485c-a388-36bbb3749b22__wakuorg_nwaku:latest.log
2026-03-11 04:32:28.549 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 44315
2026-03-11 04:32:28.550 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-11 04:32:29.550 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44315/health" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:32:29.553 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-11 04:32:29.553 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-11 04:32:29.553 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44315/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:32:29.555 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.166.135/tcp/44316/p2p/16Uiu2HAmSn8P7Zpd6VYyTTLChVhPrds8Ucn5yXBQ78snY19K5VQk","/ip4/172.18.166.135/tcp/44317/ws/p2p/16Uiu2HAmSn8P7Zpd6VYyTTLChVhPrds8Ucn5yXBQ78snY19K5VQk"],"enrUri":"enr:-L24QNojzJWegQhi-8TWyWwoODoArgg6bO2-5qIRjSYeStzzHDqiZ7KAwC3ELZU7UxLr5tenDq-u1Stkt1pBqWBjLlYCgmlkgnY0gmlwhKwSpoeKbXVsdGlhZGRyc5YACASsEqaHBq0cAAoErBKmhwatHd0DgnJzhQADAQAAiXNlY3AyNTZrMaED0dfDieQzg2lirzqsGL_BeyrC76V7qhdO6-791B8GmJGDdGNwgq0cg3VkcIKtHoV3YWt1MgA"}'
2026-03-11 04:32:29.555 INFO [src.node.waku_node] REST service is ready !!
2026-03-11 04:32:29.556 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44315/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.201.21/tcp/58742/p2p/16Uiu2HAkzVRfKjoAVNum8JckZdcbmPAi2ehurMSGcREzskaGyQGN"]'
2026-03-11 04:32:29.591 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-11 04:32:29.593 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:58741/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-11 04:32:29.612 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-11 04:32:29.613 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44315/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "1e6071e6-0dde-47c6-ad04-d68c54d267a0", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-11 04:32:29.624 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"1e6071e6-0dde-47c6-ad04-d68c54d267a0","statusDesc":"OK"}'
2026-03-11 04:32:29.633 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-11 04:32:29.633 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-11_04-32-27__d3f52960-0f14-485c-a388-36bbb3749b22__wakuorg_nwaku:latest.log
2026-03-11 04:32:29.634 DEBUG [src.node.waku_node] Starting Node...
2026-03-11 04:32:29.634 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-11 04:32:29.635 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-11 04:32:29.635 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.129.81
2026-03-11 04:32:29.635 DEBUG [src.node.docker_mananger] Generated ports ['45931', '45932', '45933', '45934', '45935']
2026-03-11 04:32:29.635 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-11 04:32:29.636 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-11 04:32:29.636 DEBUG [src.node.waku_node] Using volumes []
2026-03-11 04:32:29.636 DEBUG [src.node.docker_mananger] docker run -i -t -p 45931:45931 -p 45932:45932 -p 45933:45933 -p 45934:45934 -p 45935:45935 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=45933 --rest-port=45931 --tcp-port=45932 --discv5-udp-port=45934 --rest-address=0.0.0.0 --nat=extip:172.18.129.81 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=dcb3bc9d9fddf24a2357c3aed884df01bf73fbba2df7da56afb2465b7f07aeba --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=45935 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QBCvZl3dHfVJ2gtCC5ZybTibKqDQMGNSmZckGZOPuT_JCt30cZstb0hDlnQI-TgfnwPtvOXuD8gLtS4QZGoeKkoCgmlkgnY0gmlwhKwSyRWKbXVsdGlhZGRyc5YACASsEskVBuV2AAoErBLJFQbld90DgnJzhQADAQAAiXNlY3AyNTZrMaECS0CRZXDiW76ujQMKv6YhBCFKLtjLQUHSwK0ESybZpMeDdGNwguV2g3VkcILleIV3YWt1MgU --filternode=/ip4/172.18.201.21/tcp/58742/p2p/16Uiu2HAkzVRfKjoAVNum8JckZdcbmPAi2ehurMSGcREzskaGyQGN
2026-03-11 04:32:29.827 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.129.81 waku c0d5c9cd6bc8f2f157ca75b905a5c8c0ae36f35df019aaa2ba311d1fdbf041d5
2026-03-11 04:32:29.860 DEBUG [src.node.docker_mananger] Container started with ID c0d5c9cd6bc8. Setting up logs at ./log/docker/node3_2026-03-11_04-32-27__d3f52960-0f14-485c-a388-36bbb3749b22__wakuorg_nwaku:latest.log
2026-03-11 04:32:29.860 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 45931
2026-03-11 04:32:29.860 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-11 04:32:30.861 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45931/health" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:32:30.864 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-11 04:32:30.864 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-11 04:32:30.864 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45931/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:32:30.867 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.129.81/tcp/45932/p2p/16Uiu2HAm4zMDDHYPUKjKRHFBX414SFPA8v7kxTDj2fDL4B9KCnyj","/ip4/172.18.129.81/tcp/45933/ws/p2p/16Uiu2HAm4zMDDHYPUKjKRHFBX414SFPA8v7kxTDj2fDL4B9KCnyj"],"enrUri":"enr:-L24QGuffDS4y4m51coo0ExE9pSss-Fk9JxH4SABE4YI4L3fS_tllPUxSRub-EEYTWASF00gaztoQ1VhZTEGKebcwW4CgmlkgnY0gmlwhKwSgVGKbXVsdGlhZGRyc5YACASsEoFRBrNsAAoErBKBUQazbd0DgnJzhQADAQAAiXNlY3AyNTZrMaECjhgglOqkwYNYTH_VXmZxgCnwbQ6MwL4hMgJ1NUI4vQaDdGNwgrNsg3VkcIKzboV3YWt1MgA"}'
2026-03-11 04:32:30.867 INFO [src.node.waku_node] REST service is ready !!
2026-03-11 04:32:30.867 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45931/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.201.21/tcp/58742/p2p/16Uiu2HAkzVRfKjoAVNum8JckZdcbmPAi2ehurMSGcREzskaGyQGN"]'
2026-03-11 04:32:30.903 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-11 04:32:30.916 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-11 04:32:30.916 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-11_04-32-27__d3f52960-0f14-485c-a388-36bbb3749b22__wakuorg_nwaku:latest.log
2026-03-11 04:32:30.916 DEBUG [src.node.waku_node] Starting Node...
2026-03-11 04:32:30.917 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-11 04:32:30.919 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-11 04:32:30.920 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.54.26
2026-03-11 04:32:30.920 DEBUG [src.node.docker_mananger] Generated ports ['26174', '26175', '26176', '26177', '26178']
2026-03-11 04:32:30.920 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-11 04:32:30.921 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-11 04:32:30.922 DEBUG [src.node.waku_node] Using volumes []
2026-03-11 04:32:30.922 DEBUG [src.node.docker_mananger] docker run -i -t -p 26174:26174 -p 26175:26175 -p 26176:26176 -p 26177:26177 -p 26178:26178 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=26176 --rest-port=26174 --tcp-port=26175 --discv5-udp-port=26177 --rest-address=0.0.0.0 --nat=extip:172.18.54.26 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=cec05bfad3203d57d28a936beaeecb299cd5b2c42bb5e1aac721cc742c1f86bb --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=26178 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QBCvZl3dHfVJ2gtCC5ZybTibKqDQMGNSmZckGZOPuT_JCt30cZstb0hDlnQI-TgfnwPtvOXuD8gLtS4QZGoeKkoCgmlkgnY0gmlwhKwSyRWKbXVsdGlhZGRyc5YACASsEskVBuV2AAoErBLJFQbld90DgnJzhQADAQAAiXNlY3AyNTZrMaECS0CRZXDiW76ujQMKv6YhBCFKLtjLQUHSwK0ESybZpMeDdGNwguV2g3VkcILleIV3YWt1MgU --filternode=/ip4/172.18.201.21/tcp/58742/p2p/16Uiu2HAkzVRfKjoAVNum8JckZdcbmPAi2ehurMSGcREzskaGyQGN
2026-03-11 04:32:31.120 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.54.26 waku 5fa2fb86ce4b9d6460279966fd030f1fb70f77498a6e9425e0b8bda5369ca2a5
2026-03-11 04:32:31.156 DEBUG [src.node.docker_mananger] Container started with ID 5fa2fb86ce4b. Setting up logs at ./log/docker/node4_2026-03-11_04-32-27__d3f52960-0f14-485c-a388-36bbb3749b22__wakuorg_nwaku:latest.log
2026-03-11 04:32:31.157 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 26174
2026-03-11 04:32:31.157 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-11 04:32:32.158 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26174/health" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:32:32.160 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-11 04:32:32.161 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-11 04:32:32.161 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26174/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:32:32.163 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.54.26/tcp/26175/p2p/16Uiu2HAmNz2FtW7zbrJoeC6Ng4cKo8b1H1mczswGXxBo1ZuoCNDo","/ip4/172.18.54.26/tcp/26176/ws/p2p/16Uiu2HAmNz2FtW7zbrJoeC6Ng4cKo8b1H1mczswGXxBo1ZuoCNDo"],"enrUri":"enr:-L24QPe1vIMg_LFhZkDbX6ZYzqZHOGKXQX76pCq22arBhNkTGhVp2sZUPzvbckMZYdLZFDSRzYYrHsB4xKdO8oR8Ek8CgmlkgnY0gmlwhKwSNhqKbXVsdGlhZGRyc5YACASsEjYaBmY_AAoErBI2GgZmQN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDmXUPjUaputYXg2YVLt4GTV1sYqmX-gCgAFrwljhk6fKDdGNwgmY_g3VkcIJmQYV3YWt1MgA"}'
2026-03-11 04:32:32.163 INFO [src.node.waku_node] REST service is ready !!
2026-03-11 04:32:32.164 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26174/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.201.21/tcp/58742/p2p/16Uiu2HAkzVRfKjoAVNum8JckZdcbmPAi2ehurMSGcREzskaGyQGN"]'
2026-03-11 04:32:32.199 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-11 04:32:32.212 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-11 04:32:32.213 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-03-11_04-32-27__d3f52960-0f14-485c-a388-36bbb3749b22__wakuorg_nwaku:latest.log
2026-03-11 04:32:32.213 DEBUG [src.node.waku_node] Starting Node...
2026-03-11 04:32:32.213 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-11 04:32:32.216 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-11 04:32:32.217 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.49.143
2026-03-11 04:32:32.217 DEBUG [src.node.docker_mananger] Generated ports ['31406', '31407', '31408', '31409', '31410']
2026-03-11 04:32:32.218 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-11 04:32:32.218 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-11 04:32:32.218 DEBUG [src.node.waku_node] Using volumes []
2026-03-11 04:32:32.219 DEBUG [src.node.docker_mananger] docker run -i -t -p 31406:31406 -p 31407:31407 -p 31408:31408 -p 31409:31409 -p 31410:31410 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=31408 --rest-port=31406 --tcp-port=31407 --discv5-udp-port=31409 --rest-address=0.0.0.0 --nat=extip:172.18.49.143 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ae750e2712e0dbcd6b7db1688edbaafbee1f1b1e5a1d80fc1eccacfffae6dace --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=31410 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QBCvZl3dHfVJ2gtCC5ZybTibKqDQMGNSmZckGZOPuT_JCt30cZstb0hDlnQI-TgfnwPtvOXuD8gLtS4QZGoeKkoCgmlkgnY0gmlwhKwSyRWKbXVsdGlhZGRyc5YACASsEskVBuV2AAoErBLJFQbld90DgnJzhQADAQAAiXNlY3AyNTZrMaECS0CRZXDiW76ujQMKv6YhBCFKLtjLQUHSwK0ESybZpMeDdGNwguV2g3VkcILleIV3YWt1MgU --filternode=/ip4/172.18.201.21/tcp/58742/p2p/16Uiu2HAkzVRfKjoAVNum8JckZdcbmPAi2ehurMSGcREzskaGyQGN
2026-03-11 04:32:32.418 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.49.143 waku 0232de98c434fd73ae995a412d38f7198aba500e346d8fd85b85c2bb1b587995
2026-03-11 04:32:32.452 DEBUG [src.node.docker_mananger] Container started with ID 0232de98c434. Setting up logs at ./log/docker/node5_2026-03-11_04-32-27__d3f52960-0f14-485c-a388-36bbb3749b22__wakuorg_nwaku:latest.log
2026-03-11 04:32:32.453 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 31406
2026-03-11 04:32:32.453 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-11 04:32:33.454 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31406/health" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:32:33.457 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-11 04:32:33.457 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-11 04:32:33.457 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31406/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:32:33.459 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.49.143/tcp/31407/p2p/16Uiu2HAm5F6AzrDbdYGuXo9DEPGCg1zxoBaHMz4zJtDZwr9WMbtp","/ip4/172.18.49.143/tcp/31408/ws/p2p/16Uiu2HAm5F6AzrDbdYGuXo9DEPGCg1zxoBaHMz4zJtDZwr9WMbtp"],"enrUri":"enr:-L24QI070zI47flD5y40-3IsX4LISXZSQHkTKGW2Rk8PIl2dOg3TE6i2JxLqc8A--a6LXmgMB9Bd_QU27VNKGKtW9RYCgmlkgnY0gmlwhKwSMY-KbXVsdGlhZGRyc5YACASsEjGPBnqvAAoErBIxjwZ6sN0DgnJzhQADAQAAiXNlY3AyNTZrMaECkd7V72lZif6vmudvyBwY5-aBYgG7YkT94vQA9yxcwrWDdGNwgnqvg3VkcIJ6sYV3YWt1MgA"}'
2026-03-11 04:32:33.459 INFO [src.node.waku_node] REST service is ready !!
2026-03-11 04:32:33.460 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:31406/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.201.21/tcp/58742/p2p/16Uiu2HAkzVRfKjoAVNum8JckZdcbmPAi2ehurMSGcREzskaGyQGN"]'
2026-03-11 04:32:33.491 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-11 04:32:33.492 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44315/filter/v2/subscriptions/1" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:32:33.506 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"1","statusDesc":"OK"}'
2026-03-11 04:32:33.508 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45931/filter/v2/subscriptions/c085c429-61eb-429a-8f74-d81a0e68378d" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:32:33.524 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:45931/filter/v2/subscriptions/c085c429-61eb-429a-8f74-d81a0e68378d. Response content: b'{"requestId":"c085c429-61eb-429a-8f74-d81a0e68378d","statusDesc":"NOT_FOUND: peer has no subscriptions"}'
2026-03-11 04:32:33.531 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26174/filter/v2/subscriptions/42e8c1b7-0fd8-4210-b642-2d247bc67d38" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:32:33.542 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:26174/filter/v2/subscriptions/42e8c1b7-0fd8-4210-b642-2d247bc67d38. Response content: b'{"requestId":"42e8c1b7-0fd8-4210-b642-2d247bc67d38","statusDesc":"NOT_FOUND: peer has no subscriptions"}'
2026-03-11 04:32:33.543 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31406/filter/v2/subscriptions/97215038-3ba1-4972-aa6b-db4002bf2aa8" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:32:33.552 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:31406/filter/v2/subscriptions/97215038-3ba1-4972-aa6b-db4002bf2aa8. Response content: b'{"requestId":"97215038-3ba1-4972-aa6b-db4002bf2aa8","statusDesc":"NOT_FOUND: peer has no subscriptions"}'
2026-03-11 04:32:33.554 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-11 04:32:33.555 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-11 04:32:33.555 DEBUG [src.node.waku_node] Stopping container with id e486137f4f6c
2026-03-11 04:32:34.121 DEBUG [src.node.waku_node] Container stopped.
2026-03-11 04:32:34.122 DEBUG [src.node.waku_node] Stopping container with id 5c6fe63c606b
2026-03-11 04:32:34.707 DEBUG [src.node.waku_node] Container stopped.
2026-03-11 04:32:34.709 DEBUG [src.node.waku_node] Stopping container with id c0d5c9cd6bc8
2026-03-11 04:32:34.935 ERROR [src.node.docker_mananger] Max retries reached for container e486137f4f6c. Exiting log stream.
2026-03-11 04:32:35.274 DEBUG [src.node.waku_node] Container stopped.
2026-03-11 04:32:35.276 DEBUG [src.node.waku_node] Stopping container with id 5fa2fb86ce4b
2026-03-11 04:32:35.523 ERROR [src.node.docker_mananger] Max retries reached for container 5c6fe63c606b. Exiting log stream.
2026-03-11 04:32:35.847 DEBUG [src.node.waku_node] Container stopped.
2026-03-11 04:32:35.847 DEBUG [src.node.waku_node] Stopping container with id 0232de98c434
2026-03-11 04:32:36.089 ERROR [src.node.docker_mananger] Max retries reached for container c0d5c9cd6bc8. Exiting log stream.
2026-03-11 04:32:36.428 DEBUG [src.node.waku_node] Container stopped.
2026-03-11 04:32:36.429 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-11 04:32:36.443 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-11 04:32:36.449 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-11 04:32:36.456 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-11 04:32:36.461 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-11 04:32:36.466 DEBUG [src.node.docker_mananger] No errors found in the waku logs.