165 lines
32 KiB
Plaintext

2026-03-05 04:33:12.929 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-05 04:33:12.929 DEBUG [tests.conftest] Running test: test_optional_nodes_not_subscribed_to_same_topic with id: 2026-03-05_04-33-12__dd664c26-a69d-420d-9b1b-888e46a2c2d2
2026-03-05 04:33:12.929 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-05 04:33:12.929 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-03-05 04:33:12.930 DEBUG [src.steps.filter] Running fixture setup: setup_main_relay_node
2026-03-05 04:33:12.936 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:33:12.936 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-05_04-33-12__dd664c26-a69d-420d-9b1b-888e46a2c2d2__wakuorg_nwaku:latest.log
2026-03-05 04:33:12.936 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:33:12.936 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:33:12.937 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:33:12.937 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.101.254
2026-03-05 04:33:12.938 DEBUG [src.node.docker_mananger] Generated ports ['44490', '44491', '44492', '44493', '44494']
2026-03-05 04:33:12.938 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:33:12.938 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:33:12.938 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:33:12.938 DEBUG [src.node.docker_mananger] docker run -i -t -p 44490:44490 -p 44491:44491 -p 44492:44492 -p 44493:44493 -p 44494:44494 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=44492 --rest-port=44490 --tcp-port=44491 --discv5-udp-port=44493 --rest-address=0.0.0.0 --nat=extip:172.18.101.254 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=cf31409bddc47cab1714212efe6e921d17cddced850aedcfbde8aff02284b1d0 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=44494 --metrics-logging=true --relay=true --filter=true
2026-03-05 04:33:13.146 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.101.254 waku e9595f01ec9ce3d3f757d2f3dc2df1d8fb6a6c8f003a15c577d7e68d19197d71
2026-03-05 04:33:13.179 DEBUG [src.node.docker_mananger] Container started with ID e9595f01ec9c. Setting up logs at ./log/docker/node1_2026-03-05_04-33-12__dd664c26-a69d-420d-9b1b-888e46a2c2d2__wakuorg_nwaku:latest.log
2026-03-05 04:33:13.179 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 44490
2026-03-05 04:33:13.179 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:33:13.214 ERROR [src.node.docker_mananger] Max retries reached for container 98437553ac88. Exiting log stream.
2026-03-05 04:33:13.721 ERROR [src.node.docker_mananger] Max retries reached for container cfc52ee594f7. Exiting log stream.
2026-03-05 04:33:14.180 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44490/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:33:14.182 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:33:14.183 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:33:14.183 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44490/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:33:14.185 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.101.254/tcp/44491/p2p/16Uiu2HAm1FoFD6unnE4fk6M6mWzEZUVPVQfXgpNJAx5ubPfFUikJ","/ip4/172.18.101.254/tcp/44492/ws/p2p/16Uiu2HAm1FoFD6unnE4fk6M6mWzEZUVPVQfXgpNJAx5ubPfFUikJ"],"enrUri":"enr:-L24QF1PBIkH5fC8MReWNUD0_6Y3OIS3WdXjRFu6qwEWM_8efIVJCqIgVoruOcJpX86Jfi3tvDm1CGN3byr-16YKpTcCgmlkgnY0gmlwhKwSZf6KbXVsdGlhZGRyc5YACASsEmX-Bq3LAAoErBJl_gatzN0DgnJzhQADAQAAiXNlY3AyNTZrMaECVp6HZ58_rhskb-2iFDpru9lfC_nJ7U1NyZ2dPTsKkeuDdGNwgq3Lg3VkcIKtzYV3YWt1MgU"}'
2026-03-05 04:33:14.186 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:33:14.186 DEBUG [src.steps.filter] Running fixture setup: setup_main_filter_node
2026-03-05 04:33:14.192 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:33:14.192 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-05_04-33-12__dd664c26-a69d-420d-9b1b-888e46a2c2d2__wakuorg_nwaku:latest.log
2026-03-05 04:33:14.193 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:33:14.193 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:33:14.194 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:33:14.194 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.230.247
2026-03-05 04:33:14.194 DEBUG [src.node.docker_mananger] Generated ports ['37845', '37846', '37847', '37848', '37849']
2026-03-05 04:33:14.195 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:33:14.195 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:33:14.195 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:33:14.195 DEBUG [src.node.docker_mananger] docker run -i -t -p 37845:37845 -p 37846:37846 -p 37847:37847 -p 37848:37848 -p 37849:37849 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=37847 --rest-port=37845 --tcp-port=37846 --discv5-udp-port=37848 --rest-address=0.0.0.0 --nat=extip:172.18.230.247 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=2fcfdbdcaa58c9fb2eb9f1ed4b6d4d93e10dedaafb7dcc04ad4b7eed11cfddf9 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=37849 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QF1PBIkH5fC8MReWNUD0_6Y3OIS3WdXjRFu6qwEWM_8efIVJCqIgVoruOcJpX86Jfi3tvDm1CGN3byr-16YKpTcCgmlkgnY0gmlwhKwSZf6KbXVsdGlhZGRyc5YACASsEmX-Bq3LAAoErBJl_gatzN0DgnJzhQADAQAAiXNlY3AyNTZrMaECVp6HZ58_rhskb-2iFDpru9lfC_nJ7U1NyZ2dPTsKkeuDdGNwgq3Lg3VkcIKtzYV3YWt1MgU --filternode=/ip4/172.18.101.254/tcp/44491/p2p/16Uiu2HAm1FoFD6unnE4fk6M6mWzEZUVPVQfXgpNJAx5ubPfFUikJ
2026-03-05 04:33:14.378 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.230.247 waku 2678f52b910cf81c40a9593ddd170102358a8cbbe6ff91da9094f8fec2ae1676
2026-03-05 04:33:14.410 DEBUG [src.node.docker_mananger] Container started with ID 2678f52b910c. Setting up logs at ./log/docker/node2_2026-03-05_04-33-12__dd664c26-a69d-420d-9b1b-888e46a2c2d2__wakuorg_nwaku:latest.log
2026-03-05 04:33:14.411 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 37845
2026-03-05 04:33:14.411 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:33:15.411 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37845/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:33:15.414 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:33:15.414 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:33:15.415 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37845/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:33:15.417 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.230.247/tcp/37846/p2p/16Uiu2HAkxZXe5wFhy6AQZWC6dGgPguGdi8Unszo2J6pZVrdrAgf4","/ip4/172.18.230.247/tcp/37847/ws/p2p/16Uiu2HAkxZXe5wFhy6AQZWC6dGgPguGdi8Unszo2J6pZVrdrAgf4"],"enrUri":"enr:-L24QKQ_ctzDTje-cJLE6sAG4SH9xzZnDVEHyfV-NZsNGaIkNZom-QGqHIj64kS7Or7WerrxaifKtBb3jBK7TBSTfYYCgmlkgnY0gmlwhKwS5veKbXVsdGlhZGRyc5YACASsEub3BpPWAAoErBLm9waT190DgnJzhQADAQAAiXNlY3AyNTZrMaECLpZHBVZEo-jBkuNpBUuUDDERg05e8Ch7Ut7V4vG96VODdGNwgpPWg3VkcIKT2IV3YWt1MgA"}'
2026-03-05 04:33:15.417 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:33:15.418 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37845/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.101.254/tcp/44491/p2p/16Uiu2HAm1FoFD6unnE4fk6M6mWzEZUVPVQfXgpNJAx5ubPfFUikJ"]'
2026-03-05 04:33:15.453 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:33:15.464 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:33:15.465 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-05_04-33-12__dd664c26-a69d-420d-9b1b-888e46a2c2d2__wakuorg_nwaku:latest.log
2026-03-05 04:33:15.465 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:33:15.465 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:33:15.467 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:33:15.467 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.243.219
2026-03-05 04:33:15.467 DEBUG [src.node.docker_mananger] Generated ports ['42003', '42004', '42005', '42006', '42007']
2026-03-05 04:33:15.467 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:33:15.467 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:33:15.467 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:33:15.467 DEBUG [src.node.docker_mananger] docker run -i -t -p 42003:42003 -p 42004:42004 -p 42005:42005 -p 42006:42006 -p 42007:42007 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=42005 --rest-port=42003 --tcp-port=42004 --discv5-udp-port=42006 --rest-address=0.0.0.0 --nat=extip:172.18.243.219 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=f0fb105c9cd00135b87e21aac65708dc43d4c8dd8ef23c3dc3fdbeeeff16dbdc --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=42007 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QF1PBIkH5fC8MReWNUD0_6Y3OIS3WdXjRFu6qwEWM_8efIVJCqIgVoruOcJpX86Jfi3tvDm1CGN3byr-16YKpTcCgmlkgnY0gmlwhKwSZf6KbXVsdGlhZGRyc5YACASsEmX-Bq3LAAoErBJl_gatzN0DgnJzhQADAQAAiXNlY3AyNTZrMaECVp6HZ58_rhskb-2iFDpru9lfC_nJ7U1NyZ2dPTsKkeuDdGNwgq3Lg3VkcIKtzYV3YWt1MgU --filternode=/ip4/172.18.101.254/tcp/44491/p2p/16Uiu2HAm1FoFD6unnE4fk6M6mWzEZUVPVQfXgpNJAx5ubPfFUikJ
2026-03-05 04:33:15.666 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.243.219 waku 02980b3769fa058a0be166eea9e4ffa33c7ffe987890e41af6ed467609d79ef5
2026-03-05 04:33:15.698 DEBUG [src.node.docker_mananger] Container started with ID 02980b3769fa. Setting up logs at ./log/docker/node3_2026-03-05_04-33-12__dd664c26-a69d-420d-9b1b-888e46a2c2d2__wakuorg_nwaku:latest.log
2026-03-05 04:33:15.698 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 42003
2026-03-05 04:33:15.698 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:33:16.699 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42003/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:33:16.701 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:33:16.701 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:33:16.702 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42003/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:33:16.704 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.243.219/tcp/42004/p2p/16Uiu2HAm1Ma9tyTbaCQpy3ojA6PSapt2AyE9uxEHyejnYGdxLYrY","/ip4/172.18.243.219/tcp/42005/ws/p2p/16Uiu2HAm1Ma9tyTbaCQpy3ojA6PSapt2AyE9uxEHyejnYGdxLYrY"],"enrUri":"enr:-L24QCiZQQWa5jUUmsqkVrCp17lQDYgdwQoJMO-dy5KTMuyueKMyd55XnkxvFHF7vh5WzKo8YRn9J0AT9xEZvkXpH8QCgmlkgnY0gmlwhKwS89uKbXVsdGlhZGRyc5YACASsEvPbBqQUAAoErBLz2wakFd0DgnJzhQADAQAAiXNlY3AyNTZrMaECWBk2CFZTjAq8AHg0Np6hjxTEmr0fmJSkFJTLuE6HdL2DdGNwgqQUg3VkcIKkFoV3YWt1MgA"}'
2026-03-05 04:33:16.704 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:33:16.704 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:42003/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.101.254/tcp/44491/p2p/16Uiu2HAm1FoFD6unnE4fk6M6mWzEZUVPVQfXgpNJAx5ubPfFUikJ"]'
2026-03-05 04:33:16.743 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:33:16.757 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:33:16.758 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-05_04-33-12__dd664c26-a69d-420d-9b1b-888e46a2c2d2__wakuorg_nwaku:latest.log
2026-03-05 04:33:16.758 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:33:16.758 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:33:16.759 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:33:16.759 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.200.45
2026-03-05 04:33:16.759 DEBUG [src.node.docker_mananger] Generated ports ['10435', '10436', '10437', '10438', '10439']
2026-03-05 04:33:16.760 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:33:16.760 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:33:16.760 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:33:16.760 DEBUG [src.node.docker_mananger] docker run -i -t -p 10435:10435 -p 10436:10436 -p 10437:10437 -p 10438:10438 -p 10439:10439 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=10437 --rest-port=10435 --tcp-port=10436 --discv5-udp-port=10438 --rest-address=0.0.0.0 --nat=extip:172.18.200.45 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=6b28f7314ba6cdcec5affd67cd7eb518d1afa5f6a7c24eee3bda3e75ebdef5f5 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=10439 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QF1PBIkH5fC8MReWNUD0_6Y3OIS3WdXjRFu6qwEWM_8efIVJCqIgVoruOcJpX86Jfi3tvDm1CGN3byr-16YKpTcCgmlkgnY0gmlwhKwSZf6KbXVsdGlhZGRyc5YACASsEmX-Bq3LAAoErBJl_gatzN0DgnJzhQADAQAAiXNlY3AyNTZrMaECVp6HZ58_rhskb-2iFDpru9lfC_nJ7U1NyZ2dPTsKkeuDdGNwgq3Lg3VkcIKtzYV3YWt1MgU --filternode=/ip4/172.18.101.254/tcp/44491/p2p/16Uiu2HAm1FoFD6unnE4fk6M6mWzEZUVPVQfXgpNJAx5ubPfFUikJ
2026-03-05 04:33:16.947 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.200.45 waku 7aaa4df85bfc86f7ef9811846d111ab97c793ad31ec08ba75f62da60a4f433e2
2026-03-05 04:33:16.981 DEBUG [src.node.docker_mananger] Container started with ID 7aaa4df85bfc. Setting up logs at ./log/docker/node4_2026-03-05_04-33-12__dd664c26-a69d-420d-9b1b-888e46a2c2d2__wakuorg_nwaku:latest.log
2026-03-05 04:33:16.982 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 10435
2026-03-05 04:33:16.982 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:33:17.983 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10435/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:33:17.986 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:33:17.986 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:33:17.987 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10435/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:33:17.989 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.200.45/tcp/10436/p2p/16Uiu2HAmEubdmaFepcCvajdxrrTqa8gEwSixiWN6acUjgxsn8vmQ","/ip4/172.18.200.45/tcp/10437/ws/p2p/16Uiu2HAmEubdmaFepcCvajdxrrTqa8gEwSixiWN6acUjgxsn8vmQ"],"enrUri":"enr:-L24QGg1YMIUUIvrSoOWZzSBC-hIBxaDtg0yqJWxav_0Kz_kHvfSqDeJkGNVNtamjUZWUUdSCdwWebxlNKS25oYEoccCgmlkgnY0gmlwhKwSyC2KbXVsdGlhZGRyc5YACASsEsgtBijEAAoErBLILQYoxd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDIXVmrJUnLYeH7gz9DsI3-zGfUrQuhk-vRj7OLasvu-uDdGNwgijEg3VkcIIoxoV3YWt1MgA"}'
2026-03-05 04:33:17.989 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:33:17.989 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:10435/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.101.254/tcp/44491/p2p/16Uiu2HAm1FoFD6unnE4fk6M6mWzEZUVPVQfXgpNJAx5ubPfFUikJ"]'
2026-03-05 04:33:18.024 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:33:18.036 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:33:18.036 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-03-05_04-33-12__dd664c26-a69d-420d-9b1b-888e46a2c2d2__wakuorg_nwaku:latest.log
2026-03-05 04:33:18.036 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:33:18.037 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:33:18.040 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:33:18.040 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.117.18
2026-03-05 04:33:18.040 DEBUG [src.node.docker_mananger] Generated ports ['59105', '59106', '59107', '59108', '59109']
2026-03-05 04:33:18.041 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:33:18.042 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:33:18.043 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:33:18.044 DEBUG [src.node.docker_mananger] docker run -i -t -p 59105:59105 -p 59106:59106 -p 59107:59107 -p 59108:59108 -p 59109:59109 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=59107 --rest-port=59105 --tcp-port=59106 --discv5-udp-port=59108 --rest-address=0.0.0.0 --nat=extip:172.18.117.18 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=bf96fffd5dcba65ddef3bc6fbe7ec760dfeddddff63ce3f14990ae7ce5cf80cc --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=59109 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QF1PBIkH5fC8MReWNUD0_6Y3OIS3WdXjRFu6qwEWM_8efIVJCqIgVoruOcJpX86Jfi3tvDm1CGN3byr-16YKpTcCgmlkgnY0gmlwhKwSZf6KbXVsdGlhZGRyc5YACASsEmX-Bq3LAAoErBJl_gatzN0DgnJzhQADAQAAiXNlY3AyNTZrMaECVp6HZ58_rhskb-2iFDpru9lfC_nJ7U1NyZ2dPTsKkeuDdGNwgq3Lg3VkcIKtzYV3YWt1MgU --filternode=/ip4/172.18.101.254/tcp/44491/p2p/16Uiu2HAm1FoFD6unnE4fk6M6mWzEZUVPVQfXgpNJAx5ubPfFUikJ
2026-03-05 04:33:18.247 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.117.18 waku 0e55d02cc81f2ff2063e5d5c973752c817e87dc7c5199423feb827cade3c1e24
2026-03-05 04:33:18.286 DEBUG [src.node.docker_mananger] Container started with ID 0e55d02cc81f. Setting up logs at ./log/docker/node5_2026-03-05_04-33-12__dd664c26-a69d-420d-9b1b-888e46a2c2d2__wakuorg_nwaku:latest.log
2026-03-05 04:33:18.287 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 59105
2026-03-05 04:33:18.287 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:33:19.287 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:59105/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:33:19.291 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:33:19.291 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:33:19.291 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:59105/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:33:19.293 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.117.18/tcp/59106/p2p/16Uiu2HAmRuvP1nRDfhAfLszujv1XaWfxnBufQM2WWxuMiE6ZZGEk","/ip4/172.18.117.18/tcp/59107/ws/p2p/16Uiu2HAmRuvP1nRDfhAfLszujv1XaWfxnBufQM2WWxuMiE6ZZGEk"],"enrUri":"enr:-L24QIUvZZj4xSXiau0mlwpNZlSquKNDaVlNp-9vFAXk44V1eklbkxzIIuie6xgUDLEFXNqjpdRFgxmTAKBi3-kBeLsCgmlkgnY0gmlwhKwSdRKKbXVsdGlhZGRyc5YACASsEnUSBubiAAoErBJ1Egbm490DgnJzhQADAQAAiXNlY3AyNTZrMaEDxPsnKdVyhA_gUmEXFGpZf4_Bh-R2f2qcv5XiQHihCxmDdGNwgubig3VkcILm5IV3YWt1MgA"}'
2026-03-05 04:33:19.293 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:33:19.294 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59105/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.101.254/tcp/44491/p2p/16Uiu2HAm1FoFD6unnE4fk6M6mWzEZUVPVQfXgpNJAx5ubPfFUikJ"]'
2026-03-05 04:33:19.334 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:33:19.335 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44490/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-05 04:33:19.341 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:33:19.343 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37845/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "e0d3a7a1-015c-47ac-8372-c9b5c8516376", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-05 04:33:19.357 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"e0d3a7a1-015c-47ac-8372-c9b5c8516376","statusDesc":"OK"}'
2026-03-05 04:33:19.358 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:42003/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "9257058d-b112-4451-9ad5-e9ef95270975", "contentFilters": ["/test/2/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-05 04:33:19.369 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"9257058d-b112-4451-9ad5-e9ef95270975","statusDesc":"OK"}'
2026-03-05 04:33:19.369 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:10435/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "a5d61899-188d-4d2f-afbb-608cc71caffd", "contentFilters": ["/test/2/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-05 04:33:19.378 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"a5d61899-188d-4d2f-afbb-608cc71caffd","statusDesc":"OK"}'
2026-03-05 04:33:19.379 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59105/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "f290bc55-4c76-4e96-a810-e5d85c32e9d7", "contentFilters": ["/test/2/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-05 04:33:19.389 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"f290bc55-4c76-4e96-a810-e5d85c32e9d7","statusDesc":"OK"}'
2026-03-05 04:33:19.390 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44490/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 04:33:19.397 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:33:19.397 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-05 04:33:19.497 DEBUG [src.steps.filter] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-05 04:33:19.498 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37845/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:33:19.500 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772685199389988887,"ephemeral":false}]'
2026-03-05 04:33:19.501 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44490/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 04:33:19.506 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:33:19.506 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-05 04:33:19.607 DEBUG [src.steps.filter] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-05 04:33:19.607 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42003/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:33:19.609 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:42003/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto. Response content: b'Not subscribed to topic: /test/1/waku-filter/proto'
2026-03-05 04:33:19.613 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-05 04:33:19.614 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-05 04:33:19.614 DEBUG [src.node.waku_node] Stopping container with id e9595f01ec9c
2026-03-05 04:33:20.172 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:33:20.174 DEBUG [src.node.waku_node] Stopping container with id 2678f52b910c
2026-03-05 04:33:20.721 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:33:20.722 DEBUG [src.node.waku_node] Stopping container with id 02980b3769fa
2026-03-05 04:33:21.041 ERROR [src.node.docker_mananger] Max retries reached for container e9595f01ec9c. Exiting log stream.
2026-03-05 04:33:21.276 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:33:21.279 DEBUG [src.node.waku_node] Stopping container with id 7aaa4df85bfc
2026-03-05 04:33:21.554 ERROR [src.node.docker_mananger] Max retries reached for container 2678f52b910c. Exiting log stream.
2026-03-05 04:33:21.833 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:33:21.835 DEBUG [src.node.waku_node] Stopping container with id 0e55d02cc81f
2026-03-05 04:33:22.109 ERROR [src.node.docker_mananger] Max retries reached for container 02980b3769fa. Exiting log stream.
2026-03-05 04:33:22.358 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:33:22.360 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-05 04:33:22.388 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:33:22.396 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:33:22.404 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:33:22.408 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:33:22.411 DEBUG [src.node.docker_mananger] No errors found in the waku logs.