155 lines
30 KiB
Plaintext

2026-03-03 04:33:17.061 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-03 04:33:17.061 DEBUG [tests.conftest] Running test: test_ping_only_some_nodes_have_subscriptions with id: 2026-03-03_04-33-17__63965082-ddd2-485e-aaa2-75f5ca0f6f99
2026-03-03 04:33:17.062 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-03 04:33:17.063 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-03-03 04:33:17.063 DEBUG [src.steps.filter] Running fixture setup: setup_main_relay_node
2026-03-03 04:33:17.071 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:33:17.071 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-03_04-33-17__63965082-ddd2-485e-aaa2-75f5ca0f6f99__wakuorg_nwaku:latest.log
2026-03-03 04:33:17.072 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:33:17.072 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:33:17.074 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-03 04:33:17.074 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.112.212
2026-03-03 04:33:17.075 DEBUG [src.node.docker_mananger] Generated ports ['44530', '44531', '44532', '44533', '44534']
2026-03-03 04:33:17.076 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:33:17.077 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:33:17.077 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:33:17.078 DEBUG [src.node.docker_mananger] docker run -i -t -p 44530:44530 -p 44531:44531 -p 44532:44532 -p 44533:44533 -p 44534:44534 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=44532 --rest-port=44530 --tcp-port=44531 --discv5-udp-port=44533 --rest-address=0.0.0.0 --nat=extip:172.18.112.212 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=f1c9d7cab69b7ef4c5b9cc0144e6fbd4bbb7a66d136abd97ffb3c05adcfcfded --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=44534 --metrics-logging=true --relay=true --filter=true
2026-03-03 04:33:17.270 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.112.212 waku a35eca4e3addae5c3c9db318cbceafac6f5f445f204cb09f5fd422de7d5618b7
2026-03-03 04:33:17.294 ERROR [src.node.docker_mananger] Max retries reached for container 8679a46eaa6a. Exiting log stream.
2026-03-03 04:33:17.305 DEBUG [src.node.docker_mananger] Container started with ID a35eca4e3add. Setting up logs at ./log/docker/node1_2026-03-03_04-33-17__63965082-ddd2-485e-aaa2-75f5ca0f6f99__wakuorg_nwaku:latest.log
2026-03-03 04:33:17.306 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 44530
2026-03-03 04:33:17.306 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:33:17.921 ERROR [src.node.docker_mananger] Max retries reached for container 72fe6466d06b. Exiting log stream.
2026-03-03 04:33:18.307 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44530/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:18.310 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:33:18.310 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:33:18.310 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44530/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:18.313 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.112.212/tcp/44531/p2p/16Uiu2HAmKhbe8fGxk1hBN6ebR41kC8SYntb7fDBxv6tiGsygZ377","/ip4/172.18.112.212/tcp/44532/ws/p2p/16Uiu2HAmKhbe8fGxk1hBN6ebR41kC8SYntb7fDBxv6tiGsygZ377"],"enrUri":"enr:-L24QDkO06qRj4V2RNgBxarZEzwWZJn_qASiDjor4ISr1BlcAAOaajo3aTq26JHzyMTFioTmJiluwZrkOLMCZ5JxDsMCgmlkgnY0gmlwhKwScNSKbXVsdGlhZGRyc5YACASsEnDUBq3zAAoErBJw1Aat9N0DgnJzhQADAQAAiXNlY3AyNTZrMaEDaKzfgkKi9cFef0vT49pm6d671jRT3Yu0zlBFL1NpMhqDdGNwgq3zg3VkcIKt9YV3YWt1MgU"}'
2026-03-03 04:33:18.313 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:33:18.313 DEBUG [src.steps.filter] Running fixture setup: setup_main_filter_node
2026-03-03 04:33:18.320 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:33:18.320 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-03_04-33-17__63965082-ddd2-485e-aaa2-75f5ca0f6f99__wakuorg_nwaku:latest.log
2026-03-03 04:33:18.320 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:33:18.320 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:33:18.322 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-03 04:33:18.322 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.100.217
2026-03-03 04:33:18.322 DEBUG [src.node.docker_mananger] Generated ports ['50042', '50043', '50044', '50045', '50046']
2026-03-03 04:33:18.322 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:33:18.322 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:33:18.322 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:33:18.323 DEBUG [src.node.docker_mananger] docker run -i -t -p 50042:50042 -p 50043:50043 -p 50044:50044 -p 50045:50045 -p 50046:50046 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=50044 --rest-port=50042 --tcp-port=50043 --discv5-udp-port=50045 --rest-address=0.0.0.0 --nat=extip:172.18.100.217 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=a19fc031e6eabfbd41882cd7675b0ea2fdef96c2977badd2dc37ed096ef89e0d --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=50046 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QDkO06qRj4V2RNgBxarZEzwWZJn_qASiDjor4ISr1BlcAAOaajo3aTq26JHzyMTFioTmJiluwZrkOLMCZ5JxDsMCgmlkgnY0gmlwhKwScNSKbXVsdGlhZGRyc5YACASsEnDUBq3zAAoErBJw1Aat9N0DgnJzhQADAQAAiXNlY3AyNTZrMaEDaKzfgkKi9cFef0vT49pm6d671jRT3Yu0zlBFL1NpMhqDdGNwgq3zg3VkcIKt9YV3YWt1MgU --filternode=/ip4/172.18.112.212/tcp/44531/p2p/16Uiu2HAmKhbe8fGxk1hBN6ebR41kC8SYntb7fDBxv6tiGsygZ377
2026-03-03 04:33:18.521 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.100.217 waku 7c5a40e50afebab174c0c502874eace0e0daeff9a8006cc9f6c37faf90f0b34c
2026-03-03 04:33:18.553 DEBUG [src.node.docker_mananger] Container started with ID 7c5a40e50afe. Setting up logs at ./log/docker/node2_2026-03-03_04-33-17__63965082-ddd2-485e-aaa2-75f5ca0f6f99__wakuorg_nwaku:latest.log
2026-03-03 04:33:18.553 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 50042
2026-03-03 04:33:18.554 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:33:19.554 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50042/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:19.557 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:33:19.557 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:33:19.557 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50042/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:19.560 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.100.217/tcp/50043/p2p/16Uiu2HAmCVFeNyo8f9r4UMXiWeB25wJUVu4gzsuPoFGE3Nj2VQCv","/ip4/172.18.100.217/tcp/50044/ws/p2p/16Uiu2HAmCVFeNyo8f9r4UMXiWeB25wJUVu4gzsuPoFGE3Nj2VQCv"],"enrUri":"enr:-L24QKXraoXyPUNrOYgdRGW15kX3IQr22ob7wBX8nYTC4Dt7TzbPWWulfd6NSwlDkNEE9-npuvaKjbJgZ34OEmMhUqUCgmlkgnY0gmlwhKwSZNmKbXVsdGlhZGRyc5YACASsEmTZBsN7AAoErBJk2QbDfN0DgnJzhQADAQAAiXNlY3AyNTZrMaEC_YF8UizUlie0eXLyjKOChesJcGRb1kjbtlmNPmzD2d-DdGNwgsN7g3VkcILDfYV3YWt1MgA"}'
2026-03-03 04:33:19.560 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:33:19.560 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:50042/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.112.212/tcp/44531/p2p/16Uiu2HAmKhbe8fGxk1hBN6ebR41kC8SYntb7fDBxv6tiGsygZ377"]'
2026-03-03 04:33:19.598 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:33:19.600 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44530/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-03 04:33:19.613 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:33:19.614 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:50042/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "7663a1aa-9ec5-4249-810a-11a35f53cb06", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-03 04:33:19.629 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"7663a1aa-9ec5-4249-810a-11a35f53cb06","statusDesc":"OK"}'
2026-03-03 04:33:19.637 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:33:19.637 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-03_04-33-17__63965082-ddd2-485e-aaa2-75f5ca0f6f99__wakuorg_nwaku:latest.log
2026-03-03 04:33:19.637 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:33:19.637 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:33:19.638 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-03 04:33:19.638 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.177.76
2026-03-03 04:33:19.639 DEBUG [src.node.docker_mananger] Generated ports ['26290', '26291', '26292', '26293', '26294']
2026-03-03 04:33:19.639 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:33:19.639 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:33:19.639 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:33:19.639 DEBUG [src.node.docker_mananger] docker run -i -t -p 26290:26290 -p 26291:26291 -p 26292:26292 -p 26293:26293 -p 26294:26294 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=26292 --rest-port=26290 --tcp-port=26291 --discv5-udp-port=26293 --rest-address=0.0.0.0 --nat=extip:172.18.177.76 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=3b82bfecdef1a8bdda9f02c405edacdcd3cd6127d246cffc33f50aaeedbcbbf3 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=26294 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QDkO06qRj4V2RNgBxarZEzwWZJn_qASiDjor4ISr1BlcAAOaajo3aTq26JHzyMTFioTmJiluwZrkOLMCZ5JxDsMCgmlkgnY0gmlwhKwScNSKbXVsdGlhZGRyc5YACASsEnDUBq3zAAoErBJw1Aat9N0DgnJzhQADAQAAiXNlY3AyNTZrMaEDaKzfgkKi9cFef0vT49pm6d671jRT3Yu0zlBFL1NpMhqDdGNwgq3zg3VkcIKt9YV3YWt1MgU --filternode=/ip4/172.18.112.212/tcp/44531/p2p/16Uiu2HAmKhbe8fGxk1hBN6ebR41kC8SYntb7fDBxv6tiGsygZ377
2026-03-03 04:33:19.831 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.177.76 waku 71aefa0f3d41f7f624815053f5346b768bed17fd5178b9ad7e70647b407ad9e3
2026-03-03 04:33:19.867 DEBUG [src.node.docker_mananger] Container started with ID 71aefa0f3d41. Setting up logs at ./log/docker/node3_2026-03-03_04-33-17__63965082-ddd2-485e-aaa2-75f5ca0f6f99__wakuorg_nwaku:latest.log
2026-03-03 04:33:19.868 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 26290
2026-03-03 04:33:19.868 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:33:20.868 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26290/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:20.871 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:33:20.872 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:33:20.872 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26290/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:20.874 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.177.76/tcp/26291/p2p/16Uiu2HAmNH1kAPG71VGZXt2fxn8HrbtVptf97b2x4FsURdxVnCUR","/ip4/172.18.177.76/tcp/26292/ws/p2p/16Uiu2HAmNH1kAPG71VGZXt2fxn8HrbtVptf97b2x4FsURdxVnCUR"],"enrUri":"enr:-L24QDk2DbhUrEeb8TuejmeqfvG8P-34WnQMO8BfFuaSzMHsVBOjLrBx4YUlzYHlurNAwx4lE1dq3IAgf6Rs6oKIq4cCgmlkgnY0gmlwhKwSsUyKbXVsdGlhZGRyc5YACASsErFMBmazAAoErBKxTAZmtN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDjvOrBo8EeKP9nmPf7RjKYrUcoyGdmeQ-gyOXCGvULuqDdGNwgmazg3VkcIJmtYV3YWt1MgA"}'
2026-03-03 04:33:20.874 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:33:20.875 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26290/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.112.212/tcp/44531/p2p/16Uiu2HAmKhbe8fGxk1hBN6ebR41kC8SYntb7fDBxv6tiGsygZ377"]'
2026-03-03 04:33:20.909 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:33:20.921 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:33:20.922 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-03_04-33-17__63965082-ddd2-485e-aaa2-75f5ca0f6f99__wakuorg_nwaku:latest.log
2026-03-03 04:33:20.922 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:33:20.922 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:33:20.926 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-03 04:33:20.927 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.209.80
2026-03-03 04:33:20.928 DEBUG [src.node.docker_mananger] Generated ports ['50268', '50269', '50270', '50271', '50272']
2026-03-03 04:33:20.929 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:33:20.929 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:33:20.929 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:33:20.930 DEBUG [src.node.docker_mananger] docker run -i -t -p 50268:50268 -p 50269:50269 -p 50270:50270 -p 50271:50271 -p 50272:50272 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=50270 --rest-port=50268 --tcp-port=50269 --discv5-udp-port=50271 --rest-address=0.0.0.0 --nat=extip:172.18.209.80 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=52172aecbbe40ba80dbbc39a6d95f123fa5f3afaa93345d5bcff2114c604ff9c --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=50272 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QDkO06qRj4V2RNgBxarZEzwWZJn_qASiDjor4ISr1BlcAAOaajo3aTq26JHzyMTFioTmJiluwZrkOLMCZ5JxDsMCgmlkgnY0gmlwhKwScNSKbXVsdGlhZGRyc5YACASsEnDUBq3zAAoErBJw1Aat9N0DgnJzhQADAQAAiXNlY3AyNTZrMaEDaKzfgkKi9cFef0vT49pm6d671jRT3Yu0zlBFL1NpMhqDdGNwgq3zg3VkcIKt9YV3YWt1MgU --filternode=/ip4/172.18.112.212/tcp/44531/p2p/16Uiu2HAmKhbe8fGxk1hBN6ebR41kC8SYntb7fDBxv6tiGsygZ377
2026-03-03 04:33:21.126 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.209.80 waku f7c236280314a5784f2567e45c14a779ea386eba83a0e402a369f9d6d7aabd00
2026-03-03 04:33:21.160 DEBUG [src.node.docker_mananger] Container started with ID f7c236280314. Setting up logs at ./log/docker/node4_2026-03-03_04-33-17__63965082-ddd2-485e-aaa2-75f5ca0f6f99__wakuorg_nwaku:latest.log
2026-03-03 04:33:21.161 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 50268
2026-03-03 04:33:21.161 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:33:22.161 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50268/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:22.164 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:33:22.164 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:33:22.165 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50268/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:22.167 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.209.80/tcp/50269/p2p/16Uiu2HAmF64EmdHx7CYhLzJfJcUD7z72VJFuWtH37bG4h6PBrTTP","/ip4/172.18.209.80/tcp/50270/ws/p2p/16Uiu2HAmF64EmdHx7CYhLzJfJcUD7z72VJFuWtH37bG4h6PBrTTP"],"enrUri":"enr:-L24QNxauT_P577dIy83osp2y5jaYch_V-WoskrZAZFWN4IUSjutrFhnFtebfcXjZbVyqoaNHfueqR7i-1xl5qUDFrsCgmlkgnY0gmlwhKwS0VCKbXVsdGlhZGRyc5YACASsEtFQBsRdAAoErBLRUAbEXt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDJCNKL_K9WDLO2s9T1vGd0vRxO-WreqDOd-tPl95bH-qDdGNwgsRdg3VkcILEX4V3YWt1MgA"}'
2026-03-03 04:33:22.167 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:33:22.168 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:50268/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.112.212/tcp/44531/p2p/16Uiu2HAmKhbe8fGxk1hBN6ebR41kC8SYntb7fDBxv6tiGsygZ377"]'
2026-03-03 04:33:22.208 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:33:22.217 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:33:22.218 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-03-03_04-33-17__63965082-ddd2-485e-aaa2-75f5ca0f6f99__wakuorg_nwaku:latest.log
2026-03-03 04:33:22.219 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:33:22.219 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:33:22.221 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-03 04:33:22.221 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.185.23
2026-03-03 04:33:22.222 DEBUG [src.node.docker_mananger] Generated ports ['20565', '20566', '20567', '20568', '20569']
2026-03-03 04:33:22.222 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:33:22.223 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:33:22.223 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:33:22.223 DEBUG [src.node.docker_mananger] docker run -i -t -p 20565:20565 -p 20566:20566 -p 20567:20567 -p 20568:20568 -p 20569:20569 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=20567 --rest-port=20565 --tcp-port=20566 --discv5-udp-port=20568 --rest-address=0.0.0.0 --nat=extip:172.18.185.23 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=d544710907bbe695c6b1ccadb43b0cc9b6c9708b3c6cf73115213b22d85ebcff --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=20569 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QDkO06qRj4V2RNgBxarZEzwWZJn_qASiDjor4ISr1BlcAAOaajo3aTq26JHzyMTFioTmJiluwZrkOLMCZ5JxDsMCgmlkgnY0gmlwhKwScNSKbXVsdGlhZGRyc5YACASsEnDUBq3zAAoErBJw1Aat9N0DgnJzhQADAQAAiXNlY3AyNTZrMaEDaKzfgkKi9cFef0vT49pm6d671jRT3Yu0zlBFL1NpMhqDdGNwgq3zg3VkcIKt9YV3YWt1MgU --filternode=/ip4/172.18.112.212/tcp/44531/p2p/16Uiu2HAmKhbe8fGxk1hBN6ebR41kC8SYntb7fDBxv6tiGsygZ377
2026-03-03 04:33:22.415 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.185.23 waku 8b35202e62f60e91397afa62341d3ca8267829597d2ad8a99bfd0cbe95e657e5
2026-03-03 04:33:22.448 DEBUG [src.node.docker_mananger] Container started with ID 8b35202e62f6. Setting up logs at ./log/docker/node5_2026-03-03_04-33-17__63965082-ddd2-485e-aaa2-75f5ca0f6f99__wakuorg_nwaku:latest.log
2026-03-03 04:33:22.448 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 20565
2026-03-03 04:33:22.448 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:33:23.449 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20565/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:23.452 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:33:23.452 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:33:23.452 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20565/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:23.454 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.185.23/tcp/20566/p2p/16Uiu2HAmJ82bkkMGwwaCinLfxhyJeUhNmckjzx2uwd3Q9GKFRQTH","/ip4/172.18.185.23/tcp/20567/ws/p2p/16Uiu2HAmJ82bkkMGwwaCinLfxhyJeUhNmckjzx2uwd3Q9GKFRQTH"],"enrUri":"enr:-L24QBRQfW66wKdYSp749lTIGSMbP2tDLURAqau3c4wJEMdOblDCCF2nwz1fTAAy5Htj8Hd6PG9BSbIs5tOqqp0QC1UCgmlkgnY0gmlwhKwSuReKbXVsdGlhZGRyc5YACASsErkXBlBWAAoErBK5FwZQV90DgnJzhQADAQAAiXNlY3AyNTZrMaEDUTeo7gAF6hQrwy-D2Xn9tGpSTC7xTtk-xGYuPmIzgNCDdGNwglBWg3VkcIJQWIV3YWt1MgA"}'
2026-03-03 04:33:23.455 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:33:23.455 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20565/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.112.212/tcp/44531/p2p/16Uiu2HAmKhbe8fGxk1hBN6ebR41kC8SYntb7fDBxv6tiGsygZ377"]'
2026-03-03 04:33:23.487 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:33:23.488 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50042/filter/v2/subscriptions/1" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:23.504 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"1","statusDesc":"OK"}'
2026-03-03 04:33:23.506 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26290/filter/v2/subscriptions/a262c532-e97a-4455-bbcd-7e3295798104" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:23.517 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:26290/filter/v2/subscriptions/a262c532-e97a-4455-bbcd-7e3295798104. Response content: b'{"requestId":"a262c532-e97a-4455-bbcd-7e3295798104","statusDesc":"NOT_FOUND: peer has no subscriptions"}'
2026-03-03 04:33:23.528 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50268/filter/v2/subscriptions/af3ede89-b0a9-4413-978e-aa6a51f91d69" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:23.536 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:50268/filter/v2/subscriptions/af3ede89-b0a9-4413-978e-aa6a51f91d69. Response content: b'{"requestId":"af3ede89-b0a9-4413-978e-aa6a51f91d69","statusDesc":"NOT_FOUND: peer has no subscriptions"}'
2026-03-03 04:33:23.537 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20565/filter/v2/subscriptions/cb58ac7e-965d-4edb-97c3-69c8e705394d" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:23.546 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:20565/filter/v2/subscriptions/cb58ac7e-965d-4edb-97c3-69c8e705394d. Response content: b'{"requestId":"cb58ac7e-965d-4edb-97c3-69c8e705394d","statusDesc":"NOT_FOUND: peer has no subscriptions"}'
2026-03-03 04:33:23.549 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-03 04:33:23.549 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-03 04:33:23.550 DEBUG [src.node.waku_node] Stopping container with id a35eca4e3add
2026-03-03 04:33:24.110 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:33:24.110 DEBUG [src.node.waku_node] Stopping container with id 7c5a40e50afe
2026-03-03 04:33:24.659 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:33:24.660 DEBUG [src.node.waku_node] Stopping container with id 71aefa0f3d41
2026-03-03 04:33:24.923 ERROR [src.node.docker_mananger] Max retries reached for container a35eca4e3add. Exiting log stream.
2026-03-03 04:33:25.207 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:33:25.207 DEBUG [src.node.waku_node] Stopping container with id f7c236280314
2026-03-03 04:33:25.475 ERROR [src.node.docker_mananger] Max retries reached for container 7c5a40e50afe. Exiting log stream.
2026-03-03 04:33:25.756 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:33:25.758 DEBUG [src.node.waku_node] Stopping container with id 8b35202e62f6
2026-03-03 04:33:26.020 ERROR [src.node.docker_mananger] Max retries reached for container 71aefa0f3d41. Exiting log stream.
2026-03-03 04:33:26.300 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:33:26.302 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-03 04:33:26.316 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-03 04:33:26.320 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-03 04:33:26.324 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-03 04:33:26.328 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-03 04:33:26.332 DEBUG [src.node.docker_mananger] No errors found in the waku logs.