165 lines
32 KiB
Plaintext

2026-03-14 04:32:57.662 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-14 04:32:57.662 DEBUG [tests.conftest] Running test: test_optional_nodes_not_subscribed_to_same_topic with id: 2026-03-14_04-32-57__19a8dcb2-0809-46ec-af5a-ed241792abeb
2026-03-14 04:32:57.662 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-14 04:32:57.663 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-03-14 04:32:57.663 DEBUG [src.steps.filter] Running fixture setup: setup_main_relay_node
2026-03-14 04:32:57.669 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-14 04:32:57.669 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-14_04-32-57__19a8dcb2-0809-46ec-af5a-ed241792abeb__wakuorg_nwaku:latest.log
2026-03-14 04:32:57.669 DEBUG [src.node.waku_node] Starting Node...
2026-03-14 04:32:57.669 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-14 04:32:57.671 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-14 04:32:57.671 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.67.209
2026-03-14 04:32:57.671 DEBUG [src.node.docker_mananger] Generated ports ['33593', '33594', '33595', '33596', '33597']
2026-03-14 04:32:57.671 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-14 04:32:57.671 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-14 04:32:57.671 DEBUG [src.node.waku_node] Using volumes []
2026-03-14 04:32:57.672 DEBUG [src.node.docker_mananger] docker run -i -t -p 33593:33593 -p 33594:33594 -p 33595:33595 -p 33596:33596 -p 33597:33597 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=33595 --rest-port=33593 --tcp-port=33594 --discv5-udp-port=33596 --rest-address=0.0.0.0 --nat=extip:172.18.67.209 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=e8c70d455a8a7ed1fa0f373a6ac5c1fa7e50e5fa3db60dde1f8ce815d0f4d2f8 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=33597 --metrics-logging=true --relay=true --filter=true
2026-03-14 04:32:57.861 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.67.209 waku a6f386679fa984d57b1cb5dfcfb100e5e920b67d3a50448d6da35018b40691ff
2026-03-14 04:32:57.893 DEBUG [src.node.docker_mananger] Container started with ID a6f386679fa9. Setting up logs at ./log/docker/node1_2026-03-14_04-32-57__19a8dcb2-0809-46ec-af5a-ed241792abeb__wakuorg_nwaku:latest.log
2026-03-14 04:32:57.894 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 33593
2026-03-14 04:32:57.894 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-14 04:32:57.923 ERROR [src.node.docker_mananger] Max retries reached for container 8450e306cda0. Exiting log stream.
2026-03-14 04:32:58.456 ERROR [src.node.docker_mananger] Max retries reached for container 87dcca4a359f. Exiting log stream.
2026-03-14 04:32:58.895 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:33593/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:32:58.898 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-14 04:32:58.898 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-14 04:32:58.898 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:33593/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:32:58.901 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.67.209/tcp/33594/p2p/16Uiu2HAkvZnS6ammH9VUuSnpnaAFEhg5SGmdpEUDKNjyTN3vajw9","/ip4/172.18.67.209/tcp/33595/ws/p2p/16Uiu2HAkvZnS6ammH9VUuSnpnaAFEhg5SGmdpEUDKNjyTN3vajw9"],"enrUri":"enr:-L24QN2HuGqp4mHKiNVPqFaHJrWXM0RGli87lI9E3yBvcO0DJokE85sOg6bc6cGl1Xq87avovE9uziR0gptEyi_dZ6sCgmlkgnY0gmlwhKwSQ9GKbXVsdGlhZGRyc5YACASsEkPRBoM6AAoErBJD0QaDO90DgnJzhQADAQAAiXNlY3AyNTZrMaECEO-hYj3fki0xAKBI5yTEoW1HRa_mGiQHq3q52bLtBySDdGNwgoM6g3VkcIKDPIV3YWt1MgU"}'
2026-03-14 04:32:58.901 INFO [src.node.waku_node] REST service is ready !!
2026-03-14 04:32:58.901 DEBUG [src.steps.filter] Running fixture setup: setup_main_filter_node
2026-03-14 04:32:58.907 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-14 04:32:58.907 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-14_04-32-57__19a8dcb2-0809-46ec-af5a-ed241792abeb__wakuorg_nwaku:latest.log
2026-03-14 04:32:58.908 DEBUG [src.node.waku_node] Starting Node...
2026-03-14 04:32:58.908 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-14 04:32:58.909 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-14 04:32:58.909 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.111.244
2026-03-14 04:32:58.909 DEBUG [src.node.docker_mananger] Generated ports ['24598', '24599', '24600', '24601', '24602']
2026-03-14 04:32:58.909 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-14 04:32:58.910 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-14 04:32:58.910 DEBUG [src.node.waku_node] Using volumes []
2026-03-14 04:32:58.910 DEBUG [src.node.docker_mananger] docker run -i -t -p 24598:24598 -p 24599:24599 -p 24600:24600 -p 24601:24601 -p 24602:24602 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=24600 --rest-port=24598 --tcp-port=24599 --discv5-udp-port=24601 --rest-address=0.0.0.0 --nat=extip:172.18.111.244 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=08b27a2630ebbf6d476b99441c60f1663c7c2ecabcbba46ac2901fbbeb2a7dfc --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=24602 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QN2HuGqp4mHKiNVPqFaHJrWXM0RGli87lI9E3yBvcO0DJokE85sOg6bc6cGl1Xq87avovE9uziR0gptEyi_dZ6sCgmlkgnY0gmlwhKwSQ9GKbXVsdGlhZGRyc5YACASsEkPRBoM6AAoErBJD0QaDO90DgnJzhQADAQAAiXNlY3AyNTZrMaECEO-hYj3fki0xAKBI5yTEoW1HRa_mGiQHq3q52bLtBySDdGNwgoM6g3VkcIKDPIV3YWt1MgU --filternode=/ip4/172.18.67.209/tcp/33594/p2p/16Uiu2HAkvZnS6ammH9VUuSnpnaAFEhg5SGmdpEUDKNjyTN3vajw9
2026-03-14 04:32:59.106 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.111.244 waku 9870dcba18ba131c5a52bf94848da651c43df30420efe22a373f4856dc12418d
2026-03-14 04:32:59.140 DEBUG [src.node.docker_mananger] Container started with ID 9870dcba18ba. Setting up logs at ./log/docker/node2_2026-03-14_04-32-57__19a8dcb2-0809-46ec-af5a-ed241792abeb__wakuorg_nwaku:latest.log
2026-03-14 04:32:59.140 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 24598
2026-03-14 04:32:59.140 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-14 04:33:00.141 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24598/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:33:00.143 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-14 04:33:00.143 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-14 04:33:00.144 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24598/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:33:00.146 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.111.244/tcp/24599/p2p/16Uiu2HAmCm7LSdaxF4VtXiMjgEhHvC6RHikyJHdckSDp4mY9rbcc","/ip4/172.18.111.244/tcp/24600/ws/p2p/16Uiu2HAmCm7LSdaxF4VtXiMjgEhHvC6RHikyJHdckSDp4mY9rbcc"],"enrUri":"enr:-L24QMFNwl03XSspTIYxE178ngXbtl_EdKHECl4R_lbDEwihRMP5fF5ExuyTK2gsHafaN6iZYXewDIrdK5TOc130mvsCgmlkgnY0gmlwhKwSb_SKbXVsdGlhZGRyc5YACASsEm_0BmAXAAoErBJv9AZgGN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDAZFiHaDnI9KEYbaJONai6Q7qVkTktv7uMh9x0JhXVOGDdGNwgmAXg3VkcIJgGYV3YWt1MgA"}'
2026-03-14 04:33:00.146 INFO [src.node.waku_node] REST service is ready !!
2026-03-14 04:33:00.146 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24598/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.67.209/tcp/33594/p2p/16Uiu2HAkvZnS6ammH9VUuSnpnaAFEhg5SGmdpEUDKNjyTN3vajw9"]'
2026-03-14 04:33:00.179 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:33:00.193 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-14 04:33:00.193 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-14_04-32-57__19a8dcb2-0809-46ec-af5a-ed241792abeb__wakuorg_nwaku:latest.log
2026-03-14 04:33:00.194 DEBUG [src.node.waku_node] Starting Node...
2026-03-14 04:33:00.194 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-14 04:33:00.195 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-14 04:33:00.195 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.91.255
2026-03-14 04:33:00.195 DEBUG [src.node.docker_mananger] Generated ports ['17193', '17194', '17195', '17196', '17197']
2026-03-14 04:33:00.196 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-14 04:33:00.196 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-14 04:33:00.196 DEBUG [src.node.waku_node] Using volumes []
2026-03-14 04:33:00.196 DEBUG [src.node.docker_mananger] docker run -i -t -p 17193:17193 -p 17194:17194 -p 17195:17195 -p 17196:17196 -p 17197:17197 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=17195 --rest-port=17193 --tcp-port=17194 --discv5-udp-port=17196 --rest-address=0.0.0.0 --nat=extip:172.18.91.255 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=2ac24ce3a3a1bf3ea0da8ce50dcc4edb70c1aec258bfe731d1c2411a30bf21df --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=17197 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QN2HuGqp4mHKiNVPqFaHJrWXM0RGli87lI9E3yBvcO0DJokE85sOg6bc6cGl1Xq87avovE9uziR0gptEyi_dZ6sCgmlkgnY0gmlwhKwSQ9GKbXVsdGlhZGRyc5YACASsEkPRBoM6AAoErBJD0QaDO90DgnJzhQADAQAAiXNlY3AyNTZrMaECEO-hYj3fki0xAKBI5yTEoW1HRa_mGiQHq3q52bLtBySDdGNwgoM6g3VkcIKDPIV3YWt1MgU --filternode=/ip4/172.18.67.209/tcp/33594/p2p/16Uiu2HAkvZnS6ammH9VUuSnpnaAFEhg5SGmdpEUDKNjyTN3vajw9
2026-03-14 04:33:00.396 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.91.255 waku 061d81f4ee7cb615a58381e2b1a67936ec363282edc38ff5e4d51535e98ece82
2026-03-14 04:33:00.433 DEBUG [src.node.docker_mananger] Container started with ID 061d81f4ee7c. Setting up logs at ./log/docker/node3_2026-03-14_04-32-57__19a8dcb2-0809-46ec-af5a-ed241792abeb__wakuorg_nwaku:latest.log
2026-03-14 04:33:00.434 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 17193
2026-03-14 04:33:00.434 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-14 04:33:01.434 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17193/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:33:01.437 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-14 04:33:01.437 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-14 04:33:01.437 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17193/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:33:01.440 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.91.255/tcp/17194/p2p/16Uiu2HAm7jxDwdBJXUAVGcKbRWNNYHr7zPsf3Rfe7DwsHkFtw5WK","/ip4/172.18.91.255/tcp/17195/ws/p2p/16Uiu2HAm7jxDwdBJXUAVGcKbRWNNYHr7zPsf3Rfe7DwsHkFtw5WK"],"enrUri":"enr:-L24QJA2yKuMiS1A8yKsvZwWU6vri-TyBoiqe5t_XcdzccydPeqhwMFRfOfqOxdLOjWP632c8p8UGvIZBj09WO7lufMCgmlkgnY0gmlwhKwSW_-KbXVsdGlhZGRyc5YACASsElv_BkMqAAoErBJb_wZDK90DgnJzhQADAQAAiXNlY3AyNTZrMaECtvsQlOitshQ8VAsC67LVgKhzo8R9ZfXg-MzyNPcvW1SDdGNwgkMqg3VkcIJDLIV3YWt1MgA"}'
2026-03-14 04:33:01.440 INFO [src.node.waku_node] REST service is ready !!
2026-03-14 04:33:01.440 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17193/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.67.209/tcp/33594/p2p/16Uiu2HAkvZnS6ammH9VUuSnpnaAFEhg5SGmdpEUDKNjyTN3vajw9"]'
2026-03-14 04:33:01.472 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:33:01.483 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-14 04:33:01.484 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-14_04-32-57__19a8dcb2-0809-46ec-af5a-ed241792abeb__wakuorg_nwaku:latest.log
2026-03-14 04:33:01.486 DEBUG [src.node.waku_node] Starting Node...
2026-03-14 04:33:01.487 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-14 04:33:01.491 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-14 04:33:01.492 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.160.225
2026-03-14 04:33:01.492 DEBUG [src.node.docker_mananger] Generated ports ['22937', '22938', '22939', '22940', '22941']
2026-03-14 04:33:01.493 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-14 04:33:01.493 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-14 04:33:01.493 DEBUG [src.node.waku_node] Using volumes []
2026-03-14 04:33:01.493 DEBUG [src.node.docker_mananger] docker run -i -t -p 22937:22937 -p 22938:22938 -p 22939:22939 -p 22940:22940 -p 22941:22941 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=22939 --rest-port=22937 --tcp-port=22938 --discv5-udp-port=22940 --rest-address=0.0.0.0 --nat=extip:172.18.160.225 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=9bb0f7b5cccddbd7defcccceb2edb67d35c7a48cbbab1d3c66df5ae52446e1e3 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=22941 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QN2HuGqp4mHKiNVPqFaHJrWXM0RGli87lI9E3yBvcO0DJokE85sOg6bc6cGl1Xq87avovE9uziR0gptEyi_dZ6sCgmlkgnY0gmlwhKwSQ9GKbXVsdGlhZGRyc5YACASsEkPRBoM6AAoErBJD0QaDO90DgnJzhQADAQAAiXNlY3AyNTZrMaECEO-hYj3fki0xAKBI5yTEoW1HRa_mGiQHq3q52bLtBySDdGNwgoM6g3VkcIKDPIV3YWt1MgU --filternode=/ip4/172.18.67.209/tcp/33594/p2p/16Uiu2HAkvZnS6ammH9VUuSnpnaAFEhg5SGmdpEUDKNjyTN3vajw9
2026-03-14 04:33:01.694 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.160.225 waku 736b39e2be3d14d4290bcc567ebb8463b06d1dbdb330594843bbb29ac6b61309
2026-03-14 04:33:01.726 DEBUG [src.node.docker_mananger] Container started with ID 736b39e2be3d. Setting up logs at ./log/docker/node4_2026-03-14_04-32-57__19a8dcb2-0809-46ec-af5a-ed241792abeb__wakuorg_nwaku:latest.log
2026-03-14 04:33:01.727 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 22937
2026-03-14 04:33:01.727 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-14 04:33:02.727 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:22937/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:33:02.730 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-14 04:33:02.730 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-14 04:33:02.730 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:22937/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:33:02.733 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.160.225/tcp/22938/p2p/16Uiu2HAm7PSCYP8yQW1BFdycQjYiU5bQThbHm8NBPA7NijexruCt","/ip4/172.18.160.225/tcp/22939/ws/p2p/16Uiu2HAm7PSCYP8yQW1BFdycQjYiU5bQThbHm8NBPA7NijexruCt"],"enrUri":"enr:-L24QJtqYHIDJEKgZm3XXwf8USWSe5mnHGy-1MLDc6ELmSiLR6mZ9gY05j_v4U4lzPq5RzPi_zXYlgG0xL-fzC5gVYYCgmlkgnY0gmlwhKwSoOGKbXVsdGlhZGRyc5YACASsEqDhBlmaAAoErBKg4QZZm90DgnJzhQADAQAAiXNlY3AyNTZrMaECsbmAC4EREMrt-IYtHJyK7_DAE75i8HAiX5rSxNgc2DmDdGNwglmag3VkcIJZnIV3YWt1MgA"}'
2026-03-14 04:33:02.733 INFO [src.node.waku_node] REST service is ready !!
2026-03-14 04:33:02.733 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22937/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.67.209/tcp/33594/p2p/16Uiu2HAkvZnS6ammH9VUuSnpnaAFEhg5SGmdpEUDKNjyTN3vajw9"]'
2026-03-14 04:33:02.766 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:33:02.782 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-14 04:33:02.782 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-03-14_04-32-57__19a8dcb2-0809-46ec-af5a-ed241792abeb__wakuorg_nwaku:latest.log
2026-03-14 04:33:02.783 DEBUG [src.node.waku_node] Starting Node...
2026-03-14 04:33:02.783 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-14 04:33:02.786 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-14 04:33:02.788 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.57.34
2026-03-14 04:33:02.788 DEBUG [src.node.docker_mananger] Generated ports ['62605', '62606', '62607', '62608', '62609']
2026-03-14 04:33:02.789 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-14 04:33:02.790 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-14 04:33:02.790 DEBUG [src.node.waku_node] Using volumes []
2026-03-14 04:33:02.790 DEBUG [src.node.docker_mananger] docker run -i -t -p 62605:62605 -p 62606:62606 -p 62607:62607 -p 62608:62608 -p 62609:62609 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=62607 --rest-port=62605 --tcp-port=62606 --discv5-udp-port=62608 --rest-address=0.0.0.0 --nat=extip:172.18.57.34 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=49b8e8a38cbaf1bebcf7dcf1c2c9ce9c57433f018893f28cdbded4c71bce62d3 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=62609 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QN2HuGqp4mHKiNVPqFaHJrWXM0RGli87lI9E3yBvcO0DJokE85sOg6bc6cGl1Xq87avovE9uziR0gptEyi_dZ6sCgmlkgnY0gmlwhKwSQ9GKbXVsdGlhZGRyc5YACASsEkPRBoM6AAoErBJD0QaDO90DgnJzhQADAQAAiXNlY3AyNTZrMaECEO-hYj3fki0xAKBI5yTEoW1HRa_mGiQHq3q52bLtBySDdGNwgoM6g3VkcIKDPIV3YWt1MgU --filternode=/ip4/172.18.67.209/tcp/33594/p2p/16Uiu2HAkvZnS6ammH9VUuSnpnaAFEhg5SGmdpEUDKNjyTN3vajw9
2026-03-14 04:33:02.999 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.57.34 waku bcc85b387bc2b43b4236241c965f2c86288161c0c6aad3a8b7f3ab175b287889
2026-03-14 04:33:03.029 DEBUG [src.node.docker_mananger] Container started with ID bcc85b387bc2. Setting up logs at ./log/docker/node5_2026-03-14_04-32-57__19a8dcb2-0809-46ec-af5a-ed241792abeb__wakuorg_nwaku:latest.log
2026-03-14 04:33:03.029 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 62605
2026-03-14 04:33:03.030 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-14 04:33:04.030 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62605/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:33:04.033 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-14 04:33:04.033 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-14 04:33:04.033 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62605/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:33:04.035 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.57.34/tcp/62606/p2p/16Uiu2HAkyUv2wuu8u3caZwcobvS39oxQoXHoChSDLVXbZbbmrMiG","/ip4/172.18.57.34/tcp/62607/ws/p2p/16Uiu2HAkyUv2wuu8u3caZwcobvS39oxQoXHoChSDLVXbZbbmrMiG"],"enrUri":"enr:-L24QKIFeKHi6Jb0n_5zQB1boifIqAgsJ5U5EIDDQl_bIGgmJbztp-JZIRDyMkn2b0lbypzcuEnUQZNlFZGQ5W6UeycCgmlkgnY0gmlwhKwSOSKKbXVsdGlhZGRyc5YACASsEjkiBvSOAAoErBI5Igb0j90DgnJzhQADAQAAiXNlY3AyNTZrMaECPENhqBeOXJSxUGwXu80aLcK2U2s9JO3SFW9twvTeqlGDdGNwgvSOg3VkcIL0kIV3YWt1MgA"}'
2026-03-14 04:33:04.035 INFO [src.node.waku_node] REST service is ready !!
2026-03-14 04:33:04.036 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62605/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.67.209/tcp/33594/p2p/16Uiu2HAkvZnS6ammH9VUuSnpnaAFEhg5SGmdpEUDKNjyTN3vajw9"]'
2026-03-14 04:33:04.075 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:33:04.076 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33593/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-14 04:33:04.082 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:33:04.084 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24598/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "824a81c0-c901-48de-acf0-5b1e29a4956a", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-14 04:33:04.097 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"824a81c0-c901-48de-acf0-5b1e29a4956a","statusDesc":"OK"}'
2026-03-14 04:33:04.098 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17193/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "556080f3-370b-4b7e-b739-8028043ed535", "contentFilters": ["/test/2/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-14 04:33:04.110 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"556080f3-370b-4b7e-b739-8028043ed535","statusDesc":"OK"}'
2026-03-14 04:33:04.110 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22937/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "d581c904-e8b4-4998-a86c-11249f509f0f", "contentFilters": ["/test/2/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-14 04:33:04.119 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"d581c904-e8b4-4998-a86c-11249f509f0f","statusDesc":"OK"}'
2026-03-14 04:33:04.120 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62605/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "8d34caf5-075c-471f-9107-7439bd5d2fee", "contentFilters": ["/test/2/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-14 04:33:04.129 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"8d34caf5-075c-471f-9107-7439bd5d2fee","statusDesc":"OK"}'
2026-03-14 04:33:04.129 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33593/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-14 04:33:04.136 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:33:04.136 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-14 04:33:04.237 DEBUG [src.steps.filter] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-14 04:33:04.237 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24598/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:33:04.239 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1773462784129668804,"ephemeral":false}]'
2026-03-14 04:33:04.241 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33593/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-14 04:33:04.245 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:33:04.246 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-14 04:33:04.346 DEBUG [src.steps.filter] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-14 04:33:04.346 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17193/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:33:04.348 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:17193/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto. Response content: b'Not subscribed to topic: /test/1/waku-filter/proto'
2026-03-14 04:33:04.351 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-14 04:33:04.352 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-14 04:33:04.352 DEBUG [src.node.waku_node] Stopping container with id a6f386679fa9
2026-03-14 04:33:04.969 DEBUG [src.node.waku_node] Container stopped.
2026-03-14 04:33:04.970 DEBUG [src.node.waku_node] Stopping container with id 9870dcba18ba
2026-03-14 04:33:05.545 DEBUG [src.node.waku_node] Container stopped.
2026-03-14 04:33:05.546 DEBUG [src.node.waku_node] Stopping container with id 061d81f4ee7c
2026-03-14 04:33:05.784 ERROR [src.node.docker_mananger] Max retries reached for container a6f386679fa9. Exiting log stream.
2026-03-14 04:33:06.129 DEBUG [src.node.waku_node] Container stopped.
2026-03-14 04:33:06.131 DEBUG [src.node.waku_node] Stopping container with id 736b39e2be3d
2026-03-14 04:33:06.378 ERROR [src.node.docker_mananger] Max retries reached for container 9870dcba18ba. Exiting log stream.
2026-03-14 04:33:06.653 DEBUG [src.node.waku_node] Container stopped.
2026-03-14 04:33:06.653 DEBUG [src.node.waku_node] Stopping container with id bcc85b387bc2
2026-03-14 04:33:06.973 ERROR [src.node.docker_mananger] Max retries reached for container 061d81f4ee7c. Exiting log stream.
2026-03-14 04:33:07.237 DEBUG [src.node.waku_node] Container stopped.
2026-03-14 04:33:07.238 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-14 04:33:07.254 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-14 04:33:07.262 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-14 04:33:07.270 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-14 04:33:07.277 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-14 04:33:07.281 DEBUG [src.node.docker_mananger] No errors found in the waku logs.