165 lines
32 KiB
Plaintext

2026-03-03 04:34:15.119 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-03 04:34:15.119 DEBUG [tests.conftest] Running test: test_optional_nodes_not_subscribed_to_same_topic with id: 2026-03-03_04-34-15__37aa38a5-12e2-4a1a-9c37-2efacd153688
2026-03-03 04:34:15.120 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-03 04:34:15.120 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-03-03 04:34:15.120 DEBUG [src.steps.filter] Running fixture setup: setup_main_relay_node
2026-03-03 04:34:15.128 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:34:15.128 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-03_04-34-15__37aa38a5-12e2-4a1a-9c37-2efacd153688__wakuorg_nwaku:latest.log
2026-03-03 04:34:15.128 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:34:15.128 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:34:15.130 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-03 04:34:15.130 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.111.63
2026-03-03 04:34:15.130 DEBUG [src.node.docker_mananger] Generated ports ['33465', '33466', '33467', '33468', '33469']
2026-03-03 04:34:15.130 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:34:15.131 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:34:15.131 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:34:15.131 DEBUG [src.node.docker_mananger] docker run -i -t -p 33465:33465 -p 33466:33466 -p 33467:33467 -p 33468:33468 -p 33469:33469 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=33467 --rest-port=33465 --tcp-port=33466 --discv5-udp-port=33468 --rest-address=0.0.0.0 --nat=extip:172.18.111.63 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=8a2e6dd6dbd35abe60ae00ae7df7afdcaa9f4c52d6dbd2b29afb6cdbaa4bf83a --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=33469 --metrics-logging=true --relay=true --filter=true
2026-03-03 04:34:15.330 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.111.63 waku 64485606fb3fd059514b19c557ae933617cac65ddd20df8c1663afa0da97c8de
2026-03-03 04:34:15.364 DEBUG [src.node.docker_mananger] Container started with ID 64485606fb3f. Setting up logs at ./log/docker/node1_2026-03-03_04-34-15__37aa38a5-12e2-4a1a-9c37-2efacd153688__wakuorg_nwaku:latest.log
2026-03-03 04:34:15.365 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 33465
2026-03-03 04:34:15.366 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:34:15.368 ERROR [src.node.docker_mananger] Max retries reached for container 63054819264e. Exiting log stream.
2026-03-03 04:34:15.919 ERROR [src.node.docker_mananger] Max retries reached for container b883e18d0358. Exiting log stream.
2026-03-03 04:34:16.368 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:33465/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:34:16.371 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:34:16.371 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:34:16.371 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:33465/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:34:16.374 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.111.63/tcp/33466/p2p/16Uiu2HAkxvjcwUSJfRorN6ekDHXa6YhdnQ7kr4smJCx3R3E9qP5e","/ip4/172.18.111.63/tcp/33467/ws/p2p/16Uiu2HAkxvjcwUSJfRorN6ekDHXa6YhdnQ7kr4smJCx3R3E9qP5e"],"enrUri":"enr:-L24QCRoGD13iP0pL9YuP79-Omuwt13YzgmEHmCd7OpKAeSKUTfb4kOw6yIjN_2_-UVYZcP7gnUpoi4Hbtrrv30XQicCgmlkgnY0gmlwhKwSbz-KbXVsdGlhZGRyc5YACASsEm8_BoK6AAoErBJvPwaCu90DgnJzhQADAQAAiXNlY3AyNTZrMaECNAUFQMiWlKuHXQGGmgsU1pgPa-O8qYnK26LRneFs38WDdGNwgoK6g3VkcIKCvIV3YWt1MgU"}'
2026-03-03 04:34:16.374 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:34:16.374 DEBUG [src.steps.filter] Running fixture setup: setup_main_filter_node
2026-03-03 04:34:16.381 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:34:16.382 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-03_04-34-15__37aa38a5-12e2-4a1a-9c37-2efacd153688__wakuorg_nwaku:latest.log
2026-03-03 04:34:16.382 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:34:16.382 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:34:16.383 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-03 04:34:16.384 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.7.39
2026-03-03 04:34:16.384 DEBUG [src.node.docker_mananger] Generated ports ['37663', '37664', '37665', '37666', '37667']
2026-03-03 04:34:16.384 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:34:16.384 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:34:16.384 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:34:16.384 DEBUG [src.node.docker_mananger] docker run -i -t -p 37663:37663 -p 37664:37664 -p 37665:37665 -p 37666:37666 -p 37667:37667 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=37665 --rest-port=37663 --tcp-port=37664 --discv5-udp-port=37666 --rest-address=0.0.0.0 --nat=extip:172.18.7.39 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=fbccb9ceaaf34a4701feccfaafb1cb04e0b533bbc3aeb1e0fd51c3ee467be83c --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=37667 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QCRoGD13iP0pL9YuP79-Omuwt13YzgmEHmCd7OpKAeSKUTfb4kOw6yIjN_2_-UVYZcP7gnUpoi4Hbtrrv30XQicCgmlkgnY0gmlwhKwSbz-KbXVsdGlhZGRyc5YACASsEm8_BoK6AAoErBJvPwaCu90DgnJzhQADAQAAiXNlY3AyNTZrMaECNAUFQMiWlKuHXQGGmgsU1pgPa-O8qYnK26LRneFs38WDdGNwgoK6g3VkcIKCvIV3YWt1MgU --filternode=/ip4/172.18.111.63/tcp/33466/p2p/16Uiu2HAkxvjcwUSJfRorN6ekDHXa6YhdnQ7kr4smJCx3R3E9qP5e
2026-03-03 04:34:16.577 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.7.39 waku 1ce88706f420dca9052abaf037466ab61cafa66f1029d291f6f1cde3a64973c2
2026-03-03 04:34:16.611 DEBUG [src.node.docker_mananger] Container started with ID 1ce88706f420. Setting up logs at ./log/docker/node2_2026-03-03_04-34-15__37aa38a5-12e2-4a1a-9c37-2efacd153688__wakuorg_nwaku:latest.log
2026-03-03 04:34:16.611 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 37663
2026-03-03 04:34:16.612 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:34:17.612 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37663/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:34:17.615 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:34:17.616 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:34:17.616 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37663/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:34:17.618 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.7.39/tcp/37664/p2p/16Uiu2HAmRiQLxLr1h4uUgsWvZVd37Y6prPgVfSMM2A9ULvBLs3Lg","/ip4/172.18.7.39/tcp/37665/ws/p2p/16Uiu2HAmRiQLxLr1h4uUgsWvZVd37Y6prPgVfSMM2A9ULvBLs3Lg"],"enrUri":"enr:-L24QEF_i9_Ll2N7Es-D9YCC0OLkxf0mLUhm9dUofERpCzfGFZ81Hoxf1lHVZJHAs8Qw3w4piuQ_ZYPCeSWaodPO-pICgmlkgnY0gmlwhKwSByeKbXVsdGlhZGRyc5YACASsEgcnBpMgAAoErBIHJwaTId0DgnJzhQADAQAAiXNlY3AyNTZrMaEDwgfNhh8eiy9DLXyeMtGzgjeFBiHNyDNVB36X5bOeNL2DdGNwgpMgg3VkcIKTIoV3YWt1MgA"}'
2026-03-03 04:34:17.619 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:34:17.619 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37663/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.111.63/tcp/33466/p2p/16Uiu2HAkxvjcwUSJfRorN6ekDHXa6YhdnQ7kr4smJCx3R3E9qP5e"]'
2026-03-03 04:34:17.655 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:34:17.667 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:34:17.667 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-03_04-34-15__37aa38a5-12e2-4a1a-9c37-2efacd153688__wakuorg_nwaku:latest.log
2026-03-03 04:34:17.668 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:34:17.668 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:34:17.669 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-03 04:34:17.670 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.9.121
2026-03-03 04:34:17.670 DEBUG [src.node.docker_mananger] Generated ports ['14120', '14121', '14122', '14123', '14124']
2026-03-03 04:34:17.671 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:34:17.671 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:34:17.671 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:34:17.672 DEBUG [src.node.docker_mananger] docker run -i -t -p 14120:14120 -p 14121:14121 -p 14122:14122 -p 14123:14123 -p 14124:14124 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=14122 --rest-port=14120 --tcp-port=14121 --discv5-udp-port=14123 --rest-address=0.0.0.0 --nat=extip:172.18.9.121 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=13dad663f0a1eea3b2fe9b0deddc6ca4de801ceb4ccc9fd674ee0f4cfd72b68c --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=14124 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QCRoGD13iP0pL9YuP79-Omuwt13YzgmEHmCd7OpKAeSKUTfb4kOw6yIjN_2_-UVYZcP7gnUpoi4Hbtrrv30XQicCgmlkgnY0gmlwhKwSbz-KbXVsdGlhZGRyc5YACASsEm8_BoK6AAoErBJvPwaCu90DgnJzhQADAQAAiXNlY3AyNTZrMaECNAUFQMiWlKuHXQGGmgsU1pgPa-O8qYnK26LRneFs38WDdGNwgoK6g3VkcIKCvIV3YWt1MgU --filternode=/ip4/172.18.111.63/tcp/33466/p2p/16Uiu2HAkxvjcwUSJfRorN6ekDHXa6YhdnQ7kr4smJCx3R3E9qP5e
2026-03-03 04:34:17.884 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.9.121 waku 966a236b559fbe63452abd96e43542f3a7c01ad70bf25e545e51ec0553c3ca56
2026-03-03 04:34:17.915 DEBUG [src.node.docker_mananger] Container started with ID 966a236b559f. Setting up logs at ./log/docker/node3_2026-03-03_04-34-15__37aa38a5-12e2-4a1a-9c37-2efacd153688__wakuorg_nwaku:latest.log
2026-03-03 04:34:17.915 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 14120
2026-03-03 04:34:17.915 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:34:18.917 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14120/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:34:18.920 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:34:18.920 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:34:18.920 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14120/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:34:18.922 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.9.121/tcp/14121/p2p/16Uiu2HAmJXxGUKPUoQmcrY743oVPDag9uLWNeTxGHRrnCzBKnyYp","/ip4/172.18.9.121/tcp/14122/ws/p2p/16Uiu2HAmJXxGUKPUoQmcrY743oVPDag9uLWNeTxGHRrnCzBKnyYp"],"enrUri":"enr:-L24QHGU-eB3kQudIvSqNmmgrvpNK7EQw7ZCnR_Hy2sxvKLcdKbply2HALvJK5ZR440g-GuhWZ6eQ4wAwTCkr2aHG3kCgmlkgnY0gmlwhKwSCXmKbXVsdGlhZGRyc5YACASsEgl5BjcpAAoErBIJeQY3Kt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDV1izV948ym-PU_ZItDyy495o9Lv-tSFneb1Lz5UT0j2DdGNwgjcpg3VkcII3K4V3YWt1MgA"}'
2026-03-03 04:34:18.923 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:34:18.923 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14120/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.111.63/tcp/33466/p2p/16Uiu2HAkxvjcwUSJfRorN6ekDHXa6YhdnQ7kr4smJCx3R3E9qP5e"]'
2026-03-03 04:34:18.958 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:34:18.973 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:34:18.974 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-03_04-34-15__37aa38a5-12e2-4a1a-9c37-2efacd153688__wakuorg_nwaku:latest.log
2026-03-03 04:34:18.974 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:34:18.975 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:34:18.978 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-03 04:34:18.978 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.64.15
2026-03-03 04:34:18.978 DEBUG [src.node.docker_mananger] Generated ports ['23935', '23936', '23937', '23938', '23939']
2026-03-03 04:34:18.978 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:34:18.978 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:34:18.978 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:34:18.978 DEBUG [src.node.docker_mananger] docker run -i -t -p 23935:23935 -p 23936:23936 -p 23937:23937 -p 23938:23938 -p 23939:23939 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=23937 --rest-port=23935 --tcp-port=23936 --discv5-udp-port=23938 --rest-address=0.0.0.0 --nat=extip:172.18.64.15 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=c572bb8a6dffabfcac7fa9e6cdb4a2acefbdaae3d09a27ba71d34fd3efad22e8 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=23939 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QCRoGD13iP0pL9YuP79-Omuwt13YzgmEHmCd7OpKAeSKUTfb4kOw6yIjN_2_-UVYZcP7gnUpoi4Hbtrrv30XQicCgmlkgnY0gmlwhKwSbz-KbXVsdGlhZGRyc5YACASsEm8_BoK6AAoErBJvPwaCu90DgnJzhQADAQAAiXNlY3AyNTZrMaECNAUFQMiWlKuHXQGGmgsU1pgPa-O8qYnK26LRneFs38WDdGNwgoK6g3VkcIKCvIV3YWt1MgU --filternode=/ip4/172.18.111.63/tcp/33466/p2p/16Uiu2HAkxvjcwUSJfRorN6ekDHXa6YhdnQ7kr4smJCx3R3E9qP5e
2026-03-03 04:34:19.172 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.64.15 waku 4d25bb0429ac37381a3741630e95618fe38996e5f7c6c518325daa4af328631d
2026-03-03 04:34:19.206 DEBUG [src.node.docker_mananger] Container started with ID 4d25bb0429ac. Setting up logs at ./log/docker/node4_2026-03-03_04-34-15__37aa38a5-12e2-4a1a-9c37-2efacd153688__wakuorg_nwaku:latest.log
2026-03-03 04:34:19.206 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 23935
2026-03-03 04:34:19.207 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:34:20.207 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:23935/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:34:20.210 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:34:20.210 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:34:20.211 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:23935/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:34:20.213 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.64.15/tcp/23936/p2p/16Uiu2HAkv44NzJgx2TGeejvrvaZ5isTUvHJKXViQDY56j33Wntfu","/ip4/172.18.64.15/tcp/23937/ws/p2p/16Uiu2HAkv44NzJgx2TGeejvrvaZ5isTUvHJKXViQDY56j33Wntfu"],"enrUri":"enr:-L24QHciZxISlzXlq84ezZ_2DBxE4m_enzbl3eQZ-mDjCTUtG2GNZEkEUQG1yQnhSHMbBpjSfNx8QkB0kFSF9cllbwUCgmlkgnY0gmlwhKwSQA-KbXVsdGlhZGRyc5YACASsEkAPBl2AAAoErBJADwZdgd0DgnJzhQADAQAAiXNlY3AyNTZrMaECCVI8nqv2kVWxXwjhWT0KjxaB1bgLotq0TnzAm-jDxJSDdGNwgl2Ag3VkcIJdgoV3YWt1MgA"}'
2026-03-03 04:34:20.213 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:34:20.213 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:23935/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.111.63/tcp/33466/p2p/16Uiu2HAkxvjcwUSJfRorN6ekDHXa6YhdnQ7kr4smJCx3R3E9qP5e"]'
2026-03-03 04:34:20.250 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:34:20.265 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:34:20.266 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-03-03_04-34-15__37aa38a5-12e2-4a1a-9c37-2efacd153688__wakuorg_nwaku:latest.log
2026-03-03 04:34:20.266 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:34:20.266 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:34:20.269 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-03 04:34:20.270 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.168.75
2026-03-03 04:34:20.270 DEBUG [src.node.docker_mananger] Generated ports ['40343', '40344', '40345', '40346', '40347']
2026-03-03 04:34:20.270 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:34:20.270 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:34:20.271 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:34:20.271 DEBUG [src.node.docker_mananger] docker run -i -t -p 40343:40343 -p 40344:40344 -p 40345:40345 -p 40346:40346 -p 40347:40347 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=40345 --rest-port=40343 --tcp-port=40344 --discv5-udp-port=40346 --rest-address=0.0.0.0 --nat=extip:172.18.168.75 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=fc0dcbefec6f858ff1df0c23d0ace5b31fd2c6a3d6c68b788cf9cfb8a8ffebe4 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=40347 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QCRoGD13iP0pL9YuP79-Omuwt13YzgmEHmCd7OpKAeSKUTfb4kOw6yIjN_2_-UVYZcP7gnUpoi4Hbtrrv30XQicCgmlkgnY0gmlwhKwSbz-KbXVsdGlhZGRyc5YACASsEm8_BoK6AAoErBJvPwaCu90DgnJzhQADAQAAiXNlY3AyNTZrMaECNAUFQMiWlKuHXQGGmgsU1pgPa-O8qYnK26LRneFs38WDdGNwgoK6g3VkcIKCvIV3YWt1MgU --filternode=/ip4/172.18.111.63/tcp/33466/p2p/16Uiu2HAkxvjcwUSJfRorN6ekDHXa6YhdnQ7kr4smJCx3R3E9qP5e
2026-03-03 04:34:20.475 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.168.75 waku e57f8ad5d58f20c74302b35b7b37c9b16d1adda9942ddd922c41a4586b858044
2026-03-03 04:34:20.510 DEBUG [src.node.docker_mananger] Container started with ID e57f8ad5d58f. Setting up logs at ./log/docker/node5_2026-03-03_04-34-15__37aa38a5-12e2-4a1a-9c37-2efacd153688__wakuorg_nwaku:latest.log
2026-03-03 04:34:20.510 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 40343
2026-03-03 04:34:20.510 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:34:21.511 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40343/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:34:21.514 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:34:21.514 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:34:21.514 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40343/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:34:21.517 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.168.75/tcp/40344/p2p/16Uiu2HAmFKX5iQ1g6p341wqxLsxEV4oyN1sKYDCUwtX4yeBh9zNM","/ip4/172.18.168.75/tcp/40345/ws/p2p/16Uiu2HAmFKX5iQ1g6p341wqxLsxEV4oyN1sKYDCUwtX4yeBh9zNM"],"enrUri":"enr:-L24QJPJo_T2Rk_t7M9I1Miyvvfou1glVOtW41PiHfUxPqH1UqZSYF8LY00L5r0BGASFHU_s1g7yJGmqqGSSvc1mb4YCgmlkgnY0gmlwhKwSqEuKbXVsdGlhZGRyc5YACASsEqhLBp2YAAoErBKoSwadmd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDJ5YxWWG85oNthpoVTodoOcEiBXgx3uo2FJz4xYegFBqDdGNwgp2Yg3VkcIKdmoV3YWt1MgA"}'
2026-03-03 04:34:21.517 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:34:21.517 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:40343/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.111.63/tcp/33466/p2p/16Uiu2HAkxvjcwUSJfRorN6ekDHXa6YhdnQ7kr4smJCx3R3E9qP5e"]'
2026-03-03 04:34:21.552 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:34:21.554 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33465/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-03 04:34:21.562 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:34:21.563 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37663/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "82ca58d8-83b5-418c-be27-01d56879d4ac", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-03 04:34:21.574 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"82ca58d8-83b5-418c-be27-01d56879d4ac","statusDesc":"OK"}'
2026-03-03 04:34:21.575 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14120/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "000dff01-1add-4fcd-8eef-6ab19ae9f534", "contentFilters": ["/test/2/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-03 04:34:21.591 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"000dff01-1add-4fcd-8eef-6ab19ae9f534","statusDesc":"OK"}'
2026-03-03 04:34:21.592 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:23935/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "1d9bced3-d72a-4b94-8786-3ce35348484a", "contentFilters": ["/test/2/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-03 04:34:21.603 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"1d9bced3-d72a-4b94-8786-3ce35348484a","statusDesc":"OK"}'
2026-03-03 04:34:21.603 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:40343/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "d19267aa-e80c-4565-bf68-fcfdebe6f599", "contentFilters": ["/test/2/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-03 04:34:21.614 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"d19267aa-e80c-4565-bf68-fcfdebe6f599","statusDesc":"OK"}'
2026-03-03 04:34:21.615 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33465/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:34:21.623 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:34:21.624 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-03 04:34:21.724 DEBUG [src.steps.filter] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-03 04:34:21.725 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37663/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:34:21.727 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772512461615060868,"ephemeral":false}]'
2026-03-03 04:34:21.729 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33465/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:34:21.734 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:34:21.735 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-03 04:34:21.835 DEBUG [src.steps.filter] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-03 04:34:21.836 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14120/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:34:21.838 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:14120/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto. Response content: b'Not subscribed to topic: /test/1/waku-filter/proto'
2026-03-03 04:34:21.842 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-03 04:34:21.843 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-03 04:34:21.843 DEBUG [src.node.waku_node] Stopping container with id 64485606fb3f
2026-03-03 04:34:22.445 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:34:22.446 DEBUG [src.node.waku_node] Stopping container with id 1ce88706f420
2026-03-03 04:34:23.001 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:34:23.003 DEBUG [src.node.waku_node] Stopping container with id 966a236b559f
2026-03-03 04:34:23.261 ERROR [src.node.docker_mananger] Max retries reached for container 64485606fb3f. Exiting log stream.
2026-03-03 04:34:23.578 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:34:23.578 DEBUG [src.node.waku_node] Stopping container with id 4d25bb0429ac
2026-03-03 04:34:23.837 ERROR [src.node.docker_mananger] Max retries reached for container 1ce88706f420. Exiting log stream.
2026-03-03 04:34:24.113 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:34:24.114 DEBUG [src.node.waku_node] Stopping container with id e57f8ad5d58f
2026-03-03 04:34:24.393 ERROR [src.node.docker_mananger] Max retries reached for container 966a236b559f. Exiting log stream.
2026-03-03 04:34:24.665 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:34:24.667 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-03 04:34:24.681 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-03 04:34:24.690 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-03 04:34:24.694 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-03 04:34:24.698 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-03 04:34:24.702 DEBUG [src.node.docker_mananger] No errors found in the waku logs.