177 lines
34 KiB
Plaintext

2026-01-02 04:17:27.141 DEBUG [tests.conftest] Running fixture setup: test_id
2026-01-02 04:17:27.141 DEBUG [tests.conftest] Running test: test_filter_get_message_while_one_peer_is_paused with id: 2026-01-02_04-17-27__9415b254-8c8b-4979-9fd9-536ada57f480
2026-01-02 04:17:27.142 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-01-02 04:17:27.142 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-01-02 04:17:27.142 DEBUG [src.steps.filter] Running fixture setup: setup_main_relay_node
2026-01-02 04:17:27.148 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-01-02 04:17:27.148 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-01-02_04-17-27__9415b254-8c8b-4979-9fd9-536ada57f480__wakuorg_nwaku:latest.log
2026-01-02 04:17:27.148 DEBUG [src.node.waku_node] Starting Node...
2026-01-02 04:17:27.148 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-01-02 04:17:27.150 DEBUG [src.node.docker_mananger] Network waku already exists
2026-01-02 04:17:27.150 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.61.239
2026-01-02 04:17:27.150 DEBUG [src.node.docker_mananger] Generated ports ['34338', '34339', '34340', '34341', '34342']
2026-01-02 04:17:27.150 DEBUG [src.node.waku_node] RLN credentials were not set
2026-01-02 04:17:27.150 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-01-02 04:17:27.151 DEBUG [src.node.waku_node] Using volumes []
2026-01-02 04:17:27.151 DEBUG [src.node.docker_mananger] docker run -i -t -p 34338:34338 -p 34339:34339 -p 34340:34340 -p 34341:34341 -p 34342:34342 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=34340 --rest-port=34338 --tcp-port=34339 --discv5-udp-port=34341 --rest-address=0.0.0.0 --nat=extip:172.18.61.239 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ed360acd81ec9dfa6ee71eca20da736cea88bdc7ec57efa74e741af4a61ddc31 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=34342 --metrics-logging=true --relay=true --filter=true
2026-01-02 04:17:27.332 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.61.239 waku 900978c5f489cd0b660dc9c501b7794b677c85920bf0d2ea22faf64a048f3554
2026-01-02 04:17:27.363 DEBUG [src.node.docker_mananger] Container started with ID 900978c5f489. Setting up logs at ./log/docker/node1_2026-01-02_04-17-27__9415b254-8c8b-4979-9fd9-536ada57f480__wakuorg_nwaku:latest.log
2026-01-02 04:17:27.364 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 34338
2026-01-02 04:17:27.364 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-01-02 04:17:27.371 ERROR [src.node.docker_mananger] Max retries reached for container 0e98404490c0. Exiting log stream.
2026-01-02 04:17:27.944 ERROR [src.node.docker_mananger] Max retries reached for container accb30914d73. Exiting log stream.
2026-01-02 04:17:28.364 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34338/health" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:17:28.367 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-01-02 04:17:28.367 INFO [src.node.waku_node] Node protocols are initialized !!
2026-01-02 04:17:28.367 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34338/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:17:28.370 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.61.239/tcp/34339/p2p/16Uiu2HAkyWMdXsNsQQXq4Rq1faMDyD3JXRGxHbwJroF2STrS7pna","/ip4/172.18.61.239/tcp/34340/ws/p2p/16Uiu2HAkyWMdXsNsQQXq4Rq1faMDyD3JXRGxHbwJroF2STrS7pna"],"enrUri":"enr:-L24QN6xj4cXCeLwFo24C3Fx598JUXIC--2ti0rTPCbBkoOdbCwXTRsl4VUhLt8UbeNf_uTXdeQDehhxtJmKUIM-79kCgmlkgnY0gmlwhKwSPe-KbXVsdGlhZGRyc5YACASsEj3vBoYjAAoErBI97waGJN0DgnJzhQADAQAAiXNlY3AyNTZrMaECPKHnc8DAOPo-8oYk63WfPIebLQHaMQgy9IzIgAQfwQ-DdGNwgoYjg3VkcIKGJYV3YWt1MgU"}'
2026-01-02 04:17:28.370 INFO [src.node.waku_node] REST service is ready !!
2026-01-02 04:17:28.370 DEBUG [src.steps.filter] Running fixture setup: setup_main_filter_node
2026-01-02 04:17:28.376 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-01-02 04:17:28.376 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-01-02_04-17-27__9415b254-8c8b-4979-9fd9-536ada57f480__wakuorg_nwaku:latest.log
2026-01-02 04:17:28.377 DEBUG [src.node.waku_node] Starting Node...
2026-01-02 04:17:28.377 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-01-02 04:17:28.378 DEBUG [src.node.docker_mananger] Network waku already exists
2026-01-02 04:17:28.378 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.53.116
2026-01-02 04:17:28.378 DEBUG [src.node.docker_mananger] Generated ports ['28239', '28240', '28241', '28242', '28243']
2026-01-02 04:17:28.379 DEBUG [src.node.waku_node] RLN credentials were not set
2026-01-02 04:17:28.379 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-01-02 04:17:28.379 DEBUG [src.node.waku_node] Using volumes []
2026-01-02 04:17:28.379 DEBUG [src.node.docker_mananger] docker run -i -t -p 28239:28239 -p 28240:28240 -p 28241:28241 -p 28242:28242 -p 28243:28243 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=28241 --rest-port=28239 --tcp-port=28240 --discv5-udp-port=28242 --rest-address=0.0.0.0 --nat=extip:172.18.53.116 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=0faddc8cefbdb905e7b05b40bbbeafae25f08e98bdc1cab5ac2a06857b84bd1d --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=28243 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QN6xj4cXCeLwFo24C3Fx598JUXIC--2ti0rTPCbBkoOdbCwXTRsl4VUhLt8UbeNf_uTXdeQDehhxtJmKUIM-79kCgmlkgnY0gmlwhKwSPe-KbXVsdGlhZGRyc5YACASsEj3vBoYjAAoErBI97waGJN0DgnJzhQADAQAAiXNlY3AyNTZrMaECPKHnc8DAOPo-8oYk63WfPIebLQHaMQgy9IzIgAQfwQ-DdGNwgoYjg3VkcIKGJYV3YWt1MgU --filternode=/ip4/172.18.61.239/tcp/34339/p2p/16Uiu2HAkyWMdXsNsQQXq4Rq1faMDyD3JXRGxHbwJroF2STrS7pna
2026-01-02 04:17:28.573 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.53.116 waku a60ecf0e0019c7481e1abbebc2edc9b6ce222771848d52e89773c905b487cd1c
2026-01-02 04:17:28.601 DEBUG [src.node.docker_mananger] Container started with ID a60ecf0e0019. Setting up logs at ./log/docker/node2_2026-01-02_04-17-27__9415b254-8c8b-4979-9fd9-536ada57f480__wakuorg_nwaku:latest.log
2026-01-02 04:17:28.602 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 28239
2026-01-02 04:17:28.602 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-01-02 04:17:29.603 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:28239/health" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:17:29.607 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"}]}'
2026-01-02 04:17:29.607 INFO [src.node.waku_node] Node protocols are initialized !!
2026-01-02 04:17:29.607 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:28239/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:17:29.609 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.53.116/tcp/28240/p2p/16Uiu2HAkvf81B9FuZ4PZ33TD3EfPJbgVrvjHH41KmptPDmzmuNDx","/ip4/172.18.53.116/tcp/28241/ws/p2p/16Uiu2HAkvf81B9FuZ4PZ33TD3EfPJbgVrvjHH41KmptPDmzmuNDx"],"enrUri":"enr:-L24QD1MeqzJS4gfLJJVqunhn45HxSsiYlqdQykYIf5cGwDQfL2mUzCv069CVU0M7qVdBqig2fXUNZXefAMScgm3WQkCgmlkgnY0gmlwhKwSNXSKbXVsdGlhZGRyc5YACASsEjV0Bm5QAAoErBI1dAZuUd0DgnJzhQADAQAAiXNlY3AyNTZrMaECEk2ppZwn4au2fjNDBiQmZBd9CWtpzwt5hbVvpUV9J2ODdGNwgm5Qg3VkcIJuUoV3YWt1MgA"}'
2026-01-02 04:17:29.609 INFO [src.node.waku_node] REST service is ready !!
2026-01-02 04:17:29.610 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:28239/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.61.239/tcp/34339/p2p/16Uiu2HAkyWMdXsNsQQXq4Rq1faMDyD3JXRGxHbwJroF2STrS7pna"]'
2026-01-02 04:17:29.639 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:17:29.655 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-01-02 04:17:29.655 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-01-02_04-17-27__9415b254-8c8b-4979-9fd9-536ada57f480__wakuorg_nwaku:latest.log
2026-01-02 04:17:29.656 DEBUG [src.node.waku_node] Starting Node...
2026-01-02 04:17:29.657 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-01-02 04:17:29.660 DEBUG [src.node.docker_mananger] Network waku already exists
2026-01-02 04:17:29.660 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.130.77
2026-01-02 04:17:29.661 DEBUG [src.node.docker_mananger] Generated ports ['54193', '54194', '54195', '54196', '54197']
2026-01-02 04:17:29.661 DEBUG [src.node.waku_node] RLN credentials were not set
2026-01-02 04:17:29.661 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-01-02 04:17:29.661 DEBUG [src.node.waku_node] Using volumes []
2026-01-02 04:17:29.662 DEBUG [src.node.docker_mananger] docker run -i -t -p 54193:54193 -p 54194:54194 -p 54195:54195 -p 54196:54196 -p 54197:54197 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=54195 --rest-port=54193 --tcp-port=54194 --discv5-udp-port=54196 --rest-address=0.0.0.0 --nat=extip:172.18.130.77 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=cfdc3ca483babde8f4a8feada733c57616dffd6cadd3f78afd8a81b394983db0 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=54197 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QN6xj4cXCeLwFo24C3Fx598JUXIC--2ti0rTPCbBkoOdbCwXTRsl4VUhLt8UbeNf_uTXdeQDehhxtJmKUIM-79kCgmlkgnY0gmlwhKwSPe-KbXVsdGlhZGRyc5YACASsEj3vBoYjAAoErBI97waGJN0DgnJzhQADAQAAiXNlY3AyNTZrMaECPKHnc8DAOPo-8oYk63WfPIebLQHaMQgy9IzIgAQfwQ-DdGNwgoYjg3VkcIKGJYV3YWt1MgU --filternode=/ip4/172.18.61.239/tcp/34339/p2p/16Uiu2HAkyWMdXsNsQQXq4Rq1faMDyD3JXRGxHbwJroF2STrS7pna
2026-01-02 04:17:29.842 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.130.77 waku 46e6694cb8786000f14b14de9207d4fba012062febab1080788c6e9183504a5c
2026-01-02 04:17:29.872 DEBUG [src.node.docker_mananger] Container started with ID 46e6694cb878. Setting up logs at ./log/docker/node3_2026-01-02_04-17-27__9415b254-8c8b-4979-9fd9-536ada57f480__wakuorg_nwaku:latest.log
2026-01-02 04:17:29.872 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 54193
2026-01-02 04:17:29.873 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-01-02 04:17:30.873 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54193/health" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:17:30.877 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"}]}'
2026-01-02 04:17:30.877 INFO [src.node.waku_node] Node protocols are initialized !!
2026-01-02 04:17:30.877 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54193/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:17:30.879 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.130.77/tcp/54194/p2p/16Uiu2HAkvZg5LjQnQvmfRjDjCkqCDaXH6qXLhwj5tfiK8J2vYuaC","/ip4/172.18.130.77/tcp/54195/ws/p2p/16Uiu2HAkvZg5LjQnQvmfRjDjCkqCDaXH6qXLhwj5tfiK8J2vYuaC"],"enrUri":"enr:-L24QNv7Fahg1svF6I7jALLH6G27KdF3dlz7Yyphr7WWBssgcMfdSqXVemacs6je08d_h75AZ40Heq-aV3l-xKIopQICgmlkgnY0gmlwhKwSgk2KbXVsdGlhZGRyc5YACASsEoJNBtOyAAoErBKCTQbTs90DgnJzhQADAQAAiXNlY3AyNTZrMaECEOhxCTSEvxEZGNKM5y2bvM5lXj3qc4nsUzdcdiZ-Z12DdGNwgtOyg3VkcILTtIV3YWt1MgA"}'
2026-01-02 04:17:30.880 INFO [src.node.waku_node] REST service is ready !!
2026-01-02 04:17:30.880 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54193/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.61.239/tcp/34339/p2p/16Uiu2HAkyWMdXsNsQQXq4Rq1faMDyD3JXRGxHbwJroF2STrS7pna"]'
2026-01-02 04:17:30.909 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:17:30.921 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-01-02 04:17:30.922 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-01-02_04-17-27__9415b254-8c8b-4979-9fd9-536ada57f480__wakuorg_nwaku:latest.log
2026-01-02 04:17:30.922 DEBUG [src.node.waku_node] Starting Node...
2026-01-02 04:17:30.923 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-01-02 04:17:30.927 DEBUG [src.node.docker_mananger] Network waku already exists
2026-01-02 04:17:30.927 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.75.150
2026-01-02 04:17:30.928 DEBUG [src.node.docker_mananger] Generated ports ['58400', '58401', '58402', '58403', '58404']
2026-01-02 04:17:30.928 DEBUG [src.node.waku_node] RLN credentials were not set
2026-01-02 04:17:30.929 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-01-02 04:17:30.929 DEBUG [src.node.waku_node] Using volumes []
2026-01-02 04:17:30.929 DEBUG [src.node.docker_mananger] docker run -i -t -p 58400:58400 -p 58401:58401 -p 58402:58402 -p 58403:58403 -p 58404:58404 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=58402 --rest-port=58400 --tcp-port=58401 --discv5-udp-port=58403 --rest-address=0.0.0.0 --nat=extip:172.18.75.150 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=e2a7fc40fe6d7f5a5814952edbf7f880452ccf9bdfeef9aad6e88b5ebad5d5b7 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=58404 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QN6xj4cXCeLwFo24C3Fx598JUXIC--2ti0rTPCbBkoOdbCwXTRsl4VUhLt8UbeNf_uTXdeQDehhxtJmKUIM-79kCgmlkgnY0gmlwhKwSPe-KbXVsdGlhZGRyc5YACASsEj3vBoYjAAoErBI97waGJN0DgnJzhQADAQAAiXNlY3AyNTZrMaECPKHnc8DAOPo-8oYk63WfPIebLQHaMQgy9IzIgAQfwQ-DdGNwgoYjg3VkcIKGJYV3YWt1MgU --filternode=/ip4/172.18.61.239/tcp/34339/p2p/16Uiu2HAkyWMdXsNsQQXq4Rq1faMDyD3JXRGxHbwJroF2STrS7pna
2026-01-02 04:17:31.117 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.75.150 waku 816e8a72a1cce488fb037978a4d718d05807de73f50c6b18fc35c2a6fcc8cea4
2026-01-02 04:17:31.146 DEBUG [src.node.docker_mananger] Container started with ID 816e8a72a1cc. Setting up logs at ./log/docker/node4_2026-01-02_04-17-27__9415b254-8c8b-4979-9fd9-536ada57f480__wakuorg_nwaku:latest.log
2026-01-02 04:17:31.147 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 58400
2026-01-02 04:17:31.147 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-01-02 04:17:32.148 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58400/health" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:17:32.151 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"}]}'
2026-01-02 04:17:32.152 INFO [src.node.waku_node] Node protocols are initialized !!
2026-01-02 04:17:32.152 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58400/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:17:32.154 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.75.150/tcp/58401/p2p/16Uiu2HAm188gr2xx2K6L1uo3a7WHzD89QnMHaxJw3AYToF1biZXr","/ip4/172.18.75.150/tcp/58402/ws/p2p/16Uiu2HAm188gr2xx2K6L1uo3a7WHzD89QnMHaxJw3AYToF1biZXr"],"enrUri":"enr:-L24QC1Z7rKbCL74NVmzwsR9UwgQ5HTWN4mT2Pc291CQjc8oYSgiTM9lBDUwsy1o0rQXa0_KbYDGD-NPAtxroCPEjpQCgmlkgnY0gmlwhKwSS5aKbXVsdGlhZGRyc5YACASsEkuWBuQhAAoErBJLlgbkIt0DgnJzhQADAQAAiXNlY3AyNTZrMaECVKfdmGQ9TynGT-NLsN-V1bGte9_9g2SVN84_mZxY5oWDdGNwguQhg3VkcILkI4V3YWt1MgA"}'
2026-01-02 04:17:32.154 INFO [src.node.waku_node] REST service is ready !!
2026-01-02 04:17:32.155 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:58400/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.61.239/tcp/34339/p2p/16Uiu2HAkyWMdXsNsQQXq4Rq1faMDyD3JXRGxHbwJroF2STrS7pna"]'
2026-01-02 04:17:32.186 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:17:32.195 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-01-02 04:17:32.196 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-01-02_04-17-27__9415b254-8c8b-4979-9fd9-536ada57f480__wakuorg_nwaku:latest.log
2026-01-02 04:17:32.196 DEBUG [src.node.waku_node] Starting Node...
2026-01-02 04:17:32.196 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-01-02 04:17:32.199 DEBUG [src.node.docker_mananger] Network waku already exists
2026-01-02 04:17:32.199 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.122.136
2026-01-02 04:17:32.199 DEBUG [src.node.docker_mananger] Generated ports ['45164', '45165', '45166', '45167', '45168']
2026-01-02 04:17:32.199 DEBUG [src.node.waku_node] RLN credentials were not set
2026-01-02 04:17:32.199 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-01-02 04:17:32.200 DEBUG [src.node.waku_node] Using volumes []
2026-01-02 04:17:32.200 DEBUG [src.node.docker_mananger] docker run -i -t -p 45164:45164 -p 45165:45165 -p 45166:45166 -p 45167:45167 -p 45168:45168 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=45166 --rest-port=45164 --tcp-port=45165 --discv5-udp-port=45167 --rest-address=0.0.0.0 --nat=extip:172.18.122.136 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=0afeac669475afbcc40ef7c61ffcb0f1059e3f98b40198d2b311dabab32ebd8e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=45168 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QN6xj4cXCeLwFo24C3Fx598JUXIC--2ti0rTPCbBkoOdbCwXTRsl4VUhLt8UbeNf_uTXdeQDehhxtJmKUIM-79kCgmlkgnY0gmlwhKwSPe-KbXVsdGlhZGRyc5YACASsEj3vBoYjAAoErBI97waGJN0DgnJzhQADAQAAiXNlY3AyNTZrMaECPKHnc8DAOPo-8oYk63WfPIebLQHaMQgy9IzIgAQfwQ-DdGNwgoYjg3VkcIKGJYV3YWt1MgU --filternode=/ip4/172.18.61.239/tcp/34339/p2p/16Uiu2HAkyWMdXsNsQQXq4Rq1faMDyD3JXRGxHbwJroF2STrS7pna
2026-01-02 04:17:32.382 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.122.136 waku d73f4edb298c9a55de4a720f14aec3c33011bf3c8e37deae4064921dda21c85d
2026-01-02 04:17:32.409 DEBUG [src.node.docker_mananger] Container started with ID d73f4edb298c. Setting up logs at ./log/docker/node5_2026-01-02_04-17-27__9415b254-8c8b-4979-9fd9-536ada57f480__wakuorg_nwaku:latest.log
2026-01-02 04:17:32.410 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 45164
2026-01-02 04:17:32.410 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-01-02 04:17:33.410 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45164/health" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:17:33.414 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"}]}'
2026-01-02 04:17:33.414 INFO [src.node.waku_node] Node protocols are initialized !!
2026-01-02 04:17:33.414 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45164/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:17:33.417 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.122.136/tcp/45165/p2p/16Uiu2HAm9HwbDgiZW6fbHborD1D3HJvwV2vrLw868ZDRDJ7SzjM4","/ip4/172.18.122.136/tcp/45166/ws/p2p/16Uiu2HAm9HwbDgiZW6fbHborD1D3HJvwV2vrLw868ZDRDJ7SzjM4"],"enrUri":"enr:-L24QK6FAzd12HH6mtmBngEpVa-y9otG_aGEhO69ujJWB4LhP-Le8FZyOALZ4UKsRB2TaLV89WZx8HCXgxl2jQSHPlsCgmlkgnY0gmlwhKwSeoiKbXVsdGlhZGRyc5YACASsEnqIBrBtAAoErBJ6iAawbt0DgnJzhQADAQAAiXNlY3AyNTZrMaECzgifJi9zGNGAqVlm31sPlSEbZwxIl29mbzLpsaD2p-uDdGNwgrBtg3VkcIKwb4V3YWt1MgA"}'
2026-01-02 04:17:33.417 INFO [src.node.waku_node] REST service is ready !!
2026-01-02 04:17:33.417 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45164/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.61.239/tcp/34339/p2p/16Uiu2HAkyWMdXsNsQQXq4Rq1faMDyD3JXRGxHbwJroF2STrS7pna"]'
2026-01-02 04:17:33.447 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:17:33.448 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34338/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-01-02 04:17:33.458 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:17:33.458 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:28239/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "52dc57a4-e658-4a80-9af9-3ff66ebc025b", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-01-02 04:17:33.468 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"52dc57a4-e658-4a80-9af9-3ff66ebc025b","statusDesc":"OK"}'
2026-01-02 04:17:33.468 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54193/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "ed516418-c43a-48db-8a1b-527906f14b00", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-01-02 04:17:33.479 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"ed516418-c43a-48db-8a1b-527906f14b00","statusDesc":"OK"}'
2026-01-02 04:17:33.480 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:58400/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "eb7c9348-c262-494a-9140-d3febd84f67f", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-01-02 04:17:33.489 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"eb7c9348-c262-494a-9140-d3febd84f67f","statusDesc":"OK"}'
2026-01-02 04:17:33.490 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45164/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "4a6f7165-f6b3-4def-9b00-92d4aa041785", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-01-02 04:17:33.499 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"4a6f7165-f6b3-4def-9b00-92d4aa041785","statusDesc":"OK"}'
2026-01-02 04:17:33.500 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34338/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:17:33.512 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:17:33.512 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-01-02 04:17:33.613 DEBUG [src.steps.filter] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-01-02 04:17:33.613 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:28239/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:17:33.616 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1767327453500082701,"ephemeral":false}]'
2026-01-02 04:17:33.617 DEBUG [src.steps.filter] Checking that peer NODE_3:wakuorg/nwaku:latest can find the published message
2026-01-02 04:17:33.618 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54193/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:17:33.620 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1767327453500082701,"ephemeral":false}]'
2026-01-02 04:17:33.621 DEBUG [src.steps.filter] Checking that peer NODE_4:wakuorg/nwaku:latest can find the published message
2026-01-02 04:17:33.621 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58400/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:17:33.623 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1767327453500082701,"ephemeral":false}]'
2026-01-02 04:17:33.625 DEBUG [src.steps.filter] Checking that peer NODE_5:wakuorg/nwaku:latest can find the published message
2026-01-02 04:17:33.625 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45164/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:17:33.627 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1767327453500082701,"ephemeral":false}]'
2026-01-02 04:17:33.628 DEBUG [src.node.waku_node] Pausing container with id a60ecf0e0019
2026-01-02 04:17:33.638 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34338/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:17:33.644 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:17:33.644 DEBUG [src.node.waku_node] Unpause container with id a60ecf0e0019
2026-01-02 04:17:33.652 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34338/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:17:33.658 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:17:33.658 DEBUG [src.libs.common] Sleeping for 0.5 seconds
2026-01-02 04:17:34.159 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:28239/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:17:34.161 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1767327453628777077,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1767327453628849833,"ephemeral":false}]'
2026-01-02 04:17:34.163 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-01-02 04:17:34.164 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-01-02 04:17:34.164 DEBUG [src.node.waku_node] Stopping container with id 900978c5f489
2026-01-02 04:17:34.769 DEBUG [src.node.waku_node] Container stopped.
2026-01-02 04:17:34.770 DEBUG [src.node.waku_node] Stopping container with id a60ecf0e0019
2026-01-02 04:17:35.354 DEBUG [src.node.waku_node] Container stopped.
2026-01-02 04:17:35.356 DEBUG [src.node.waku_node] Stopping container with id 46e6694cb878
2026-01-02 04:17:35.640 ERROR [src.node.docker_mananger] Max retries reached for container 900978c5f489. Exiting log stream.
2026-01-02 04:17:35.865 DEBUG [src.node.waku_node] Container stopped.
2026-01-02 04:17:35.867 DEBUG [src.node.waku_node] Stopping container with id 816e8a72a1cc
2026-01-02 04:17:36.192 ERROR [src.node.docker_mananger] Max retries reached for container a60ecf0e0019. Exiting log stream.
2026-01-02 04:17:36.380 DEBUG [src.node.waku_node] Container stopped.
2026-01-02 04:17:36.381 DEBUG [src.node.waku_node] Stopping container with id d73f4edb298c
2026-01-02 04:17:36.689 ERROR [src.node.docker_mananger] Max retries reached for container 46e6694cb878. Exiting log stream.
2026-01-02 04:17:36.898 DEBUG [src.node.waku_node] Container stopped.
2026-01-02 04:17:36.898 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-01-02 04:17:36.930 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-01-02 04:17:36.939 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-01-02 04:17:36.943 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-01-02 04:17:36.947 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-01-02 04:17:36.952 DEBUG [src.node.docker_mananger] No errors found in the waku logs.