201 lines
42 KiB
Plaintext

2026-03-17 04:35:14.629 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-17 04:35:14.629 DEBUG [tests.conftest] Running test: test_store_filter_interaction_with_six_nodes with id: 2026-03-17_04-35-14__f4c5c0b2-cd37-4dc3-a3cf-e92078d6404e
2026-03-17 04:35:14.629 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-17 04:35:14.630 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-03-17 04:35:14.630 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-03-17 04:35:14.642 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-17 04:35:14.642 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-17_04-35-14__f4c5c0b2-cd37-4dc3-a3cf-e92078d6404e__wakuorg_nwaku:latest.log
2026-03-17 04:35:14.648 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-17 04:35:14.648 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-17_04-35-14__f4c5c0b2-cd37-4dc3-a3cf-e92078d6404e__wakuorg_nwaku:latest.log
2026-03-17 04:35:14.654 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-17 04:35:14.654 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-17_04-35-14__f4c5c0b2-cd37-4dc3-a3cf-e92078d6404e__wakuorg_nwaku:latest.log
2026-03-17 04:35:14.655 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-17 04:35:14.655 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-17 04:35:14.656 DEBUG [tests.e2e.test_e2e] Create 6 nodes
2026-03-17 04:35:14.662 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-17 04:35:14.662 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-17_04-35-14__f4c5c0b2-cd37-4dc3-a3cf-e92078d6404e__wakuorg_nwaku:latest.log
2026-03-17 04:35:14.668 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-17 04:35:14.668 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-03-17_04-35-14__f4c5c0b2-cd37-4dc3-a3cf-e92078d6404e__wakuorg_nwaku:latest.log
2026-03-17 04:35:14.674 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-17 04:35:14.674 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node6_2026-03-17_04-35-14__f4c5c0b2-cd37-4dc3-a3cf-e92078d6404e__wakuorg_nwaku:latest.log
2026-03-17 04:35:14.674 DEBUG [tests.e2e.test_e2e] Start 5 nodes with their corresponding config
2026-03-17 04:35:14.674 DEBUG [src.node.waku_node] Starting Node...
2026-03-17 04:35:14.675 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-17 04:35:14.718 DEBUG [src.node.docker_mananger] Network waku created
2026-03-17 04:35:14.718 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.118.32
2026-03-17 04:35:14.718 DEBUG [src.node.docker_mananger] Generated ports ['44509', '44510', '44511', '44512', '44513']
2026-03-17 04:35:14.719 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-17 04:35:14.719 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-17 04:35:14.719 DEBUG [src.node.waku_node] Using volumes []
2026-03-17 04:35:14.719 DEBUG [src.node.docker_mananger] docker run -i -t -p 44509:44509 -p 44510:44510 -p 44511:44511 -p 44512:44512 -p 44513:44513 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=44511 --rest-port=44509 --tcp-port=44510 --discv5-udp-port=44512 --rest-address=0.0.0.0 --nat=extip:172.18.118.32 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=5ccf93e7373f3bf29b49b72bcbddb05e0d8fbcd3114d41daecde3e11acf9dade --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=44513 --metrics-logging=true --relay=true --store=true
2026-03-17 04:35:18.550 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.118.32 waku 3401d6f38e2f6dda5b0ec598236d9a52da5189c4ef47b894ab5dcf573089f187
2026-03-17 04:35:18.582 DEBUG [src.node.docker_mananger] Container started with ID 3401d6f38e2f. Setting up logs at ./log/docker/node1_2026-03-17_04-35-14__f4c5c0b2-cd37-4dc3-a3cf-e92078d6404e__wakuorg_nwaku:latest.log
2026-03-17 04:35:18.582 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 44509
2026-03-17 04:35:18.584 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-17 04:35:19.585 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44509/health" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:35:19.588 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-17 04:35:19.588 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-17 04:35:19.588 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44509/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:35:19.591 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.118.32/tcp/44510/p2p/16Uiu2HAm7nsmLpSSzgiMFQq8c422qiRJZ5ajLBMgydQSqsSfyfcY","/ip4/172.18.118.32/tcp/44511/ws/p2p/16Uiu2HAm7nsmLpSSzgiMFQq8c422qiRJZ5ajLBMgydQSqsSfyfcY"],"enrUri":"enr:-L24QMnnG7pu4GnnefKRC6ooMxhZM6M13GKN2wejT6xvr60pCCikq5PTZhVW_bLixUyVGreVDf-QllYmj7yyYcU50CcCgmlkgnY0gmlwhKwSdiCKbXVsdGlhZGRyc5YACASsEnYgBq3eAAoErBJ2IAat390DgnJzhQADAQAAiXNlY3AyNTZrMaECt7rEDLXa_jw9ei_JBJam7GcIiKUqEIe5qRZUFw1cgKWDdGNwgq3eg3VkcIKt4IV3YWt1MgM"}'
2026-03-17 04:35:19.591 INFO [src.node.waku_node] REST service is ready !!
2026-03-17 04:35:19.591 DEBUG [src.node.waku_node] Starting Node...
2026-03-17 04:35:19.591 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-17 04:35:19.593 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-17 04:35:19.593 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.38.23
2026-03-17 04:35:19.593 DEBUG [src.node.docker_mananger] Generated ports ['12638', '12639', '12640', '12641', '12642']
2026-03-17 04:35:19.593 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-17 04:35:19.594 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-17 04:35:19.594 DEBUG [src.node.waku_node] Using volumes []
2026-03-17 04:35:19.594 DEBUG [src.node.docker_mananger] docker run -i -t -p 12638:12638 -p 12639:12639 -p 12640:12640 -p 12641:12641 -p 12642:12642 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=12640 --rest-port=12638 --tcp-port=12639 --discv5-udp-port=12641 --rest-address=0.0.0.0 --nat=extip:172.18.38.23 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=bc6dfe8b9b724149b7ba6b8cfde2a24b9a8dd5f53e64782ecaa5e9a99000783e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=12642 --metrics-logging=true --relay=true --store=true --discv5-bootstrap-node=enr:-L24QMnnG7pu4GnnefKRC6ooMxhZM6M13GKN2wejT6xvr60pCCikq5PTZhVW_bLixUyVGreVDf-QllYmj7yyYcU50CcCgmlkgnY0gmlwhKwSdiCKbXVsdGlhZGRyc5YACASsEnYgBq3eAAoErBJ2IAat390DgnJzhQADAQAAiXNlY3AyNTZrMaECt7rEDLXa_jw9ei_JBJam7GcIiKUqEIe5qRZUFw1cgKWDdGNwgq3eg3VkcIKt4IV3YWt1MgM
2026-03-17 04:35:19.787 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.38.23 waku c982b5a7f1cfd74884ff04a4719d22e449f7f3d90eeeafc7bf0b64e0e413f402
2026-03-17 04:35:19.821 DEBUG [src.node.docker_mananger] Container started with ID c982b5a7f1cf. Setting up logs at ./log/docker/node2_2026-03-17_04-35-14__f4c5c0b2-cd37-4dc3-a3cf-e92078d6404e__wakuorg_nwaku:latest.log
2026-03-17 04:35:19.822 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 12638
2026-03-17 04:35:19.822 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-17 04:35:20.822 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12638/health" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:35:20.825 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-17 04:35:20.826 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-17 04:35:20.826 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12638/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:35:20.828 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.38.23/tcp/12639/p2p/16Uiu2HAmQQT8RxcnrJfCWvv2zKZUP3zEYAMy8es3HkDVzMNt5yb1","/ip4/172.18.38.23/tcp/12640/ws/p2p/16Uiu2HAmQQT8RxcnrJfCWvv2zKZUP3zEYAMy8es3HkDVzMNt5yb1"],"enrUri":"enr:-L24QIex-z4H7KEhR5FGegT6DHYgmIZ6HHd0lmw79oW-12GpDpUCQSU7jhR8LRfwP-Q14iGEf-e48MxRYgHV5MlWgnICgmlkgnY0gmlwhKwSJheKbXVsdGlhZGRyc5YACASsEiYXBjFfAAoErBImFwYxYN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDrpLPLiSmhR1Lvh583O-crZus7ShsW-q3YTWIY5GMJASDdGNwgjFfg3VkcIIxYYV3YWt1MgM"}'
2026-03-17 04:35:20.829 INFO [src.node.waku_node] REST service is ready !!
2026-03-17 04:35:20.829 DEBUG [src.node.waku_node] Starting Node...
2026-03-17 04:35:20.829 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-17 04:35:20.830 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-17 04:35:20.831 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.6.236
2026-03-17 04:35:20.831 DEBUG [src.node.docker_mananger] Generated ports ['50449', '50450', '50451', '50452', '50453']
2026-03-17 04:35:20.831 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-17 04:35:20.831 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-17 04:35:20.831 DEBUG [src.node.waku_node] Using volumes []
2026-03-17 04:35:20.831 DEBUG [src.node.docker_mananger] docker run -i -t -p 50449:50449 -p 50450:50450 -p 50451:50451 -p 50452:50452 -p 50453:50453 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=50451 --rest-port=50449 --tcp-port=50450 --discv5-udp-port=50452 --rest-address=0.0.0.0 --nat=extip:172.18.6.236 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=b7dc4c70b91f172fb5b6bcfffbee3fa1b1dbfa7ea3cebfd4affd78fe43b1a4cc --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=50453 --metrics-logging=true --relay=true --store=true --discv5-bootstrap-node=enr:-L24QIex-z4H7KEhR5FGegT6DHYgmIZ6HHd0lmw79oW-12GpDpUCQSU7jhR8LRfwP-Q14iGEf-e48MxRYgHV5MlWgnICgmlkgnY0gmlwhKwSJheKbXVsdGlhZGRyc5YACASsEiYXBjFfAAoErBImFwYxYN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDrpLPLiSmhR1Lvh583O-crZus7ShsW-q3YTWIY5GMJASDdGNwgjFfg3VkcIIxYYV3YWt1MgM
2026-03-17 04:35:21.049 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.6.236 waku 590a44edd4067906bd1030558ac975a83472b84429674012f6fd4380058e9f17
2026-03-17 04:35:21.082 DEBUG [src.node.docker_mananger] Container started with ID 590a44edd406. Setting up logs at ./log/docker/node3_2026-03-17_04-35-14__f4c5c0b2-cd37-4dc3-a3cf-e92078d6404e__wakuorg_nwaku:latest.log
2026-03-17 04:35:21.083 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 50449
2026-03-17 04:35:21.083 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-17 04:35:22.084 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50449/health" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:35:22.087 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-17 04:35:22.087 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-17 04:35:22.087 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50449/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:35:22.089 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.6.236/tcp/50450/p2p/16Uiu2HAm4Fp4ATe4mN8ZypgeuQj7CyLkzkCz5wUvCPx3hjK6qrph","/ip4/172.18.6.236/tcp/50451/ws/p2p/16Uiu2HAm4Fp4ATe4mN8ZypgeuQj7CyLkzkCz5wUvCPx3hjK6qrph"],"enrUri":"enr:-L24QExiZim0epCR-cqXzD629VqNf2PrZ7y29-Urt32GSazxJXAA1UCeio_N-4YzSX9qKUGA6x1YW898mhKwyCOSwhwCgmlkgnY0gmlwhKwSBuyKbXVsdGlhZGRyc5YACASsEgbsBsUSAAoErBIG7AbFE90DgnJzhQADAQAAiXNlY3AyNTZrMaECgzKBTKF54QWL849SHA91JCIQKvOPEH8fw8rHsNJif0KDdGNwgsUSg3VkcILFFIV3YWt1MgM"}'
2026-03-17 04:35:22.089 INFO [src.node.waku_node] REST service is ready !!
2026-03-17 04:35:22.090 DEBUG [src.node.waku_node] Starting Node...
2026-03-17 04:35:22.090 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-17 04:35:22.091 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-17 04:35:22.091 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.14.225
2026-03-17 04:35:22.091 DEBUG [src.node.docker_mananger] Generated ports ['13550', '13551', '13552', '13553', '13554']
2026-03-17 04:35:22.092 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-17 04:35:22.092 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-17 04:35:22.092 DEBUG [src.node.waku_node] Using volumes []
2026-03-17 04:35:22.092 DEBUG [src.node.docker_mananger] docker run -i -t -p 13550:13550 -p 13551:13551 -p 13552:13552 -p 13553:13553 -p 13554:13554 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=13552 --rest-port=13550 --tcp-port=13551 --discv5-udp-port=13553 --rest-address=0.0.0.0 --nat=extip:172.18.14.225 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=d82a58dd5fa7ffa6c97a2e39e9466ffecbfad6daaaa281473b0c8a7e4a4f8fb7 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=13554 --metrics-logging=true --relay=true --filter=true --store=true --discv5-bootstrap-node=enr:-L24QExiZim0epCR-cqXzD629VqNf2PrZ7y29-Urt32GSazxJXAA1UCeio_N-4YzSX9qKUGA6x1YW898mhKwyCOSwhwCgmlkgnY0gmlwhKwSBuyKbXVsdGlhZGRyc5YACASsEgbsBsUSAAoErBIG7AbFE90DgnJzhQADAQAAiXNlY3AyNTZrMaECgzKBTKF54QWL849SHA91JCIQKvOPEH8fw8rHsNJif0KDdGNwgsUSg3VkcILFFIV3YWt1MgM
2026-03-17 04:35:22.319 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.14.225 waku a5fdacb28199213a23abb4ccf83cfce3877908ccaf0021afe902b980ecce5b8c
2026-03-17 04:35:22.358 DEBUG [src.node.docker_mananger] Container started with ID a5fdacb28199. Setting up logs at ./log/docker/node4_2026-03-17_04-35-14__f4c5c0b2-cd37-4dc3-a3cf-e92078d6404e__wakuorg_nwaku:latest.log
2026-03-17 04:35:22.358 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 13550
2026-03-17 04:35:22.359 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-17 04:35:23.360 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13550/health" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:35:23.363 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-17 04:35:23.363 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-17 04:35:23.363 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13550/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:35:23.366 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.14.225/tcp/13551/p2p/16Uiu2HAm3HnGiSAGpnNorB1Qdj5Wio9Fu3YWWk8C4huwaqeL4BW6","/ip4/172.18.14.225/tcp/13552/ws/p2p/16Uiu2HAm3HnGiSAGpnNorB1Qdj5Wio9Fu3YWWk8C4huwaqeL4BW6"],"enrUri":"enr:-L24QCfI4PguGzSXaYoEU1cNDQF39o0EXmUHCG-MV19ouYIBRI8NSN-vlKi3yqxSjEuu3iB88f324R1FDPTlTmqVvqUCgmlkgnY0gmlwhKwSDuGKbXVsdGlhZGRyc5YACASsEg7hBjTvAAoErBIO4QY08N0DgnJzhQADAQAAiXNlY3AyNTZrMaECdNf2ii9hRJt0HatJKkbu8e1a8-vRImJL_PulyrZBXUeDdGNwgjTvg3VkcII08YV3YWt1Mgc"}'
2026-03-17 04:35:23.367 INFO [src.node.waku_node] REST service is ready !!
2026-03-17 04:35:23.367 DEBUG [src.node.waku_node] Starting Node...
2026-03-17 04:35:23.367 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-17 04:35:23.368 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-17 04:35:23.368 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.207.138
2026-03-17 04:35:23.368 DEBUG [src.node.docker_mananger] Generated ports ['45762', '45763', '45764', '45765', '45766']
2026-03-17 04:35:23.369 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-17 04:35:23.369 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-17 04:35:23.369 DEBUG [src.node.waku_node] Using volumes []
2026-03-17 04:35:23.369 DEBUG [src.node.docker_mananger] docker run -i -t -p 45762:45762 -p 45763:45763 -p 45764:45764 -p 45765:45765 -p 45766:45766 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=45764 --rest-port=45762 --tcp-port=45763 --discv5-udp-port=45765 --rest-address=0.0.0.0 --nat=extip:172.18.207.138 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=9d08c12204c9f4e6d8a8ac1002ef467ec1ee94a49fe1457b1bff9e559ea87bef --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=45766 --metrics-logging=true --relay=false --filternode=/ip4/172.18.14.225/tcp/13551/p2p/16Uiu2HAm3HnGiSAGpnNorB1Qdj5Wio9Fu3YWWk8C4huwaqeL4BW6 --discv5-bootstrap-node=enr:-L24QCfI4PguGzSXaYoEU1cNDQF39o0EXmUHCG-MV19ouYIBRI8NSN-vlKi3yqxSjEuu3iB88f324R1FDPTlTmqVvqUCgmlkgnY0gmlwhKwSDuGKbXVsdGlhZGRyc5YACASsEg7hBjTvAAoErBIO4QY08N0DgnJzhQADAQAAiXNlY3AyNTZrMaECdNf2ii9hRJt0HatJKkbu8e1a8-vRImJL_PulyrZBXUeDdGNwgjTvg3VkcII08YV3YWt1Mgc
2026-03-17 04:35:23.599 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.207.138 waku c8099c1aaf5ee2525c898d311f62c3e397f28b97f49e10707d6de8e42f91ec01
2026-03-17 04:35:23.633 DEBUG [src.node.docker_mananger] Container started with ID c8099c1aaf5e. Setting up logs at ./log/docker/node6_2026-03-17_04-35-14__f4c5c0b2-cd37-4dc3-a3cf-e92078d6404e__wakuorg_nwaku:latest.log
2026-03-17 04:35:23.634 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 45762
2026-03-17 04:35:23.634 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-17 04:35:24.638 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45762/health" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:35:24.650 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-17 04:35:24.653 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-17 04:35:24.653 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45762/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:35:24.663 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.207.138/tcp/45763/p2p/16Uiu2HAmRcTp6kZthpig582MMWTxqV9vonAap4BM4XyXKDffoJw5","/ip4/172.18.207.138/tcp/45764/ws/p2p/16Uiu2HAmRcTp6kZthpig582MMWTxqV9vonAap4BM4XyXKDffoJw5"],"enrUri":"enr:-L24QPkI0wlKj3MuJ_TDTJY3HDKk0IYaxYPKd8hzm3CcgIibWDdA6YUsIPyJ6tJ0vSAZD4ESi5tfYbkAgXMUo749IckCgmlkgnY0gmlwhKwSz4qKbXVsdGlhZGRyc5YACASsEs-KBrLDAAoErBLPigayxN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDwII9QPf4iOlT6JvLxzqjKOn81z6fLZTKetI0H-rYSvSDdGNwgrLDg3VkcIKyxYV3YWt1MgA"}'
2026-03-17 04:35:24.665 INFO [src.node.waku_node] REST service is ready !!
2026-03-17 04:35:24.673 DEBUG [tests.e2e.test_e2e] Subscribe nodes to relay pubsub topics
2026-03-17 04:35:24.673 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44509/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-17 04:35:24.683 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-17 04:35:24.683 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12638/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-17 04:35:24.693 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-17 04:35:24.694 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:50449/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-17 04:35:24.706 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-17 04:35:24.707 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13550/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-17 04:35:24.723 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-17 04:35:24.726 DEBUG [tests.e2e.test_e2e] Node6 subscribe to filter for pubsubtopic /waku/2/rs/3/1
2026-03-17 04:35:24.726 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45762/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "1", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-17 04:35:24.780 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"1","statusDesc":"OK"}'
2026-03-17 04:35:24.781 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44509/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:35:24.787 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.6.236/tcp/50450/p2p/16Uiu2HAm4Fp4ATe4mN8ZypgeuQj7CyLkzkCz5wUvCPx3hjK6qrph","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0","origin":"Discv5"},{"multiaddr":"/ip4/172.18.38.23/tcp/40514/p2p/16Uiu2HAmQQT8RxcnrJfCWvv2zKZUP3zEYAMy8es3HkDVzMNt5yb1","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0","origin":"Discv5"},{"multiaddr":"/ip4/172.18.14.225/tcp/13551/p2p/16Uiu2HAm3HnGiSAGpnNorB1Qdj5Wio9Fu3YWWk8C4huwaqeL4BW6","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0","origin":"Discv5"}]'
2026-03-17 04:35:24.787 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12638/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:35:24.792 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.6.236/tcp/33778/p2p/16Uiu2HAm4Fp4ATe4mN8ZypgeuQj7CyLkzkCz5wUvCPx3hjK6qrph","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.118.32/tcp/44510/p2p/16Uiu2HAm7nsmLpSSzgiMFQq8c422qiRJZ5ajLBMgydQSqsSfyfcY","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0","origin":"Discv5"}]'
2026-03-17 04:35:24.792 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50449/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:35:24.796 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.118.32/tcp/58970/p2p/16Uiu2HAm7nsmLpSSzgiMFQq8c422qiRJZ5ajLBMgydQSqsSfyfcY","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.38.23/tcp/12639/p2p/16Uiu2HAmQQT8RxcnrJfCWvv2zKZUP3zEYAMy8es3HkDVzMNt5yb1","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0","origin":"Discv5"},{"multiaddr":"/ip4/172.18.14.225/tcp/47534/p2p/16Uiu2HAm3HnGiSAGpnNorB1Qdj5Wio9Fu3YWWk8C4huwaqeL4BW6","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0","origin":"UnknownOrigin"}]'
2026-03-17 04:35:24.798 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13550/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:35:24.803 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.6.236/tcp/50450/p2p/16Uiu2HAm4Fp4ATe4mN8ZypgeuQj7CyLkzkCz5wUvCPx3hjK6qrph","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0","origin":"Discv5"},{"multiaddr":"/ip4/172.18.118.32/tcp/48320/p2p/16Uiu2HAm7nsmLpSSzgiMFQq8c422qiRJZ5ajLBMgydQSqsSfyfcY","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.207.138/tcp/38616/p2p/16Uiu2HAmRcTp6kZthpig582MMWTxqV9vonAap4BM4XyXKDffoJw5","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0","origin":"UnknownOrigin"}]'
2026-03-17 04:35:24.803 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45762/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:35:24.805 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.14.225/tcp/13551/p2p/16Uiu2HAm3HnGiSAGpnNorB1Qdj5Wio9Fu3YWWk8C4huwaqeL4BW6","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0,1],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0","origin":"Discv5"}]'
2026-03-17 04:35:24.805 DEBUG [src.libs.common] Sleeping for 50 seconds
2026-03-17 04:36:14.806 DEBUG [tests.e2e.test_e2e] Node1 publish message for topic /waku/2/rs/3/1
2026-03-17 04:36:14.806 DEBUG [src.steps.store] Relaying message
2026-03-17 04:36:14.807 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44509/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-17 04:36:14.816 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-17 04:36:14.818 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-17 04:36:15.023 DEBUG [src.libs.common] Sleeping for 4 seconds
2026-03-17 04:36:19.023 DEBUG [tests.e2e.test_e2e] Node6 inquery for filter messages on pubsubtopic /waku/2/rs/3/1 & contenttopic/test/1/waku-filter/proto
2026-03-17 04:36:19.024 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45762/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:36:19.026 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1773722174806651207,"ephemeral":false}]'
2026-03-17 04:36:19.027 DEBUG [tests.e2e.test_e2e] Filter inquiry response is [{'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1773722174806651207, 'ephemeral': False}]
2026-03-17 04:36:19.027 DEBUG [tests.e2e.test_e2e] Node5 goes live !!
2026-03-17 04:36:19.027 DEBUG [src.node.waku_node] Starting Node...
2026-03-17 04:36:19.027 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-17 04:36:19.029 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-17 04:36:19.029 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.54.186
2026-03-17 04:36:19.029 DEBUG [src.node.docker_mananger] Generated ports ['49784', '49785', '49786', '49787', '49788']
2026-03-17 04:36:19.029 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-17 04:36:19.029 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-17 04:36:19.029 DEBUG [src.node.waku_node] Using volumes []
2026-03-17 04:36:19.029 DEBUG [src.node.docker_mananger] docker run -i -t -p 49784:49784 -p 49785:49785 -p 49786:49786 -p 49787:49787 -p 49788:49788 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=49786 --rest-port=49784 --tcp-port=49785 --discv5-udp-port=49787 --rest-address=0.0.0.0 --nat=extip:172.18.54.186 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=62d39007cc83262d30e9d6afb01ec8e33a05b5c2d41e21b4c3eca25f246feba8 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=49788 --metrics-logging=true --relay=false --storenode=/ip4/172.18.14.225/tcp/13551/p2p/16Uiu2HAm3HnGiSAGpnNorB1Qdj5Wio9Fu3YWWk8C4huwaqeL4BW6 --discv5-bootstrap-node=enr:-L24QCfI4PguGzSXaYoEU1cNDQF39o0EXmUHCG-MV19ouYIBRI8NSN-vlKi3yqxSjEuu3iB88f324R1FDPTlTmqVvqUCgmlkgnY0gmlwhKwSDuGKbXVsdGlhZGRyc5YACASsEg7hBjTvAAoErBIO4QY08N0DgnJzhQADAQAAiXNlY3AyNTZrMaECdNf2ii9hRJt0HatJKkbu8e1a8-vRImJL_PulyrZBXUeDdGNwgjTvg3VkcII08YV3YWt1Mgc
2026-03-17 04:36:19.241 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.54.186 waku cd3146cf32fee7d918c4024eba4c78ee437b886972eea718ad7b0107ebd1d902
2026-03-17 04:36:19.276 DEBUG [src.node.docker_mananger] Container started with ID cd3146cf32fe. Setting up logs at ./log/docker/node5_2026-03-17_04-35-14__f4c5c0b2-cd37-4dc3-a3cf-e92078d6404e__wakuorg_nwaku:latest.log
2026-03-17 04:36:19.276 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 49784
2026-03-17 04:36:19.277 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-17 04:36:20.277 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:49784/health" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:36:20.280 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-17 04:36:20.280 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-17 04:36:20.281 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:49784/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:36:20.283 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.54.186/tcp/49785/p2p/16Uiu2HAmMqMfVjyPGddWSdzXQRXPRQ5UgpnSF3yyUanFLjgZ5Zzs","/ip4/172.18.54.186/tcp/49786/ws/p2p/16Uiu2HAmMqMfVjyPGddWSdzXQRXPRQ5UgpnSF3yyUanFLjgZ5Zzs"],"enrUri":"enr:-L24QGbma93Ztx5WjhHfCAjJtOsTA4Gluim5dr8gUgaCk2_CRbl-F2gfK2IN3zP7U69D8IxfuJjq-tSCVM6mLj9PM5UCgmlkgnY0gmlwhKwSNrqKbXVsdGlhZGRyc5YACASsEja6BsJ5AAoErBI2ugbCet0DgnJzhQADAQAAiXNlY3AyNTZrMaEDiGEXEzSt7rIyDPc-gY1z5BNY3ULNQfHn4jyScn_b8ZyDdGNwgsJ5g3VkcILCe4V3YWt1MgA"}'
2026-03-17 04:36:20.283 INFO [src.node.waku_node] REST service is ready !!
2026-03-17 04:36:20.283 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-17 04:36:22.283 DEBUG [tests.e2e.test_e2e] Node5 makes request to get stored messages
2026-03-17 04:36:22.284 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-17 04:36:22.284 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:49784/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F1&pageSize=50&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:36:22.331 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"fc3f361816501d7341b6","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0xfc918537e8d1753f6c6c450109fa22cb8b74f6ccae0dcdeca383e0b155b257ce"}]}'
2026-03-17 04:36:22.332 DEBUG [src.steps.store] messages length is 1
2026-03-17 04:36:22.340 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-17 04:36:22.341 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-17 04:36:22.341 DEBUG [src.node.waku_node] Stopping container with id 3401d6f38e2f
2026-03-17 04:36:22.953 DEBUG [src.node.waku_node] Container stopped.
2026-03-17 04:36:22.953 DEBUG [src.node.waku_node] Stopping container with id c982b5a7f1cf
2026-03-17 04:36:23.520 DEBUG [src.node.waku_node] Container stopped.
2026-03-17 04:36:23.521 DEBUG [src.node.waku_node] Stopping container with id 590a44edd406
2026-03-17 04:36:23.773 ERROR [src.node.docker_mananger] Max retries reached for container 3401d6f38e2f. Exiting log stream.
2026-03-17 04:36:24.109 DEBUG [src.node.waku_node] Container stopped.
2026-03-17 04:36:24.111 DEBUG [src.node.waku_node] Stopping container with id a5fdacb28199
2026-03-17 04:36:24.582 ERROR [src.node.docker_mananger] Max retries reached for container c982b5a7f1cf. Exiting log stream.
2026-03-17 04:36:24.675 DEBUG [src.node.waku_node] Container stopped.
2026-03-17 04:36:24.675 DEBUG [src.node.waku_node] Stopping container with id c8099c1aaf5e
2026-03-17 04:36:24.926 ERROR [src.node.docker_mananger] Max retries reached for container 590a44edd406. Exiting log stream.
2026-03-17 04:36:25.200 DEBUG [src.node.waku_node] Container stopped.
2026-03-17 04:36:25.202 DEBUG [src.node.waku_node] Stopping container with id cd3146cf32fe
2026-03-17 04:36:25.485 ERROR [src.node.docker_mananger] Max retries reached for container a5fdacb28199. Exiting log stream.
2026-03-17 04:36:25.738 DEBUG [src.node.waku_node] Container stopped.
2026-03-17 04:36:25.739 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-17 04:36:25.789 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-17 04:36:25.884 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-17 04:36:25.935 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-17 04:36:26.000 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-17 04:36:26.033 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-17 04:36:26.038 DEBUG [src.node.docker_mananger] No errors found in the waku logs.