2026-02-25 19:46:01 +00:00

162 lines
30 KiB
Plaintext

2026-02-25 19:27:57.411 DEBUG [tests.conftest] Running fixture setup: test_id
2026-02-25 19:27:57.412 DEBUG [tests.conftest] Running test: test_store_no_peer_selected with id: 2026-02-25_19-27-57__54f30d5f-a163-4225-990e-3fa5627e08f4
2026-02-25 19:27:57.412 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-02-25 19:27:57.413 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-02-25 19:27:57.413 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-02-25 19:27:57.428 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 19:27:57.429 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-02-25_19-27-57__54f30d5f-a163-4225-990e-3fa5627e08f4__wakuorg_nwaku:latest.log
2026-02-25 19:27:57.435 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 19:27:57.435 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-02-25_19-27-57__54f30d5f-a163-4225-990e-3fa5627e08f4__wakuorg_nwaku:latest.log
2026-02-25 19:27:57.442 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 19:27:57.442 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-02-25_19-27-57__54f30d5f-a163-4225-990e-3fa5627e08f4__wakuorg_nwaku:latest.log
2026-02-25 19:27:57.442 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-02-25 19:27:57.442 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-02-25 19:27:57.443 DEBUG [tests.e2e.test_e2e] Start 5 nodes
2026-02-25 19:27:57.449 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 19:27:57.449 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-02-25_19-27-57__54f30d5f-a163-4225-990e-3fa5627e08f4__wakuorg_nwaku:latest.log
2026-02-25 19:27:57.455 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 19:27:57.455 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-02-25_19-27-57__54f30d5f-a163-4225-990e-3fa5627e08f4__wakuorg_nwaku:latest.log
2026-02-25 19:27:57.460 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 19:27:57.461 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-02-25_19-27-57__54f30d5f-a163-4225-990e-3fa5627e08f4__wakuorg_nwaku:latest.log
2026-02-25 19:27:57.461 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 19:27:57.461 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 19:27:57.505 DEBUG [src.node.docker_mananger] Network waku created
2026-02-25 19:27:57.505 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.44.83
2026-02-25 19:27:57.505 DEBUG [src.node.docker_mananger] Generated ports ['23612', '23613', '23614', '23615', '23616']
2026-02-25 19:27:57.505 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 19:27:57.506 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 19:27:57.506 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 19:27:57.506 DEBUG [src.node.docker_mananger] docker run -i -t -p 23612:23612 -p 23613:23613 -p 23614:23614 -p 23615:23615 -p 23616:23616 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=23614 --rest-port=23612 --tcp-port=23613 --discv5-udp-port=23615 --rest-address=0.0.0.0 --nat=extip:172.18.44.83 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=a561e5f38beacaeee99bce575fe23a6c5de2ed85393a0cfebffc2f1ee2eb9b62 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=23616 --metrics-logging=true --relay=true --store=true
2026-02-25 19:28:01.480 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.44.83 waku d436bc364cf33200390a7890c1d2f9b07d149003eb5b0175cbb491b26caf98e5
2026-02-25 19:28:01.518 DEBUG [src.node.docker_mananger] Container started with ID d436bc364cf3. Setting up logs at ./log/docker/node1_2026-02-25_19-27-57__54f30d5f-a163-4225-990e-3fa5627e08f4__wakuorg_nwaku:latest.log
2026-02-25 19:28:01.518 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 23612
2026-02-25 19:28:01.518 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 19:28:02.519 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:23612/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 19:28:02.522 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 19:28:02.523 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 19:28:02.523 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:23612/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 19:28:02.525 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.44.83/tcp/23613/p2p/16Uiu2HAmCBDZXqtTD3sKht73Rwxprap1745K5Vd4vc6riPLpb23F","/ip4/172.18.44.83/tcp/23614/ws/p2p/16Uiu2HAmCBDZXqtTD3sKht73Rwxprap1745K5Vd4vc6riPLpb23F"],"enrUri":"enr:-L24QBEOO1Dkd-EqoX558v-t7KgfLrB6BZmhDj8NUw5cl9NyMj6lgCaSRD2Hebhn2aoRsyw0hrw162EDuyZ7Uuhc174CgmlkgnY0gmlwhKwSLFOKbXVsdGlhZGRyc5YACASsEixTBlw9AAoErBIsUwZcPt0DgnJzhQADAQAAiXNlY3AyNTZrMaEC-OKs132OIMzPJK6LLPtTtY-tA3zcN8Tps7PfIU79NsaDdGNwglw9g3VkcIJcP4V3YWt1MgM"}'
2026-02-25 19:28:02.525 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 19:28:02.525 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 19:28:02.526 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 19:28:02.527 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 19:28:02.527 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.141.119
2026-02-25 19:28:02.527 DEBUG [src.node.docker_mananger] Generated ports ['57360', '57361', '57362', '57363', '57364']
2026-02-25 19:28:02.527 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 19:28:02.528 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 19:28:02.528 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 19:28:02.528 DEBUG [src.node.docker_mananger] docker run -i -t -p 57360:57360 -p 57361:57361 -p 57362:57362 -p 57363:57363 -p 57364:57364 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=57362 --rest-port=57360 --tcp-port=57361 --discv5-udp-port=57363 --rest-address=0.0.0.0 --nat=extip:172.18.141.119 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=e9cceace9cca4e8ffefbdd2a9ff9b14982823ea8b76d1b15d1aa6cbcd2c8fc13 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=57364 --metrics-logging=true --store=false --relay=false --discv5-bootstrap-node=enr:-L24QBEOO1Dkd-EqoX558v-t7KgfLrB6BZmhDj8NUw5cl9NyMj6lgCaSRD2Hebhn2aoRsyw0hrw162EDuyZ7Uuhc174CgmlkgnY0gmlwhKwSLFOKbXVsdGlhZGRyc5YACASsEixTBlw9AAoErBIsUwZcPt0DgnJzhQADAQAAiXNlY3AyNTZrMaEC-OKs132OIMzPJK6LLPtTtY-tA3zcN8Tps7PfIU79NsaDdGNwglw9g3VkcIJcP4V3YWt1MgM
2026-02-25 19:28:02.723 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.141.119 waku 701ed05286be343ed8ae2055ab3c4bf0a3103fc5dbbc8a77e7c9c1aa8058f732
2026-02-25 19:28:02.758 DEBUG [src.node.docker_mananger] Container started with ID 701ed05286be. Setting up logs at ./log/docker/node2_2026-02-25_19-27-57__54f30d5f-a163-4225-990e-3fa5627e08f4__wakuorg_nwaku:latest.log
2026-02-25 19:28:02.758 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 57360
2026-02-25 19:28:02.759 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 19:28:03.759 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57360/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 19:28:03.763 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 19:28:03.763 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 19:28:03.763 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57360/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 19:28:03.766 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.141.119/tcp/57361/p2p/16Uiu2HAmRHjkNrkvLj9wY8pWjvrbas74oG5YRdpqkP2CNu4TujPC","/ip4/172.18.141.119/tcp/57362/ws/p2p/16Uiu2HAmRHjkNrkvLj9wY8pWjvrbas74oG5YRdpqkP2CNu4TujPC"],"enrUri":"enr:-L24QE6SSdio4NfNIfWxUvlxNXKhaUCaDOLIAabOZ1Mjk02vT1-LZ4s0QqBzjjhj1znxj4LQIX2eRfn2AVHvU3XE4BUCgmlkgnY0gmlwhKwSjXeKbXVsdGlhZGRyc5YACASsEo13BuARAAoErBKNdwbgEt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDu7Y4-8sGZTZRaGTSESCHtPJzjDkOxb2YLrrDshr-iA-DdGNwguARg3VkcILgE4V3YWt1MgA"}'
2026-02-25 19:28:03.766 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 19:28:03.766 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 19:28:03.766 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 19:28:03.768 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 19:28:03.768 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.59.140
2026-02-25 19:28:03.768 DEBUG [src.node.docker_mananger] Generated ports ['56732', '56733', '56734', '56735', '56736']
2026-02-25 19:28:03.768 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 19:28:03.768 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 19:28:03.768 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 19:28:03.768 DEBUG [src.node.docker_mananger] docker run -i -t -p 56732:56732 -p 56733:56733 -p 56734:56734 -p 56735:56735 -p 56736:56736 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=56734 --rest-port=56732 --tcp-port=56733 --discv5-udp-port=56735 --rest-address=0.0.0.0 --nat=extip:172.18.59.140 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=bfb0feddfae7f9e940b058a1ac743b00bb37a8634d9fe2ed4c6d890864df03de --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=56736 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QE6SSdio4NfNIfWxUvlxNXKhaUCaDOLIAabOZ1Mjk02vT1-LZ4s0QqBzjjhj1znxj4LQIX2eRfn2AVHvU3XE4BUCgmlkgnY0gmlwhKwSjXeKbXVsdGlhZGRyc5YACASsEo13BuARAAoErBKNdwbgEt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDu7Y4-8sGZTZRaGTSESCHtPJzjDkOxb2YLrrDshr-iA-DdGNwguARg3VkcILgE4V3YWt1MgA
2026-02-25 19:28:03.957 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.59.140 waku 43c98a962b1225c5e544d63a23c0dbf12e34bd3e6200f9e7fae1eca88eec6fd0
2026-02-25 19:28:03.993 DEBUG [src.node.docker_mananger] Container started with ID 43c98a962b12. Setting up logs at ./log/docker/node3_2026-02-25_19-27-57__54f30d5f-a163-4225-990e-3fa5627e08f4__wakuorg_nwaku:latest.log
2026-02-25 19:28:03.993 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 56732
2026-02-25 19:28:03.994 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 19:28:04.995 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56732/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 19:28:04.998 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 19:28:04.998 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 19:28:04.998 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56732/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 19:28:05.000 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.59.140/tcp/56733/p2p/16Uiu2HAmLtkP76S1Wvq4K6PY9MtgKhGjg5bn8C2Md3DovwA34duz","/ip4/172.18.59.140/tcp/56734/ws/p2p/16Uiu2HAmLtkP76S1Wvq4K6PY9MtgKhGjg5bn8C2Md3DovwA34duz"],"enrUri":"enr:-L24QBKd7j90j42DJ7rMORIKilfsSJ0Tk7BYOAWYltg_KH1EASiZI8jdtBX_a3y0DNkBvGjturx2tEJNEl729QF0phACgmlkgnY0gmlwhKwSO4yKbXVsdGlhZGRyc5YACASsEjuMBt2dAAoErBI7jAbdnt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDemPVEPgxj6YN6ZLLMoPjFfohjPmq6nCILTkycQf2HEmDdGNwgt2dg3VkcILdn4V3YWt1MgA"}'
2026-02-25 19:28:05.001 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 19:28:05.001 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 19:28:05.001 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 19:28:05.002 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 19:28:05.002 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.94.144
2026-02-25 19:28:05.003 DEBUG [src.node.docker_mananger] Generated ports ['61250', '61251', '61252', '61253', '61254']
2026-02-25 19:28:05.003 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 19:28:05.003 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 19:28:05.003 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 19:28:05.003 DEBUG [src.node.docker_mananger] docker run -i -t -p 61250:61250 -p 61251:61251 -p 61252:61252 -p 61253:61253 -p 61254:61254 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=61252 --rest-port=61250 --tcp-port=61251 --discv5-udp-port=61253 --rest-address=0.0.0.0 --nat=extip:172.18.94.144 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=f9db27b9aab9ddaf023f8caef95be57e44ec3bc3ad086c79ee97f56fcf2bb7d4 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=61254 --metrics-logging=true --relay=true --store=false --discv5-bootstrap-node=enr:-L24QBKd7j90j42DJ7rMORIKilfsSJ0Tk7BYOAWYltg_KH1EASiZI8jdtBX_a3y0DNkBvGjturx2tEJNEl729QF0phACgmlkgnY0gmlwhKwSO4yKbXVsdGlhZGRyc5YACASsEjuMBt2dAAoErBI7jAbdnt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDemPVEPgxj6YN6ZLLMoPjFfohjPmq6nCILTkycQf2HEmDdGNwgt2dg3VkcILdn4V3YWt1MgA
2026-02-25 19:28:05.210 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.94.144 waku 68f6eea92ebe254dd475ae72b7cbaf6c78661abd3a6483e3ca62de9bc78796bc
2026-02-25 19:28:05.244 DEBUG [src.node.docker_mananger] Container started with ID 68f6eea92ebe. Setting up logs at ./log/docker/node3_2026-02-25_19-27-57__54f30d5f-a163-4225-990e-3fa5627e08f4__wakuorg_nwaku:latest.log
2026-02-25 19:28:05.244 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 61250
2026-02-25 19:28:05.245 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 19:28:06.246 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61250/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 19:28:06.262 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 19:28:06.264 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 19:28:06.270 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61250/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 19:28:06.277 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.94.144/tcp/61251/p2p/16Uiu2HAmRp3qCz58nGiEciKcHLHHK2vgLKfi9Rp4k569SahHvn8R","/ip4/172.18.94.144/tcp/61252/ws/p2p/16Uiu2HAmRp3qCz58nGiEciKcHLHHK2vgLKfi9Rp4k569SahHvn8R"],"enrUri":"enr:-L24QNj6_w9STbrxut95dp1mJiWMvTXVM7ZRTdMfJdOqhkIjcGa_bAuAKYLebZfyo3TwcMomQVS6Iq9Y8J-AxF7z4TMCgmlkgnY0gmlwhKwSXpCKbXVsdGlhZGRyc5YACASsEl6QBu9DAAoErBJekAbvRN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDw3oX-7rOwwwdFcpjFeLRzsNg6Me4HaYf1dmnQFFFJAqDdGNwgu9Dg3VkcILvRYV3YWt1MgE"}'
2026-02-25 19:28:06.277 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 19:28:06.278 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 19:28:06.278 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 19:28:06.279 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 19:28:06.280 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.63.76
2026-02-25 19:28:06.280 DEBUG [src.node.docker_mananger] Generated ports ['4423', '4424', '4425', '4426', '4427']
2026-02-25 19:28:06.280 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 19:28:06.280 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 19:28:06.280 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 19:28:06.280 DEBUG [src.node.docker_mananger] docker run -i -t -p 4423:4423 -p 4424:4424 -p 4425:4425 -p 4426:4426 -p 4427:4427 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=4425 --rest-port=4423 --tcp-port=4424 --discv5-udp-port=4426 --rest-address=0.0.0.0 --nat=extip:172.18.63.76 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=3c4f3501e251034efa91a4a4bfba4a1eaa9c7a18c4609ed4a755a8dfd5effc37 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=4427 --metrics-logging=true --relay=false --store=false --discv5-bootstrap-node=enr:-L24QNj6_w9STbrxut95dp1mJiWMvTXVM7ZRTdMfJdOqhkIjcGa_bAuAKYLebZfyo3TwcMomQVS6Iq9Y8J-AxF7z4TMCgmlkgnY0gmlwhKwSXpCKbXVsdGlhZGRyc5YACASsEl6QBu9DAAoErBJekAbvRN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDw3oX-7rOwwwdFcpjFeLRzsNg6Me4HaYf1dmnQFFFJAqDdGNwgu9Dg3VkcILvRYV3YWt1MgE
2026-02-25 19:28:06.476 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.63.76 waku 707ca17ca395445a3d6aa0089b5b23a24502ef970e9cea2946fa3fd01f0e9d04
2026-02-25 19:28:06.511 DEBUG [src.node.docker_mananger] Container started with ID 707ca17ca395. Setting up logs at ./log/docker/node4_2026-02-25_19-27-57__54f30d5f-a163-4225-990e-3fa5627e08f4__wakuorg_nwaku:latest.log
2026-02-25 19:28:06.511 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 4423
2026-02-25 19:28:06.512 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 19:28:07.513 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:4423/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 19:28:07.516 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 19:28:07.516 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 19:28:07.516 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:4423/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 19:28:07.519 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.63.76/tcp/4424/p2p/16Uiu2HAm5izkNpowos11BcTmsfgxyiKchS24ARMxWRdUNv7NwvzS","/ip4/172.18.63.76/tcp/4425/ws/p2p/16Uiu2HAm5izkNpowos11BcTmsfgxyiKchS24ARMxWRdUNv7NwvzS"],"enrUri":"enr:-L24QLmOdBLJCOA9xwGbk1oM88T0ebDR0U8GwK133iHesayPXqoYICQuxghejgmpxlg9G_bmNEmXjU4dxTAh3BTuvt8CgmlkgnY0gmlwhKwSP0yKbXVsdGlhZGRyc5YACASsEj9MBhFIAAoErBI_TAYRSd0DgnJzhQADAQAAiXNlY3AyNTZrMaECmQT2_2ek9t8W6e96s8lSwTOVl7wjOqJYIrLg97HuYLeDdGNwghFIg3VkcIIRSoV3YWt1MgA"}'
2026-02-25 19:28:07.519 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 19:28:07.519 DEBUG [tests.e2e.test_e2e] Add 3 peer nodes to node3
2026-02-25 19:28:07.520 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:56732/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.44.83/tcp/23613/p2p/16Uiu2HAmCBDZXqtTD3sKht73Rwxprap1745K5Vd4vc6riPLpb23F"]'
2026-02-25 19:28:07.543 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 19:28:07.544 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:56732/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.141.119/tcp/57361/p2p/16Uiu2HAmRHjkNrkvLj9wY8pWjvrbas74oG5YRdpqkP2CNu4TujPC"]'
2026-02-25 19:28:07.570 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 19:28:07.571 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:56732/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.94.144/tcp/61251/p2p/16Uiu2HAmRp3qCz58nGiEciKcHLHHK2vgLKfi9Rp4k569SahHvn8R"]'
2026-02-25 19:28:07.578 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 19:28:07.579 DEBUG [tests.e2e.test_e2e] Subscribe nodes 1,2 to relay on pubsubtopic /waku/2/rs/3/1
2026-02-25 19:28:07.580 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61250/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-25 19:28:07.587 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 19:28:07.587 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:23612/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-25 19:28:07.594 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 19:28:07.599 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:23612/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-25 19:28:07.604 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.59.140/tcp/38908/p2p/16Uiu2HAmLtkP76S1Wvq4K6PY9MtgKhGjg5bn8C2Md3DovwA34duz","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"UnknownOrigin"}]'
2026-02-25 19:28:07.604 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61250/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-25 19:28:07.607 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.59.140/tcp/56733/p2p/16Uiu2HAmLtkP76S1Wvq4K6PY9MtgKhGjg5bn8C2Md3DovwA34duz","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"Discv5"}]'
2026-02-25 19:28:07.608 DEBUG [src.libs.common] Sleeping for 30 seconds
2026-02-25 19:28:37.608 DEBUG [tests.e2e.test_e2e] Node1 publish message
2026-02-25 19:28:37.608 DEBUG [src.steps.store] Relaying message
2026-02-25 19:28:37.609 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61250/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 19:28:37.614 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 19:28:37.616 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 19:28:37.816 DEBUG [tests.e2e.test_e2e] Check if node3 can inquiry stored message without stor peer specified
2026-02-25 19:28:37.816 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56732/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F1&contentTopics=%2Ftest%2F1%2Fwaku-filter%2Fproto&pageSize=5&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-02-25 19:28:37.825 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"e9d32875e870fabf61c5","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x34c99fffd22b199b2955e2438f5ff4aa15a8909e6b00e945039820eaec1d25f2"}]}'
2026-02-25 19:28:37.828 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-02-25 19:28:37.829 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-02-25 19:28:37.829 DEBUG [src.node.waku_node] Stopping container with id d436bc364cf3
2026-02-25 19:28:38.395 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 19:28:38.395 DEBUG [src.node.waku_node] Stopping container with id 701ed05286be
2026-02-25 19:28:38.974 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 19:28:38.975 DEBUG [src.node.waku_node] Stopping container with id 43c98a962b12
2026-02-25 19:28:39.291 ERROR [src.node.docker_mananger] Max retries reached for container d436bc364cf3. Exiting log stream.
2026-02-25 19:28:39.515 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 19:28:39.518 DEBUG [src.node.waku_node] Stopping container with id 68f6eea92ebe
2026-02-25 19:28:39.787 ERROR [src.node.docker_mananger] Max retries reached for container 701ed05286be. Exiting log stream.
2026-02-25 19:28:40.053 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 19:28:40.053 DEBUG [src.node.waku_node] Stopping container with id 707ca17ca395
2026-02-25 19:28:40.329 ERROR [src.node.docker_mananger] Max retries reached for container 43c98a962b12. Exiting log stream.
2026-02-25 19:28:40.620 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 19:28:40.622 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-02-25 19:28:40.663 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 19:28:40.674 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 19:28:40.698 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 19:28:40.722 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 19:28:40.724 DEBUG [src.node.docker_mananger] No errors found in the waku logs.