163 lines
30 KiB
Plaintext
Raw Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

2026-04-22 23:58:28.626 INFO [tests.conftest] Fleet bootstrap inactive pass --fleet (or set FLEET_BOOTSTRAP=true) to connect local nodes to the waku.test fleet
2026-04-22 23:58:28.626 DEBUG [tests.conftest] Running fixture setup: test_id
2026-04-22 23:58:28.627 DEBUG [tests.conftest] Running test: test_store_no_peer_selected with id: 2026-04-22_23-58-28__f053c5ae-eda7-43af-ade6-a94410699e54
2026-04-22 23:58:28.627 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-04-22 23:58:28.627 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-04-22 23:58:28.627 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-04-22 23:58:28.634 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-22 23:58:28.635 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-04-22_23-58-28__f053c5ae-eda7-43af-ade6-a94410699e54__wakuorg_nwaku:latest.log
2026-04-22 23:58:28.640 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-22 23:58:28.640 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-04-22_23-58-28__f053c5ae-eda7-43af-ade6-a94410699e54__wakuorg_nwaku:latest.log
2026-04-22 23:58:28.645 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-22 23:58:28.645 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-04-22_23-58-28__f053c5ae-eda7-43af-ade6-a94410699e54__wakuorg_nwaku:latest.log
2026-04-22 23:58:28.645 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-04-22 23:58:28.645 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-04-22 23:58:28.646 DEBUG [tests.e2e.test_e2e] Start 5 nodes
2026-04-22 23:58:28.650 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-22 23:58:28.651 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-04-22_23-58-28__f053c5ae-eda7-43af-ade6-a94410699e54__wakuorg_nwaku:latest.log
2026-04-22 23:58:28.655 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-22 23:58:28.655 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-04-22_23-58-28__f053c5ae-eda7-43af-ade6-a94410699e54__wakuorg_nwaku:latest.log
2026-04-22 23:58:28.660 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-22 23:58:28.660 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-04-22_23-58-28__f053c5ae-eda7-43af-ade6-a94410699e54__wakuorg_nwaku:latest.log
2026-04-22 23:58:28.660 DEBUG [src.node.waku_node] Starting Node...
2026-04-22 23:58:28.660 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-22 23:58:28.908 DEBUG [src.node.docker_mananger] Network waku created
2026-04-22 23:58:28.909 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.0.11
2026-04-22 23:58:28.909 DEBUG [src.node.docker_mananger] Generated ports ['6690', '6691', '6692', '6693', '6694']
2026-04-22 23:58:28.909 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-22 23:58:28.909 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-22 23:58:28.909 DEBUG [src.node.waku_node] Using volumes []
2026-04-22 23:58:28.909 DEBUG [src.node.docker_mananger] docker run -i -t -p 6690:6690 -p 6691:6691 -p 6692:6692 -p 6693:6693 -p 6694:6694 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=6692 --rest-port=6690 --tcp-port=6691 --discv5-udp-port=6693 --rest-address=0.0.0.0 --nat=extip:172.18.0.11 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=3efcfafecaadcc2fbe7d1ca6fffd3b1ea00acf8efacfefb3fc1ac4ca9a0d645a --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=6694 --metrics-logging=true --relay=true --store=true
2026-04-22 23:58:37.795 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.0.11 waku 3c924d02358db8b2f6046d37754ec3dee02d921f27d00104bf82f8df5bb86e73
2026-04-22 23:58:37.968 DEBUG [src.node.docker_mananger] Container started with ID 3c924d02358d. Setting up logs at ./log/docker/node1_2026-04-22_23-58-28__f053c5ae-eda7-43af-ade6-a94410699e54__wakuorg_nwaku:latest.log
2026-04-22 23:58:37.969 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 6690
2026-04-22 23:58:37.969 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-22 23:58:38.969 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6690/health" -H "Content-Type: application/json" -d 'None'
2026-04-22 23:58:38.972 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-22 23:58:38.972 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-22 23:58:38.973 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6690/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-22 23:58:38.974 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.0.11/tcp/6691/p2p/16Uiu2HAm2PXYJJRccaDi8kznJn6WEkiyVpDAXtt3PcnM8A9bnoEh","/ip4/172.18.0.11/tcp/6692/ws/p2p/16Uiu2HAm2PXYJJRccaDi8kznJn6WEkiyVpDAXtt3PcnM8A9bnoEh"],"enrUri":"enr:-L24QKf8reNjnEiqiwPpGF6ssMI4TRKD6elAy6bCg3QEZ7kgaoecZz2MHHOgnMBKTniJNykLhiVW5j0hxRnZICrFOq0CgmlkgnY0gmlwhKwSAAuKbXVsdGlhZGRyc5YACASsEgALBhojAAoErBIACwYaJN0DgnJzhQDGAQAAiXNlY3AyNTZrMaECZ3UarpiFERtJ2vYr36BHOZaOV-fwEjIEherZIZ2rpXqDdGNwghojg3VkcIIaJYV3YWt1MgM"}'
2026-04-22 23:58:38.974 INFO [src.node.waku_node] REST service is ready !!
2026-04-22 23:58:38.975 DEBUG [src.node.waku_node] Starting Node...
2026-04-22 23:58:38.975 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-22 23:58:38.976 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-22 23:58:38.976 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.67.195
2026-04-22 23:58:38.976 DEBUG [src.node.docker_mananger] Generated ports ['12809', '12810', '12811', '12812', '12813']
2026-04-22 23:58:38.976 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-22 23:58:38.976 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-22 23:58:38.976 DEBUG [src.node.waku_node] Using volumes []
2026-04-22 23:58:38.976 DEBUG [src.node.docker_mananger] docker run -i -t -p 12809:12809 -p 12810:12810 -p 12811:12811 -p 12812:12812 -p 12813:12813 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=12811 --rest-port=12809 --tcp-port=12810 --discv5-udp-port=12812 --rest-address=0.0.0.0 --nat=extip:172.18.67.195 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=197b3567cdd4a5bed9a1bdaea0ac7dcd1cba13eadcf42b1d9822e9bb494b3fac --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=12813 --metrics-logging=true --store=false --relay=false --discv5-bootstrap-node=enr:-L24QKf8reNjnEiqiwPpGF6ssMI4TRKD6elAy6bCg3QEZ7kgaoecZz2MHHOgnMBKTniJNykLhiVW5j0hxRnZICrFOq0CgmlkgnY0gmlwhKwSAAuKbXVsdGlhZGRyc5YACASsEgALBhojAAoErBIACwYaJN0DgnJzhQDGAQAAiXNlY3AyNTZrMaECZ3UarpiFERtJ2vYr36BHOZaOV-fwEjIEherZIZ2rpXqDdGNwghojg3VkcIIaJYV3YWt1MgM
2026-04-22 23:58:40.077 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.67.195 waku b5c0b79e613d5d91c7aeebc66914c6e4a6e58b00f1d8d040a8d8cbb39d201fec
2026-04-22 23:58:40.869 DEBUG [src.node.docker_mananger] Container started with ID b5c0b79e613d. Setting up logs at ./log/docker/node2_2026-04-22_23-58-28__f053c5ae-eda7-43af-ade6-a94410699e54__wakuorg_nwaku:latest.log
2026-04-22 23:58:40.870 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 12809
2026-04-22 23:58:40.870 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-22 23:58:41.871 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12809/health" -H "Content-Type: application/json" -d 'None'
2026-04-22 23:58:41.874 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-22 23:58:41.874 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-22 23:58:41.874 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12809/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-22 23:58:41.876 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.67.195/tcp/12810/p2p/16Uiu2HAmD1MLg663rmDTiPDnStgbvKnGfcGXuFxhRK6bKe3dZrXA","/ip4/172.18.67.195/tcp/12811/ws/p2p/16Uiu2HAmD1MLg663rmDTiPDnStgbvKnGfcGXuFxhRK6bKe3dZrXA"],"enrUri":"enr:-L24QGwhuI0SlDDklEgdNHpeTEMzHpCtoDwzOYsQ9EN4k1VDQpd3kh3v3ELmxrvdEWc5aM9MU9G5qhoXg-_oYP9HUQ0CgmlkgnY0gmlwhKwSQ8OKbXVsdGlhZGRyc5YACASsEkPDBjIKAAoErBJDwwYyC90DgnJzhQDGAQAAiXNlY3AyNTZrMaEDBTdZVckr_Sh0zb7PBMt_Z5tC1RGcs5KvTvTY6LuigXmDdGNwgjIKg3VkcIIyDIV3YWt1MgA"}'
2026-04-22 23:58:41.876 INFO [src.node.waku_node] REST service is ready !!
2026-04-22 23:58:41.876 DEBUG [src.node.waku_node] Starting Node...
2026-04-22 23:58:41.876 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-22 23:58:41.877 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-22 23:58:41.877 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.159.225
2026-04-22 23:58:41.878 DEBUG [src.node.docker_mananger] Generated ports ['60274', '60275', '60276', '60277', '60278']
2026-04-22 23:58:41.878 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-22 23:58:41.878 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-22 23:58:41.878 DEBUG [src.node.waku_node] Using volumes []
2026-04-22 23:58:41.878 DEBUG [src.node.docker_mananger] docker run -i -t -p 60274:60274 -p 60275:60275 -p 60276:60276 -p 60277:60277 -p 60278:60278 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=60276 --rest-port=60274 --tcp-port=60275 --discv5-udp-port=60277 --rest-address=0.0.0.0 --nat=extip:172.18.159.225 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=f9a16aaebde1ea8dfb5f9f6a814ec2cbea53c08fcde6cc8d391bdbc3a5ae4c99 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=60278 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QGwhuI0SlDDklEgdNHpeTEMzHpCtoDwzOYsQ9EN4k1VDQpd3kh3v3ELmxrvdEWc5aM9MU9G5qhoXg-_oYP9HUQ0CgmlkgnY0gmlwhKwSQ8OKbXVsdGlhZGRyc5YACASsEkPDBjIKAAoErBJDwwYyC90DgnJzhQDGAQAAiXNlY3AyNTZrMaEDBTdZVckr_Sh0zb7PBMt_Z5tC1RGcs5KvTvTY6LuigXmDdGNwgjIKg3VkcIIyDIV3YWt1MgA
2026-04-22 23:58:42.484 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.159.225 waku 54a4cbdf368eb425bf8d1bec4471c420f436670ce0eab21e5d852dc76370a6f2
2026-04-22 23:58:42.513 DEBUG [src.node.docker_mananger] Container started with ID 54a4cbdf368e. Setting up logs at ./log/docker/node3_2026-04-22_23-58-28__f053c5ae-eda7-43af-ade6-a94410699e54__wakuorg_nwaku:latest.log
2026-04-22 23:58:42.513 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 60274
2026-04-22 23:58:42.514 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-22 23:58:43.514 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60274/health" -H "Content-Type: application/json" -d 'None'
2026-04-22 23:58:43.517 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-22 23:58:43.517 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-22 23:58:43.517 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60274/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-22 23:58:43.519 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.159.225/tcp/60275/p2p/16Uiu2HAm1GvVUdNgTM1bXtUuHMjBUYNggm2LWqf9pWCw4YmESiUD","/ip4/172.18.159.225/tcp/60276/ws/p2p/16Uiu2HAm1GvVUdNgTM1bXtUuHMjBUYNggm2LWqf9pWCw4YmESiUD"],"enrUri":"enr:-L24QFR-lJJT2lKZe0gsMwc41I7BEvJn_T5geohYa-dEiHRnL7C1dEKPn7l2mdu5sfMWxLTKA6yD1cY3UG6bpig0DRQCgmlkgnY0gmlwhKwSn-GKbXVsdGlhZGRyc5YACASsEp_hButzAAoErBKf4QbrdN0DgnJzhQDGAQAAiXNlY3AyNTZrMaECVuhNhLFqqGXxw1gwVOoBRsSrPZXNzkq0KL02o44QEWaDdGNwgutzg3VkcILrdYV3YWt1MgA"}'
2026-04-22 23:58:43.519 INFO [src.node.waku_node] REST service is ready !!
2026-04-22 23:58:43.519 DEBUG [src.node.waku_node] Starting Node...
2026-04-22 23:58:43.519 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-22 23:58:43.520 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-22 23:58:43.520 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.232.212
2026-04-22 23:58:43.520 DEBUG [src.node.docker_mananger] Generated ports ['24309', '24310', '24311', '24312', '24313']
2026-04-22 23:58:43.520 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-22 23:58:43.521 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-22 23:58:43.521 DEBUG [src.node.waku_node] Using volumes []
2026-04-22 23:58:43.521 DEBUG [src.node.docker_mananger] docker run -i -t -p 24309:24309 -p 24310:24310 -p 24311:24311 -p 24312:24312 -p 24313:24313 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=24311 --rest-port=24309 --tcp-port=24310 --discv5-udp-port=24312 --rest-address=0.0.0.0 --nat=extip:172.18.232.212 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=4d1fc95bad0faeebfcb4a5c21ced52e299deb2c3f50fcf889439b90d01a6bc4a --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=24313 --metrics-logging=true --relay=true --store=false --discv5-bootstrap-node=enr:-L24QFR-lJJT2lKZe0gsMwc41I7BEvJn_T5geohYa-dEiHRnL7C1dEKPn7l2mdu5sfMWxLTKA6yD1cY3UG6bpig0DRQCgmlkgnY0gmlwhKwSn-GKbXVsdGlhZGRyc5YACASsEp_hButzAAoErBKf4QbrdN0DgnJzhQDGAQAAiXNlY3AyNTZrMaECVuhNhLFqqGXxw1gwVOoBRsSrPZXNzkq0KL02o44QEWaDdGNwgutzg3VkcILrdYV3YWt1MgA
2026-04-22 23:58:43.921 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.232.212 waku 5e3578d55b32ad88909cfcbdacef6636c931f533f1573900dd4b0b48266c9c9a
2026-04-22 23:58:43.945 DEBUG [src.node.docker_mananger] Container started with ID 5e3578d55b32. Setting up logs at ./log/docker/node3_2026-04-22_23-58-28__f053c5ae-eda7-43af-ade6-a94410699e54__wakuorg_nwaku:latest.log
2026-04-22 23:58:43.945 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 24309
2026-04-22 23:58:43.945 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-22 23:58:44.946 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24309/health" -H "Content-Type: application/json" -d 'None'
2026-04-22 23:58:44.948 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-22 23:58:44.948 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-22 23:58:44.948 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24309/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-22 23:58:44.950 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.232.212/tcp/24310/p2p/16Uiu2HAm9wJ1Me2iuTpnPQnfmpatWsNoHygyTM2m713QHcjszWSQ","/ip4/172.18.232.212/tcp/24311/ws/p2p/16Uiu2HAm9wJ1Me2iuTpnPQnfmpatWsNoHygyTM2m713QHcjszWSQ"],"enrUri":"enr:-L24QKMis69giLxwNhmZ-CsU2z0kNFPCb5UUkMJ7TrrEChS6Gt9TEeSewb7OEUUILogW4E6pl_y7HupCJO65gv_reRACgmlkgnY0gmlwhKwS6NSKbXVsdGlhZGRyc5YACASsEujUBl72AAoErBLo1AZe990DgnJzhQDGAQAAiXNlY3AyNTZrMaEC15oyPHVDc6-PRRZ-sE0ZSqHVUVGGYYbwgrxcDlmKbN2DdGNwgl72g3VkcIJe-IV3YWt1MgE"}'
2026-04-22 23:58:44.950 INFO [src.node.waku_node] REST service is ready !!
2026-04-22 23:58:44.951 DEBUG [src.node.waku_node] Starting Node...
2026-04-22 23:58:44.951 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-22 23:58:44.952 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-22 23:58:44.952 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.160.69
2026-04-22 23:58:44.952 DEBUG [src.node.docker_mananger] Generated ports ['32500', '32501', '32502', '32503', '32504']
2026-04-22 23:58:44.952 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-22 23:58:44.952 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-22 23:58:44.952 DEBUG [src.node.waku_node] Using volumes []
2026-04-22 23:58:44.952 DEBUG [src.node.docker_mananger] docker run -i -t -p 32500:32500 -p 32501:32501 -p 32502:32502 -p 32503:32503 -p 32504:32504 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=32502 --rest-port=32500 --tcp-port=32501 --discv5-udp-port=32503 --rest-address=0.0.0.0 --nat=extip:172.18.160.69 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=ec9b381508fa000d457dea87ef91b6f95ba28dad4d2ac5174be26ce6aedc1cd7 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=32504 --metrics-logging=true --relay=false --store=false --discv5-bootstrap-node=enr:-L24QKMis69giLxwNhmZ-CsU2z0kNFPCb5UUkMJ7TrrEChS6Gt9TEeSewb7OEUUILogW4E6pl_y7HupCJO65gv_reRACgmlkgnY0gmlwhKwS6NSKbXVsdGlhZGRyc5YACASsEujUBl72AAoErBLo1AZe990DgnJzhQDGAQAAiXNlY3AyNTZrMaEC15oyPHVDc6-PRRZ-sE0ZSqHVUVGGYYbwgrxcDlmKbN2DdGNwgl72g3VkcIJe-IV3YWt1MgE
2026-04-22 23:58:45.674 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.160.69 waku 782806bf2ff1496000720fbd8adb17aa740df22779933edd7bbd0f2d529261ad
2026-04-22 23:58:45.700 DEBUG [src.node.docker_mananger] Container started with ID 782806bf2ff1. Setting up logs at ./log/docker/node4_2026-04-22_23-58-28__f053c5ae-eda7-43af-ade6-a94410699e54__wakuorg_nwaku:latest.log
2026-04-22 23:58:45.701 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 32500
2026-04-22 23:58:45.701 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-22 23:58:46.701 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32500/health" -H "Content-Type: application/json" -d 'None'
2026-04-22 23:58:46.704 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-22 23:58:46.704 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-22 23:58:46.704 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32500/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-22 23:58:46.706 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.160.69/tcp/32501/p2p/16Uiu2HAmABpRbWcCTzNq5cfo3rMS2mrQAWti9mznRTw8HazqpBkL","/ip4/172.18.160.69/tcp/32502/ws/p2p/16Uiu2HAmABpRbWcCTzNq5cfo3rMS2mrQAWti9mznRTw8HazqpBkL"],"enrUri":"enr:-L24QGwgdLqOBDwAv2gBY-4tqF8G55fbivBHexQNjlfed4gLecJIkFiJ3Vd1fAWS6JSWGZG9psVIZRJhO21VB-BcRXICgmlkgnY0gmlwhKwSoEWKbXVsdGlhZGRyc5YACASsEqBFBn71AAoErBKgRQZ-9t0DgnJzhQDGAQAAiXNlY3AyNTZrMaEC21K4oTt45qBnXIs0mX1GyxeedrP4gGinnTILU_2Yb3GDdGNwgn71g3VkcIJ-94V3YWt1MgA"}'
2026-04-22 23:58:46.706 INFO [src.node.waku_node] REST service is ready !!
2026-04-22 23:58:46.706 DEBUG [tests.e2e.test_e2e] Add 3 peer nodes to node3
2026-04-22 23:58:46.706 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:60274/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.0.11/tcp/6691/p2p/16Uiu2HAm2PXYJJRccaDi8kznJn6WEkiyVpDAXtt3PcnM8A9bnoEh"]'
2026-04-22 23:58:46.725 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-22 23:58:46.726 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:60274/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.67.195/tcp/12810/p2p/16Uiu2HAmD1MLg663rmDTiPDnStgbvKnGfcGXuFxhRK6bKe3dZrXA"]'
2026-04-22 23:58:46.744 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-22 23:58:46.745 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:60274/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.232.212/tcp/24310/p2p/16Uiu2HAm9wJ1Me2iuTpnPQnfmpatWsNoHygyTM2m713QHcjszWSQ"]'
2026-04-22 23:58:46.749 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-22 23:58:46.750 DEBUG [tests.e2e.test_e2e] Subscribe nodes 1,2 to relay on pubsubtopic /waku/2/rs/198/1
2026-04-22 23:58:46.750 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24309/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/1"]'
2026-04-22 23:58:46.752 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-22 23:58:46.752 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:6690/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/1"]'
2026-04-22 23:58:46.754 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-22 23:58:46.755 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6690/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-04-22 23:58:46.757 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.159.225/tcp/34632/p2p/16Uiu2HAm1GvVUdNgTM1bXtUuHMjBUYNggm2LWqf9pWCw4YmESiUD","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-\\"v0.38.0-18-gbb8a7e\\"","origin":"UnknownOrigin"}]'
2026-04-22 23:58:46.757 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24309/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-04-22 23:58:46.758 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.159.225/tcp/60275/p2p/16Uiu2HAm1GvVUdNgTM1bXtUuHMjBUYNggm2LWqf9pWCw4YmESiUD","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-\\"v0.38.0-18-gbb8a7e\\"","origin":"Discv5"}]'
2026-04-22 23:58:46.759 DEBUG [src.libs.common] Sleeping for 30 seconds
2026-04-22 23:59:16.759 DEBUG [tests.e2e.test_e2e] Node1 publish message
2026-04-22 23:59:16.759 DEBUG [src.steps.store] Relaying message
2026-04-22 23:59:16.760 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24309/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-04-22 23:59:16.764 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-22 23:59:16.764 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-04-22 23:59:16.965 DEBUG [tests.e2e.test_e2e] Check if node3 can inquiry stored message without stor peer specified
2026-04-22 23:59:16.965 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60274/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F198%2F1&contentTopics=%2Ftest%2F1%2Fwaku-filter%2Fproto&pageSize=5&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-04-22 23:59:16.972 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"71e587cef1e49613ec9e","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0xe4cb9fcff981c513633bf357d031a51f02dd04fcd9cdbfa34f8cae4fe80d51dd"}]}'
2026-04-22 23:59:16.975 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-04-22 23:59:16.976 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-04-22 23:59:16.976 DEBUG [src.node.waku_node] Stopping container with id 3c924d02358d
2026-04-22 23:59:17.588 DEBUG [src.node.waku_node] Container stopped.
2026-04-22 23:59:17.589 DEBUG [src.node.waku_node] Stopping container with id b5c0b79e613d
2026-04-22 23:59:18.440 ERROR [src.node.docker_mananger] Max retries reached for container 3c924d02358d. Exiting log stream.
2026-04-22 23:59:19.658 DEBUG [src.node.waku_node] Container stopped.
2026-04-22 23:59:19.660 DEBUG [src.node.waku_node] Stopping container with id 54a4cbdf368e
2026-04-22 23:59:20.469 ERROR [src.node.docker_mananger] Max retries reached for container b5c0b79e613d. Exiting log stream.
2026-04-22 23:59:20.653 DEBUG [src.node.waku_node] Container stopped.
2026-04-22 23:59:20.653 DEBUG [src.node.waku_node] Stopping container with id 5e3578d55b32
2026-04-22 23:59:21.463 ERROR [src.node.docker_mananger] Max retries reached for container 54a4cbdf368e. Exiting log stream.
2026-04-22 23:59:21.487 DEBUG [src.node.waku_node] Container stopped.
2026-04-22 23:59:21.487 DEBUG [src.node.waku_node] Stopping container with id 782806bf2ff1
2026-04-22 23:59:22.054 DEBUG [src.node.waku_node] Container stopped.
2026-04-22 23:59:22.056 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-04-22 23:59:22.097 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-22 23:59:22.107 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-22 23:59:22.131 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-22 23:59:22.155 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-22 23:59:22.156 DEBUG [src.node.docker_mananger] No errors found in the waku logs.