178 lines
34 KiB
Plaintext
Raw Blame History

This file contains invisible Unicode characters

This file contains invisible Unicode characters that are indistinguishable to humans but may be processed differently by a computer. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

DEBUG  tests.conftest:conftest.py:51 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:57 Running test: test_multiple_edge_service_nodes_communication with id: 2025-12-22_04-17-24__8ec3b716-3e0f-467c-9fcc-21cce2265019
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.steps.filter:filter.py:28 Running fixture setup: filter_setup
DEBUG  src.steps.light_push:light_push.py:28 Running fixture setup: light_push_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node1_2025-12-22_04-17-24__8ec3b716-3e0f-467c-9fcc-21cce2265019__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node2_2025-12-22_04-17-24__8ec3b716-3e0f-467c-9fcc-21cce2265019__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node3_2025-12-22_04-17-24__8ec3b716-3e0f-467c-9fcc-21cce2265019__wakuorg_nwaku:latest.log
DEBUG  src.steps.relay:relay.py:28 Running fixture setup: relay_setup
DEBUG  src.steps.store:store.py:31 Running fixture setup: store_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node4_2025-12-22_04-17-24__8ec3b716-3e0f-467c-9fcc-21cce2265019__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node5_2025-12-22_04-17-24__8ec3b716-3e0f-467c-9fcc-21cce2265019__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node6_2025-12-22_04-17-24__8ec3b716-3e0f-467c-9fcc-21cce2265019__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node7_2025-12-22_04-17-24__8ec3b716-3e0f-467c-9fcc-21cce2265019__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node8_2025-12-22_04-17-24__8ec3b716-3e0f-467c-9fcc-21cce2265019__wakuorg_nwaku:latest.log
DEBUG  tests.e2e.test_e2e:test_e2e.py:434 Start 2 edges nodes and 3 service nodes
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:33 Network waku created
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.56.201
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['32112', '32113', '32114', '32115', '32116']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 32112:32112 -p 32113:32113 -p 32114:32114 -p 32115:32115 -p 32116:32116 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=32114 --rest-port=32112 --tcp-port=32113 --discv5-udp-port=32115 --rest-address=0.0.0.0 --nat=extip:172.18.56.201 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=d484be6b1dbe74d1f2684de3916c79cad2801be6de9887f98ffd7dc9fefcc2f8 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=32116 --metrics-logging=true --relay=true --store=true --lightpush=true
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.56.201 waku 1779b06bf56aab06a345fb3b5281f4da98c2921c6a0262e2d19a643f376fd924
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 1779b06bf56a. Setting up logs at ./log/docker/node6_2025-12-22_04-17-24__8ec3b716-3e0f-467c-9fcc-21cce2265019__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 32112
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:32112/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:32112/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.56.201/tcp/32113/p2p/16Uiu2HAm7KoF9m1cDh1xQYBgeARhoyeiD71wvteMaLbsJkyVGzNa","/ip4/172.18.56.201/tcp/32114/ws/p2p/16Uiu2HAm7KoF9m1cDh1xQYBgeARhoyeiD71wvteMaLbsJkyVGzNa"],"enrUri":"enr:-L24QBwUX7OxBcaxVIMnf-5IofO8Q30M8ryOwRowFBJ-zxUAGL-hXgtjsgcqdIXhpMZqmP-aGqyAf_6CqTO5XBKtk7kCgmlkgnY0gmlwhKwSOMmKbXVsdGlhZGRyc5YACASsEjjJBn1xAAoErBI4yQZ9ct0DgnJzhQADAQAAiXNlY3AyNTZrMaECsMr4_AcGZxAXSk_gEjGI7eG-C94AWKebAyTJZsyNnD-DdGNwgn1xg3VkcIJ9c4V3YWt1Mgs"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.134.229
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['1402', '1403', '1404', '1405', '1406']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 1402:1402 -p 1403:1403 -p 1404:1404 -p 1405:1405 -p 1406:1406 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=1404 --rest-port=1402 --tcp-port=1403 --discv5-udp-port=1405 --rest-address=0.0.0.0 --nat=extip:172.18.134.229 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=9ded16c37d87468b8ddc005da8036dcdadfdfd2fcf7bf3dcb8a9dca2dddc4cd4 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=1406 --metrics-logging=true --relay=false --lightpushnode=/ip4/172.18.56.201/tcp/32113/p2p/16Uiu2HAm7KoF9m1cDh1xQYBgeARhoyeiD71wvteMaLbsJkyVGzNa --discv5-bootstrap-node=enr:-L24QBwUX7OxBcaxVIMnf-5IofO8Q30M8ryOwRowFBJ-zxUAGL-hXgtjsgcqdIXhpMZqmP-aGqyAf_6CqTO5XBKtk7kCgmlkgnY0gmlwhKwSOMmKbXVsdGlhZGRyc5YACASsEjjJBn1xAAoErBI4yQZ9ct0DgnJzhQADAQAAiXNlY3AyNTZrMaECsMr4_AcGZxAXSk_gEjGI7eG-C94AWKebAyTJZsyNnD-DdGNwgn1xg3VkcIJ9c4V3YWt1Mgs
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.134.229 waku e715fe12e69f12fc0bde1866683e2bae076b0e8a857a51cf39d246a324d68c96
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID e715fe12e69f. Setting up logs at ./log/docker/node4_2025-12-22_04-17-24__8ec3b716-3e0f-467c-9fcc-21cce2265019__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 1402
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:1402/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:1402/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.134.229/tcp/1403/p2p/16Uiu2HAmC8FPJkv7w95hi9Rwyz6WZWRhCCeT33z3B2PwrHZFr5Eq","/ip4/172.18.134.229/tcp/1404/ws/p2p/16Uiu2HAmC8FPJkv7w95hi9Rwyz6WZWRhCCeT33z3B2PwrHZFr5Eq"],"enrUri":"enr:-L24QIVpGILxF4RFebfCcDVIYMQ66hWaHXTSP-Leq-4CNceBD8SqDJuPg8pp5Kx9bxTeT1_sB7AzX3qhV3dxgbTGq8gCgmlkgnY0gmlwhKwShuWKbXVsdGlhZGRyc5YACASsEoblBgV7AAoErBKG5QYFfN0DgnJzhQADAQAAiXNlY3AyNTZrMaEC-B_-qvD3uPj3ETGDOy7fhweptTBGuY1MGVhJoGYZMLqDdGNwggV7g3VkcIIFfYV3YWt1MgA"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.2.245
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['24716', '24717', '24718', '24719', '24720']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 24716:24716 -p 24717:24717 -p 24718:24718 -p 24719:24719 -p 24720:24720 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=24718 --rest-port=24716 --tcp-port=24717 --discv5-udp-port=24719 --rest-address=0.0.0.0 --nat=extip:172.18.2.245 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=a4d0b7eee9c1dd91f9d212d7144ca72fbb08add57e5aebbc2a6ee9b3b429d5de --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=24720 --metrics-logging=true --relay=true --store=true --discv5-bootstrap-node=enr:-L24QBwUX7OxBcaxVIMnf-5IofO8Q30M8ryOwRowFBJ-zxUAGL-hXgtjsgcqdIXhpMZqmP-aGqyAf_6CqTO5XBKtk7kCgmlkgnY0gmlwhKwSOMmKbXVsdGlhZGRyc5YACASsEjjJBn1xAAoErBI4yQZ9ct0DgnJzhQADAQAAiXNlY3AyNTZrMaECsMr4_AcGZxAXSk_gEjGI7eG-C94AWKebAyTJZsyNnD-DdGNwgn1xg3VkcIJ9c4V3YWt1Mgs
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.2.245 waku 0d2ee3cbe333f8555e9fa2ce9de2e73fdfad592ea25eab29d639fe388ff141ca
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 0d2ee3cbe333. Setting up logs at ./log/docker/node7_2025-12-22_04-17-24__8ec3b716-3e0f-467c-9fcc-21cce2265019__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 24716
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:24716/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:24716/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.2.245/tcp/24717/p2p/16Uiu2HAm3CDCQ3EQ8s8dzPZGrPBe7gAT2WkvvZ46LFeSDasc8FAc","/ip4/172.18.2.245/tcp/24718/ws/p2p/16Uiu2HAm3CDCQ3EQ8s8dzPZGrPBe7gAT2WkvvZ46LFeSDasc8FAc"],"enrUri":"enr:-L24QBit2FS0eZu_9S_REguWQzVs41xGdlFbNeF5I6vB9ilFA3WATJZBrHYCRePRJY0TrCNUaegRoeJXMHYSTu5QrmQCgmlkgnY0gmlwhKwSAvWKbXVsdGlhZGRyc5YACASsEgL1BmCNAAoErBIC9QZgjt0DgnJzhQADAQAAiXNlY3AyNTZrMaECc2qpX98V54jaAkseFjj2SvVGsfzg29Xp6ocVpAEqmu2DdGNwgmCNg3VkcIJgj4V3YWt1MgM"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.216.0
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['13852', '13853', '13854', '13855', '13856']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 13852:13852 -p 13853:13853 -p 13854:13854 -p 13855:13855 -p 13856:13856 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=13854 --rest-port=13852 --tcp-port=13853 --discv5-udp-port=13855 --rest-address=0.0.0.0 --nat=extip:172.18.216.0 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=2adec7bd3a6079b12c01fbc9ae3cd7b4f43bdb3cf5f9ee3dae66c91e628c7db0 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=13856 --metrics-logging=true --relay=true --filter=true --storenode=/ip4/172.18.2.245/tcp/24717/p2p/16Uiu2HAm3CDCQ3EQ8s8dzPZGrPBe7gAT2WkvvZ46LFeSDasc8FAc --discv5-bootstrap-node=enr:-L24QBit2FS0eZu_9S_REguWQzVs41xGdlFbNeF5I6vB9ilFA3WATJZBrHYCRePRJY0TrCNUaegRoeJXMHYSTu5QrmQCgmlkgnY0gmlwhKwSAvWKbXVsdGlhZGRyc5YACASsEgL1BmCNAAoErBIC9QZgjt0DgnJzhQADAQAAiXNlY3AyNTZrMaECc2qpX98V54jaAkseFjj2SvVGsfzg29Xp6ocVpAEqmu2DdGNwgmCNg3VkcIJgj4V3YWt1MgM
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.216.0 waku 79ef58803cc5221268821fcc7aa4ee7a0c135aa2b66784475fcb8bbf778cbb02
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 79ef58803cc5. Setting up logs at ./log/docker/node8_2025-12-22_04-17-24__8ec3b716-3e0f-467c-9fcc-21cce2265019__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 13852
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:13852/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"READY"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:13852/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.216.0/tcp/13853/p2p/16Uiu2HAmHaJrxnU29wwZ9eqAPP43KUMjJ15nZyaEMbtw8Q5wbd7E","/ip4/172.18.216.0/tcp/13854/ws/p2p/16Uiu2HAmHaJrxnU29wwZ9eqAPP43KUMjJ15nZyaEMbtw8Q5wbd7E"],"enrUri":"enr:-L24QMBcXYqWI7-Q-lYoSBCFBM41O2bBhcaQlLqdWfAGcE4_K9oEAQ9NG3XIX8onqnkV-XZ32MdqImKDV3AV85jxky4CgmlkgnY0gmlwhKwS2ACKbXVsdGlhZGRyc5YACASsEtgABjYdAAoErBLYAAY2Ht0DgnJzhQADAQAAiXNlY3AyNTZrMaEDSRd2MyT_dJ_8ZXxzay59PCklr4IX91tHowvLrR2IIOmDdGNwgjYdg3VkcII2H4V3YWt1MgU"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.89.254
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['11612', '11613', '11614', '11615', '11616']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 11612:11612 -p 11613:11613 -p 11614:11614 -p 11615:11615 -p 11616:11616 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=11614 --rest-port=11612 --tcp-port=11613 --discv5-udp-port=11615 --rest-address=0.0.0.0 --nat=extip:172.18.89.254 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=4fbe95f3cce4846a32b54a0a912ca473a1ab6aaea6a3bc0feb60e4c80cd23ef0 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=11616 --metrics-logging=true --relay=false --filternode=/ip4/172.18.216.0/tcp/13853/p2p/16Uiu2HAmHaJrxnU29wwZ9eqAPP43KUMjJ15nZyaEMbtw8Q5wbd7E --storenode=/ip4/172.18.2.245/tcp/24717/p2p/16Uiu2HAm3CDCQ3EQ8s8dzPZGrPBe7gAT2WkvvZ46LFeSDasc8FAc --discv5-bootstrap-node=enr:-L24QBit2FS0eZu_9S_REguWQzVs41xGdlFbNeF5I6vB9ilFA3WATJZBrHYCRePRJY0TrCNUaegRoeJXMHYSTu5QrmQCgmlkgnY0gmlwhKwSAvWKbXVsdGlhZGRyc5YACASsEgL1BmCNAAoErBIC9QZgjt0DgnJzhQADAQAAiXNlY3AyNTZrMaECc2qpX98V54jaAkseFjj2SvVGsfzg29Xp6ocVpAEqmu2DdGNwgmCNg3VkcIJgj4V3YWt1MgM
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.89.254 waku 36f89261cb5cddb9fe4d52a3afcc18765ea7697130694c1e9a720d8b1f93392d
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 36f89261cb5c. Setting up logs at ./log/docker/node5_2025-12-22_04-17-24__8ec3b716-3e0f-467c-9fcc-21cce2265019__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 11612
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:11612/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"READY"},{"Filter Client":"READY"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:11612/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.89.254/tcp/11613/p2p/16Uiu2HAm6NvhN5xnX1HsXaYaqQZk8QvKbammEfDGYwSVw8vP2bwr","/ip4/172.18.89.254/tcp/11614/ws/p2p/16Uiu2HAm6NvhN5xnX1HsXaYaqQZk8QvKbammEfDGYwSVw8vP2bwr"],"enrUri":"enr:-L24QH6NrStyYyx4KUBSzFFhreBpuh-ULoXPLH--tj3iSFHMUbZ9NTStZ5STAIpf6hexc4YVFxB9BoP7Zc0CKFqyx5cCgmlkgnY0gmlwhKwSWf6KbXVsdGlhZGRyc5YACASsEln-Bi1dAAoErBJZ_gYtXt0DgnJzhQADAQAAiXNlY3AyNTZrMaECorx0O3MD7L7KXoDPAYjIF_KwIr-iyfQzZ7jG9gSEJ52DdGNwgi1dg3VkcIItX4V3YWt1MgA"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  tests.e2e.test_e2e:test_e2e.py:450 Connect 3 service nodes to relay subscriptions
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:32112/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:24716/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:13852/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:32112/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.2.245/tcp/44620/p2p/16Uiu2HAm3CDCQ3EQ8s8dzPZGrPBe7gAT2WkvvZ46LFeSDasc8FAc","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-123-ge3dd62","origin":"Discv5"}]'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:24716/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.17.0.5/tcp/42436/p2p/16Uiu2HAmHaJrxnU29wwZ9eqAPP43KUMjJ15nZyaEMbtw8Q5wbd7E","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-123-ge3dd62","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.56.201/tcp/32113/p2p/16Uiu2HAm7KoF9m1cDh1xQYBgeARhoyeiD71wvteMaLbsJkyVGzNa","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/lightpush/3.0.0","/vac/waku/lightpush/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-123-ge3dd62","origin":"Discv5"}]'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:13852/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.2.245/tcp/24717/p2p/16Uiu2HAm3CDCQ3EQ8s8dzPZGrPBe7gAT2WkvvZ46LFeSDasc8FAc","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-123-ge3dd62","origin":"Discv5"}]'
DEBUG  src.libs.common:common.py:47 Sleeping for 30 seconds
DEBUG  tests.e2e.test_e2e:test_e2e.py:456 Edge node2 makes filter subscription to pubsubtopic /waku/2/rs/3/1 and content topic /test/1/waku-filter/proto
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:11612/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "1", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"requestId":"1","statusDesc":"OK"}'
DEBUG  tests.e2e.test_e2e:test_e2e.py:461 Check if service node1 receives message sent by edge node1
DEBUG  src.steps.light_push:light_push.py:121 Lightpushing message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:1402/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/3/1", "message": {"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": 1766377083386976362}}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.1 seconds
DEBUG  src.steps.light_push:light_push.py:125 Checking that peer NODE_1:wakuorg/nwaku:latest can find the lightpushed message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:32112/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1766377083386976362,"ephemeral":false,"proof":""}]'
DEBUG  tests.e2e.test_e2e:test_e2e.py:465 Check if edge node2 can query stored message
DEBUG  src.steps.store:store.py:211 Checking that peer wakuorg/nwaku:latest can find the stored messages
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:11612/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F1&pageSize=50&ascending=true" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"requestId":"60189cc684b14ef02613","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x19e32c097ca5c5a385500a19556a21d2d33c4b9a06909708bc170cef7431953d"}]}'
DEBUG  src.steps.store:store.py:228 messages length is 1
DEBUG  tests.e2e.test_e2e:test_e2e.py:468 Check if service node3 can query stored message
DEBUG  src.steps.store:store.py:211 Checking that peer wakuorg/nwaku:latest can find the stored messages
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:13852/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F1&pageSize=50&ascending=true" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"requestId":"cdbfe58b7fab06269c5e","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x19e32c097ca5c5a385500a19556a21d2d33c4b9a06909708bc170cef7431953d"}]}'
DEBUG  src.steps.store:store.py:228 messages length is 1
DEBUG  tests.e2e.test_e2e:test_e2e.py:471 Check if edge node2 can get sent message using filter get request
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:11612/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1766377083386976362,"ephemeral":false}]'
DEBUG  tests.conftest:conftest.py:59 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:83 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 1779b06bf56a
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id e715fe12e69f
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 0d2ee3cbe333
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 1779b06bf56a. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 79ef58803cc5
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container e715fe12e69f. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 36f89261cb5c
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 0d2ee3cbe333. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  tests.conftest:conftest.py:98 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.