306 lines
57 KiB
Plaintext
Raw Blame History

This file contains invisible Unicode characters

This file contains invisible Unicode characters that are indistinguishable to humans but may be processed differently by a computer. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

INFO  tests.conftest:conftest.py:106 Fleet bootstrap inactive pass --fleet (or set FLEET_BOOTSTRAP=true) to connect local nodes to the waku.test fleet
DEBUG  tests.conftest:conftest.py:201 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:207 Running test: test_light_push_with_missing_pubsub_topics with id: 2026-04-22_23-59-58__ffca544e-03a3-4a77-a8cd-b21dd3c6d181
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.steps.light_push:light_push.py:28 Running fixture setup: light_push_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:108 WakuNode instance initialized with log path ./log/docker/receiving_node1_2026-04-22_23-59-58__ffca544e-03a3-4a77-a8cd-b21dd3c6d181__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:116 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.5.108
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['43694', '43695', '43696', '43697', '43698']
DEBUG  src.node.waku_node:waku_node.py:606 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:211 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:217 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 43694:43694 -p 43695:43695 -p 43696:43696 -p 43697:43697 -p 43698:43698 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=43696 --rest-port=43694 --tcp-port=43695 --discv5-udp-port=43697 --rest-address=0.0.0.0 --nat=extip:172.18.5.108 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=df6ec4af4f35e3e036929dcc1d780b7a7cea2cac548accde20cdd8cbf1d2b18e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=43698 --metrics-logging=true --lightpush=true --relay=true
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 7843fea0023d. Exiting log stream.
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.5.108 waku 6b0b1ed3a5940ba0f7d7ba38bd031fe95e9ff20da7083d6123f547ff0a1d983f
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 6b0b1ed3a594. Setting up logs at ./log/docker/receiving_node1_2026-04-22_23-59-58__ffca544e-03a3-4a77-a8cd-b21dd3c6d181__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:228 Started container from image wakuorg/nwaku:latest. REST: 43694
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 9fdbaf7082c4. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:43694/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:412 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:43694/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.5.108/tcp/43695/p2p/16Uiu2HAkvjeVJ25wGTCUgPxkvNWhqnogf2cZQJBD9fqsAQaKGfaX","/ip4/172.18.5.108/tcp/43696/ws/p2p/16Uiu2HAkvjeVJ25wGTCUgPxkvNWhqnogf2cZQJBD9fqsAQaKGfaX"],"enrUri":"enr:-L24QJ6LLrkfp4wqOmhcJVEkDKQFTJqe0FYRBGQhbcpo89aLXpkK6ZSjXXAIfxgI470IMJyC6tpotW8hs31NtvGjkA8CgmlkgnY0gmlwhKwSBWyKbXVsdGlhZGRyc5YACASsEgVsBqqvAAoErBIFbAaqsN0DgnJzhQDGAQAAiXNlY3AyNTZrMaECE3Z0h7ei832bbGeBc8lUq_Z_0IGHjXl10j1pZgZc0EiDdGNwgqqvg3VkcIKqsYV3YWt1Mgk"}'
INFO  src.node.waku_node:waku_node.py:417 REST service is ready !!
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:108 WakuNode instance initialized with log path ./log/docker/receiving_node2_2026-04-22_23-59-58__ffca544e-03a3-4a77-a8cd-b21dd3c6d181__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:116 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.0.116
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['19184', '19185', '19186', '19187', '19188']
DEBUG  src.node.waku_node:waku_node.py:606 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:211 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:217 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 19184:19184 -p 19185:19185 -p 19186:19186 -p 19187:19187 -p 19188:19188 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=19186 --rest-port=19184 --tcp-port=19185 --discv5-udp-port=19187 --rest-address=0.0.0.0 --nat=extip:172.18.0.116 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=adc3eeee268fcca8ad3c5da467c3bfaf2cd5ab50510f26af0bbbdd907b82a9fd --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=19188 --metrics-logging=true --lightpush=false --relay=true
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.0.116 waku f95541e6eea0067003fac146f2d1ca7effd351a726e7037f3287ae75f77fc2f2
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID f95541e6eea0. Setting up logs at ./log/docker/receiving_node2_2026-04-22_23-59-58__ffca544e-03a3-4a77-a8cd-b21dd3c6d181__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:228 Started container from image wakuorg/nwaku:latest. REST: 19184
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:19184/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:412 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:19184/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.0.116/tcp/19185/p2p/16Uiu2HAmVZueFs4t114Xe5WwqtXEGAQvSD2UBcyhK62xNtRZ7FQX","/ip4/172.18.0.116/tcp/19186/ws/p2p/16Uiu2HAmVZueFs4t114Xe5WwqtXEGAQvSD2UBcyhK62xNtRZ7FQX"],"enrUri":"enr:-L24QKijxbXDK5eCKRCKctdF-hI-UraRHOjWWAH75MpqFlXDNpdLNgd_mnPLi3ZDGcn5SEte5HUBAsCYfnTUiFcClGQCgmlkgnY0gmlwhKwSAHSKbXVsdGlhZGRyc5YACASsEgB0BkrxAAoErBIAdAZK8t0DgnJzhQDGAQAAiXNlY3AyNTZrMaED-0lzcgF3iN3H1UtvdzOO5eqWXFErGZtUDmTGUUwjM3yDdGNwgkrxg3VkcIJK84V3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:417 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:19184/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.5.108/tcp/43695/p2p/16Uiu2HAkvjeVJ25wGTCUgPxkvNWhqnogf2cZQJBD9fqsAQaKGfaX"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:108 WakuNode instance initialized with log path ./log/docker/lightpush_node1_2026-04-22_23-59-58__ffca544e-03a3-4a77-a8cd-b21dd3c6d181__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:116 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.144.80
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['3558', '3559', '3560', '3561', '3562']
DEBUG  src.node.waku_node:waku_node.py:606 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:211 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:217 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 3558:3558 -p 3559:3559 -p 3560:3560 -p 3561:3561 -p 3562:3562 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=3560 --rest-port=3558 --tcp-port=3559 --discv5-udp-port=3561 --rest-address=0.0.0.0 --nat=extip:172.18.144.80 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=165fe6d9acdcbf341d62effdafbc672eca0320e11decf071859ac6ff87ccfd2f --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=3562 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QJ6LLrkfp4wqOmhcJVEkDKQFTJqe0FYRBGQhbcpo89aLXpkK6ZSjXXAIfxgI470IMJyC6tpotW8hs31NtvGjkA8CgmlkgnY0gmlwhKwSBWyKbXVsdGlhZGRyc5YACASsEgVsBqqvAAoErBIFbAaqsN0DgnJzhQDGAQAAiXNlY3AyNTZrMaECE3Z0h7ei832bbGeBc8lUq_Z_0IGHjXl10j1pZgZc0EiDdGNwgqqvg3VkcIKqsYV3YWt1Mgk --lightpushnode=/ip4/172.18.5.108/tcp/43695/p2p/16Uiu2HAkvjeVJ25wGTCUgPxkvNWhqnogf2cZQJBD9fqsAQaKGfaX --lightpush=true --relay=true
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.144.80 waku c9ab688f3ff89a4a1c54c59a349f307845a58a8ff247ccfd08a44021a814d66f
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID c9ab688f3ff8. Setting up logs at ./log/docker/lightpush_node1_2026-04-22_23-59-58__ffca544e-03a3-4a77-a8cd-b21dd3c6d181__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:228 Started container from image wakuorg/nwaku:latest. REST: 3558
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:3558/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:412 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:3558/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.144.80/tcp/3559/p2p/16Uiu2HAmCH1tso1moKpScnc3W6vQFGap5mq5nQP8CrEKMH1QMoS6","/ip4/172.18.144.80/tcp/3560/ws/p2p/16Uiu2HAmCH1tso1moKpScnc3W6vQFGap5mq5nQP8CrEKMH1QMoS6"],"enrUri":"enr:-L24QNWE_r1acjz3Lr_I-Pu4tejOKdDfaNoJDeqjs5RDvL2ENlp7hvVRriGwW_XKnVtqoPdnwkKUBpGcIaSRfI0D7wUCgmlkgnY0gmlwhKwSkFCKbXVsdGlhZGRyc5YACASsEpBQBg3nAAoErBKQUAYN6N0DgnJzhQDGAQAAiXNlY3AyNTZrMaEC-l73-5r6MDDi6KDyGbMBEdxm8dsvb5E2vBc4vqDVP7eDdGNwgg3ng3VkcIIN6YV3YWt1Mgk"}'
INFO  src.node.waku_node:waku_node.py:417 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:3558/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.5.108/tcp/43695/p2p/16Uiu2HAkvjeVJ25wGTCUgPxkvNWhqnogf2cZQJBD9fqsAQaKGfaX"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:3558/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.0.116/tcp/19185/p2p/16Uiu2HAmVZueFs4t114Xe5WwqtXEGAQvSD2UBcyhK62xNtRZ7FQX"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:43694/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:19184/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:3558/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:3558/lightpush/v1/message" -H "Content-Type: application/json" -d '{"message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "contentTopic": "/myapp/1/latest/proto", "timestamp": 1776902402086941854}}'
ERROR  src.node.api_clients.base_client:base_client.py:16 HTTP error occurred: 503 Server Error: Service Unavailable for url: http://127.0.0.1:3558/lightpush/v1/message. Response content: b'Failed to request a message push: Pubsub topic must be specified when static sharding is enabled'
DEBUG  tests.conftest:conftest.py:209 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:233 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:343 Stopping container with id 6b0b1ed3a594
DEBUG  src.node.waku_node:waku_node.py:355 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:343 Stopping container with id f95541e6eea0
DEBUG  src.node.waku_node:waku_node.py:355 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:343 Stopping container with id c9ab688f3ff8
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 6b0b1ed3a594. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:355 Container stopped.
DEBUG  tests.conftest:conftest.py:248 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  tests.conftest:conftest.py:223 Running fixture teardown: attach_logs_on_fail
DEBUG  tests.conftest:conftest.py:224 Test failed, attempting to attach logs to the allure reports
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/receiving_node1_2026-04-22_23-59-58__ffca544e-03a3-4a77-a8cd-b21dd3c6d181__wakuorg_nwaku:latest.log
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/lightpush_node1_2026-04-22_23-59-58__ffca544e-03a3-4a77-a8cd-b21dd3c6d181__wakuorg_nwaku:latest.log
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/receiving_node2_2026-04-22_23-59-58__ffca544e-03a3-4a77-a8cd-b21dd3c6d181__wakuorg_nwaku:latest.log
INFO  tests.conftest:conftest.py:106 Fleet bootstrap inactive pass --fleet (or set FLEET_BOOTSTRAP=true) to connect local nodes to the waku.test fleet
DEBUG  tests.conftest:conftest.py:201 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:207 Running test: test_light_push_with_missing_pubsub_topics with id: 2026-04-23_00-00-03__9e3ab6b3-50ce-42f5-98f3-b2f9bd82a345
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.steps.light_push:light_push.py:28 Running fixture setup: light_push_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:108 WakuNode instance initialized with log path ./log/docker/receiving_node1_2026-04-23_00-00-03__9e3ab6b3-50ce-42f5-98f3-b2f9bd82a345__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:116 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.255.92
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['32756', '32757', '32758', '32759', '32760']
DEBUG  src.node.waku_node:waku_node.py:606 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:211 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:217 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 32756:32756 -p 32757:32757 -p 32758:32758 -p 32759:32759 -p 32760:32760 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=32758 --rest-port=32756 --tcp-port=32757 --discv5-udp-port=32759 --rest-address=0.0.0.0 --nat=extip:172.18.255.92 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=412b7aafb2cf9a358f0b51a339f09afafa5ecedadbbdb5abf022944dd9cf2c54 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=32760 --metrics-logging=true --lightpush=true --relay=true
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.255.92 waku 903ef0fac14568781c088741df3d06fed65422a107ab1a2b47cea7998d8b2cba
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 903ef0fac145. Setting up logs at ./log/docker/receiving_node1_2026-04-23_00-00-03__9e3ab6b3-50ce-42f5-98f3-b2f9bd82a345__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:228 Started container from image wakuorg/nwaku:latest. REST: 32756
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container f95541e6eea0. Exiting log stream.
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container c9ab688f3ff8. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:32756/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:412 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:32756/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.255.92/tcp/32757/p2p/16Uiu2HAmPdm9DxMpoJ5npiMgu4XKiQsqfw61MH49m7QcMBcGshfr","/ip4/172.18.255.92/tcp/32758/ws/p2p/16Uiu2HAmPdm9DxMpoJ5npiMgu4XKiQsqfw61MH49m7QcMBcGshfr"],"enrUri":"enr:-L24QFXqtkQhPs3SFK6F7PU0v22MQbWS75DREhndCskClnXWQVghs4cb6EnuUB1LBrFCzeKL8mZ5CJ8fS6FFLrGgifsCgmlkgnY0gmlwhKwS_1yKbXVsdGlhZGRyc5YACASsEv9cBn_1AAoErBL_XAZ_9t0DgnJzhQDGAQAAiXNlY3AyNTZrMaEDoyAKf-oK47JKYJKUGe6_3uzqdHabRJBAM-pHP0nNTI2DdGNwgn_1g3VkcIJ_94V3YWt1Mgk"}'
INFO  src.node.waku_node:waku_node.py:417 REST service is ready !!
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:108 WakuNode instance initialized with log path ./log/docker/receiving_node2_2026-04-23_00-00-03__9e3ab6b3-50ce-42f5-98f3-b2f9bd82a345__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:116 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.63.100
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['43893', '43894', '43895', '43896', '43897']
DEBUG  src.node.waku_node:waku_node.py:606 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:211 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:217 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 43893:43893 -p 43894:43894 -p 43895:43895 -p 43896:43896 -p 43897:43897 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=43895 --rest-port=43893 --tcp-port=43894 --discv5-udp-port=43896 --rest-address=0.0.0.0 --nat=extip:172.18.63.100 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=3cc5cbcaf21cec2d7eae7bcdeb4cc443ab4ea87df469d4dff476a2d84bf9e0a9 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=43897 --metrics-logging=true --lightpush=false --relay=true
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.63.100 waku 85ff05e7a3aeaff7f9d0a21b5dafa707f8acea8f97ef34587ee03da76beda4be
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 85ff05e7a3ae. Setting up logs at ./log/docker/receiving_node2_2026-04-23_00-00-03__9e3ab6b3-50ce-42f5-98f3-b2f9bd82a345__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:228 Started container from image wakuorg/nwaku:latest. REST: 43893
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:43893/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:412 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:43893/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.63.100/tcp/43894/p2p/16Uiu2HAm8XcudE6YWy3HAv419WQzmLitufvn6pQ7jad6QjzGurBv","/ip4/172.18.63.100/tcp/43895/ws/p2p/16Uiu2HAm8XcudE6YWy3HAv419WQzmLitufvn6pQ7jad6QjzGurBv"],"enrUri":"enr:-L24QIrsLXfVNOcaKjRfNFAsaci3bkyEOw8C1x1RY8p6djZhJP-_-s_hT7yZcs1gxg1SR78H76MAQVs551a23PCM9MkCgmlkgnY0gmlwhKwSP2SKbXVsdGlhZGRyc5YACASsEj9kBqt2AAoErBI_ZAard90DgnJzhQDGAQAAiXNlY3AyNTZrMaECwq3xCA79w_qLVYtjG5K2wsBkcH_C5ZbRx1i36wDsBA2DdGNwgqt2g3VkcIKreIV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:417 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:43893/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.255.92/tcp/32757/p2p/16Uiu2HAmPdm9DxMpoJ5npiMgu4XKiQsqfw61MH49m7QcMBcGshfr"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:108 WakuNode instance initialized with log path ./log/docker/lightpush_node1_2026-04-23_00-00-03__9e3ab6b3-50ce-42f5-98f3-b2f9bd82a345__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:116 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.71.156
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['49376', '49377', '49378', '49379', '49380']
DEBUG  src.node.waku_node:waku_node.py:606 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:211 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:217 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 49376:49376 -p 49377:49377 -p 49378:49378 -p 49379:49379 -p 49380:49380 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=49378 --rest-port=49376 --tcp-port=49377 --discv5-udp-port=49379 --rest-address=0.0.0.0 --nat=extip:172.18.71.156 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=fda96476e1f10eb6c06ed304a1adaab5add89d4dfded37826bd1d6f0e31acf89 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=49380 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QFXqtkQhPs3SFK6F7PU0v22MQbWS75DREhndCskClnXWQVghs4cb6EnuUB1LBrFCzeKL8mZ5CJ8fS6FFLrGgifsCgmlkgnY0gmlwhKwS_1yKbXVsdGlhZGRyc5YACASsEv9cBn_1AAoErBL_XAZ_9t0DgnJzhQDGAQAAiXNlY3AyNTZrMaEDoyAKf-oK47JKYJKUGe6_3uzqdHabRJBAM-pHP0nNTI2DdGNwgn_1g3VkcIJ_94V3YWt1Mgk --lightpushnode=/ip4/172.18.255.92/tcp/32757/p2p/16Uiu2HAmPdm9DxMpoJ5npiMgu4XKiQsqfw61MH49m7QcMBcGshfr --lightpush=true --relay=true
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.71.156 waku 8301848675da749786f75dbd7c3437ac05dbd64d65f24e73b421481131847c44
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 8301848675da. Setting up logs at ./log/docker/lightpush_node1_2026-04-23_00-00-03__9e3ab6b3-50ce-42f5-98f3-b2f9bd82a345__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:228 Started container from image wakuorg/nwaku:latest. REST: 49376
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:49376/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:412 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:49376/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.71.156/tcp/49377/p2p/16Uiu2HAmDzHSHgKyK9Rjge926642vWdCn9YDNUQis7LqetMGuLcV","/ip4/172.18.71.156/tcp/49378/ws/p2p/16Uiu2HAmDzHSHgKyK9Rjge926642vWdCn9YDNUQis7LqetMGuLcV"],"enrUri":"enr:-L24QCBR9Jj7HO8PRXfBKuDtZkcIIGvOiFzNsTHOig_Ekp-tNyghUKWIzqmbfPVhj6y6K3V41ZYDCFScmIfDnQiDO1ECgmlkgnY0gmlwhKwSR5yKbXVsdGlhZGRyc5YACASsEkecBsDhAAoErBJHnAbA4t0DgnJzhQDGAQAAiXNlY3AyNTZrMaEDE80KrS_znzh6xzQ8WTXoaIHCYWia2bozjOzKJYv9f4aDdGNwgsDhg3VkcILA44V3YWt1Mgk"}'
INFO  src.node.waku_node:waku_node.py:417 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:49376/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.255.92/tcp/32757/p2p/16Uiu2HAmPdm9DxMpoJ5npiMgu4XKiQsqfw61MH49m7QcMBcGshfr"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:49376/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.63.100/tcp/43894/p2p/16Uiu2HAm8XcudE6YWy3HAv419WQzmLitufvn6pQ7jad6QjzGurBv"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:32756/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:43893/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:49376/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:49376/lightpush/v1/message" -H "Content-Type: application/json" -d '{"message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "contentTopic": "/myapp/1/latest/proto", "timestamp": 1776902407531295597}}'
ERROR  src.node.api_clients.base_client:base_client.py:16 HTTP error occurred: 503 Server Error: Service Unavailable for url: http://127.0.0.1:49376/lightpush/v1/message. Response content: b'Failed to request a message push: Pubsub topic must be specified when static sharding is enabled'
DEBUG  tests.conftest:conftest.py:209 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:233 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:343 Stopping container with id 903ef0fac145
DEBUG  src.node.waku_node:waku_node.py:355 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:343 Stopping container with id 85ff05e7a3ae
DEBUG  src.node.waku_node:waku_node.py:355 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:343 Stopping container with id 8301848675da
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 903ef0fac145. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:355 Container stopped.
DEBUG  tests.conftest:conftest.py:248 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  tests.conftest:conftest.py:223 Running fixture teardown: attach_logs_on_fail
DEBUG  tests.conftest:conftest.py:224 Test failed, attempting to attach logs to the allure reports
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/receiving_node2_2026-04-23_00-00-03__9e3ab6b3-50ce-42f5-98f3-b2f9bd82a345__wakuorg_nwaku:latest.log
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/receiving_node1_2026-04-23_00-00-03__9e3ab6b3-50ce-42f5-98f3-b2f9bd82a345__wakuorg_nwaku:latest.log
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/lightpush_node1_2026-04-23_00-00-03__9e3ab6b3-50ce-42f5-98f3-b2f9bd82a345__wakuorg_nwaku:latest.log
INFO  tests.conftest:conftest.py:106 Fleet bootstrap inactive pass --fleet (or set FLEET_BOOTSTRAP=true) to connect local nodes to the waku.test fleet
DEBUG  tests.conftest:conftest.py:201 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:207 Running test: test_light_push_with_missing_pubsub_topics with id: 2026-04-23_00-00-09__30fdca7d-4282-485c-8356-785014698709
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.steps.light_push:light_push.py:28 Running fixture setup: light_push_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:108 WakuNode instance initialized with log path ./log/docker/receiving_node1_2026-04-23_00-00-09__30fdca7d-4282-485c-8356-785014698709__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:116 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.113.142
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['19875', '19876', '19877', '19878', '19879']
DEBUG  src.node.waku_node:waku_node.py:606 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:211 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:217 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 19875:19875 -p 19876:19876 -p 19877:19877 -p 19878:19878 -p 19879:19879 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=19877 --rest-port=19875 --tcp-port=19876 --discv5-udp-port=19878 --rest-address=0.0.0.0 --nat=extip:172.18.113.142 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=7aa68cdde05c5bbe32efe33c65e6fb8aebebec4b51ec33f2b1be88544ffbba2c --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=19879 --metrics-logging=true --lightpush=true --relay=true
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.113.142 waku e23b9a9e2d4378ba06ebfaa13d0ca8276757228ae8545a7bf215ed976967724e
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID e23b9a9e2d43. Setting up logs at ./log/docker/receiving_node1_2026-04-23_00-00-09__30fdca7d-4282-485c-8356-785014698709__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:228 Started container from image wakuorg/nwaku:latest. REST: 19875
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 85ff05e7a3ae. Exiting log stream.
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 8301848675da. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:19875/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:412 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:19875/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.113.142/tcp/19876/p2p/16Uiu2HAmKTFXWEMryVkj5K3B8gWNjUJBJdgXyD5L5Cq8pm1YpcRF","/ip4/172.18.113.142/tcp/19877/ws/p2p/16Uiu2HAmKTFXWEMryVkj5K3B8gWNjUJBJdgXyD5L5Cq8pm1YpcRF"],"enrUri":"enr:-L24QHLI_jtDwU65cNwpJRA8m4YaGIXzMMVVSs4G3JLzIQy3eSRoTrPiKtrhk_7PqsEdCAhuQYpCLJBB0iSc-FluRYsCgmlkgnY0gmlwhKwScY6KbXVsdGlhZGRyc5YACASsEnGOBk2kAAoErBJxjgZNpd0DgnJzhQDGAQAAiXNlY3AyNTZrMaEDZP__m5zpxtt_7Z4fXy_JV_Y2dvGTg2GgPAebfiPiNzKDdGNwgk2kg3VkcIJNpoV3YWt1Mgk"}'
INFO  src.node.waku_node:waku_node.py:417 REST service is ready !!
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:108 WakuNode instance initialized with log path ./log/docker/receiving_node2_2026-04-23_00-00-09__30fdca7d-4282-485c-8356-785014698709__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:116 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.86.140
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['50530', '50531', '50532', '50533', '50534']
DEBUG  src.node.waku_node:waku_node.py:606 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:211 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:217 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 50530:50530 -p 50531:50531 -p 50532:50532 -p 50533:50533 -p 50534:50534 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=50532 --rest-port=50530 --tcp-port=50531 --discv5-udp-port=50533 --rest-address=0.0.0.0 --nat=extip:172.18.86.140 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=07fae502ef190eec85956a6d8ccebdfc4c1adfb7cde82822ad9c7db5106d6b79 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=50534 --metrics-logging=true --lightpush=false --relay=true
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.86.140 waku dc6b3b4e850ce3084965442c1a59cb7e66a433d7073acc310d0baea51fde9d57
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID dc6b3b4e850c. Setting up logs at ./log/docker/receiving_node2_2026-04-23_00-00-09__30fdca7d-4282-485c-8356-785014698709__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:228 Started container from image wakuorg/nwaku:latest. REST: 50530
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:50530/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:412 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:50530/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.86.140/tcp/50531/p2p/16Uiu2HAm42SzvbdMXCiL9wiCAc6oXJd5h3tnRsVdZKGGTnURLFu7","/ip4/172.18.86.140/tcp/50532/ws/p2p/16Uiu2HAm42SzvbdMXCiL9wiCAc6oXJd5h3tnRsVdZKGGTnURLFu7"],"enrUri":"enr:-L24QBy_PamajrtwIQiBHfeYIguLC_c6KBgG0ir08LCdYIU8TLGOVGQsefhnzBQUGsj6bnDpdO8ZB7KMUD1tzRpeR4cCgmlkgnY0gmlwhKwSVoyKbXVsdGlhZGRyc5YACASsElaMBsVjAAoErBJWjAbFZN0DgnJzhQDGAQAAiXNlY3AyNTZrMaECf8Ylig5403UZEO7027X3DCsf7ywaqmcUXKPOton6nV6DdGNwgsVjg3VkcILFZYV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:417 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:50530/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.113.142/tcp/19876/p2p/16Uiu2HAmKTFXWEMryVkj5K3B8gWNjUJBJdgXyD5L5Cq8pm1YpcRF"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:108 WakuNode instance initialized with log path ./log/docker/lightpush_node1_2026-04-23_00-00-09__30fdca7d-4282-485c-8356-785014698709__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:116 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.202.54
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['55321', '55322', '55323', '55324', '55325']
DEBUG  src.node.waku_node:waku_node.py:606 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:211 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:217 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 55321:55321 -p 55322:55322 -p 55323:55323 -p 55324:55324 -p 55325:55325 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=55323 --rest-port=55321 --tcp-port=55322 --discv5-udp-port=55324 --rest-address=0.0.0.0 --nat=extip:172.18.202.54 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=8ccf00252b9f96f57f5b8456846cb0fafa0cba2e36269cfbea1dff6cb9c8ebc3 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=55325 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QHLI_jtDwU65cNwpJRA8m4YaGIXzMMVVSs4G3JLzIQy3eSRoTrPiKtrhk_7PqsEdCAhuQYpCLJBB0iSc-FluRYsCgmlkgnY0gmlwhKwScY6KbXVsdGlhZGRyc5YACASsEnGOBk2kAAoErBJxjgZNpd0DgnJzhQDGAQAAiXNlY3AyNTZrMaEDZP__m5zpxtt_7Z4fXy_JV_Y2dvGTg2GgPAebfiPiNzKDdGNwgk2kg3VkcIJNpoV3YWt1Mgk --lightpushnode=/ip4/172.18.113.142/tcp/19876/p2p/16Uiu2HAmKTFXWEMryVkj5K3B8gWNjUJBJdgXyD5L5Cq8pm1YpcRF --lightpush=true --relay=true
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.202.54 waku 7babcbffbda3c1914a00696e845e541e941807a049350936a9d831c19992d99d
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 7babcbffbda3. Setting up logs at ./log/docker/lightpush_node1_2026-04-23_00-00-09__30fdca7d-4282-485c-8356-785014698709__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:228 Started container from image wakuorg/nwaku:latest. REST: 55321
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:55321/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:412 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:55321/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.202.54/tcp/55322/p2p/16Uiu2HAmUKkefxEQJZkhGwK3SPqwTgDbmXsxiK9qwtqi3q6WE72u","/ip4/172.18.202.54/tcp/55323/ws/p2p/16Uiu2HAmUKkefxEQJZkhGwK3SPqwTgDbmXsxiK9qwtqi3q6WE72u"],"enrUri":"enr:-L24QJsRIhs08HoMZ5gdUyWjrM8g_ymEhbv3nykHljtujC59A8u9VB4J59kC3h_Wc59PmQSLQhBMsDpIrXtG_EHVuXQCgmlkgnY0gmlwhKwSyjaKbXVsdGlhZGRyc5YACASsEso2BtgaAAoErBLKNgbYG90DgnJzhQDGAQAAiXNlY3AyNTZrMaED6M1253VMyIMTrPQdmXSHvahT4ci9pSqKp265p-Bf8D6DdGNwgtgag3VkcILYHIV3YWt1Mgk"}'
INFO  src.node.waku_node:waku_node.py:417 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:55321/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.113.142/tcp/19876/p2p/16Uiu2HAmKTFXWEMryVkj5K3B8gWNjUJBJdgXyD5L5Cq8pm1YpcRF"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:55321/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.86.140/tcp/50531/p2p/16Uiu2HAm42SzvbdMXCiL9wiCAc6oXJd5h3tnRsVdZKGGTnURLFu7"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:19875/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:50530/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:55321/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:55321/lightpush/v1/message" -H "Content-Type: application/json" -d '{"message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "contentTopic": "/myapp/1/latest/proto", "timestamp": 1776902412905512344}}'
ERROR  src.node.api_clients.base_client:base_client.py:16 HTTP error occurred: 503 Server Error: Service Unavailable for url: http://127.0.0.1:55321/lightpush/v1/message. Response content: b'Failed to request a message push: Pubsub topic must be specified when static sharding is enabled'
DEBUG  tests.conftest:conftest.py:209 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:233 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:343 Stopping container with id e23b9a9e2d43
DEBUG  src.node.waku_node:waku_node.py:355 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:343 Stopping container with id dc6b3b4e850c
DEBUG  src.node.waku_node:waku_node.py:355 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:343 Stopping container with id 7babcbffbda3
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container e23b9a9e2d43. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:355 Container stopped.
DEBUG  tests.conftest:conftest.py:248 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  tests.conftest:conftest.py:223 Running fixture teardown: attach_logs_on_fail
DEBUG  tests.conftest:conftest.py:224 Test failed, attempting to attach logs to the allure reports
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/receiving_node2_2026-04-23_00-00-09__30fdca7d-4282-485c-8356-785014698709__wakuorg_nwaku:latest.log
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/receiving_node1_2026-04-23_00-00-09__30fdca7d-4282-485c-8356-785014698709__wakuorg_nwaku:latest.log
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/lightpush_node1_2026-04-23_00-00-09__30fdca7d-4282-485c-8356-785014698709__wakuorg_nwaku:latest.log