256 lines
49 KiB
Plaintext
Raw Blame History

This file contains invisible Unicode characters

This file contains invisible Unicode characters that are indistinguishable to humans but may be processed differently by a computer. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

DEBUG  tests.conftest:conftest.py:51 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:57 Running test: test_start_node_with_50_pubsub_topics with id: 2026-03-06_04-32-59__65d8026f-c85d-4ba5-838a-2663dfc32414
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.steps.relay:relay.py:28 Running fixture setup: relay_setup
DEBUG  src.steps.sharding:sharding.py:30 Running fixture setup: sharding_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node1_2026-03-06_04-32-59__65d8026f-c85d-4ba5-838a-2663dfc32414__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.216.50
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['28711', '28712', '28713', '28714', '28715']
DEBUG  src.node.waku_node:waku_node.py:72 Cluster id was resolved to: 2
DEBUG  src.node.waku_node:waku_node.py:163 Removing pubsub-topic from nwaku args
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 28711:28711 -p 28712:28712 -p 28713:28713 -p 28714:28714 -p 28715:28715 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=28713 --rest-port=28711 --tcp-port=28712 --discv5-udp-port=28714 --rest-address=0.0.0.0 --nat=extip:172.18.216.50 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=c6757a9dd82ccc3c82a3e72bd024a5f6eb688e8ebe209bccaed00ace4ad0dc5b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=28715 --metrics-logging=true --relay=true --filter=true
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container ba7a7c916537. Exiting log stream.
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.216.50 waku daf620dbe8460be1b1f9cf00f4a33a62c6eba52f8bdeafcc9723aa709f4bb522
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID daf620dbe846. Setting up logs at ./log/docker/node1_2026-03-06_04-32-59__65d8026f-c85d-4ba5-838a-2663dfc32414__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 28711
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 2577f92d280b. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:28711/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:28711/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.216.50/tcp/28712/p2p/16Uiu2HAm8Edin3E2syELBdpjKUd4chFG7XbUhuoFz5SFCSdENFAD","/ip4/172.18.216.50/tcp/28713/ws/p2p/16Uiu2HAm8Edin3E2syELBdpjKUd4chFG7XbUhuoFz5SFCSdENFAD"],"enrUri":"enr:-L24QLAhK338b0xiLZXJs1-iODek2u_-6kImPfP90D42zulVQv_P64CbEshir5sX1zmMfxFnUzo_Dyflu5dq57a2-R4CgmlkgnY0gmlwhKwS2DKKbXVsdGlhZGRyc5YACASsEtgyBnAoAAoErBLYMgZwKd0DgnJzhQACAQAAiXNlY3AyNTZrMaECvlP8q9LzGTAqI3y1nlWYvovo2pN3y-1zJEkPWEYBc2aDdGNwgnAog3VkcIJwKoV3YWt1MgU"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node2_2026-03-06_04-32-59__65d8026f-c85d-4ba5-838a-2663dfc32414__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.213.95
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['23791', '23792', '23793', '23794', '23795']
DEBUG  src.node.waku_node:waku_node.py:72 Cluster id was resolved to: 2
DEBUG  src.node.waku_node:waku_node.py:163 Removing pubsub-topic from nwaku args
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 23791:23791 -p 23792:23792 -p 23793:23793 -p 23794:23794 -p 23795:23795 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=23793 --rest-port=23791 --tcp-port=23792 --discv5-udp-port=23794 --rest-address=0.0.0.0 --nat=extip:172.18.213.95 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=ec1b9cb8a371adbaddd1c6cd7b987c60dc4aec0373361bac9fc30b176806e0b3 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=23795 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QLAhK338b0xiLZXJs1-iODek2u_-6kImPfP90D42zulVQv_P64CbEshir5sX1zmMfxFnUzo_Dyflu5dq57a2-R4CgmlkgnY0gmlwhKwS2DKKbXVsdGlhZGRyc5YACASsEtgyBnAoAAoErBLYMgZwKd0DgnJzhQACAQAAiXNlY3AyNTZrMaECvlP8q9LzGTAqI3y1nlWYvovo2pN3y-1zJEkPWEYBc2aDdGNwgnAog3VkcIJwKoV3YWt1MgU
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.213.95 waku fc600c8087521e5d1cff81256fbde1e70ca6d4e11970f0f28cd66296b05ad1b4
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID fc600c808752. Setting up logs at ./log/docker/node2_2026-03-06_04-32-59__65d8026f-c85d-4ba5-838a-2663dfc32414__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 23791
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:23791/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:23791/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:23791/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.213.95/tcp/23792/p2p/16Uiu2HAmMn3TVtV7tPPrJKS2BH3EB1r3KULwr8SDmttAWZRVGGHA","/ip4/172.18.213.95/tcp/23793/ws/p2p/16Uiu2HAmMn3TVtV7tPPrJKS2BH3EB1r3KULwr8SDmttAWZRVGGHA"],"enrUri":"enr:-L24QND2-Bg1mR8LRubAFhhkDphihnfnm4c7kZKn_8udl8X8fZga3JozVYdnyWPk3buH_78pnb9w8o7FlVupKSuggJ8CgmlkgnY0gmlwhKwS1V-KbXVsdGlhZGRyc5YACASsEtVfBlzwAAoErBLVXwZc8d0DgnJzhQACAQAAiXNlY3AyNTZrMaEDh4fC2xO_MyGor2COgUOyrIolcS56-_rdsFx6iZo1oV2DdGNwglzwg3VkcIJc8oV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:23791/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.216.50/tcp/28712/p2p/16Uiu2HAm8Edin3E2syELBdpjKUd4chFG7XbUhuoFz5SFCSdENFAD"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:28711/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7", "/waku/2/rs/2/8", "/waku/2/rs/2/9", "/waku/2/rs/2/10", "/waku/2/rs/2/11", "/waku/2/rs/2/12", "/waku/2/rs/2/13", "/waku/2/rs/2/14", "/waku/2/rs/2/15", "/waku/2/rs/2/16", "/waku/2/rs/2/17", "/waku/2/rs/2/18", "/waku/2/rs/2/19", "/waku/2/rs/2/20", "/waku/2/rs/2/21", "/waku/2/rs/2/22", "/waku/2/rs/2/23", "/waku/2/rs/2/24", "/waku/2/rs/2/25", "/waku/2/rs/2/26", "/waku/2/rs/2/27", "/waku/2/rs/2/28", "/waku/2/rs/2/29", "/waku/2/rs/2/30", "/waku/2/rs/2/31", "/waku/2/rs/2/32", "/waku/2/rs/2/33", "/waku/2/rs/2/34", "/waku/2/rs/2/35", "/waku/2/rs/2/36", "/waku/2/rs/2/37", "/waku/2/rs/2/38", "/waku/2/rs/2/39", "/waku/2/rs/2/40", "/waku/2/rs/2/41", "/waku/2/rs/2/42", "/waku/2/rs/2/43", "/waku/2/rs/2/44", "/waku/2/rs/2/45", "/waku/2/rs/2/46", "/waku/2/rs/2/47", "/waku/2/rs/2/48", "/waku/2/rs/2/49"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:23791/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7", "/waku/2/rs/2/8", "/waku/2/rs/2/9", "/waku/2/rs/2/10", "/waku/2/rs/2/11", "/waku/2/rs/2/12", "/waku/2/rs/2/13", "/waku/2/rs/2/14", "/waku/2/rs/2/15", "/waku/2/rs/2/16", "/waku/2/rs/2/17", "/waku/2/rs/2/18", "/waku/2/rs/2/19", "/waku/2/rs/2/20", "/waku/2/rs/2/21", "/waku/2/rs/2/22", "/waku/2/rs/2/23", "/waku/2/rs/2/24", "/waku/2/rs/2/25", "/waku/2/rs/2/26", "/waku/2/rs/2/27", "/waku/2/rs/2/28", "/waku/2/rs/2/29", "/waku/2/rs/2/30", "/waku/2/rs/2/31", "/waku/2/rs/2/32", "/waku/2/rs/2/33", "/waku/2/rs/2/34", "/waku/2/rs/2/35", "/waku/2/rs/2/36", "/waku/2/rs/2/37", "/waku/2/rs/2/38", "/waku/2/rs/2/39", "/waku/2/rs/2/40", "/waku/2/rs/2/41", "/waku/2/rs/2/42", "/waku/2/rs/2/43", "/waku/2/rs/2/44", "/waku/2/rs/2/45", "/waku/2/rs/2/46", "/waku/2/rs/2/47", "/waku/2/rs/2/48", "/waku/2/rs/2/49"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:28711/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.1 seconds
DEBUG  src.steps.sharding:sharding.py:158 Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:28711/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772771581933274358,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772771582822157854,"ephemeral":false,"proof":""}]'
DEBUG  tests.conftest:conftest.py:59 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:83 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id daf620dbe846
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id fc600c808752
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  tests.conftest:conftest.py:98 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  tests.conftest:conftest.py:73 Running fixture teardown: attach_logs_on_fail
DEBUG  tests.conftest:conftest.py:74 Test failed, attempting to attach logs to the allure reports
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/node2_2026-03-06_04-32-59__65d8026f-c85d-4ba5-838a-2663dfc32414__wakuorg_nwaku:latest.log
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/node1_2026-03-06_04-32-59__65d8026f-c85d-4ba5-838a-2663dfc32414__wakuorg_nwaku:latest.log
DEBUG  tests.conftest:conftest.py:51 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:57 Running test: test_start_node_with_50_pubsub_topics with id: 2026-03-06_04-33-04__a9f27f9f-b4eb-42a0-bc9e-c9c732c4ed0e
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.steps.relay:relay.py:28 Running fixture setup: relay_setup
DEBUG  src.steps.sharding:sharding.py:30 Running fixture setup: sharding_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node1_2026-03-06_04-33-04__a9f27f9f-b4eb-42a0-bc9e-c9c732c4ed0e__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.106.67
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['6317', '6318', '6319', '6320', '6321']
DEBUG  src.node.waku_node:waku_node.py:72 Cluster id was resolved to: 2
DEBUG  src.node.waku_node:waku_node.py:163 Removing pubsub-topic from nwaku args
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 6317:6317 -p 6318:6318 -p 6319:6319 -p 6320:6320 -p 6321:6321 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=6319 --rest-port=6317 --tcp-port=6318 --discv5-udp-port=6320 --rest-address=0.0.0.0 --nat=extip:172.18.106.67 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=a79de3dbea7f4cd78561c949da2efab839caf8f7c9bdb2ebeff50855fb9ffacc --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=6321 --metrics-logging=true --relay=true --filter=true
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container daf620dbe846. Exiting log stream.
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.106.67 waku b42375dd3b1142832825c36d6c03c6f7ae1bcd08c107242c44a94a5154b2fad8
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID b42375dd3b11. Setting up logs at ./log/docker/node1_2026-03-06_04-33-04__a9f27f9f-b4eb-42a0-bc9e-c9c732c4ed0e__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 6317
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container fc600c808752. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:6317/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:6317/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:6317/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.106.67/tcp/6318/p2p/16Uiu2HAmFvdgrGvg2PeNAwUN6N7yonx5drNkzmmPFnAyYFqHZhya","/ip4/172.18.106.67/tcp/6319/ws/p2p/16Uiu2HAmFvdgrGvg2PeNAwUN6N7yonx5drNkzmmPFnAyYFqHZhya"],"enrUri":"enr:-L24QL1RdCC0aU_vqKgUIXfzbMIRqF2IK9Q3iHqd13chS1jgYQyeSVkn2qWyTZnhl1xCRgR7MxB-8iNa6An5ZVJKQ4sCgmlkgnY0gmlwhKwSakOKbXVsdGlhZGRyc5YACASsEmpDBhiuAAoErBJqQwYYr90DgnJzhQACAQAAiXNlY3AyNTZrMaEDMJT9guJqtNME7NFbPdp2GsZsI-zdata1AnMCm5p54XGDdGNwghiug3VkcIIYsIV3YWt1MgU"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node2_2026-03-06_04-33-04__a9f27f9f-b4eb-42a0-bc9e-c9c732c4ed0e__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.169.238
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['10961', '10962', '10963', '10964', '10965']
DEBUG  src.node.waku_node:waku_node.py:72 Cluster id was resolved to: 2
DEBUG  src.node.waku_node:waku_node.py:163 Removing pubsub-topic from nwaku args
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 10961:10961 -p 10962:10962 -p 10963:10963 -p 10964:10964 -p 10965:10965 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=10963 --rest-port=10961 --tcp-port=10962 --discv5-udp-port=10964 --rest-address=0.0.0.0 --nat=extip:172.18.169.238 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=2b42db9a5feec8b4c472b1a2e229b4f6d0a1dcd6a8c0b73aa8acd03a8c9f2dcc --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=10965 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QL1RdCC0aU_vqKgUIXfzbMIRqF2IK9Q3iHqd13chS1jgYQyeSVkn2qWyTZnhl1xCRgR7MxB-8iNa6An5ZVJKQ4sCgmlkgnY0gmlwhKwSakOKbXVsdGlhZGRyc5YACASsEmpDBhiuAAoErBJqQwYYr90DgnJzhQACAQAAiXNlY3AyNTZrMaEDMJT9guJqtNME7NFbPdp2GsZsI-zdata1AnMCm5p54XGDdGNwghiug3VkcIIYsIV3YWt1MgU
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.169.238 waku 0f31f893b3caf15c81fc49f610c555405b4354c3587fcf67b9eef4462bd66a8e
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 0f31f893b3ca. Setting up logs at ./log/docker/node2_2026-03-06_04-33-04__a9f27f9f-b4eb-42a0-bc9e-c9c732c4ed0e__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 10961
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:10961/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:10961/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:10961/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:10961/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:10961/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:10961/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:10961/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:10961/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:10961/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:10961/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:10961/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.169.238/tcp/10962/p2p/16Uiu2HAm3RgwTc4EZTf5zhPvuQxQgnSy7XbPGpzwrujqVBLS5o89","/ip4/172.18.169.238/tcp/10963/ws/p2p/16Uiu2HAm3RgwTc4EZTf5zhPvuQxQgnSy7XbPGpzwrujqVBLS5o89"],"enrUri":"enr:-L24QMKq8_JurP7BFZ0Pcn_iIPjmDXyMSolFKZkPWliPX0dif8rzVFe9rxIMjTYrPC8T76-yU6Z9gVpFxBnAiGd4y8ACgmlkgnY0gmlwhKwSqe6KbXVsdGlhZGRyc5YACASsEqnuBirSAAoErBKp7gYq090DgnJzhQACAQAAiXNlY3AyNTZrMaECdt6UoxJTJOLSLrQAgALuxY8K-3PbQCJXK4AERbQNuKaDdGNwgirSg3VkcIIq1IV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:10961/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.106.67/tcp/6318/p2p/16Uiu2HAmFvdgrGvg2PeNAwUN6N7yonx5drNkzmmPFnAyYFqHZhya"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:6317/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7", "/waku/2/rs/2/8", "/waku/2/rs/2/9", "/waku/2/rs/2/10", "/waku/2/rs/2/11", "/waku/2/rs/2/12", "/waku/2/rs/2/13", "/waku/2/rs/2/14", "/waku/2/rs/2/15", "/waku/2/rs/2/16", "/waku/2/rs/2/17", "/waku/2/rs/2/18", "/waku/2/rs/2/19", "/waku/2/rs/2/20", "/waku/2/rs/2/21", "/waku/2/rs/2/22", "/waku/2/rs/2/23", "/waku/2/rs/2/24", "/waku/2/rs/2/25", "/waku/2/rs/2/26", "/waku/2/rs/2/27", "/waku/2/rs/2/28", "/waku/2/rs/2/29", "/waku/2/rs/2/30", "/waku/2/rs/2/31", "/waku/2/rs/2/32", "/waku/2/rs/2/33", "/waku/2/rs/2/34", "/waku/2/rs/2/35", "/waku/2/rs/2/36", "/waku/2/rs/2/37", "/waku/2/rs/2/38", "/waku/2/rs/2/39", "/waku/2/rs/2/40", "/waku/2/rs/2/41", "/waku/2/rs/2/42", "/waku/2/rs/2/43", "/waku/2/rs/2/44", "/waku/2/rs/2/45", "/waku/2/rs/2/46", "/waku/2/rs/2/47", "/waku/2/rs/2/48", "/waku/2/rs/2/49"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:10961/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7", "/waku/2/rs/2/8", "/waku/2/rs/2/9", "/waku/2/rs/2/10", "/waku/2/rs/2/11", "/waku/2/rs/2/12", "/waku/2/rs/2/13", "/waku/2/rs/2/14", "/waku/2/rs/2/15", "/waku/2/rs/2/16", "/waku/2/rs/2/17", "/waku/2/rs/2/18", "/waku/2/rs/2/19", "/waku/2/rs/2/20", "/waku/2/rs/2/21", "/waku/2/rs/2/22", "/waku/2/rs/2/23", "/waku/2/rs/2/24", "/waku/2/rs/2/25", "/waku/2/rs/2/26", "/waku/2/rs/2/27", "/waku/2/rs/2/28", "/waku/2/rs/2/29", "/waku/2/rs/2/30", "/waku/2/rs/2/31", "/waku/2/rs/2/32", "/waku/2/rs/2/33", "/waku/2/rs/2/34", "/waku/2/rs/2/35", "/waku/2/rs/2/36", "/waku/2/rs/2/37", "/waku/2/rs/2/38", "/waku/2/rs/2/39", "/waku/2/rs/2/40", "/waku/2/rs/2/41", "/waku/2/rs/2/42", "/waku/2/rs/2/43", "/waku/2/rs/2/44", "/waku/2/rs/2/45", "/waku/2/rs/2/46", "/waku/2/rs/2/47", "/waku/2/rs/2/48", "/waku/2/rs/2/49"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:6317/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.1 seconds
DEBUG  src.steps.sharding:sharding.py:158 Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:6317/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772771586383433293,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772771587977763263,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772771588168509708,"ephemeral":false,"proof":""}]'
DEBUG  tests.conftest:conftest.py:59 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:83 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id b42375dd3b11
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 0f31f893b3ca
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  tests.conftest:conftest.py:98 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  tests.conftest:conftest.py:73 Running fixture teardown: attach_logs_on_fail
DEBUG  tests.conftest:conftest.py:74 Test failed, attempting to attach logs to the allure reports
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/node2_2026-03-06_04-33-04__a9f27f9f-b4eb-42a0-bc9e-c9c732c4ed0e__wakuorg_nwaku:latest.log
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/node1_2026-03-06_04-33-04__a9f27f9f-b4eb-42a0-bc9e-c9c732c4ed0e__wakuorg_nwaku:latest.log
DEBUG  tests.conftest:conftest.py:51 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:57 Running test: test_start_node_with_50_pubsub_topics with id: 2026-03-06_04-33-09__a58b73c3-97e9-48d7-991d-88479f94083b
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.steps.relay:relay.py:28 Running fixture setup: relay_setup
DEBUG  src.steps.sharding:sharding.py:30 Running fixture setup: sharding_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node1_2026-03-06_04-33-09__a58b73c3-97e9-48d7-991d-88479f94083b__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.255.45
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['51348', '51349', '51350', '51351', '51352']
DEBUG  src.node.waku_node:waku_node.py:72 Cluster id was resolved to: 2
DEBUG  src.node.waku_node:waku_node.py:163 Removing pubsub-topic from nwaku args
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 51348:51348 -p 51349:51349 -p 51350:51350 -p 51351:51351 -p 51352:51352 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=51350 --rest-port=51348 --tcp-port=51349 --discv5-udp-port=51351 --rest-address=0.0.0.0 --nat=extip:172.18.255.45 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=9b0a1be6efc11c2bc93ef0037d2185c6dc0dedb79f8df28683f7618d9b58af96 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=51352 --metrics-logging=true --relay=true --filter=true
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container b42375dd3b11. Exiting log stream.
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.255.45 waku 42d2e6eefdfb2fdb2ef4cec021b4d9678238b1e52fb986d8f1d44495b58e8a28
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 42d2e6eefdfb. Setting up logs at ./log/docker/node1_2026-03-06_04-33-09__a58b73c3-97e9-48d7-991d-88479f94083b__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 51348
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 0f31f893b3ca. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:51348/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:51348/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.255.45/tcp/51349/p2p/16Uiu2HAmUsATGbwa643HGM5fywJvdRKMzKb4zcQ8HqMrbqE6hSmJ","/ip4/172.18.255.45/tcp/51350/ws/p2p/16Uiu2HAmUsATGbwa643HGM5fywJvdRKMzKb4zcQ8HqMrbqE6hSmJ"],"enrUri":"enr:-L24QParjk1jeL37FhOiBIzFmWK2o-jvCaN_gxFYdB41sRXDa1iM6y78FQFxkWwMJKjGR7cyZAm7X-gW3bf1pWoVF2MCgmlkgnY0gmlwhKwS_y2KbXVsdGlhZGRyc5YACASsEv8tBsiVAAoErBL_LQbIlt0DgnJzhQACAQAAiXNlY3AyNTZrMaED8NliV1PGLrP6ZRu7Zf_5DrOBKSprEJxDz5RBWJrZ_T2DdGNwgsiVg3VkcILIl4V3YWt1MgU"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node2_2026-03-06_04-33-09__a58b73c3-97e9-48d7-991d-88479f94083b__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.23.173
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['26099', '26100', '26101', '26102', '26103']
DEBUG  src.node.waku_node:waku_node.py:72 Cluster id was resolved to: 2
DEBUG  src.node.waku_node:waku_node.py:163 Removing pubsub-topic from nwaku args
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 26099:26099 -p 26100:26100 -p 26101:26101 -p 26102:26102 -p 26103:26103 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=26101 --rest-port=26099 --tcp-port=26100 --discv5-udp-port=26102 --rest-address=0.0.0.0 --nat=extip:172.18.23.173 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=eaf47cc5e1fdff4abc4deb4910dafca2e0b0888d0d4d9c37fe0bc94b06b7d149 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=26103 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QParjk1jeL37FhOiBIzFmWK2o-jvCaN_gxFYdB41sRXDa1iM6y78FQFxkWwMJKjGR7cyZAm7X-gW3bf1pWoVF2MCgmlkgnY0gmlwhKwS_y2KbXVsdGlhZGRyc5YACASsEv8tBsiVAAoErBL_LQbIlt0DgnJzhQACAQAAiXNlY3AyNTZrMaED8NliV1PGLrP6ZRu7Zf_5DrOBKSprEJxDz5RBWJrZ_T2DdGNwgsiVg3VkcILIl4V3YWt1MgU
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.23.173 waku fad9a94e8fb1ac17ddf10db224c041b6d60c75acca4aae58b03b22500f00521c
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID fad9a94e8fb1. Setting up logs at ./log/docker/node2_2026-03-06_04-33-09__a58b73c3-97e9-48d7-991d-88479f94083b__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 26099
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:26099/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:26099/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.23.173/tcp/26100/p2p/16Uiu2HAmN9pNNyd32wFvM2WAs6TuTJ2cpvgLyb7G2UvqD5zdmAfs","/ip4/172.18.23.173/tcp/26101/ws/p2p/16Uiu2HAmN9pNNyd32wFvM2WAs6TuTJ2cpvgLyb7G2UvqD5zdmAfs"],"enrUri":"enr:-L24QAJ3attrNtlDoH1J5K0hply4pYqqKodF0K8_zjpimwMHVu9xjGL63Dp7i5Q_Y_PqhW7TcOSAdzcthSNfZ1BJUM8CgmlkgnY0gmlwhKwSF62KbXVsdGlhZGRyc5YACASsEhetBmX0AAoErBIXrQZl9d0DgnJzhQACAQAAiXNlY3AyNTZrMaEDjRu9cVYkL8yuewYFOt6uNP5i2uwr0OaCfKPnkTl9cdKDdGNwgmX0g3VkcIJl9oV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:26099/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.255.45/tcp/51349/p2p/16Uiu2HAmUsATGbwa643HGM5fywJvdRKMzKb4zcQ8HqMrbqE6hSmJ"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:51348/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7", "/waku/2/rs/2/8", "/waku/2/rs/2/9", "/waku/2/rs/2/10", "/waku/2/rs/2/11", "/waku/2/rs/2/12", "/waku/2/rs/2/13", "/waku/2/rs/2/14", "/waku/2/rs/2/15", "/waku/2/rs/2/16", "/waku/2/rs/2/17", "/waku/2/rs/2/18", "/waku/2/rs/2/19", "/waku/2/rs/2/20", "/waku/2/rs/2/21", "/waku/2/rs/2/22", "/waku/2/rs/2/23", "/waku/2/rs/2/24", "/waku/2/rs/2/25", "/waku/2/rs/2/26", "/waku/2/rs/2/27", "/waku/2/rs/2/28", "/waku/2/rs/2/29", "/waku/2/rs/2/30", "/waku/2/rs/2/31", "/waku/2/rs/2/32", "/waku/2/rs/2/33", "/waku/2/rs/2/34", "/waku/2/rs/2/35", "/waku/2/rs/2/36", "/waku/2/rs/2/37", "/waku/2/rs/2/38", "/waku/2/rs/2/39", "/waku/2/rs/2/40", "/waku/2/rs/2/41", "/waku/2/rs/2/42", "/waku/2/rs/2/43", "/waku/2/rs/2/44", "/waku/2/rs/2/45", "/waku/2/rs/2/46", "/waku/2/rs/2/47", "/waku/2/rs/2/48", "/waku/2/rs/2/49"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:26099/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7", "/waku/2/rs/2/8", "/waku/2/rs/2/9", "/waku/2/rs/2/10", "/waku/2/rs/2/11", "/waku/2/rs/2/12", "/waku/2/rs/2/13", "/waku/2/rs/2/14", "/waku/2/rs/2/15", "/waku/2/rs/2/16", "/waku/2/rs/2/17", "/waku/2/rs/2/18", "/waku/2/rs/2/19", "/waku/2/rs/2/20", "/waku/2/rs/2/21", "/waku/2/rs/2/22", "/waku/2/rs/2/23", "/waku/2/rs/2/24", "/waku/2/rs/2/25", "/waku/2/rs/2/26", "/waku/2/rs/2/27", "/waku/2/rs/2/28", "/waku/2/rs/2/29", "/waku/2/rs/2/30", "/waku/2/rs/2/31", "/waku/2/rs/2/32", "/waku/2/rs/2/33", "/waku/2/rs/2/34", "/waku/2/rs/2/35", "/waku/2/rs/2/36", "/waku/2/rs/2/37", "/waku/2/rs/2/38", "/waku/2/rs/2/39", "/waku/2/rs/2/40", "/waku/2/rs/2/41", "/waku/2/rs/2/42", "/waku/2/rs/2/43", "/waku/2/rs/2/44", "/waku/2/rs/2/45", "/waku/2/rs/2/46", "/waku/2/rs/2/47", "/waku/2/rs/2/48", "/waku/2/rs/2/49"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:51348/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.1 seconds
DEBUG  src.steps.sharding:sharding.py:158 Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:51348/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772771590748595796,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772771587977763263,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772771588168509708,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772771592612234178,"ephemeral":false,"proof":""}]'
DEBUG  tests.conftest:conftest.py:59 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:83 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 42d2e6eefdfb
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id fad9a94e8fb1
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  tests.conftest:conftest.py:98 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  tests.conftest:conftest.py:73 Running fixture teardown: attach_logs_on_fail
DEBUG  tests.conftest:conftest.py:74 Test failed, attempting to attach logs to the allure reports
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/node2_2026-03-06_04-33-09__a58b73c3-97e9-48d7-991d-88479f94083b__wakuorg_nwaku:latest.log
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/node1_2026-03-06_04-33-09__a58b73c3-97e9-48d7-991d-88479f94083b__wakuorg_nwaku:latest.log