261 lines
44 KiB
Plaintext
Raw Blame History

This file contains invisible Unicode characters

This file contains invisible Unicode characters that are indistinguishable to humans but may be processed differently by a computer. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

DEBUG  tests.conftest:conftest.py:51 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:57 Running test: test_cant_publish_on_not_subscribed_shard with id: 2026-03-24_04-44-24__b2c355b6-3c4f-419f-b353-fe2148774f58
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.steps.relay:relay.py:28 Running fixture setup: relay_setup
DEBUG  src.steps.sharding:sharding.py:30 Running fixture setup: sharding_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node1_2026-03-24_04-44-24__b2c355b6-3c4f-419f-b353-fe2148774f58__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.4.94
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['59003', '59004', '59005', '59006', '59007']
DEBUG  src.node.waku_node:waku_node.py:72 Cluster id was resolved to: 2
DEBUG  src.node.waku_node:waku_node.py:163 Removing pubsub-topic from nwaku args
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 59003:59003 -p 59004:59004 -p 59005:59005 -p 59006:59006 -p 59007:59007 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=59005 --rest-port=59003 --tcp-port=59004 --discv5-udp-port=59006 --rest-address=0.0.0.0 --nat=extip:172.18.4.94 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=3fc8fbdebbe7a6a84d1aa3eaefe992c20bc07957da01dc574e9ddbead531bb25 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=59007 --metrics-logging=true --relay=true --filter=true
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.4.94 waku 8f4119153c35c84357e4979723684eb4e5d4e1f22268ec1ff85c25d73d578382
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 8f4119153c35. Setting up logs at ./log/docker/node1_2026-03-24_04-44-24__b2c355b6-3c4f-419f-b353-fe2148774f58__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 59003
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container d185e1cefa98. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:59003/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:59003/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:59003/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.4.94/tcp/59004/p2p/16Uiu2HAm2krV8xGQ2T3vSmYzxWVcfw9gNBie9nNqEoF9wpxwKDTA","/ip4/172.18.4.94/tcp/59005/ws/p2p/16Uiu2HAm2krV8xGQ2T3vSmYzxWVcfw9gNBie9nNqEoF9wpxwKDTA"],"enrUri":"enr:-L24QGzVR_jwcuqZLF7_4lxbuyteWB6nWKYpDlh-ZPe4gDIaEx7PzIjrvsNxCvK4cPIX5p1ZTGMT3Pspn8p5Kx6RHm4CgmlkgnY0gmlwhKwSBF6KbXVsdGlhZGRyc5YACASsEgReBuZ8AAoErBIEXgbmfd0DgnJzhQACAQAAiXNlY3AyNTZrMaECbOu5E9lhYOavJIKMQxcMcfvQ2P5lOQsyIzaKsjyl0e2DdGNwguZ8g3VkcILmfoV3YWt1MgU"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node2_2026-03-24_04-44-24__b2c355b6-3c4f-419f-b353-fe2148774f58__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.40.20
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['56638', '56639', '56640', '56641', '56642']
DEBUG  src.node.waku_node:waku_node.py:72 Cluster id was resolved to: 2
DEBUG  src.node.waku_node:waku_node.py:163 Removing pubsub-topic from nwaku args
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 56638:56638 -p 56639:56639 -p 56640:56640 -p 56641:56641 -p 56642:56642 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=56640 --rest-port=56638 --tcp-port=56639 --discv5-udp-port=56641 --rest-address=0.0.0.0 --nat=extip:172.18.40.20 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=a969fba0dc9bb439350bb3d1e6d516349720ff286ce1ebf4abefbf2fe2b3f1bd --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=56642 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QGzVR_jwcuqZLF7_4lxbuyteWB6nWKYpDlh-ZPe4gDIaEx7PzIjrvsNxCvK4cPIX5p1ZTGMT3Pspn8p5Kx6RHm4CgmlkgnY0gmlwhKwSBF6KbXVsdGlhZGRyc5YACASsEgReBuZ8AAoErBIEXgbmfd0DgnJzhQACAQAAiXNlY3AyNTZrMaECbOu5E9lhYOavJIKMQxcMcfvQ2P5lOQsyIzaKsjyl0e2DdGNwguZ8g3VkcILmfoV3YWt1MgU
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.40.20 waku 9f57f873439fadcf3e91575ea6a19240cabd780939e958d014a096e904f75a28
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 9f57f873439f. Setting up logs at ./log/docker/node2_2026-03-24_04-44-24__b2c355b6-3c4f-419f-b353-fe2148774f58__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 56638
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:56638/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:56638/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:56638/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.40.20/tcp/56639/p2p/16Uiu2HAmECS8XYE9uNmKTepApG3XgragU81U6xtxQqyTzJyEdyk5","/ip4/172.18.40.20/tcp/56640/ws/p2p/16Uiu2HAmECS8XYE9uNmKTepApG3XgragU81U6xtxQqyTzJyEdyk5"],"enrUri":"enr:-L24QCosAvBqnukOb2WJm-b0TidNnH53nyLbs_5yuP282rdTE5pZMFG7Lohx4XfKJurBJb178Gjb0nX-niMQFwHxfS8CgmlkgnY0gmlwhKwSKBSKbXVsdGlhZGRyc5YACASsEigUBt0_AAoErBIoFAbdQN0DgnJzhQACAQAAiXNlY3AyNTZrMaEDFunXbFvncCEeZKk51fK6LW4K9ZN63g8J-9QS-92uDtKDdGNwgt0_g3VkcILdQYV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:56638/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.4.94/tcp/59004/p2p/16Uiu2HAm2krV8xGQ2T3vSmYzxWVcfw9gNBie9nNqEoF9wpxwKDTA"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:59003/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:56638/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:59003/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.1 seconds
DEBUG  src.steps.sharding:sharding.py:158 Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:59003/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
ERROR  src.node.api_clients.base_client:base_client.py:16 HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:59003/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1. Response content: b''
DEBUG  tests.conftest:conftest.py:59 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:83 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 8f4119153c35
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 9f57f873439f
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  tests.conftest:conftest.py:98 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  tests.conftest:conftest.py:73 Running fixture teardown: attach_logs_on_fail
DEBUG  tests.conftest:conftest.py:74 Test failed, attempting to attach logs to the allure reports
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/node1_2026-03-24_04-44-24__b2c355b6-3c4f-419f-b353-fe2148774f58__wakuorg_nwaku:latest.log
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/node2_2026-03-24_04-44-24__b2c355b6-3c4f-419f-b353-fe2148774f58__wakuorg_nwaku:latest.log
DEBUG  tests.conftest:conftest.py:51 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:57 Running test: test_cant_publish_on_not_subscribed_shard with id: 2026-03-24_04-44-28__a17e2f5d-5566-49fe-848f-971cd2583a7a
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.steps.relay:relay.py:28 Running fixture setup: relay_setup
DEBUG  src.steps.sharding:sharding.py:30 Running fixture setup: sharding_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node1_2026-03-24_04-44-28__a17e2f5d-5566-49fe-848f-971cd2583a7a__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.54.20
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['63980', '63981', '63982', '63983', '63984']
DEBUG  src.node.waku_node:waku_node.py:72 Cluster id was resolved to: 2
DEBUG  src.node.waku_node:waku_node.py:163 Removing pubsub-topic from nwaku args
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 63980:63980 -p 63981:63981 -p 63982:63982 -p 63983:63983 -p 63984:63984 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=63982 --rest-port=63980 --tcp-port=63981 --discv5-udp-port=63983 --rest-address=0.0.0.0 --nat=extip:172.18.54.20 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=eb11ada71f08bf73cec236b996a91a1f5451e2bba6aab0b2b2acef835180c7b7 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=63984 --metrics-logging=true --relay=true --filter=true
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 8f4119153c35. Exiting log stream.
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.54.20 waku 07781fbade51703f8d7938f102bad3e2d96e0b810e902f8f4aa7766fc5e47a94
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 07781fbade51. Setting up logs at ./log/docker/node1_2026-03-24_04-44-28__a17e2f5d-5566-49fe-848f-971cd2583a7a__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 63980
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 9f57f873439f. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:63980/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:63980/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:63980/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:63980/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:63980/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:63980/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:63980/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:63980/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:63980/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:63980/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:63980/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.54.20/tcp/63981/p2p/16Uiu2HAmFEPQjqzuJc8fwsqQfo1i8hVMZBA9UJRNzFsBoUUVAdw4","/ip4/172.18.54.20/tcp/63982/ws/p2p/16Uiu2HAmFEPQjqzuJc8fwsqQfo1i8hVMZBA9UJRNzFsBoUUVAdw4"],"enrUri":"enr:-L24QN44tQYscw6d9MLWN5-28K5eSgoU4fcUI7GeFPR3NrcxFg-sANG3nOfL2aOTroQvwHXlavSw4yjamiPSkERvdJsCgmlkgnY0gmlwhKwSNhSKbXVsdGlhZGRyc5YACASsEjYUBvntAAoErBI2FAb57t0DgnJzhQACAQAAiXNlY3AyNTZrMaEDJkWdLiecVGmH0Nve4A7TekfcSGzCwBddrZsMUs1_ABeDdGNwgvntg3VkcIL574V3YWt1MgU"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node2_2026-03-24_04-44-28__a17e2f5d-5566-49fe-848f-971cd2583a7a__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.44.4
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['9354', '9355', '9356', '9357', '9358']
DEBUG  src.node.waku_node:waku_node.py:72 Cluster id was resolved to: 2
DEBUG  src.node.waku_node:waku_node.py:163 Removing pubsub-topic from nwaku args
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 9354:9354 -p 9355:9355 -p 9356:9356 -p 9357:9357 -p 9358:9358 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=9356 --rest-port=9354 --tcp-port=9355 --discv5-udp-port=9357 --rest-address=0.0.0.0 --nat=extip:172.18.44.4 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=d39aad90e9fdcea1ebdadc90bccdb1c5ccd5a9f8ffd19ac5c65cb7ae1307cafa --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=9358 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QN44tQYscw6d9MLWN5-28K5eSgoU4fcUI7GeFPR3NrcxFg-sANG3nOfL2aOTroQvwHXlavSw4yjamiPSkERvdJsCgmlkgnY0gmlwhKwSNhSKbXVsdGlhZGRyc5YACASsEjYUBvntAAoErBI2FAb57t0DgnJzhQACAQAAiXNlY3AyNTZrMaEDJkWdLiecVGmH0Nve4A7TekfcSGzCwBddrZsMUs1_ABeDdGNwgvntg3VkcIL574V3YWt1MgU
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.44.4 waku a7b65f6ca26ca2cd87fd64a8401919bedb4c1aeef0d0fc576bb38776ef73ab00
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID a7b65f6ca26c. Setting up logs at ./log/docker/node2_2026-03-24_04-44-28__a17e2f5d-5566-49fe-848f-971cd2583a7a__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 9354
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:9354/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:9354/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:9354/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.44.4/tcp/9355/p2p/16Uiu2HAmRzJHdWXobjTij7UTKjV1rshqBBCeRxf1AdCgixuCDmF7","/ip4/172.18.44.4/tcp/9356/ws/p2p/16Uiu2HAmRzJHdWXobjTij7UTKjV1rshqBBCeRxf1AdCgixuCDmF7"],"enrUri":"enr:-L24QJDJoa0M27I9YgFCoE-k6Ih_S0lRXSvV3TlP3S63XX4tVH7xhZs_YMI79lcACFYiGvSMr5mF-gN7oOQjrWV2Jm8CgmlkgnY0gmlwhKwSLASKbXVsdGlhZGRyc5YACASsEiwEBiSLAAoErBIsBAYkjN0DgnJzhQACAQAAiXNlY3AyNTZrMaEDxho_KiCTUD63XmlcIvcKSUfeGtOBUpm1a53OS245lrKDdGNwgiSLg3VkcIIkjYV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:9354/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.54.20/tcp/63981/p2p/16Uiu2HAmFEPQjqzuJc8fwsqQfo1i8hVMZBA9UJRNzFsBoUUVAdw4"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:63980/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:9354/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:63980/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.1 seconds
DEBUG  src.steps.sharding:sharding.py:158 Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:63980/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
ERROR  src.node.api_clients.base_client:base_client.py:16 HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:63980/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1. Response content: b''
DEBUG  tests.conftest:conftest.py:59 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:83 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 07781fbade51
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id a7b65f6ca26c
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  tests.conftest:conftest.py:98 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  tests.conftest:conftest.py:73 Running fixture teardown: attach_logs_on_fail
DEBUG  tests.conftest:conftest.py:74 Test failed, attempting to attach logs to the allure reports
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/node1_2026-03-24_04-44-28__a17e2f5d-5566-49fe-848f-971cd2583a7a__wakuorg_nwaku:latest.log
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/node2_2026-03-24_04-44-28__a17e2f5d-5566-49fe-848f-971cd2583a7a__wakuorg_nwaku:latest.log
DEBUG  tests.conftest:conftest.py:51 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:57 Running test: test_cant_publish_on_not_subscribed_shard with id: 2026-03-24_04-44-33__02017913-82e5-4922-b202-71eb4e7be1b7
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.steps.relay:relay.py:28 Running fixture setup: relay_setup
DEBUG  src.steps.sharding:sharding.py:30 Running fixture setup: sharding_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node1_2026-03-24_04-44-33__02017913-82e5-4922-b202-71eb4e7be1b7__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.220.253
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['46035', '46036', '46037', '46038', '46039']
DEBUG  src.node.waku_node:waku_node.py:72 Cluster id was resolved to: 2
DEBUG  src.node.waku_node:waku_node.py:163 Removing pubsub-topic from nwaku args
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 46035:46035 -p 46036:46036 -p 46037:46037 -p 46038:46038 -p 46039:46039 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=46037 --rest-port=46035 --tcp-port=46036 --discv5-udp-port=46038 --rest-address=0.0.0.0 --nat=extip:172.18.220.253 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=dcaad0b5b1b2074f89813af0be80f43ab1d966aa7ddddb363bd269a2e26cc741 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=46039 --metrics-logging=true --relay=true --filter=true
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 07781fbade51. Exiting log stream.
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.220.253 waku a20e92667ff3f2c9543a7924c87c21ab0f121848b7745c0a2880328990e615ff
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID a20e92667ff3. Setting up logs at ./log/docker/node1_2026-03-24_04-44-33__02017913-82e5-4922-b202-71eb4e7be1b7__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 46035
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container a7b65f6ca26c. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:46035/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:46035/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:46035/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.220.253/tcp/46036/p2p/16Uiu2HAmFvGN3m2BvTyN59sqHRuWyHxHWdbfdKpdBgGEKFDJKVmy","/ip4/172.18.220.253/tcp/46037/ws/p2p/16Uiu2HAmFvGN3m2BvTyN59sqHRuWyHxHWdbfdKpdBgGEKFDJKVmy"],"enrUri":"enr:-L24QExuogb2lXI0pBzSb_wDkf4GVKfxIPD0G6ALS0ZWfTOlIb1TbHAk9kwXd8zFisrEkhbb1mgaST0KpbPL12KRTyQCgmlkgnY0gmlwhKwS3P2KbXVsdGlhZGRyc5YACASsEtz9BrPUAAoErBLc_Qaz1d0DgnJzhQACAQAAiXNlY3AyNTZrMaEDMHzhA4Qwk_-Y10ouNswzVkSX_wKXNRMurdtwse8BJgCDdGNwgrPUg3VkcIKz1oV3YWt1MgU"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node2_2026-03-24_04-44-33__02017913-82e5-4922-b202-71eb4e7be1b7__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.69.153
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['41672', '41673', '41674', '41675', '41676']
DEBUG  src.node.waku_node:waku_node.py:72 Cluster id was resolved to: 2
DEBUG  src.node.waku_node:waku_node.py:163 Removing pubsub-topic from nwaku args
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 41672:41672 -p 41673:41673 -p 41674:41674 -p 41675:41675 -p 41676:41676 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=41674 --rest-port=41672 --tcp-port=41673 --discv5-udp-port=41675 --rest-address=0.0.0.0 --nat=extip:172.18.69.153 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=b6dcbd26604fcf01e37a6d5beb9dda56cc7efeed66184051d9e96c5faa2deffc --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=41676 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QExuogb2lXI0pBzSb_wDkf4GVKfxIPD0G6ALS0ZWfTOlIb1TbHAk9kwXd8zFisrEkhbb1mgaST0KpbPL12KRTyQCgmlkgnY0gmlwhKwS3P2KbXVsdGlhZGRyc5YACASsEtz9BrPUAAoErBLc_Qaz1d0DgnJzhQACAQAAiXNlY3AyNTZrMaEDMHzhA4Qwk_-Y10ouNswzVkSX_wKXNRMurdtwse8BJgCDdGNwgrPUg3VkcIKz1oV3YWt1MgU
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.69.153 waku 67a17683d03e9f929d4cdbfdd5c6e2d4dee5711c76d716fd46c81e16125abf14
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 67a17683d03e. Setting up logs at ./log/docker/node2_2026-03-24_04-44-33__02017913-82e5-4922-b202-71eb4e7be1b7__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 41672
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:41672/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:41672/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:41672/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.69.153/tcp/41673/p2p/16Uiu2HAmNiwrsCBgaC2YUQPm4kzbq7FGEF5i5kN981r1xg3WtN5o","/ip4/172.18.69.153/tcp/41674/ws/p2p/16Uiu2HAmNiwrsCBgaC2YUQPm4kzbq7FGEF5i5kN981r1xg3WtN5o"],"enrUri":"enr:-L24QI-UJzoQoN35CRXoGCu2NQhFCJFhoJFjlaqeA5MKUO0JZwUw3IvMuiecVq3thw_ZJi4ag0YlZ6nGpeDUMNlelcwCgmlkgnY0gmlwhKwSRZmKbXVsdGlhZGRyc5YACASsEkWZBqLJAAoErBJFmQaiyt0DgnJzhQACAQAAiXNlY3AyNTZrMaEDlZhggYYmAdxjmL6HEHQHrkV3tem13FCZarm9v1IzOFKDdGNwgqLJg3VkcIKiy4V3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:41672/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.220.253/tcp/46036/p2p/16Uiu2HAmFvGN3m2BvTyN59sqHRuWyHxHWdbfdKpdBgGEKFDJKVmy"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:46035/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:41672/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:46035/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.1 seconds
DEBUG  src.steps.sharding:sharding.py:158 Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:46035/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
ERROR  src.node.api_clients.base_client:base_client.py:16 HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:46035/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1. Response content: b''
DEBUG  tests.conftest:conftest.py:59 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:83 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id a20e92667ff3
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 67a17683d03e
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  tests.conftest:conftest.py:98 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  tests.conftest:conftest.py:73 Running fixture teardown: attach_logs_on_fail
DEBUG  tests.conftest:conftest.py:74 Test failed, attempting to attach logs to the allure reports
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/node1_2026-03-24_04-44-33__02017913-82e5-4922-b202-71eb4e7be1b7__wakuorg_nwaku:latest.log
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/node2_2026-03-24_04-44-33__02017913-82e5-4922-b202-71eb4e7be1b7__wakuorg_nwaku:latest.log