2026-02-25 19:46:01 +00:00

171 lines
35 KiB
Plaintext
Raw Blame History

This file contains invisible Unicode characters

This file contains invisible Unicode characters that are indistinguishable to humans but may be processed differently by a computer. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

DEBUG  tests.conftest:conftest.py:51 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:57 Running test: test_filter_auto_sharding_multiple_content_topics with id: 2026-02-25_19-27-41__7de8977f-1e75-43d7-a9c0-d6114d30be6c
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.steps.relay:relay.py:28 Running fixture setup: relay_setup
DEBUG  src.steps.sharding:sharding.py:30 Running fixture setup: sharding_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node1_2026-02-25_19-27-41__7de8977f-1e75-43d7-a9c0-d6114d30be6c__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.37.108
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['55626', '55627', '55628', '55629', '55630']
DEBUG  src.node.waku_node:waku_node.py:163 Removing pubsub-topic from nwaku args
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 55626:55626 -p 55627:55627 -p 55628:55628 -p 55629:55629 -p 55630:55630 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=55628 --rest-port=55626 --tcp-port=55627 --discv5-udp-port=55629 --rest-address=0.0.0.0 --nat=extip:172.18.37.108 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=b02ee124dacf5da3b5d67c43e7fcbafbdaacd1aeef334c8edcf50ee2e4d6df4f --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=55630 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto --content-topic=/waku/2/content/test.js --content-topic=/app/22/sometopic/someencoding --content-topic=/toychat/2/huilong/proto --content-topic=/statusim/1/community/cbor --content-topic=/app/27/sometopic/someencoding --content-topic=/app/29/sometopic/someencoding --content-topic=/app/20/sometopic/someencoding --num-shards-in-network=8
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.37.108 waku 2f65a8d9792e121e1701a0949a80665837a75f90154f3a3483a14c6b3b603fdb
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 2f65a8d9792e. Setting up logs at ./log/docker/node1_2026-02-25_19-27-41__7de8977f-1e75-43d7-a9c0-d6114d30be6c__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 55626
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container b8c8baf24e9c. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:55626/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:55626/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.37.108/tcp/55627/p2p/16Uiu2HAkwh42zfSGYUvu3tVGkPgiXn9Fwe6xKWQdzmM4RAmuLJQx","/ip4/172.18.37.108/tcp/55628/ws/p2p/16Uiu2HAkwh42zfSGYUvu3tVGkPgiXn9Fwe6xKWQdzmM4RAmuLJQx"],"enrUri":"enr:-L24QB0qPHgdUzgII5onSp_U9qEAILZTwB0nXl7mYt1X7rnBCu9UnF0kWP7Y18cm5XBlC0cu7CM22l56n7mFKmVs4owCgmlkgnY0gmlwhKwSJWyKbXVsdGlhZGRyc5YACASsEiVsBtlLAAoErBIlbAbZTN0DgnJzhQACAQAAiXNlY3AyNTZrMaECIagGHQu6h_EmhGHrasWC7cq41DdaZJ3AB1W901l5i8mDdGNwgtlLg3VkcILZTYV3YWt1MgU"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node2_2026-02-25_19-27-41__7de8977f-1e75-43d7-a9c0-d6114d30be6c__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.10.158
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['51304', '51305', '51306', '51307', '51308']
DEBUG  src.node.waku_node:waku_node.py:163 Removing pubsub-topic from nwaku args
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 51304:51304 -p 51305:51305 -p 51306:51306 -p 51307:51307 -p 51308:51308 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=51306 --rest-port=51304 --tcp-port=51305 --discv5-udp-port=51307 --rest-address=0.0.0.0 --nat=extip:172.18.10.158 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=2aebfcda7ac85786698d674f4b851bdee678f6b4e1e09a3ec9ef3555baefd0ca --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=51308 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QB0qPHgdUzgII5onSp_U9qEAILZTwB0nXl7mYt1X7rnBCu9UnF0kWP7Y18cm5XBlC0cu7CM22l56n7mFKmVs4owCgmlkgnY0gmlwhKwSJWyKbXVsdGlhZGRyc5YACASsEiVsBtlLAAoErBIlbAbZTN0DgnJzhQACAQAAiXNlY3AyNTZrMaECIagGHQu6h_EmhGHrasWC7cq41DdaZJ3AB1W901l5i8mDdGNwgtlLg3VkcILZTYV3YWt1MgU --filternode=/ip4/172.18.37.108/tcp/55627/p2p/16Uiu2HAkwh42zfSGYUvu3tVGkPgiXn9Fwe6xKWQdzmM4RAmuLJQx --content-topic=/myapp/1/latest/proto --content-topic=/waku/2/content/test.js --content-topic=/app/22/sometopic/someencoding --content-topic=/toychat/2/huilong/proto --content-topic=/statusim/1/community/cbor --content-topic=/app/27/sometopic/someencoding --content-topic=/app/29/sometopic/someencoding --content-topic=/app/20/sometopic/someencoding
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.10.158 waku 3405e3c4f489ba04ec8c57bf4105ae442d9bffb909320a4e966906c67e2e777c
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 3405e3c4f489. Setting up logs at ./log/docker/node2_2026-02-25_19-27-41__7de8977f-1e75-43d7-a9c0-d6114d30be6c__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 51304
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:51304/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:51304/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.10.158/tcp/51305/p2p/16Uiu2HAm4R4yiTMzUfGNvccywxYZ6UzFgLrfHJuRLSNb6ztR4oGz","/ip4/172.18.10.158/tcp/51306/ws/p2p/16Uiu2HAm4R4yiTMzUfGNvccywxYZ6UzFgLrfHJuRLSNb6ztR4oGz"],"enrUri":"enr:-L24QDTdfetWBpQSCrF8IMJEJvwAFF3nTjj5tSGggFPsveojEbHn-vN0rfQJjL5tNp3lm-XwzdBagq-4MLRQfIdXw4QCgmlkgnY0gmlwhKwSCp6KbXVsdGlhZGRyc5YACASsEgqeBshpAAoErBIKngbIat0DgnJzhQACAQAAiXNlY3AyNTZrMaEChZGbL1Xxbt5gsQ3rQ5SqvT5ldxPPz3aw-NoSgt_jr6-DdGNwgshpg3VkcILIa4V3YWt1MgA"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:51304/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.37.108/tcp/55627/p2p/16Uiu2HAkwh42zfSGYUvu3tVGkPgiXn9Fwe6xKWQdzmM4RAmuLJQx"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:55626/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:51304/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "7f091b1d-39c6-40f0-8a5d-604f630623c4", "contentFilters": ["/myapp/1/latest/proto"], "pubsubTopic": "/waku/2/rs/2/0"}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"requestId":"7f091b1d-39c6-40f0-8a5d-604f630623c4","statusDesc":"OK"}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:51304/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "c2b6c2ad-e5fe-4ca2-bd0e-18f926752fed", "contentFilters": ["/waku/2/content/test.js"], "pubsubTopic": "/waku/2/rs/2/1"}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"requestId":"c2b6c2ad-e5fe-4ca2-bd0e-18f926752fed","statusDesc":"OK"}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:51304/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "8bc11add-9f74-49a7-81fa-73c2dc20c458", "contentFilters": ["/app/22/sometopic/someencoding"], "pubsubTopic": "/waku/2/rs/2/2"}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"requestId":"8bc11add-9f74-49a7-81fa-73c2dc20c458","statusDesc":"OK"}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:51304/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "69326b8b-15b7-44f8-99a0-7d4b856029ce", "contentFilters": ["/toychat/2/huilong/proto"], "pubsubTopic": "/waku/2/rs/2/3"}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"requestId":"69326b8b-15b7-44f8-99a0-7d4b856029ce","statusDesc":"OK"}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:51304/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "32e412a8-8e5b-4317-8e33-15536cdf1c7c", "contentFilters": ["/statusim/1/community/cbor"], "pubsubTopic": "/waku/2/rs/2/4"}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"requestId":"32e412a8-8e5b-4317-8e33-15536cdf1c7c","statusDesc":"OK"}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:51304/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "f4f04a79-0101-49b1-9aee-3268eea700fd", "contentFilters": ["/app/27/sometopic/someencoding"], "pubsubTopic": "/waku/2/rs/2/5"}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"requestId":"f4f04a79-0101-49b1-9aee-3268eea700fd","statusDesc":"OK"}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:51304/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "905b59c6-3f97-44f1-8a78-d0fdd688a17b", "contentFilters": ["/app/29/sometopic/someencoding"], "pubsubTopic": "/waku/2/rs/2/6"}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"requestId":"905b59c6-3f97-44f1-8a78-d0fdd688a17b","statusDesc":"OK"}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:51304/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "3d50e19f-4458-41a1-a6a7-69a73750e899", "contentFilters": ["/app/20/sometopic/someencoding"], "pubsubTopic": "/waku/2/rs/2/7"}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"requestId":"3d50e19f-4458-41a1-a6a7-69a73750e899","statusDesc":"OK"}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:55626/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
ERROR  src.node.api_clients.base_client:base_client.py:16 HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:55626/relay/v1/auto/messages. Response content: b'Failed to publish: publish failed in relay: NoPeersToPublish'
DEBUG  tests.conftest:conftest.py:59 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:83 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 2f65a8d9792e
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 3405e3c4f489
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  tests.conftest:conftest.py:98 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  tests.conftest:conftest.py:73 Running fixture teardown: attach_logs_on_fail
DEBUG  tests.conftest:conftest.py:74 Test failed, attempting to attach logs to the allure reports
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/node1_2026-02-25_19-27-41__7de8977f-1e75-43d7-a9c0-d6114d30be6c__wakuorg_nwaku:latest.log
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/node2_2026-02-25_19-27-41__7de8977f-1e75-43d7-a9c0-d6114d30be6c__wakuorg_nwaku:latest.log
DEBUG  tests.conftest:conftest.py:51 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:57 Running test: test_filter_auto_sharding_multiple_content_topics with id: 2026-02-25_19-27-45__e4257a9e-7c1d-4c0a-84e6-5c83c55c9345
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.steps.relay:relay.py:28 Running fixture setup: relay_setup
DEBUG  src.steps.sharding:sharding.py:30 Running fixture setup: sharding_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node1_2026-02-25_19-27-45__e4257a9e-7c1d-4c0a-84e6-5c83c55c9345__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.7.84
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['52061', '52062', '52063', '52064', '52065']
DEBUG  src.node.waku_node:waku_node.py:163 Removing pubsub-topic from nwaku args
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 52061:52061 -p 52062:52062 -p 52063:52063 -p 52064:52064 -p 52065:52065 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=52063 --rest-port=52061 --tcp-port=52062 --discv5-udp-port=52064 --rest-address=0.0.0.0 --nat=extip:172.18.7.84 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=bbe5ded2c5d0e6fce8fb341fb9bfe8c9a17a2f71ece5e81f76c4d5a68cddf86e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=52065 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto --content-topic=/waku/2/content/test.js --content-topic=/app/22/sometopic/someencoding --content-topic=/toychat/2/huilong/proto --content-topic=/statusim/1/community/cbor --content-topic=/app/27/sometopic/someencoding --content-topic=/app/29/sometopic/someencoding --content-topic=/app/20/sometopic/someencoding --num-shards-in-network=8
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.7.84 waku c3bba004f057c0764ba742f047815813678034b4d484f9567d8afab8e4ce4e26
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 2f65a8d9792e. Exiting log stream.
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID c3bba004f057. Setting up logs at ./log/docker/node1_2026-02-25_19-27-45__e4257a9e-7c1d-4c0a-84e6-5c83c55c9345__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 52061
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 3405e3c4f489. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:52061/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:52061/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.7.84/tcp/52062/p2p/16Uiu2HAmLn1537mTjJ3HmWacocjb2CwE8t8GVApoTmpZLeqNv4KT","/ip4/172.18.7.84/tcp/52063/ws/p2p/16Uiu2HAmLn1537mTjJ3HmWacocjb2CwE8t8GVApoTmpZLeqNv4KT"],"enrUri":"enr:-L24QFo0w8By9BCZM2w3PAEyTX-_wMzhLUZoOpq3cVgjRTUUVJna4RHUlnVJSo3VVhVRL__8DGoP7EMAlnhhEoLzaOwCgmlkgnY0gmlwhKwSB1SKbXVsdGlhZGRyc5YACASsEgdUBsteAAoErBIHVAbLX90DgnJzhQACAQAAiXNlY3AyNTZrMaEDeKlf-83kuwiS_s5pMbfgC_kAu-qrbNamYwJL8JnHqvKDdGNwgsteg3VkcILLYIV3YWt1MgU"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node2_2026-02-25_19-27-45__e4257a9e-7c1d-4c0a-84e6-5c83c55c9345__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.197.193
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['2530', '2531', '2532', '2533', '2534']
DEBUG  src.node.waku_node:waku_node.py:163 Removing pubsub-topic from nwaku args
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 2530:2530 -p 2531:2531 -p 2532:2532 -p 2533:2533 -p 2534:2534 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=2532 --rest-port=2530 --tcp-port=2531 --discv5-udp-port=2533 --rest-address=0.0.0.0 --nat=extip:172.18.197.193 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=ec3646dcc4f9cdf0e3b8d99cedcc34cf1d7d8becda47efc2ea0bfae2adbccfe0 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=2534 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QFo0w8By9BCZM2w3PAEyTX-_wMzhLUZoOpq3cVgjRTUUVJna4RHUlnVJSo3VVhVRL__8DGoP7EMAlnhhEoLzaOwCgmlkgnY0gmlwhKwSB1SKbXVsdGlhZGRyc5YACASsEgdUBsteAAoErBIHVAbLX90DgnJzhQACAQAAiXNlY3AyNTZrMaEDeKlf-83kuwiS_s5pMbfgC_kAu-qrbNamYwJL8JnHqvKDdGNwgsteg3VkcILLYIV3YWt1MgU --filternode=/ip4/172.18.7.84/tcp/52062/p2p/16Uiu2HAmLn1537mTjJ3HmWacocjb2CwE8t8GVApoTmpZLeqNv4KT --content-topic=/myapp/1/latest/proto --content-topic=/waku/2/content/test.js --content-topic=/app/22/sometopic/someencoding --content-topic=/toychat/2/huilong/proto --content-topic=/statusim/1/community/cbor --content-topic=/app/27/sometopic/someencoding --content-topic=/app/29/sometopic/someencoding --content-topic=/app/20/sometopic/someencoding
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.197.193 waku 3d410a8f5b394356470ece4740f946c1bac929985fff5c9263839515e7ec3026
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 3d410a8f5b39. Setting up logs at ./log/docker/node2_2026-02-25_19-27-45__e4257a9e-7c1d-4c0a-84e6-5c83c55c9345__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 2530
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:2530/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:2530/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.197.193/tcp/2531/p2p/16Uiu2HAkxPCWEypUdnEpDCNoNKjXvUBZDqXU1hSY7cVQSzGFouvf","/ip4/172.18.197.193/tcp/2532/ws/p2p/16Uiu2HAkxPCWEypUdnEpDCNoNKjXvUBZDqXU1hSY7cVQSzGFouvf"],"enrUri":"enr:-L24QKUokq1YTDhZU5aCLJOJhmRMHwdBhMPqG0o5VxSOna_ja6U6TB7OfagY_Ffo5SiDlbXEBBQDOjgDQWcX4gwwrWsCgmlkgnY0gmlwhKwSxcGKbXVsdGlhZGRyc5YACASsEsXBBgnjAAoErBLFwQYJ5N0DgnJzhQACAQAAiXNlY3AyNTZrMaECK_DVQo1zXpI64930EKH3Hhowh506ZkyNIZ1ZN23dK6iDdGNwggnjg3VkcIIJ5YV3YWt1MgA"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:2530/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.7.84/tcp/52062/p2p/16Uiu2HAmLn1537mTjJ3HmWacocjb2CwE8t8GVApoTmpZLeqNv4KT"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:52061/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:2530/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "ce934e34-c498-4324-8f36-1e4de99ac306", "contentFilters": ["/myapp/1/latest/proto"], "pubsubTopic": "/waku/2/rs/2/0"}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"requestId":"ce934e34-c498-4324-8f36-1e4de99ac306","statusDesc":"OK"}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:2530/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "fde94be9-0d74-4e67-a0e5-8e8e2fca44a2", "contentFilters": ["/waku/2/content/test.js"], "pubsubTopic": "/waku/2/rs/2/1"}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"requestId":"fde94be9-0d74-4e67-a0e5-8e8e2fca44a2","statusDesc":"OK"}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:2530/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "74715c7e-b374-4cd1-a0dd-0961c93c457a", "contentFilters": ["/app/22/sometopic/someencoding"], "pubsubTopic": "/waku/2/rs/2/2"}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"requestId":"74715c7e-b374-4cd1-a0dd-0961c93c457a","statusDesc":"OK"}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:2530/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "f3b120ee-71b3-4f6f-85b9-18e85f85e776", "contentFilters": ["/toychat/2/huilong/proto"], "pubsubTopic": "/waku/2/rs/2/3"}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"requestId":"f3b120ee-71b3-4f6f-85b9-18e85f85e776","statusDesc":"OK"}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:2530/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "1c5e0ba4-d972-4e53-be8b-6e389c25e637", "contentFilters": ["/statusim/1/community/cbor"], "pubsubTopic": "/waku/2/rs/2/4"}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"requestId":"1c5e0ba4-d972-4e53-be8b-6e389c25e637","statusDesc":"OK"}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:2530/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "6b913b79-ee77-4a7c-9b18-331bfbdca204", "contentFilters": ["/app/27/sometopic/someencoding"], "pubsubTopic": "/waku/2/rs/2/5"}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"requestId":"6b913b79-ee77-4a7c-9b18-331bfbdca204","statusDesc":"OK"}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:2530/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "4b6a1198-364e-40b1-9c23-7bf03c2743c0", "contentFilters": ["/app/29/sometopic/someencoding"], "pubsubTopic": "/waku/2/rs/2/6"}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"requestId":"4b6a1198-364e-40b1-9c23-7bf03c2743c0","statusDesc":"OK"}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:2530/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "a32baeac-2279-4d68-a155-cb970a41f755", "contentFilters": ["/app/20/sometopic/someencoding"], "pubsubTopic": "/waku/2/rs/2/7"}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"requestId":"a32baeac-2279-4d68-a155-cb970a41f755","statusDesc":"OK"}'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:52061/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
ERROR  src.node.api_clients.base_client:base_client.py:16 HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:52061/relay/v1/auto/messages. Response content: b'Failed to publish: publish failed in relay: NoPeersToPublish'
DEBUG  tests.conftest:conftest.py:59 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:83 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id c3bba004f057
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 3d410a8f5b39
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  tests.conftest:conftest.py:98 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  tests.conftest:conftest.py:73 Running fixture teardown: attach_logs_on_fail
DEBUG  tests.conftest:conftest.py:74 Test failed, attempting to attach logs to the allure reports
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/node1_2026-02-25_19-27-45__e4257a9e-7c1d-4c0a-84e6-5c83c55c9345__wakuorg_nwaku:latest.log
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/node2_2026-02-25_19-27-45__e4257a9e-7c1d-4c0a-84e6-5c83c55c9345__wakuorg_nwaku:latest.log