2026-02-25 20:22:16 +00:00

258 lines
52 KiB
Plaintext

2026-02-25 20:04:27.036 DEBUG [tests.conftest] Running fixture setup: test_id
2026-02-25 20:04:27.037 DEBUG [tests.conftest] Running test: test_filter_auto_sharding_multiple_content_topics with id: 2026-02-25_20-04-27__aa3524db-c206-4621-a976-c6324d7c2a9a
2026-02-25 20:04:27.037 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-02-25 20:04:27.037 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-02-25 20:04:27.037 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-02-25 20:04:27.047 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 20:04:27.047 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-02-25_20-04-27__aa3524db-c206-4621-a976-c6324d7c2a9a__wakuorg_nwaku:latest.log
2026-02-25 20:04:27.047 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 20:04:27.047 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 20:04:27.049 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 20:04:27.049 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.69.179
2026-02-25 20:04:27.049 DEBUG [src.node.docker_mananger] Generated ports ['64752', '64753', '64754', '64755', '64756']
2026-02-25 20:04:27.050 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-02-25 20:04:27.050 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 20:04:27.050 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 20:04:27.050 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 20:04:27.050 DEBUG [src.node.docker_mananger] docker run -i -t -p 64752:64752 -p 64753:64753 -p 64754:64754 -p 64755:64755 -p 64756:64756 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=64754 --rest-port=64752 --tcp-port=64753 --discv5-udp-port=64755 --rest-address=0.0.0.0 --nat=extip:172.18.69.179 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=09cdcb2a6d35cfaa8b696bfcd7afb8a5c5bfdce9ef22acc245a4edd58ebf76d7 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=64756 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto --content-topic=/waku/2/content/test.js --content-topic=/app/22/sometopic/someencoding --content-topic=/toychat/2/huilong/proto --content-topic=/statusim/1/community/cbor --content-topic=/app/27/sometopic/someencoding --content-topic=/app/29/sometopic/someencoding --content-topic=/app/20/sometopic/someencoding --num-shards-in-network=8
2026-02-25 20:04:27.265 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.69.179 waku 638d6a12e3150f073ab1a44e3e914da9dc7ab7a4b294a8a3b42a11b350636a17
2026-02-25 20:04:27.302 DEBUG [src.node.docker_mananger] Container started with ID 638d6a12e315. Setting up logs at ./log/docker/node1_2026-02-25_20-04-27__aa3524db-c206-4621-a976-c6324d7c2a9a__wakuorg_nwaku:latest.log
2026-02-25 20:04:27.303 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 64752
2026-02-25 20:04:27.305 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 20:04:27.844 ERROR [src.node.docker_mananger] Max retries reached for container d5923962cea8. Exiting log stream.
2026-02-25 20:04:28.307 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64752/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:04:28.311 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 20:04:28.311 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 20:04:28.311 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64752/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:04:28.314 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.69.179/tcp/64753/p2p/16Uiu2HAmCMaSjVgo3ETQPuYxi9G7QS1ZVAmrrZyawecCgKfP49A4","/ip4/172.18.69.179/tcp/64754/ws/p2p/16Uiu2HAmCMaSjVgo3ETQPuYxi9G7QS1ZVAmrrZyawecCgKfP49A4"],"enrUri":"enr:-L24QAaXO5tjLlLW7EZjlDLCDX89y4JMypo2JO-XPJqYDyV1Rt-XIDUmV7e2GDrRE27UwGVk_5XTa9pWSVM6q3d7T8kCgmlkgnY0gmlwhKwSRbOKbXVsdGlhZGRyc5YACASsEkWzBvzxAAoErBJFswb88t0DgnJzhQACAQAAiXNlY3AyNTZrMaEC-4oYcX0msUwgtCaIYD8KOpJTy4-iHB63QeLvERy9JcWDdGNwgvzxg3VkcIL884V3YWt1MgU"}'
2026-02-25 20:04:28.314 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 20:04:28.321 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 20:04:28.321 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-02-25_20-04-27__aa3524db-c206-4621-a976-c6324d7c2a9a__wakuorg_nwaku:latest.log
2026-02-25 20:04:28.322 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 20:04:28.322 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 20:04:28.323 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 20:04:28.323 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.82.239
2026-02-25 20:04:28.324 DEBUG [src.node.docker_mananger] Generated ports ['63328', '63329', '63330', '63331', '63332']
2026-02-25 20:04:28.324 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-02-25 20:04:28.324 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 20:04:28.324 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 20:04:28.324 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 20:04:28.324 DEBUG [src.node.docker_mananger] docker run -i -t -p 63328:63328 -p 63329:63329 -p 63330:63330 -p 63331:63331 -p 63332:63332 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=63330 --rest-port=63328 --tcp-port=63329 --discv5-udp-port=63331 --rest-address=0.0.0.0 --nat=extip:172.18.82.239 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=a4fbe5ccaa3bd41c7ec729849be4afdba66a1f42cb7d72e9545a1dcc2303e0c0 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=63332 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QAaXO5tjLlLW7EZjlDLCDX89y4JMypo2JO-XPJqYDyV1Rt-XIDUmV7e2GDrRE27UwGVk_5XTa9pWSVM6q3d7T8kCgmlkgnY0gmlwhKwSRbOKbXVsdGlhZGRyc5YACASsEkWzBvzxAAoErBJFswb88t0DgnJzhQACAQAAiXNlY3AyNTZrMaEC-4oYcX0msUwgtCaIYD8KOpJTy4-iHB63QeLvERy9JcWDdGNwgvzxg3VkcIL884V3YWt1MgU --filternode=/ip4/172.18.69.179/tcp/64753/p2p/16Uiu2HAmCMaSjVgo3ETQPuYxi9G7QS1ZVAmrrZyawecCgKfP49A4 --content-topic=/myapp/1/latest/proto --content-topic=/waku/2/content/test.js --content-topic=/app/22/sometopic/someencoding --content-topic=/toychat/2/huilong/proto --content-topic=/statusim/1/community/cbor --content-topic=/app/27/sometopic/someencoding --content-topic=/app/29/sometopic/someencoding --content-topic=/app/20/sometopic/someencoding
2026-02-25 20:04:28.533 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.82.239 waku 5d6e1468a14b1d0ac37e159fdc9f9bb981576247c60fff296795dc41813b0d10
2026-02-25 20:04:28.571 DEBUG [src.node.docker_mananger] Container started with ID 5d6e1468a14b. Setting up logs at ./log/docker/node2_2026-02-25_20-04-27__aa3524db-c206-4621-a976-c6324d7c2a9a__wakuorg_nwaku:latest.log
2026-02-25 20:04:28.571 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 63328
2026-02-25 20:04:28.571 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 20:04:29.572 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63328/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:04:29.575 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 20:04:29.575 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 20:04:29.576 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63328/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:04:29.578 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.82.239/tcp/63329/p2p/16Uiu2HAm9enjAUYr3FxT5WUuCKDMrrLF3gbFGkXnzuJbZbfanx56","/ip4/172.18.82.239/tcp/63330/ws/p2p/16Uiu2HAm9enjAUYr3FxT5WUuCKDMrrLF3gbFGkXnzuJbZbfanx56"],"enrUri":"enr:-L24QFEmtp5HzS4V7Zb8QAeliXRVppf-OmUAjOmdLaJ4_nrpBn-m0qpx4uOaGMymRXyMl236QcYsNxtIFM65o4sX6sQCgmlkgnY0gmlwhKwSUu-KbXVsdGlhZGRyc5YACASsElLvBvdhAAoErBJS7wb3Yt0DgnJzhQACAQAAiXNlY3AyNTZrMaEC01_MFkTN6faHX_DKJj4zH53LRwmF-ynD7UKeIkgU-gGDdGNwgvdhg3VkcIL3Y4V3YWt1MgA"}'
2026-02-25 20:04:29.579 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 20:04:29.579 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63328/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.69.179/tcp/64753/p2p/16Uiu2HAmCMaSjVgo3ETQPuYxi9G7QS1ZVAmrrZyawecCgKfP49A4"]'
2026-02-25 20:04:29.620 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:04:29.621 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:64752/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-02-25 20:04:29.640 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:04:29.641 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63328/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "2fa2366d-873b-4538-bf74-afeea1f91a6d", "contentFilters": ["/myapp/1/latest/proto"], "pubsubTopic": "/waku/2/rs/2/0"}'
2026-02-25 20:04:29.657 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"2fa2366d-873b-4538-bf74-afeea1f91a6d","statusDesc":"OK"}'
2026-02-25 20:04:29.658 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63328/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "5866a042-783c-47bf-aebc-fe84563eac82", "contentFilters": ["/waku/2/content/test.js"], "pubsubTopic": "/waku/2/rs/2/1"}'
2026-02-25 20:04:29.669 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"5866a042-783c-47bf-aebc-fe84563eac82","statusDesc":"OK"}'
2026-02-25 20:04:29.669 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63328/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "627da8c9-7fc5-4fa8-94c4-c1c8a435642e", "contentFilters": ["/app/22/sometopic/someencoding"], "pubsubTopic": "/waku/2/rs/2/2"}'
2026-02-25 20:04:29.679 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"627da8c9-7fc5-4fa8-94c4-c1c8a435642e","statusDesc":"OK"}'
2026-02-25 20:04:29.680 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63328/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "ea322fc4-913b-4acb-9237-56c56656948f", "contentFilters": ["/toychat/2/huilong/proto"], "pubsubTopic": "/waku/2/rs/2/3"}'
2026-02-25 20:04:29.689 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"ea322fc4-913b-4acb-9237-56c56656948f","statusDesc":"OK"}'
2026-02-25 20:04:29.689 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63328/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "62326408-2764-452f-a8ed-7ac42dbc2eb3", "contentFilters": ["/statusim/1/community/cbor"], "pubsubTopic": "/waku/2/rs/2/4"}'
2026-02-25 20:04:29.700 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"62326408-2764-452f-a8ed-7ac42dbc2eb3","statusDesc":"OK"}'
2026-02-25 20:04:29.701 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63328/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "22ad634e-a01a-440c-9a3b-356ced15d8ca", "contentFilters": ["/app/27/sometopic/someencoding"], "pubsubTopic": "/waku/2/rs/2/5"}'
2026-02-25 20:04:29.711 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"22ad634e-a01a-440c-9a3b-356ced15d8ca","statusDesc":"OK"}'
2026-02-25 20:04:29.712 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63328/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "a2518d09-37b5-477b-b335-ee51117f4b26", "contentFilters": ["/app/29/sometopic/someencoding"], "pubsubTopic": "/waku/2/rs/2/6"}'
2026-02-25 20:04:29.722 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"a2518d09-37b5-477b-b335-ee51117f4b26","statusDesc":"OK"}'
2026-02-25 20:04:29.723 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63328/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "f530ed90-b15a-4c9f-b101-11534f4c6c50", "contentFilters": ["/app/20/sometopic/someencoding"], "pubsubTopic": "/waku/2/rs/2/7"}'
2026-02-25 20:04:29.734 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"f530ed90-b15a-4c9f-b101-11534f4c6c50","statusDesc":"OK"}'
2026-02-25 20:04:29.734 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:64752/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 20:04:29.744 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:64752/relay/v1/auto/messages. Response content: b'Failed to publish: publish failed in relay: NoPeersToPublish'
2026-02-25 20:04:29.819 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-02-25 20:04:29.820 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-02-25 20:04:29.820 DEBUG [src.node.waku_node] Stopping container with id 638d6a12e315
2026-02-25 20:04:30.437 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 20:04:30.439 DEBUG [src.node.waku_node] Stopping container with id 5d6e1468a14b
2026-02-25 20:04:31.060 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 20:04:31.064 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-02-25 20:04:31.081 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 20:04:31.089 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 20:04:31.091 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-02-25 20:04:31.091 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-02-25 20:04:31.094 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-02-25_20-04-27__aa3524db-c206-4621-a976-c6324d7c2a9a__wakuorg_nwaku:latest.log
2026-02-25 20:04:31.094 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-02-25_20-04-27__aa3524db-c206-4621-a976-c6324d7c2a9a__wakuorg_nwaku:latest.log
2026-02-25 20:04:31.099 DEBUG [tests.conftest] Running fixture setup: test_id
2026-02-25 20:04:31.099 DEBUG [tests.conftest] Running test: test_filter_auto_sharding_multiple_content_topics with id: 2026-02-25_20-04-31__9fdd6e50-86e4-4d97-b45a-d22735d655a6
2026-02-25 20:04:31.099 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-02-25 20:04:31.099 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-02-25 20:04:31.100 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-02-25 20:04:31.108 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 20:04:31.108 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-02-25_20-04-31__9fdd6e50-86e4-4d97-b45a-d22735d655a6__wakuorg_nwaku:latest.log
2026-02-25 20:04:31.108 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 20:04:31.109 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 20:04:31.110 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 20:04:31.110 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.235.174
2026-02-25 20:04:31.110 DEBUG [src.node.docker_mananger] Generated ports ['15047', '15048', '15049', '15050', '15051']
2026-02-25 20:04:31.111 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-02-25 20:04:31.111 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 20:04:31.111 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 20:04:31.111 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 20:04:31.111 DEBUG [src.node.docker_mananger] docker run -i -t -p 15047:15047 -p 15048:15048 -p 15049:15049 -p 15050:15050 -p 15051:15051 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=15049 --rest-port=15047 --tcp-port=15048 --discv5-udp-port=15050 --rest-address=0.0.0.0 --nat=extip:172.18.235.174 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=a6cdaa32addabfea5d4df2fbc781121c7d1387d9ddb446f565bceb30ee8757ed --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=15051 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto --content-topic=/waku/2/content/test.js --content-topic=/app/22/sometopic/someencoding --content-topic=/toychat/2/huilong/proto --content-topic=/statusim/1/community/cbor --content-topic=/app/27/sometopic/someencoding --content-topic=/app/29/sometopic/someencoding --content-topic=/app/20/sometopic/someencoding --num-shards-in-network=8
2026-02-25 20:04:31.297 ERROR [src.node.docker_mananger] Max retries reached for container 638d6a12e315. Exiting log stream.
2026-02-25 20:04:31.320 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.235.174 waku 004850ea127bd3f58824adb0c5d0eada1d97d24cd21f2712150193954ecc6cb7
2026-02-25 20:04:31.361 DEBUG [src.node.docker_mananger] Container started with ID 004850ea127b. Setting up logs at ./log/docker/node1_2026-02-25_20-04-31__9fdd6e50-86e4-4d97-b45a-d22735d655a6__wakuorg_nwaku:latest.log
2026-02-25 20:04:31.362 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 15047
2026-02-25 20:04:31.363 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 20:04:31.876 ERROR [src.node.docker_mananger] Max retries reached for container 5d6e1468a14b. Exiting log stream.
2026-02-25 20:04:32.364 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15047/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:04:32.367 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 20:04:32.367 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 20:04:32.368 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15047/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:04:32.370 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.235.174/tcp/15048/p2p/16Uiu2HAmHdw7WCn2conkJBxhR14ozGFkdxJvnVazNMZUDVdzKntB","/ip4/172.18.235.174/tcp/15049/ws/p2p/16Uiu2HAmHdw7WCn2conkJBxhR14ozGFkdxJvnVazNMZUDVdzKntB"],"enrUri":"enr:-L24QAvsUp_Q7VLZD4YUBXw9PfyA34ZWbdB9X8Ghg3Blfm7UPSJf2nxw0_ZUhtRFB8FTkFHIu7TCSRdPKDNj-ycf_u4CgmlkgnY0gmlwhKwS666KbXVsdGlhZGRyc5YACASsEuuuBjrIAAoErBLrrgY6yd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDSgUxZhViFCPZn7SUdRp-gR1jHh4JJf8GByvCqizaNMyDdGNwgjrIg3VkcII6yoV3YWt1MgU"}'
2026-02-25 20:04:32.370 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 20:04:32.378 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 20:04:32.378 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-02-25_20-04-31__9fdd6e50-86e4-4d97-b45a-d22735d655a6__wakuorg_nwaku:latest.log
2026-02-25 20:04:32.378 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 20:04:32.378 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 20:04:32.380 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 20:04:32.380 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.179.87
2026-02-25 20:04:32.380 DEBUG [src.node.docker_mananger] Generated ports ['36314', '36315', '36316', '36317', '36318']
2026-02-25 20:04:32.380 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-02-25 20:04:32.381 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 20:04:32.381 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 20:04:32.381 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 20:04:32.381 DEBUG [src.node.docker_mananger] docker run -i -t -p 36314:36314 -p 36315:36315 -p 36316:36316 -p 36317:36317 -p 36318:36318 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=36316 --rest-port=36314 --tcp-port=36315 --discv5-udp-port=36317 --rest-address=0.0.0.0 --nat=extip:172.18.179.87 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=6bdab5bd0edef20f3f74cf04ddde36c1a7da5d501b03dcab1ffb6838caedf6e4 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=36318 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QAvsUp_Q7VLZD4YUBXw9PfyA34ZWbdB9X8Ghg3Blfm7UPSJf2nxw0_ZUhtRFB8FTkFHIu7TCSRdPKDNj-ycf_u4CgmlkgnY0gmlwhKwS666KbXVsdGlhZGRyc5YACASsEuuuBjrIAAoErBLrrgY6yd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDSgUxZhViFCPZn7SUdRp-gR1jHh4JJf8GByvCqizaNMyDdGNwgjrIg3VkcII6yoV3YWt1MgU --filternode=/ip4/172.18.235.174/tcp/15048/p2p/16Uiu2HAmHdw7WCn2conkJBxhR14ozGFkdxJvnVazNMZUDVdzKntB --content-topic=/myapp/1/latest/proto --content-topic=/waku/2/content/test.js --content-topic=/app/22/sometopic/someencoding --content-topic=/toychat/2/huilong/proto --content-topic=/statusim/1/community/cbor --content-topic=/app/27/sometopic/someencoding --content-topic=/app/29/sometopic/someencoding --content-topic=/app/20/sometopic/someencoding
2026-02-25 20:04:32.601 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.179.87 waku 375cd6e9f4f92012e3976081fea7d71416974d0a7f9ab38de8eba085e329af19
2026-02-25 20:04:32.635 DEBUG [src.node.docker_mananger] Container started with ID 375cd6e9f4f9. Setting up logs at ./log/docker/node2_2026-02-25_20-04-31__9fdd6e50-86e4-4d97-b45a-d22735d655a6__wakuorg_nwaku:latest.log
2026-02-25 20:04:32.636 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 36314
2026-02-25 20:04:32.636 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 20:04:33.636 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:36314/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:04:33.640 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 20:04:33.640 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 20:04:33.640 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:36314/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:04:33.643 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.179.87/tcp/36315/p2p/16Uiu2HAmFbqzjZGzD7n6vibZxBCE9zNpmK1ZP1au78ovRQVTQUrV","/ip4/172.18.179.87/tcp/36316/ws/p2p/16Uiu2HAmFbqzjZGzD7n6vibZxBCE9zNpmK1ZP1au78ovRQVTQUrV"],"enrUri":"enr:-L24QOZZIbtQp0mTe3E9tC6mes58iupoORYA374Cx6PkeCPNTDJrBu4znbWF0HlxogqofIM_CUcJ_3p8aWcf9hUBEisCgmlkgnY0gmlwhKwSs1eKbXVsdGlhZGRyc5YACASsErNXBo3bAAoErBKzVwaN3N0DgnJzhQACAQAAiXNlY3AyNTZrMaEDK8TfO1Ys9zt3CsTwRCzFLd-dlVy4m4VbA4xjOaooUXqDdGNwgo3bg3VkcIKN3YV3YWt1MgA"}'
2026-02-25 20:04:33.644 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 20:04:33.644 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:36314/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.235.174/tcp/15048/p2p/16Uiu2HAmHdw7WCn2conkJBxhR14ozGFkdxJvnVazNMZUDVdzKntB"]'
2026-02-25 20:04:33.684 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:04:33.686 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:15047/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-02-25 20:04:33.706 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:04:33.707 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:36314/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "70beda84-3b25-42a3-9c86-91a0db504810", "contentFilters": ["/myapp/1/latest/proto"], "pubsubTopic": "/waku/2/rs/2/0"}'
2026-02-25 20:04:33.723 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"70beda84-3b25-42a3-9c86-91a0db504810","statusDesc":"OK"}'
2026-02-25 20:04:33.724 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:36314/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "0933babb-917c-4119-8a85-9ba4ce9b073b", "contentFilters": ["/waku/2/content/test.js"], "pubsubTopic": "/waku/2/rs/2/1"}'
2026-02-25 20:04:33.734 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"0933babb-917c-4119-8a85-9ba4ce9b073b","statusDesc":"OK"}'
2026-02-25 20:04:33.735 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:36314/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "23cbdb34-e3b1-4c0d-b2c0-dd9e1db6554b", "contentFilters": ["/app/22/sometopic/someencoding"], "pubsubTopic": "/waku/2/rs/2/2"}'
2026-02-25 20:04:33.748 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"23cbdb34-e3b1-4c0d-b2c0-dd9e1db6554b","statusDesc":"OK"}'
2026-02-25 20:04:33.748 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:36314/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "aa1aa1fb-5d44-4d21-8cd2-e2f3b2a0718e", "contentFilters": ["/toychat/2/huilong/proto"], "pubsubTopic": "/waku/2/rs/2/3"}'
2026-02-25 20:04:33.760 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"aa1aa1fb-5d44-4d21-8cd2-e2f3b2a0718e","statusDesc":"OK"}'
2026-02-25 20:04:33.760 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:36314/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "3d4fe7bd-76ad-4a03-a807-a095e2d85695", "contentFilters": ["/statusim/1/community/cbor"], "pubsubTopic": "/waku/2/rs/2/4"}'
2026-02-25 20:04:33.771 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"3d4fe7bd-76ad-4a03-a807-a095e2d85695","statusDesc":"OK"}'
2026-02-25 20:04:33.772 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:36314/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "0047ac8a-7401-4aaf-87a6-56936faf7f3d", "contentFilters": ["/app/27/sometopic/someencoding"], "pubsubTopic": "/waku/2/rs/2/5"}'
2026-02-25 20:04:33.783 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"0047ac8a-7401-4aaf-87a6-56936faf7f3d","statusDesc":"OK"}'
2026-02-25 20:04:33.784 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:36314/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "d1c4c7dc-e088-4766-acc9-6ca069f41a8a", "contentFilters": ["/app/29/sometopic/someencoding"], "pubsubTopic": "/waku/2/rs/2/6"}'
2026-02-25 20:04:33.797 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"d1c4c7dc-e088-4766-acc9-6ca069f41a8a","statusDesc":"OK"}'
2026-02-25 20:04:33.797 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:36314/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "73db3d1b-6e0d-4b47-b179-cbcc5be3539b", "contentFilters": ["/app/20/sometopic/someencoding"], "pubsubTopic": "/waku/2/rs/2/7"}'
2026-02-25 20:04:33.809 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"73db3d1b-6e0d-4b47-b179-cbcc5be3539b","statusDesc":"OK"}'
2026-02-25 20:04:33.810 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:15047/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 20:04:33.821 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:15047/relay/v1/auto/messages. Response content: b'Failed to publish: publish failed in relay: NoPeersToPublish'
2026-02-25 20:04:33.864 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-02-25 20:04:33.865 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-02-25 20:04:33.865 DEBUG [src.node.waku_node] Stopping container with id 004850ea127b
2026-02-25 20:04:34.478 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 20:04:34.479 DEBUG [src.node.waku_node] Stopping container with id 375cd6e9f4f9
2026-02-25 20:04:35.098 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 20:04:35.101 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-02-25 20:04:35.109 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 20:04:35.118 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 20:04:35.119 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-02-25 20:04:35.119 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-02-25 20:04:35.119 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-02-25_20-04-31__9fdd6e50-86e4-4d97-b45a-d22735d655a6__wakuorg_nwaku:latest.log
2026-02-25 20:04:35.120 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-02-25_20-04-31__9fdd6e50-86e4-4d97-b45a-d22735d655a6__wakuorg_nwaku:latest.log
2026-02-25 20:04:35.124 DEBUG [tests.conftest] Running fixture setup: test_id
2026-02-25 20:04:35.125 DEBUG [tests.conftest] Running test: test_filter_auto_sharding_multiple_content_topics with id: 2026-02-25_20-04-35__c90cceba-514d-477c-8a80-047ea1fd7153
2026-02-25 20:04:35.125 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-02-25 20:04:35.125 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-02-25 20:04:35.125 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-02-25 20:04:35.134 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 20:04:35.134 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-02-25_20-04-35__c90cceba-514d-477c-8a80-047ea1fd7153__wakuorg_nwaku:latest.log
2026-02-25 20:04:35.135 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 20:04:35.135 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 20:04:35.136 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 20:04:35.137 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.83.81
2026-02-25 20:04:35.137 DEBUG [src.node.docker_mananger] Generated ports ['20755', '20756', '20757', '20758', '20759']
2026-02-25 20:04:35.137 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-02-25 20:04:35.137 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 20:04:35.137 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 20:04:35.137 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 20:04:35.138 DEBUG [src.node.docker_mananger] docker run -i -t -p 20755:20755 -p 20756:20756 -p 20757:20757 -p 20758:20758 -p 20759:20759 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=20757 --rest-port=20755 --tcp-port=20756 --discv5-udp-port=20758 --rest-address=0.0.0.0 --nat=extip:172.18.83.81 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=e54eced5a611daafd900339fdead806a1893c1dbcc7ff92868d6d19682dbfeca --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=20759 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto --content-topic=/waku/2/content/test.js --content-topic=/app/22/sometopic/someencoding --content-topic=/toychat/2/huilong/proto --content-topic=/statusim/1/community/cbor --content-topic=/app/27/sometopic/someencoding --content-topic=/app/29/sometopic/someencoding --content-topic=/app/20/sometopic/someencoding --num-shards-in-network=8
2026-02-25 20:04:35.297 ERROR [src.node.docker_mananger] Max retries reached for container 004850ea127b. Exiting log stream.
2026-02-25 20:04:35.359 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.83.81 waku 00b44b3a9c018f60596b391623da363b1dd66986f78cc01bddc1ef7aec4b229b
2026-02-25 20:04:35.399 DEBUG [src.node.docker_mananger] Container started with ID 00b44b3a9c01. Setting up logs at ./log/docker/node1_2026-02-25_20-04-35__c90cceba-514d-477c-8a80-047ea1fd7153__wakuorg_nwaku:latest.log
2026-02-25 20:04:35.399 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 20755
2026-02-25 20:04:35.400 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 20:04:35.913 ERROR [src.node.docker_mananger] Max retries reached for container 375cd6e9f4f9. Exiting log stream.
2026-02-25 20:04:36.400 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20755/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:04:36.403 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 20:04:36.404 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 20:04:36.404 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20755/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:04:36.407 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.83.81/tcp/20756/p2p/16Uiu2HAmGW3tNCTmffFdGCSJNWjofiRSvvuxQkTuxGeKjMU19wdd","/ip4/172.18.83.81/tcp/20757/ws/p2p/16Uiu2HAmGW3tNCTmffFdGCSJNWjofiRSvvuxQkTuxGeKjMU19wdd"],"enrUri":"enr:-L24QKgm8VWjYEWeZgcK4Y9nJCfCpADl7cCQHCy1Ip_D0qaATL2HQY98lzPl7lpqUnXqNIK4bhwgXZacw6bOSkhI8ogCgmlkgnY0gmlwhKwSU1GKbXVsdGlhZGRyc5YACASsElNRBlEUAAoErBJTUQZRFd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDOSSEs6ABpbddPH7sgHhgeIVHA25pnh-xoa2-XYtUJQSDdGNwglEUg3VkcIJRFoV3YWt1MgU"}'
2026-02-25 20:04:36.407 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 20:04:36.414 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 20:04:36.414 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-02-25_20-04-35__c90cceba-514d-477c-8a80-047ea1fd7153__wakuorg_nwaku:latest.log
2026-02-25 20:04:36.414 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 20:04:36.414 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 20:04:36.416 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 20:04:36.416 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.31.24
2026-02-25 20:04:36.416 DEBUG [src.node.docker_mananger] Generated ports ['17820', '17821', '17822', '17823', '17824']
2026-02-25 20:04:36.416 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-02-25 20:04:36.416 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 20:04:36.416 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 20:04:36.417 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 20:04:36.417 DEBUG [src.node.docker_mananger] docker run -i -t -p 17820:17820 -p 17821:17821 -p 17822:17822 -p 17823:17823 -p 17824:17824 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=17822 --rest-port=17820 --tcp-port=17821 --discv5-udp-port=17823 --rest-address=0.0.0.0 --nat=extip:172.18.31.24 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=e827edbcc217af9ea77913d9f131bfe227f1cdb9cceb75fd9ea3c0ae6abe72a4 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=17824 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QKgm8VWjYEWeZgcK4Y9nJCfCpADl7cCQHCy1Ip_D0qaATL2HQY98lzPl7lpqUnXqNIK4bhwgXZacw6bOSkhI8ogCgmlkgnY0gmlwhKwSU1GKbXVsdGlhZGRyc5YACASsElNRBlEUAAoErBJTUQZRFd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDOSSEs6ABpbddPH7sgHhgeIVHA25pnh-xoa2-XYtUJQSDdGNwglEUg3VkcIJRFoV3YWt1MgU --filternode=/ip4/172.18.83.81/tcp/20756/p2p/16Uiu2HAmGW3tNCTmffFdGCSJNWjofiRSvvuxQkTuxGeKjMU19wdd --content-topic=/myapp/1/latest/proto --content-topic=/waku/2/content/test.js --content-topic=/app/22/sometopic/someencoding --content-topic=/toychat/2/huilong/proto --content-topic=/statusim/1/community/cbor --content-topic=/app/27/sometopic/someencoding --content-topic=/app/29/sometopic/someencoding --content-topic=/app/20/sometopic/someencoding
2026-02-25 20:04:36.641 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.31.24 waku 9b0507dda116e0edc7e36feac38909693d048dedf55425296b493bb681843814
2026-02-25 20:04:36.682 DEBUG [src.node.docker_mananger] Container started with ID 9b0507dda116. Setting up logs at ./log/docker/node2_2026-02-25_20-04-35__c90cceba-514d-477c-8a80-047ea1fd7153__wakuorg_nwaku:latest.log
2026-02-25 20:04:36.682 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 17820
2026-02-25 20:04:36.682 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 20:04:37.684 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17820/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:04:37.687 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 20:04:37.687 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 20:04:37.687 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17820/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:04:37.690 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.31.24/tcp/17821/p2p/16Uiu2HAkzTTwTbVHMVV3Y9uU1SiDfHY43zzUKN8XUHtmVYXAiJ91","/ip4/172.18.31.24/tcp/17822/ws/p2p/16Uiu2HAkzTTwTbVHMVV3Y9uU1SiDfHY43zzUKN8XUHtmVYXAiJ91"],"enrUri":"enr:-L24QKx0aIbN9FMKa9acKgYuZ_MzQcOR5i-cHBwPoqYknBfaAIfbvh9TEJNeF9dYBay24QxapqvJRRhnZp1IcT9QwPcCgmlkgnY0gmlwhKwSHxiKbXVsdGlhZGRyc5YACASsEh8YBkWdAAoErBIfGAZFnt0DgnJzhQACAQAAiXNlY3AyNTZrMaECSr_7eChqyn_F6L9jFERA3qrTGpG58ZU1SZ5YnVs-iayDdGNwgkWdg3VkcIJFn4V3YWt1MgA"}'
2026-02-25 20:04:37.690 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 20:04:37.691 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17820/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.83.81/tcp/20756/p2p/16Uiu2HAmGW3tNCTmffFdGCSJNWjofiRSvvuxQkTuxGeKjMU19wdd"]'
2026-02-25 20:04:37.730 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:04:37.731 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20755/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-02-25 20:04:37.750 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:04:37.752 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17820/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "dcb88a67-47f0-45da-8a9c-247346622e7a", "contentFilters": ["/myapp/1/latest/proto"], "pubsubTopic": "/waku/2/rs/2/0"}'
2026-02-25 20:04:37.767 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"dcb88a67-47f0-45da-8a9c-247346622e7a","statusDesc":"OK"}'
2026-02-25 20:04:37.767 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17820/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "8b97e06d-82fe-46f9-a687-a0d628d3e9ae", "contentFilters": ["/waku/2/content/test.js"], "pubsubTopic": "/waku/2/rs/2/1"}'
2026-02-25 20:04:37.777 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"8b97e06d-82fe-46f9-a687-a0d628d3e9ae","statusDesc":"OK"}'
2026-02-25 20:04:37.778 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17820/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "a3aa5f19-27e9-4be0-b572-ba9df3bc263f", "contentFilters": ["/app/22/sometopic/someencoding"], "pubsubTopic": "/waku/2/rs/2/2"}'
2026-02-25 20:04:37.788 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"a3aa5f19-27e9-4be0-b572-ba9df3bc263f","statusDesc":"OK"}'
2026-02-25 20:04:37.789 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17820/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "60f9990d-c93a-4f29-a76c-05ff8d36ee05", "contentFilters": ["/toychat/2/huilong/proto"], "pubsubTopic": "/waku/2/rs/2/3"}'
2026-02-25 20:04:37.799 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"60f9990d-c93a-4f29-a76c-05ff8d36ee05","statusDesc":"OK"}'
2026-02-25 20:04:37.799 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17820/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "264cb651-3805-4f13-9ece-2fdc00c8c7e7", "contentFilters": ["/statusim/1/community/cbor"], "pubsubTopic": "/waku/2/rs/2/4"}'
2026-02-25 20:04:37.810 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"264cb651-3805-4f13-9ece-2fdc00c8c7e7","statusDesc":"OK"}'
2026-02-25 20:04:37.810 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17820/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "2ab2bbda-4736-47ee-9904-9669dd65e013", "contentFilters": ["/app/27/sometopic/someencoding"], "pubsubTopic": "/waku/2/rs/2/5"}'
2026-02-25 20:04:37.821 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"2ab2bbda-4736-47ee-9904-9669dd65e013","statusDesc":"OK"}'
2026-02-25 20:04:37.821 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17820/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "714a7ace-5710-4626-8209-60a4f25036af", "contentFilters": ["/app/29/sometopic/someencoding"], "pubsubTopic": "/waku/2/rs/2/6"}'
2026-02-25 20:04:37.832 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"714a7ace-5710-4626-8209-60a4f25036af","statusDesc":"OK"}'
2026-02-25 20:04:37.833 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17820/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "7bd37794-fe3e-4537-888d-458e0aba9278", "contentFilters": ["/app/20/sometopic/someencoding"], "pubsubTopic": "/waku/2/rs/2/7"}'
2026-02-25 20:04:37.843 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"7bd37794-fe3e-4537-888d-458e0aba9278","statusDesc":"OK"}'
2026-02-25 20:04:37.844 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20755/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 20:04:37.854 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:20755/relay/v1/auto/messages. Response content: b'Failed to publish: publish failed in relay: NoPeersToPublish'
2026-02-25 20:04:37.894 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-02-25 20:04:37.895 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-02-25 20:04:37.896 DEBUG [src.node.waku_node] Stopping container with id 00b44b3a9c01
2026-02-25 20:04:38.531 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 20:04:38.535 DEBUG [src.node.waku_node] Stopping container with id 9b0507dda116
2026-02-25 20:04:39.153 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 20:04:39.155 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-02-25 20:04:39.175 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 20:04:39.183 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 20:04:39.185 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-02-25 20:04:39.185 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-02-25 20:04:39.187 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-02-25_20-04-35__c90cceba-514d-477c-8a80-047ea1fd7153__wakuorg_nwaku:latest.log
2026-02-25 20:04:39.188 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-02-25_20-04-35__c90cceba-514d-477c-8a80-047ea1fd7153__wakuorg_nwaku:latest.log