2026-02-25 07:41:35 +00:00

172 lines
34 KiB
Plaintext

2026-02-25 07:23:18.855 DEBUG [tests.conftest] Running fixture setup: test_id
2026-02-25 07:23:18.856 DEBUG [tests.conftest] Running test: test_filter_auto_sharding_multiple_content_topics with id: 2026-02-25_07-23-18__fabfb1ae-0498-4480-8ff4-c7d12be86d7c
2026-02-25 07:23:18.856 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-02-25 07:23:18.856 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-02-25 07:23:18.856 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-02-25 07:23:18.865 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 07:23:18.865 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-02-25_07-23-18__fabfb1ae-0498-4480-8ff4-c7d12be86d7c__wakuorg_nwaku:latest.log
2026-02-25 07:23:18.865 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 07:23:18.865 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 07:23:18.867 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 07:23:18.867 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.85.20
2026-02-25 07:23:18.867 DEBUG [src.node.docker_mananger] Generated ports ['46809', '46810', '46811', '46812', '46813']
2026-02-25 07:23:18.867 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-02-25 07:23:18.867 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 07:23:18.868 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 07:23:18.868 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 07:23:18.868 DEBUG [src.node.docker_mananger] docker run -i -t -p 46809:46809 -p 46810:46810 -p 46811:46811 -p 46812:46812 -p 46813:46813 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=46811 --rest-port=46809 --tcp-port=46810 --discv5-udp-port=46812 --rest-address=0.0.0.0 --nat=extip:172.18.85.20 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=2e0af2f89bbb51ce7c689de53ba9850dcf16a102092a9b9cddcdeb3c0dab3dcf --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=46813 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto --content-topic=/waku/2/content/test.js --content-topic=/app/22/sometopic/someencoding --content-topic=/toychat/2/huilong/proto --content-topic=/statusim/1/community/cbor --content-topic=/app/27/sometopic/someencoding --content-topic=/app/29/sometopic/someencoding --content-topic=/app/20/sometopic/someencoding --num-shards-in-network=8
2026-02-25 07:23:19.051 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.85.20 waku 259e0582dcbf8eb37477f2d9b5153125cd68f6f53a2b5006a684c84d4525b29c
2026-02-25 07:23:19.085 DEBUG [src.node.docker_mananger] Container started with ID 259e0582dcbf. Setting up logs at ./log/docker/node1_2026-02-25_07-23-18__fabfb1ae-0498-4480-8ff4-c7d12be86d7c__wakuorg_nwaku:latest.log
2026-02-25 07:23:19.085 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 46809
2026-02-25 07:23:19.086 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 07:23:19.662 ERROR [src.node.docker_mananger] Max retries reached for container 783ccb82ad2b. Exiting log stream.
2026-02-25 07:23:20.086 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:46809/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:23:20.089 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 07:23:20.089 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 07:23:20.089 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:46809/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:23:20.092 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.85.20/tcp/46810/p2p/16Uiu2HAkuW1U4UU5fDLUjUoHuSDh9U78RVYtFbkZ8B4WEEL3oJ9G","/ip4/172.18.85.20/tcp/46811/ws/p2p/16Uiu2HAkuW1U4UU5fDLUjUoHuSDh9U78RVYtFbkZ8B4WEEL3oJ9G"],"enrUri":"enr:-L24QDFv1sXOEG3PGNeKpKD-uGUBHPEXKHB_gdHX3K7PPgFZV-25FD5hiSUfbP6aOaT4pN912IY4F6udKJQD8rDknnoCgmlkgnY0gmlwhKwSVRSKbXVsdGlhZGRyc5YACASsElUUBrbaAAoErBJVFAa2290DgnJzhQACAQAAiXNlY3AyNTZrMaECARxbkEtyDmt77zM63SLKglffETJuFGiIJp8C1dxpTjODdGNwgrbag3VkcIK23IV3YWt1MgU"}'
2026-02-25 07:23:20.092 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 07:23:20.099 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 07:23:20.099 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-02-25_07-23-18__fabfb1ae-0498-4480-8ff4-c7d12be86d7c__wakuorg_nwaku:latest.log
2026-02-25 07:23:20.099 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 07:23:20.099 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 07:23:20.101 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 07:23:20.101 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.113.112
2026-02-25 07:23:20.101 DEBUG [src.node.docker_mananger] Generated ports ['33988', '33989', '33990', '33991', '33992']
2026-02-25 07:23:20.101 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-02-25 07:23:20.101 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 07:23:20.102 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 07:23:20.102 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 07:23:20.102 DEBUG [src.node.docker_mananger] docker run -i -t -p 33988:33988 -p 33989:33989 -p 33990:33990 -p 33991:33991 -p 33992:33992 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=33990 --rest-port=33988 --tcp-port=33989 --discv5-udp-port=33991 --rest-address=0.0.0.0 --nat=extip:172.18.113.112 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=8c9eabad59bcdbf8c3bbc3adfae9aa0bbbefaae476e4feebbace9d4ae7264ad1 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=33992 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QDFv1sXOEG3PGNeKpKD-uGUBHPEXKHB_gdHX3K7PPgFZV-25FD5hiSUfbP6aOaT4pN912IY4F6udKJQD8rDknnoCgmlkgnY0gmlwhKwSVRSKbXVsdGlhZGRyc5YACASsElUUBrbaAAoErBJVFAa2290DgnJzhQACAQAAiXNlY3AyNTZrMaECARxbkEtyDmt77zM63SLKglffETJuFGiIJp8C1dxpTjODdGNwgrbag3VkcIK23IV3YWt1MgU --filternode=/ip4/172.18.85.20/tcp/46810/p2p/16Uiu2HAkuW1U4UU5fDLUjUoHuSDh9U78RVYtFbkZ8B4WEEL3oJ9G --content-topic=/myapp/1/latest/proto --content-topic=/waku/2/content/test.js --content-topic=/app/22/sometopic/someencoding --content-topic=/toychat/2/huilong/proto --content-topic=/statusim/1/community/cbor --content-topic=/app/27/sometopic/someencoding --content-topic=/app/29/sometopic/someencoding --content-topic=/app/20/sometopic/someencoding
2026-02-25 07:23:20.301 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.113.112 waku cbff26e57e7c8326bff458c7884cbc3a47673a943c3d0bb9beacbd017eee9de7
2026-02-25 07:23:20.330 DEBUG [src.node.docker_mananger] Container started with ID cbff26e57e7c. Setting up logs at ./log/docker/node2_2026-02-25_07-23-18__fabfb1ae-0498-4480-8ff4-c7d12be86d7c__wakuorg_nwaku:latest.log
2026-02-25 07:23:20.331 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 33988
2026-02-25 07:23:20.331 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 07:23:21.331 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:33988/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:23:21.334 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 07:23:21.334 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 07:23:21.334 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:33988/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:23:21.337 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.113.112/tcp/33989/p2p/16Uiu2HAmCxGDEmuXQkPfPXfrD2WX3wovddxC1ePggkGhyKRFJP8q","/ip4/172.18.113.112/tcp/33990/ws/p2p/16Uiu2HAmCxGDEmuXQkPfPXfrD2WX3wovddxC1ePggkGhyKRFJP8q"],"enrUri":"enr:-L24QJWFCw0rDJBXu1SQ4nTD1p1BF72AkOAAezc7LqQBcLR1Sv8hIvd45RF5oiOGK58J8cDlL9o8k7zTRJVcbxTIYnoCgmlkgnY0gmlwhKwScXCKbXVsdGlhZGRyc5YACASsEnFwBoTFAAoErBJxcAaExt0DgnJzhQACAQAAiXNlY3AyNTZrMaEDBGzO3DI3s0aIzs3ZnFYiCRbtiiCChxSVLgbFjV7lm-aDdGNwgoTFg3VkcIKEx4V3YWt1MgA"}'
2026-02-25 07:23:21.337 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 07:23:21.337 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33988/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.85.20/tcp/46810/p2p/16Uiu2HAkuW1U4UU5fDLUjUoHuSDh9U78RVYtFbkZ8B4WEEL3oJ9G"]'
2026-02-25 07:23:21.374 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:23:21.375 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:46809/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-02-25 07:23:21.393 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:23:21.394 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33988/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "63188e46-58f5-4781-a8f1-b6594709b664", "contentFilters": ["/myapp/1/latest/proto"], "pubsubTopic": "/waku/2/rs/2/0"}'
2026-02-25 07:23:21.405 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"63188e46-58f5-4781-a8f1-b6594709b664","statusDesc":"OK"}'
2026-02-25 07:23:21.407 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33988/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "61207098-a010-40f1-b8e5-55d2be4351a8", "contentFilters": ["/waku/2/content/test.js"], "pubsubTopic": "/waku/2/rs/2/1"}'
2026-02-25 07:23:21.417 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"61207098-a010-40f1-b8e5-55d2be4351a8","statusDesc":"OK"}'
2026-02-25 07:23:21.418 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33988/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "65277f31-a1da-4cda-9dbe-b96dbb37b301", "contentFilters": ["/app/22/sometopic/someencoding"], "pubsubTopic": "/waku/2/rs/2/2"}'
2026-02-25 07:23:21.426 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"65277f31-a1da-4cda-9dbe-b96dbb37b301","statusDesc":"OK"}'
2026-02-25 07:23:21.427 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33988/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "33adccf7-b06a-4b85-bd59-ef710ea4806a", "contentFilters": ["/toychat/2/huilong/proto"], "pubsubTopic": "/waku/2/rs/2/3"}'
2026-02-25 07:23:21.435 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"33adccf7-b06a-4b85-bd59-ef710ea4806a","statusDesc":"OK"}'
2026-02-25 07:23:21.436 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33988/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "33cddac8-a43f-4659-8713-a0d6af8b422f", "contentFilters": ["/statusim/1/community/cbor"], "pubsubTopic": "/waku/2/rs/2/4"}'
2026-02-25 07:23:21.445 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"33cddac8-a43f-4659-8713-a0d6af8b422f","statusDesc":"OK"}'
2026-02-25 07:23:21.445 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33988/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "a9b053bc-6923-40a6-bf7b-12dcc7ad5bd0", "contentFilters": ["/app/27/sometopic/someencoding"], "pubsubTopic": "/waku/2/rs/2/5"}'
2026-02-25 07:23:21.456 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"a9b053bc-6923-40a6-bf7b-12dcc7ad5bd0","statusDesc":"OK"}'
2026-02-25 07:23:21.456 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33988/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "6e7c48eb-5b51-4087-aa5d-38ca5482df08", "contentFilters": ["/app/29/sometopic/someencoding"], "pubsubTopic": "/waku/2/rs/2/6"}'
2026-02-25 07:23:21.465 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"6e7c48eb-5b51-4087-aa5d-38ca5482df08","statusDesc":"OK"}'
2026-02-25 07:23:21.466 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33988/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "1e568915-3c4e-440a-a907-b80bc023fdde", "contentFilters": ["/app/20/sometopic/someencoding"], "pubsubTopic": "/waku/2/rs/2/7"}'
2026-02-25 07:23:21.475 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"1e568915-3c4e-440a-a907-b80bc023fdde","statusDesc":"OK"}'
2026-02-25 07:23:21.476 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:46809/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:23:21.485 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:46809/relay/v1/auto/messages. Response content: b'Failed to publish: publish failed in relay: NoPeersToPublish'
2026-02-25 07:23:21.550 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-02-25 07:23:21.551 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-02-25 07:23:21.552 DEBUG [src.node.waku_node] Stopping container with id 259e0582dcbf
2026-02-25 07:23:22.129 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 07:23:22.130 DEBUG [src.node.waku_node] Stopping container with id cbff26e57e7c
2026-02-25 07:23:22.689 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 07:23:22.692 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-02-25 07:23:22.701 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 07:23:22.709 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 07:23:22.712 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-02-25 07:23:22.713 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-02-25 07:23:22.717 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-02-25_07-23-18__fabfb1ae-0498-4480-8ff4-c7d12be86d7c__wakuorg_nwaku:latest.log
2026-02-25 07:23:22.722 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-02-25_07-23-18__fabfb1ae-0498-4480-8ff4-c7d12be86d7c__wakuorg_nwaku:latest.log
2026-02-25 07:23:22.735 DEBUG [tests.conftest] Running fixture setup: test_id
2026-02-25 07:23:22.735 DEBUG [tests.conftest] Running test: test_filter_auto_sharding_multiple_content_topics with id: 2026-02-25_07-23-22__7620be43-e254-4f74-a1d3-5067c666626b
2026-02-25 07:23:22.736 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-02-25 07:23:22.736 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-02-25 07:23:22.736 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-02-25 07:23:22.747 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 07:23:22.748 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-02-25_07-23-22__7620be43-e254-4f74-a1d3-5067c666626b__wakuorg_nwaku:latest.log
2026-02-25 07:23:22.748 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 07:23:22.748 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 07:23:22.752 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 07:23:22.752 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.71.87
2026-02-25 07:23:22.752 DEBUG [src.node.docker_mananger] Generated ports ['63781', '63782', '63783', '63784', '63785']
2026-02-25 07:23:22.752 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-02-25 07:23:22.753 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 07:23:22.753 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 07:23:22.753 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 07:23:22.753 DEBUG [src.node.docker_mananger] docker run -i -t -p 63781:63781 -p 63782:63782 -p 63783:63783 -p 63784:63784 -p 63785:63785 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=63783 --rest-port=63781 --tcp-port=63782 --discv5-udp-port=63784 --rest-address=0.0.0.0 --nat=extip:172.18.71.87 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=8decd1a5e4bda82dbfe55bdc3405bde373de3423bcc6ce5a51e3ca85e5861a6b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=63785 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto --content-topic=/waku/2/content/test.js --content-topic=/app/22/sometopic/someencoding --content-topic=/toychat/2/huilong/proto --content-topic=/statusim/1/community/cbor --content-topic=/app/27/sometopic/someencoding --content-topic=/app/29/sometopic/someencoding --content-topic=/app/20/sometopic/someencoding --num-shards-in-network=8
2026-02-25 07:23:22.935 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.71.87 waku 4b7bdfe3baca7ad36d88715f272feadebfc56962e9a172997eb339cf0890931b
2026-02-25 07:23:22.947 ERROR [src.node.docker_mananger] Max retries reached for container 259e0582dcbf. Exiting log stream.
2026-02-25 07:23:22.970 DEBUG [src.node.docker_mananger] Container started with ID 4b7bdfe3baca. Setting up logs at ./log/docker/node1_2026-02-25_07-23-22__7620be43-e254-4f74-a1d3-5067c666626b__wakuorg_nwaku:latest.log
2026-02-25 07:23:22.970 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 63781
2026-02-25 07:23:22.970 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 07:23:23.567 ERROR [src.node.docker_mananger] Max retries reached for container cbff26e57e7c. Exiting log stream.
2026-02-25 07:23:23.972 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63781/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:23:23.975 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 07:23:23.975 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 07:23:23.975 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63781/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:23:23.978 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.71.87/tcp/63782/p2p/16Uiu2HAm9iqhdBgPX7u17ar6SU8nQ4e2PLD9PJ89CWEfuG1RMPNy","/ip4/172.18.71.87/tcp/63783/ws/p2p/16Uiu2HAm9iqhdBgPX7u17ar6SU8nQ4e2PLD9PJ89CWEfuG1RMPNy"],"enrUri":"enr:-L24QJnWb_5cdBx0vfYGTb4UpkfQ0hCNeBsN4f5m_gSJGybUKDbIpVo3KgUBso-Z2siq7hGG7ROUrUOdCSWe4T-XzygCgmlkgnY0gmlwhKwSR1eKbXVsdGlhZGRyc5YACASsEkdXBvkmAAoErBJHVwb5J90DgnJzhQACAQAAiXNlY3AyNTZrMaEC1Gl7iF5pbXG1mncEBXqpAoxtWC9VPZ9XWghJ8F2HTnKDdGNwgvkmg3VkcIL5KIV3YWt1MgU"}'
2026-02-25 07:23:23.978 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 07:23:23.985 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 07:23:23.985 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-02-25_07-23-22__7620be43-e254-4f74-a1d3-5067c666626b__wakuorg_nwaku:latest.log
2026-02-25 07:23:23.985 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 07:23:23.985 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 07:23:23.986 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 07:23:23.987 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.213.210
2026-02-25 07:23:23.987 DEBUG [src.node.docker_mananger] Generated ports ['38193', '38194', '38195', '38196', '38197']
2026-02-25 07:23:23.987 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-02-25 07:23:23.987 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 07:23:23.987 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 07:23:23.987 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 07:23:23.988 DEBUG [src.node.docker_mananger] docker run -i -t -p 38193:38193 -p 38194:38194 -p 38195:38195 -p 38196:38196 -p 38197:38197 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=38195 --rest-port=38193 --tcp-port=38194 --discv5-udp-port=38196 --rest-address=0.0.0.0 --nat=extip:172.18.213.210 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=e2c6bbaccbb40c31f857ced3a628917c82effbbefddfda5cddebea6cd3f8523a --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=38197 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QJnWb_5cdBx0vfYGTb4UpkfQ0hCNeBsN4f5m_gSJGybUKDbIpVo3KgUBso-Z2siq7hGG7ROUrUOdCSWe4T-XzygCgmlkgnY0gmlwhKwSR1eKbXVsdGlhZGRyc5YACASsEkdXBvkmAAoErBJHVwb5J90DgnJzhQACAQAAiXNlY3AyNTZrMaEC1Gl7iF5pbXG1mncEBXqpAoxtWC9VPZ9XWghJ8F2HTnKDdGNwgvkmg3VkcIL5KIV3YWt1MgU --filternode=/ip4/172.18.71.87/tcp/63782/p2p/16Uiu2HAm9iqhdBgPX7u17ar6SU8nQ4e2PLD9PJ89CWEfuG1RMPNy --content-topic=/myapp/1/latest/proto --content-topic=/waku/2/content/test.js --content-topic=/app/22/sometopic/someencoding --content-topic=/toychat/2/huilong/proto --content-topic=/statusim/1/community/cbor --content-topic=/app/27/sometopic/someencoding --content-topic=/app/29/sometopic/someencoding --content-topic=/app/20/sometopic/someencoding
2026-02-25 07:23:24.183 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.213.210 waku d6b0fcf92a9f5fd403fb1f4e2c8c9f4e848ad4e92cf1cea96be2d6662e6efb01
2026-02-25 07:23:24.220 DEBUG [src.node.docker_mananger] Container started with ID d6b0fcf92a9f. Setting up logs at ./log/docker/node2_2026-02-25_07-23-22__7620be43-e254-4f74-a1d3-5067c666626b__wakuorg_nwaku:latest.log
2026-02-25 07:23:24.220 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 38193
2026-02-25 07:23:24.221 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 07:23:25.222 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38193/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:23:25.225 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 07:23:25.225 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 07:23:25.225 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38193/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:23:25.228 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.213.210/tcp/38194/p2p/16Uiu2HAkubfPhdpQru1BxDEWS4oohVZWhTne4evBDZxB9WoRC5Sz","/ip4/172.18.213.210/tcp/38195/ws/p2p/16Uiu2HAkubfPhdpQru1BxDEWS4oohVZWhTne4evBDZxB9WoRC5Sz"],"enrUri":"enr:-L24QFOcExDbr59uhCBx2DauYpTgtKG_zxh4FMBUyFS311iiHD1JHx7lAaA7Kj5c0q-khJHaS0Hgs5vSMyglndPSToYCgmlkgnY0gmlwhKwS1dKKbXVsdGlhZGRyc5YACASsEtXSBpUyAAoErBLV0gaVM90DgnJzhQACAQAAiXNlY3AyNTZrMaECAo8kumJwa5rq6TPQ-a3DZspkHcPslBOxeOEFJsC536uDdGNwgpUyg3VkcIKVNIV3YWt1MgA"}'
2026-02-25 07:23:25.228 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 07:23:25.228 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38193/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.71.87/tcp/63782/p2p/16Uiu2HAm9iqhdBgPX7u17ar6SU8nQ4e2PLD9PJ89CWEfuG1RMPNy"]'
2026-02-25 07:23:25.262 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:23:25.263 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63781/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-02-25 07:23:25.283 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:23:25.284 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38193/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "383b3d0f-4538-4099-a87e-d54cb4e4fee2", "contentFilters": ["/myapp/1/latest/proto"], "pubsubTopic": "/waku/2/rs/2/0"}'
2026-02-25 07:23:25.297 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"383b3d0f-4538-4099-a87e-d54cb4e4fee2","statusDesc":"OK"}'
2026-02-25 07:23:25.298 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38193/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "c36d0586-f812-408b-95b3-c5598aeba091", "contentFilters": ["/waku/2/content/test.js"], "pubsubTopic": "/waku/2/rs/2/1"}'
2026-02-25 07:23:25.306 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"c36d0586-f812-408b-95b3-c5598aeba091","statusDesc":"OK"}'
2026-02-25 07:23:25.307 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38193/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "51cd159d-65d9-4084-b2b1-9a14943f80b7", "contentFilters": ["/app/22/sometopic/someencoding"], "pubsubTopic": "/waku/2/rs/2/2"}'
2026-02-25 07:23:25.316 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"51cd159d-65d9-4084-b2b1-9a14943f80b7","statusDesc":"OK"}'
2026-02-25 07:23:25.316 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38193/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "6b457c64-d05d-424c-8243-76892f3db63e", "contentFilters": ["/toychat/2/huilong/proto"], "pubsubTopic": "/waku/2/rs/2/3"}'
2026-02-25 07:23:25.325 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"6b457c64-d05d-424c-8243-76892f3db63e","statusDesc":"OK"}'
2026-02-25 07:23:25.325 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38193/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "dda84b18-4adc-42c9-9584-82cee2df9386", "contentFilters": ["/statusim/1/community/cbor"], "pubsubTopic": "/waku/2/rs/2/4"}'
2026-02-25 07:23:25.334 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"dda84b18-4adc-42c9-9584-82cee2df9386","statusDesc":"OK"}'
2026-02-25 07:23:25.335 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38193/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "27e9d832-fe38-4557-876b-b011bc6dcab9", "contentFilters": ["/app/27/sometopic/someencoding"], "pubsubTopic": "/waku/2/rs/2/5"}'
2026-02-25 07:23:25.344 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"27e9d832-fe38-4557-876b-b011bc6dcab9","statusDesc":"OK"}'
2026-02-25 07:23:25.344 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38193/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "e2fa5471-1f81-42ac-9db3-af890da1288b", "contentFilters": ["/app/29/sometopic/someencoding"], "pubsubTopic": "/waku/2/rs/2/6"}'
2026-02-25 07:23:25.354 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"e2fa5471-1f81-42ac-9db3-af890da1288b","statusDesc":"OK"}'
2026-02-25 07:23:25.354 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38193/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "d5d9763d-8d90-4c70-96fb-f1e40a66e813", "contentFilters": ["/app/20/sometopic/someencoding"], "pubsubTopic": "/waku/2/rs/2/7"}'
2026-02-25 07:23:25.364 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"d5d9763d-8d90-4c70-96fb-f1e40a66e813","statusDesc":"OK"}'
2026-02-25 07:23:25.364 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63781/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:23:25.374 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:63781/relay/v1/auto/messages. Response content: b'Failed to publish: publish failed in relay: NoPeersToPublish'
2026-02-25 07:23:25.411 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-02-25 07:23:25.412 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-02-25 07:23:25.412 DEBUG [src.node.waku_node] Stopping container with id 4b7bdfe3baca
2026-02-25 07:23:25.954 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 07:23:25.954 DEBUG [src.node.waku_node] Stopping container with id d6b0fcf92a9f
2026-02-25 07:23:26.494 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 07:23:26.495 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-02-25 07:23:26.515 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 07:23:26.524 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 07:23:26.525 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-02-25 07:23:26.525 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-02-25 07:23:26.526 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-02-25_07-23-22__7620be43-e254-4f74-a1d3-5067c666626b__wakuorg_nwaku:latest.log
2026-02-25 07:23:26.529 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-02-25_07-23-22__7620be43-e254-4f74-a1d3-5067c666626b__wakuorg_nwaku:latest.log