202 lines
35 KiB
Plaintext
Raw Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

2026-04-22 23:57:37.968 INFO [tests.conftest] Fleet bootstrap inactive pass --fleet (or set FLEET_BOOTSTRAP=true) to connect local nodes to the waku.test fleet
2026-04-22 23:57:37.969 DEBUG [tests.conftest] Running fixture setup: test_id
2026-04-22 23:57:37.969 DEBUG [tests.conftest] Running test: test_single_content_topic[/app/27/sometopic/someencoding] with id: 2026-04-22_23-57-37__840b78cb-d88f-4b49-8bdf-eb65df64f571
2026-04-22 23:57:37.970 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-04-22 23:57:37.970 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-04-22 23:57:37.971 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-04-22 23:57:37.982 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-22 23:57:37.983 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-04-22_23-57-37__840b78cb-d88f-4b49-8bdf-eb65df64f571__wakuorg_nwaku:latest.log
2026-04-22 23:57:37.983 DEBUG [src.node.waku_node] Starting Node...
2026-04-22 23:57:37.983 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-22 23:57:37.986 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-22 23:57:37.987 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.206.155
2026-04-22 23:57:37.987 DEBUG [src.node.docker_mananger] Generated ports ['11556', '11557', '11558', '11559', '11560']
2026-04-22 23:57:37.987 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-22 23:57:37.987 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-22 23:57:37.987 DEBUG [src.node.waku_node] Using volumes []
2026-04-22 23:57:37.987 DEBUG [src.node.docker_mananger] docker run -i -t -p 11556:11556 -p 11557:11557 -p 11558:11558 -p 11559:11559 -p 11560:11560 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=11558 --rest-port=11556 --tcp-port=11557 --discv5-udp-port=11559 --rest-address=0.0.0.0 --nat=extip:172.18.206.155 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=fb82ccba0cfa0038332e3e2d5c09bd6b9fe0e54dafdb4550f0db20fe0b09eceb --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=11560 --metrics-logging=true --relay=true --filter=true --content-topic=/app/27/sometopic/someencoding
2026-04-22 23:57:38.183 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.206.155 waku 5288f3fc4d4f1807a9ea5cfea73fe76b7c335e4f780b500872123e4b13cd12c5
2026-04-22 23:57:38.218 DEBUG [src.node.docker_mananger] Container started with ID 5288f3fc4d4f. Setting up logs at ./log/docker/node1_2026-04-22_23-57-37__840b78cb-d88f-4b49-8bdf-eb65df64f571__wakuorg_nwaku:latest.log
2026-04-22 23:57:38.220 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 11556
2026-04-22 23:57:38.220 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-22 23:57:38.304 ERROR [src.node.docker_mananger] Max retries reached for container 55f98e190db0. Exiting log stream.
2026-04-22 23:57:38.818 ERROR [src.node.docker_mananger] Max retries reached for container a07f72c32396. Exiting log stream.
2026-04-22 23:57:39.221 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11556/health" -H "Content-Type: application/json" -d 'None'
2026-04-22 23:57:39.224 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-22 23:57:39.224 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-22 23:57:39.224 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11556/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-22 23:57:39.227 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.206.155/tcp/11557/p2p/16Uiu2HAmUpXtCYDtpow7kxs4cLxgRJoZUnciU5qidvH88g2dW9UX","/ip4/172.18.206.155/tcp/11558/ws/p2p/16Uiu2HAmUpXtCYDtpow7kxs4cLxgRJoZUnciU5qidvH88g2dW9UX"],"enrUri":"enr:-L24QI5n-9Rew3NmFdgF8qX85yuJRxwyhcECouh9yesMpiuregK6UKT0asak6fBIK-gQcNMCUb3nzkQF7WhzDOB5CbMCgmlkgnY0gmlwhKwSzpuKbXVsdGlhZGRyc5YACASsEs6bBi0lAAoErBLOmwYtJt0DgnJzhQDHAQAAiXNlY3AyNTZrMaED8CzfXCPxvnJy1stQqlxfMyaDIZsUl4Y_qCNsKuY6egSDdGNwgi0lg3VkcIItJ4V3YWt1MgU"}'
2026-04-22 23:57:39.227 INFO [src.node.waku_node] REST service is ready !!
2026-04-22 23:57:39.233 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-22 23:57:39.234 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-04-22_23-57-37__840b78cb-d88f-4b49-8bdf-eb65df64f571__wakuorg_nwaku:latest.log
2026-04-22 23:57:39.234 DEBUG [src.node.waku_node] Starting Node...
2026-04-22 23:57:39.234 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-22 23:57:39.235 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-22 23:57:39.235 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.57.12
2026-04-22 23:57:39.236 DEBUG [src.node.docker_mananger] Generated ports ['65377', '65378', '65379', '65380', '65381']
2026-04-22 23:57:39.236 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-22 23:57:39.236 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-22 23:57:39.236 DEBUG [src.node.waku_node] Using volumes []
2026-04-22 23:57:39.236 DEBUG [src.node.docker_mananger] docker run -i -t -p 65377:65377 -p 65378:65378 -p 65379:65379 -p 65380:65380 -p 65381:65381 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=65379 --rest-port=65377 --tcp-port=65378 --discv5-udp-port=65380 --rest-address=0.0.0.0 --nat=extip:172.18.57.12 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=24afc927affbf4fee0fd3361dac45af4ac7e0d8c94afd968fbce4beba62acbe5 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=65381 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QI5n-9Rew3NmFdgF8qX85yuJRxwyhcECouh9yesMpiuregK6UKT0asak6fBIK-gQcNMCUb3nzkQF7WhzDOB5CbMCgmlkgnY0gmlwhKwSzpuKbXVsdGlhZGRyc5YACASsEs6bBi0lAAoErBLOmwYtJt0DgnJzhQDHAQAAiXNlY3AyNTZrMaED8CzfXCPxvnJy1stQqlxfMyaDIZsUl4Y_qCNsKuY6egSDdGNwgi0lg3VkcIItJ4V3YWt1MgU --content-topic=/app/27/sometopic/someencoding
2026-04-22 23:57:39.423 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.57.12 waku 3e00728a6e03f6e3cf6744e578687a5857c898ef1a46a7c692ac37d1cc6bce8b
2026-04-22 23:57:39.455 DEBUG [src.node.docker_mananger] Container started with ID 3e00728a6e03. Setting up logs at ./log/docker/node2_2026-04-22_23-57-37__840b78cb-d88f-4b49-8bdf-eb65df64f571__wakuorg_nwaku:latest.log
2026-04-22 23:57:39.456 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 65377
2026-04-22 23:57:39.456 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-22 23:57:40.456 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:65377/health" -H "Content-Type: application/json" -d 'None'
2026-04-22 23:57:40.470 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-22 23:57:40.470 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-22 23:57:40.470 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:65377/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-22 23:57:40.473 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.57.12/tcp/65378/p2p/16Uiu2HAkzbbVrCxKoa5XJybxNLjsvh86M9B3Md4vpmvVx9aDwWQu","/ip4/172.18.57.12/tcp/65379/ws/p2p/16Uiu2HAkzbbVrCxKoa5XJybxNLjsvh86M9B3Md4vpmvVx9aDwWQu"],"enrUri":"enr:-L24QNNHYgUH5V0rztJSFuiYPqZkoRa0s-PTVhSxj8EzxZ14KlitxBAGpUqymiKyDGPMF527rSoy8GAxF4yGgUdI_wkCgmlkgnY0gmlwhKwSOQyKbXVsdGlhZGRyc5YACASsEjkMBv9iAAoErBI5DAb_Y90DgnJzhQDHAQAAiXNlY3AyNTZrMaECTNUs1cGmK-AT8HsOjUxebZrg7Ajuom-9FKCaVRPNts6DdGNwgv9ig3VkcIL_ZIV3YWt1MgE"}'
2026-04-22 23:57:40.473 INFO [src.node.waku_node] REST service is ready !!
2026-04-22 23:57:40.474 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:65377/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.206.155/tcp/11557/p2p/16Uiu2HAmUpXtCYDtpow7kxs4cLxgRJoZUnciU5qidvH88g2dW9UX"]'
2026-04-22 23:57:40.480 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-22 23:57:40.480 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11556/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/app/27/sometopic/someencoding"]'
2026-04-22 23:57:40.486 ERROR [src.node.api_clients.base_client] HTTP error occurred: 500 Server Error: Internal Server Error for url: http://127.0.0.1:11556/relay/v1/auto/subscriptions. Response content: b'Subscribe failed:Failed to decode subscription event: Static sharding is used, relay subscriptions must specify a pubsub topic'
2026-04-22 23:57:40.529 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-04-22 23:57:40.531 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-04-22 23:57:40.531 DEBUG [src.node.waku_node] Stopping container with id 5288f3fc4d4f
2026-04-22 23:57:41.043 DEBUG [src.node.waku_node] Container stopped.
2026-04-22 23:57:41.043 DEBUG [src.node.waku_node] Stopping container with id 3e00728a6e03
2026-04-22 23:57:41.467 DEBUG [src.node.waku_node] Container stopped.
2026-04-22 23:57:41.469 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-04-22 23:57:41.477 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-22 23:57:41.485 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-22 23:57:41.487 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-04-22 23:57:41.487 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-04-22 23:57:41.490 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-04-22_23-57-37__840b78cb-d88f-4b49-8bdf-eb65df64f571__wakuorg_nwaku:latest.log
2026-04-22 23:57:41.495 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-04-22_23-57-37__840b78cb-d88f-4b49-8bdf-eb65df64f571__wakuorg_nwaku:latest.log
2026-04-22 23:57:41.506 INFO [tests.conftest] Fleet bootstrap inactive pass --fleet (or set FLEET_BOOTSTRAP=true) to connect local nodes to the waku.test fleet
2026-04-22 23:57:41.506 DEBUG [tests.conftest] Running fixture setup: test_id
2026-04-22 23:57:41.506 DEBUG [tests.conftest] Running test: test_single_content_topic[/app/27/sometopic/someencoding] with id: 2026-04-22_23-57-41__69e98666-9def-4726-a8cc-301f52cb0a55
2026-04-22 23:57:41.506 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-04-22 23:57:41.507 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-04-22 23:57:41.507 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-04-22 23:57:41.514 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-22 23:57:41.515 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-04-22_23-57-41__69e98666-9def-4726-a8cc-301f52cb0a55__wakuorg_nwaku:latest.log
2026-04-22 23:57:41.515 DEBUG [src.node.waku_node] Starting Node...
2026-04-22 23:57:41.515 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-22 23:57:41.516 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-22 23:57:41.517 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.139.213
2026-04-22 23:57:41.517 DEBUG [src.node.docker_mananger] Generated ports ['63850', '63851', '63852', '63853', '63854']
2026-04-22 23:57:41.517 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-22 23:57:41.517 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-22 23:57:41.517 DEBUG [src.node.waku_node] Using volumes []
2026-04-22 23:57:41.517 DEBUG [src.node.docker_mananger] docker run -i -t -p 63850:63850 -p 63851:63851 -p 63852:63852 -p 63853:63853 -p 63854:63854 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=63852 --rest-port=63850 --tcp-port=63851 --discv5-udp-port=63853 --rest-address=0.0.0.0 --nat=extip:172.18.139.213 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=ce2f3ce0ea0a65cbe19dccfbbf459eb685bcba9adfbf7ac7decd7dacc5453da0 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=63854 --metrics-logging=true --relay=true --filter=true --content-topic=/app/27/sometopic/someencoding
2026-04-22 23:57:41.704 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.139.213 waku aaaa70af3a46e8ab1c9ed94d62ae97d70317d49535218ba1b78353bff7c0bc17
2026-04-22 23:57:41.739 DEBUG [src.node.docker_mananger] Container started with ID aaaa70af3a46. Setting up logs at ./log/docker/node1_2026-04-22_23-57-41__69e98666-9def-4726-a8cc-301f52cb0a55__wakuorg_nwaku:latest.log
2026-04-22 23:57:41.739 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 63850
2026-04-22 23:57:41.740 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-22 23:57:41.857 ERROR [src.node.docker_mananger] Max retries reached for container 5288f3fc4d4f. Exiting log stream.
2026-04-22 23:57:42.317 ERROR [src.node.docker_mananger] Max retries reached for container 3e00728a6e03. Exiting log stream.
2026-04-22 23:57:42.740 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63850/health" -H "Content-Type: application/json" -d 'None'
2026-04-22 23:57:42.743 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-22 23:57:42.743 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-22 23:57:42.743 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63850/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-22 23:57:42.746 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.139.213/tcp/63851/p2p/16Uiu2HAkvqbeRe7zjdmCyHDN9xMrwwLPq2HNHutZVEWMF2UbmUnC","/ip4/172.18.139.213/tcp/63852/ws/p2p/16Uiu2HAkvqbeRe7zjdmCyHDN9xMrwwLPq2HNHutZVEWMF2UbmUnC"],"enrUri":"enr:-L24QIlrtsoO7rsPWbiIm0j-9q4QJv1f_-GuhhJkfnaUbZvLEzQeqOi6H4LcdQ8_KikTtS6S3N9WaJrH2MlKokqeqoMCgmlkgnY0gmlwhKwSi9WKbXVsdGlhZGRyc5YACASsEovVBvlrAAoErBKL1Qb5bN0DgnJzhQDHAQAAiXNlY3AyNTZrMaECFPy52DMBLXoh-qGLsAhl5UTTjrHI1II-pGgK835mgymDdGNwgvlrg3VkcIL5bYV3YWt1MgU"}'
2026-04-22 23:57:42.746 INFO [src.node.waku_node] REST service is ready !!
2026-04-22 23:57:42.753 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-22 23:57:42.753 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-04-22_23-57-41__69e98666-9def-4726-a8cc-301f52cb0a55__wakuorg_nwaku:latest.log
2026-04-22 23:57:42.754 DEBUG [src.node.waku_node] Starting Node...
2026-04-22 23:57:42.754 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-22 23:57:42.755 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-22 23:57:42.755 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.45.141
2026-04-22 23:57:42.755 DEBUG [src.node.docker_mananger] Generated ports ['42138', '42139', '42140', '42141', '42142']
2026-04-22 23:57:42.755 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-22 23:57:42.756 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-22 23:57:42.756 DEBUG [src.node.waku_node] Using volumes []
2026-04-22 23:57:42.756 DEBUG [src.node.docker_mananger] docker run -i -t -p 42138:42138 -p 42139:42139 -p 42140:42140 -p 42141:42141 -p 42142:42142 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=42140 --rest-port=42138 --tcp-port=42139 --discv5-udp-port=42141 --rest-address=0.0.0.0 --nat=extip:172.18.45.141 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=cdd3642b9867ec3a8b4f5bf70aca48c1980fd6bbda48067d5fc1b5de77f7c3af --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=42142 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QIlrtsoO7rsPWbiIm0j-9q4QJv1f_-GuhhJkfnaUbZvLEzQeqOi6H4LcdQ8_KikTtS6S3N9WaJrH2MlKokqeqoMCgmlkgnY0gmlwhKwSi9WKbXVsdGlhZGRyc5YACASsEovVBvlrAAoErBKL1Qb5bN0DgnJzhQDHAQAAiXNlY3AyNTZrMaECFPy52DMBLXoh-qGLsAhl5UTTjrHI1II-pGgK835mgymDdGNwgvlrg3VkcIL5bYV3YWt1MgU --content-topic=/app/27/sometopic/someencoding
2026-04-22 23:57:42.939 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.45.141 waku af7a952061134e2da827e4bd7307f9d6944480788d539f1866c184c490d0ca9e
2026-04-22 23:57:42.972 DEBUG [src.node.docker_mananger] Container started with ID af7a95206113. Setting up logs at ./log/docker/node2_2026-04-22_23-57-41__69e98666-9def-4726-a8cc-301f52cb0a55__wakuorg_nwaku:latest.log
2026-04-22 23:57:42.972 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 42138
2026-04-22 23:57:42.973 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-22 23:57:43.973 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42138/health" -H "Content-Type: application/json" -d 'None'
2026-04-22 23:57:43.987 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-22 23:57:43.987 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-22 23:57:43.987 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42138/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-22 23:57:43.992 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.45.141/tcp/42139/p2p/16Uiu2HAmKHKrRX3oDvR5JQaxPdwBvFHDjLdHf4sT9hWpcrigGY4s","/ip4/172.18.45.141/tcp/42140/ws/p2p/16Uiu2HAmKHKrRX3oDvR5JQaxPdwBvFHDjLdHf4sT9hWpcrigGY4s"],"enrUri":"enr:-L24QHCFzN1dLKQzNZJnE2kIdYv0cnRv04HTjGgv1JN9UCBbfjDZltbVzch6VfrZdzrTadZOA29BY0C25USFqGELMG4CgmlkgnY0gmlwhKwSLY2KbXVsdGlhZGRyc5YACASsEi2NBqSbAAoErBItjQaknN0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDYnUU_qq0v_EdbrGHZUeU0fDDKRsVbBWlqWaevTFvt2SDdGNwgqSbg3VkcIKknYV3YWt1MgE"}'
2026-04-22 23:57:43.992 INFO [src.node.waku_node] REST service is ready !!
2026-04-22 23:57:43.993 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:42138/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.139.213/tcp/63851/p2p/16Uiu2HAkvqbeRe7zjdmCyHDN9xMrwwLPq2HNHutZVEWMF2UbmUnC"]'
2026-04-22 23:57:43.997 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-22 23:57:43.998 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63850/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/app/27/sometopic/someencoding"]'
2026-04-22 23:57:44.001 ERROR [src.node.api_clients.base_client] HTTP error occurred: 500 Server Error: Internal Server Error for url: http://127.0.0.1:63850/relay/v1/auto/subscriptions. Response content: b'Subscribe failed:Failed to decode subscription event: Static sharding is used, relay subscriptions must specify a pubsub topic'
2026-04-22 23:57:44.039 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-04-22 23:57:44.041 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-04-22 23:57:44.041 DEBUG [src.node.waku_node] Stopping container with id aaaa70af3a46
2026-04-22 23:57:44.490 DEBUG [src.node.waku_node] Container stopped.
2026-04-22 23:57:44.491 DEBUG [src.node.waku_node] Stopping container with id af7a95206113
2026-04-22 23:57:44.914 DEBUG [src.node.waku_node] Container stopped.
2026-04-22 23:57:44.916 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-04-22 23:57:44.928 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-22 23:57:44.934 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-22 23:57:44.936 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-04-22 23:57:44.936 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-04-22 23:57:44.937 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-04-22_23-57-41__69e98666-9def-4726-a8cc-301f52cb0a55__wakuorg_nwaku:latest.log
2026-04-22 23:57:44.937 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-04-22_23-57-41__69e98666-9def-4726-a8cc-301f52cb0a55__wakuorg_nwaku:latest.log
2026-04-22 23:57:44.941 INFO [tests.conftest] Fleet bootstrap inactive pass --fleet (or set FLEET_BOOTSTRAP=true) to connect local nodes to the waku.test fleet
2026-04-22 23:57:44.941 DEBUG [tests.conftest] Running fixture setup: test_id
2026-04-22 23:57:44.941 DEBUG [tests.conftest] Running test: test_single_content_topic[/app/27/sometopic/someencoding] with id: 2026-04-22_23-57-44__fdbbd454-91d4-4c7e-a000-2578db7fa9d4
2026-04-22 23:57:44.942 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-04-22 23:57:44.942 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-04-22 23:57:44.942 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-04-22 23:57:44.949 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-22 23:57:44.949 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-04-22_23-57-44__fdbbd454-91d4-4c7e-a000-2578db7fa9d4__wakuorg_nwaku:latest.log
2026-04-22 23:57:44.949 DEBUG [src.node.waku_node] Starting Node...
2026-04-22 23:57:44.949 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-22 23:57:44.951 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-22 23:57:44.951 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.128.147
2026-04-22 23:57:44.951 DEBUG [src.node.docker_mananger] Generated ports ['29507', '29508', '29509', '29510', '29511']
2026-04-22 23:57:44.951 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-22 23:57:44.951 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-22 23:57:44.952 DEBUG [src.node.waku_node] Using volumes []
2026-04-22 23:57:44.952 DEBUG [src.node.docker_mananger] docker run -i -t -p 29507:29507 -p 29508:29508 -p 29509:29509 -p 29510:29510 -p 29511:29511 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=29509 --rest-port=29507 --tcp-port=29508 --discv5-udp-port=29510 --rest-address=0.0.0.0 --nat=extip:172.18.128.147 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=60ff2bda9f2adf2dcf40d80f02fefaa8aecbe50bbdb9ef725a2fc4b55bf2aed1 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=29511 --metrics-logging=true --relay=true --filter=true --content-topic=/app/27/sometopic/someencoding
2026-04-22 23:57:45.134 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.128.147 waku 0ae158f0319e588cf08ac21a23cd64009ec4b61aec3da37acb0201f7c610afcf
2026-04-22 23:57:45.172 DEBUG [src.node.docker_mananger] Container started with ID 0ae158f0319e. Setting up logs at ./log/docker/node1_2026-04-22_23-57-44__fdbbd454-91d4-4c7e-a000-2578db7fa9d4__wakuorg_nwaku:latest.log
2026-04-22 23:57:45.173 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 29507
2026-04-22 23:57:45.174 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-22 23:57:45.342 ERROR [src.node.docker_mananger] Max retries reached for container aaaa70af3a46. Exiting log stream.
2026-04-22 23:57:45.740 ERROR [src.node.docker_mananger] Max retries reached for container af7a95206113. Exiting log stream.
2026-04-22 23:57:46.174 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:29507/health" -H "Content-Type: application/json" -d 'None'
2026-04-22 23:57:46.177 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-22 23:57:46.177 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-22 23:57:46.178 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:29507/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-22 23:57:46.180 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.128.147/tcp/29508/p2p/16Uiu2HAkuVX4uyGXRqdDhrjFMaSYTRAMVrB8twcdYd3dHfYRQZEp","/ip4/172.18.128.147/tcp/29509/ws/p2p/16Uiu2HAkuVX4uyGXRqdDhrjFMaSYTRAMVrB8twcdYd3dHfYRQZEp"],"enrUri":"enr:-L24QNgjyAX55qp9g2xGh1A-fzUQcRGiZs7dyua-zjcmavTIORdwBsyFa4bQxUz0Rsl05ZfWVKTZqnlNuar6wb6qfooCgmlkgnY0gmlwhKwSgJOKbXVsdGlhZGRyc5YACASsEoCTBnNEAAoErBKAkwZzRd0DgnJzhQDHAQAAiXNlY3AyNTZrMaECAPw_KaDppS8z8XLHgvdMeiGDJ2FVVZP5_9UzK8PlzpmDdGNwgnNEg3VkcIJzRoV3YWt1MgU"}'
2026-04-22 23:57:46.180 INFO [src.node.waku_node] REST service is ready !!
2026-04-22 23:57:46.187 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-22 23:57:46.187 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-04-22_23-57-44__fdbbd454-91d4-4c7e-a000-2578db7fa9d4__wakuorg_nwaku:latest.log
2026-04-22 23:57:46.188 DEBUG [src.node.waku_node] Starting Node...
2026-04-22 23:57:46.188 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-22 23:57:46.189 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-22 23:57:46.189 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.185.241
2026-04-22 23:57:46.189 DEBUG [src.node.docker_mananger] Generated ports ['18160', '18161', '18162', '18163', '18164']
2026-04-22 23:57:46.189 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-22 23:57:46.190 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-22 23:57:46.190 DEBUG [src.node.waku_node] Using volumes []
2026-04-22 23:57:46.190 DEBUG [src.node.docker_mananger] docker run -i -t -p 18160:18160 -p 18161:18161 -p 18162:18162 -p 18163:18163 -p 18164:18164 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=18162 --rest-port=18160 --tcp-port=18161 --discv5-udp-port=18163 --rest-address=0.0.0.0 --nat=extip:172.18.185.241 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=5fbf41d7283ae07b5da7b95a8ac0e1f1b9fdad11c9dbd197fa2a541144c361bb --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=18164 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QNgjyAX55qp9g2xGh1A-fzUQcRGiZs7dyua-zjcmavTIORdwBsyFa4bQxUz0Rsl05ZfWVKTZqnlNuar6wb6qfooCgmlkgnY0gmlwhKwSgJOKbXVsdGlhZGRyc5YACASsEoCTBnNEAAoErBKAkwZzRd0DgnJzhQDHAQAAiXNlY3AyNTZrMaECAPw_KaDppS8z8XLHgvdMeiGDJ2FVVZP5_9UzK8PlzpmDdGNwgnNEg3VkcIJzRoV3YWt1MgU --content-topic=/app/27/sometopic/someencoding
2026-04-22 23:57:46.387 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.185.241 waku e92bf4e59360eaee5d439c8d817fe10a23115ea535a1ff0624f0222ac6c971e6
2026-04-22 23:57:46.420 DEBUG [src.node.docker_mananger] Container started with ID e92bf4e59360. Setting up logs at ./log/docker/node2_2026-04-22_23-57-44__fdbbd454-91d4-4c7e-a000-2578db7fa9d4__wakuorg_nwaku:latest.log
2026-04-22 23:57:46.421 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 18160
2026-04-22 23:57:46.422 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-22 23:57:47.424 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18160/health" -H "Content-Type: application/json" -d 'None'
2026-04-22 23:57:47.432 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-22 23:57:47.434 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-22 23:57:47.434 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18160/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-22 23:57:47.438 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.185.241/tcp/18161/p2p/16Uiu2HAmHv1YN8ZJABW1PTtwH3fcmfXzJr3NUhSpkk94M2zmxbXx","/ip4/172.18.185.241/tcp/18162/ws/p2p/16Uiu2HAmHv1YN8ZJABW1PTtwH3fcmfXzJr3NUhSpkk94M2zmxbXx"],"enrUri":"enr:-L24QDL31hyPie2huYks0XUUfK5teT-HxyfwFkF2aS1yybSJCRLa2LwWcOsh4g6ZjhEk80Rp8gO64NXO9DhE2er-H7YCgmlkgnY0gmlwhKwSufGKbXVsdGlhZGRyc5YACASsErnxBkbxAAoErBK58QZG8t0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDTiN-Tk7G21VQO59x5MM9nDDrhnJRPVXenTFBMzdoswODdGNwgkbxg3VkcIJG84V3YWt1MgE"}'
2026-04-22 23:57:47.438 INFO [src.node.waku_node] REST service is ready !!
2026-04-22 23:57:47.439 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:18160/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.128.147/tcp/29508/p2p/16Uiu2HAkuVX4uyGXRqdDhrjFMaSYTRAMVrB8twcdYd3dHfYRQZEp"]'
2026-04-22 23:57:47.442 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-22 23:57:47.443 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:29507/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/app/27/sometopic/someencoding"]'
2026-04-22 23:57:47.446 ERROR [src.node.api_clients.base_client] HTTP error occurred: 500 Server Error: Internal Server Error for url: http://127.0.0.1:29507/relay/v1/auto/subscriptions. Response content: b'Subscribe failed:Failed to decode subscription event: Static sharding is used, relay subscriptions must specify a pubsub topic'
2026-04-22 23:57:47.488 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-04-22 23:57:47.489 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-04-22 23:57:47.490 DEBUG [src.node.waku_node] Stopping container with id 0ae158f0319e
2026-04-22 23:57:47.958 DEBUG [src.node.waku_node] Container stopped.
2026-04-22 23:57:47.961 DEBUG [src.node.waku_node] Stopping container with id e92bf4e59360
2026-04-22 23:57:48.398 DEBUG [src.node.waku_node] Container stopped.
2026-04-22 23:57:48.399 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-04-22 23:57:48.411 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-22 23:57:48.417 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-22 23:57:48.418 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-04-22 23:57:48.418 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-04-22 23:57:48.418 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-04-22_23-57-44__fdbbd454-91d4-4c7e-a000-2578db7fa9d4__wakuorg_nwaku:latest.log
2026-04-22 23:57:48.419 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-04-22_23-57-44__fdbbd454-91d4-4c7e-a000-2578db7fa9d4__wakuorg_nwaku:latest.log