203 lines
36 KiB
Plaintext
Raw Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

2026-04-23 00:01:27.667 INFO [tests.conftest] Fleet bootstrap inactive pass --fleet (or set FLEET_BOOTSTRAP=true) to connect local nodes to the waku.test fleet
2026-04-23 00:01:27.667 DEBUG [tests.conftest] Running fixture setup: test_id
2026-04-23 00:01:27.667 DEBUG [tests.conftest] Running test: test_single_content_topic[/statusim/1/community/cbor] with id: 2026-04-23_00-01-27__296851fa-dd34-4716-b4c8-c07be424182d
2026-04-23 00:01:27.667 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-04-23 00:01:27.668 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-04-23 00:01:27.668 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-04-23 00:01:27.674 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 00:01:27.674 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-04-23_00-01-27__296851fa-dd34-4716-b4c8-c07be424182d__wakuorg_nwaku:latest.log
2026-04-23 00:01:27.674 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 00:01:27.674 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 00:01:27.675 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 00:01:27.676 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.138.226
2026-04-23 00:01:27.676 DEBUG [src.node.docker_mananger] Generated ports ['33146', '33147', '33148', '33149', '33150']
2026-04-23 00:01:27.676 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 00:01:27.676 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 00:01:27.676 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 00:01:27.676 DEBUG [src.node.docker_mananger] docker run -i -t -p 33146:33146 -p 33147:33147 -p 33148:33148 -p 33149:33149 -p 33150:33150 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=33148 --rest-port=33146 --tcp-port=33147 --discv5-udp-port=33149 --rest-address=0.0.0.0 --nat=extip:172.18.138.226 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=d3ac7ccfdcddd3c5351dde31edfde4cfc8b55bfb6cdad1a33dd3ed2e4ca83dfd --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=33150 --metrics-logging=true --relay=true --filter=true --content-topic=/statusim/1/community/cbor
2026-04-23 00:01:27.770 ERROR [src.node.docker_mananger] Max retries reached for container 644c1cdd65eb. Exiting log stream.
2026-04-23 00:01:28.457 ERROR [src.node.docker_mananger] Max retries reached for container 8a5cd298ab98. Exiting log stream.
2026-04-23 00:01:29.193 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.138.226 waku c7c49190c6914cb38decc05cf3ad94bf053c2903b05aae663f69c0d04418e145
2026-04-23 00:01:29.217 DEBUG [src.node.docker_mananger] Container started with ID c7c49190c691. Setting up logs at ./log/docker/node1_2026-04-23_00-01-27__296851fa-dd34-4716-b4c8-c07be424182d__wakuorg_nwaku:latest.log
2026-04-23 00:01:29.217 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 33146
2026-04-23 00:01:29.217 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 00:01:30.218 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:33146/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 00:01:30.220 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 00:01:30.220 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 00:01:30.220 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:33146/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 00:01:30.222 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.138.226/tcp/33147/p2p/16Uiu2HAmKmAx7d84MWVUsd8y8sRRckRpA7X467RSZt9ucEtBoFWJ","/ip4/172.18.138.226/tcp/33148/ws/p2p/16Uiu2HAmKmAx7d84MWVUsd8y8sRRckRpA7X467RSZt9ucEtBoFWJ"],"enrUri":"enr:-L24QObOtGawvu4hhm5stW6LUcXSlx3wE7HiO9SPWgFpAlmMdeiwHaFieXMKIYOYSg8_ZF_BhnZ9tPNdcR-vktvrMeoCgmlkgnY0gmlwhKwSiuKKbXVsdGlhZGRyc5YACASsEoriBoF7AAoErBKK4gaBfN0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDaZdHf1mys-FUclxnvuuDAIWa3xtwsX-HU50WlCnbJAuDdGNwgoF7g3VkcIKBfYV3YWt1MgU"}'
2026-04-23 00:01:30.222 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 00:01:30.228 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 00:01:30.228 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-04-23_00-01-27__296851fa-dd34-4716-b4c8-c07be424182d__wakuorg_nwaku:latest.log
2026-04-23 00:01:30.228 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 00:01:30.228 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 00:01:30.229 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 00:01:30.229 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.229.87
2026-04-23 00:01:30.229 DEBUG [src.node.docker_mananger] Generated ports ['18911', '18912', '18913', '18914', '18915']
2026-04-23 00:01:30.230 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 00:01:30.230 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 00:01:30.230 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 00:01:30.230 DEBUG [src.node.docker_mananger] docker run -i -t -p 18911:18911 -p 18912:18912 -p 18913:18913 -p 18914:18914 -p 18915:18915 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=18913 --rest-port=18911 --tcp-port=18912 --discv5-udp-port=18914 --rest-address=0.0.0.0 --nat=extip:172.18.229.87 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=cf98ffc9c7ff489bc2fb20ea64aa5d9b3c6dcb5412b2aac9c65007ecce3b4f92 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=18915 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QObOtGawvu4hhm5stW6LUcXSlx3wE7HiO9SPWgFpAlmMdeiwHaFieXMKIYOYSg8_ZF_BhnZ9tPNdcR-vktvrMeoCgmlkgnY0gmlwhKwSiuKKbXVsdGlhZGRyc5YACASsEoriBoF7AAoErBKK4gaBfN0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDaZdHf1mys-FUclxnvuuDAIWa3xtwsX-HU50WlCnbJAuDdGNwgoF7g3VkcIKBfYV3YWt1MgU --content-topic=/statusim/1/community/cbor
2026-04-23 00:01:30.899 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.229.87 waku 1ecd2225e14a83e823156987ac972627fad23b35915ab29f4c80c5e9e4a0e059
2026-04-23 00:01:31.434 DEBUG [src.node.docker_mananger] Container started with ID 1ecd2225e14a. Setting up logs at ./log/docker/node2_2026-04-23_00-01-27__296851fa-dd34-4716-b4c8-c07be424182d__wakuorg_nwaku:latest.log
2026-04-23 00:01:31.434 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 18911
2026-04-23 00:01:31.435 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 00:01:32.435 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18911/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 00:01:32.438 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 00:01:32.438 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 00:01:32.438 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18911/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 00:01:32.440 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.229.87/tcp/18912/p2p/16Uiu2HAmRC2iZSmG1VGxBua94Ggxix1ru23CN3gXG8cvfDHrvGd4","/ip4/172.18.229.87/tcp/18913/ws/p2p/16Uiu2HAmRC2iZSmG1VGxBua94Ggxix1ru23CN3gXG8cvfDHrvGd4"],"enrUri":"enr:-L24QItAsGR491CJ4_lLPPb0qql85U5iFSTzjp9U259m26SCEw-ZjawAm9io7CpZxg_PUM2iDHv6aL2OFcC2q8QPYmwCgmlkgnY0gmlwhKwS5VeKbXVsdGlhZGRyc5YACASsEuVXBkngAAoErBLlVwZJ4d0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDuj_snMk54BeY7RnXCKWvmx8K3qTEXOEMT07GFHPaQp-DdGNwgkngg3VkcIJJ4oV3YWt1MgE"}'
2026-04-23 00:01:32.440 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 00:01:32.440 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:18911/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.138.226/tcp/33147/p2p/16Uiu2HAmKmAx7d84MWVUsd8y8sRRckRpA7X467RSZt9ucEtBoFWJ"]'
2026-04-23 00:01:32.442 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 00:01:32.443 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33146/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/statusim/1/community/cbor"]'
2026-04-23 00:01:32.445 ERROR [src.node.api_clients.base_client] HTTP error occurred: 500 Server Error: Internal Server Error for url: http://127.0.0.1:33146/relay/v1/auto/subscriptions. Response content: b'Subscribe failed:Failed to decode subscription event: Static sharding is used, relay subscriptions must specify a pubsub topic'
2026-04-23 00:01:32.501 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-04-23 00:01:32.503 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-04-23 00:01:32.503 DEBUG [src.node.waku_node] Stopping container with id c7c49190c691
2026-04-23 00:01:34.095 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 00:01:34.099 DEBUG [src.node.waku_node] Stopping container with id 1ecd2225e14a
2026-04-23 00:01:34.918 ERROR [src.node.docker_mananger] Max retries reached for container c7c49190c691. Exiting log stream.
2026-04-23 00:01:35.817 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 00:01:35.818 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-04-23 00:01:35.827 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 00:01:35.832 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 00:01:35.832 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-04-23 00:01:35.832 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-04-23 00:01:35.833 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-04-23_00-01-27__296851fa-dd34-4716-b4c8-c07be424182d__wakuorg_nwaku:latest.log
2026-04-23 00:01:35.833 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-04-23_00-01-27__296851fa-dd34-4716-b4c8-c07be424182d__wakuorg_nwaku:latest.log
2026-04-23 00:01:35.836 INFO [tests.conftest] Fleet bootstrap inactive pass --fleet (or set FLEET_BOOTSTRAP=true) to connect local nodes to the waku.test fleet
2026-04-23 00:01:35.836 DEBUG [tests.conftest] Running fixture setup: test_id
2026-04-23 00:01:35.836 DEBUG [tests.conftest] Running test: test_single_content_topic[/statusim/1/community/cbor] with id: 2026-04-23_00-01-35__5bfaa66e-0116-4de0-a11d-cd01c44be36f
2026-04-23 00:01:35.836 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-04-23 00:01:35.836 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-04-23 00:01:35.837 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-04-23 00:01:35.843 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 00:01:35.843 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-04-23_00-01-35__5bfaa66e-0116-4de0-a11d-cd01c44be36f__wakuorg_nwaku:latest.log
2026-04-23 00:01:35.843 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 00:01:35.843 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 00:01:35.844 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 00:01:35.844 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.165.76
2026-04-23 00:01:35.844 DEBUG [src.node.docker_mananger] Generated ports ['14503', '14504', '14505', '14506', '14507']
2026-04-23 00:01:35.845 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 00:01:35.845 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 00:01:35.845 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 00:01:35.845 DEBUG [src.node.docker_mananger] docker run -i -t -p 14503:14503 -p 14504:14504 -p 14505:14505 -p 14506:14506 -p 14507:14507 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=14505 --rest-port=14503 --tcp-port=14504 --discv5-udp-port=14506 --rest-address=0.0.0.0 --nat=extip:172.18.165.76 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=63e6a1ddcb79d8f5d04d1733f3c8ca4fe1b41eeefb8f2ebfbafdf8615d0adbdd --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=14507 --metrics-logging=true --relay=true --filter=true --content-topic=/statusim/1/community/cbor
2026-04-23 00:01:36.636 ERROR [src.node.docker_mananger] Max retries reached for container 1ecd2225e14a. Exiting log stream.
2026-04-23 00:01:36.974 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.165.76 waku 926a51b94ace38f5e5d553d695eeb0833531ec4939a8577ba7487deadbeaafc0
2026-04-23 00:01:37.005 DEBUG [src.node.docker_mananger] Container started with ID 926a51b94ace. Setting up logs at ./log/docker/node1_2026-04-23_00-01-35__5bfaa66e-0116-4de0-a11d-cd01c44be36f__wakuorg_nwaku:latest.log
2026-04-23 00:01:37.006 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 14503
2026-04-23 00:01:37.006 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 00:01:38.006 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14503/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 00:01:38.008 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 00:01:38.009 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 00:01:38.009 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14503/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 00:01:38.011 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.165.76/tcp/14504/p2p/16Uiu2HAmPx7Nuts5jrsZqDR3fHhRjDuLmtwhzorG74bA5VLP93gn","/ip4/172.18.165.76/tcp/14505/ws/p2p/16Uiu2HAmPx7Nuts5jrsZqDR3fHhRjDuLmtwhzorG74bA5VLP93gn"],"enrUri":"enr:-L24QAXayanPlYCIjMPOqsU8Vx3Q0_Isou9E3hxb2unF68-JalGZZdxgUnb4-8r0akLupbsC-Y-jDvvviFtWYFCSDHUCgmlkgnY0gmlwhKwSpUyKbXVsdGlhZGRyc5YACASsEqVMBjioAAoErBKlTAY4qd0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDp9NgYtEQ8NQzJOVzQK6Ih-M4ABNtUtdKjv-M1BZP8MuDdGNwgjiog3VkcII4qoV3YWt1MgU"}'
2026-04-23 00:01:38.011 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 00:01:38.017 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 00:01:38.017 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-04-23_00-01-35__5bfaa66e-0116-4de0-a11d-cd01c44be36f__wakuorg_nwaku:latest.log
2026-04-23 00:01:38.017 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 00:01:38.017 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 00:01:38.018 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 00:01:38.018 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.143.241
2026-04-23 00:01:38.019 DEBUG [src.node.docker_mananger] Generated ports ['45269', '45270', '45271', '45272', '45273']
2026-04-23 00:01:38.019 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 00:01:38.019 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 00:01:38.019 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 00:01:38.019 DEBUG [src.node.docker_mananger] docker run -i -t -p 45269:45269 -p 45270:45270 -p 45271:45271 -p 45272:45272 -p 45273:45273 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=45271 --rest-port=45269 --tcp-port=45270 --discv5-udp-port=45272 --rest-address=0.0.0.0 --nat=extip:172.18.143.241 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=9f6cba3fd0ceddec0eacfc3ca9782aa21444caa64dafcc65e7bae6e3fcc3b1fc --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=45273 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QAXayanPlYCIjMPOqsU8Vx3Q0_Isou9E3hxb2unF68-JalGZZdxgUnb4-8r0akLupbsC-Y-jDvvviFtWYFCSDHUCgmlkgnY0gmlwhKwSpUyKbXVsdGlhZGRyc5YACASsEqVMBjioAAoErBKlTAY4qd0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDp9NgYtEQ8NQzJOVzQK6Ih-M4ABNtUtdKjv-M1BZP8MuDdGNwgjiog3VkcII4qoV3YWt1MgU --content-topic=/statusim/1/community/cbor
2026-04-23 00:01:39.225 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.143.241 waku ce686d3c48aad19d70cbafb30d6582b8cb7ac999d79eda37896ff3f52da1d263
2026-04-23 00:01:39.425 DEBUG [src.node.docker_mananger] Container started with ID ce686d3c48aa. Setting up logs at ./log/docker/node2_2026-04-23_00-01-35__5bfaa66e-0116-4de0-a11d-cd01c44be36f__wakuorg_nwaku:latest.log
2026-04-23 00:01:39.426 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 45269
2026-04-23 00:01:39.426 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 00:01:40.426 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45269/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 00:01:40.429 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 00:01:40.429 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 00:01:40.429 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45269/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 00:01:40.431 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.143.241/tcp/45270/p2p/16Uiu2HAmTwNZ2d9sKek2zL3wtt9tAeNu5sSuw5Bh4X1GL4pUWAR5","/ip4/172.18.143.241/tcp/45271/ws/p2p/16Uiu2HAmTwNZ2d9sKek2zL3wtt9tAeNu5sSuw5Bh4X1GL4pUWAR5"],"enrUri":"enr:-L24QBPrhtpXpKgzwnPi6JH997mdb8LgQuKlQMC3k3YBXVsxIOryc29kX6tvc5QQ-3Q0ukLuuINIPfSl_lxtc1y9VNkCgmlkgnY0gmlwhKwSj_GKbXVsdGlhZGRyc5YACASsEo_xBrDWAAoErBKP8Qaw190DgnJzhQDHAQAAiXNlY3AyNTZrMaED4xGzf85Jia9zzjSOY59JhfJ5eJJsUCtAsGPe3hmh5JCDdGNwgrDWg3VkcIKw2IV3YWt1MgE"}'
2026-04-23 00:01:40.431 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 00:01:40.431 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45269/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.165.76/tcp/14504/p2p/16Uiu2HAmPx7Nuts5jrsZqDR3fHhRjDuLmtwhzorG74bA5VLP93gn"]'
2026-04-23 00:01:40.433 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 00:01:40.434 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14503/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/statusim/1/community/cbor"]'
2026-04-23 00:01:40.436 ERROR [src.node.api_clients.base_client] HTTP error occurred: 500 Server Error: Internal Server Error for url: http://127.0.0.1:14503/relay/v1/auto/subscriptions. Response content: b'Subscribe failed:Failed to decode subscription event: Static sharding is used, relay subscriptions must specify a pubsub topic'
2026-04-23 00:01:40.464 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-04-23 00:01:40.465 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-04-23 00:01:40.466 DEBUG [src.node.waku_node] Stopping container with id 926a51b94ace
2026-04-23 00:01:41.989 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 00:01:41.990 DEBUG [src.node.waku_node] Stopping container with id ce686d3c48aa
2026-04-23 00:01:42.800 ERROR [src.node.docker_mananger] Max retries reached for container 926a51b94ace. Exiting log stream.
2026-04-23 00:01:42.869 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 00:01:42.871 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-04-23 00:01:42.875 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 00:01:42.880 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 00:01:42.880 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-04-23 00:01:42.881 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-04-23 00:01:42.881 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-04-23_00-01-35__5bfaa66e-0116-4de0-a11d-cd01c44be36f__wakuorg_nwaku:latest.log
2026-04-23 00:01:42.881 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-04-23_00-01-35__5bfaa66e-0116-4de0-a11d-cd01c44be36f__wakuorg_nwaku:latest.log
2026-04-23 00:01:42.884 INFO [tests.conftest] Fleet bootstrap inactive pass --fleet (or set FLEET_BOOTSTRAP=true) to connect local nodes to the waku.test fleet
2026-04-23 00:01:42.884 DEBUG [tests.conftest] Running fixture setup: test_id
2026-04-23 00:01:42.884 DEBUG [tests.conftest] Running test: test_single_content_topic[/statusim/1/community/cbor] with id: 2026-04-23_00-01-42__d8cf7f4d-b044-4c96-9a70-539948d73c3b
2026-04-23 00:01:42.885 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-04-23 00:01:42.885 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-04-23 00:01:42.885 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-04-23 00:01:42.891 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 00:01:42.891 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-04-23_00-01-42__d8cf7f4d-b044-4c96-9a70-539948d73c3b__wakuorg_nwaku:latest.log
2026-04-23 00:01:42.892 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 00:01:42.892 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 00:01:42.893 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 00:01:42.893 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.1.187
2026-04-23 00:01:42.893 DEBUG [src.node.docker_mananger] Generated ports ['58327', '58328', '58329', '58330', '58331']
2026-04-23 00:01:42.893 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 00:01:42.893 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 00:01:42.893 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 00:01:42.893 DEBUG [src.node.docker_mananger] docker run -i -t -p 58327:58327 -p 58328:58328 -p 58329:58329 -p 58330:58330 -p 58331:58331 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=58329 --rest-port=58327 --tcp-port=58328 --discv5-udp-port=58330 --rest-address=0.0.0.0 --nat=extip:172.18.1.187 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=be5affcb99116bdebdcccc633e0bb7ec8d9bb5ed9209fee5cadc48f1bd0ae8c3 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=58331 --metrics-logging=true --relay=true --filter=true --content-topic=/statusim/1/community/cbor
2026-04-23 00:01:43.680 ERROR [src.node.docker_mananger] Max retries reached for container ce686d3c48aa. Exiting log stream.
2026-04-23 00:01:44.029 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.1.187 waku 3ab4b4fe813193ffcabf0131d7eed6ffbe7f72f91b77e645aa6578f4de417dd9
2026-04-23 00:01:44.368 DEBUG [src.node.docker_mananger] Container started with ID 3ab4b4fe8131. Setting up logs at ./log/docker/node1_2026-04-23_00-01-42__d8cf7f4d-b044-4c96-9a70-539948d73c3b__wakuorg_nwaku:latest.log
2026-04-23 00:01:44.369 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 58327
2026-04-23 00:01:44.369 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 00:01:45.370 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58327/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 00:01:45.372 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 00:01:45.372 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 00:01:45.372 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58327/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 00:01:45.374 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.1.187/tcp/58328/p2p/16Uiu2HAm1X6rrznTpTqZMDPFipjqgH9YSdGw2cmseoAW9F7SBUXs","/ip4/172.18.1.187/tcp/58329/ws/p2p/16Uiu2HAm1X6rrznTpTqZMDPFipjqgH9YSdGw2cmseoAW9F7SBUXs"],"enrUri":"enr:-L24QCCYnXxRj9gGujJlQiE_GA7CLv3Vdd5Va1ZKh2LGi3xrJEtktx4S5S9jucYKuEQdO3w7L_lngk3IhBiPO1LCtIoCgmlkgnY0gmlwhKwSAbuKbXVsdGlhZGRyc5YACASsEgG7BuPYAAoErBIBuwbj2d0DgnJzhQDHAQAAiXNlY3AyNTZrMaECWoood_XxYktHEv49zFfU_Kpi4lcIZde_iUSaRQEtaiqDdGNwguPYg3VkcILj2oV3YWt1MgU"}'
2026-04-23 00:01:45.374 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 00:01:45.380 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 00:01:45.380 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-04-23_00-01-42__d8cf7f4d-b044-4c96-9a70-539948d73c3b__wakuorg_nwaku:latest.log
2026-04-23 00:01:45.381 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 00:01:45.381 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 00:01:45.382 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 00:01:45.382 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.121.185
2026-04-23 00:01:45.382 DEBUG [src.node.docker_mananger] Generated ports ['54325', '54326', '54327', '54328', '54329']
2026-04-23 00:01:45.382 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 00:01:45.382 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 00:01:45.383 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 00:01:45.383 DEBUG [src.node.docker_mananger] docker run -i -t -p 54325:54325 -p 54326:54326 -p 54327:54327 -p 54328:54328 -p 54329:54329 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=54327 --rest-port=54325 --tcp-port=54326 --discv5-udp-port=54328 --rest-address=0.0.0.0 --nat=extip:172.18.121.185 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=a6e85e79d2a0cfafbaf859dabf290b632bec3f4f514b2ad634bae2af4ba151fd --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=54329 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QCCYnXxRj9gGujJlQiE_GA7CLv3Vdd5Va1ZKh2LGi3xrJEtktx4S5S9jucYKuEQdO3w7L_lngk3IhBiPO1LCtIoCgmlkgnY0gmlwhKwSAbuKbXVsdGlhZGRyc5YACASsEgG7BuPYAAoErBIBuwbj2d0DgnJzhQDHAQAAiXNlY3AyNTZrMaECWoood_XxYktHEv49zFfU_Kpi4lcIZde_iUSaRQEtaiqDdGNwguPYg3VkcILj2oV3YWt1MgU --content-topic=/statusim/1/community/cbor
2026-04-23 00:01:46.268 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.121.185 waku c02e4a43d0100c628f07cb3b544d5b39314fb0a0addca3e8482cbccafc36a41c
2026-04-23 00:01:46.566 DEBUG [src.node.docker_mananger] Container started with ID c02e4a43d010. Setting up logs at ./log/docker/node2_2026-04-23_00-01-42__d8cf7f4d-b044-4c96-9a70-539948d73c3b__wakuorg_nwaku:latest.log
2026-04-23 00:01:46.567 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 54325
2026-04-23 00:01:46.567 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 00:01:47.568 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54325/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 00:01:47.570 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 00:01:47.571 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 00:01:47.571 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54325/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 00:01:47.572 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.121.185/tcp/54326/p2p/16Uiu2HAm5KubesUevTVXAhc3SVi5ZkcUAihW2AVG9kH4fii7LTdb","/ip4/172.18.121.185/tcp/54327/ws/p2p/16Uiu2HAm5KubesUevTVXAhc3SVi5ZkcUAihW2AVG9kH4fii7LTdb"],"enrUri":"enr:-L24QOfnC0r_YPlAXBQwfVLSu9D3Xi60G5WYSA9SMSUdqJ-vSs7aLXbqGLhkd8F3ni1NH2VCdXM4JYEt93ROV0QnIJ0CgmlkgnY0gmlwhKwSebmKbXVsdGlhZGRyc5YACASsEnm5BtQ2AAoErBJ5uQbUN90DgnJzhQDHAQAAiXNlY3AyNTZrMaECkxrIW5JNvXO2PuK4myKKCOd5I4lfbnjKAn8d5u97giqDdGNwgtQ2g3VkcILUOIV3YWt1MgE"}'
2026-04-23 00:01:47.573 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 00:01:47.573 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54325/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.1.187/tcp/58328/p2p/16Uiu2HAm1X6rrznTpTqZMDPFipjqgH9YSdGw2cmseoAW9F7SBUXs"]'
2026-04-23 00:01:47.575 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 00:01:47.575 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:58327/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/statusim/1/community/cbor"]'
2026-04-23 00:01:47.577 ERROR [src.node.api_clients.base_client] HTTP error occurred: 500 Server Error: Internal Server Error for url: http://127.0.0.1:58327/relay/v1/auto/subscriptions. Response content: b'Subscribe failed:Failed to decode subscription event: Static sharding is used, relay subscriptions must specify a pubsub topic'
2026-04-23 00:01:47.607 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-04-23 00:01:47.608 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-04-23 00:01:47.609 DEBUG [src.node.waku_node] Stopping container with id 3ab4b4fe8131
2026-04-23 00:01:48.581 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 00:01:48.581 DEBUG [src.node.waku_node] Stopping container with id c02e4a43d010
2026-04-23 00:01:49.391 ERROR [src.node.docker_mananger] Max retries reached for container 3ab4b4fe8131. Exiting log stream.
2026-04-23 00:01:50.027 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 00:01:50.029 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-04-23 00:01:50.033 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 00:01:50.038 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 00:01:50.039 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-04-23 00:01:50.039 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-04-23 00:01:50.039 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-04-23_00-01-42__d8cf7f4d-b044-4c96-9a70-539948d73c3b__wakuorg_nwaku:latest.log
2026-04-23 00:01:50.040 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-04-23_00-01-42__d8cf7f4d-b044-4c96-9a70-539948d73c3b__wakuorg_nwaku:latest.log