199 lines
35 KiB
Plaintext

2026-04-23 22:04:13.270 DEBUG [tests.conftest] Running fixture setup: test_id
2026-04-23 22:04:13.270 DEBUG [tests.conftest] Running test: test_single_content_topic[/myapp/1/latest/proto] with id: 2026-04-23_22-04-13__9f1f9ad8-9650-48ec-b0c1-f0936ff74d5f
2026-04-23 22:04:13.270 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-04-23 22:04:13.271 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-04-23 22:04:13.271 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-04-23 22:04:13.278 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 22:04:13.279 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-04-23_22-04-13__9f1f9ad8-9650-48ec-b0c1-f0936ff74d5f__wakuorg_nwaku:latest.log
2026-04-23 22:04:13.279 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 22:04:13.279 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 22:04:13.281 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 22:04:13.281 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.10.161
2026-04-23 22:04:13.281 DEBUG [src.node.docker_mananger] Generated ports ['25459', '25460', '25461', '25462', '25463']
2026-04-23 22:04:13.281 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 22:04:13.281 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 22:04:13.281 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 22:04:13.281 DEBUG [src.node.docker_mananger] docker run -i -t -p 25459:25459 -p 25460:25460 -p 25461:25461 -p 25462:25462 -p 25463:25463 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=25461 --rest-port=25459 --tcp-port=25460 --discv5-udp-port=25462 --rest-address=0.0.0.0 --nat=extip:172.18.10.161 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=1d7a8f5a2943f8dfbdba06a64ce7a9583aba038ac1f9bea2f54fbefce83bb4d9 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=25463 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto
2026-04-23 22:04:13.469 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.10.161 waku a1fdbee693b40dbcad0781cc95cee626d3f4a665b3799145757c50aaa4c09084
2026-04-23 22:04:13.505 DEBUG [src.node.docker_mananger] Container started with ID a1fdbee693b4. Setting up logs at ./log/docker/node1_2026-04-23_22-04-13__9f1f9ad8-9650-48ec-b0c1-f0936ff74d5f__wakuorg_nwaku:latest.log
2026-04-23 22:04:13.506 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 25459
2026-04-23 22:04:13.506 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 22:04:13.612 ERROR [src.node.docker_mananger] Max retries reached for container e3c6d7ecc21a. Exiting log stream.
2026-04-23 22:04:14.067 ERROR [src.node.docker_mananger] Max retries reached for container 8865667ac245. Exiting log stream.
2026-04-23 22:04:14.507 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25459/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:04:14.510 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 22:04:14.510 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 22:04:14.511 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25459/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:04:14.513 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.10.161/tcp/25460/p2p/16Uiu2HAm8a5USTEURubLHWAPD4SAHd7EGAxWnLBXGUVEGNZ3d7bK","/ip4/172.18.10.161/tcp/25461/ws/p2p/16Uiu2HAm8a5USTEURubLHWAPD4SAHd7EGAxWnLBXGUVEGNZ3d7bK"],"enrUri":"enr:-L24QLQYVyqKFiCDZMDh7DB4eHElEyuuxwR6B6YXpF_De158CxvqfRRvU_qgGYK1SbS6MiEq4-ONQ4qpRcU4BzqfpzMCgmlkgnY0gmlwhKwSCqGKbXVsdGlhZGRyc5YACASsEgqhBmN0AAoErBIKoQZjdd0DgnJzhQDHAQAAiXNlY3AyNTZrMaECw08kIn1dWLG8v5gA-AOmwu-jrvpNqVFqAD1GdNPWPB6DdGNwgmN0g3VkcIJjdoV3YWt1MgU"}'
2026-04-23 22:04:14.513 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 22:04:14.521 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 22:04:14.521 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-04-23_22-04-13__9f1f9ad8-9650-48ec-b0c1-f0936ff74d5f__wakuorg_nwaku:latest.log
2026-04-23 22:04:14.521 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 22:04:14.521 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 22:04:14.523 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 22:04:14.523 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.215.158
2026-04-23 22:04:14.523 DEBUG [src.node.docker_mananger] Generated ports ['3924', '3925', '3926', '3927', '3928']
2026-04-23 22:04:14.523 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 22:04:14.523 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 22:04:14.524 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 22:04:14.524 DEBUG [src.node.docker_mananger] docker run -i -t -p 3924:3924 -p 3925:3925 -p 3926:3926 -p 3927:3927 -p 3928:3928 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=3926 --rest-port=3924 --tcp-port=3925 --discv5-udp-port=3927 --rest-address=0.0.0.0 --nat=extip:172.18.215.158 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=e2adb1de7bbeb0da4131dcf0489b1bebc099eefaf7bd5022c40314fbc715b44d --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=3928 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QLQYVyqKFiCDZMDh7DB4eHElEyuuxwR6B6YXpF_De158CxvqfRRvU_qgGYK1SbS6MiEq4-ONQ4qpRcU4BzqfpzMCgmlkgnY0gmlwhKwSCqGKbXVsdGlhZGRyc5YACASsEgqhBmN0AAoErBIKoQZjdd0DgnJzhQDHAQAAiXNlY3AyNTZrMaECw08kIn1dWLG8v5gA-AOmwu-jrvpNqVFqAD1GdNPWPB6DdGNwgmN0g3VkcIJjdoV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-04-23 22:04:14.725 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.215.158 waku 7d66ea4de03d2de1c168095b8135c58995355b022fc9b5fd73380a366f1d46b0
2026-04-23 22:04:14.765 DEBUG [src.node.docker_mananger] Container started with ID 7d66ea4de03d. Setting up logs at ./log/docker/node2_2026-04-23_22-04-13__9f1f9ad8-9650-48ec-b0c1-f0936ff74d5f__wakuorg_nwaku:latest.log
2026-04-23 22:04:14.766 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 3924
2026-04-23 22:04:14.766 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 22:04:15.767 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3924/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:04:15.776 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 22:04:15.777 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 22:04:15.778 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3924/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:04:15.782 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.215.158/tcp/3925/p2p/16Uiu2HAkvTteSv9RN6xngMLbkxpKjsc9arU5VGudgg7FECvjJhxT","/ip4/172.18.215.158/tcp/3926/ws/p2p/16Uiu2HAkvTteSv9RN6xngMLbkxpKjsc9arU5VGudgg7FECvjJhxT"],"enrUri":"enr:-L24QNyEbfUG5USH8l1Y9_9IQHztY7NRTCm1zarDHk7rcsHsPbkJyg--FjPogNzHn9OI-bf4A1xYepZuARB5drpZbh0CgmlkgnY0gmlwhKwS156KbXVsdGlhZGRyc5YACASsEteeBg9VAAoErBLXngYPVt0DgnJzhQDHAQAAiXNlY3AyNTZrMaECD20rqOPBSZySroYfmqICPeWFk-6cS--ru-Vi7nrYwNiDdGNwgg9Vg3VkcIIPV4V3YWt1MgE"}'
2026-04-23 22:04:15.782 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 22:04:15.783 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3924/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.10.161/tcp/25460/p2p/16Uiu2HAm8a5USTEURubLHWAPD4SAHd7EGAxWnLBXGUVEGNZ3d7bK"]'
2026-04-23 22:04:15.786 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 22:04:15.787 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:25459/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-04-23 22:04:15.789 ERROR [src.node.api_clients.base_client] HTTP error occurred: 500 Server Error: Internal Server Error for url: http://127.0.0.1:25459/relay/v1/auto/subscriptions. Response content: b'Subscribe failed:Failed to decode subscription event: Static sharding is used, relay subscriptions must specify a pubsub topic'
2026-04-23 22:04:15.859 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-04-23 22:04:15.860 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-04-23 22:04:15.861 DEBUG [src.node.waku_node] Stopping container with id a1fdbee693b4
2026-04-23 22:04:16.348 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 22:04:16.348 DEBUG [src.node.waku_node] Stopping container with id 7d66ea4de03d
2026-04-23 22:04:16.846 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 22:04:16.849 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-04-23 22:04:16.859 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 22:04:16.865 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 22:04:16.865 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-04-23 22:04:16.865 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-04-23 22:04:16.866 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-04-23_22-04-13__9f1f9ad8-9650-48ec-b0c1-f0936ff74d5f__wakuorg_nwaku:latest.log
2026-04-23 22:04:16.867 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-04-23_22-04-13__9f1f9ad8-9650-48ec-b0c1-f0936ff74d5f__wakuorg_nwaku:latest.log
2026-04-23 22:04:16.870 DEBUG [tests.conftest] Running fixture setup: test_id
2026-04-23 22:04:16.871 DEBUG [tests.conftest] Running test: test_single_content_topic[/myapp/1/latest/proto] with id: 2026-04-23_22-04-16__a44cf8a5-674f-4a03-b9fc-63da04c212f3
2026-04-23 22:04:16.871 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-04-23 22:04:16.871 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-04-23 22:04:16.871 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-04-23 22:04:16.880 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 22:04:16.880 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-04-23_22-04-16__a44cf8a5-674f-4a03-b9fc-63da04c212f3__wakuorg_nwaku:latest.log
2026-04-23 22:04:16.880 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 22:04:16.880 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 22:04:16.882 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 22:04:16.882 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.7.71
2026-04-23 22:04:16.882 DEBUG [src.node.docker_mananger] Generated ports ['2812', '2813', '2814', '2815', '2816']
2026-04-23 22:04:16.882 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 22:04:16.883 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 22:04:16.883 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 22:04:16.883 DEBUG [src.node.docker_mananger] docker run -i -t -p 2812:2812 -p 2813:2813 -p 2814:2814 -p 2815:2815 -p 2816:2816 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=2814 --rest-port=2812 --tcp-port=2813 --discv5-udp-port=2815 --rest-address=0.0.0.0 --nat=extip:172.18.7.71 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=f49da9df8e9bfe4ec51f6b7c185be52ad5fed4d3fea94cda2d99d5cc78b93cd7 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=2816 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto
2026-04-23 22:04:17.078 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.7.71 waku 0cbc09abd6e8bc82db8a3bcb3ec682e672e98d9ed3dff27c863b904058f43ece
2026-04-23 22:04:17.113 DEBUG [src.node.docker_mananger] Container started with ID 0cbc09abd6e8. Setting up logs at ./log/docker/node1_2026-04-23_22-04-16__a44cf8a5-674f-4a03-b9fc-63da04c212f3__wakuorg_nwaku:latest.log
2026-04-23 22:04:17.114 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 2812
2026-04-23 22:04:17.114 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 22:04:17.189 ERROR [src.node.docker_mananger] Max retries reached for container a1fdbee693b4. Exiting log stream.
2026-04-23 22:04:17.660 ERROR [src.node.docker_mananger] Max retries reached for container 7d66ea4de03d. Exiting log stream.
2026-04-23 22:04:18.114 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2812/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:04:18.117 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 22:04:18.118 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 22:04:18.118 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2812/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:04:18.120 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.7.71/tcp/2813/p2p/16Uiu2HAmUiL5JD5iEemxYwq4zaeUUVpizmhAsGmjbfN2gYJDp9nD","/ip4/172.18.7.71/tcp/2814/ws/p2p/16Uiu2HAmUiL5JD5iEemxYwq4zaeUUVpizmhAsGmjbfN2gYJDp9nD"],"enrUri":"enr:-L24QO2lQRXgfuqMly6ZxIiPLVxNwHsCbnafOO10JcPJsL3OdffBe8ctbc2nF8fP7qEVEM7qBDj2CMq_wy8itWgesJsCgmlkgnY0gmlwhKwSB0eKbXVsdGlhZGRyc5YACASsEgdHBgr9AAoErBIHRwYK_t0DgnJzhQDHAQAAiXNlY3AyNTZrMaED7pYJGehXEgFXJeRpGZxHOPRn_4hLBUqPZi9tBoSZ01aDdGNwggr9g3VkcIIK_4V3YWt1MgU"}'
2026-04-23 22:04:18.121 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 22:04:18.129 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 22:04:18.129 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-04-23_22-04-16__a44cf8a5-674f-4a03-b9fc-63da04c212f3__wakuorg_nwaku:latest.log
2026-04-23 22:04:18.130 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 22:04:18.130 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 22:04:18.131 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 22:04:18.131 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.109.212
2026-04-23 22:04:18.132 DEBUG [src.node.docker_mananger] Generated ports ['23919', '23920', '23921', '23922', '23923']
2026-04-23 22:04:18.132 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 22:04:18.132 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 22:04:18.132 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 22:04:18.132 DEBUG [src.node.docker_mananger] docker run -i -t -p 23919:23919 -p 23920:23920 -p 23921:23921 -p 23922:23922 -p 23923:23923 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=23921 --rest-port=23919 --tcp-port=23920 --discv5-udp-port=23922 --rest-address=0.0.0.0 --nat=extip:172.18.109.212 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=daeb6095f47ce1ecafeddfbc4dc3a71c65f4cb6e8d9decbedafbb560d71392ce --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=23923 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QO2lQRXgfuqMly6ZxIiPLVxNwHsCbnafOO10JcPJsL3OdffBe8ctbc2nF8fP7qEVEM7qBDj2CMq_wy8itWgesJsCgmlkgnY0gmlwhKwSB0eKbXVsdGlhZGRyc5YACASsEgdHBgr9AAoErBIHRwYK_t0DgnJzhQDHAQAAiXNlY3AyNTZrMaED7pYJGehXEgFXJeRpGZxHOPRn_4hLBUqPZi9tBoSZ01aDdGNwggr9g3VkcIIK_4V3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-04-23 22:04:18.324 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.109.212 waku 9034a83988084e209f406d110b6fef9e8a871654e3fc14983605c84686b31645
2026-04-23 22:04:18.364 DEBUG [src.node.docker_mananger] Container started with ID 9034a8398808. Setting up logs at ./log/docker/node2_2026-04-23_22-04-16__a44cf8a5-674f-4a03-b9fc-63da04c212f3__wakuorg_nwaku:latest.log
2026-04-23 22:04:18.364 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 23919
2026-04-23 22:04:18.365 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 22:04:19.366 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:23919/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:04:19.372 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 22:04:19.373 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 22:04:19.373 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:23919/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:04:19.377 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.109.212/tcp/23920/p2p/16Uiu2HAm3pTSaTvaq34qDPY3RQr6CF6TQwXyAcDqGc4r7CpjJcZc","/ip4/172.18.109.212/tcp/23921/ws/p2p/16Uiu2HAm3pTSaTvaq34qDPY3RQr6CF6TQwXyAcDqGc4r7CpjJcZc"],"enrUri":"enr:-L24QHdfJBsEl9jSLCEyA1ewbxN-8mrp8WujSxA0onAhYzpkAfs4oub2qm4vVy4_LSBpqVUMBHBN4_yGDip6500z_TYCgmlkgnY0gmlwhKwSbdSKbXVsdGlhZGRyc5YACASsEm3UBl1wAAoErBJt1AZdcd0DgnJzhQDHAQAAiXNlY3AyNTZrMaECfLOtUcZ8vL7QxvytyR5cmt8-WFDdKmArZL6HsCQYE7eDdGNwgl1wg3VkcIJdcoV3YWt1MgE"}'
2026-04-23 22:04:19.377 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 22:04:19.378 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:23919/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.7.71/tcp/2813/p2p/16Uiu2HAmUiL5JD5iEemxYwq4zaeUUVpizmhAsGmjbfN2gYJDp9nD"]'
2026-04-23 22:04:19.383 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 22:04:19.383 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:2812/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-04-23 22:04:19.387 ERROR [src.node.api_clients.base_client] HTTP error occurred: 500 Server Error: Internal Server Error for url: http://127.0.0.1:2812/relay/v1/auto/subscriptions. Response content: b'Subscribe failed:Failed to decode subscription event: Static sharding is used, relay subscriptions must specify a pubsub topic'
2026-04-23 22:04:19.424 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-04-23 22:04:19.425 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-04-23 22:04:19.425 DEBUG [src.node.waku_node] Stopping container with id 0cbc09abd6e8
2026-04-23 22:04:19.931 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 22:04:19.931 DEBUG [src.node.waku_node] Stopping container with id 9034a8398808
2026-04-23 22:04:20.376 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 22:04:20.378 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-04-23 22:04:20.385 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 22:04:20.391 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 22:04:20.392 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-04-23 22:04:20.392 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-04-23 22:04:20.392 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-04-23_22-04-16__a44cf8a5-674f-4a03-b9fc-63da04c212f3__wakuorg_nwaku:latest.log
2026-04-23 22:04:20.393 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-04-23_22-04-16__a44cf8a5-674f-4a03-b9fc-63da04c212f3__wakuorg_nwaku:latest.log
2026-04-23 22:04:20.396 DEBUG [tests.conftest] Running fixture setup: test_id
2026-04-23 22:04:20.397 DEBUG [tests.conftest] Running test: test_single_content_topic[/myapp/1/latest/proto] with id: 2026-04-23_22-04-20__3f289dc4-b1fb-4849-b45c-f57ff02159dd
2026-04-23 22:04:20.397 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-04-23 22:04:20.397 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-04-23 22:04:20.397 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-04-23 22:04:20.405 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 22:04:20.406 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-04-23_22-04-20__3f289dc4-b1fb-4849-b45c-f57ff02159dd__wakuorg_nwaku:latest.log
2026-04-23 22:04:20.406 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 22:04:20.406 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 22:04:20.407 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 22:04:20.407 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.98.241
2026-04-23 22:04:20.408 DEBUG [src.node.docker_mananger] Generated ports ['25439', '25440', '25441', '25442', '25443']
2026-04-23 22:04:20.408 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 22:04:20.408 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 22:04:20.408 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 22:04:20.408 DEBUG [src.node.docker_mananger] docker run -i -t -p 25439:25439 -p 25440:25440 -p 25441:25441 -p 25442:25442 -p 25443:25443 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=25441 --rest-port=25439 --tcp-port=25440 --discv5-udp-port=25442 --rest-address=0.0.0.0 --nat=extip:172.18.98.241 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=9acdbe53fba778b0ad6177acf6a3f30b8d5394b62fd88e7ef15aebf63eecf9f5 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=25443 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto
2026-04-23 22:04:20.591 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.98.241 waku 712cef2f51b3114bb0ef9029607232a2b7ff2b144384b7f0d6bda69ff5d7e849
2026-04-23 22:04:20.632 DEBUG [src.node.docker_mananger] Container started with ID 712cef2f51b3. Setting up logs at ./log/docker/node1_2026-04-23_22-04-20__3f289dc4-b1fb-4849-b45c-f57ff02159dd__wakuorg_nwaku:latest.log
2026-04-23 22:04:20.632 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 25439
2026-04-23 22:04:20.633 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 22:04:20.745 ERROR [src.node.docker_mananger] Max retries reached for container 0cbc09abd6e8. Exiting log stream.
2026-04-23 22:04:21.202 ERROR [src.node.docker_mananger] Max retries reached for container 9034a8398808. Exiting log stream.
2026-04-23 22:04:21.634 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25439/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:04:21.637 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 22:04:21.637 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 22:04:21.637 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25439/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:04:21.640 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.98.241/tcp/25440/p2p/16Uiu2HAmFGYGwM7EUVzCXjVzvzSKXGHQJkUxmhyjUztDHpY4ovkj","/ip4/172.18.98.241/tcp/25441/ws/p2p/16Uiu2HAmFGYGwM7EUVzCXjVzvzSKXGHQJkUxmhyjUztDHpY4ovkj"],"enrUri":"enr:-L24QIjVGC-dhF0382j9tt8_obc8nFCBA3mOqOe3W-3bnI4ubzj3YL73_F0fTxR72NMPjN67KBWhOjo_eMHuEyphWAQCgmlkgnY0gmlwhKwSYvGKbXVsdGlhZGRyc5YACASsEmLxBmNgAAoErBJi8QZjYd0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDJtLMwoKWi8q8XHVg1i_JIsDQZHrj98Wtxahek0hSHtyDdGNwgmNgg3VkcIJjYoV3YWt1MgU"}'
2026-04-23 22:04:21.640 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 22:04:21.647 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 22:04:21.648 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-04-23_22-04-20__3f289dc4-b1fb-4849-b45c-f57ff02159dd__wakuorg_nwaku:latest.log
2026-04-23 22:04:21.648 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 22:04:21.648 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 22:04:21.650 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 22:04:21.650 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.107.168
2026-04-23 22:04:21.650 DEBUG [src.node.docker_mananger] Generated ports ['39892', '39893', '39894', '39895', '39896']
2026-04-23 22:04:21.650 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 22:04:21.650 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 22:04:21.651 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 22:04:21.651 DEBUG [src.node.docker_mananger] docker run -i -t -p 39892:39892 -p 39893:39893 -p 39894:39894 -p 39895:39895 -p 39896:39896 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=39894 --rest-port=39892 --tcp-port=39893 --discv5-udp-port=39895 --rest-address=0.0.0.0 --nat=extip:172.18.107.168 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=2ab4108d71e98d0f821e7e8fd235acd6606fe36f1b9ffd9fca74bcf4aceca6b0 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=39896 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QIjVGC-dhF0382j9tt8_obc8nFCBA3mOqOe3W-3bnI4ubzj3YL73_F0fTxR72NMPjN67KBWhOjo_eMHuEyphWAQCgmlkgnY0gmlwhKwSYvGKbXVsdGlhZGRyc5YACASsEmLxBmNgAAoErBJi8QZjYd0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDJtLMwoKWi8q8XHVg1i_JIsDQZHrj98Wtxahek0hSHtyDdGNwgmNgg3VkcIJjYoV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-04-23 22:04:21.842 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.107.168 waku f85034e57b982f8d251201e3bc493e1b1d4993408094bc3ca70191479b1b0dc0
2026-04-23 22:04:21.879 DEBUG [src.node.docker_mananger] Container started with ID f85034e57b98. Setting up logs at ./log/docker/node2_2026-04-23_22-04-20__3f289dc4-b1fb-4849-b45c-f57ff02159dd__wakuorg_nwaku:latest.log
2026-04-23 22:04:21.879 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 39892
2026-04-23 22:04:21.880 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 22:04:22.880 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:39892/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:04:22.887 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 22:04:22.889 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 22:04:22.889 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:39892/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:04:22.900 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.107.168/tcp/39893/p2p/16Uiu2HAmGnrzkkWhoNoHbJfUtt94nQ4rC5tvxD3P8Tf87tgqBs5S","/ip4/172.18.107.168/tcp/39894/ws/p2p/16Uiu2HAmGnrzkkWhoNoHbJfUtt94nQ4rC5tvxD3P8Tf87tgqBs5S"],"enrUri":"enr:-L24QBLyqHT9mol9iimr3Zg6YVpErNAM2u-Y5N61Q2BUo2D8aKdSqGeFMFYkA8Zgck0kRD0uL1ki9L4JEmqkQgHjc-ECgmlkgnY0gmlwhKwSa6iKbXVsdGlhZGRyc5YACASsEmuoBpvVAAoErBJrqAab1t0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDPXMUNMSSUWOqGywH_sZ_wYXHv3xpRsgHAPRmiw--9rmDdGNwgpvVg3VkcIKb14V3YWt1MgE"}'
2026-04-23 22:04:22.901 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 22:04:22.901 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39892/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.98.241/tcp/25440/p2p/16Uiu2HAmFGYGwM7EUVzCXjVzvzSKXGHQJkUxmhyjUztDHpY4ovkj"]'
2026-04-23 22:04:22.905 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 22:04:22.905 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:25439/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-04-23 22:04:22.908 ERROR [src.node.api_clients.base_client] HTTP error occurred: 500 Server Error: Internal Server Error for url: http://127.0.0.1:25439/relay/v1/auto/subscriptions. Response content: b'Subscribe failed:Failed to decode subscription event: Static sharding is used, relay subscriptions must specify a pubsub topic'
2026-04-23 22:04:22.943 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-04-23 22:04:22.944 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-04-23 22:04:22.944 DEBUG [src.node.waku_node] Stopping container with id 712cef2f51b3
2026-04-23 22:04:23.422 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 22:04:23.422 DEBUG [src.node.waku_node] Stopping container with id f85034e57b98
2026-04-23 22:04:23.885 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 22:04:23.886 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-04-23 22:04:23.892 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 22:04:23.898 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 22:04:23.899 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-04-23 22:04:23.899 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-04-23 22:04:23.900 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-04-23_22-04-20__3f289dc4-b1fb-4849-b45c-f57ff02159dd__wakuorg_nwaku:latest.log
2026-04-23 22:04:23.900 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-04-23_22-04-20__3f289dc4-b1fb-4849-b45c-f57ff02159dd__wakuorg_nwaku:latest.log