logos-messaging/logos-messaging-interop-tests
1
0
Fork 0
mirror of https://github.com/logos-messaging/logos-messaging-interop-tests.git synced 2026-05-27 04:39:32 +00:00
Code Issues Packages Projects Releases Wiki Activity
logos-messaging-interop-tests/nim/1208/data/attachments/8db116a1612d4189.txt

451 lines
82 KiB
Plaintext
Raw Blame History

2026-04-23 05:17:53.498 DEBUG [tests.conftest] Running fixture setup: test_id
2026-04-23 05:17:53.498 DEBUG [tests.conftest] Running test: test_auto_shard_relay with id: 2026-04-23_05-17-53__eecc0330-1d96-44c1-98ba-b9e02a9452ab
2026-04-23 05:17:53.498 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-04-23 05:17:53.498 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-04-23 05:17:53.499 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-04-23 05:17:53.506 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 05:17:53.506 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-04-23_05-17-53__eecc0330-1d96-44c1-98ba-b9e02a9452ab__wakuorg_nwaku:latest.log
2026-04-23 05:17:53.506 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 05:17:53.506 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 05:17:53.508 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 05:17:53.508 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.160.85
2026-04-23 05:17:53.508 DEBUG [src.node.docker_mananger] Generated ports ['41603', '41604', '41605', '41606', '41607']
2026-04-23 05:17:53.508 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 05:17:53.508 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 05:17:53.508 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 05:17:53.508 DEBUG [src.node.docker_mananger] docker run -i -t -p 41603:41603 -p 41604:41604 -p 41605:41605 -p 41606:41606 -p 41607:41607 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=41605 --rest-port=41603 --tcp-port=41604 --discv5-udp-port=41606 --rest-address=0.0.0.0 --nat=extip:172.18.160.85 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=fc5888e2fb6da2edd4630f2e8bf7e952f3782bfddee2b1ad6a9212443f7e8f50 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=41607 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto
2026-04-23 05:17:53.709 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.160.85 waku 36e481119b230ce0878a1192d20f46f182c99fef0191c6a7175ca3818fe3aaf2
2026-04-23 05:17:53.745 DEBUG [src.node.docker_mananger] Container started with ID 36e481119b23. Setting up logs at ./log/docker/node1_2026-04-23_05-17-53__eecc0330-1d96-44c1-98ba-b9e02a9452ab__wakuorg_nwaku:latest.log
2026-04-23 05:17:53.745 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 41603
2026-04-23 05:17:53.745 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 05:17:53.847 ERROR [src.node.docker_mananger] Max retries reached for container a0495e9d569d. Exiting log stream.
2026-04-23 05:17:54.300 ERROR [src.node.docker_mananger] Max retries reached for container dd5503baa364. Exiting log stream.
2026-04-23 05:17:54.747 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:41603/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:17:54.750 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 05:17:54.750 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 05:17:54.750 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:41603/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:17:54.753 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.160.85/tcp/41604/p2p/16Uiu2HAmDFhiR2KVUqyJQiNBEbYhaKjvA89r7C7LsFBWNGWthiFM","/ip4/172.18.160.85/tcp/41605/ws/p2p/16Uiu2HAmDFhiR2KVUqyJQiNBEbYhaKjvA89r7C7LsFBWNGWthiFM"],"enrUri":"enr:-L24QA96thwaGZoSBQ2wUmqQMB6SZQ9GMNzCPb9uX4jy4E29DiYScFExq1cmLs-xS-nnmDx3yIMwIKV0CbFBEWwFoFACgmlkgnY0gmlwhKwSoFWKbXVsdGlhZGRyc5YACASsEqBVBqKEAAoErBKgVQaihd0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDCOSEp_2tRWBq4fn_aNa8B15d-CJATPu-Hpg8rfuRdNSDdGNwgqKEg3VkcIKihoV3YWt1MgU"}'
2026-04-23 05:17:54.753 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 05:17:54.759 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 05:17:54.760 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-04-23_05-17-53__eecc0330-1d96-44c1-98ba-b9e02a9452ab__wakuorg_nwaku:latest.log
2026-04-23 05:17:54.760 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 05:17:54.760 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 05:17:54.761 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 05:17:54.761 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.11.21
2026-04-23 05:17:54.761 DEBUG [src.node.docker_mananger] Generated ports ['55704', '55705', '55706', '55707', '55708']
2026-04-23 05:17:54.762 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 05:17:54.762 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 05:17:54.762 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 05:17:54.762 DEBUG [src.node.docker_mananger] docker run -i -t -p 55704:55704 -p 55705:55705 -p 55706:55706 -p 55707:55707 -p 55708:55708 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=55706 --rest-port=55704 --tcp-port=55705 --discv5-udp-port=55707 --rest-address=0.0.0.0 --nat=extip:172.18.11.21 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=cf2d4da9f2e2bc9e588a1f0e3ea893a4e58aade07d8144125f3ed59dfd6771ad --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=55708 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QA96thwaGZoSBQ2wUmqQMB6SZQ9GMNzCPb9uX4jy4E29DiYScFExq1cmLs-xS-nnmDx3yIMwIKV0CbFBEWwFoFACgmlkgnY0gmlwhKwSoFWKbXVsdGlhZGRyc5YACASsEqBVBqKEAAoErBKgVQaihd0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDCOSEp_2tRWBq4fn_aNa8B15d-CJATPu-Hpg8rfuRdNSDdGNwgqKEg3VkcIKihoV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-04-23 05:17:54.958 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.11.21 waku 671c9fc227b040fd0dd37460c5df680b89820561d804a1b1d93d6ebe63eb8fa8
2026-04-23 05:17:54.994 DEBUG [src.node.docker_mananger] Container started with ID 671c9fc227b0. Setting up logs at ./log/docker/node2_2026-04-23_05-17-53__eecc0330-1d96-44c1-98ba-b9e02a9452ab__wakuorg_nwaku:latest.log
2026-04-23 05:17:54.995 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 55704
2026-04-23 05:17:54.995 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 05:17:55.996 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55704/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:17:56.003 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 05:17:56.004 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 05:17:56.005 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55704/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:17:56.008 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.11.21/tcp/55705/p2p/16Uiu2HAmKcoeDpiCU4ZixwLyYKKHREe9jJMbNtJVCmLb1T7BrHyg","/ip4/172.18.11.21/tcp/55706/ws/p2p/16Uiu2HAmKcoeDpiCU4ZixwLyYKKHREe9jJMbNtJVCmLb1T7BrHyg"],"enrUri":"enr:-L24QBdprCLaiMFxiLrzQo7s6E3LGdbURHZg9CWcYkUtcpmJIksh3C03Wq2L9aeMqZREZDREZwwjB4-yaX2Eg3cmcTQCgmlkgnY0gmlwhKwSCxWKbXVsdGlhZGRyc5YACASsEgsVBtmZAAoErBILFQbZmt0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDZ3KKCfZwSRaeMe4xqCfIuGrYDGBo1ogq3p50zP1sn5-DdGNwgtmZg3VkcILZm4V3YWt1MgE"}'
2026-04-23 05:17:56.008 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 05:17:56.009 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:55704/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.160.85/tcp/41604/p2p/16Uiu2HAmDFhiR2KVUqyJQiNBEbYhaKjvA89r7C7LsFBWNGWthiFM"]'
2026-04-23 05:17:56.014 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 05:17:56.022 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 05:17:56.023 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-04-23_05-17-53__eecc0330-1d96-44c1-98ba-b9e02a9452ab__wakuorg_nwaku:latest.log
2026-04-23 05:17:56.023 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 05:17:56.023 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 05:17:56.024 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 05:17:56.024 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.214.115
2026-04-23 05:17:56.025 DEBUG [src.node.docker_mananger] Generated ports ['29923', '29924', '29925', '29926', '29927']
2026-04-23 05:17:56.025 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 05:17:56.025 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 05:17:56.025 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 05:17:56.025 DEBUG [src.node.docker_mananger] docker run -i -t -p 29923:29923 -p 29924:29924 -p 29925:29925 -p 29926:29926 -p 29927:29927 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=29925 --rest-port=29923 --tcp-port=29924 --discv5-udp-port=29926 --rest-address=0.0.0.0 --nat=extip:172.18.214.115 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=e0d8cd20bd72300ddd5fbaca50cade4a97280e0aed53ebc4e7c19e8d19c48af0 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=29927 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QA96thwaGZoSBQ2wUmqQMB6SZQ9GMNzCPb9uX4jy4E29DiYScFExq1cmLs-xS-nnmDx3yIMwIKV0CbFBEWwFoFACgmlkgnY0gmlwhKwSoFWKbXVsdGlhZGRyc5YACASsEqBVBqKEAAoErBKgVQaihd0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDCOSEp_2tRWBq4fn_aNa8B15d-CJATPu-Hpg8rfuRdNSDdGNwgqKEg3VkcIKihoV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-04-23 05:17:56.214 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.214.115 waku 26028d7ae3301a7b80d2a2426ccd71d95189cd171a63606374b11c629acf9d76
2026-04-23 05:17:56.244 DEBUG [src.node.docker_mananger] Container started with ID 26028d7ae330. Setting up logs at ./log/docker/node3_2026-04-23_05-17-53__eecc0330-1d96-44c1-98ba-b9e02a9452ab__wakuorg_nwaku:latest.log
2026-04-23 05:17:56.245 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 29923
2026-04-23 05:17:56.245 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 05:17:57.249 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:29923/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:17:57.261 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 05:17:57.263 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 05:17:57.263 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:29923/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:17:57.268 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.214.115/tcp/29924/p2p/16Uiu2HAmHzesQE3wkEqHTK2iGbzGN6WTxJpc6j3yKTqJ99KEtg9f","/ip4/172.18.214.115/tcp/29925/ws/p2p/16Uiu2HAmHzesQE3wkEqHTK2iGbzGN6WTxJpc6j3yKTqJ99KEtg9f"],"enrUri":"enr:-L24QIqym7U2OJJvU2ubUrRK58xSJD-X2GldrIKkyWTkk1w-VGABckiesJMXdiW6IHI3YcynCJz0G4b8OFQYo1Ubyn8CgmlkgnY0gmlwhKwS1nOKbXVsdGlhZGRyc5YACASsEtZzBnTkAAoErBLWcwZ05d0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDT1QGFRKAhSLb6OccpJmxFMZNNImfKM5VY2RTtY5MtnqDdGNwgnTkg3VkcIJ05oV3YWt1MgE"}'
2026-04-23 05:17:57.268 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 05:17:57.268 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:29923/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.160.85/tcp/41604/p2p/16Uiu2HAmDFhiR2KVUqyJQiNBEbYhaKjvA89r7C7LsFBWNGWthiFM"]'
2026-04-23 05:17:57.273 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 05:17:57.280 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 05:17:57.280 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-04-23_05-17-53__eecc0330-1d96-44c1-98ba-b9e02a9452ab__wakuorg_nwaku:latest.log
2026-04-23 05:17:57.280 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 05:17:57.280 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 05:17:57.282 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 05:17:57.282 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.186.38
2026-04-23 05:17:57.282 DEBUG [src.node.docker_mananger] Generated ports ['10606', '10607', '10608', '10609', '10610']
2026-04-23 05:17:57.282 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 05:17:57.282 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 05:17:57.282 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 05:17:57.282 DEBUG [src.node.docker_mananger] docker run -i -t -p 10606:10606 -p 10607:10607 -p 10608:10608 -p 10609:10609 -p 10610:10610 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=10608 --rest-port=10606 --tcp-port=10607 --discv5-udp-port=10609 --rest-address=0.0.0.0 --nat=extip:172.18.186.38 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=4e5e3defc89b960e3fa3fa12e9e6bbcc71d4cba9a26d1669a560d7ed8ae7ed0a --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=10610 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QA96thwaGZoSBQ2wUmqQMB6SZQ9GMNzCPb9uX4jy4E29DiYScFExq1cmLs-xS-nnmDx3yIMwIKV0CbFBEWwFoFACgmlkgnY0gmlwhKwSoFWKbXVsdGlhZGRyc5YACASsEqBVBqKEAAoErBKgVQaihd0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDCOSEp_2tRWBq4fn_aNa8B15d-CJATPu-Hpg8rfuRdNSDdGNwgqKEg3VkcIKihoV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-04-23 05:17:57.486 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.186.38 waku 16895ac97b0603f1d09ffd6104484ea9184f0621ec280d9ba37d058f9c80718f
2026-04-23 05:17:57.522 DEBUG [src.node.docker_mananger] Container started with ID 16895ac97b06. Setting up logs at ./log/docker/node4_2026-04-23_05-17-53__eecc0330-1d96-44c1-98ba-b9e02a9452ab__wakuorg_nwaku:latest.log
2026-04-23 05:17:57.523 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 10606
2026-04-23 05:17:57.523 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 05:17:58.533 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10606/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:17:58.538 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 05:17:58.538 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 05:17:58.538 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10606/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:17:58.541 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.186.38/tcp/10607/p2p/16Uiu2HAm1Pj13bVQfDHCTwM5dkYdrEzpqXbfnmAFiCsgFAraFTUQ","/ip4/172.18.186.38/tcp/10608/ws/p2p/16Uiu2HAm1Pj13bVQfDHCTwM5dkYdrEzpqXbfnmAFiCsgFAraFTUQ"],"enrUri":"enr:-L24QKEQee6mN1l8aeJYOK7ZOKgvc7hiu76ip46QJLiI9QHMP8onlkHJ2BBp9GP44xXjtqnXkCfkNHdejyf2sr_h1tcCgmlkgnY0gmlwhKwSuiaKbXVsdGlhZGRyc5YACASsEromBilvAAoErBK6JgYpcN0DgnJzhQDHAQAAiXNlY3AyNTZrMaECWKZgX57tDcFUB6XfP9bsxddSWEWy_lyRlXgi5F4WFv2DdGNwgilvg3VkcIIpcYV3YWt1MgE"}'
2026-04-23 05:17:58.541 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 05:17:58.542 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:10606/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.160.85/tcp/41604/p2p/16Uiu2HAmDFhiR2KVUqyJQiNBEbYhaKjvA89r7C7LsFBWNGWthiFM"]'
2026-04-23 05:17:58.544 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 05:17:58.552 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 05:17:58.552 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-04-23_05-17-53__eecc0330-1d96-44c1-98ba-b9e02a9452ab__wakuorg_nwaku:latest.log
2026-04-23 05:17:58.552 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 05:17:58.552 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 05:17:58.554 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 05:17:58.554 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.115.248
2026-04-23 05:17:58.554 DEBUG [src.node.docker_mananger] Generated ports ['1730', '1731', '1732', '1733', '1734']
2026-04-23 05:17:58.554 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 05:17:58.554 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 05:17:58.554 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 05:17:58.555 DEBUG [src.node.docker_mananger] docker run -i -t -p 1730:1730 -p 1731:1731 -p 1732:1732 -p 1733:1733 -p 1734:1734 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=1732 --rest-port=1730 --tcp-port=1731 --discv5-udp-port=1733 --rest-address=0.0.0.0 --nat=extip:172.18.115.248 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=ff09eb8bb24ec1b7691ec8b2b0f5163bc0bdb61accf331a29ce5eeb7254fbc37 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=1734 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QA96thwaGZoSBQ2wUmqQMB6SZQ9GMNzCPb9uX4jy4E29DiYScFExq1cmLs-xS-nnmDx3yIMwIKV0CbFBEWwFoFACgmlkgnY0gmlwhKwSoFWKbXVsdGlhZGRyc5YACASsEqBVBqKEAAoErBKgVQaihd0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDCOSEp_2tRWBq4fn_aNa8B15d-CJATPu-Hpg8rfuRdNSDdGNwgqKEg3VkcIKihoV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-04-23 05:17:58.756 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.115.248 waku 2ad69b961ba66a188ca0968ae4e583bc4a04abde9f4faed80a51ee717612cde1
2026-04-23 05:17:58.790 DEBUG [src.node.docker_mananger] Container started with ID 2ad69b961ba6. Setting up logs at ./log/docker/node5_2026-04-23_05-17-53__eecc0330-1d96-44c1-98ba-b9e02a9452ab__wakuorg_nwaku:latest.log
2026-04-23 05:17:58.791 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 1730
2026-04-23 05:17:58.792 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 05:17:59.798 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1730/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:17:59.803 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 05:17:59.804 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 05:17:59.804 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1730/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:17:59.808 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.115.248/tcp/1731/p2p/16Uiu2HAmPaXBx1oQuPBuWy82L8bTpyBxAhX4mBxNjpfajZmdw11Y","/ip4/172.18.115.248/tcp/1732/ws/p2p/16Uiu2HAmPaXBx1oQuPBuWy82L8bTpyBxAhX4mBxNjpfajZmdw11Y"],"enrUri":"enr:-L24QK6rZH8bxXrWblJVIOqsUD1CBVsdBXjt5cmaZ_XWnmKHDg4MHneib4LZ3yIVfzKZpNoWKBqkdIqeGgzTsORsgU4CgmlkgnY0gmlwhKwSc_iKbXVsdGlhZGRyc5YACASsEnP4BgbDAAoErBJz-AYGxN0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDokuFmNXmqYVs4qN71M19Tg8ZTTJ5jp-dUz8PNGAEzE-DdGNwggbDg3VkcIIGxYV3YWt1MgE"}'
2026-04-23 05:17:59.808 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 05:17:59.809 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1730/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.160.85/tcp/41604/p2p/16Uiu2HAmDFhiR2KVUqyJQiNBEbYhaKjvA89r7C7LsFBWNGWthiFM"]'
2026-04-23 05:17:59.811 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 05:17:59.812 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:41603/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-04-23 05:17:59.815 ERROR [src.node.api_clients.base_client] HTTP error occurred: 500 Server Error: Internal Server Error for url: http://127.0.0.1:41603/relay/v1/auto/subscriptions. Response content: b'Subscribe failed:Failed to decode subscription event: Static sharding is used, relay subscriptions must specify a pubsub topic'
2026-04-23 05:17:59.852 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-04-23 05:17:59.853 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-04-23 05:17:59.853 DEBUG [src.node.waku_node] Stopping container with id 36e481119b23
2026-04-23 05:18:00.381 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 05:18:00.381 DEBUG [src.node.waku_node] Stopping container with id 671c9fc227b0
2026-04-23 05:18:00.889 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 05:18:00.891 DEBUG [src.node.waku_node] Stopping container with id 26028d7ae330
2026-04-23 05:18:01.256 ERROR [src.node.docker_mananger] Max retries reached for container 36e481119b23. Exiting log stream.
2026-04-23 05:18:01.380 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 05:18:01.380 DEBUG [src.node.waku_node] Stopping container with id 16895ac97b06
2026-04-23 05:18:01.729 ERROR [src.node.docker_mananger] Max retries reached for container 671c9fc227b0. Exiting log stream.
2026-04-23 05:18:01.854 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 05:18:01.854 DEBUG [src.node.waku_node] Stopping container with id 2ad69b961ba6
2026-04-23 05:18:02.216 ERROR [src.node.docker_mananger] Max retries reached for container 26028d7ae330. Exiting log stream.
2026-04-23 05:18:02.328 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 05:18:02.329 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-04-23 05:18:02.363 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 05:18:02.374 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 05:18:02.386 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 05:18:02.392 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 05:18:02.398 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 05:18:02.400 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-04-23 05:18:02.400 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-04-23 05:18:02.402 DEBUG [src.libs.common] Attaching file ./log/docker/node5_2026-04-23_05-17-53__eecc0330-1d96-44c1-98ba-b9e02a9452ab__wakuorg_nwaku:latest.log
2026-04-23 05:18:02.405 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-04-23_05-17-53__eecc0330-1d96-44c1-98ba-b9e02a9452ab__wakuorg_nwaku:latest.log
2026-04-23 05:18:02.410 DEBUG [src.libs.common] Attaching file ./log/docker/node3_2026-04-23_05-17-53__eecc0330-1d96-44c1-98ba-b9e02a9452ab__wakuorg_nwaku:latest.log
2026-04-23 05:18:02.417 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-04-23_05-17-53__eecc0330-1d96-44c1-98ba-b9e02a9452ab__wakuorg_nwaku:latest.log
2026-04-23 05:18:02.422 DEBUG [src.libs.common] Attaching file ./log/docker/node4_2026-04-23_05-17-53__eecc0330-1d96-44c1-98ba-b9e02a9452ab__wakuorg_nwaku:latest.log
2026-04-23 05:18:02.427 DEBUG [tests.conftest] Running fixture setup: test_id
2026-04-23 05:18:02.428 DEBUG [tests.conftest] Running test: test_auto_shard_relay with id: 2026-04-23_05-18-02__1fab64fc-6d1c-4024-a587-1f7f5f609347
2026-04-23 05:18:02.428 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-04-23 05:18:02.428 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-04-23 05:18:02.429 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-04-23 05:18:02.437 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 05:18:02.437 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-04-23_05-18-02__1fab64fc-6d1c-4024-a587-1f7f5f609347__wakuorg_nwaku:latest.log
2026-04-23 05:18:02.437 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 05:18:02.437 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 05:18:02.439 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 05:18:02.439 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.148.103
2026-04-23 05:18:02.439 DEBUG [src.node.docker_mananger] Generated ports ['19008', '19009', '19010', '19011', '19012']
2026-04-23 05:18:02.439 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 05:18:02.439 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 05:18:02.440 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 05:18:02.440 DEBUG [src.node.docker_mananger] docker run -i -t -p 19008:19008 -p 19009:19009 -p 19010:19010 -p 19011:19011 -p 19012:19012 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=19010 --rest-port=19008 --tcp-port=19009 --discv5-udp-port=19011 --rest-address=0.0.0.0 --nat=extip:172.18.148.103 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=fcebdacf1e4a7088be7f37ebcd3ed9fc7b1cae888fdbcefaef3a81e2cde9cb3b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=19012 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto
2026-04-23 05:18:02.631 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.148.103 waku 915c1d7e98941c0f99271a232d8c4a40b50e8f93edb0d83625465e2a56132873
2026-04-23 05:18:02.667 DEBUG [src.node.docker_mananger] Container started with ID 915c1d7e9894. Setting up logs at ./log/docker/node1_2026-04-23_05-18-02__1fab64fc-6d1c-4024-a587-1f7f5f609347__wakuorg_nwaku:latest.log
2026-04-23 05:18:02.668 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 19008
2026-04-23 05:18:02.669 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 05:18:02.672 ERROR [src.node.docker_mananger] Max retries reached for container 16895ac97b06. Exiting log stream.
2026-04-23 05:18:03.236 ERROR [src.node.docker_mananger] Max retries reached for container 2ad69b961ba6. Exiting log stream.
2026-04-23 05:18:03.670 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19008/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:18:03.673 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 05:18:03.674 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 05:18:03.674 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19008/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:18:03.676 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.148.103/tcp/19009/p2p/16Uiu2HAm21zTR595FHqiobGQZPZmjhkDQDj4mDgkJJth3guyEsWc","/ip4/172.18.148.103/tcp/19010/ws/p2p/16Uiu2HAm21zTR595FHqiobGQZPZmjhkDQDj4mDgkJJth3guyEsWc"],"enrUri":"enr:-L24QPTJMCLENNFAssZ5EKDlvxqpZSJFfSx4bogsxfJPLC3eFzeurAtevI-6dhh55FshyzopNWaYRwXzvAjJszU3kD0CgmlkgnY0gmlwhKwSlGeKbXVsdGlhZGRyc5YACASsEpRnBkpBAAoErBKUZwZKQt0DgnJzhQDHAQAAiXNlY3AyNTZrMaECYfDCniaeOMf0q41-3U-2CYQBjcKbnCrehwlBPzxPRoWDdGNwgkpBg3VkcIJKQ4V3YWt1MgU"}'
2026-04-23 05:18:03.677 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 05:18:03.684 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 05:18:03.684 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-04-23_05-18-02__1fab64fc-6d1c-4024-a587-1f7f5f609347__wakuorg_nwaku:latest.log
2026-04-23 05:18:03.684 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 05:18:03.684 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 05:18:03.686 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 05:18:03.688 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.166.128
2026-04-23 05:18:03.688 DEBUG [src.node.docker_mananger] Generated ports ['43735', '43736', '43737', '43738', '43739']
2026-04-23 05:18:03.688 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 05:18:03.688 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 05:18:03.688 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 05:18:03.688 DEBUG [src.node.docker_mananger] docker run -i -t -p 43735:43735 -p 43736:43736 -p 43737:43737 -p 43738:43738 -p 43739:43739 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=43737 --rest-port=43735 --tcp-port=43736 --discv5-udp-port=43738 --rest-address=0.0.0.0 --nat=extip:172.18.166.128 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=2b2bfef7c245e7d6326e4f051caddc2df3b6fed127ff6bf06e8d3b8fcbcb0dbf --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=43739 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QPTJMCLENNFAssZ5EKDlvxqpZSJFfSx4bogsxfJPLC3eFzeurAtevI-6dhh55FshyzopNWaYRwXzvAjJszU3kD0CgmlkgnY0gmlwhKwSlGeKbXVsdGlhZGRyc5YACASsEpRnBkpBAAoErBKUZwZKQt0DgnJzhQDHAQAAiXNlY3AyNTZrMaECYfDCniaeOMf0q41-3U-2CYQBjcKbnCrehwlBPzxPRoWDdGNwgkpBg3VkcIJKQ4V3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-04-23 05:18:03.890 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.166.128 waku 0fbf009bdb2cdab8afbae358b7d58698a62f794463da7d7f5b05e68001b6d35c
2026-04-23 05:18:03.925 DEBUG [src.node.docker_mananger] Container started with ID 0fbf009bdb2c. Setting up logs at ./log/docker/node2_2026-04-23_05-18-02__1fab64fc-6d1c-4024-a587-1f7f5f609347__wakuorg_nwaku:latest.log
2026-04-23 05:18:03.925 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 43735
2026-04-23 05:18:03.925 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 05:18:04.928 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43735/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:18:04.935 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 05:18:04.936 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 05:18:04.936 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43735/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:18:04.940 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.166.128/tcp/43736/p2p/16Uiu2HAm3TdT8YKHL2u8FMrCPtpnWJ6raXg3NEQ77mHDrR2v2dWY","/ip4/172.18.166.128/tcp/43737/ws/p2p/16Uiu2HAm3TdT8YKHL2u8FMrCPtpnWJ6raXg3NEQ77mHDrR2v2dWY"],"enrUri":"enr:-L24QD8K_81m_3UKBSMY5l-ZWoSAgpa9Rpy6LTMQ4TPIXKqKZapUbsYMFgN7hamWxYjiemJ892udvFq7gqtMLmFxKmECgmlkgnY0gmlwhKwSpoCKbXVsdGlhZGRyc5YACASsEqaABqrYAAoErBKmgAaq2d0DgnJzhQDHAQAAiXNlY3AyNTZrMaECd13MQEZ9VihB9oZR34NGKhywsieJa1Z9apxtBPHD6FmDdGNwgqrYg3VkcIKq2oV3YWt1MgE"}'
2026-04-23 05:18:04.940 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 05:18:04.942 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43735/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.148.103/tcp/19009/p2p/16Uiu2HAm21zTR595FHqiobGQZPZmjhkDQDj4mDgkJJth3guyEsWc"]'
2026-04-23 05:18:04.948 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 05:18:04.957 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 05:18:04.957 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-04-23_05-18-02__1fab64fc-6d1c-4024-a587-1f7f5f609347__wakuorg_nwaku:latest.log
2026-04-23 05:18:04.957 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 05:18:04.958 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 05:18:04.959 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 05:18:04.959 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.36.33
2026-04-23 05:18:04.959 DEBUG [src.node.docker_mananger] Generated ports ['65215', '65216', '65217', '65218', '65219']
2026-04-23 05:18:04.959 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 05:18:04.959 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 05:18:04.960 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 05:18:04.960 DEBUG [src.node.docker_mananger] docker run -i -t -p 65215:65215 -p 65216:65216 -p 65217:65217 -p 65218:65218 -p 65219:65219 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=65217 --rest-port=65215 --tcp-port=65216 --discv5-udp-port=65218 --rest-address=0.0.0.0 --nat=extip:172.18.36.33 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=ac842c5a362eeda38fefd61b2d9e149bbb305ed9dfec9ce843a7596f42e6f75b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=65219 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QPTJMCLENNFAssZ5EKDlvxqpZSJFfSx4bogsxfJPLC3eFzeurAtevI-6dhh55FshyzopNWaYRwXzvAjJszU3kD0CgmlkgnY0gmlwhKwSlGeKbXVsdGlhZGRyc5YACASsEpRnBkpBAAoErBKUZwZKQt0DgnJzhQDHAQAAiXNlY3AyNTZrMaECYfDCniaeOMf0q41-3U-2CYQBjcKbnCrehwlBPzxPRoWDdGNwgkpBg3VkcIJKQ4V3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-04-23 05:18:05.163 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.36.33 waku b6e0f8303d8531ff2abe4a43df91a27c6cfb4491ceb8cb2a3f91652b328b4cc5
2026-04-23 05:18:05.200 DEBUG [src.node.docker_mananger] Container started with ID b6e0f8303d85. Setting up logs at ./log/docker/node3_2026-04-23_05-18-02__1fab64fc-6d1c-4024-a587-1f7f5f609347__wakuorg_nwaku:latest.log
2026-04-23 05:18:05.200 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 65215
2026-04-23 05:18:05.200 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 05:18:06.201 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:65215/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:18:06.206 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 05:18:06.206 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 05:18:06.207 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:65215/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:18:06.212 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.36.33/tcp/65216/p2p/16Uiu2HAkzF4wNmUJ3xyFnMN2ny1VXCChgeNPBcHVoMKtDhV7HBu2","/ip4/172.18.36.33/tcp/65217/ws/p2p/16Uiu2HAkzF4wNmUJ3xyFnMN2ny1VXCChgeNPBcHVoMKtDhV7HBu2"],"enrUri":"enr:-L24QNg7cdnCpn9oquLW4DKtyWLY2buPVuIVBDQZqXZil1-CB_W2ItWieJpDho-iXiMhv23mIQE-9iI3sUNAWghXfTQCgmlkgnY0gmlwhKwSJCGKbXVsdGlhZGRyc5YACASsEiQhBv7AAAoErBIkIQb-wd0DgnJzhQDHAQAAiXNlY3AyNTZrMaECR5MBOcOoKhtDiu-dpB64qYID3MPVKiJrbmCqfxpQPJGDdGNwgv7Ag3VkcIL-woV3YWt1MgE"}'
2026-04-23 05:18:06.212 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 05:18:06.213 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:65215/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.148.103/tcp/19009/p2p/16Uiu2HAm21zTR595FHqiobGQZPZmjhkDQDj4mDgkJJth3guyEsWc"]'
2026-04-23 05:18:06.217 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 05:18:06.225 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 05:18:06.225 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-04-23_05-18-02__1fab64fc-6d1c-4024-a587-1f7f5f609347__wakuorg_nwaku:latest.log
2026-04-23 05:18:06.225 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 05:18:06.225 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 05:18:06.227 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 05:18:06.227 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.207.129
2026-04-23 05:18:06.227 DEBUG [src.node.docker_mananger] Generated ports ['37195', '37196', '37197', '37198', '37199']
2026-04-23 05:18:06.227 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 05:18:06.228 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 05:18:06.228 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 05:18:06.228 DEBUG [src.node.docker_mananger] docker run -i -t -p 37195:37195 -p 37196:37196 -p 37197:37197 -p 37198:37198 -p 37199:37199 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=37197 --rest-port=37195 --tcp-port=37196 --discv5-udp-port=37198 --rest-address=0.0.0.0 --nat=extip:172.18.207.129 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=f2cd8fe7d64bfd7cfe5f13ce05db0ea34ecffa44b51906eb7b2faf6f40446de5 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=37199 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QPTJMCLENNFAssZ5EKDlvxqpZSJFfSx4bogsxfJPLC3eFzeurAtevI-6dhh55FshyzopNWaYRwXzvAjJszU3kD0CgmlkgnY0gmlwhKwSlGeKbXVsdGlhZGRyc5YACASsEpRnBkpBAAoErBKUZwZKQt0DgnJzhQDHAQAAiXNlY3AyNTZrMaECYfDCniaeOMf0q41-3U-2CYQBjcKbnCrehwlBPzxPRoWDdGNwgkpBg3VkcIJKQ4V3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-04-23 05:18:06.425 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.207.129 waku 3b9171b0f1be9c9b03dae7658a5e7ea9b048ec38660fe4c6a236336e25a5b3b9
2026-04-23 05:18:06.464 DEBUG [src.node.docker_mananger] Container started with ID 3b9171b0f1be. Setting up logs at ./log/docker/node4_2026-04-23_05-18-02__1fab64fc-6d1c-4024-a587-1f7f5f609347__wakuorg_nwaku:latest.log
2026-04-23 05:18:06.465 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 37195
2026-04-23 05:18:06.466 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 05:18:07.467 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37195/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:18:07.476 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 05:18:07.477 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 05:18:07.478 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37195/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:18:07.483 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.207.129/tcp/37196/p2p/16Uiu2HAm66QuSSxBTahnkywTmePznrHgQU4FB9utXnZMwsWESAFQ","/ip4/172.18.207.129/tcp/37197/ws/p2p/16Uiu2HAm66QuSSxBTahnkywTmePznrHgQU4FB9utXnZMwsWESAFQ"],"enrUri":"enr:-L24QJeOZ8JeS7fzOeBsQoE83qhFnY-JRSATM7YBFJvrWxYhaeazGo4i_9gTvYO3Y0xNq4tls9oJggaQiy6OaLjlytACgmlkgnY0gmlwhKwSz4GKbXVsdGlhZGRyc5YACASsEs-BBpFMAAoErBLPgQaRTd0DgnJzhQDHAQAAiXNlY3AyNTZrMaECnoF5srzZ7yaPH_Varn_p0MvMOgyyjs1QA9fOHIL2O9-DdGNwgpFMg3VkcIKRToV3YWt1MgE"}'
2026-04-23 05:18:07.484 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 05:18:07.484 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37195/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.148.103/tcp/19009/p2p/16Uiu2HAm21zTR595FHqiobGQZPZmjhkDQDj4mDgkJJth3guyEsWc"]'
2026-04-23 05:18:07.490 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 05:18:07.497 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 05:18:07.497 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-04-23_05-18-02__1fab64fc-6d1c-4024-a587-1f7f5f609347__wakuorg_nwaku:latest.log
2026-04-23 05:18:07.497 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 05:18:07.497 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 05:18:07.499 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 05:18:07.499 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.176.255
2026-04-23 05:18:07.499 DEBUG [src.node.docker_mananger] Generated ports ['43987', '43988', '43989', '43990', '43991']
2026-04-23 05:18:07.499 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 05:18:07.499 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 05:18:07.499 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 05:18:07.500 DEBUG [src.node.docker_mananger] docker run -i -t -p 43987:43987 -p 43988:43988 -p 43989:43989 -p 43990:43990 -p 43991:43991 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=43989 --rest-port=43987 --tcp-port=43988 --discv5-udp-port=43990 --rest-address=0.0.0.0 --nat=extip:172.18.176.255 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=ad9e669cf4d2babae8fff771a50cffc728184fac486c067b6300cfb2caf3d8a1 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=43991 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QPTJMCLENNFAssZ5EKDlvxqpZSJFfSx4bogsxfJPLC3eFzeurAtevI-6dhh55FshyzopNWaYRwXzvAjJszU3kD0CgmlkgnY0gmlwhKwSlGeKbXVsdGlhZGRyc5YACASsEpRnBkpBAAoErBKUZwZKQt0DgnJzhQDHAQAAiXNlY3AyNTZrMaECYfDCniaeOMf0q41-3U-2CYQBjcKbnCrehwlBPzxPRoWDdGNwgkpBg3VkcIJKQ4V3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-04-23 05:18:07.702 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.176.255 waku e423455f4d892389bfec6bccbc570c6ccab25b746f7c873f389b4cae1b669ffe
2026-04-23 05:18:07.741 DEBUG [src.node.docker_mananger] Container started with ID e423455f4d89. Setting up logs at ./log/docker/node5_2026-04-23_05-18-02__1fab64fc-6d1c-4024-a587-1f7f5f609347__wakuorg_nwaku:latest.log
2026-04-23 05:18:07.742 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 43987
2026-04-23 05:18:07.742 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 05:18:08.744 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43987/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:18:08.753 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 05:18:08.754 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 05:18:08.755 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43987/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:18:08.757 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.176.255/tcp/43988/p2p/16Uiu2HAmJ9t2SMNVaATqazv2LbXtKKd4SwVCNsG9Gr2asBQuxAA9","/ip4/172.18.176.255/tcp/43989/ws/p2p/16Uiu2HAmJ9t2SMNVaATqazv2LbXtKKd4SwVCNsG9Gr2asBQuxAA9"],"enrUri":"enr:-L24QIvld50LUI3bBY80iqIzFn9sWEDEzk7OzGgsKSyVKj16Fg7wnfMlmoe23CrFdP28Nm28qHgYG2ugj4sN-zBZNkECgmlkgnY0gmlwhKwSsP-KbXVsdGlhZGRyc5YACASsErD_BqvUAAoErBKw_war1d0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDUbEgWOHqFsuVeBnJb8anQavnS5-UJLFZW8fpdNNx0g6DdGNwgqvUg3VkcIKr1oV3YWt1MgE"}'
2026-04-23 05:18:08.757 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 05:18:08.757 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43987/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.148.103/tcp/19009/p2p/16Uiu2HAm21zTR595FHqiobGQZPZmjhkDQDj4mDgkJJth3guyEsWc"]'
2026-04-23 05:18:08.760 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 05:18:08.761 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:19008/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-04-23 05:18:08.763 ERROR [src.node.api_clients.base_client] HTTP error occurred: 500 Server Error: Internal Server Error for url: http://127.0.0.1:19008/relay/v1/auto/subscriptions. Response content: b'Subscribe failed:Failed to decode subscription event: Static sharding is used, relay subscriptions must specify a pubsub topic'
2026-04-23 05:18:08.800 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-04-23 05:18:08.801 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-04-23 05:18:08.801 DEBUG [src.node.waku_node] Stopping container with id 915c1d7e9894
2026-04-23 05:18:09.319 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 05:18:09.322 DEBUG [src.node.waku_node] Stopping container with id 0fbf009bdb2c
2026-04-23 05:18:09.820 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 05:18:09.821 DEBUG [src.node.waku_node] Stopping container with id b6e0f8303d85
2026-04-23 05:18:10.195 ERROR [src.node.docker_mananger] Max retries reached for container 915c1d7e9894. Exiting log stream.
2026-04-23 05:18:10.296 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 05:18:10.296 DEBUG [src.node.waku_node] Stopping container with id 3b9171b0f1be
2026-04-23 05:18:10.635 ERROR [src.node.docker_mananger] Max retries reached for container 0fbf009bdb2c. Exiting log stream.
2026-04-23 05:18:10.755 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 05:18:10.756 DEBUG [src.node.waku_node] Stopping container with id e423455f4d89
2026-04-23 05:18:11.110 ERROR [src.node.docker_mananger] Max retries reached for container b6e0f8303d85. Exiting log stream.
2026-04-23 05:18:11.231 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 05:18:11.232 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-04-23 05:18:11.268 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 05:18:11.274 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 05:18:11.279 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 05:18:11.290 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 05:18:11.295 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 05:18:11.296 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-04-23 05:18:11.296 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-04-23 05:18:11.296 DEBUG [src.libs.common] Attaching file ./log/docker/node5_2026-04-23_05-18-02__1fab64fc-6d1c-4024-a587-1f7f5f609347__wakuorg_nwaku:latest.log
2026-04-23 05:18:11.297 DEBUG [src.libs.common] Attaching file ./log/docker/node3_2026-04-23_05-18-02__1fab64fc-6d1c-4024-a587-1f7f5f609347__wakuorg_nwaku:latest.log
2026-04-23 05:18:11.297 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-04-23_05-18-02__1fab64fc-6d1c-4024-a587-1f7f5f609347__wakuorg_nwaku:latest.log
2026-04-23 05:18:11.298 DEBUG [src.libs.common] Attaching file ./log/docker/node4_2026-04-23_05-18-02__1fab64fc-6d1c-4024-a587-1f7f5f609347__wakuorg_nwaku:latest.log
2026-04-23 05:18:11.298 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-04-23_05-18-02__1fab64fc-6d1c-4024-a587-1f7f5f609347__wakuorg_nwaku:latest.log
2026-04-23 05:18:11.302 DEBUG [tests.conftest] Running fixture setup: test_id
2026-04-23 05:18:11.302 DEBUG [tests.conftest] Running test: test_auto_shard_relay with id: 2026-04-23_05-18-11__3eef21a4-2845-4810-9fc8-4530255954f8
2026-04-23 05:18:11.303 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-04-23 05:18:11.303 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-04-23 05:18:11.303 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-04-23 05:18:11.311 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 05:18:11.311 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-04-23_05-18-11__3eef21a4-2845-4810-9fc8-4530255954f8__wakuorg_nwaku:latest.log
2026-04-23 05:18:11.311 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 05:18:11.311 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 05:18:11.313 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 05:18:11.313 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.51.47
2026-04-23 05:18:11.313 DEBUG [src.node.docker_mananger] Generated ports ['41082', '41083', '41084', '41085', '41086']
2026-04-23 05:18:11.313 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 05:18:11.313 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 05:18:11.314 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 05:18:11.314 DEBUG [src.node.docker_mananger] docker run -i -t -p 41082:41082 -p 41083:41083 -p 41084:41084 -p 41085:41085 -p 41086:41086 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=41084 --rest-port=41082 --tcp-port=41083 --discv5-udp-port=41085 --rest-address=0.0.0.0 --nat=extip:172.18.51.47 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=86af0c4af0a5ed15ddc075394b8cf1d1aaaaf1bde3a8e380fbafcdbb7e69aa29 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=41086 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto
2026-04-23 05:18:11.501 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.51.47 waku 4790155903cd4762c6fa820ce92804f3eeece5c371c08241e0a8b3fa335711f6
2026-04-23 05:18:11.537 DEBUG [src.node.docker_mananger] Container started with ID 4790155903cd. Setting up logs at ./log/docker/node1_2026-04-23_05-18-11__3eef21a4-2845-4810-9fc8-4530255954f8__wakuorg_nwaku:latest.log
2026-04-23 05:18:11.538 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 41082
2026-04-23 05:18:11.538 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 05:18:11.590 ERROR [src.node.docker_mananger] Max retries reached for container 3b9171b0f1be. Exiting log stream.
2026-04-23 05:18:12.079 ERROR [src.node.docker_mananger] Max retries reached for container e423455f4d89. Exiting log stream.
2026-04-23 05:18:12.538 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:41082/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:18:12.542 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 05:18:12.542 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 05:18:12.542 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:41082/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:18:12.544 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.51.47/tcp/41083/p2p/16Uiu2HAkwerGuayWxAXXptNVk1qpXyciFCB8yjqYra4yJfe1Gfv9","/ip4/172.18.51.47/tcp/41084/ws/p2p/16Uiu2HAkwerGuayWxAXXptNVk1qpXyciFCB8yjqYra4yJfe1Gfv9"],"enrUri":"enr:-L24QHJUxS_Qdqgj4wd3DBIwuaFH9_pbh_pdHg--7Zc33bRlZuNnGxr3-jywJzpztpjtP_sd_Pqto6MDBFn-h4CaCxMCgmlkgnY0gmlwhKwSMy-KbXVsdGlhZGRyc5YACASsEjMvBqB7AAoErBIzLwagfN0DgnJzhQDHAQAAiXNlY3AyNTZrMaECIReQpowJZpOTLgIsMGSd2A5KJq9xFw6AFc6tugRsSdqDdGNwgqB7g3VkcIKgfYV3YWt1MgU"}'
2026-04-23 05:18:12.545 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 05:18:12.551 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 05:18:12.552 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-04-23_05-18-11__3eef21a4-2845-4810-9fc8-4530255954f8__wakuorg_nwaku:latest.log
2026-04-23 05:18:12.552 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 05:18:12.552 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 05:18:12.554 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 05:18:12.554 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.98.132
2026-04-23 05:18:12.554 DEBUG [src.node.docker_mananger] Generated ports ['62760', '62761', '62762', '62763', '62764']
2026-04-23 05:18:12.554 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 05:18:12.554 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 05:18:12.554 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 05:18:12.554 DEBUG [src.node.docker_mananger] docker run -i -t -p 62760:62760 -p 62761:62761 -p 62762:62762 -p 62763:62763 -p 62764:62764 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=62762 --rest-port=62760 --tcp-port=62761 --discv5-udp-port=62763 --rest-address=0.0.0.0 --nat=extip:172.18.98.132 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=c0d0aadcf4cc7ba2578d5aeb9a9dcfc01c508e0e761448c7faae000cb7aededc --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=62764 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QHJUxS_Qdqgj4wd3DBIwuaFH9_pbh_pdHg--7Zc33bRlZuNnGxr3-jywJzpztpjtP_sd_Pqto6MDBFn-h4CaCxMCgmlkgnY0gmlwhKwSMy-KbXVsdGlhZGRyc5YACASsEjMvBqB7AAoErBIzLwagfN0DgnJzhQDHAQAAiXNlY3AyNTZrMaECIReQpowJZpOTLgIsMGSd2A5KJq9xFw6AFc6tugRsSdqDdGNwgqB7g3VkcIKgfYV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-04-23 05:18:12.744 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.98.132 waku 018e81cf17f8061d5f7438babfb280bb692ca87b9fc6a4554fbd6b789c80b461
2026-04-23 05:18:12.778 DEBUG [src.node.docker_mananger] Container started with ID 018e81cf17f8. Setting up logs at ./log/docker/node2_2026-04-23_05-18-11__3eef21a4-2845-4810-9fc8-4530255954f8__wakuorg_nwaku:latest.log
2026-04-23 05:18:12.778 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 62760
2026-04-23 05:18:12.779 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 05:18:13.780 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62760/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:18:13.791 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 05:18:13.793 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 05:18:13.793 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62760/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:18:13.796 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.98.132/tcp/62761/p2p/16Uiu2HAmLTbL5UJPRpfyvghAXX6T5USX1ceF1pFsDBJWdrRuYoo9","/ip4/172.18.98.132/tcp/62762/ws/p2p/16Uiu2HAmLTbL5UJPRpfyvghAXX6T5USX1ceF1pFsDBJWdrRuYoo9"],"enrUri":"enr:-L24QDRm5DQm2KymlH_tuzLXRH3hgQbpBvCyH1zn1OD7f3w6KE1G9H1ce5WugrbxiwK6vOXcXO7WOKXNbGABhQiaQjwCgmlkgnY0gmlwhKwSYoSKbXVsdGlhZGRyc5YACASsEmKEBvUpAAoErBJihAb1Kt0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDc_IToqgMvkJBbUxw_KrCrE8XmQk3oxlnaC_m1s8Ma0SDdGNwgvUpg3VkcIL1K4V3YWt1MgE"}'
2026-04-23 05:18:13.797 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 05:18:13.798 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62760/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.51.47/tcp/41083/p2p/16Uiu2HAkwerGuayWxAXXptNVk1qpXyciFCB8yjqYra4yJfe1Gfv9"]'
2026-04-23 05:18:13.801 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 05:18:13.808 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 05:18:13.808 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-04-23_05-18-11__3eef21a4-2845-4810-9fc8-4530255954f8__wakuorg_nwaku:latest.log
2026-04-23 05:18:13.808 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 05:18:13.809 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 05:18:13.810 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 05:18:13.810 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.220.208
2026-04-23 05:18:13.810 DEBUG [src.node.docker_mananger] Generated ports ['53151', '53152', '53153', '53154', '53155']
2026-04-23 05:18:13.810 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 05:18:13.810 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 05:18:13.811 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 05:18:13.811 DEBUG [src.node.docker_mananger] docker run -i -t -p 53151:53151 -p 53152:53152 -p 53153:53153 -p 53154:53154 -p 53155:53155 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=53153 --rest-port=53151 --tcp-port=53152 --discv5-udp-port=53154 --rest-address=0.0.0.0 --nat=extip:172.18.220.208 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=aa984136c3d94e98bfdc4c2aaaae25eb8bbd3d8dd90dea5abdd6a21bf6ecd86e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=53155 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QHJUxS_Qdqgj4wd3DBIwuaFH9_pbh_pdHg--7Zc33bRlZuNnGxr3-jywJzpztpjtP_sd_Pqto6MDBFn-h4CaCxMCgmlkgnY0gmlwhKwSMy-KbXVsdGlhZGRyc5YACASsEjMvBqB7AAoErBIzLwagfN0DgnJzhQDHAQAAiXNlY3AyNTZrMaECIReQpowJZpOTLgIsMGSd2A5KJq9xFw6AFc6tugRsSdqDdGNwgqB7g3VkcIKgfYV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-04-23 05:18:14.009 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.220.208 waku 9e40a13a052b674138f32d86fea9af7c21d10734a8d4c1c6cf485451f14c43f4
2026-04-23 05:18:14.047 DEBUG [src.node.docker_mananger] Container started with ID 9e40a13a052b. Setting up logs at ./log/docker/node3_2026-04-23_05-18-11__3eef21a4-2845-4810-9fc8-4530255954f8__wakuorg_nwaku:latest.log
2026-04-23 05:18:14.047 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 53151
2026-04-23 05:18:14.047 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 05:18:15.050 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53151/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:18:15.057 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 05:18:15.058 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 05:18:15.058 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53151/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:18:15.063 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.220.208/tcp/53152/p2p/16Uiu2HAmArsQLvstMgWLWrUXwbsJqWQhrJ3dsDLdadeBAuWomW7D","/ip4/172.18.220.208/tcp/53153/ws/p2p/16Uiu2HAmArsQLvstMgWLWrUXwbsJqWQhrJ3dsDLdadeBAuWomW7D"],"enrUri":"enr:-L24QJmZGwUBItvm_XZp4MBWHNeTe_bV9wmADpTi8xd2czoHYdqho44_8LOYQ3kLB3zTX37VlGp6vHrOWimVDWrw3-ECgmlkgnY0gmlwhKwS3NCKbXVsdGlhZGRyc5YACASsEtzQBs-gAAoErBLc0AbPod0DgnJzhQDHAQAAiXNlY3AyNTZrMaEC5VO9kAb0sKIQMp-REPAqT1ybMon7utOdSBxZXbamsNyDdGNwgs-gg3VkcILPooV3YWt1MgE"}'
2026-04-23 05:18:15.063 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 05:18:15.064 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53151/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.51.47/tcp/41083/p2p/16Uiu2HAkwerGuayWxAXXptNVk1qpXyciFCB8yjqYra4yJfe1Gfv9"]'
2026-04-23 05:18:15.067 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 05:18:15.073 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 05:18:15.073 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-04-23_05-18-11__3eef21a4-2845-4810-9fc8-4530255954f8__wakuorg_nwaku:latest.log
2026-04-23 05:18:15.073 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 05:18:15.074 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 05:18:15.075 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 05:18:15.075 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.110.111
2026-04-23 05:18:15.075 DEBUG [src.node.docker_mananger] Generated ports ['32259', '32260', '32261', '32262', '32263']
2026-04-23 05:18:15.075 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 05:18:15.075 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 05:18:15.075 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 05:18:15.076 DEBUG [src.node.docker_mananger] docker run -i -t -p 32259:32259 -p 32260:32260 -p 32261:32261 -p 32262:32262 -p 32263:32263 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=32261 --rest-port=32259 --tcp-port=32260 --discv5-udp-port=32262 --rest-address=0.0.0.0 --nat=extip:172.18.110.111 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=aadd72da22e8d0c66e9d8ce4e1cb3dd7dd1d84fedf4bfeb1eb02f8562aea6aa7 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=32263 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QHJUxS_Qdqgj4wd3DBIwuaFH9_pbh_pdHg--7Zc33bRlZuNnGxr3-jywJzpztpjtP_sd_Pqto6MDBFn-h4CaCxMCgmlkgnY0gmlwhKwSMy-KbXVsdGlhZGRyc5YACASsEjMvBqB7AAoErBIzLwagfN0DgnJzhQDHAQAAiXNlY3AyNTZrMaECIReQpowJZpOTLgIsMGSd2A5KJq9xFw6AFc6tugRsSdqDdGNwgqB7g3VkcIKgfYV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-04-23 05:18:15.268 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.110.111 waku 489044f04246bbce66b8fd80a5e84d0f389c414fc019c80177d2ba3f2066c683
2026-04-23 05:18:15.304 DEBUG [src.node.docker_mananger] Container started with ID 489044f04246. Setting up logs at ./log/docker/node4_2026-04-23_05-18-11__3eef21a4-2845-4810-9fc8-4530255954f8__wakuorg_nwaku:latest.log
2026-04-23 05:18:15.304 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 32259
2026-04-23 05:18:15.305 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 05:18:16.305 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32259/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:18:16.314 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 05:18:16.314 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 05:18:16.314 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32259/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:18:16.319 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.110.111/tcp/32260/p2p/16Uiu2HAm575ztcUspRx5dCxKHuN3YtB62ABv7mYQnw42KGgdDnNm","/ip4/172.18.110.111/tcp/32261/ws/p2p/16Uiu2HAm575ztcUspRx5dCxKHuN3YtB62ABv7mYQnw42KGgdDnNm"],"enrUri":"enr:-L24QDrXh5nWUFFc5M-iwVqOQ05Fg4Ec_yBJB-jNZ7ahK3zeAjrtgEK_7VQsNm5eNpuIz1nMfIVxW_39k4D16UqkZbICgmlkgnY0gmlwhKwSbm-KbXVsdGlhZGRyc5YACASsEm5vBn4EAAoErBJubwZ-Bd0DgnJzhQDHAQAAiXNlY3AyNTZrMaECj9H9_qDAlOlD1jaDHrjBU1FFzStpsGjIqSkEWIRqSYKDdGNwgn4Eg3VkcIJ-BoV3YWt1MgE"}'
2026-04-23 05:18:16.320 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 05:18:16.320 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32259/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.51.47/tcp/41083/p2p/16Uiu2HAkwerGuayWxAXXptNVk1qpXyciFCB8yjqYra4yJfe1Gfv9"]'
2026-04-23 05:18:16.326 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 05:18:16.336 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 05:18:16.336 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-04-23_05-18-11__3eef21a4-2845-4810-9fc8-4530255954f8__wakuorg_nwaku:latest.log
2026-04-23 05:18:16.336 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 05:18:16.336 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 05:18:16.338 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 05:18:16.338 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.217.252
2026-04-23 05:18:16.338 DEBUG [src.node.docker_mananger] Generated ports ['14853', '14854', '14855', '14856', '14857']
2026-04-23 05:18:16.338 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 05:18:16.338 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 05:18:16.339 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 05:18:16.339 DEBUG [src.node.docker_mananger] docker run -i -t -p 14853:14853 -p 14854:14854 -p 14855:14855 -p 14856:14856 -p 14857:14857 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=14855 --rest-port=14853 --tcp-port=14854 --discv5-udp-port=14856 --rest-address=0.0.0.0 --nat=extip:172.18.217.252 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=3cc7b04d4ebae557e5018e789efeadc7e21c7584d7d99eed4d78b19bf8e27c5c --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=14857 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QHJUxS_Qdqgj4wd3DBIwuaFH9_pbh_pdHg--7Zc33bRlZuNnGxr3-jywJzpztpjtP_sd_Pqto6MDBFn-h4CaCxMCgmlkgnY0gmlwhKwSMy-KbXVsdGlhZGRyc5YACASsEjMvBqB7AAoErBIzLwagfN0DgnJzhQDHAQAAiXNlY3AyNTZrMaECIReQpowJZpOTLgIsMGSd2A5KJq9xFw6AFc6tugRsSdqDdGNwgqB7g3VkcIKgfYV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-04-23 05:18:16.527 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.217.252 waku ba2657801dec8de5845275cac5d435b1680c6b164f4c73e7a4ca863557b9bab7
2026-04-23 05:18:16.569 DEBUG [src.node.docker_mananger] Container started with ID ba2657801dec. Setting up logs at ./log/docker/node5_2026-04-23_05-18-11__3eef21a4-2845-4810-9fc8-4530255954f8__wakuorg_nwaku:latest.log
2026-04-23 05:18:16.569 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 14853
2026-04-23 05:18:16.569 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 05:18:17.572 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14853/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:18:17.579 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 05:18:17.579 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 05:18:17.580 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14853/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:18:17.583 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.217.252/tcp/14854/p2p/16Uiu2HAmA1XKSvmhNZ7cnFtWAJN9g5RLsTwurTBmtkMtzh22nppo","/ip4/172.18.217.252/tcp/14855/ws/p2p/16Uiu2HAmA1XKSvmhNZ7cnFtWAJN9g5RLsTwurTBmtkMtzh22nppo"],"enrUri":"enr:-L24QF0EZfA2aRSgG-wEdGhpP688kZrdf6R1AC1zixdgwHCNQzIy-uw_EcIVgxZOTJpDYhrt_Zy42VuDBGxIvz38UoUCgmlkgnY0gmlwhKwS2fyKbXVsdGlhZGRyc5YACASsEtn8BjoGAAoErBLZ_AY6B90DgnJzhQDHAQAAiXNlY3AyNTZrMaEC2K-SQPdSQm1zudYanc9WlKcoVJMjYfEI5eTIwXDpX6iDdGNwgjoGg3VkcII6CIV3YWt1MgE"}'
2026-04-23 05:18:17.584 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 05:18:17.584 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14853/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.51.47/tcp/41083/p2p/16Uiu2HAkwerGuayWxAXXptNVk1qpXyciFCB8yjqYra4yJfe1Gfv9"]'
2026-04-23 05:18:17.587 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 05:18:17.587 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:41082/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-04-23 05:18:17.590 ERROR [src.node.api_clients.base_client] HTTP error occurred: 500 Server Error: Internal Server Error for url: http://127.0.0.1:41082/relay/v1/auto/subscriptions. Response content: b'Subscribe failed:Failed to decode subscription event: Static sharding is used, relay subscriptions must specify a pubsub topic'
2026-04-23 05:18:17.629 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-04-23 05:18:17.631 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-04-23 05:18:17.631 DEBUG [src.node.waku_node] Stopping container with id 4790155903cd
2026-04-23 05:18:18.146 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 05:18:18.149 DEBUG [src.node.waku_node] Stopping container with id 018e81cf17f8
2026-04-23 05:18:18.661 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 05:18:18.661 DEBUG [src.node.waku_node] Stopping container with id 9e40a13a052b
2026-04-23 05:18:18.962 ERROR [src.node.docker_mananger] Max retries reached for container 4790155903cd. Exiting log stream.
2026-04-23 05:18:19.129 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 05:18:19.129 DEBUG [src.node.waku_node] Stopping container with id 489044f04246
2026-04-23 05:18:19.475 ERROR [src.node.docker_mananger] Max retries reached for container 018e81cf17f8. Exiting log stream.
2026-04-23 05:18:19.593 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 05:18:19.593 DEBUG [src.node.waku_node] Stopping container with id ba2657801dec
2026-04-23 05:18:19.943 ERROR [src.node.docker_mananger] Max retries reached for container 9e40a13a052b. Exiting log stream.
2026-04-23 05:18:20.049 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 05:18:20.053 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-04-23 05:18:20.073 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 05:18:20.079 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 05:18:20.085 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 05:18:20.095 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 05:18:20.101 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 05:18:20.102 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-04-23 05:18:20.102 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-04-23 05:18:20.102 DEBUG [src.libs.common] Attaching file ./log/docker/node3_2026-04-23_05-18-11__3eef21a4-2845-4810-9fc8-4530255954f8__wakuorg_nwaku:latest.log
2026-04-23 05:18:20.103 DEBUG [src.libs.common] Attaching file ./log/docker/node4_2026-04-23_05-18-11__3eef21a4-2845-4810-9fc8-4530255954f8__wakuorg_nwaku:latest.log
2026-04-23 05:18:20.103 DEBUG [src.libs.common] Attaching file ./log/docker/node5_2026-04-23_05-18-11__3eef21a4-2845-4810-9fc8-4530255954f8__wakuorg_nwaku:latest.log
2026-04-23 05:18:20.104 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-04-23_05-18-11__3eef21a4-2845-4810-9fc8-4530255954f8__wakuorg_nwaku:latest.log
2026-04-23 05:18:20.105 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-04-23_05-18-11__3eef21a4-2845-4810-9fc8-4530255954f8__wakuorg_nwaku:latest.log
Reference in New Issue View Git Blame Copy Permalink