151 lines
28 KiB
Plaintext

2026-04-23 22:06:07.434 DEBUG [tests.conftest] Running fixture setup: test_id
2026-04-23 22:06:07.434 DEBUG [tests.conftest] Running test: test_auto_shard_relay with id: 2026-04-23_22-06-07__6bafbc45-d668-4b18-97b6-169f25ff94df
2026-04-23 22:06:07.435 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-04-23 22:06:07.435 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-04-23 22:06:07.435 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-04-23 22:06:07.442 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 22:06:07.443 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-04-23_22-06-07__6bafbc45-d668-4b18-97b6-169f25ff94df__wakuorg_nwaku:latest.log
2026-04-23 22:06:07.443 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 22:06:07.443 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 22:06:07.444 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 22:06:07.445 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.159.161
2026-04-23 22:06:07.445 DEBUG [src.node.docker_mananger] Generated ports ['49020', '49021', '49022', '49023', '49024']
2026-04-23 22:06:07.445 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 22:06:07.445 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 22:06:07.445 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 22:06:07.445 DEBUG [src.node.docker_mananger] docker run -i -t -p 49020:49020 -p 49021:49021 -p 49022:49022 -p 49023:49023 -p 49024:49024 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=49022 --rest-port=49020 --tcp-port=49021 --discv5-udp-port=49023 --rest-address=0.0.0.0 --nat=extip:172.18.159.161 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=e2efeba45b50ea27a97552330b1efa80de2258fc0cde67a981cda42ac4e29af5 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=49024 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto
2026-04-23 22:06:07.632 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.159.161 waku 834aa00b84be133ac65b54160a8ab616b87e38653d1e56708b58a67d4798d5c8
2026-04-23 22:06:07.667 DEBUG [src.node.docker_mananger] Container started with ID 834aa00b84be. Setting up logs at ./log/docker/node1_2026-04-23_22-06-07__6bafbc45-d668-4b18-97b6-169f25ff94df__wakuorg_nwaku:latest.log
2026-04-23 22:06:07.668 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 49020
2026-04-23 22:06:07.668 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 22:06:07.819 ERROR [src.node.docker_mananger] Max retries reached for container 420dc40d8607. Exiting log stream.
2026-04-23 22:06:08.241 ERROR [src.node.docker_mananger] Max retries reached for container 62b5e67e023b. Exiting log stream.
2026-04-23 22:06:08.668 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:49020/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:06:08.671 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 22:06:08.672 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 22:06:08.672 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:49020/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:06:08.674 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.159.161/tcp/49021/p2p/16Uiu2HAm7oE1qrFL9ERivLCazkfXA97LutHuY6gweBYwgfUtuzZE","/ip4/172.18.159.161/tcp/49022/ws/p2p/16Uiu2HAm7oE1qrFL9ERivLCazkfXA97LutHuY6gweBYwgfUtuzZE"],"enrUri":"enr:-L24QK9r6hI1MOqdAz9B0z2Y2agMHJ2InfweO2LxrRiOPCkaDrx0CPvxAmaa7fs6HkLJMIO3ENV0pnODa7oKwHxvzbwCgmlkgnY0gmlwhKwSn6GKbXVsdGlhZGRyc5YACASsEp-hBr99AAoErBKfoQa_ft0DgnJzhQDHAQAAiXNlY3AyNTZrMaECt9Gpnqx_cHlh3__GbW6BnIP2_PwqqjC75D9wZJFN-YGDdGNwgr99g3VkcIK_f4V3YWt1MgU"}'
2026-04-23 22:06:08.674 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 22:06:08.681 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 22:06:08.681 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-04-23_22-06-07__6bafbc45-d668-4b18-97b6-169f25ff94df__wakuorg_nwaku:latest.log
2026-04-23 22:06:08.681 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 22:06:08.681 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 22:06:08.683 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 22:06:08.683 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.75.165
2026-04-23 22:06:08.683 DEBUG [src.node.docker_mananger] Generated ports ['57003', '57004', '57005', '57006', '57007']
2026-04-23 22:06:08.683 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 22:06:08.683 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 22:06:08.683 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 22:06:08.683 DEBUG [src.node.docker_mananger] docker run -i -t -p 57003:57003 -p 57004:57004 -p 57005:57005 -p 57006:57006 -p 57007:57007 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=57005 --rest-port=57003 --tcp-port=57004 --discv5-udp-port=57006 --rest-address=0.0.0.0 --nat=extip:172.18.75.165 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=dbde9d62cb1c2adb35bef3acc23adab86ef364f13d8c2716c9619e97863b82fc --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=57007 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QK9r6hI1MOqdAz9B0z2Y2agMHJ2InfweO2LxrRiOPCkaDrx0CPvxAmaa7fs6HkLJMIO3ENV0pnODa7oKwHxvzbwCgmlkgnY0gmlwhKwSn6GKbXVsdGlhZGRyc5YACASsEp-hBr99AAoErBKfoQa_ft0DgnJzhQDHAQAAiXNlY3AyNTZrMaECt9Gpnqx_cHlh3__GbW6BnIP2_PwqqjC75D9wZJFN-YGDdGNwgr99g3VkcIK_f4V3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-04-23 22:06:08.866 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.75.165 waku 51d2075dea9b4deab43284ebd887421da1a9b544449fb57ab35ec154719c0fa0
2026-04-23 22:06:08.901 DEBUG [src.node.docker_mananger] Container started with ID 51d2075dea9b. Setting up logs at ./log/docker/node2_2026-04-23_22-06-07__6bafbc45-d668-4b18-97b6-169f25ff94df__wakuorg_nwaku:latest.log
2026-04-23 22:06:08.902 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 57003
2026-04-23 22:06:08.902 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 22:06:09.903 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57003/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:06:09.911 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 22:06:09.911 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 22:06:09.912 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57003/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:06:09.915 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.75.165/tcp/57004/p2p/16Uiu2HAmFhJ6P5f3AsCrAsU6att3wm5Jx3uDkifa4jaLEyzQF52Q","/ip4/172.18.75.165/tcp/57005/ws/p2p/16Uiu2HAmFhJ6P5f3AsCrAsU6att3wm5Jx3uDkifa4jaLEyzQF52Q"],"enrUri":"enr:-L24QP_iFOZJcgUbQPhXpVRoKbCLx3mjqUem7uOt0Kjj0ghudj4Kzxy3dWBibDGuvm8KIzY9ebyIQmEktmXPPCvkPEICgmlkgnY0gmlwhKwSS6WKbXVsdGlhZGRyc5YACASsEkulBt6sAAoErBJLpQberd0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDLSpI0BZDtdbupMOmwd_XXltTdqNmQk_xAKUfldkMA6GDdGNwgt6sg3VkcILeroV3YWt1MgE"}'
2026-04-23 22:06:09.916 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 22:06:09.916 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57003/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.159.161/tcp/49021/p2p/16Uiu2HAm7oE1qrFL9ERivLCazkfXA97LutHuY6gweBYwgfUtuzZE"]'
2026-04-23 22:06:09.922 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 22:06:09.931 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 22:06:09.931 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-04-23_22-06-07__6bafbc45-d668-4b18-97b6-169f25ff94df__wakuorg_nwaku:latest.log
2026-04-23 22:06:09.931 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 22:06:09.931 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 22:06:09.933 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 22:06:09.933 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.48.174
2026-04-23 22:06:09.933 DEBUG [src.node.docker_mananger] Generated ports ['41256', '41257', '41258', '41259', '41260']
2026-04-23 22:06:09.933 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 22:06:09.933 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 22:06:09.933 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 22:06:09.934 DEBUG [src.node.docker_mananger] docker run -i -t -p 41256:41256 -p 41257:41257 -p 41258:41258 -p 41259:41259 -p 41260:41260 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=41258 --rest-port=41256 --tcp-port=41257 --discv5-udp-port=41259 --rest-address=0.0.0.0 --nat=extip:172.18.48.174 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=0a4257b96af2cfdcbb625a1f0acaddedfd0e8adbccb0e002eb5b64f3bd3afea8 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=41260 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QK9r6hI1MOqdAz9B0z2Y2agMHJ2InfweO2LxrRiOPCkaDrx0CPvxAmaa7fs6HkLJMIO3ENV0pnODa7oKwHxvzbwCgmlkgnY0gmlwhKwSn6GKbXVsdGlhZGRyc5YACASsEp-hBr99AAoErBKfoQa_ft0DgnJzhQDHAQAAiXNlY3AyNTZrMaECt9Gpnqx_cHlh3__GbW6BnIP2_PwqqjC75D9wZJFN-YGDdGNwgr99g3VkcIK_f4V3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-04-23 22:06:10.119 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.48.174 waku a7aea894d05958d5854ba3f495b73591d61b6bcc472e471642e620376668598e
2026-04-23 22:06:10.152 DEBUG [src.node.docker_mananger] Container started with ID a7aea894d059. Setting up logs at ./log/docker/node3_2026-04-23_22-06-07__6bafbc45-d668-4b18-97b6-169f25ff94df__wakuorg_nwaku:latest.log
2026-04-23 22:06:10.152 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 41256
2026-04-23 22:06:10.152 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 22:06:11.157 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:41256/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:06:11.165 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 22:06:11.165 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 22:06:11.167 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:41256/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:06:11.171 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.48.174/tcp/41257/p2p/16Uiu2HAmA5kFHNdGdpUASKLw2CLvZhbLpH3ZFTAbn99k2uYfombq","/ip4/172.18.48.174/tcp/41258/ws/p2p/16Uiu2HAmA5kFHNdGdpUASKLw2CLvZhbLpH3ZFTAbn99k2uYfombq"],"enrUri":"enr:-L24QP-ZTzp_IVHA0I122snML9FhRQyj6hcSscwNdZeKgvlRLx27Nl8kANp7MalyMah31hCjMd3Lo80pFF2ooB8XU5ECgmlkgnY0gmlwhKwSMK6KbXVsdGlhZGRyc5YACASsEjCuBqEpAAoErBIwrgahKt0DgnJzhQDHAQAAiXNlY3AyNTZrMaEC2cSDMvDyQMDMZX-AFRRDIC-aRF1Du_YJZ06o15nNHoSDdGNwgqEpg3VkcIKhK4V3YWt1MgE"}'
2026-04-23 22:06:11.172 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 22:06:11.172 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:41256/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.159.161/tcp/49021/p2p/16Uiu2HAm7oE1qrFL9ERivLCazkfXA97LutHuY6gweBYwgfUtuzZE"]'
2026-04-23 22:06:11.175 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 22:06:11.182 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 22:06:11.182 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-04-23_22-06-07__6bafbc45-d668-4b18-97b6-169f25ff94df__wakuorg_nwaku:latest.log
2026-04-23 22:06:11.182 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 22:06:11.182 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 22:06:11.183 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 22:06:11.184 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.120.15
2026-04-23 22:06:11.184 DEBUG [src.node.docker_mananger] Generated ports ['35808', '35809', '35810', '35811', '35812']
2026-04-23 22:06:11.184 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 22:06:11.184 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 22:06:11.184 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 22:06:11.184 DEBUG [src.node.docker_mananger] docker run -i -t -p 35808:35808 -p 35809:35809 -p 35810:35810 -p 35811:35811 -p 35812:35812 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=35810 --rest-port=35808 --tcp-port=35809 --discv5-udp-port=35811 --rest-address=0.0.0.0 --nat=extip:172.18.120.15 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=dd07e71e7a60da703dbb1afdcffbbabe43ded835bdf7fed29b4b55fd907931ff --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=35812 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QK9r6hI1MOqdAz9B0z2Y2agMHJ2InfweO2LxrRiOPCkaDrx0CPvxAmaa7fs6HkLJMIO3ENV0pnODa7oKwHxvzbwCgmlkgnY0gmlwhKwSn6GKbXVsdGlhZGRyc5YACASsEp-hBr99AAoErBKfoQa_ft0DgnJzhQDHAQAAiXNlY3AyNTZrMaECt9Gpnqx_cHlh3__GbW6BnIP2_PwqqjC75D9wZJFN-YGDdGNwgr99g3VkcIK_f4V3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-04-23 22:06:11.389 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.120.15 waku 7a265b66b191d1ebd86cfc685cedeeb91e88875530870c0176a89b51c0bd852e
2026-04-23 22:06:11.423 DEBUG [src.node.docker_mananger] Container started with ID 7a265b66b191. Setting up logs at ./log/docker/node4_2026-04-23_22-06-07__6bafbc45-d668-4b18-97b6-169f25ff94df__wakuorg_nwaku:latest.log
2026-04-23 22:06:11.424 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 35808
2026-04-23 22:06:11.424 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 22:06:12.429 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35808/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:06:12.435 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 22:06:12.436 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 22:06:12.436 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35808/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:06:12.441 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.120.15/tcp/35809/p2p/16Uiu2HAmGWNLcCgM3JY1kmv7mUaqa8reCsDdHUiXFaMyepRsMfeG","/ip4/172.18.120.15/tcp/35810/ws/p2p/16Uiu2HAmGWNLcCgM3JY1kmv7mUaqa8reCsDdHUiXFaMyepRsMfeG"],"enrUri":"enr:-L24QL1vdq_ggrrX0HvmnpxrVZDtNhhxB0wX8YYAq8XmUESII1qc6io4O0F2heRBJaMe7tTioF4zDn52X990nwXfqTACgmlkgnY0gmlwhKwSeA-KbXVsdGlhZGRyc5YACASsEngPBovhAAoErBJ4DwaL4t0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDOTlh8mNYfIlhlG8jV2rYzesnKwnSCqhCQWQ_GYnaWUmDdGNwgovhg3VkcIKL44V3YWt1MgE"}'
2026-04-23 22:06:12.441 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 22:06:12.442 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35808/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.159.161/tcp/49021/p2p/16Uiu2HAm7oE1qrFL9ERivLCazkfXA97LutHuY6gweBYwgfUtuzZE"]'
2026-04-23 22:06:12.452 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 22:06:12.459 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 22:06:12.459 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-04-23_22-06-07__6bafbc45-d668-4b18-97b6-169f25ff94df__wakuorg_nwaku:latest.log
2026-04-23 22:06:12.459 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 22:06:12.459 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 22:06:12.461 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 22:06:12.461 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.133.151
2026-04-23 22:06:12.461 DEBUG [src.node.docker_mananger] Generated ports ['61580', '61581', '61582', '61583', '61584']
2026-04-23 22:06:12.461 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 22:06:12.461 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 22:06:12.461 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 22:06:12.462 DEBUG [src.node.docker_mananger] docker run -i -t -p 61580:61580 -p 61581:61581 -p 61582:61582 -p 61583:61583 -p 61584:61584 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=61582 --rest-port=61580 --tcp-port=61581 --discv5-udp-port=61583 --rest-address=0.0.0.0 --nat=extip:172.18.133.151 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=a5a42ec5ab76c952af3aefdc55f4d6f7f644aafab58cc81afada6c7e82ea8dfb --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=61584 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QK9r6hI1MOqdAz9B0z2Y2agMHJ2InfweO2LxrRiOPCkaDrx0CPvxAmaa7fs6HkLJMIO3ENV0pnODa7oKwHxvzbwCgmlkgnY0gmlwhKwSn6GKbXVsdGlhZGRyc5YACASsEp-hBr99AAoErBKfoQa_ft0DgnJzhQDHAQAAiXNlY3AyNTZrMaECt9Gpnqx_cHlh3__GbW6BnIP2_PwqqjC75D9wZJFN-YGDdGNwgr99g3VkcIK_f4V3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-04-23 22:06:12.649 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.133.151 waku 1cdb45a4c8e83ff272b5e0e3e80a602816db2a7c71406dfc23026bacde807b9f
2026-04-23 22:06:12.683 DEBUG [src.node.docker_mananger] Container started with ID 1cdb45a4c8e8. Setting up logs at ./log/docker/node5_2026-04-23_22-06-07__6bafbc45-d668-4b18-97b6-169f25ff94df__wakuorg_nwaku:latest.log
2026-04-23 22:06:12.684 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 61580
2026-04-23 22:06:12.684 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 22:06:13.685 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61580/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:06:13.691 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 22:06:13.695 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 22:06:13.696 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61580/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:06:13.702 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.133.151/tcp/61581/p2p/16Uiu2HAm4SvQe5mVogT2vrinFXCvdQKmzYj6XMv2uzSk19ctim2E","/ip4/172.18.133.151/tcp/61582/ws/p2p/16Uiu2HAm4SvQe5mVogT2vrinFXCvdQKmzYj6XMv2uzSk19ctim2E"],"enrUri":"enr:-L24QPba3q33KC3ykH2s22jQFdR07AYxqD0mXxY3IJnkyYjcXh3pe5OEGjUB_fR13LjAm8NlpVOeGMhgC4V7arOg4ooCgmlkgnY0gmlwhKwShZeKbXVsdGlhZGRyc5YACASsEoWXBvCNAAoErBKFlwbwjt0DgnJzhQDHAQAAiXNlY3AyNTZrMaEChgsTzyJZEr-VRmJpiKjlIQuPaXyH3T1GPK7MO3yPHO-DdGNwgvCNg3VkcILwj4V3YWt1MgE"}'
2026-04-23 22:06:13.702 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 22:06:13.703 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61580/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.159.161/tcp/49021/p2p/16Uiu2HAm7oE1qrFL9ERivLCazkfXA97LutHuY6gweBYwgfUtuzZE"]'
2026-04-23 22:06:13.707 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 22:06:13.708 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:49020/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-04-23 22:06:13.710 ERROR [src.node.api_clients.base_client] HTTP error occurred: 500 Server Error: Internal Server Error for url: http://127.0.0.1:49020/relay/v1/auto/subscriptions. Response content: b'Subscribe failed:Failed to decode subscription event: Static sharding is used, relay subscriptions must specify a pubsub topic'
2026-04-23 22:06:13.778 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-04-23 22:06:13.779 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-04-23 22:06:13.779 DEBUG [src.node.waku_node] Stopping container with id 834aa00b84be
2026-04-23 22:06:14.281 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 22:06:14.281 DEBUG [src.node.waku_node] Stopping container with id 51d2075dea9b
2026-04-23 22:06:14.774 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 22:06:14.775 DEBUG [src.node.waku_node] Stopping container with id a7aea894d059
2026-04-23 22:06:15.095 ERROR [src.node.docker_mananger] Max retries reached for container 834aa00b84be. Exiting log stream.
2026-04-23 22:06:15.263 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 22:06:15.265 DEBUG [src.node.waku_node] Stopping container with id 7a265b66b191
2026-04-23 22:06:15.609 ERROR [src.node.docker_mananger] Max retries reached for container 51d2075dea9b. Exiting log stream.
2026-04-23 22:06:15.719 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 22:06:15.721 DEBUG [src.node.waku_node] Stopping container with id 1cdb45a4c8e8
2026-04-23 22:06:16.079 ERROR [src.node.docker_mananger] Max retries reached for container a7aea894d059. Exiting log stream.
2026-04-23 22:06:16.173 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 22:06:16.175 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-04-23 22:06:16.194 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 22:06:16.205 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 22:06:16.210 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 22:06:16.216 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 22:06:16.221 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 22:06:16.222 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-04-23 22:06:16.222 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-04-23 22:06:16.222 DEBUG [src.libs.common] Attaching file ./log/docker/node3_2026-04-23_22-06-07__6bafbc45-d668-4b18-97b6-169f25ff94df__wakuorg_nwaku:latest.log
2026-04-23 22:06:16.223 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-04-23_22-06-07__6bafbc45-d668-4b18-97b6-169f25ff94df__wakuorg_nwaku:latest.log
2026-04-23 22:06:16.224 DEBUG [src.libs.common] Attaching file ./log/docker/node4_2026-04-23_22-06-07__6bafbc45-d668-4b18-97b6-169f25ff94df__wakuorg_nwaku:latest.log
2026-04-23 22:06:16.224 DEBUG [src.libs.common] Attaching file ./log/docker/node5_2026-04-23_22-06-07__6bafbc45-d668-4b18-97b6-169f25ff94df__wakuorg_nwaku:latest.log
2026-04-23 22:06:16.225 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-04-23_22-06-07__6bafbc45-d668-4b18-97b6-169f25ff94df__wakuorg_nwaku:latest.log