297 lines
57 KiB
Plaintext

2026-03-01 04:44:13.142 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-01 04:44:13.143 DEBUG [tests.conftest] Running test: test_auto_shard_relay_10_nwaku_nodes with id: 2026-03-01_04-44-13__1b5c7d6b-c9b3-47ca-aa8a-57978ff07174
2026-03-01 04:44:13.143 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-01 04:44:13.143 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-01 04:44:13.143 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-01 04:44:13.151 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-01 04:44:13.151 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-01_04-44-13__1b5c7d6b-c9b3-47ca-aa8a-57978ff07174__wakuorg_nwaku:latest.log
2026-03-01 04:44:13.151 DEBUG [src.node.waku_node] Starting Node...
2026-03-01 04:44:13.151 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-01 04:44:13.153 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-01 04:44:13.153 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.203.173
2026-03-01 04:44:13.153 DEBUG [src.node.docker_mananger] Generated ports ['2611', '2612', '2613', '2614', '2615']
2026-03-01 04:44:13.153 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-01 04:44:13.153 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-01 04:44:13.153 DEBUG [src.node.waku_node] Using volumes []
2026-03-01 04:44:13.154 DEBUG [src.node.docker_mananger] docker run -i -t -p 2611:2611 -p 2612:2612 -p 2613:2613 -p 2614:2614 -p 2615:2615 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=2613 --rest-port=2611 --tcp-port=2612 --discv5-udp-port=2614 --rest-address=0.0.0.0 --nat=extip:172.18.203.173 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=af6ea93efcdee2e7f1c3f7a75edef7e346b51aa9cbbefab63ea0b6a6feffa9dc --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=2615 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto
2026-03-01 04:44:13.359 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.203.173 waku 7f258bc5bd0d64f9a0dba08f1bf859941d51c9d652bc7de155b8011eeeb25f77
2026-03-01 04:44:13.393 DEBUG [src.node.docker_mananger] Container started with ID 7f258bc5bd0d. Setting up logs at ./log/docker/node1_2026-03-01_04-44-13__1b5c7d6b-c9b3-47ca-aa8a-57978ff07174__wakuorg_nwaku:latest.log
2026-03-01 04:44:13.394 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 2611
2026-03-01 04:44:13.395 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-01 04:44:13.949 ERROR [src.node.docker_mananger] Max retries reached for container fedfddf30cd4. Exiting log stream.
2026-03-01 04:44:14.395 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2611/health" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:44:14.398 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-01 04:44:14.398 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-01 04:44:14.398 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2611/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:44:14.401 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.203.173/tcp/2612/p2p/16Uiu2HAmEXmhVK9arM9D6Zkt2aUS8JzdfiSKjqBBjAmZ5fafgj8L","/ip4/172.18.203.173/tcp/2613/ws/p2p/16Uiu2HAmEXmhVK9arM9D6Zkt2aUS8JzdfiSKjqBBjAmZ5fafgj8L"],"enrUri":"enr:-L24QMy0CZ_palraubdoWb9QKLNpmQqmdLuPCHcKL47X8lsTFV4Byqfku64Ih2PyPfavLFew2I8LCzrj-JB4TNEGC8sCgmlkgnY0gmlwhKwSy62KbXVsdGlhZGRyc5YACASsEsutBgo0AAoErBLLrQYKNd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDG94AuOegQQKZuhFUf7ZEnZbuHHVBHMLRVip2PMEEgymDdGNwggo0g3VkcIIKNoV3YWt1MgU"}'
2026-03-01 04:44:14.401 INFO [src.node.waku_node] REST service is ready !!
2026-03-01 04:44:14.408 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-01 04:44:14.408 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-01_04-44-13__1b5c7d6b-c9b3-47ca-aa8a-57978ff07174__wakuorg_nwaku:latest.log
2026-03-01 04:44:14.409 DEBUG [src.node.waku_node] Starting Node...
2026-03-01 04:44:14.409 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-01 04:44:14.410 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-01 04:44:14.410 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.220.240
2026-03-01 04:44:14.410 DEBUG [src.node.docker_mananger] Generated ports ['17352', '17353', '17354', '17355', '17356']
2026-03-01 04:44:14.411 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-01 04:44:14.411 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-01 04:44:14.411 DEBUG [src.node.waku_node] Using volumes []
2026-03-01 04:44:14.411 DEBUG [src.node.docker_mananger] docker run -i -t -p 17352:17352 -p 17353:17353 -p 17354:17354 -p 17355:17355 -p 17356:17356 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=17354 --rest-port=17352 --tcp-port=17353 --discv5-udp-port=17355 --rest-address=0.0.0.0 --nat=extip:172.18.220.240 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=e4bad44137ecf1b855abda5ced9cee3edbfd4fcb69b1ec9ebbfcef7f2ed67bbf --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=17356 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QMy0CZ_palraubdoWb9QKLNpmQqmdLuPCHcKL47X8lsTFV4Byqfku64Ih2PyPfavLFew2I8LCzrj-JB4TNEGC8sCgmlkgnY0gmlwhKwSy62KbXVsdGlhZGRyc5YACASsEsutBgo0AAoErBLLrQYKNd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDG94AuOegQQKZuhFUf7ZEnZbuHHVBHMLRVip2PMEEgymDdGNwggo0g3VkcIIKNoV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-01 04:44:14.599 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.220.240 waku 31697a8232fa84887da28bfe2c3b3f527790d33675803c865365682f09e8f5ec
2026-03-01 04:44:14.632 DEBUG [src.node.docker_mananger] Container started with ID 31697a8232fa. Setting up logs at ./log/docker/node3_2026-03-01_04-44-13__1b5c7d6b-c9b3-47ca-aa8a-57978ff07174__wakuorg_nwaku:latest.log
2026-03-01 04:44:14.632 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 17352
2026-03-01 04:44:14.633 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-01 04:44:15.633 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17352/health" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:44:15.659 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-01 04:44:15.660 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-01 04:44:15.660 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17352/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:44:15.666 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.220.240/tcp/17353/p2p/16Uiu2HAmBc7g25Ra9j9ARpiWAv5eh7QvPvph9p9ufsov9pj5wdax","/ip4/172.18.220.240/tcp/17354/ws/p2p/16Uiu2HAmBc7g25Ra9j9ARpiWAv5eh7QvPvph9p9ufsov9pj5wdax"],"enrUri":"enr:-L24QI95fFIV72B8i6Zj0nD5r1D8-JOCUqCKkzUPIbg6VzWlU56pjd4krjzK94X_HUkv9_l0RJN5QjjH67Fgl8VjBq8CgmlkgnY0gmlwhKwS3PCKbXVsdGlhZGRyc5YACASsEtzwBkPJAAoErBLc8AZDyt0DgnJzhQACAQAAiXNlY3AyNTZrMaEC8GfZx4yZQbvfBXDOHDzOYWVk6XkyuZEqM29tv_CJuHGDdGNwgkPJg3VkcIJDy4V3YWt1MgE"}'
2026-03-01 04:44:15.667 INFO [src.node.waku_node] REST service is ready !!
2026-03-01 04:44:15.667 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17352/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.203.173/tcp/2612/p2p/16Uiu2HAmEXmhVK9arM9D6Zkt2aUS8JzdfiSKjqBBjAmZ5fafgj8L"]'
2026-03-01 04:44:15.670 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:44:15.676 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-01 04:44:15.677 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-01_04-44-13__1b5c7d6b-c9b3-47ca-aa8a-57978ff07174__wakuorg_nwaku:latest.log
2026-03-01 04:44:15.677 DEBUG [src.node.waku_node] Starting Node...
2026-03-01 04:44:15.677 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-01 04:44:15.678 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-01 04:44:15.678 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.195.134
2026-03-01 04:44:15.679 DEBUG [src.node.docker_mananger] Generated ports ['6228', '6229', '6230', '6231', '6232']
2026-03-01 04:44:15.679 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-01 04:44:15.679 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-01 04:44:15.679 DEBUG [src.node.waku_node] Using volumes []
2026-03-01 04:44:15.679 DEBUG [src.node.docker_mananger] docker run -i -t -p 6228:6228 -p 6229:6229 -p 6230:6230 -p 6231:6231 -p 6232:6232 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=6230 --rest-port=6228 --tcp-port=6229 --discv5-udp-port=6231 --rest-address=0.0.0.0 --nat=extip:172.18.195.134 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=cf7305b9eb7d6b7eb097d5e1ac1bc3d4babb19a8665a6d3b7ad3f4e9e32af428 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=6232 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QMy0CZ_palraubdoWb9QKLNpmQqmdLuPCHcKL47X8lsTFV4Byqfku64Ih2PyPfavLFew2I8LCzrj-JB4TNEGC8sCgmlkgnY0gmlwhKwSy62KbXVsdGlhZGRyc5YACASsEsutBgo0AAoErBLLrQYKNd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDG94AuOegQQKZuhFUf7ZEnZbuHHVBHMLRVip2PMEEgymDdGNwggo0g3VkcIIKNoV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-01 04:44:15.878 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.195.134 waku 9291bd45109878e6ce41368e172f1dd077da478b676229e17be514b983917b99
2026-03-01 04:44:15.913 DEBUG [src.node.docker_mananger] Container started with ID 9291bd451098. Setting up logs at ./log/docker/node4_2026-03-01_04-44-13__1b5c7d6b-c9b3-47ca-aa8a-57978ff07174__wakuorg_nwaku:latest.log
2026-03-01 04:44:15.913 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 6228
2026-03-01 04:44:15.914 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-01 04:44:16.915 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6228/health" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:44:16.928 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-01 04:44:16.930 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-01 04:44:16.930 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6228/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:44:16.936 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.195.134/tcp/6229/p2p/16Uiu2HAm3k7GyfbotgFu9uyyRw6SXX5zjMBsyoZhcvBsLC7qiiY1","/ip4/172.18.195.134/tcp/6230/ws/p2p/16Uiu2HAm3k7GyfbotgFu9uyyRw6SXX5zjMBsyoZhcvBsLC7qiiY1"],"enrUri":"enr:-L24QL-GNE_y8mmG0CF8DemEGmYFethakELX_7QyWD6cwJLxT7rJe6DOlo_ui2BmEGXoHTbZnloRpIxjY1eONFZxFS8CgmlkgnY0gmlwhKwSw4aKbXVsdGlhZGRyc5YACASsEsOGBhhVAAoErBLDhgYYVt0DgnJzhQACAQAAiXNlY3AyNTZrMaECe5aNdTy75vPensTLO1mIomYMpRDxOeXUOtzGYeu31TKDdGNwghhVg3VkcIIYV4V3YWt1MgE"}'
2026-03-01 04:44:16.937 INFO [src.node.waku_node] REST service is ready !!
2026-03-01 04:44:16.937 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:6228/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.203.173/tcp/2612/p2p/16Uiu2HAmEXmhVK9arM9D6Zkt2aUS8JzdfiSKjqBBjAmZ5fafgj8L"]'
2026-03-01 04:44:16.942 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:44:16.949 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-01 04:44:16.949 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-03-01_04-44-13__1b5c7d6b-c9b3-47ca-aa8a-57978ff07174__wakuorg_nwaku:latest.log
2026-03-01 04:44:16.949 DEBUG [src.node.waku_node] Starting Node...
2026-03-01 04:44:16.949 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-01 04:44:16.951 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-01 04:44:16.951 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.80.167
2026-03-01 04:44:16.951 DEBUG [src.node.docker_mananger] Generated ports ['62166', '62167', '62168', '62169', '62170']
2026-03-01 04:44:16.951 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-01 04:44:16.951 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-01 04:44:16.952 DEBUG [src.node.waku_node] Using volumes []
2026-03-01 04:44:16.952 DEBUG [src.node.docker_mananger] docker run -i -t -p 62166:62166 -p 62167:62167 -p 62168:62168 -p 62169:62169 -p 62170:62170 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=62168 --rest-port=62166 --tcp-port=62167 --discv5-udp-port=62169 --rest-address=0.0.0.0 --nat=extip:172.18.80.167 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=1f02c30ce5c29ad7c2983d2bdc5bb784eee8baffc976efa1eae7af5c2ac070a4 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=62170 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QMy0CZ_palraubdoWb9QKLNpmQqmdLuPCHcKL47X8lsTFV4Byqfku64Ih2PyPfavLFew2I8LCzrj-JB4TNEGC8sCgmlkgnY0gmlwhKwSy62KbXVsdGlhZGRyc5YACASsEsutBgo0AAoErBLLrQYKNd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDG94AuOegQQKZuhFUf7ZEnZbuHHVBHMLRVip2PMEEgymDdGNwggo0g3VkcIIKNoV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-01 04:44:17.154 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.80.167 waku 1f30199f22b97707b933d50fa005f752166eb5525e4749a1b27d124ca71f6cb8
2026-03-01 04:44:17.190 DEBUG [src.node.docker_mananger] Container started with ID 1f30199f22b9. Setting up logs at ./log/docker/node5_2026-03-01_04-44-13__1b5c7d6b-c9b3-47ca-aa8a-57978ff07174__wakuorg_nwaku:latest.log
2026-03-01 04:44:17.191 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 62166
2026-03-01 04:44:17.191 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-01 04:44:18.192 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62166/health" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:44:18.205 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-01 04:44:18.205 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-01 04:44:18.208 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62166/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:44:18.212 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.80.167/tcp/62167/p2p/16Uiu2HAmFSgFmxSLF8QFfSivH7YEK1dHC49RAzB5q3PvdKDd3vA4","/ip4/172.18.80.167/tcp/62168/ws/p2p/16Uiu2HAmFSgFmxSLF8QFfSivH7YEK1dHC49RAzB5q3PvdKDd3vA4"],"enrUri":"enr:-L24QMs6_g9k3YzRY-D4kgGaF083MublIDsZYLAH-qk9znlGfR8fTd4GI61pn7jQszt0L80s15HVl2bTzVhSysDFI8ACgmlkgnY0gmlwhKwSUKeKbXVsdGlhZGRyc5YACASsElCnBvLXAAoErBJQpwby2N0DgnJzhQACAQAAiXNlY3AyNTZrMaEDKWuhg2YeXjYPkaJ6EYdK0MS6EzXUAk9d3qsXod7qDBGDdGNwgvLXg3VkcILy2YV3YWt1MgE"}'
2026-03-01 04:44:18.214 INFO [src.node.waku_node] REST service is ready !!
2026-03-01 04:44:18.215 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62166/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.203.173/tcp/2612/p2p/16Uiu2HAmEXmhVK9arM9D6Zkt2aUS8JzdfiSKjqBBjAmZ5fafgj8L"]'
2026-03-01 04:44:18.218 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:44:18.225 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-01 04:44:18.225 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node6_2026-03-01_04-44-13__1b5c7d6b-c9b3-47ca-aa8a-57978ff07174__wakuorg_nwaku:latest.log
2026-03-01 04:44:18.225 DEBUG [src.node.waku_node] Starting Node...
2026-03-01 04:44:18.225 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-01 04:44:18.226 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-01 04:44:18.227 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.118.55
2026-03-01 04:44:18.227 DEBUG [src.node.docker_mananger] Generated ports ['50790', '50791', '50792', '50793', '50794']
2026-03-01 04:44:18.227 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-01 04:44:18.227 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-01 04:44:18.227 DEBUG [src.node.waku_node] Using volumes []
2026-03-01 04:44:18.227 DEBUG [src.node.docker_mananger] docker run -i -t -p 50790:50790 -p 50791:50791 -p 50792:50792 -p 50793:50793 -p 50794:50794 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=50792 --rest-port=50790 --tcp-port=50791 --discv5-udp-port=50793 --rest-address=0.0.0.0 --nat=extip:172.18.118.55 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=2df28dcc056fa30efe4e8aed12bcd7feb1bcfda82beff5cfdbaa08ab48a9eca4 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=50794 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QMy0CZ_palraubdoWb9QKLNpmQqmdLuPCHcKL47X8lsTFV4Byqfku64Ih2PyPfavLFew2I8LCzrj-JB4TNEGC8sCgmlkgnY0gmlwhKwSy62KbXVsdGlhZGRyc5YACASsEsutBgo0AAoErBLLrQYKNd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDG94AuOegQQKZuhFUf7ZEnZbuHHVBHMLRVip2PMEEgymDdGNwggo0g3VkcIIKNoV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-01 04:44:18.423 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.118.55 waku 2ed41bd592f740e9007366f28d1a149ba396fd091c22be76b349ffee2d0b292f
2026-03-01 04:44:18.455 DEBUG [src.node.docker_mananger] Container started with ID 2ed41bd592f7. Setting up logs at ./log/docker/node6_2026-03-01_04-44-13__1b5c7d6b-c9b3-47ca-aa8a-57978ff07174__wakuorg_nwaku:latest.log
2026-03-01 04:44:18.456 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 50790
2026-03-01 04:44:18.457 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-01 04:44:19.459 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50790/health" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:44:19.477 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-01 04:44:19.477 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-01 04:44:19.478 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50790/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:44:19.486 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.118.55/tcp/50791/p2p/16Uiu2HAmDUDf9S7aQBDakTiPHk6XaL1v8s9WSMeWaHhkLBH8CSHp","/ip4/172.18.118.55/tcp/50792/ws/p2p/16Uiu2HAmDUDf9S7aQBDakTiPHk6XaL1v8s9WSMeWaHhkLBH8CSHp"],"enrUri":"enr:-L24QDXbyiL3GcMxESRqD6iwWooL0eO2keyIgKVXY4fcEJEpC80cneyKHpDkzJD03Xgd491dm4YL4oqlx4nC5jpWHQkCgmlkgnY0gmlwhKwSdjeKbXVsdGlhZGRyc5YACASsEnY3BsZnAAoErBJ2NwbGaN0DgnJzhQACAQAAiXNlY3AyNTZrMaEDDBlYZFD0MBPJhywsHqa_IzpLq-CT2HYYfOKfCVegOnuDdGNwgsZng3VkcILGaYV3YWt1MgE"}'
2026-03-01 04:44:19.487 INFO [src.node.waku_node] REST service is ready !!
2026-03-01 04:44:19.488 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:50790/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.203.173/tcp/2612/p2p/16Uiu2HAmEXmhVK9arM9D6Zkt2aUS8JzdfiSKjqBBjAmZ5fafgj8L"]'
2026-03-01 04:44:19.491 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:44:19.497 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-01 04:44:19.497 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node7_2026-03-01_04-44-13__1b5c7d6b-c9b3-47ca-aa8a-57978ff07174__wakuorg_nwaku:latest.log
2026-03-01 04:44:19.498 DEBUG [src.node.waku_node] Starting Node...
2026-03-01 04:44:19.498 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-01 04:44:19.499 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-01 04:44:19.499 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.50.29
2026-03-01 04:44:19.499 DEBUG [src.node.docker_mananger] Generated ports ['25491', '25492', '25493', '25494', '25495']
2026-03-01 04:44:19.500 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-01 04:44:19.500 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-01 04:44:19.500 DEBUG [src.node.waku_node] Using volumes []
2026-03-01 04:44:19.500 DEBUG [src.node.docker_mananger] docker run -i -t -p 25491:25491 -p 25492:25492 -p 25493:25493 -p 25494:25494 -p 25495:25495 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=25493 --rest-port=25491 --tcp-port=25492 --discv5-udp-port=25494 --rest-address=0.0.0.0 --nat=extip:172.18.50.29 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=f3ef88ff30db1c2c73cedd98dcfae68b0724da3087ba8f95dfa3ecd2c3f845ce --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=25495 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QMy0CZ_palraubdoWb9QKLNpmQqmdLuPCHcKL47X8lsTFV4Byqfku64Ih2PyPfavLFew2I8LCzrj-JB4TNEGC8sCgmlkgnY0gmlwhKwSy62KbXVsdGlhZGRyc5YACASsEsutBgo0AAoErBLLrQYKNd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDG94AuOegQQKZuhFUf7ZEnZbuHHVBHMLRVip2PMEEgymDdGNwggo0g3VkcIIKNoV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-01 04:44:19.702 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.50.29 waku 4e8942866ff366c9c4be3ee09f921f1146ff40148799a4bca1fec6c9a4e987b5
2026-03-01 04:44:19.736 DEBUG [src.node.docker_mananger] Container started with ID 4e8942866ff3. Setting up logs at ./log/docker/node7_2026-03-01_04-44-13__1b5c7d6b-c9b3-47ca-aa8a-57978ff07174__wakuorg_nwaku:latest.log
2026-03-01 04:44:19.736 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 25491
2026-03-01 04:44:19.736 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-01 04:44:20.737 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25491/health" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:44:20.766 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-01 04:44:20.767 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-01 04:44:20.767 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25491/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:44:20.772 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.50.29/tcp/25492/p2p/16Uiu2HAm8M5QEv4okhksBVPsbuiBARBBNx8UzF5ugcr3WpkCdMf2","/ip4/172.18.50.29/tcp/25493/ws/p2p/16Uiu2HAm8M5QEv4okhksBVPsbuiBARBBNx8UzF5ugcr3WpkCdMf2"],"enrUri":"enr:-L24QHSmgywbJeYtdnazb_aly1jxHLTQKfOsRlLHdXquw2H9fsIdy-TQ4Y3QFd0_ueHoce60dZV_CpNeVWGcCXU284kCgmlkgnY0gmlwhKwSMh2KbXVsdGlhZGRyc5YACASsEjIdBmOUAAoErBIyHQZjld0DgnJzhQACAQAAiXNlY3AyNTZrMaECv_qCPyG76duoDS1pbLgIzgcKZUXAhiP828njTeCJ5N2DdGNwgmOUg3VkcIJjloV3YWt1MgE"}'
2026-03-01 04:44:20.773 INFO [src.node.waku_node] REST service is ready !!
2026-03-01 04:44:20.773 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:25491/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.203.173/tcp/2612/p2p/16Uiu2HAmEXmhVK9arM9D6Zkt2aUS8JzdfiSKjqBBjAmZ5fafgj8L"]'
2026-03-01 04:44:20.776 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:44:20.783 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-01 04:44:20.783 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node8_2026-03-01_04-44-13__1b5c7d6b-c9b3-47ca-aa8a-57978ff07174__wakuorg_nwaku:latest.log
2026-03-01 04:44:20.783 DEBUG [src.node.waku_node] Starting Node...
2026-03-01 04:44:20.783 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-01 04:44:20.784 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-01 04:44:20.784 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.158.197
2026-03-01 04:44:20.784 DEBUG [src.node.docker_mananger] Generated ports ['24536', '24537', '24538', '24539', '24540']
2026-03-01 04:44:20.785 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-01 04:44:20.785 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-01 04:44:20.785 DEBUG [src.node.waku_node] Using volumes []
2026-03-01 04:44:20.785 DEBUG [src.node.docker_mananger] docker run -i -t -p 24536:24536 -p 24537:24537 -p 24538:24538 -p 24539:24539 -p 24540:24540 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=24538 --rest-port=24536 --tcp-port=24537 --discv5-udp-port=24539 --rest-address=0.0.0.0 --nat=extip:172.18.158.197 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=441f049b6bdc8e31c80e898a979dbee64cfded2efd6da34d57eee6d4bca2dba7 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=24540 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QMy0CZ_palraubdoWb9QKLNpmQqmdLuPCHcKL47X8lsTFV4Byqfku64Ih2PyPfavLFew2I8LCzrj-JB4TNEGC8sCgmlkgnY0gmlwhKwSy62KbXVsdGlhZGRyc5YACASsEsutBgo0AAoErBLLrQYKNd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDG94AuOegQQKZuhFUf7ZEnZbuHHVBHMLRVip2PMEEgymDdGNwggo0g3VkcIIKNoV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-01 04:44:20.992 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.158.197 waku 6c188dd6323b3d02ee0be9b8233f4851d6b02ccb8c8976b65db9c6f3e1a8265a
2026-03-01 04:44:21.027 DEBUG [src.node.docker_mananger] Container started with ID 6c188dd6323b. Setting up logs at ./log/docker/node8_2026-03-01_04-44-13__1b5c7d6b-c9b3-47ca-aa8a-57978ff07174__wakuorg_nwaku:latest.log
2026-03-01 04:44:21.028 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 24536
2026-03-01 04:44:21.028 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-01 04:44:22.030 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24536/health" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:44:22.045 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-01 04:44:22.046 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-01 04:44:22.047 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24536/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:44:22.053 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.158.197/tcp/24537/p2p/16Uiu2HAmLYNbdmaCgAb9eujBb98CrDwsg9A1BE8HPFegKUYSqWV7","/ip4/172.18.158.197/tcp/24538/ws/p2p/16Uiu2HAmLYNbdmaCgAb9eujBb98CrDwsg9A1BE8HPFegKUYSqWV7"],"enrUri":"enr:-L24QD7fqQjv6hu5gVSI56PwhLRre7xlA8r4cAWBn3tOuOlLLCUEOikR_KrVcd9SJwK9FXj3j6l7xEVyCx6nL-jvDywCgmlkgnY0gmlwhKwSnsWKbXVsdGlhZGRyc5YACASsEp7FBl_ZAAoErBKexQZf2t0DgnJzhQACAQAAiXNlY3AyNTZrMaEDdSuVupgSUN3gn2mKXSI8IujetRPRVOevPZr7iEdgBqKDdGNwgl_Zg3VkcIJf24V3YWt1MgE"}'
2026-03-01 04:44:22.054 INFO [src.node.waku_node] REST service is ready !!
2026-03-01 04:44:22.054 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24536/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.203.173/tcp/2612/p2p/16Uiu2HAmEXmhVK9arM9D6Zkt2aUS8JzdfiSKjqBBjAmZ5fafgj8L"]'
2026-03-01 04:44:22.060 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:44:22.067 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-01 04:44:22.067 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node9_2026-03-01_04-44-13__1b5c7d6b-c9b3-47ca-aa8a-57978ff07174__wakuorg_nwaku:latest.log
2026-03-01 04:44:22.067 DEBUG [src.node.waku_node] Starting Node...
2026-03-01 04:44:22.067 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-01 04:44:22.068 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-01 04:44:22.069 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.246.12
2026-03-01 04:44:22.069 DEBUG [src.node.docker_mananger] Generated ports ['41135', '41136', '41137', '41138', '41139']
2026-03-01 04:44:22.069 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-01 04:44:22.069 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-01 04:44:22.069 DEBUG [src.node.waku_node] Using volumes []
2026-03-01 04:44:22.069 DEBUG [src.node.docker_mananger] docker run -i -t -p 41135:41135 -p 41136:41136 -p 41137:41137 -p 41138:41138 -p 41139:41139 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=41137 --rest-port=41135 --tcp-port=41136 --discv5-udp-port=41138 --rest-address=0.0.0.0 --nat=extip:172.18.246.12 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=9d8dade7f249d04ae0d6ae57ecc61eb49f7b7ddc28e0ebc5decdda9bbb7ebda2 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=41139 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QMy0CZ_palraubdoWb9QKLNpmQqmdLuPCHcKL47X8lsTFV4Byqfku64Ih2PyPfavLFew2I8LCzrj-JB4TNEGC8sCgmlkgnY0gmlwhKwSy62KbXVsdGlhZGRyc5YACASsEsutBgo0AAoErBLLrQYKNd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDG94AuOegQQKZuhFUf7ZEnZbuHHVBHMLRVip2PMEEgymDdGNwggo0g3VkcIIKNoV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-01 04:44:22.276 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.246.12 waku 7196fa14a1f7dcdad9fd8b91fa7c67d2c9eab98a2b46a38f9ae9c17c5fe20723
2026-03-01 04:44:22.310 DEBUG [src.node.docker_mananger] Container started with ID 7196fa14a1f7. Setting up logs at ./log/docker/node9_2026-03-01_04-44-13__1b5c7d6b-c9b3-47ca-aa8a-57978ff07174__wakuorg_nwaku:latest.log
2026-03-01 04:44:22.310 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 41135
2026-03-01 04:44:22.310 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-01 04:44:23.311 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:41135/health" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:44:23.326 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-01 04:44:23.326 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-01 04:44:23.327 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:41135/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:44:23.334 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.246.12/tcp/41136/p2p/16Uiu2HAkxYB4KhoWsD24feC6W2csTpyB5ioDgCWy2A1iowDSMwYD","/ip4/172.18.246.12/tcp/41137/ws/p2p/16Uiu2HAkxYB4KhoWsD24feC6W2csTpyB5ioDgCWy2A1iowDSMwYD"],"enrUri":"enr:-L24QPKMBsSFObqbXxUj1Dbn9dDrBmtXooi4vJ8nfuJcSOw5UuO_9-WOrbi0USTQJcPEDbTUXyBMdOPjiz4QfeBuNhwCgmlkgnY0gmlwhKwS9gyKbXVsdGlhZGRyc5YACASsEvYMBqCwAAoErBL2DAagsd0DgnJzhQACAQAAiXNlY3AyNTZrMaECLj1soeetfuhoPbabYrUoYCMwqYaPjSzwbV9h4YrFC1qDdGNwgqCwg3VkcIKgsoV3YWt1MgE"}'
2026-03-01 04:44:23.334 INFO [src.node.waku_node] REST service is ready !!
2026-03-01 04:44:23.335 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:41135/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.203.173/tcp/2612/p2p/16Uiu2HAmEXmhVK9arM9D6Zkt2aUS8JzdfiSKjqBBjAmZ5fafgj8L"]'
2026-03-01 04:44:23.337 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:44:23.344 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-01 04:44:23.345 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node10_2026-03-01_04-44-13__1b5c7d6b-c9b3-47ca-aa8a-57978ff07174__wakuorg_nwaku:latest.log
2026-03-01 04:44:23.345 DEBUG [src.node.waku_node] Starting Node...
2026-03-01 04:44:23.345 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-01 04:44:23.346 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-01 04:44:23.346 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.194.233
2026-03-01 04:44:23.347 DEBUG [src.node.docker_mananger] Generated ports ['53664', '53665', '53666', '53667', '53668']
2026-03-01 04:44:23.347 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-01 04:44:23.347 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-01 04:44:23.347 DEBUG [src.node.waku_node] Using volumes []
2026-03-01 04:44:23.347 DEBUG [src.node.docker_mananger] docker run -i -t -p 53664:53664 -p 53665:53665 -p 53666:53666 -p 53667:53667 -p 53668:53668 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=53666 --rest-port=53664 --tcp-port=53665 --discv5-udp-port=53667 --rest-address=0.0.0.0 --nat=extip:172.18.194.233 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=a1fd6ed4f17251d971cb2cdeea36c2918bfdb634dbc0e3d2f8e11b0c07f87bbf --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=53668 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QMy0CZ_palraubdoWb9QKLNpmQqmdLuPCHcKL47X8lsTFV4Byqfku64Ih2PyPfavLFew2I8LCzrj-JB4TNEGC8sCgmlkgnY0gmlwhKwSy62KbXVsdGlhZGRyc5YACASsEsutBgo0AAoErBLLrQYKNd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDG94AuOegQQKZuhFUf7ZEnZbuHHVBHMLRVip2PMEEgymDdGNwggo0g3VkcIIKNoV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-01 04:44:23.567 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.194.233 waku 00c18b713898a9e213c8ed6550b23022d6f2b43b7fa807db0fdc64e10efec7da
2026-03-01 04:44:23.601 DEBUG [src.node.docker_mananger] Container started with ID 00c18b713898. Setting up logs at ./log/docker/node10_2026-03-01_04-44-13__1b5c7d6b-c9b3-47ca-aa8a-57978ff07174__wakuorg_nwaku:latest.log
2026-03-01 04:44:23.601 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 53664
2026-03-01 04:44:23.602 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-01 04:44:24.602 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53664/health" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:44:24.630 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-01 04:44:24.630 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-01 04:44:24.631 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53664/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:44:24.643 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.194.233/tcp/53665/p2p/16Uiu2HAmRfDRFgTtZdWu7pbKTurTSjbicJtk6n2TJcCsnrrENWDd","/ip4/172.18.194.233/tcp/53666/ws/p2p/16Uiu2HAmRfDRFgTtZdWu7pbKTurTSjbicJtk6n2TJcCsnrrENWDd"],"enrUri":"enr:-L24QCUZ5FANVk3XCu6D1e3UDxW1cKCH9btCt2REQxxgKV6pUOv1u4EktLuGGVS9Ij7T_O1EU5WQsMYn4Y4loWBC03ICgmlkgnY0gmlwhKwSwumKbXVsdGlhZGRyc5YACASsEsLpBtGhAAoErBLC6QbRot0DgnJzhQACAQAAiXNlY3AyNTZrMaEDwTa02xkwpYzCFWB7aa_Tnq3lVsgye-SDfkFx-DpLIWiDdGNwgtGhg3VkcILRo4V3YWt1MgE"}'
2026-03-01 04:44:24.646 INFO [src.node.waku_node] REST service is ready !!
2026-03-01 04:44:24.649 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53664/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.203.173/tcp/2612/p2p/16Uiu2HAmEXmhVK9arM9D6Zkt2aUS8JzdfiSKjqBBjAmZ5fafgj8L"]'
2026-03-01 04:44:24.660 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:44:24.661 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:2611/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-01 04:44:24.664 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:44:24.664 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17352/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-01 04:44:24.668 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:44:24.668 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:6228/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-01 04:44:24.670 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:44:24.671 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62166/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-01 04:44:24.673 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:44:24.674 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:50790/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-01 04:44:24.676 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:44:24.676 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:25491/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-01 04:44:24.679 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:44:24.679 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24536/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-01 04:44:24.681 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:44:24.682 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:41135/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-01 04:44:24.684 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:44:24.684 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53664/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-01 04:44:24.687 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:44:24.687 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:2611/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-01 04:44:24.702 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:44:24.705 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-01 04:44:24.809 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-01 04:44:24.809 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2611/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:44:24.811 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772340264687605747,"ephemeral":false,"proof":""}]'
2026-03-01 04:44:24.813 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-01 04:44:24.813 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17352/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:44:24.815 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772340264687605747,"ephemeral":false,"proof":""}]'
2026-03-01 04:44:24.817 DEBUG [src.steps.sharding] Checking that peer NODE_3:wakuorg/nwaku:latest can find the published message
2026-03-01 04:44:24.817 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6228/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:44:24.819 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772340264687605747,"ephemeral":false,"proof":""}]'
2026-03-01 04:44:24.822 DEBUG [src.steps.sharding] Checking that peer NODE_4:wakuorg/nwaku:latest can find the published message
2026-03-01 04:44:24.822 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62166/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:44:24.824 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772340264687605747,"ephemeral":false,"proof":""}]'
2026-03-01 04:44:24.825 DEBUG [src.steps.sharding] Checking that peer NODE_5:wakuorg/nwaku:latest can find the published message
2026-03-01 04:44:24.826 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50790/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:44:24.828 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772340264687605747,"ephemeral":false,"proof":""}]'
2026-03-01 04:44:24.829 DEBUG [src.steps.sharding] Checking that peer NODE_6:wakuorg/nwaku:latest can find the published message
2026-03-01 04:44:24.829 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25491/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:44:24.832 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772340264687605747,"ephemeral":false,"proof":""}]'
2026-03-01 04:44:24.833 DEBUG [src.steps.sharding] Checking that peer NODE_7:wakuorg/nwaku:latest can find the published message
2026-03-01 04:44:24.834 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24536/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:44:24.836 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772340264687605747,"ephemeral":false,"proof":""}]'
2026-03-01 04:44:24.837 DEBUG [src.steps.sharding] Checking that peer NODE_8:wakuorg/nwaku:latest can find the published message
2026-03-01 04:44:24.838 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:41135/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:44:24.840 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772340264687605747,"ephemeral":false,"proof":""}]'
2026-03-01 04:44:24.842 DEBUG [src.steps.sharding] Checking that peer NODE_9:wakuorg/nwaku:latest can find the published message
2026-03-01 04:44:24.842 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53664/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:44:24.844 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772340264687605747,"ephemeral":false,"proof":""}]'
2026-03-01 04:44:24.847 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-01 04:44:24.848 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-01 04:44:24.848 DEBUG [src.node.waku_node] Stopping container with id 7f258bc5bd0d
2026-03-01 04:44:25.522 DEBUG [src.node.waku_node] Container stopped.
2026-03-01 04:44:25.524 DEBUG [src.node.waku_node] Stopping container with id 31697a8232fa
2026-03-01 04:44:26.123 DEBUG [src.node.waku_node] Container stopped.
2026-03-01 04:44:26.124 DEBUG [src.node.waku_node] Stopping container with id 9291bd451098
2026-03-01 04:44:26.467 ERROR [src.node.docker_mananger] Max retries reached for container 7f258bc5bd0d. Exiting log stream.
2026-03-01 04:44:26.759 DEBUG [src.node.waku_node] Container stopped.
2026-03-01 04:44:26.759 DEBUG [src.node.waku_node] Stopping container with id 1f30199f22b9
2026-03-01 04:44:27.001 ERROR [src.node.docker_mananger] Max retries reached for container 31697a8232fa. Exiting log stream.
2026-03-01 04:44:27.337 DEBUG [src.node.waku_node] Container stopped.
2026-03-01 04:44:27.339 DEBUG [src.node.waku_node] Stopping container with id 2ed41bd592f7
2026-03-01 04:44:27.576 ERROR [src.node.docker_mananger] Max retries reached for container 9291bd451098. Exiting log stream.
2026-03-01 04:44:27.919 DEBUG [src.node.waku_node] Container stopped.
2026-03-01 04:44:27.920 DEBUG [src.node.waku_node] Stopping container with id 4e8942866ff3
2026-03-01 04:44:28.197 ERROR [src.node.docker_mananger] Max retries reached for container 1f30199f22b9. Exiting log stream.
2026-03-01 04:44:28.497 DEBUG [src.node.waku_node] Container stopped.
2026-03-01 04:44:28.497 DEBUG [src.node.waku_node] Stopping container with id 6c188dd6323b
2026-03-01 04:44:28.733 ERROR [src.node.docker_mananger] Max retries reached for container 2ed41bd592f7. Exiting log stream.
2026-03-01 04:44:29.068 DEBUG [src.node.waku_node] Container stopped.
2026-03-01 04:44:29.069 DEBUG [src.node.waku_node] Stopping container with id 7196fa14a1f7
2026-03-01 04:44:29.311 ERROR [src.node.docker_mananger] Max retries reached for container 4e8942866ff3. Exiting log stream.
2026-03-01 04:44:29.633 DEBUG [src.node.waku_node] Container stopped.
2026-03-01 04:44:29.635 DEBUG [src.node.waku_node] Stopping container with id 00c18b713898
2026-03-01 04:44:29.881 ERROR [src.node.docker_mananger] Max retries reached for container 6c188dd6323b. Exiting log stream.
2026-03-01 04:44:30.212 DEBUG [src.node.waku_node] Container stopped.
2026-03-01 04:44:30.212 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-01 04:44:30.272 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-01 04:44:30.307 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-01 04:44:30.317 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-01 04:44:30.335 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-01 04:44:30.344 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-01 04:44:30.350 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-01 04:44:30.355 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-01 04:44:30.360 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-01 04:44:30.364 DEBUG [src.node.docker_mananger] No errors found in the waku logs.