logos-messaging/logos-messaging-interop-tests
1
0
Fork 0
mirror of https://github.com/logos-messaging/logos-messaging-interop-tests.git synced 2026-05-03 09:03:25 +00:00
Code Issues Packages Projects Releases Wiki Activity
logos-messaging-interop-tests/nim/1113/data/attachments/6338a930b3be0453.txt

609 lines
111 KiB
Plaintext
Raw Blame History

2026-03-13 04:38:22.223 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-13 04:38:22.223 DEBUG [tests.conftest] Running test: test_auto_shard_relay_10_nwaku_nodes with id: 2026-03-13_04-38-22__48ece234-1c98-44be-81c9-abbb00516e02
2026-03-13 04:38:22.223 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-13 04:38:22.224 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-13 04:38:22.224 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-13 04:38:22.231 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-13 04:38:22.231 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-13_04-38-22__48ece234-1c98-44be-81c9-abbb00516e02__wakuorg_nwaku:latest.log
2026-03-13 04:38:22.231 DEBUG [src.node.waku_node] Starting Node...
2026-03-13 04:38:22.231 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-13 04:38:22.233 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-13 04:38:22.233 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.115.23
2026-03-13 04:38:22.233 DEBUG [src.node.docker_mananger] Generated ports ['26467', '26468', '26469', '26470', '26471']
2026-03-13 04:38:22.233 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-13 04:38:22.233 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-13 04:38:22.234 DEBUG [src.node.waku_node] Using volumes []
2026-03-13 04:38:22.234 DEBUG [src.node.docker_mananger] docker run -i -t -p 26467:26467 -p 26468:26468 -p 26469:26469 -p 26470:26470 -p 26471:26471 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=26469 --rest-port=26467 --tcp-port=26468 --discv5-udp-port=26470 --rest-address=0.0.0.0 --nat=extip:172.18.115.23 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=7e3dd6b8dde2b8aeee0e0eab7c9aba4ea3e50791cadb7a033cffcf3fe2d3df1b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=26471 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto
2026-03-13 04:38:22.428 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.115.23 waku 7860b9b3d08e0fb68454bf4951a3fb74941114e27c60328b61ec1863d0af37e9
2026-03-13 04:38:22.466 DEBUG [src.node.docker_mananger] Container started with ID 7860b9b3d08e. Setting up logs at ./log/docker/node1_2026-03-13_04-38-22__48ece234-1c98-44be-81c9-abbb00516e02__wakuorg_nwaku:latest.log
2026-03-13 04:38:22.466 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 26467
2026-03-13 04:38:22.466 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-13 04:38:23.028 ERROR [src.node.docker_mananger] Max retries reached for container a52feaf0201e. Exiting log stream.
2026-03-13 04:38:23.467 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26467/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:23.469 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-13 04:38:23.470 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-13 04:38:23.470 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26467/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:23.472 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.115.23/tcp/26468/p2p/16Uiu2HAkydRU9Kir2PukWNDK6wxyBfhknxTfb39sAATX8E3ibeAG","/ip4/172.18.115.23/tcp/26469/ws/p2p/16Uiu2HAkydRU9Kir2PukWNDK6wxyBfhknxTfb39sAATX8E3ibeAG"],"enrUri":"enr:-L24QA8rEvB9TFRovOqIwIjBLOFwvxk5NFyhGS9JXeNxhqTTSAYpqJmjQNA9XGbDlVwOnsiNHFFFUrECJECHphDaZdICgmlkgnY0gmlwhKwScxeKbXVsdGlhZGRyc5YACASsEnMXBmdkAAoErBJzFwZnZd0DgnJzhQACAQAAiXNlY3AyNTZrMaECPnFPPw3C-E1I5FUEuXE5Fy_B4DAw2xz0IYjv5jOn7S2DdGNwgmdkg3VkcIJnZoV3YWt1MgU"}'
2026-03-13 04:38:23.473 INFO [src.node.waku_node] REST service is ready !!
2026-03-13 04:38:23.480 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-13 04:38:23.480 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-13_04-38-22__48ece234-1c98-44be-81c9-abbb00516e02__wakuorg_nwaku:latest.log
2026-03-13 04:38:23.480 DEBUG [src.node.waku_node] Starting Node...
2026-03-13 04:38:23.480 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-13 04:38:23.482 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-13 04:38:23.482 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.28.181
2026-03-13 04:38:23.482 DEBUG [src.node.docker_mananger] Generated ports ['29795', '29796', '29797', '29798', '29799']
2026-03-13 04:38:23.482 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-13 04:38:23.482 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-13 04:38:23.483 DEBUG [src.node.waku_node] Using volumes []
2026-03-13 04:38:23.483 DEBUG [src.node.docker_mananger] docker run -i -t -p 29795:29795 -p 29796:29796 -p 29797:29797 -p 29798:29798 -p 29799:29799 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=29797 --rest-port=29795 --tcp-port=29796 --discv5-udp-port=29798 --rest-address=0.0.0.0 --nat=extip:172.18.28.181 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=71cc8cadcf6e8daf31bbc5d9f0eaabff388acaf0304a9bdeedeee7bdf6fe3aa7 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=29799 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QA8rEvB9TFRovOqIwIjBLOFwvxk5NFyhGS9JXeNxhqTTSAYpqJmjQNA9XGbDlVwOnsiNHFFFUrECJECHphDaZdICgmlkgnY0gmlwhKwScxeKbXVsdGlhZGRyc5YACASsEnMXBmdkAAoErBJzFwZnZd0DgnJzhQACAQAAiXNlY3AyNTZrMaECPnFPPw3C-E1I5FUEuXE5Fy_B4DAw2xz0IYjv5jOn7S2DdGNwgmdkg3VkcIJnZoV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-13 04:38:23.693 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.28.181 waku d63219cb145adf4ee160aa2fa084e7b3f5bd002f805141413b7471b3c5d7d751
2026-03-13 04:38:23.730 DEBUG [src.node.docker_mananger] Container started with ID d63219cb145a. Setting up logs at ./log/docker/node3_2026-03-13_04-38-22__48ece234-1c98-44be-81c9-abbb00516e02__wakuorg_nwaku:latest.log
2026-03-13 04:38:23.730 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 29795
2026-03-13 04:38:23.730 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-13 04:38:24.731 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:29795/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:24.734 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-13 04:38:24.835 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:29795/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:24.837 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-13 04:38:24.938 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:29795/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:24.940 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-13 04:38:24.940 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-13 04:38:24.941 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:29795/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:24.943 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.28.181/tcp/29796/p2p/16Uiu2HAm1xC3TDAwx1CDqgw5pZuyifzRjGEcsHzgHq1DpTcTjpeZ","/ip4/172.18.28.181/tcp/29797/ws/p2p/16Uiu2HAm1xC3TDAwx1CDqgw5pZuyifzRjGEcsHzgHq1DpTcTjpeZ"],"enrUri":"enr:-L24QLuR-08Dgw7KwpvaDsPDvCXdqh2mFzyn8oqt_GibAep2XrXsON3T7bWOoQhGn0xv2YwlwzoSHyHHZLSfXRZBCVkCgmlkgnY0gmlwhKwSHLWKbXVsdGlhZGRyc5YACASsEhy1BnRkAAoErBIctQZ0Zd0DgnJzhQACAQAAiXNlY3AyNTZrMaECYPeJzFSAIbMTlET8Yx2uUHnDd4PwquNOFY6HQcwjcS6DdGNwgnRkg3VkcIJ0ZoV3YWt1MgE"}'
2026-03-13 04:38:24.943 INFO [src.node.waku_node] REST service is ready !!
2026-03-13 04:38:24.944 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:29795/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.115.23/tcp/26468/p2p/16Uiu2HAkydRU9Kir2PukWNDK6wxyBfhknxTfb39sAATX8E3ibeAG"]'
2026-03-13 04:38:24.971 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:24.985 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-13 04:38:24.986 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-13_04-38-22__48ece234-1c98-44be-81c9-abbb00516e02__wakuorg_nwaku:latest.log
2026-03-13 04:38:24.986 DEBUG [src.node.waku_node] Starting Node...
2026-03-13 04:38:24.986 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-13 04:38:24.987 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-13 04:38:24.987 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.244.59
2026-03-13 04:38:24.988 DEBUG [src.node.docker_mananger] Generated ports ['11743', '11744', '11745', '11746', '11747']
2026-03-13 04:38:24.988 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-13 04:38:24.988 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-13 04:38:24.988 DEBUG [src.node.waku_node] Using volumes []
2026-03-13 04:38:24.988 DEBUG [src.node.docker_mananger] docker run -i -t -p 11743:11743 -p 11744:11744 -p 11745:11745 -p 11746:11746 -p 11747:11747 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=11745 --rest-port=11743 --tcp-port=11744 --discv5-udp-port=11746 --rest-address=0.0.0.0 --nat=extip:172.18.244.59 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=3bb9f4bc70d8d0dea9fc4eb2236ceb9d3b7aba7de0de55a4b5b24b8b8b29e6ee --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=11747 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QA8rEvB9TFRovOqIwIjBLOFwvxk5NFyhGS9JXeNxhqTTSAYpqJmjQNA9XGbDlVwOnsiNHFFFUrECJECHphDaZdICgmlkgnY0gmlwhKwScxeKbXVsdGlhZGRyc5YACASsEnMXBmdkAAoErBJzFwZnZd0DgnJzhQACAQAAiXNlY3AyNTZrMaECPnFPPw3C-E1I5FUEuXE5Fy_B4DAw2xz0IYjv5jOn7S2DdGNwgmdkg3VkcIJnZoV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-13 04:38:25.204 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.244.59 waku 44e24774d97b886fc33c5150caf7e7ec5b73a7e2e6da01c53a1ef90ecc5d1733
2026-03-13 04:38:25.241 DEBUG [src.node.docker_mananger] Container started with ID 44e24774d97b. Setting up logs at ./log/docker/node4_2026-03-13_04-38-22__48ece234-1c98-44be-81c9-abbb00516e02__wakuorg_nwaku:latest.log
2026-03-13 04:38:25.242 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 11743
2026-03-13 04:38:25.243 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-13 04:38:26.244 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11743/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:26.274 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-13 04:38:26.375 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11743/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:26.380 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-13 04:38:26.380 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-13 04:38:26.381 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11743/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:26.384 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.244.59/tcp/11744/p2p/16Uiu2HAm68kHX9SizvJGLoVaSHfJjV4cSducCPcmswRWeg9ncPaE","/ip4/172.18.244.59/tcp/11745/ws/p2p/16Uiu2HAm68kHX9SizvJGLoVaSHfJjV4cSducCPcmswRWeg9ncPaE"],"enrUri":"enr:-L24QIf4rKHn69M7_7DoL0fcton8vlsDa_n3Kzua5zNVvzGfVKGh7HdNXbwUUY1jqdbuIPxTGhC8YKIjJ__ExPceXxUCgmlkgnY0gmlwhKwS9DuKbXVsdGlhZGRyc5YACASsEvQ7Bi3gAAoErBL0OwYt4d0DgnJzhQACAQAAiXNlY3AyNTZrMaECnxqNA6X2Q3PPJnhCdefzx4ynlYvYzu3kGiqxZeHDoieDdGNwgi3gg3VkcIIt4oV3YWt1MgE"}'
2026-03-13 04:38:26.384 INFO [src.node.waku_node] REST service is ready !!
2026-03-13 04:38:26.384 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11743/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.115.23/tcp/26468/p2p/16Uiu2HAkydRU9Kir2PukWNDK6wxyBfhknxTfb39sAATX8E3ibeAG"]'
2026-03-13 04:38:26.412 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:26.425 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-13 04:38:26.426 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-03-13_04-38-22__48ece234-1c98-44be-81c9-abbb00516e02__wakuorg_nwaku:latest.log
2026-03-13 04:38:26.426 DEBUG [src.node.waku_node] Starting Node...
2026-03-13 04:38:26.426 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-13 04:38:26.428 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-13 04:38:26.428 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.11.139
2026-03-13 04:38:26.428 DEBUG [src.node.docker_mananger] Generated ports ['34861', '34862', '34863', '34864', '34865']
2026-03-13 04:38:26.429 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-13 04:38:26.429 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-13 04:38:26.429 DEBUG [src.node.waku_node] Using volumes []
2026-03-13 04:38:26.429 DEBUG [src.node.docker_mananger] docker run -i -t -p 34861:34861 -p 34862:34862 -p 34863:34863 -p 34864:34864 -p 34865:34865 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=34863 --rest-port=34861 --tcp-port=34862 --discv5-udp-port=34864 --rest-address=0.0.0.0 --nat=extip:172.18.11.139 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=e3da28effaa053f78f0b2829fa4cf7c6fb9fc9ebdefb5ba9ea06563d746964e9 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=34865 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QA8rEvB9TFRovOqIwIjBLOFwvxk5NFyhGS9JXeNxhqTTSAYpqJmjQNA9XGbDlVwOnsiNHFFFUrECJECHphDaZdICgmlkgnY0gmlwhKwScxeKbXVsdGlhZGRyc5YACASsEnMXBmdkAAoErBJzFwZnZd0DgnJzhQACAQAAiXNlY3AyNTZrMaECPnFPPw3C-E1I5FUEuXE5Fy_B4DAw2xz0IYjv5jOn7S2DdGNwgmdkg3VkcIJnZoV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-13 04:38:26.694 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.11.139 waku 93e0b8b7ad92fcc66fbff04653b0d9aca52324536d82b2529882fb13ce6b0771
2026-03-13 04:38:26.749 DEBUG [src.node.docker_mananger] Container started with ID 93e0b8b7ad92. Setting up logs at ./log/docker/node5_2026-03-13_04-38-22__48ece234-1c98-44be-81c9-abbb00516e02__wakuorg_nwaku:latest.log
2026-03-13 04:38:26.751 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 34861
2026-03-13 04:38:26.755 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-13 04:38:27.756 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34861/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:27.760 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-13 04:38:27.861 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34861/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:27.863 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-13 04:38:27.864 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-13 04:38:27.864 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34861/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:27.866 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.11.139/tcp/34862/p2p/16Uiu2HAmU7A8kT3ZVUJeX7xC19AXEnu1DQwtXfjGrUb2cbZH1VMW","/ip4/172.18.11.139/tcp/34863/ws/p2p/16Uiu2HAmU7A8kT3ZVUJeX7xC19AXEnu1DQwtXfjGrUb2cbZH1VMW"],"enrUri":"enr:-L24QKzPCOnziBjaDyY62tNCYrak1X4fnywz1GQz8Nit6GmMbNCLnyHJaT82TkExRqEZ1pkolrqppX1SHvWlaI_wzTMCgmlkgnY0gmlwhKwSC4uKbXVsdGlhZGRyc5YACASsEguLBoguAAoErBILiwaIL90DgnJzhQACAQAAiXNlY3AyNTZrMaED5ZN3rj-WMrK1LW9JCysV4RJ3Dd-T-1KXTCh9pGNM1pWDdGNwgogug3VkcIKIMIV3YWt1MgE"}'
2026-03-13 04:38:27.866 INFO [src.node.waku_node] REST service is ready !!
2026-03-13 04:38:27.867 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34861/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.115.23/tcp/26468/p2p/16Uiu2HAkydRU9Kir2PukWNDK6wxyBfhknxTfb39sAATX8E3ibeAG"]'
2026-03-13 04:38:27.911 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:27.921 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-13 04:38:27.921 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node6_2026-03-13_04-38-22__48ece234-1c98-44be-81c9-abbb00516e02__wakuorg_nwaku:latest.log
2026-03-13 04:38:27.921 DEBUG [src.node.waku_node] Starting Node...
2026-03-13 04:38:27.922 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-13 04:38:27.923 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-13 04:38:27.923 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.88.68
2026-03-13 04:38:27.923 DEBUG [src.node.docker_mananger] Generated ports ['5958', '5959', '5960', '5961', '5962']
2026-03-13 04:38:27.923 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-13 04:38:27.924 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-13 04:38:27.924 DEBUG [src.node.waku_node] Using volumes []
2026-03-13 04:38:27.924 DEBUG [src.node.docker_mananger] docker run -i -t -p 5958:5958 -p 5959:5959 -p 5960:5960 -p 5961:5961 -p 5962:5962 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=5960 --rest-port=5958 --tcp-port=5959 --discv5-udp-port=5961 --rest-address=0.0.0.0 --nat=extip:172.18.88.68 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=b52a33f23e7cff24812cee3b45c81caeaeb7e7a978f1097b1fbfda5d33a2cf2a --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=5962 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QA8rEvB9TFRovOqIwIjBLOFwvxk5NFyhGS9JXeNxhqTTSAYpqJmjQNA9XGbDlVwOnsiNHFFFUrECJECHphDaZdICgmlkgnY0gmlwhKwScxeKbXVsdGlhZGRyc5YACASsEnMXBmdkAAoErBJzFwZnZd0DgnJzhQACAQAAiXNlY3AyNTZrMaECPnFPPw3C-E1I5FUEuXE5Fy_B4DAw2xz0IYjv5jOn7S2DdGNwgmdkg3VkcIJnZoV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-13 04:38:28.133 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.88.68 waku 54ac2fcb07a8db9b46d35e56a28f1d85113864052a1a3ba312b7a990a414cd4e
2026-03-13 04:38:28.172 DEBUG [src.node.docker_mananger] Container started with ID 54ac2fcb07a8. Setting up logs at ./log/docker/node6_2026-03-13_04-38-22__48ece234-1c98-44be-81c9-abbb00516e02__wakuorg_nwaku:latest.log
2026-03-13 04:38:28.172 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 5958
2026-03-13 04:38:28.172 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-13 04:38:29.173 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:5958/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:29.176 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-13 04:38:29.276 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:5958/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:29.308 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-13 04:38:29.409 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:5958/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:29.411 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-13 04:38:29.411 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-13 04:38:29.411 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:5958/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:29.414 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.88.68/tcp/5959/p2p/16Uiu2HAmEE4umN78E9KdCTm21j167b41BH6abKsQmA3mqyvafUyY","/ip4/172.18.88.68/tcp/5960/ws/p2p/16Uiu2HAmEE4umN78E9KdCTm21j167b41BH6abKsQmA3mqyvafUyY"],"enrUri":"enr:-L24QDOoKN5TAuRJhWo7rqOHF_BxVQFQSUdhXGfW7RlX01inb0T8D2pEogGGlrmfqk4-w4sbpzsypTQmDHjZTUqk6kwCgmlkgnY0gmlwhKwSWESKbXVsdGlhZGRyc5YACASsElhEBhdHAAoErBJYRAYXSN0DgnJzhQACAQAAiXNlY3AyNTZrMaEDF1UCchHsX7ule0HFJ-TenuIZPeqkZv7aoYG81UM3xLuDdGNwghdHg3VkcIIXSYV3YWt1MgE"}'
2026-03-13 04:38:29.415 INFO [src.node.waku_node] REST service is ready !!
2026-03-13 04:38:29.415 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:5958/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.115.23/tcp/26468/p2p/16Uiu2HAkydRU9Kir2PukWNDK6wxyBfhknxTfb39sAATX8E3ibeAG"]'
2026-03-13 04:38:29.464 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:29.478 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-13 04:38:29.479 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node7_2026-03-13_04-38-22__48ece234-1c98-44be-81c9-abbb00516e02__wakuorg_nwaku:latest.log
2026-03-13 04:38:29.480 DEBUG [src.node.waku_node] Starting Node...
2026-03-13 04:38:29.481 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-13 04:38:29.483 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-13 04:38:29.484 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.76.89
2026-03-13 04:38:29.484 DEBUG [src.node.docker_mananger] Generated ports ['64340', '64341', '64342', '64343', '64344']
2026-03-13 04:38:29.485 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-13 04:38:29.485 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-13 04:38:29.485 DEBUG [src.node.waku_node] Using volumes []
2026-03-13 04:38:29.486 DEBUG [src.node.docker_mananger] docker run -i -t -p 64340:64340 -p 64341:64341 -p 64342:64342 -p 64343:64343 -p 64344:64344 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=64342 --rest-port=64340 --tcp-port=64341 --discv5-udp-port=64343 --rest-address=0.0.0.0 --nat=extip:172.18.76.89 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=c19593ab08c0eec0a150fc2cceff9bbc0e439fa5fd38ec41d0639aaafd3f811f --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=64344 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QA8rEvB9TFRovOqIwIjBLOFwvxk5NFyhGS9JXeNxhqTTSAYpqJmjQNA9XGbDlVwOnsiNHFFFUrECJECHphDaZdICgmlkgnY0gmlwhKwScxeKbXVsdGlhZGRyc5YACASsEnMXBmdkAAoErBJzFwZnZd0DgnJzhQACAQAAiXNlY3AyNTZrMaECPnFPPw3C-E1I5FUEuXE5Fy_B4DAw2xz0IYjv5jOn7S2DdGNwgmdkg3VkcIJnZoV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-13 04:38:29.695 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.76.89 waku bc78142cd882300d1b3f0fa04f4bcac9e43d7d8011e1f57a2fea40287eb3d742
2026-03-13 04:38:29.745 DEBUG [src.node.docker_mananger] Container started with ID bc78142cd882. Setting up logs at ./log/docker/node7_2026-03-13_04-38-22__48ece234-1c98-44be-81c9-abbb00516e02__wakuorg_nwaku:latest.log
2026-03-13 04:38:29.745 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 64340
2026-03-13 04:38:29.746 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-13 04:38:30.746 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64340/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:30.758 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-13 04:38:30.859 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64340/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:30.862 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-13 04:38:30.862 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-13 04:38:30.862 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64340/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:30.864 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.76.89/tcp/64341/p2p/16Uiu2HAmBVYbSB6r8t91QatJU63tZoQwwKf8Wo9pvidw6irY8HRa","/ip4/172.18.76.89/tcp/64342/ws/p2p/16Uiu2HAmBVYbSB6r8t91QatJU63tZoQwwKf8Wo9pvidw6irY8HRa"],"enrUri":"enr:-L24QDg18L781arIoJye7w94umF5Np9vY-qqVtjKR_kY24cZX7UwYN_mUnBRBFHKzOGa0JQC-BxlfCSvB7ynO0h7qcMCgmlkgnY0gmlwhKwSTFmKbXVsdGlhZGRyc5YACASsEkxZBvtVAAoErBJMWQb7Vt0DgnJzhQACAQAAiXNlY3AyNTZrMaEC7rj2l8APtj1Y_A6qy-gKkDn3Snp_Igr14YCVTEMe9jmDdGNwgvtVg3VkcIL7V4V3YWt1MgE"}'
2026-03-13 04:38:30.865 INFO [src.node.waku_node] REST service is ready !!
2026-03-13 04:38:30.865 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:64340/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.115.23/tcp/26468/p2p/16Uiu2HAkydRU9Kir2PukWNDK6wxyBfhknxTfb39sAATX8E3ibeAG"]'
2026-03-13 04:38:30.885 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:30.898 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-13 04:38:30.899 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node8_2026-03-13_04-38-22__48ece234-1c98-44be-81c9-abbb00516e02__wakuorg_nwaku:latest.log
2026-03-13 04:38:30.899 DEBUG [src.node.waku_node] Starting Node...
2026-03-13 04:38:30.900 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-13 04:38:30.903 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-13 04:38:30.904 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.50.109
2026-03-13 04:38:30.904 DEBUG [src.node.docker_mananger] Generated ports ['60372', '60373', '60374', '60375', '60376']
2026-03-13 04:38:30.904 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-13 04:38:30.905 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-13 04:38:30.905 DEBUG [src.node.waku_node] Using volumes []
2026-03-13 04:38:30.905 DEBUG [src.node.docker_mananger] docker run -i -t -p 60372:60372 -p 60373:60373 -p 60374:60374 -p 60375:60375 -p 60376:60376 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=60374 --rest-port=60372 --tcp-port=60373 --discv5-udp-port=60375 --rest-address=0.0.0.0 --nat=extip:172.18.50.109 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=2b428d7adf6f32fff2acaff0dbc23647bff67be7dbcefb2e17a5f814b439ae85 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=60376 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QA8rEvB9TFRovOqIwIjBLOFwvxk5NFyhGS9JXeNxhqTTSAYpqJmjQNA9XGbDlVwOnsiNHFFFUrECJECHphDaZdICgmlkgnY0gmlwhKwScxeKbXVsdGlhZGRyc5YACASsEnMXBmdkAAoErBJzFwZnZd0DgnJzhQACAQAAiXNlY3AyNTZrMaECPnFPPw3C-E1I5FUEuXE5Fy_B4DAw2xz0IYjv5jOn7S2DdGNwgmdkg3VkcIJnZoV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-13 04:38:31.116 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.50.109 waku eb2cc67ea61dd555532aa641858c96a649a096a6bb61ad01cbc94440c4c9ade6
2026-03-13 04:38:31.161 DEBUG [src.node.docker_mananger] Container started with ID eb2cc67ea61d. Setting up logs at ./log/docker/node8_2026-03-13_04-38-22__48ece234-1c98-44be-81c9-abbb00516e02__wakuorg_nwaku:latest.log
2026-03-13 04:38:31.161 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 60372
2026-03-13 04:38:31.162 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-13 04:38:32.162 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60372/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:32.166 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-13 04:38:32.267 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60372/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:32.269 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-13 04:38:32.369 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60372/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:32.372 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-13 04:38:32.472 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60372/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:32.474 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-13 04:38:32.575 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60372/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:32.577 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-13 04:38:32.577 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-13 04:38:32.577 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60372/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:32.580 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.50.109/tcp/60373/p2p/16Uiu2HAm3Z9WgHJ9RmfT21X4Viz1VE9fKRhA3ozxzAUKD37TWosN","/ip4/172.18.50.109/tcp/60374/ws/p2p/16Uiu2HAm3Z9WgHJ9RmfT21X4Viz1VE9fKRhA3ozxzAUKD37TWosN"],"enrUri":"enr:-L24QNhVgniQosll2VtCGBQR6l94bRnodLCwaSPDdN5_toE1RZ7l0ko2RQKkFqPkNH5p1UC731fgnqaW_oym3-MDQ8kCgmlkgnY0gmlwhKwSMm2KbXVsdGlhZGRyc5YACASsEjJtBuvVAAoErBIybQbr1t0DgnJzhQACAQAAiXNlY3AyNTZrMaECeMexMZNPxIa1pk0w8EF7xXookVhJlQSx24iXJh3BSkmDdGNwguvVg3VkcILr14V3YWt1MgE"}'
2026-03-13 04:38:32.580 INFO [src.node.waku_node] REST service is ready !!
2026-03-13 04:38:32.580 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:60372/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.115.23/tcp/26468/p2p/16Uiu2HAkydRU9Kir2PukWNDK6wxyBfhknxTfb39sAATX8E3ibeAG"]'
2026-03-13 04:38:32.605 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:32.615 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-13 04:38:32.616 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node9_2026-03-13_04-38-22__48ece234-1c98-44be-81c9-abbb00516e02__wakuorg_nwaku:latest.log
2026-03-13 04:38:32.617 DEBUG [src.node.waku_node] Starting Node...
2026-03-13 04:38:32.617 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-13 04:38:32.621 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-13 04:38:32.622 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.220.250
2026-03-13 04:38:32.624 DEBUG [src.node.docker_mananger] Generated ports ['11748', '11749', '11750', '11751', '11752']
2026-03-13 04:38:32.625 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-13 04:38:32.626 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-13 04:38:32.626 DEBUG [src.node.waku_node] Using volumes []
2026-03-13 04:38:32.627 DEBUG [src.node.docker_mananger] docker run -i -t -p 11748:11748 -p 11749:11749 -p 11750:11750 -p 11751:11751 -p 11752:11752 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=11750 --rest-port=11748 --tcp-port=11749 --discv5-udp-port=11751 --rest-address=0.0.0.0 --nat=extip:172.18.220.250 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=9d4eea6eb4cad08f946c796fbecf22b5c06dcceccfd6cd6cffeecdfe8292e653 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=11752 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QA8rEvB9TFRovOqIwIjBLOFwvxk5NFyhGS9JXeNxhqTTSAYpqJmjQNA9XGbDlVwOnsiNHFFFUrECJECHphDaZdICgmlkgnY0gmlwhKwScxeKbXVsdGlhZGRyc5YACASsEnMXBmdkAAoErBJzFwZnZd0DgnJzhQACAQAAiXNlY3AyNTZrMaECPnFPPw3C-E1I5FUEuXE5Fy_B4DAw2xz0IYjv5jOn7S2DdGNwgmdkg3VkcIJnZoV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-13 04:38:32.852 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.220.250 waku e63de1a5f15fe6a539dd63373416e068715dce12fc07c0008716fab5fe5308a7
2026-03-13 04:38:32.887 DEBUG [src.node.docker_mananger] Container started with ID e63de1a5f15f. Setting up logs at ./log/docker/node9_2026-03-13_04-38-22__48ece234-1c98-44be-81c9-abbb00516e02__wakuorg_nwaku:latest.log
2026-03-13 04:38:32.888 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 11748
2026-03-13 04:38:32.889 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-13 04:38:33.889 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11748/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:33.892 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-13 04:38:33.893 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-13 04:38:33.893 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11748/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:33.896 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.220.250/tcp/11749/p2p/16Uiu2HAmSqMQt9dPxPB2goopTK7qXupwmaK2isiugTzuSw1K55oA","/ip4/172.18.220.250/tcp/11750/ws/p2p/16Uiu2HAmSqMQt9dPxPB2goopTK7qXupwmaK2isiugTzuSw1K55oA"],"enrUri":"enr:-L24QPMKmRW9X3oYIdMNdf5quZAW_8rrEN6mB_DzhfLmD88jX19UkZpxWaQb87Le8PpdbX6yTX_UjXOyYsCADdE2_XkCgmlkgnY0gmlwhKwS3PqKbXVsdGlhZGRyc5YACASsEtz6Bi3lAAoErBLc-gYt5t0DgnJzhQACAQAAiXNlY3AyNTZrMaED0qs9aJLxmxxuw7Hh0n8j6QmbJd2IDPzq13qUzqlIiMWDdGNwgi3lg3VkcIIt54V3YWt1MgE"}'
2026-03-13 04:38:33.896 INFO [src.node.waku_node] REST service is ready !!
2026-03-13 04:38:33.896 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11748/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.115.23/tcp/26468/p2p/16Uiu2HAkydRU9Kir2PukWNDK6wxyBfhknxTfb39sAATX8E3ibeAG"]'
2026-03-13 04:38:33.923 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:33.939 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-13 04:38:33.941 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node10_2026-03-13_04-38-22__48ece234-1c98-44be-81c9-abbb00516e02__wakuorg_nwaku:latest.log
2026-03-13 04:38:33.941 DEBUG [src.node.waku_node] Starting Node...
2026-03-13 04:38:33.941 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-13 04:38:33.943 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-13 04:38:33.944 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.210.94
2026-03-13 04:38:33.944 DEBUG [src.node.docker_mananger] Generated ports ['54878', '54879', '54880', '54881', '54882']
2026-03-13 04:38:33.947 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-13 04:38:33.947 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-13 04:38:33.948 DEBUG [src.node.waku_node] Using volumes []
2026-03-13 04:38:33.948 DEBUG [src.node.docker_mananger] docker run -i -t -p 54878:54878 -p 54879:54879 -p 54880:54880 -p 54881:54881 -p 54882:54882 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=54880 --rest-port=54878 --tcp-port=54879 --discv5-udp-port=54881 --rest-address=0.0.0.0 --nat=extip:172.18.210.94 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=b6bc9d90e1bdfbabcf5bba4b60a9ea2a8b98fcebe260e1f76ae6cbf3cce1be70 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=54882 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QA8rEvB9TFRovOqIwIjBLOFwvxk5NFyhGS9JXeNxhqTTSAYpqJmjQNA9XGbDlVwOnsiNHFFFUrECJECHphDaZdICgmlkgnY0gmlwhKwScxeKbXVsdGlhZGRyc5YACASsEnMXBmdkAAoErBJzFwZnZd0DgnJzhQACAQAAiXNlY3AyNTZrMaECPnFPPw3C-E1I5FUEuXE5Fy_B4DAw2xz0IYjv5jOn7S2DdGNwgmdkg3VkcIJnZoV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-13 04:38:34.178 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.210.94 waku b697ebe6c4efbb37b30cb649730759c6b2bab1e8afaa0ee8a773495f75f5ab9d
2026-03-13 04:38:34.216 DEBUG [src.node.docker_mananger] Container started with ID b697ebe6c4ef. Setting up logs at ./log/docker/node10_2026-03-13_04-38-22__48ece234-1c98-44be-81c9-abbb00516e02__wakuorg_nwaku:latest.log
2026-03-13 04:38:34.218 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 54878
2026-03-13 04:38:34.220 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-13 04:38:35.221 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54878/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:35.224 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-13 04:38:35.224 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-13 04:38:35.224 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54878/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:35.227 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.210.94/tcp/54879/p2p/16Uiu2HAmExtQxVLCeYkmAWbUyPTDKGMPd1UNiqc4zpYxXGRq5X3C","/ip4/172.18.210.94/tcp/54880/ws/p2p/16Uiu2HAmExtQxVLCeYkmAWbUyPTDKGMPd1UNiqc4zpYxXGRq5X3C"],"enrUri":"enr:-L24QCogLfkUXMWcyV-cKPMw_6JlhJGGxBtsS-SmsiIXgFQZV48qe7FCA99yNZGqVY1cy7R6T3rTwm1Zh37WOckve4kCgmlkgnY0gmlwhKwS0l6KbXVsdGlhZGRyc5YACASsEtJeBtZfAAoErBLSXgbWYN0DgnJzhQACAQAAiXNlY3AyNTZrMaEDIk0dnim9JJqAJFhtq_FcrtWx3h1VRIpeeF5yyORFFxeDdGNwgtZfg3VkcILWYYV3YWt1MgE"}'
2026-03-13 04:38:35.227 INFO [src.node.waku_node] REST service is ready !!
2026-03-13 04:38:35.228 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54878/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.115.23/tcp/26468/p2p/16Uiu2HAkydRU9Kir2PukWNDK6wxyBfhknxTfb39sAATX8E3ibeAG"]'
2026-03-13 04:38:35.255 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:35.257 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26467/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-13 04:38:35.269 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:35.270 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:29795/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-13 04:38:35.274 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:35.275 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11743/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-13 04:38:35.282 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:35.283 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34861/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-13 04:38:35.287 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:35.287 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:5958/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-13 04:38:35.289 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:35.290 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:64340/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-13 04:38:35.292 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:35.292 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:60372/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-13 04:38:35.295 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:35.295 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11748/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-13 04:38:35.298 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:35.298 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54878/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-13 04:38:35.300 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:35.301 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26467/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:38:35.328 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:35.329 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-13 04:38:35.430 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-13 04:38:35.430 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26467/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:35.433 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773376700563573797,"ephemeral":false,"proof":""},{"payload":"L215YXBwLzEvbGF0ZXN0L3Byb3Rv","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773376705410370710,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773376709728144116,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773376714558088387,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773376715301409200,"ephemeral":false,"proof":""}]'
2026-03-13 04:38:35.485 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-13 04:38:35.487 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-13 04:38:35.487 DEBUG [src.node.waku_node] Stopping container with id 7860b9b3d08e
2026-03-13 04:38:36.127 DEBUG [src.node.waku_node] Container stopped.
2026-03-13 04:38:36.128 DEBUG [src.node.waku_node] Stopping container with id d63219cb145a
2026-03-13 04:38:36.760 DEBUG [src.node.waku_node] Container stopped.
2026-03-13 04:38:36.762 DEBUG [src.node.waku_node] Stopping container with id 44e24774d97b
2026-03-13 04:38:36.946 ERROR [src.node.docker_mananger] Max retries reached for container 7860b9b3d08e. Exiting log stream.
2026-03-13 04:38:37.354 DEBUG [src.node.waku_node] Container stopped.
2026-03-13 04:38:37.354 DEBUG [src.node.waku_node] Stopping container with id 93e0b8b7ad92
2026-03-13 04:38:37.805 ERROR [src.node.docker_mananger] Max retries reached for container d63219cb145a. Exiting log stream.
2026-03-13 04:38:37.956 DEBUG [src.node.waku_node] Container stopped.
2026-03-13 04:38:37.957 DEBUG [src.node.waku_node] Stopping container with id 54ac2fcb07a8
2026-03-13 04:38:38.168 ERROR [src.node.docker_mananger] Max retries reached for container 44e24774d97b. Exiting log stream.
2026-03-13 04:38:38.552 DEBUG [src.node.waku_node] Container stopped.
2026-03-13 04:38:38.554 DEBUG [src.node.waku_node] Stopping container with id bc78142cd882
2026-03-13 04:38:38.771 ERROR [src.node.docker_mananger] Max retries reached for container 93e0b8b7ad92. Exiting log stream.
2026-03-13 04:38:39.170 DEBUG [src.node.waku_node] Container stopped.
2026-03-13 04:38:39.173 DEBUG [src.node.waku_node] Stopping container with id eb2cc67ea61d
2026-03-13 04:38:39.368 ERROR [src.node.docker_mananger] Max retries reached for container 54ac2fcb07a8. Exiting log stream.
2026-03-13 04:38:39.774 DEBUG [src.node.waku_node] Container stopped.
2026-03-13 04:38:39.777 DEBUG [src.node.waku_node] Stopping container with id e63de1a5f15f
2026-03-13 04:38:40.131 ERROR [src.node.docker_mananger] Max retries reached for container bc78142cd882. Exiting log stream.
2026-03-13 04:38:40.360 DEBUG [src.node.waku_node] Container stopped.
2026-03-13 04:38:40.360 DEBUG [src.node.waku_node] Stopping container with id b697ebe6c4ef
2026-03-13 04:38:40.729 ERROR [src.node.docker_mananger] Max retries reached for container eb2cc67ea61d. Exiting log stream.
2026-03-13 04:38:40.912 DEBUG [src.node.waku_node] Container stopped.
2026-03-13 04:38:40.914 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-13 04:38:41.032 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-13 04:38:41.160 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-13 04:38:41.218 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-13 04:38:41.264 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-13 04:38:41.304 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-13 04:38:41.374 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-13 04:38:41.376 ERROR [src.node.docker_mananger] Max retries reached for container e63de1a5f15f. Exiting log stream.
2026-03-13 04:38:41.445 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-13 04:38:41.481 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-13 04:38:41.509 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-13 04:38:41.509 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-13 04:38:41.510 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-13 04:38:41.510 DEBUG [src.libs.common] Attaching file ./log/docker/node7_2026-03-13_04-38-22__48ece234-1c98-44be-81c9-abbb00516e02__wakuorg_nwaku:latest.log
2026-03-13 04:38:41.512 DEBUG [src.libs.common] Attaching file ./log/docker/node6_2026-03-13_04-38-22__48ece234-1c98-44be-81c9-abbb00516e02__wakuorg_nwaku:latest.log
2026-03-13 04:38:41.513 DEBUG [src.libs.common] Attaching file ./log/docker/node8_2026-03-13_04-38-22__48ece234-1c98-44be-81c9-abbb00516e02__wakuorg_nwaku:latest.log
2026-03-13 04:38:41.515 DEBUG [src.libs.common] Attaching file ./log/docker/node9_2026-03-13_04-38-22__48ece234-1c98-44be-81c9-abbb00516e02__wakuorg_nwaku:latest.log
2026-03-13 04:38:41.516 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-13_04-38-22__48ece234-1c98-44be-81c9-abbb00516e02__wakuorg_nwaku:latest.log
2026-03-13 04:38:41.519 DEBUG [src.libs.common] Attaching file ./log/docker/node10_2026-03-13_04-38-22__48ece234-1c98-44be-81c9-abbb00516e02__wakuorg_nwaku:latest.log
2026-03-13 04:38:41.520 DEBUG [src.libs.common] Attaching file ./log/docker/node3_2026-03-13_04-38-22__48ece234-1c98-44be-81c9-abbb00516e02__wakuorg_nwaku:latest.log
2026-03-13 04:38:41.523 DEBUG [src.libs.common] Attaching file ./log/docker/node4_2026-03-13_04-38-22__48ece234-1c98-44be-81c9-abbb00516e02__wakuorg_nwaku:latest.log
2026-03-13 04:38:41.524 DEBUG [src.libs.common] Attaching file ./log/docker/node5_2026-03-13_04-38-22__48ece234-1c98-44be-81c9-abbb00516e02__wakuorg_nwaku:latest.log
2026-03-13 04:38:41.529 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-13 04:38:41.530 DEBUG [tests.conftest] Running test: test_auto_shard_relay_10_nwaku_nodes with id: 2026-03-13_04-38-41__ad45205e-e6d6-4c09-9697-b7dce07aad55
2026-03-13 04:38:41.530 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-13 04:38:41.530 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-13 04:38:41.531 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-13 04:38:41.538 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-13 04:38:41.538 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-13_04-38-41__ad45205e-e6d6-4c09-9697-b7dce07aad55__wakuorg_nwaku:latest.log
2026-03-13 04:38:41.538 DEBUG [src.node.waku_node] Starting Node...
2026-03-13 04:38:41.538 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-13 04:38:41.539 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-13 04:38:41.540 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.101.98
2026-03-13 04:38:41.540 DEBUG [src.node.docker_mananger] Generated ports ['24118', '24119', '24120', '24121', '24122']
2026-03-13 04:38:41.540 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-13 04:38:41.540 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-13 04:38:41.540 DEBUG [src.node.waku_node] Using volumes []
2026-03-13 04:38:41.540 DEBUG [src.node.docker_mananger] docker run -i -t -p 24118:24118 -p 24119:24119 -p 24120:24120 -p 24121:24121 -p 24122:24122 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=24120 --rest-port=24118 --tcp-port=24119 --discv5-udp-port=24121 --rest-address=0.0.0.0 --nat=extip:172.18.101.98 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=ace6806e1e21fdde97aabef4de8046b0edca044baf8bdc3edad1a42f0cb2bfa6 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=24122 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto
2026-03-13 04:38:41.739 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.101.98 waku 623041bd63ac2eed11cefb77c1d17d4a5bfcb70ecfb5e9e06b9dc0b2576a6454
2026-03-13 04:38:41.779 DEBUG [src.node.docker_mananger] Container started with ID 623041bd63ac. Setting up logs at ./log/docker/node1_2026-03-13_04-38-41__ad45205e-e6d6-4c09-9697-b7dce07aad55__wakuorg_nwaku:latest.log
2026-03-13 04:38:41.780 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 24118
2026-03-13 04:38:41.780 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-13 04:38:42.083 ERROR [src.node.docker_mananger] Max retries reached for container b697ebe6c4ef. Exiting log stream.
2026-03-13 04:38:42.781 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24118/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:42.784 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-13 04:38:42.884 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24118/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:42.886 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-13 04:38:42.987 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24118/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:43.032 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-13 04:38:43.132 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24118/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:43.135 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-13 04:38:43.136 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-13 04:38:43.136 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24118/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:43.139 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.101.98/tcp/24119/p2p/16Uiu2HAkx4m9PiCM2UdtQaT2sc1btWxH19bp7vdhsA17UVPV3ACr","/ip4/172.18.101.98/tcp/24120/ws/p2p/16Uiu2HAkx4m9PiCM2UdtQaT2sc1btWxH19bp7vdhsA17UVPV3ACr"],"enrUri":"enr:-L24QKv1YSk6MBHSL-13UXu5tSSInnwIH9CjN_DmIpxY8DN4BnSnigX9K7iqAsX7yEgmERnjRhi1UmiF6aM18zUK_hsCgmlkgnY0gmlwhKwSZWKKbXVsdGlhZGRyc5YACASsEmViBl43AAoErBJlYgZeON0DgnJzhQACAQAAiXNlY3AyNTZrMaECJze0Vdx806LuCQlc-iZImW9lhErdXRq2eD1FfkNyu0ODdGNwgl43g3VkcIJeOYV3YWt1MgU"}'
2026-03-13 04:38:43.139 INFO [src.node.waku_node] REST service is ready !!
2026-03-13 04:38:43.149 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-13 04:38:43.149 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-13_04-38-41__ad45205e-e6d6-4c09-9697-b7dce07aad55__wakuorg_nwaku:latest.log
2026-03-13 04:38:43.149 DEBUG [src.node.waku_node] Starting Node...
2026-03-13 04:38:43.150 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-13 04:38:43.151 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-13 04:38:43.151 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.209.46
2026-03-13 04:38:43.151 DEBUG [src.node.docker_mananger] Generated ports ['46146', '46147', '46148', '46149', '46150']
2026-03-13 04:38:43.151 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-13 04:38:43.152 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-13 04:38:43.152 DEBUG [src.node.waku_node] Using volumes []
2026-03-13 04:38:43.152 DEBUG [src.node.docker_mananger] docker run -i -t -p 46146:46146 -p 46147:46147 -p 46148:46148 -p 46149:46149 -p 46150:46150 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=46148 --rest-port=46146 --tcp-port=46147 --discv5-udp-port=46149 --rest-address=0.0.0.0 --nat=extip:172.18.209.46 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=2bdd69d8aaec0b0ad0dcfa9a5a9c1dbb8ac23fffb61c6a5a9bfb662a6ad76f98 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=46150 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QKv1YSk6MBHSL-13UXu5tSSInnwIH9CjN_DmIpxY8DN4BnSnigX9K7iqAsX7yEgmERnjRhi1UmiF6aM18zUK_hsCgmlkgnY0gmlwhKwSZWKKbXVsdGlhZGRyc5YACASsEmViBl43AAoErBJlYgZeON0DgnJzhQACAQAAiXNlY3AyNTZrMaECJze0Vdx806LuCQlc-iZImW9lhErdXRq2eD1FfkNyu0ODdGNwgl43g3VkcIJeOYV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-13 04:38:43.354 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.209.46 waku b39bcca572f53f18541eb2903358a4133384f1c23e170d472f8c34f4fffe17fd
2026-03-13 04:38:43.395 DEBUG [src.node.docker_mananger] Container started with ID b39bcca572f5. Setting up logs at ./log/docker/node3_2026-03-13_04-38-41__ad45205e-e6d6-4c09-9697-b7dce07aad55__wakuorg_nwaku:latest.log
2026-03-13 04:38:43.396 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 46146
2026-03-13 04:38:43.396 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-13 04:38:44.397 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:46146/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:44.399 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-13 04:38:44.400 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-13 04:38:44.400 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:46146/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:44.403 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.209.46/tcp/46147/p2p/16Uiu2HAm6ZBDn9ts2ELANEdTWr6fd6R9G9W9FVwR9mwm8Xd49fC5","/ip4/172.18.209.46/tcp/46148/ws/p2p/16Uiu2HAm6ZBDn9ts2ELANEdTWr6fd6R9G9W9FVwR9mwm8Xd49fC5"],"enrUri":"enr:-L24QPac_qxZ-FvmzXQiL2QjvS4ntO4dlC7dwKjKR8sBlmNvd8WeOGh7QasNboBwY2dYapUy16S8RLcDjULLOplep64CgmlkgnY0gmlwhKwS0S6KbXVsdGlhZGRyc5YACASsEtEuBrRDAAoErBLRLga0RN0DgnJzhQACAQAAiXNlY3AyNTZrMaECpVyvVj2EP9CC_eZKRW2OP9nRHQo5GCiSTUbF_y6olcqDdGNwgrRDg3VkcIK0RYV3YWt1MgE"}'
2026-03-13 04:38:44.404 INFO [src.node.waku_node] REST service is ready !!
2026-03-13 04:38:44.404 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:46146/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.101.98/tcp/24119/p2p/16Uiu2HAkx4m9PiCM2UdtQaT2sc1btWxH19bp7vdhsA17UVPV3ACr"]'
2026-03-13 04:38:44.427 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:44.440 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-13 04:38:44.440 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-13_04-38-41__ad45205e-e6d6-4c09-9697-b7dce07aad55__wakuorg_nwaku:latest.log
2026-03-13 04:38:44.441 DEBUG [src.node.waku_node] Starting Node...
2026-03-13 04:38:44.442 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-13 04:38:44.444 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-13 04:38:44.445 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.243.5
2026-03-13 04:38:44.445 DEBUG [src.node.docker_mananger] Generated ports ['42496', '42497', '42498', '42499', '42500']
2026-03-13 04:38:44.445 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-13 04:38:44.445 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-13 04:38:44.450 DEBUG [src.node.waku_node] Using volumes []
2026-03-13 04:38:44.450 DEBUG [src.node.docker_mananger] docker run -i -t -p 42496:42496 -p 42497:42497 -p 42498:42498 -p 42499:42499 -p 42500:42500 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=42498 --rest-port=42496 --tcp-port=42497 --discv5-udp-port=42499 --rest-address=0.0.0.0 --nat=extip:172.18.243.5 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=67a351beed587db4a4f8e46de9adb49327acaeecdfeb4e7d15e156a2dcdbbc8e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=42500 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QKv1YSk6MBHSL-13UXu5tSSInnwIH9CjN_DmIpxY8DN4BnSnigX9K7iqAsX7yEgmERnjRhi1UmiF6aM18zUK_hsCgmlkgnY0gmlwhKwSZWKKbXVsdGlhZGRyc5YACASsEmViBl43AAoErBJlYgZeON0DgnJzhQACAQAAiXNlY3AyNTZrMaECJze0Vdx806LuCQlc-iZImW9lhErdXRq2eD1FfkNyu0ODdGNwgl43g3VkcIJeOYV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-13 04:38:44.654 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.243.5 waku 2db97c58f5e92a4f0f03a8c95a007a7f0a74e094a0e2839b75cfbfb7a5003dff
2026-03-13 04:38:44.689 DEBUG [src.node.docker_mananger] Container started with ID 2db97c58f5e9. Setting up logs at ./log/docker/node4_2026-03-13_04-38-41__ad45205e-e6d6-4c09-9697-b7dce07aad55__wakuorg_nwaku:latest.log
2026-03-13 04:38:44.690 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 42496
2026-03-13 04:38:44.690 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-13 04:38:45.690 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42496/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:45.693 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-13 04:38:45.693 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-13 04:38:45.693 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42496/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:45.696 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.243.5/tcp/42497/p2p/16Uiu2HAmBsmKLarN7yJpZR9gLLWTpfaMLqgmjBPZ8cZBzU7FWM1j","/ip4/172.18.243.5/tcp/42498/ws/p2p/16Uiu2HAmBsmKLarN7yJpZR9gLLWTpfaMLqgmjBPZ8cZBzU7FWM1j"],"enrUri":"enr:-L24QN3E4m-eOYYPoBEpUzy3_4GoEoJpphsHKczt1YSlUpNiLKrTHxwLNKzmtyXtziPuWphW_DZlAV0nKrUp_k9aEBkCgmlkgnY0gmlwhKwS8wWKbXVsdGlhZGRyc5YACASsEvMFBqYBAAoErBLzBQamAt0DgnJzhQACAQAAiXNlY3AyNTZrMaEC9GogW-Vwh8Q6MxpO3LypEmagpBnINiIFszgEvhDmY2KDdGNwgqYBg3VkcIKmA4V3YWt1MgE"}'
2026-03-13 04:38:45.696 INFO [src.node.waku_node] REST service is ready !!
2026-03-13 04:38:45.696 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:42496/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.101.98/tcp/24119/p2p/16Uiu2HAkx4m9PiCM2UdtQaT2sc1btWxH19bp7vdhsA17UVPV3ACr"]'
2026-03-13 04:38:45.722 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:45.736 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-13 04:38:45.736 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-03-13_04-38-41__ad45205e-e6d6-4c09-9697-b7dce07aad55__wakuorg_nwaku:latest.log
2026-03-13 04:38:45.736 DEBUG [src.node.waku_node] Starting Node...
2026-03-13 04:38:45.737 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-13 04:38:45.738 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-13 04:38:45.738 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.76.228
2026-03-13 04:38:45.738 DEBUG [src.node.docker_mananger] Generated ports ['53833', '53834', '53835', '53836', '53837']
2026-03-13 04:38:45.739 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-13 04:38:45.739 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-13 04:38:45.739 DEBUG [src.node.waku_node] Using volumes []
2026-03-13 04:38:45.739 DEBUG [src.node.docker_mananger] docker run -i -t -p 53833:53833 -p 53834:53834 -p 53835:53835 -p 53836:53836 -p 53837:53837 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=53835 --rest-port=53833 --tcp-port=53834 --discv5-udp-port=53836 --rest-address=0.0.0.0 --nat=extip:172.18.76.228 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=e7da8ceac8ff0b992ab57cb6eeb89da6de482fcfcfdcc32dfbffef5e4dc185f3 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=53837 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QKv1YSk6MBHSL-13UXu5tSSInnwIH9CjN_DmIpxY8DN4BnSnigX9K7iqAsX7yEgmERnjRhi1UmiF6aM18zUK_hsCgmlkgnY0gmlwhKwSZWKKbXVsdGlhZGRyc5YACASsEmViBl43AAoErBJlYgZeON0DgnJzhQACAQAAiXNlY3AyNTZrMaECJze0Vdx806LuCQlc-iZImW9lhErdXRq2eD1FfkNyu0ODdGNwgl43g3VkcIJeOYV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-13 04:38:45.944 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.76.228 waku 5417ae5c0484e698d8a3878bb71315c6f46613839fd9cf7a8b85ba3154daeb58
2026-03-13 04:38:45.982 DEBUG [src.node.docker_mananger] Container started with ID 5417ae5c0484. Setting up logs at ./log/docker/node5_2026-03-13_04-38-41__ad45205e-e6d6-4c09-9697-b7dce07aad55__wakuorg_nwaku:latest.log
2026-03-13 04:38:45.983 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 53833
2026-03-13 04:38:45.984 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-13 04:38:46.984 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53833/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:46.987 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-13 04:38:46.987 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-13 04:38:46.987 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53833/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:46.989 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.76.228/tcp/53834/p2p/16Uiu2HAmGihXsqXAXPPpJYTLwRs7VWYueJi48t1u2iQBk9VGyjrT","/ip4/172.18.76.228/tcp/53835/ws/p2p/16Uiu2HAmGihXsqXAXPPpJYTLwRs7VWYueJi48t1u2iQBk9VGyjrT"],"enrUri":"enr:-L24QOnl_Cy4kba-VNCKaFwfHPUYa1l7NUyOdnPjbvlFbX84IpYX8XUI6B-eMrCupDBKgEuYkR5OWTw9-5POoyuHLf0CgmlkgnY0gmlwhKwSTOSKbXVsdGlhZGRyc5YACASsEkzkBtJKAAoErBJM5AbSS90DgnJzhQACAQAAiXNlY3AyNTZrMaEDPGIOLXdhmWI1lNnCe4CqlBblf-xYUAUW5XMJgXto7syDdGNwgtJKg3VkcILSTIV3YWt1MgE"}'
2026-03-13 04:38:46.990 INFO [src.node.waku_node] REST service is ready !!
2026-03-13 04:38:46.990 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53833/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.101.98/tcp/24119/p2p/16Uiu2HAkx4m9PiCM2UdtQaT2sc1btWxH19bp7vdhsA17UVPV3ACr"]'
2026-03-13 04:38:47.041 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:47.051 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-13 04:38:47.051 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node6_2026-03-13_04-38-41__ad45205e-e6d6-4c09-9697-b7dce07aad55__wakuorg_nwaku:latest.log
2026-03-13 04:38:47.051 DEBUG [src.node.waku_node] Starting Node...
2026-03-13 04:38:47.051 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-13 04:38:47.052 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-13 04:38:47.053 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.168.103
2026-03-13 04:38:47.053 DEBUG [src.node.docker_mananger] Generated ports ['62800', '62801', '62802', '62803', '62804']
2026-03-13 04:38:47.053 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-13 04:38:47.053 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-13 04:38:47.053 DEBUG [src.node.waku_node] Using volumes []
2026-03-13 04:38:47.053 DEBUG [src.node.docker_mananger] docker run -i -t -p 62800:62800 -p 62801:62801 -p 62802:62802 -p 62803:62803 -p 62804:62804 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=62802 --rest-port=62800 --tcp-port=62801 --discv5-udp-port=62803 --rest-address=0.0.0.0 --nat=extip:172.18.168.103 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=0cffdbefdb595109af6cadabfcb4bb317b1c894e8e6ec6fa9edad88c4fdd0bab --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=62804 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QKv1YSk6MBHSL-13UXu5tSSInnwIH9CjN_DmIpxY8DN4BnSnigX9K7iqAsX7yEgmERnjRhi1UmiF6aM18zUK_hsCgmlkgnY0gmlwhKwSZWKKbXVsdGlhZGRyc5YACASsEmViBl43AAoErBJlYgZeON0DgnJzhQACAQAAiXNlY3AyNTZrMaECJze0Vdx806LuCQlc-iZImW9lhErdXRq2eD1FfkNyu0ODdGNwgl43g3VkcIJeOYV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-13 04:38:47.269 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.168.103 waku 4fd435663237e2ab7b947b32f5b178e7a87b7f5013aed48cb4ec5e4a6a0580c5
2026-03-13 04:38:47.303 DEBUG [src.node.docker_mananger] Container started with ID 4fd435663237. Setting up logs at ./log/docker/node6_2026-03-13_04-38-41__ad45205e-e6d6-4c09-9697-b7dce07aad55__wakuorg_nwaku:latest.log
2026-03-13 04:38:47.303 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 62800
2026-03-13 04:38:47.303 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-13 04:38:48.305 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62800/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:48.308 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-13 04:38:48.308 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-13 04:38:48.308 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62800/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:48.310 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.168.103/tcp/62801/p2p/16Uiu2HAm3s54fx47gt3ThQ4aaeKje59mSWY2FAuiEoheCEtn7Suy","/ip4/172.18.168.103/tcp/62802/ws/p2p/16Uiu2HAm3s54fx47gt3ThQ4aaeKje59mSWY2FAuiEoheCEtn7Suy"],"enrUri":"enr:-L24QIG7U5K9aV92HaZVteqGvlSs1z1q9uvcHDPdB6AuB8mZJ3x2HTrvkg7ZwEqL9uibMSnwdGkLVnysqZSUOVDcfgUCgmlkgnY0gmlwhKwSqGeKbXVsdGlhZGRyc5YACASsEqhnBvVRAAoErBKoZwb1Ut0DgnJzhQACAQAAiXNlY3AyNTZrMaECfV8d71Iy66vNdsy5dsGziVyMyQhGz7c0xo5h4VNJteSDdGNwgvVRg3VkcIL1U4V3YWt1MgE"}'
2026-03-13 04:38:48.311 INFO [src.node.waku_node] REST service is ready !!
2026-03-13 04:38:48.311 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62800/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.101.98/tcp/24119/p2p/16Uiu2HAkx4m9PiCM2UdtQaT2sc1btWxH19bp7vdhsA17UVPV3ACr"]'
2026-03-13 04:38:48.342 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:48.353 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-13 04:38:48.355 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node7_2026-03-13_04-38-41__ad45205e-e6d6-4c09-9697-b7dce07aad55__wakuorg_nwaku:latest.log
2026-03-13 04:38:48.355 DEBUG [src.node.waku_node] Starting Node...
2026-03-13 04:38:48.355 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-13 04:38:48.358 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-13 04:38:48.358 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.33.229
2026-03-13 04:38:48.358 DEBUG [src.node.docker_mananger] Generated ports ['17821', '17822', '17823', '17824', '17825']
2026-03-13 04:38:48.358 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-13 04:38:48.358 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-13 04:38:48.358 DEBUG [src.node.waku_node] Using volumes []
2026-03-13 04:38:48.358 DEBUG [src.node.docker_mananger] docker run -i -t -p 17821:17821 -p 17822:17822 -p 17823:17823 -p 17824:17824 -p 17825:17825 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=17823 --rest-port=17821 --tcp-port=17822 --discv5-udp-port=17824 --rest-address=0.0.0.0 --nat=extip:172.18.33.229 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=0e3be9dea68d8ff99adbdd271ebeecfea37c00a27bda27dd7c7185e4c5f2c2eb --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=17825 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QKv1YSk6MBHSL-13UXu5tSSInnwIH9CjN_DmIpxY8DN4BnSnigX9K7iqAsX7yEgmERnjRhi1UmiF6aM18zUK_hsCgmlkgnY0gmlwhKwSZWKKbXVsdGlhZGRyc5YACASsEmViBl43AAoErBJlYgZeON0DgnJzhQACAQAAiXNlY3AyNTZrMaECJze0Vdx806LuCQlc-iZImW9lhErdXRq2eD1FfkNyu0ODdGNwgl43g3VkcIJeOYV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-13 04:38:48.572 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.33.229 waku 8dc542bd7f40371e67eabe714558d25d289cb5fd0e311fe55ce954d0e73da2a1
2026-03-13 04:38:48.614 DEBUG [src.node.docker_mananger] Container started with ID 8dc542bd7f40. Setting up logs at ./log/docker/node7_2026-03-13_04-38-41__ad45205e-e6d6-4c09-9697-b7dce07aad55__wakuorg_nwaku:latest.log
2026-03-13 04:38:48.614 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 17821
2026-03-13 04:38:48.614 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-13 04:38:49.615 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17821/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:49.618 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-13 04:38:49.719 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17821/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:49.765 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-13 04:38:49.866 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17821/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:49.869 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-13 04:38:49.869 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-13 04:38:49.869 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17821/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:49.871 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.33.229/tcp/17822/p2p/16Uiu2HAm7jGKoRBc1zpAh1BwoAs9C1hDhsjhW9xthkeaEuUT4v1u","/ip4/172.18.33.229/tcp/17823/ws/p2p/16Uiu2HAm7jGKoRBc1zpAh1BwoAs9C1hDhsjhW9xthkeaEuUT4v1u"],"enrUri":"enr:-L24QBO2VfBbCJFIVAnrB6hHCqXnn8_NFRvqfYzb3BbBPLASW7pc-yZYsx3Pc7zuBkrvBycFPuU_OGBz9EX0qm0BmzsCgmlkgnY0gmlwhKwSIeWKbXVsdGlhZGRyc5YACASsEiHlBkWeAAoErBIh5QZFn90DgnJzhQACAQAAiXNlY3AyNTZrMaECts3zaizfVpmjm9kcqpkjumhySh5Y_XU83TGPENh7jyCDdGNwgkWeg3VkcIJFoIV3YWt1MgE"}'
2026-03-13 04:38:49.872 INFO [src.node.waku_node] REST service is ready !!
2026-03-13 04:38:49.872 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17821/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.101.98/tcp/24119/p2p/16Uiu2HAkx4m9PiCM2UdtQaT2sc1btWxH19bp7vdhsA17UVPV3ACr"]'
2026-03-13 04:38:49.917 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:49.932 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-13 04:38:49.935 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node8_2026-03-13_04-38-41__ad45205e-e6d6-4c09-9697-b7dce07aad55__wakuorg_nwaku:latest.log
2026-03-13 04:38:49.938 DEBUG [src.node.waku_node] Starting Node...
2026-03-13 04:38:49.939 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-13 04:38:49.943 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-13 04:38:49.946 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.176.3
2026-03-13 04:38:49.947 DEBUG [src.node.docker_mananger] Generated ports ['64902', '64903', '64904', '64905', '64906']
2026-03-13 04:38:49.947 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-13 04:38:49.948 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-13 04:38:49.952 DEBUG [src.node.waku_node] Using volumes []
2026-03-13 04:38:49.952 DEBUG [src.node.docker_mananger] docker run -i -t -p 64902:64902 -p 64903:64903 -p 64904:64904 -p 64905:64905 -p 64906:64906 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=64904 --rest-port=64902 --tcp-port=64903 --discv5-udp-port=64905 --rest-address=0.0.0.0 --nat=extip:172.18.176.3 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=cda9f055a1ca205ba9ee1cddfff2fba1b026df72b5090abef4ea4a8f029795e6 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=64906 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QKv1YSk6MBHSL-13UXu5tSSInnwIH9CjN_DmIpxY8DN4BnSnigX9K7iqAsX7yEgmERnjRhi1UmiF6aM18zUK_hsCgmlkgnY0gmlwhKwSZWKKbXVsdGlhZGRyc5YACASsEmViBl43AAoErBJlYgZeON0DgnJzhQACAQAAiXNlY3AyNTZrMaECJze0Vdx806LuCQlc-iZImW9lhErdXRq2eD1FfkNyu0ODdGNwgl43g3VkcIJeOYV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-13 04:38:50.159 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.176.3 waku e5d51df0ab8bb83d81c79af6d2adb3ef06c6ed3c56f34f97a62d1a9d3f7f8e23
2026-03-13 04:38:50.198 DEBUG [src.node.docker_mananger] Container started with ID e5d51df0ab8b. Setting up logs at ./log/docker/node8_2026-03-13_04-38-41__ad45205e-e6d6-4c09-9697-b7dce07aad55__wakuorg_nwaku:latest.log
2026-03-13 04:38:50.199 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 64902
2026-03-13 04:38:50.202 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-13 04:38:51.202 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64902/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:51.205 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-13 04:38:51.205 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-13 04:38:51.206 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64902/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:51.208 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.176.3/tcp/64903/p2p/16Uiu2HAm66Vf6ZT9MLKJ1qG1iiFk6RBrf3axeMY1BXoCP4MicyPf","/ip4/172.18.176.3/tcp/64904/ws/p2p/16Uiu2HAm66Vf6ZT9MLKJ1qG1iiFk6RBrf3axeMY1BXoCP4MicyPf"],"enrUri":"enr:-L24QIXUQ2X-banJEoJUWKUbK-f9uTd9TIaUR9MhO4DfT80qaWsgAaBSVFf1AQxTxyZtWoUjuVC29f9H1bfm4uIbP-oCgmlkgnY0gmlwhKwSsAOKbXVsdGlhZGRyc5YACASsErADBv2HAAoErBKwAwb9iN0DgnJzhQACAQAAiXNlY3AyNTZrMaECnobZavdkUGW6ZdMDf6NH7nQpORMJgWg9SzQTkrU4mUqDdGNwgv2Hg3VkcIL9iYV3YWt1MgE"}'
2026-03-13 04:38:51.208 INFO [src.node.waku_node] REST service is ready !!
2026-03-13 04:38:51.209 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:64902/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.101.98/tcp/24119/p2p/16Uiu2HAkx4m9PiCM2UdtQaT2sc1btWxH19bp7vdhsA17UVPV3ACr"]'
2026-03-13 04:38:51.237 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:51.249 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-13 04:38:51.249 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node9_2026-03-13_04-38-41__ad45205e-e6d6-4c09-9697-b7dce07aad55__wakuorg_nwaku:latest.log
2026-03-13 04:38:51.249 DEBUG [src.node.waku_node] Starting Node...
2026-03-13 04:38:51.249 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-13 04:38:51.251 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-13 04:38:51.251 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.224.148
2026-03-13 04:38:51.251 DEBUG [src.node.docker_mananger] Generated ports ['51348', '51349', '51350', '51351', '51352']
2026-03-13 04:38:51.251 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-13 04:38:51.251 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-13 04:38:51.251 DEBUG [src.node.waku_node] Using volumes []
2026-03-13 04:38:51.252 DEBUG [src.node.docker_mananger] docker run -i -t -p 51348:51348 -p 51349:51349 -p 51350:51350 -p 51351:51351 -p 51352:51352 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=51350 --rest-port=51348 --tcp-port=51349 --discv5-udp-port=51351 --rest-address=0.0.0.0 --nat=extip:172.18.224.148 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=776accc1abb39afed5f95a0501fab93719587ad0faea1216fcb9e376036baaca --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=51352 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QKv1YSk6MBHSL-13UXu5tSSInnwIH9CjN_DmIpxY8DN4BnSnigX9K7iqAsX7yEgmERnjRhi1UmiF6aM18zUK_hsCgmlkgnY0gmlwhKwSZWKKbXVsdGlhZGRyc5YACASsEmViBl43AAoErBJlYgZeON0DgnJzhQACAQAAiXNlY3AyNTZrMaECJze0Vdx806LuCQlc-iZImW9lhErdXRq2eD1FfkNyu0ODdGNwgl43g3VkcIJeOYV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-13 04:38:51.464 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.224.148 waku 0d766898bab6f09c5609dc36a6f984fdcf33fa8340132cd0e20b9ce97ef7e3f0
2026-03-13 04:38:51.503 DEBUG [src.node.docker_mananger] Container started with ID 0d766898bab6. Setting up logs at ./log/docker/node9_2026-03-13_04-38-41__ad45205e-e6d6-4c09-9697-b7dce07aad55__wakuorg_nwaku:latest.log
2026-03-13 04:38:51.504 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 51348
2026-03-13 04:38:51.504 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-13 04:38:52.504 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:51348/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:52.507 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-13 04:38:52.507 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-13 04:38:52.507 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:51348/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:52.510 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.224.148/tcp/51349/p2p/16Uiu2HAmTECXzsxEciq2y7vhdY5FErvJ1j5H2rdUSsgPjYWnS16Q","/ip4/172.18.224.148/tcp/51350/ws/p2p/16Uiu2HAmTECXzsxEciq2y7vhdY5FErvJ1j5H2rdUSsgPjYWnS16Q"],"enrUri":"enr:-L24QB1fobS3mMFwfwLRQ4RyMGaUBD84CUFdgW32E_m9NAMzZ8aWS7W2Kos4_efp-JcJ6zjL4chw7EegtfiM1QbqEM8CgmlkgnY0gmlwhKwS4JSKbXVsdGlhZGRyc5YACASsEuCUBsiVAAoErBLglAbIlt0DgnJzhQACAQAAiXNlY3AyNTZrMaED2IWPlctFPe84997PJD4ua4IVs87w9exnz07NRaH71NGDdGNwgsiVg3VkcILIl4V3YWt1MgE"}'
2026-03-13 04:38:52.510 INFO [src.node.waku_node] REST service is ready !!
2026-03-13 04:38:52.510 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:51348/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.101.98/tcp/24119/p2p/16Uiu2HAkx4m9PiCM2UdtQaT2sc1btWxH19bp7vdhsA17UVPV3ACr"]'
2026-03-13 04:38:52.538 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:52.548 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-13 04:38:52.548 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node10_2026-03-13_04-38-41__ad45205e-e6d6-4c09-9697-b7dce07aad55__wakuorg_nwaku:latest.log
2026-03-13 04:38:52.549 DEBUG [src.node.waku_node] Starting Node...
2026-03-13 04:38:52.550 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-13 04:38:52.552 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-13 04:38:52.552 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.238.54
2026-03-13 04:38:52.553 DEBUG [src.node.docker_mananger] Generated ports ['31781', '31782', '31783', '31784', '31785']
2026-03-13 04:38:52.554 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-13 04:38:52.554 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-13 04:38:52.555 DEBUG [src.node.waku_node] Using volumes []
2026-03-13 04:38:52.555 DEBUG [src.node.docker_mananger] docker run -i -t -p 31781:31781 -p 31782:31782 -p 31783:31783 -p 31784:31784 -p 31785:31785 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=31783 --rest-port=31781 --tcp-port=31782 --discv5-udp-port=31784 --rest-address=0.0.0.0 --nat=extip:172.18.238.54 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=dd44e309214f38fefab2041b7db2109ecf22aaadb9a783da23f0fcb9e404b32b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=31785 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QKv1YSk6MBHSL-13UXu5tSSInnwIH9CjN_DmIpxY8DN4BnSnigX9K7iqAsX7yEgmERnjRhi1UmiF6aM18zUK_hsCgmlkgnY0gmlwhKwSZWKKbXVsdGlhZGRyc5YACASsEmViBl43AAoErBJlYgZeON0DgnJzhQACAQAAiXNlY3AyNTZrMaECJze0Vdx806LuCQlc-iZImW9lhErdXRq2eD1FfkNyu0ODdGNwgl43g3VkcIJeOYV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-13 04:38:52.772 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.238.54 waku 332772a23ab5a40cc45b36a52a61d3c348a9ee903ce971f213c366bcae17916e
2026-03-13 04:38:52.808 DEBUG [src.node.docker_mananger] Container started with ID 332772a23ab5. Setting up logs at ./log/docker/node10_2026-03-13_04-38-41__ad45205e-e6d6-4c09-9697-b7dce07aad55__wakuorg_nwaku:latest.log
2026-03-13 04:38:52.809 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 31781
2026-03-13 04:38:52.809 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-13 04:38:53.810 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31781/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:53.813 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-13 04:38:53.913 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31781/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:53.915 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-13 04:38:54.016 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31781/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:54.018 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-13 04:38:54.118 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31781/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:54.163 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-13 04:38:54.264 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31781/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:54.266 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-13 04:38:54.268 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-13 04:38:54.268 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31781/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:54.274 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.238.54/tcp/31782/p2p/16Uiu2HAkyX3W7A1pG7gGJjmLZpLF8spoo3ZqVY4BjMs2qNG8xjgf","/ip4/172.18.238.54/tcp/31783/ws/p2p/16Uiu2HAkyX3W7A1pG7gGJjmLZpLF8spoo3ZqVY4BjMs2qNG8xjgf"],"enrUri":"enr:-L24QJchcXjHsWudywbPnf9-UFlEOWR4v3MeeQyHIsiWcPXTCIicoDc9TDariCSkpTn8IWpUAqFbVQwXsGUQRm8RNqQCgmlkgnY0gmlwhKwS7jaKbXVsdGlhZGRyc5YACASsEu42BnwmAAoErBLuNgZ8J90DgnJzhQACAQAAiXNlY3AyNTZrMaECPM78y7ZjLf0De_BLK3BH_jL2LeFf3OZtuiRE1LuO_4yDdGNwgnwmg3VkcIJ8KIV3YWt1MgE"}'
2026-03-13 04:38:54.275 INFO [src.node.waku_node] REST service is ready !!
2026-03-13 04:38:54.276 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:31781/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.101.98/tcp/24119/p2p/16Uiu2HAkx4m9PiCM2UdtQaT2sc1btWxH19bp7vdhsA17UVPV3ACr"]'
2026-03-13 04:38:54.311 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:54.312 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24118/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-13 04:38:54.318 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:54.320 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:46146/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-13 04:38:54.324 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:54.325 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:42496/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-13 04:38:54.331 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:54.332 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53833/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-13 04:38:54.336 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:54.337 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62800/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-13 04:38:54.339 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:54.339 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17821/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-13 04:38:54.342 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:54.342 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:64902/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-13 04:38:54.344 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:54.345 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:51348/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-13 04:38:54.348 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:54.348 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:31781/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-13 04:38:54.351 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:54.351 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24118/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:38:54.370 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:54.373 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-13 04:38:54.474 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-13 04:38:54.475 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24118/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:54.479 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773376723251664799,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773376727187684939,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773376734351637863,"ephemeral":false,"proof":""}]'
2026-03-13 04:38:54.486 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-13 04:38:54.488 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-13 04:38:54.488 DEBUG [src.node.waku_node] Stopping container with id 623041bd63ac
2026-03-13 04:38:55.192 DEBUG [src.node.waku_node] Container stopped.
2026-03-13 04:38:55.194 DEBUG [src.node.waku_node] Stopping container with id b39bcca572f5
2026-03-13 04:38:55.813 DEBUG [src.node.waku_node] Container stopped.
2026-03-13 04:38:55.815 DEBUG [src.node.waku_node] Stopping container with id 2db97c58f5e9
2026-03-13 04:38:56.268 ERROR [src.node.docker_mananger] Max retries reached for container 623041bd63ac. Exiting log stream.
2026-03-13 04:38:56.490 DEBUG [src.node.waku_node] Container stopped.
2026-03-13 04:38:56.492 DEBUG [src.node.waku_node] Stopping container with id 5417ae5c0484
2026-03-13 04:38:56.833 ERROR [src.node.docker_mananger] Max retries reached for container b39bcca572f5. Exiting log stream.
2026-03-13 04:38:57.092 DEBUG [src.node.waku_node] Container stopped.
2026-03-13 04:38:57.094 DEBUG [src.node.waku_node] Stopping container with id 4fd435663237
2026-03-13 04:38:57.308 ERROR [src.node.docker_mananger] Max retries reached for container 2db97c58f5e9. Exiting log stream.
2026-03-13 04:38:57.703 DEBUG [src.node.waku_node] Container stopped.
2026-03-13 04:38:57.705 DEBUG [src.node.waku_node] Stopping container with id 8dc542bd7f40
2026-03-13 04:38:58.108 ERROR [src.node.docker_mananger] Max retries reached for container 5417ae5c0484. Exiting log stream.
2026-03-13 04:38:58.291 DEBUG [src.node.waku_node] Container stopped.
2026-03-13 04:38:58.293 DEBUG [src.node.waku_node] Stopping container with id e5d51df0ab8b
2026-03-13 04:38:58.670 ERROR [src.node.docker_mananger] Max retries reached for container 4fd435663237. Exiting log stream.
2026-03-13 04:38:58.879 DEBUG [src.node.waku_node] Container stopped.
2026-03-13 04:38:58.882 DEBUG [src.node.waku_node] Stopping container with id 0d766898bab6
2026-03-13 04:38:59.106 ERROR [src.node.docker_mananger] Max retries reached for container 8dc542bd7f40. Exiting log stream.
2026-03-13 04:38:59.490 DEBUG [src.node.waku_node] Container stopped.
2026-03-13 04:38:59.492 DEBUG [src.node.waku_node] Stopping container with id 332772a23ab5
2026-03-13 04:38:59.699 ERROR [src.node.docker_mananger] Max retries reached for container e5d51df0ab8b. Exiting log stream.
2026-03-13 04:39:00.064 DEBUG [src.node.waku_node] Container stopped.
2026-03-13 04:39:00.067 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-13 04:39:00.229 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-13 04:39:00.321 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-13 04:39:00.359 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-13 04:39:00.447 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-13 04:39:00.522 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-13 04:39:00.524 ERROR [src.node.docker_mananger] Max retries reached for container 0d766898bab6. Exiting log stream.
2026-03-13 04:39:00.560 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-13 04:39:00.598 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-13 04:39:00.627 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-13 04:39:00.656 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-13 04:39:00.658 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-13 04:39:00.658 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-13 04:39:00.659 DEBUG [src.libs.common] Attaching file ./log/docker/node6_2026-03-13_04-38-41__ad45205e-e6d6-4c09-9697-b7dce07aad55__wakuorg_nwaku:latest.log
2026-03-13 04:39:00.661 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-13_04-38-41__ad45205e-e6d6-4c09-9697-b7dce07aad55__wakuorg_nwaku:latest.log
2026-03-13 04:39:00.664 DEBUG [src.libs.common] Attaching file ./log/docker/node8_2026-03-13_04-38-41__ad45205e-e6d6-4c09-9697-b7dce07aad55__wakuorg_nwaku:latest.log
2026-03-13 04:39:00.665 DEBUG [src.libs.common] Attaching file ./log/docker/node7_2026-03-13_04-38-41__ad45205e-e6d6-4c09-9697-b7dce07aad55__wakuorg_nwaku:latest.log
2026-03-13 04:39:00.667 DEBUG [src.libs.common] Attaching file ./log/docker/node4_2026-03-13_04-38-41__ad45205e-e6d6-4c09-9697-b7dce07aad55__wakuorg_nwaku:latest.log
2026-03-13 04:39:00.668 DEBUG [src.libs.common] Attaching file ./log/docker/node3_2026-03-13_04-38-41__ad45205e-e6d6-4c09-9697-b7dce07aad55__wakuorg_nwaku:latest.log
2026-03-13 04:39:00.670 DEBUG [src.libs.common] Attaching file ./log/docker/node5_2026-03-13_04-38-41__ad45205e-e6d6-4c09-9697-b7dce07aad55__wakuorg_nwaku:latest.log
2026-03-13 04:39:00.672 DEBUG [src.libs.common] Attaching file ./log/docker/node10_2026-03-13_04-38-41__ad45205e-e6d6-4c09-9697-b7dce07aad55__wakuorg_nwaku:latest.log
2026-03-13 04:39:00.673 DEBUG [src.libs.common] Attaching file ./log/docker/node9_2026-03-13_04-38-41__ad45205e-e6d6-4c09-9697-b7dce07aad55__wakuorg_nwaku:latest.log
Reference in New Issue View Git Blame Copy Permalink