920 lines
168 KiB
Plaintext

2026-03-16 04:57:00.835 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-16 04:57:00.835 DEBUG [tests.conftest] Running test: test_auto_shard_relay_10_nwaku_nodes with id: 2026-03-16_04-57-00__7793d91e-5a8d-4b35-9cd2-a5fa761978e0
2026-03-16 04:57:00.836 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-16 04:57:00.836 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-16 04:57:00.836 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-16 04:57:00.844 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:57:00.844 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-16_04-57-00__7793d91e-5a8d-4b35-9cd2-a5fa761978e0__wakuorg_nwaku:latest.log
2026-03-16 04:57:00.844 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:57:00.844 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:57:00.845 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:57:00.845 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.30.6
2026-03-16 04:57:00.846 DEBUG [src.node.docker_mananger] Generated ports ['5071', '5072', '5073', '5074', '5075']
2026-03-16 04:57:00.846 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:57:00.846 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:57:00.846 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:57:00.846 DEBUG [src.node.docker_mananger] docker run -i -t -p 5071:5071 -p 5072:5072 -p 5073:5073 -p 5074:5074 -p 5075:5075 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=5073 --rest-port=5071 --tcp-port=5072 --discv5-udp-port=5074 --rest-address=0.0.0.0 --nat=extip:172.18.30.6 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=dcbbabe769a325b8ae01af9ddf4d2de4504f7497b4cc2cadceb7aa84e3ad4a20 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=5075 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto
2026-03-16 04:57:01.045 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.30.6 waku 390549fdb6650f8b7b22194552815e5f2b4443179c32faaf80cde9e6886d37e5
2026-03-16 04:57:01.081 DEBUG [src.node.docker_mananger] Container started with ID 390549fdb665. Setting up logs at ./log/docker/node1_2026-03-16_04-57-00__7793d91e-5a8d-4b35-9cd2-a5fa761978e0__wakuorg_nwaku:latest.log
2026-03-16 04:57:01.082 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 5071
2026-03-16 04:57:01.082 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:57:01.640 ERROR [src.node.docker_mananger] Max retries reached for container ec6125e2664a. Exiting log stream.
2026-03-16 04:57:02.082 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:5071/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:02.085 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:57:02.085 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:57:02.085 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:5071/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:02.088 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.30.6/tcp/5072/p2p/16Uiu2HAkzMJEBVBQHWDL5BqU3VWMqE9Fk1Cicyb79ocT2vjpZvru","/ip4/172.18.30.6/tcp/5073/ws/p2p/16Uiu2HAkzMJEBVBQHWDL5BqU3VWMqE9Fk1Cicyb79ocT2vjpZvru"],"enrUri":"enr:-L24QIwYQChMlwAhFxBAhYrB7eqNlvSECZTF_2VL6xSgaEJ7FG4NN7ZrYK_j9egHh1yZdMHR1r3ijc8IFQPjkMY9SPwCgmlkgnY0gmlwhKwSHgaKbXVsdGlhZGRyc5YACASsEh4GBhPQAAoErBIeBgYT0d0DgnJzhQACAQAAiXNlY3AyNTZrMaECSSuEM3iMheHpWajHKN8n1gU1nTz1l9OdOgLhODcvELKDdGNwghPQg3VkcIIT0oV3YWt1MgU"}'
2026-03-16 04:57:02.088 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:57:02.095 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:57:02.095 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-16_04-57-00__7793d91e-5a8d-4b35-9cd2-a5fa761978e0__wakuorg_nwaku:latest.log
2026-03-16 04:57:02.095 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:57:02.095 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:57:02.097 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:57:02.097 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.244.155
2026-03-16 04:57:02.097 DEBUG [src.node.docker_mananger] Generated ports ['61083', '61084', '61085', '61086', '61087']
2026-03-16 04:57:02.097 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:57:02.097 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:57:02.097 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:57:02.098 DEBUG [src.node.docker_mananger] docker run -i -t -p 61083:61083 -p 61084:61084 -p 61085:61085 -p 61086:61086 -p 61087:61087 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=61085 --rest-port=61083 --tcp-port=61084 --discv5-udp-port=61086 --rest-address=0.0.0.0 --nat=extip:172.18.244.155 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=18d5ffdbe2ea04bedd05a4b6a0abcfb1f3bdf21432aa0c7c13bba1ee1d0ae96b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=61087 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QIwYQChMlwAhFxBAhYrB7eqNlvSECZTF_2VL6xSgaEJ7FG4NN7ZrYK_j9egHh1yZdMHR1r3ijc8IFQPjkMY9SPwCgmlkgnY0gmlwhKwSHgaKbXVsdGlhZGRyc5YACASsEh4GBhPQAAoErBIeBgYT0d0DgnJzhQACAQAAiXNlY3AyNTZrMaECSSuEM3iMheHpWajHKN8n1gU1nTz1l9OdOgLhODcvELKDdGNwghPQg3VkcIIT0oV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-16 04:57:02.303 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.244.155 waku c1ed4305cd35a9f20fd3ca88b6948fc4050b71a843976c24e0e3127bf3e49303
2026-03-16 04:57:02.340 DEBUG [src.node.docker_mananger] Container started with ID c1ed4305cd35. Setting up logs at ./log/docker/node3_2026-03-16_04-57-00__7793d91e-5a8d-4b35-9cd2-a5fa761978e0__wakuorg_nwaku:latest.log
2026-03-16 04:57:02.341 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 61083
2026-03-16 04:57:02.341 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:57:03.342 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61083/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:03.349 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:57:03.349 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:57:03.349 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61083/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:03.352 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.244.155/tcp/61084/p2p/16Uiu2HAmCFQ8jmCEjRpuAVht79zBY3hASFhxNnuyWLn2vY22Nf4v","/ip4/172.18.244.155/tcp/61085/ws/p2p/16Uiu2HAmCFQ8jmCEjRpuAVht79zBY3hASFhxNnuyWLn2vY22Nf4v"],"enrUri":"enr:-L24QFSDi4Y5wRftZLhbwbH8WsQZ3sI2ECqZJapiVGNnfgymOliTFM3lkOPR3D5XpT1W-NNYB_Cwxt8gpbiHetcZQ7sCgmlkgnY0gmlwhKwS9JuKbXVsdGlhZGRyc5YACASsEvSbBu6cAAoErBL0mwbund0DgnJzhQACAQAAiXNlY3AyNTZrMaEC-fTz6O9on3decepoyCNEkRpjE8ld7TFWrub2YRO_0XODdGNwgu6cg3VkcILunoV3YWt1MgE"}'
2026-03-16 04:57:03.353 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:57:03.353 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61083/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.30.6/tcp/5072/p2p/16Uiu2HAkzMJEBVBQHWDL5BqU3VWMqE9Fk1Cicyb79ocT2vjpZvru"]'
2026-03-16 04:57:03.381 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:03.395 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:57:03.395 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-16_04-57-00__7793d91e-5a8d-4b35-9cd2-a5fa761978e0__wakuorg_nwaku:latest.log
2026-03-16 04:57:03.396 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:57:03.398 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:57:03.402 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:57:03.403 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.47.102
2026-03-16 04:57:03.403 DEBUG [src.node.docker_mananger] Generated ports ['50949', '50950', '50951', '50952', '50953']
2026-03-16 04:57:03.403 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:57:03.405 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:57:03.406 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:57:03.407 DEBUG [src.node.docker_mananger] docker run -i -t -p 50949:50949 -p 50950:50950 -p 50951:50951 -p 50952:50952 -p 50953:50953 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=50951 --rest-port=50949 --tcp-port=50950 --discv5-udp-port=50952 --rest-address=0.0.0.0 --nat=extip:172.18.47.102 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=f30afd95bcda21c2fdd8ec771da5ef962ef5fa5c46c3dcab6c7eb290feadefbb --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=50953 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QIwYQChMlwAhFxBAhYrB7eqNlvSECZTF_2VL6xSgaEJ7FG4NN7ZrYK_j9egHh1yZdMHR1r3ijc8IFQPjkMY9SPwCgmlkgnY0gmlwhKwSHgaKbXVsdGlhZGRyc5YACASsEh4GBhPQAAoErBIeBgYT0d0DgnJzhQACAQAAiXNlY3AyNTZrMaECSSuEM3iMheHpWajHKN8n1gU1nTz1l9OdOgLhODcvELKDdGNwghPQg3VkcIIT0oV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-16 04:57:03.633 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.47.102 waku 4144ea13bddc58e4334921170645a714833790fafb269c3aeef94856a95c98a2
2026-03-16 04:57:03.673 DEBUG [src.node.docker_mananger] Container started with ID 4144ea13bddc. Setting up logs at ./log/docker/node4_2026-03-16_04-57-00__7793d91e-5a8d-4b35-9cd2-a5fa761978e0__wakuorg_nwaku:latest.log
2026-03-16 04:57:03.674 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 50949
2026-03-16 04:57:03.674 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:57:04.675 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50949/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:04.692 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:57:04.793 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50949/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:04.795 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:57:04.795 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:57:04.796 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50949/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:04.798 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.47.102/tcp/50950/p2p/16Uiu2HAkxF2a8gxfHKcYzmKji7ZMg9b5kxZhECU2UTUv8tZ3GUtz","/ip4/172.18.47.102/tcp/50951/ws/p2p/16Uiu2HAkxF2a8gxfHKcYzmKji7ZMg9b5kxZhECU2UTUv8tZ3GUtz"],"enrUri":"enr:-L24QKy5DxVf9ywPJi01MfRDJ3i74P7W55AEDsj0OjzI1KugazWM5wvq98awXIxX7qrogRl_x23-RymhjGnONl_f6zICgmlkgnY0gmlwhKwSL2aKbXVsdGlhZGRyc5YACASsEi9mBscGAAoErBIvZgbHB90DgnJzhQACAQAAiXNlY3AyNTZrMaECKdj0lU7bKMgzpHnUKpFFwcAdITn9VLs8hitJFMgIsEuDdGNwgscGg3VkcILHCIV3YWt1MgE"}'
2026-03-16 04:57:04.798 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:57:04.799 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:50949/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.30.6/tcp/5072/p2p/16Uiu2HAkzMJEBVBQHWDL5BqU3VWMqE9Fk1Cicyb79ocT2vjpZvru"]'
2026-03-16 04:57:04.829 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:04.841 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:57:04.841 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-03-16_04-57-00__7793d91e-5a8d-4b35-9cd2-a5fa761978e0__wakuorg_nwaku:latest.log
2026-03-16 04:57:04.841 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:57:04.842 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:57:04.844 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:57:04.844 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.15.204
2026-03-16 04:57:04.845 DEBUG [src.node.docker_mananger] Generated ports ['63465', '63466', '63467', '63468', '63469']
2026-03-16 04:57:04.845 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:57:04.845 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:57:04.846 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:57:04.846 DEBUG [src.node.docker_mananger] docker run -i -t -p 63465:63465 -p 63466:63466 -p 63467:63467 -p 63468:63468 -p 63469:63469 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=63467 --rest-port=63465 --tcp-port=63466 --discv5-udp-port=63468 --rest-address=0.0.0.0 --nat=extip:172.18.15.204 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=febebb6ebcc8af388c7dea2c2384a30afbe5aad18ff278523bc1efeedbe3889e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=63469 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QIwYQChMlwAhFxBAhYrB7eqNlvSECZTF_2VL6xSgaEJ7FG4NN7ZrYK_j9egHh1yZdMHR1r3ijc8IFQPjkMY9SPwCgmlkgnY0gmlwhKwSHgaKbXVsdGlhZGRyc5YACASsEh4GBhPQAAoErBIeBgYT0d0DgnJzhQACAQAAiXNlY3AyNTZrMaECSSuEM3iMheHpWajHKN8n1gU1nTz1l9OdOgLhODcvELKDdGNwghPQg3VkcIIT0oV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-16 04:57:05.068 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.15.204 waku 4327eaf25318e93ba4bd756b7b265a6f55948040507b48f3d8e10c30a1732830
2026-03-16 04:57:05.128 DEBUG [src.node.docker_mananger] Container started with ID 4327eaf25318. Setting up logs at ./log/docker/node5_2026-03-16_04-57-00__7793d91e-5a8d-4b35-9cd2-a5fa761978e0__wakuorg_nwaku:latest.log
2026-03-16 04:57:05.128 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 63465
2026-03-16 04:57:05.128 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:57:06.129 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63465/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:06.131 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:57:06.232 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63465/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:06.238 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:57:06.238 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:57:06.238 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63465/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:06.241 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.15.204/tcp/63466/p2p/16Uiu2HAmGp3Km5n1gvHHTWaWCuyuAXhpDAoNAoLZtzE4QXS5Uz8G","/ip4/172.18.15.204/tcp/63467/ws/p2p/16Uiu2HAmGp3Km5n1gvHHTWaWCuyuAXhpDAoNAoLZtzE4QXS5Uz8G"],"enrUri":"enr:-L24QAmoPNibYA5Kt6Rg38phPvQOet5zqDIhH8e7mb4Pu4HPU5WSQ2SMOAiH1WFPmT7f9nkDejjddjStzpRAz_VmFeECgmlkgnY0gmlwhKwSD8yKbXVsdGlhZGRyc5YACASsEg_MBvfqAAoErBIPzAb3690DgnJzhQACAQAAiXNlY3AyNTZrMaEDPcBWWKB5sSw01m6_RVO6Fe9Xt0J4MM3hSbyF7sM8f8GDdGNwgvfqg3VkcIL37IV3YWt1MgE"}'
2026-03-16 04:57:06.241 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:57:06.241 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63465/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.30.6/tcp/5072/p2p/16Uiu2HAkzMJEBVBQHWDL5BqU3VWMqE9Fk1Cicyb79ocT2vjpZvru"]'
2026-03-16 04:57:06.266 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:06.284 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:57:06.285 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node6_2026-03-16_04-57-00__7793d91e-5a8d-4b35-9cd2-a5fa761978e0__wakuorg_nwaku:latest.log
2026-03-16 04:57:06.286 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:57:06.286 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:57:06.290 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:57:06.291 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.213.18
2026-03-16 04:57:06.292 DEBUG [src.node.docker_mananger] Generated ports ['56077', '56078', '56079', '56080', '56081']
2026-03-16 04:57:06.292 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:57:06.293 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:57:06.294 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:57:06.295 DEBUG [src.node.docker_mananger] docker run -i -t -p 56077:56077 -p 56078:56078 -p 56079:56079 -p 56080:56080 -p 56081:56081 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=56079 --rest-port=56077 --tcp-port=56078 --discv5-udp-port=56080 --rest-address=0.0.0.0 --nat=extip:172.18.213.18 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=bcaaff019cdef8bbccdcdca2bdfbe798ac56b115d5848dc62eef7c7cdaedcc5a --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=56081 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QIwYQChMlwAhFxBAhYrB7eqNlvSECZTF_2VL6xSgaEJ7FG4NN7ZrYK_j9egHh1yZdMHR1r3ijc8IFQPjkMY9SPwCgmlkgnY0gmlwhKwSHgaKbXVsdGlhZGRyc5YACASsEh4GBhPQAAoErBIeBgYT0d0DgnJzhQACAQAAiXNlY3AyNTZrMaECSSuEM3iMheHpWajHKN8n1gU1nTz1l9OdOgLhODcvELKDdGNwghPQg3VkcIIT0oV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-16 04:57:06.534 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.213.18 waku bd9cc8cb8df7cf142006e2b617dd836d187a502db1909cb57494a1f4aa469e87
2026-03-16 04:57:06.570 DEBUG [src.node.docker_mananger] Container started with ID bd9cc8cb8df7. Setting up logs at ./log/docker/node6_2026-03-16_04-57-00__7793d91e-5a8d-4b35-9cd2-a5fa761978e0__wakuorg_nwaku:latest.log
2026-03-16 04:57:06.570 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 56077
2026-03-16 04:57:06.570 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:57:07.571 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56077/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:07.574 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:57:07.674 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56077/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:07.677 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:57:07.777 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56077/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:07.780 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:57:07.780 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:57:07.780 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56077/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:07.782 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.213.18/tcp/56078/p2p/16Uiu2HAmAjD5n8E96ykKZdJFVpgF3d6JqY7YJA6KmNsGY29mV4hu","/ip4/172.18.213.18/tcp/56079/ws/p2p/16Uiu2HAmAjD5n8E96ykKZdJFVpgF3d6JqY7YJA6KmNsGY29mV4hu"],"enrUri":"enr:-L24QCNk3Ti4wttFSCimT7nyHz8dJQsNLYs_i39nmuAnOviPa6_sSX1Rqpzzef0Sbj1dUMbl7fpSp5KfMm4-ATGMpbkCgmlkgnY0gmlwhKwS1RKKbXVsdGlhZGRyc5YACASsEtUSBtsOAAoErBLVEgbbD90DgnJzhQACAQAAiXNlY3AyNTZrMaEC411YnOkDwEGG_cdF7lFBWUtae85O3Ps12_yhSYMBW5CDdGNwgtsOg3VkcILbEIV3YWt1MgE"}'
2026-03-16 04:57:07.783 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:57:07.783 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:56077/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.30.6/tcp/5072/p2p/16Uiu2HAkzMJEBVBQHWDL5BqU3VWMqE9Fk1Cicyb79ocT2vjpZvru"]'
2026-03-16 04:57:07.810 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:07.823 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:57:07.823 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node7_2026-03-16_04-57-00__7793d91e-5a8d-4b35-9cd2-a5fa761978e0__wakuorg_nwaku:latest.log
2026-03-16 04:57:07.823 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:57:07.824 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:57:07.825 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:57:07.825 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.244.209
2026-03-16 04:57:07.825 DEBUG [src.node.docker_mananger] Generated ports ['24208', '24209', '24210', '24211', '24212']
2026-03-16 04:57:07.825 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:57:07.826 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:57:07.826 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:57:07.826 DEBUG [src.node.docker_mananger] docker run -i -t -p 24208:24208 -p 24209:24209 -p 24210:24210 -p 24211:24211 -p 24212:24212 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=24210 --rest-port=24208 --tcp-port=24209 --discv5-udp-port=24211 --rest-address=0.0.0.0 --nat=extip:172.18.244.209 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=cc1eefc5e3eef94a3f6b6ef8d7ac55f8bcbacbcbadb01bee22e1c5c4b17050a2 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=24212 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QIwYQChMlwAhFxBAhYrB7eqNlvSECZTF_2VL6xSgaEJ7FG4NN7ZrYK_j9egHh1yZdMHR1r3ijc8IFQPjkMY9SPwCgmlkgnY0gmlwhKwSHgaKbXVsdGlhZGRyc5YACASsEh4GBhPQAAoErBIeBgYT0d0DgnJzhQACAQAAiXNlY3AyNTZrMaECSSuEM3iMheHpWajHKN8n1gU1nTz1l9OdOgLhODcvELKDdGNwghPQg3VkcIIT0oV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-16 04:57:08.041 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.244.209 waku b2a7b19ea8253fd6b84cf5d4d24de9d83387b8d11be31ff18220eb55f52813c8
2026-03-16 04:57:08.096 DEBUG [src.node.docker_mananger] Container started with ID b2a7b19ea825. Setting up logs at ./log/docker/node7_2026-03-16_04-57-00__7793d91e-5a8d-4b35-9cd2-a5fa761978e0__wakuorg_nwaku:latest.log
2026-03-16 04:57:08.096 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 24208
2026-03-16 04:57:08.096 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:57:09.098 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24208/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:09.104 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:57:09.107 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:57:09.108 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24208/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:09.113 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.244.209/tcp/24209/p2p/16Uiu2HAm7QXXvQrrJNZ7AjcAGNRTV1PTnPvxPmkTRKdRUGCQ1dQV","/ip4/172.18.244.209/tcp/24210/ws/p2p/16Uiu2HAm7QXXvQrrJNZ7AjcAGNRTV1PTnPvxPmkTRKdRUGCQ1dQV"],"enrUri":"enr:-L24QDKY-vIjQRUeI4g9qLI2ajd3_DsEXybI8L06X-iZtcZgXTJwDWeI-HMGIBn7uAvItee_G4Wm8MwXZpR2Z79u2KICgmlkgnY0gmlwhKwS9NGKbXVsdGlhZGRyc5YACASsEvTRBl6RAAoErBL00QZekt0DgnJzhQACAQAAiXNlY3AyNTZrMaECsgEcwFtpyecROptQGriEKqbRMWStihPQ2F-C-JwY-fKDdGNwgl6Rg3VkcIJek4V3YWt1MgE"}'
2026-03-16 04:57:09.115 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:57:09.116 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24208/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.30.6/tcp/5072/p2p/16Uiu2HAkzMJEBVBQHWDL5BqU3VWMqE9Fk1Cicyb79ocT2vjpZvru"]'
2026-03-16 04:57:09.152 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:09.165 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:57:09.166 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node8_2026-03-16_04-57-00__7793d91e-5a8d-4b35-9cd2-a5fa761978e0__wakuorg_nwaku:latest.log
2026-03-16 04:57:09.166 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:57:09.166 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:57:09.169 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:57:09.170 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.133.190
2026-03-16 04:57:09.171 DEBUG [src.node.docker_mananger] Generated ports ['48654', '48655', '48656', '48657', '48658']
2026-03-16 04:57:09.171 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:57:09.173 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:57:09.173 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:57:09.173 DEBUG [src.node.docker_mananger] docker run -i -t -p 48654:48654 -p 48655:48655 -p 48656:48656 -p 48657:48657 -p 48658:48658 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=48656 --rest-port=48654 --tcp-port=48655 --discv5-udp-port=48657 --rest-address=0.0.0.0 --nat=extip:172.18.133.190 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=2de1b0a98ffe801d5fd0dc6dccc0cd0d80bfaea7f32edf279d3f8c2a894d8343 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=48658 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QIwYQChMlwAhFxBAhYrB7eqNlvSECZTF_2VL6xSgaEJ7FG4NN7ZrYK_j9egHh1yZdMHR1r3ijc8IFQPjkMY9SPwCgmlkgnY0gmlwhKwSHgaKbXVsdGlhZGRyc5YACASsEh4GBhPQAAoErBIeBgYT0d0DgnJzhQACAQAAiXNlY3AyNTZrMaECSSuEM3iMheHpWajHKN8n1gU1nTz1l9OdOgLhODcvELKDdGNwghPQg3VkcIIT0oV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-16 04:57:09.423 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.133.190 waku 56bd7ac34a493f1b842ecb62ff173d7e17284fbb6d9c4d9725cab7c8608efc55
2026-03-16 04:57:09.465 DEBUG [src.node.docker_mananger] Container started with ID 56bd7ac34a49. Setting up logs at ./log/docker/node8_2026-03-16_04-57-00__7793d91e-5a8d-4b35-9cd2-a5fa761978e0__wakuorg_nwaku:latest.log
2026-03-16 04:57:09.466 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 48654
2026-03-16 04:57:09.466 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:57:10.467 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48654/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:10.497 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:57:10.598 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48654/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:10.607 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:57:10.607 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:57:10.608 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48654/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:10.610 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.133.190/tcp/48655/p2p/16Uiu2HAmTZ4xC7k7QCTHxHg37DDxfC89hptHFZnKAJnJLYJg6B4L","/ip4/172.18.133.190/tcp/48656/ws/p2p/16Uiu2HAmTZ4xC7k7QCTHxHg37DDxfC89hptHFZnKAJnJLYJg6B4L"],"enrUri":"enr:-L24QMWzJyHdtDHEsh0s7WifHW12grdZQjP8bVCCYdgm78tlSdlWnnwMQgh9JXP0-d6KKtAaD4DV_XPVsDUJ1D_2RKACgmlkgnY0gmlwhKwShb6KbXVsdGlhZGRyc5YACASsEoW-Br4PAAoErBKFvga-EN0DgnJzhQACAQAAiXNlY3AyNTZrMaED3VsFs_wDFY7uCJhVPD52pqoxD-tuFYctsN7-BtPZTEGDdGNwgr4Pg3VkcIK-EYV3YWt1MgE"}'
2026-03-16 04:57:10.610 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:57:10.611 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48654/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.30.6/tcp/5072/p2p/16Uiu2HAkzMJEBVBQHWDL5BqU3VWMqE9Fk1Cicyb79ocT2vjpZvru"]'
2026-03-16 04:57:10.633 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:10.652 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:57:10.656 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node9_2026-03-16_04-57-00__7793d91e-5a8d-4b35-9cd2-a5fa761978e0__wakuorg_nwaku:latest.log
2026-03-16 04:57:10.657 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:57:10.657 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:57:10.663 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:57:10.663 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.178.138
2026-03-16 04:57:10.665 DEBUG [src.node.docker_mananger] Generated ports ['44504', '44505', '44506', '44507', '44508']
2026-03-16 04:57:10.666 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:57:10.667 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:57:10.667 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:57:10.668 DEBUG [src.node.docker_mananger] docker run -i -t -p 44504:44504 -p 44505:44505 -p 44506:44506 -p 44507:44507 -p 44508:44508 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=44506 --rest-port=44504 --tcp-port=44505 --discv5-udp-port=44507 --rest-address=0.0.0.0 --nat=extip:172.18.178.138 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=f2f9066053dfecd9ee40ff81ced0b3e7f8993ab0ca1b77c0a8a9cd9b2449288f --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=44508 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QIwYQChMlwAhFxBAhYrB7eqNlvSECZTF_2VL6xSgaEJ7FG4NN7ZrYK_j9egHh1yZdMHR1r3ijc8IFQPjkMY9SPwCgmlkgnY0gmlwhKwSHgaKbXVsdGlhZGRyc5YACASsEh4GBhPQAAoErBIeBgYT0d0DgnJzhQACAQAAiXNlY3AyNTZrMaECSSuEM3iMheHpWajHKN8n1gU1nTz1l9OdOgLhODcvELKDdGNwghPQg3VkcIIT0oV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-16 04:57:10.898 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.178.138 waku 903bda412fed0985464ede27fdd767f86ecab2e7cc248861b957ef2b70879d42
2026-03-16 04:57:10.944 DEBUG [src.node.docker_mananger] Container started with ID 903bda412fed. Setting up logs at ./log/docker/node9_2026-03-16_04-57-00__7793d91e-5a8d-4b35-9cd2-a5fa761978e0__wakuorg_nwaku:latest.log
2026-03-16 04:57:10.945 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 44504
2026-03-16 04:57:10.945 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:57:11.945 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44504/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:11.952 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:57:12.053 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44504/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:12.058 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:57:12.060 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:57:12.061 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44504/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:12.077 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.178.138/tcp/44505/p2p/16Uiu2HAm5RYHwe7FWTKFKUTcj5tyWrC1r5VGWhzQtquYb4sFagQd","/ip4/172.18.178.138/tcp/44506/ws/p2p/16Uiu2HAm5RYHwe7FWTKFKUTcj5tyWrC1r5VGWhzQtquYb4sFagQd"],"enrUri":"enr:-L24QGl3pulXbIezMGhlzqAkut6mhbBGb0XgUVKRemOkqWJ1Y6X3Agevy1QAp8EpbOw5mwthdAQI8yaCHX0d9064w5sCgmlkgnY0gmlwhKwSsoqKbXVsdGlhZGRyc5YACASsErKKBq3ZAAoErBKyigat2t0DgnJzhQACAQAAiXNlY3AyNTZrMaEClIwtbalOW1FkMVpbmbcM0uJC0bazfKwnDx-ffXZR296DdGNwgq3Zg3VkcIKt24V3YWt1MgE"}'
2026-03-16 04:57:12.079 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:57:12.092 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44504/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.30.6/tcp/5072/p2p/16Uiu2HAkzMJEBVBQHWDL5BqU3VWMqE9Fk1Cicyb79ocT2vjpZvru"]'
2026-03-16 04:57:12.146 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:12.158 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:57:12.158 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node10_2026-03-16_04-57-00__7793d91e-5a8d-4b35-9cd2-a5fa761978e0__wakuorg_nwaku:latest.log
2026-03-16 04:57:12.161 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:57:12.162 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:57:12.168 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:57:12.168 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.206.19
2026-03-16 04:57:12.168 DEBUG [src.node.docker_mananger] Generated ports ['56311', '56312', '56313', '56314', '56315']
2026-03-16 04:57:12.170 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:57:12.170 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:57:12.171 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:57:12.171 DEBUG [src.node.docker_mananger] docker run -i -t -p 56311:56311 -p 56312:56312 -p 56313:56313 -p 56314:56314 -p 56315:56315 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=56313 --rest-port=56311 --tcp-port=56312 --discv5-udp-port=56314 --rest-address=0.0.0.0 --nat=extip:172.18.206.19 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=c096cdfacc18ae7b3e1bf9f8466ddb7e624c08af24ce2a8bbf5ee0b0fecc65ff --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=56315 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QIwYQChMlwAhFxBAhYrB7eqNlvSECZTF_2VL6xSgaEJ7FG4NN7ZrYK_j9egHh1yZdMHR1r3ijc8IFQPjkMY9SPwCgmlkgnY0gmlwhKwSHgaKbXVsdGlhZGRyc5YACASsEh4GBhPQAAoErBIeBgYT0d0DgnJzhQACAQAAiXNlY3AyNTZrMaECSSuEM3iMheHpWajHKN8n1gU1nTz1l9OdOgLhODcvELKDdGNwghPQg3VkcIIT0oV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-16 04:57:12.428 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.206.19 waku fba8c40138a7b4b0c6c8991ac05d9127823db048184ab691d36036c4d0f340d7
2026-03-16 04:57:12.489 DEBUG [src.node.docker_mananger] Container started with ID fba8c40138a7. Setting up logs at ./log/docker/node10_2026-03-16_04-57-00__7793d91e-5a8d-4b35-9cd2-a5fa761978e0__wakuorg_nwaku:latest.log
2026-03-16 04:57:12.490 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 56311
2026-03-16 04:57:12.490 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:57:13.490 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56311/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:13.497 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:57:13.497 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:57:13.497 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56311/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:13.500 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.206.19/tcp/56312/p2p/16Uiu2HAkwdbjXYYxwXWjCkTnHudUADM58EJLUWMNhFTWaAyrmCUL","/ip4/172.18.206.19/tcp/56313/ws/p2p/16Uiu2HAkwdbjXYYxwXWjCkTnHudUADM58EJLUWMNhFTWaAyrmCUL"],"enrUri":"enr:-L24QCSvxRu1fbMQZdu1XgHOZgqD5NQlewtQI7PT0sdBI98FCHGUMz6f8m2yUNC24d_EaT2Ij1KmcYXjgNQXzGIGW1ICgmlkgnY0gmlwhKwSzhOKbXVsdGlhZGRyc5YACASsEs4TBtv4AAoErBLOEwbb-d0DgnJzhQACAQAAiXNlY3AyNTZrMaECIMWK6eZQ6Iwox99VTPz_nDoeW4QG-I2AguIKTyhmLG2DdGNwgtv4g3VkcILb-oV3YWt1MgE"}'
2026-03-16 04:57:13.500 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:57:13.501 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:56311/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.30.6/tcp/5072/p2p/16Uiu2HAkzMJEBVBQHWDL5BqU3VWMqE9Fk1Cicyb79ocT2vjpZvru"]'
2026-03-16 04:57:13.531 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:13.533 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:5071/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:57:13.542 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:13.544 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61083/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:57:13.554 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:13.556 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:50949/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:57:13.563 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:13.564 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63465/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:57:13.567 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:13.568 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:56077/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:57:13.573 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:13.573 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24208/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:57:13.576 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:13.576 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48654/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:57:13.579 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:13.579 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44504/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:57:13.582 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:13.582 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:56311/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:57:13.586 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:13.587 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:5071/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:57:13.606 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:13.606 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 04:57:13.708 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-16 04:57:13.709 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:5071/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:13.711 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773637023249077525,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773637025261815701,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773637027341230200,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773637029707751472,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773637033587080893,"ephemeral":false,"proof":""}]'
2026-03-16 04:57:13.772 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-16 04:57:13.774 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-16 04:57:13.774 DEBUG [src.node.waku_node] Stopping container with id 390549fdb665
2026-03-16 04:57:14.476 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:57:14.476 DEBUG [src.node.waku_node] Stopping container with id c1ed4305cd35
2026-03-16 04:57:15.143 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:57:15.146 DEBUG [src.node.waku_node] Stopping container with id 4144ea13bddc
2026-03-16 04:57:15.768 ERROR [src.node.docker_mananger] Max retries reached for container 390549fdb665. Exiting log stream.
2026-03-16 04:57:15.816 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:57:15.817 DEBUG [src.node.waku_node] Stopping container with id 4327eaf25318
2026-03-16 04:57:16.285 ERROR [src.node.docker_mananger] Max retries reached for container c1ed4305cd35. Exiting log stream.
2026-03-16 04:57:16.424 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:57:16.428 DEBUG [src.node.waku_node] Stopping container with id bd9cc8cb8df7
2026-03-16 04:57:16.638 ERROR [src.node.docker_mananger] Max retries reached for container 4144ea13bddc. Exiting log stream.
2026-03-16 04:57:17.030 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:57:17.033 DEBUG [src.node.waku_node] Stopping container with id b2a7b19ea825
2026-03-16 04:57:17.243 ERROR [src.node.docker_mananger] Max retries reached for container 4327eaf25318. Exiting log stream.
2026-03-16 04:57:17.638 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:57:17.638 DEBUG [src.node.waku_node] Stopping container with id 56bd7ac34a49
2026-03-16 04:57:17.847 ERROR [src.node.docker_mananger] Max retries reached for container bd9cc8cb8df7. Exiting log stream.
2026-03-16 04:57:18.218 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:57:18.219 DEBUG [src.node.waku_node] Stopping container with id 903bda412fed
2026-03-16 04:57:18.454 ERROR [src.node.docker_mananger] Max retries reached for container b2a7b19ea825. Exiting log stream.
2026-03-16 04:57:18.813 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:57:18.813 DEBUG [src.node.waku_node] Stopping container with id fba8c40138a7
2026-03-16 04:57:19.032 ERROR [src.node.docker_mananger] Max retries reached for container 56bd7ac34a49. Exiting log stream.
2026-03-16 04:57:19.405 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:57:19.406 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-16 04:57:19.629 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:57:19.769 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:57:19.840 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:57:19.899 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:57:19.953 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:57:20.004 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:57:20.050 ERROR [src.node.docker_mananger] Max retries reached for container 903bda412fed. Exiting log stream.
2026-03-16 04:57:20.050 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:57:20.085 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:57:20.117 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:57:20.118 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-16 04:57:20.118 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-16 04:57:20.119 DEBUG [src.libs.common] Attaching file ./log/docker/node4_2026-03-16_04-57-00__7793d91e-5a8d-4b35-9cd2-a5fa761978e0__wakuorg_nwaku:latest.log
2026-03-16 04:57:20.121 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-16_04-57-00__7793d91e-5a8d-4b35-9cd2-a5fa761978e0__wakuorg_nwaku:latest.log
2026-03-16 04:57:20.126 DEBUG [src.libs.common] Attaching file ./log/docker/node8_2026-03-16_04-57-00__7793d91e-5a8d-4b35-9cd2-a5fa761978e0__wakuorg_nwaku:latest.log
2026-03-16 04:57:20.127 DEBUG [src.libs.common] Attaching file ./log/docker/node7_2026-03-16_04-57-00__7793d91e-5a8d-4b35-9cd2-a5fa761978e0__wakuorg_nwaku:latest.log
2026-03-16 04:57:20.128 DEBUG [src.libs.common] Attaching file ./log/docker/node6_2026-03-16_04-57-00__7793d91e-5a8d-4b35-9cd2-a5fa761978e0__wakuorg_nwaku:latest.log
2026-03-16 04:57:20.130 DEBUG [src.libs.common] Attaching file ./log/docker/node10_2026-03-16_04-57-00__7793d91e-5a8d-4b35-9cd2-a5fa761978e0__wakuorg_nwaku:latest.log
2026-03-16 04:57:20.131 DEBUG [src.libs.common] Attaching file ./log/docker/node9_2026-03-16_04-57-00__7793d91e-5a8d-4b35-9cd2-a5fa761978e0__wakuorg_nwaku:latest.log
2026-03-16 04:57:20.132 DEBUG [src.libs.common] Attaching file ./log/docker/node3_2026-03-16_04-57-00__7793d91e-5a8d-4b35-9cd2-a5fa761978e0__wakuorg_nwaku:latest.log
2026-03-16 04:57:20.135 DEBUG [src.libs.common] Attaching file ./log/docker/node5_2026-03-16_04-57-00__7793d91e-5a8d-4b35-9cd2-a5fa761978e0__wakuorg_nwaku:latest.log
2026-03-16 04:57:20.141 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-16 04:57:20.141 DEBUG [tests.conftest] Running test: test_auto_shard_relay_10_nwaku_nodes with id: 2026-03-16_04-57-20__e87f238a-cfe8-4bfc-a9d6-7160a23e1049
2026-03-16 04:57:20.141 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-16 04:57:20.142 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-16 04:57:20.142 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-16 04:57:20.150 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:57:20.150 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-16_04-57-20__e87f238a-cfe8-4bfc-a9d6-7160a23e1049__wakuorg_nwaku:latest.log
2026-03-16 04:57:20.150 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:57:20.150 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:57:20.152 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:57:20.152 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.209.21
2026-03-16 04:57:20.152 DEBUG [src.node.docker_mananger] Generated ports ['15808', '15809', '15810', '15811', '15812']
2026-03-16 04:57:20.152 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:57:20.152 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:57:20.152 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:57:20.152 DEBUG [src.node.docker_mananger] docker run -i -t -p 15808:15808 -p 15809:15809 -p 15810:15810 -p 15811:15811 -p 15812:15812 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=15810 --rest-port=15808 --tcp-port=15809 --discv5-udp-port=15811 --rest-address=0.0.0.0 --nat=extip:172.18.209.21 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=7adf3d0a4b026b04335e77aaedd559a0be244aef6b9d9e6c5a1ff7bb5aac68c3 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=15812 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto
2026-03-16 04:57:20.356 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.209.21 waku d80358c840f99c4e146d4996519a5841da3ca123c973a354304cc5fd2e178299
2026-03-16 04:57:20.394 DEBUG [src.node.docker_mananger] Container started with ID d80358c840f9. Setting up logs at ./log/docker/node1_2026-03-16_04-57-20__e87f238a-cfe8-4bfc-a9d6-7160a23e1049__wakuorg_nwaku:latest.log
2026-03-16 04:57:20.395 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 15808
2026-03-16 04:57:20.395 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:57:20.562 ERROR [src.node.docker_mananger] Max retries reached for container fba8c40138a7. Exiting log stream.
2026-03-16 04:57:21.396 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15808/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:21.398 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:57:21.499 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15808/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:21.501 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:57:21.501 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:57:21.502 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15808/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:21.504 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.209.21/tcp/15809/p2p/16Uiu2HAm5jrNNQ534UPN6D7Hbgc7Unq6PSk4bXJ2YUi7g2smQmmN","/ip4/172.18.209.21/tcp/15810/ws/p2p/16Uiu2HAm5jrNNQ534UPN6D7Hbgc7Unq6PSk4bXJ2YUi7g2smQmmN"],"enrUri":"enr:-L24QBVqNcWIvKNfyeTVjK68ku9dH3trMzKL4p5y8PhVDOeXMyiFVLNLFLsFdVKxhvd_YPl8qhmN81y6sA3eoZTsEsMCgmlkgnY0gmlwhKwS0RWKbXVsdGlhZGRyc5YACASsEtEVBj3BAAoErBLRFQY9wt0DgnJzhQACAQAAiXNlY3AyNTZrMaECmT0SLAE-J-wgE3WKLt9ZUwSB69A2pHIqU6_Sk1PkwZWDdGNwgj3Bg3VkcII9w4V3YWt1MgU"}'
2026-03-16 04:57:21.504 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:57:21.512 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:57:21.513 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-16_04-57-20__e87f238a-cfe8-4bfc-a9d6-7160a23e1049__wakuorg_nwaku:latest.log
2026-03-16 04:57:21.513 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:57:21.513 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:57:21.514 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:57:21.514 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.146.7
2026-03-16 04:57:21.515 DEBUG [src.node.docker_mananger] Generated ports ['51946', '51947', '51948', '51949', '51950']
2026-03-16 04:57:21.515 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:57:21.515 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:57:21.515 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:57:21.515 DEBUG [src.node.docker_mananger] docker run -i -t -p 51946:51946 -p 51947:51947 -p 51948:51948 -p 51949:51949 -p 51950:51950 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=51948 --rest-port=51946 --tcp-port=51947 --discv5-udp-port=51949 --rest-address=0.0.0.0 --nat=extip:172.18.146.7 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=2dcc5acdf01f26c42a25acb9821f76f1faffade7ce13e39ce9f1ebc2b8a21db1 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=51950 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QBVqNcWIvKNfyeTVjK68ku9dH3trMzKL4p5y8PhVDOeXMyiFVLNLFLsFdVKxhvd_YPl8qhmN81y6sA3eoZTsEsMCgmlkgnY0gmlwhKwS0RWKbXVsdGlhZGRyc5YACASsEtEVBj3BAAoErBLRFQY9wt0DgnJzhQACAQAAiXNlY3AyNTZrMaECmT0SLAE-J-wgE3WKLt9ZUwSB69A2pHIqU6_Sk1PkwZWDdGNwgj3Bg3VkcII9w4V3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-16 04:57:21.717 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.146.7 waku 38aff7a213a1c708786bdbd2e0274ea4eacb9b12b50050508c0dbee4b0fdf3e2
2026-03-16 04:57:21.754 DEBUG [src.node.docker_mananger] Container started with ID 38aff7a213a1. Setting up logs at ./log/docker/node3_2026-03-16_04-57-20__e87f238a-cfe8-4bfc-a9d6-7160a23e1049__wakuorg_nwaku:latest.log
2026-03-16 04:57:21.754 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 51946
2026-03-16 04:57:21.754 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:57:22.755 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:51946/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:22.757 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:57:22.758 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:57:22.758 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:51946/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:22.760 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.146.7/tcp/51947/p2p/16Uiu2HAm65W8P395g9sJsMvcfMtbdQJhSemmYXFiFSjSUBJK32Ux","/ip4/172.18.146.7/tcp/51948/ws/p2p/16Uiu2HAm65W8P395g9sJsMvcfMtbdQJhSemmYXFiFSjSUBJK32Ux"],"enrUri":"enr:-L24QJrkMj3VwGRSoNwRlLYhLS1CtCEPXyIfRHTllRxDj9GJDmhLQ1K8U0UGwAHvPrSXMiC5F-jK9nqMXZkjI_HUKPMCgmlkgnY0gmlwhKwSkgeKbXVsdGlhZGRyc5YACASsEpIHBsrrAAoErBKSBwbK7N0DgnJzhQACAQAAiXNlY3AyNTZrMaECnkXM5a-zNPrIub3ayMVexDwAuxTurk-fsz8MKIfifYmDdGNwgsrrg3VkcILK7YV3YWt1MgE"}'
2026-03-16 04:57:22.760 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:57:22.761 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:51946/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.209.21/tcp/15809/p2p/16Uiu2HAm5jrNNQ534UPN6D7Hbgc7Unq6PSk4bXJ2YUi7g2smQmmN"]'
2026-03-16 04:57:22.781 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:22.796 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:57:22.797 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-16_04-57-20__e87f238a-cfe8-4bfc-a9d6-7160a23e1049__wakuorg_nwaku:latest.log
2026-03-16 04:57:22.797 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:57:22.798 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:57:22.803 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:57:22.803 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.76.214
2026-03-16 04:57:22.803 DEBUG [src.node.docker_mananger] Generated ports ['63259', '63260', '63261', '63262', '63263']
2026-03-16 04:57:22.804 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:57:22.804 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:57:22.804 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:57:22.805 DEBUG [src.node.docker_mananger] docker run -i -t -p 63259:63259 -p 63260:63260 -p 63261:63261 -p 63262:63262 -p 63263:63263 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=63261 --rest-port=63259 --tcp-port=63260 --discv5-udp-port=63262 --rest-address=0.0.0.0 --nat=extip:172.18.76.214 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=3c970dceeb84cac224c9c6e6bf4cee9daec5fec2ca68c33e7a201abe14b59e69 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=63263 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QBVqNcWIvKNfyeTVjK68ku9dH3trMzKL4p5y8PhVDOeXMyiFVLNLFLsFdVKxhvd_YPl8qhmN81y6sA3eoZTsEsMCgmlkgnY0gmlwhKwS0RWKbXVsdGlhZGRyc5YACASsEtEVBj3BAAoErBLRFQY9wt0DgnJzhQACAQAAiXNlY3AyNTZrMaECmT0SLAE-J-wgE3WKLt9ZUwSB69A2pHIqU6_Sk1PkwZWDdGNwgj3Bg3VkcII9w4V3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-16 04:57:23.011 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.76.214 waku 951a4144c8c732f20d01677b78764e49aa2defe72347421138a36fe8cd5197cb
2026-03-16 04:57:23.047 DEBUG [src.node.docker_mananger] Container started with ID 951a4144c8c7. Setting up logs at ./log/docker/node4_2026-03-16_04-57-20__e87f238a-cfe8-4bfc-a9d6-7160a23e1049__wakuorg_nwaku:latest.log
2026-03-16 04:57:23.047 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 63259
2026-03-16 04:57:23.047 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:57:24.048 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63259/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:24.051 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:57:24.051 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:57:24.051 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63259/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:24.054 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.76.214/tcp/63260/p2p/16Uiu2HAm2KbCgCCkg2bM3hhSsMz7pKpEtVdvVWnSeJjnNk32SP4f","/ip4/172.18.76.214/tcp/63261/ws/p2p/16Uiu2HAm2KbCgCCkg2bM3hhSsMz7pKpEtVdvVWnSeJjnNk32SP4f"],"enrUri":"enr:-L24QGxoGijEj32MZqNnoDdzmC_DHsI7T5IwydDp07Qu97sBfpj2xmSBnAcbFGTv-aaFslATXqo3D7e6xWQ5aR_3xEMCgmlkgnY0gmlwhKwSTNaKbXVsdGlhZGRyc5YACASsEkzWBvccAAoErBJM1gb3Hd0DgnJzhQACAQAAiXNlY3AyNTZrMaECZnLr2A5QkSXC-RPMZADbXW5dQn0CUMtLP7hcVlh3_mSDdGNwgvccg3VkcIL3HoV3YWt1MgE"}'
2026-03-16 04:57:24.054 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:57:24.054 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63259/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.209.21/tcp/15809/p2p/16Uiu2HAm5jrNNQ534UPN6D7Hbgc7Unq6PSk4bXJ2YUi7g2smQmmN"]'
2026-03-16 04:57:24.078 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:24.092 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:57:24.093 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-03-16_04-57-20__e87f238a-cfe8-4bfc-a9d6-7160a23e1049__wakuorg_nwaku:latest.log
2026-03-16 04:57:24.093 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:57:24.093 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:57:24.095 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:57:24.096 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.201.163
2026-03-16 04:57:24.096 DEBUG [src.node.docker_mananger] Generated ports ['34356', '34357', '34358', '34359', '34360']
2026-03-16 04:57:24.096 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:57:24.096 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:57:24.096 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:57:24.097 DEBUG [src.node.docker_mananger] docker run -i -t -p 34356:34356 -p 34357:34357 -p 34358:34358 -p 34359:34359 -p 34360:34360 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=34358 --rest-port=34356 --tcp-port=34357 --discv5-udp-port=34359 --rest-address=0.0.0.0 --nat=extip:172.18.201.163 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=fd94cfcfb57dadbbf6b4c986b0bea7acfec5ffd8cca4ad35ff373c6a2efbc60e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=34360 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QBVqNcWIvKNfyeTVjK68ku9dH3trMzKL4p5y8PhVDOeXMyiFVLNLFLsFdVKxhvd_YPl8qhmN81y6sA3eoZTsEsMCgmlkgnY0gmlwhKwS0RWKbXVsdGlhZGRyc5YACASsEtEVBj3BAAoErBLRFQY9wt0DgnJzhQACAQAAiXNlY3AyNTZrMaECmT0SLAE-J-wgE3WKLt9ZUwSB69A2pHIqU6_Sk1PkwZWDdGNwgj3Bg3VkcII9w4V3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-16 04:57:24.302 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.201.163 waku 1f18a2082bc6bf6d6bdd956015f43a6c07c15a1e282b50273575f50d68182d79
2026-03-16 04:57:24.338 DEBUG [src.node.docker_mananger] Container started with ID 1f18a2082bc6. Setting up logs at ./log/docker/node5_2026-03-16_04-57-20__e87f238a-cfe8-4bfc-a9d6-7160a23e1049__wakuorg_nwaku:latest.log
2026-03-16 04:57:24.338 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 34356
2026-03-16 04:57:24.338 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:57:25.340 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34356/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:25.343 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:57:25.443 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34356/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:25.446 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:57:25.546 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34356/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:25.550 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:57:25.550 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:57:25.551 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34356/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:25.553 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.201.163/tcp/34357/p2p/16Uiu2HAmUvuAMgNTGNivYZQg6FuiBiWVLWXSRivjKqLzfs89e3Bd","/ip4/172.18.201.163/tcp/34358/ws/p2p/16Uiu2HAmUvuAMgNTGNivYZQg6FuiBiWVLWXSRivjKqLzfs89e3Bd"],"enrUri":"enr:-L24QCSKNXgA_k0nRJUiwvnmqPpjCWCFcOdMN6OsQpIUn6zoBGhoK8ycpMIb8vRjPcyZv4PvDuguWEPyCbpIdSHR2xoCgmlkgnY0gmlwhKwSyaOKbXVsdGlhZGRyc5YACASsEsmjBoY1AAoErBLJowaGNt0DgnJzhQACAQAAiXNlY3AyNTZrMaED8c5qyGaVC2oms5PGLDSSFnHJUab2xQRuP3-TRaj5YtiDdGNwgoY1g3VkcIKGN4V3YWt1MgE"}'
2026-03-16 04:57:25.553 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:57:25.553 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34356/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.209.21/tcp/15809/p2p/16Uiu2HAm5jrNNQ534UPN6D7Hbgc7Unq6PSk4bXJ2YUi7g2smQmmN"]'
2026-03-16 04:57:25.572 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:25.586 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:57:25.589 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node6_2026-03-16_04-57-20__e87f238a-cfe8-4bfc-a9d6-7160a23e1049__wakuorg_nwaku:latest.log
2026-03-16 04:57:25.589 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:57:25.590 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:57:25.592 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:57:25.592 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.1.176
2026-03-16 04:57:25.592 DEBUG [src.node.docker_mananger] Generated ports ['13299', '13300', '13301', '13302', '13303']
2026-03-16 04:57:25.593 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:57:25.595 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:57:25.595 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:57:25.595 DEBUG [src.node.docker_mananger] docker run -i -t -p 13299:13299 -p 13300:13300 -p 13301:13301 -p 13302:13302 -p 13303:13303 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=13301 --rest-port=13299 --tcp-port=13300 --discv5-udp-port=13302 --rest-address=0.0.0.0 --nat=extip:172.18.1.176 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=1bb70cad19a1ff3b8f20ead0e45eed801debb9fcbabf6e1253db5e70d05d55cd --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=13303 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QBVqNcWIvKNfyeTVjK68ku9dH3trMzKL4p5y8PhVDOeXMyiFVLNLFLsFdVKxhvd_YPl8qhmN81y6sA3eoZTsEsMCgmlkgnY0gmlwhKwS0RWKbXVsdGlhZGRyc5YACASsEtEVBj3BAAoErBLRFQY9wt0DgnJzhQACAQAAiXNlY3AyNTZrMaECmT0SLAE-J-wgE3WKLt9ZUwSB69A2pHIqU6_Sk1PkwZWDdGNwgj3Bg3VkcII9w4V3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-16 04:57:25.814 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.1.176 waku bf9d1f5baf8547006f0621ed4fac64b6942944c76ad78abdb21b9cc695685298
2026-03-16 04:57:25.851 DEBUG [src.node.docker_mananger] Container started with ID bf9d1f5baf85. Setting up logs at ./log/docker/node6_2026-03-16_04-57-20__e87f238a-cfe8-4bfc-a9d6-7160a23e1049__wakuorg_nwaku:latest.log
2026-03-16 04:57:25.851 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 13299
2026-03-16 04:57:25.851 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:57:26.853 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13299/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:26.855 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:57:26.956 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13299/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:26.958 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:57:26.959 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:57:26.959 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13299/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:26.961 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.1.176/tcp/13300/p2p/16Uiu2HAmNu4sSPUUckgSKvMsduFXhq5Ys6obUm7Be92iPjowLrKY","/ip4/172.18.1.176/tcp/13301/ws/p2p/16Uiu2HAmNu4sSPUUckgSKvMsduFXhq5Ys6obUm7Be92iPjowLrKY"],"enrUri":"enr:-L24QGTfBibPLSgkGByYafQ74jzUay4JfgBJJoRi_JL2qaf7Sx8LscGCu-_y1U9-mamvuk0_QVgQ7HhAcuYtVD8jc2QCgmlkgnY0gmlwhKwSAbCKbXVsdGlhZGRyc5YACASsEgGwBjP0AAoErBIBsAYz9d0DgnJzhQACAQAAiXNlY3AyNTZrMaEDmDAcdE6ojM_uCq6De4NjDBWxtHOjm_WCoIIkC36fNa-DdGNwgjP0g3VkcIIz9oV3YWt1MgE"}'
2026-03-16 04:57:26.961 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:57:26.962 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13299/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.209.21/tcp/15809/p2p/16Uiu2HAm5jrNNQ534UPN6D7Hbgc7Unq6PSk4bXJ2YUi7g2smQmmN"]'
2026-03-16 04:57:27.014 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:27.031 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:57:27.032 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node7_2026-03-16_04-57-20__e87f238a-cfe8-4bfc-a9d6-7160a23e1049__wakuorg_nwaku:latest.log
2026-03-16 04:57:27.032 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:57:27.033 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:57:27.035 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:57:27.035 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.205.229
2026-03-16 04:57:27.035 DEBUG [src.node.docker_mananger] Generated ports ['37909', '37910', '37911', '37912', '37913']
2026-03-16 04:57:27.035 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:57:27.036 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:57:27.036 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:57:27.036 DEBUG [src.node.docker_mananger] docker run -i -t -p 37909:37909 -p 37910:37910 -p 37911:37911 -p 37912:37912 -p 37913:37913 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=37911 --rest-port=37909 --tcp-port=37910 --discv5-udp-port=37912 --rest-address=0.0.0.0 --nat=extip:172.18.205.229 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=61d1109ad40e45740947d2ae7d1058288720eb9e1928a8cc4d5327bfdbebcc75 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=37913 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QBVqNcWIvKNfyeTVjK68ku9dH3trMzKL4p5y8PhVDOeXMyiFVLNLFLsFdVKxhvd_YPl8qhmN81y6sA3eoZTsEsMCgmlkgnY0gmlwhKwS0RWKbXVsdGlhZGRyc5YACASsEtEVBj3BAAoErBLRFQY9wt0DgnJzhQACAQAAiXNlY3AyNTZrMaECmT0SLAE-J-wgE3WKLt9ZUwSB69A2pHIqU6_Sk1PkwZWDdGNwgj3Bg3VkcII9w4V3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-16 04:57:27.252 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.205.229 waku 9fdf521dc3c437c843b69e1dddcea2c10684307d43c110a94ef1ee25708ccb60
2026-03-16 04:57:27.287 DEBUG [src.node.docker_mananger] Container started with ID 9fdf521dc3c4. Setting up logs at ./log/docker/node7_2026-03-16_04-57-20__e87f238a-cfe8-4bfc-a9d6-7160a23e1049__wakuorg_nwaku:latest.log
2026-03-16 04:57:27.287 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 37909
2026-03-16 04:57:27.287 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:57:28.288 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37909/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:28.291 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:57:28.391 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37909/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:28.394 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:57:28.494 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37909/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:28.499 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:57:28.500 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:57:28.500 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37909/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:28.506 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.205.229/tcp/37910/p2p/16Uiu2HAmEnwdJcjozqio8ieTbSYS3RZBLGwVyZU6DESETh5Lhjn4","/ip4/172.18.205.229/tcp/37911/ws/p2p/16Uiu2HAmEnwdJcjozqio8ieTbSYS3RZBLGwVyZU6DESETh5Lhjn4"],"enrUri":"enr:-L24QBgfU29wZLHy4pxrLai7DoEXUu_cyjd3b3Le6hqZcO1tCASVjR824SmzA0SoLSQszx18MgYIF-7q-WYkTPGs4h4CgmlkgnY0gmlwhKwSzeWKbXVsdGlhZGRyc5YACASsEs3lBpQWAAoErBLN5QaUF90DgnJzhQACAQAAiXNlY3AyNTZrMaEDH8Dwv0cfdzJRYgAzDr0-NIxVA3yHGrd-3mASdXskvQ2DdGNwgpQWg3VkcIKUGIV3YWt1MgE"}'
2026-03-16 04:57:28.506 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:57:28.507 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37909/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.209.21/tcp/15809/p2p/16Uiu2HAm5jrNNQ534UPN6D7Hbgc7Unq6PSk4bXJ2YUi7g2smQmmN"]'
2026-03-16 04:57:28.531 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:28.546 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:57:28.546 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node8_2026-03-16_04-57-20__e87f238a-cfe8-4bfc-a9d6-7160a23e1049__wakuorg_nwaku:latest.log
2026-03-16 04:57:28.547 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:57:28.547 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:57:28.554 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:57:28.554 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.45.15
2026-03-16 04:57:28.555 DEBUG [src.node.docker_mananger] Generated ports ['58224', '58225', '58226', '58227', '58228']
2026-03-16 04:57:28.557 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:57:28.557 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:57:28.557 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:57:28.558 DEBUG [src.node.docker_mananger] docker run -i -t -p 58224:58224 -p 58225:58225 -p 58226:58226 -p 58227:58227 -p 58228:58228 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=58226 --rest-port=58224 --tcp-port=58225 --discv5-udp-port=58227 --rest-address=0.0.0.0 --nat=extip:172.18.45.15 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=bbeead536b4ec8ee91a1a214f8e6df90e1e7ce4e1cfaa32e6dd4dbfdd8facc94 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=58228 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QBVqNcWIvKNfyeTVjK68ku9dH3trMzKL4p5y8PhVDOeXMyiFVLNLFLsFdVKxhvd_YPl8qhmN81y6sA3eoZTsEsMCgmlkgnY0gmlwhKwS0RWKbXVsdGlhZGRyc5YACASsEtEVBj3BAAoErBLRFQY9wt0DgnJzhQACAQAAiXNlY3AyNTZrMaECmT0SLAE-J-wgE3WKLt9ZUwSB69A2pHIqU6_Sk1PkwZWDdGNwgj3Bg3VkcII9w4V3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-16 04:57:28.801 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.45.15 waku e8fdbe49d1c35a7e7a955aed888a1a9b5904e7d348f27d1f84f2cdf0c7c95add
2026-03-16 04:57:28.838 DEBUG [src.node.docker_mananger] Container started with ID e8fdbe49d1c3. Setting up logs at ./log/docker/node8_2026-03-16_04-57-20__e87f238a-cfe8-4bfc-a9d6-7160a23e1049__wakuorg_nwaku:latest.log
2026-03-16 04:57:28.838 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 58224
2026-03-16 04:57:28.838 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:57:29.840 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58224/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:29.857 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:57:29.859 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:57:29.861 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58224/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:29.866 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.45.15/tcp/58225/p2p/16Uiu2HAmSMfibL8qL7fw7Yj1eMEDimtzx4FyEtdhxTfUfs9fh5iq","/ip4/172.18.45.15/tcp/58226/ws/p2p/16Uiu2HAmSMfibL8qL7fw7Yj1eMEDimtzx4FyEtdhxTfUfs9fh5iq"],"enrUri":"enr:-L24QDKu3DPCiohANR0P1vStFWEpvO-0LqyP9a6sr4Qsdr4OS1MFT5oZtllIYorwnqnFBWGjMm6aWSKfFq1ozJ7yskUCgmlkgnY0gmlwhKwSLQ-KbXVsdGlhZGRyc5YACASsEi0PBuNxAAoErBItDwbjct0DgnJzhQACAQAAiXNlY3AyNTZrMaEDy5Os1iUnq2YHNO7xZ-ArxbTBv_nmg6Dc5gQSg3gFECqDdGNwguNxg3VkcILjc4V3YWt1MgE"}'
2026-03-16 04:57:29.866 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:57:29.869 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:58224/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.209.21/tcp/15809/p2p/16Uiu2HAm5jrNNQ534UPN6D7Hbgc7Unq6PSk4bXJ2YUi7g2smQmmN"]'
2026-03-16 04:57:29.895 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:29.912 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:57:29.914 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node9_2026-03-16_04-57-20__e87f238a-cfe8-4bfc-a9d6-7160a23e1049__wakuorg_nwaku:latest.log
2026-03-16 04:57:29.916 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:57:29.917 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:57:29.923 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:57:29.924 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.211.133
2026-03-16 04:57:29.924 DEBUG [src.node.docker_mananger] Generated ports ['57686', '57687', '57688', '57689', '57690']
2026-03-16 04:57:29.927 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:57:29.927 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:57:29.930 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:57:29.933 DEBUG [src.node.docker_mananger] docker run -i -t -p 57686:57686 -p 57687:57687 -p 57688:57688 -p 57689:57689 -p 57690:57690 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=57688 --rest-port=57686 --tcp-port=57687 --discv5-udp-port=57689 --rest-address=0.0.0.0 --nat=extip:172.18.211.133 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=f57d48589b4ee93adfcbbb4c3cae9e3b66df9fda520ce6c3dbf7dbac8ece2c7f --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=57690 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QBVqNcWIvKNfyeTVjK68ku9dH3trMzKL4p5y8PhVDOeXMyiFVLNLFLsFdVKxhvd_YPl8qhmN81y6sA3eoZTsEsMCgmlkgnY0gmlwhKwS0RWKbXVsdGlhZGRyc5YACASsEtEVBj3BAAoErBLRFQY9wt0DgnJzhQACAQAAiXNlY3AyNTZrMaECmT0SLAE-J-wgE3WKLt9ZUwSB69A2pHIqU6_Sk1PkwZWDdGNwgj3Bg3VkcII9w4V3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-16 04:57:30.166 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.211.133 waku 5b6ae457396691b4722eeec28c27a37732c4beb602fada27d31e2e3136788ffd
2026-03-16 04:57:30.206 DEBUG [src.node.docker_mananger] Container started with ID 5b6ae4573966. Setting up logs at ./log/docker/node9_2026-03-16_04-57-20__e87f238a-cfe8-4bfc-a9d6-7160a23e1049__wakuorg_nwaku:latest.log
2026-03-16 04:57:30.207 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 57686
2026-03-16 04:57:30.207 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:57:31.207 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57686/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:31.210 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:57:31.310 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57686/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:31.313 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:57:31.414 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57686/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:31.417 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:57:31.417 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:57:31.417 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57686/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:31.420 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.211.133/tcp/57687/p2p/16Uiu2HAmDgdxwcWBskZG4DstqLDRGAE4P5TG9PcGqLjUbeFUvYNC","/ip4/172.18.211.133/tcp/57688/ws/p2p/16Uiu2HAmDgdxwcWBskZG4DstqLDRGAE4P5TG9PcGqLjUbeFUvYNC"],"enrUri":"enr:-L24QJ97Y1R5jZMdXJUJ4ct4_AzCfXhJZLBFTbpqWRmrN2-ZSNiyIg_icBWphag82I_kvM_J3rzj-MfnFDVhjD9dlAMCgmlkgnY0gmlwhKwS04WKbXVsdGlhZGRyc5YACASsEtOFBuFXAAoErBLThQbhWN0DgnJzhQACAQAAiXNlY3AyNTZrMaEDD0fMft9U5uRW98QT6kkOuKZ1s854o3UCJB6vdIK3vSGDdGNwguFXg3VkcILhWYV3YWt1MgE"}'
2026-03-16 04:57:31.420 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:57:31.420 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57686/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.209.21/tcp/15809/p2p/16Uiu2HAm5jrNNQ534UPN6D7Hbgc7Unq6PSk4bXJ2YUi7g2smQmmN"]'
2026-03-16 04:57:31.453 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:31.498 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:57:31.501 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node10_2026-03-16_04-57-20__e87f238a-cfe8-4bfc-a9d6-7160a23e1049__wakuorg_nwaku:latest.log
2026-03-16 04:57:31.501 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:57:31.503 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:57:31.509 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:57:31.511 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.82.25
2026-03-16 04:57:31.512 DEBUG [src.node.docker_mananger] Generated ports ['39096', '39097', '39098', '39099', '39100']
2026-03-16 04:57:31.512 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:57:31.512 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:57:31.512 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:57:31.513 DEBUG [src.node.docker_mananger] docker run -i -t -p 39096:39096 -p 39097:39097 -p 39098:39098 -p 39099:39099 -p 39100:39100 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=39098 --rest-port=39096 --tcp-port=39097 --discv5-udp-port=39099 --rest-address=0.0.0.0 --nat=extip:172.18.82.25 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=50b03fa05598f6fbb81890efea27a48fd51cd50da5c640f89fa4e002dfd60ae6 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=39100 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QBVqNcWIvKNfyeTVjK68ku9dH3trMzKL4p5y8PhVDOeXMyiFVLNLFLsFdVKxhvd_YPl8qhmN81y6sA3eoZTsEsMCgmlkgnY0gmlwhKwS0RWKbXVsdGlhZGRyc5YACASsEtEVBj3BAAoErBLRFQY9wt0DgnJzhQACAQAAiXNlY3AyNTZrMaECmT0SLAE-J-wgE3WKLt9ZUwSB69A2pHIqU6_Sk1PkwZWDdGNwgj3Bg3VkcII9w4V3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-16 04:57:31.786 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.82.25 waku 9e959f263d6819a2bf57ac7b8e073bcd7c439f07fcf060bf2c60fd94896fdbc5
2026-03-16 04:57:31.831 DEBUG [src.node.docker_mananger] Container started with ID 9e959f263d68. Setting up logs at ./log/docker/node10_2026-03-16_04-57-20__e87f238a-cfe8-4bfc-a9d6-7160a23e1049__wakuorg_nwaku:latest.log
2026-03-16 04:57:31.831 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 39096
2026-03-16 04:57:31.831 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:57:32.836 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:39096/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:32.858 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:57:32.961 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:39096/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:32.964 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:57:32.964 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:57:32.964 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:39096/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:32.967 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.82.25/tcp/39097/p2p/16Uiu2HAmLt54c2fHgeZBPY1R81S2v2Qf4gnhHzQ3adE7WN9mA733","/ip4/172.18.82.25/tcp/39098/ws/p2p/16Uiu2HAmLt54c2fHgeZBPY1R81S2v2Qf4gnhHzQ3adE7WN9mA733"],"enrUri":"enr:-L24QKeIBJDZfBxREa3mh9_EDSCTe-pvZ02zdB1_xsNSoTogY9Iv34yGo60zEolC_cNYi0XgdEWlEQcD4R5-X0OpcDwCgmlkgnY0gmlwhKwSUhmKbXVsdGlhZGRyc5YACASsElIZBpi5AAoErBJSGQaYut0DgnJzhQACAQAAiXNlY3AyNTZrMaEDejdfycFAAaRCf0aOvXJFec91OKB_EGr1ELMSvSc16jaDdGNwgpi5g3VkcIKYu4V3YWt1MgE"}'
2026-03-16 04:57:32.967 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:57:32.967 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39096/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.209.21/tcp/15809/p2p/16Uiu2HAm5jrNNQ534UPN6D7Hbgc7Unq6PSk4bXJ2YUi7g2smQmmN"]'
2026-03-16 04:57:33.000 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:33.001 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:15808/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:57:33.007 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:33.009 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:51946/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:57:33.016 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:33.017 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63259/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:57:33.035 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:33.037 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34356/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:57:33.046 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:33.046 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13299/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:57:33.051 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:33.052 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37909/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:57:33.057 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:33.058 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:58224/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:57:33.062 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:33.062 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57686/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:57:33.065 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:33.065 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39096/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:57:33.068 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:33.068 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:15808/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:57:33.086 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:33.087 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 04:57:33.187 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-16 04:57:33.189 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15808/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:33.203 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773637039552509711,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773637043590474351,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773637047762528024,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773637051847360109,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773637053068541609,"ephemeral":false,"proof":""}]'
2026-03-16 04:57:33.229 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-16 04:57:33.231 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-16 04:57:33.232 DEBUG [src.node.waku_node] Stopping container with id d80358c840f9
2026-03-16 04:57:33.917 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:57:33.918 DEBUG [src.node.waku_node] Stopping container with id 38aff7a213a1
2026-03-16 04:57:34.544 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:57:34.544 DEBUG [src.node.waku_node] Stopping container with id 951a4144c8c7
2026-03-16 04:57:34.742 ERROR [src.node.docker_mananger] Max retries reached for container d80358c840f9. Exiting log stream.
2026-03-16 04:57:35.189 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:57:35.191 DEBUG [src.node.waku_node] Stopping container with id 1f18a2082bc6
2026-03-16 04:57:35.604 ERROR [src.node.docker_mananger] Max retries reached for container 38aff7a213a1. Exiting log stream.
2026-03-16 04:57:35.807 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:57:35.808 DEBUG [src.node.waku_node] Stopping container with id bf9d1f5baf85
2026-03-16 04:57:36.011 ERROR [src.node.docker_mananger] Max retries reached for container 951a4144c8c7. Exiting log stream.
2026-03-16 04:57:36.863 ERROR [src.node.docker_mananger] Max retries reached for container 1f18a2082bc6. Exiting log stream.
2026-03-16 04:57:46.416 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:57:46.418 DEBUG [src.node.waku_node] Stopping container with id 9fdf521dc3c4
2026-03-16 04:57:46.999 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:57:47.001 DEBUG [src.node.waku_node] Stopping container with id e8fdbe49d1c3
2026-03-16 04:57:47.236 ERROR [src.node.docker_mananger] Max retries reached for container bf9d1f5baf85. Exiting log stream.
2026-03-16 04:57:47.575 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:57:47.577 DEBUG [src.node.waku_node] Stopping container with id 5b6ae4573966
2026-03-16 04:57:48.067 ERROR [src.node.docker_mananger] Max retries reached for container 9fdf521dc3c4. Exiting log stream.
2026-03-16 04:57:48.159 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:57:48.161 DEBUG [src.node.waku_node] Stopping container with id 9e959f263d68
2026-03-16 04:57:48.392 ERROR [src.node.docker_mananger] Max retries reached for container e8fdbe49d1c3. Exiting log stream.
2026-03-16 04:57:48.780 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:57:48.782 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-16 04:57:48.881 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:57:48.998 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:57:49.057 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:57:49.152 ERROR [src.node.docker_mananger] Max retries reached for container 5b6ae4573966. Exiting log stream.
2026-03-16 04:57:49.178 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:57:49.244 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:57:49.367 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:57:49.423 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:57:49.475 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:57:49.516 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:57:49.517 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-16 04:57:49.518 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-16 04:57:49.518 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-16_04-57-20__e87f238a-cfe8-4bfc-a9d6-7160a23e1049__wakuorg_nwaku:latest.log
2026-03-16 04:57:49.521 DEBUG [src.libs.common] Attaching file ./log/docker/node4_2026-03-16_04-57-20__e87f238a-cfe8-4bfc-a9d6-7160a23e1049__wakuorg_nwaku:latest.log
2026-03-16 04:57:49.523 DEBUG [src.libs.common] Attaching file ./log/docker/node7_2026-03-16_04-57-20__e87f238a-cfe8-4bfc-a9d6-7160a23e1049__wakuorg_nwaku:latest.log
2026-03-16 04:57:49.526 DEBUG [src.libs.common] Attaching file ./log/docker/node8_2026-03-16_04-57-20__e87f238a-cfe8-4bfc-a9d6-7160a23e1049__wakuorg_nwaku:latest.log
2026-03-16 04:57:49.527 DEBUG [src.libs.common] Attaching file ./log/docker/node10_2026-03-16_04-57-20__e87f238a-cfe8-4bfc-a9d6-7160a23e1049__wakuorg_nwaku:latest.log
2026-03-16 04:57:49.529 DEBUG [src.libs.common] Attaching file ./log/docker/node9_2026-03-16_04-57-20__e87f238a-cfe8-4bfc-a9d6-7160a23e1049__wakuorg_nwaku:latest.log
2026-03-16 04:57:49.530 DEBUG [src.libs.common] Attaching file ./log/docker/node5_2026-03-16_04-57-20__e87f238a-cfe8-4bfc-a9d6-7160a23e1049__wakuorg_nwaku:latest.log
2026-03-16 04:57:49.533 DEBUG [src.libs.common] Attaching file ./log/docker/node3_2026-03-16_04-57-20__e87f238a-cfe8-4bfc-a9d6-7160a23e1049__wakuorg_nwaku:latest.log
2026-03-16 04:57:49.536 DEBUG [src.libs.common] Attaching file ./log/docker/node6_2026-03-16_04-57-20__e87f238a-cfe8-4bfc-a9d6-7160a23e1049__wakuorg_nwaku:latest.log
2026-03-16 04:57:49.541 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-16 04:57:49.542 DEBUG [tests.conftest] Running test: test_auto_shard_relay_10_nwaku_nodes with id: 2026-03-16_04-57-49__f3fab322-5193-41d1-bd8b-9939f4906b07
2026-03-16 04:57:49.542 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-16 04:57:49.542 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-16 04:57:49.543 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-16 04:57:49.552 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:57:49.552 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-16_04-57-49__f3fab322-5193-41d1-bd8b-9939f4906b07__wakuorg_nwaku:latest.log
2026-03-16 04:57:49.552 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:57:49.552 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:57:49.554 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:57:49.554 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.122.119
2026-03-16 04:57:49.554 DEBUG [src.node.docker_mananger] Generated ports ['5753', '5754', '5755', '5756', '5757']
2026-03-16 04:57:49.554 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:57:49.554 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:57:49.554 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:57:49.555 DEBUG [src.node.docker_mananger] docker run -i -t -p 5753:5753 -p 5754:5754 -p 5755:5755 -p 5756:5756 -p 5757:5757 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=5755 --rest-port=5753 --tcp-port=5754 --discv5-udp-port=5756 --rest-address=0.0.0.0 --nat=extip:172.18.122.119 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=866a97d5ed7cb598014c6d1a6ead75ffa28c27598de4acfd6ae444caa54bd134 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=5757 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto
2026-03-16 04:57:49.759 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.122.119 waku d9e4eae2bfb5ebbb6fb5079879988d44b75b5f785ead6f37681ce4b4ccfb0a20
2026-03-16 04:57:49.798 DEBUG [src.node.docker_mananger] Container started with ID d9e4eae2bfb5. Setting up logs at ./log/docker/node1_2026-03-16_04-57-49__f3fab322-5193-41d1-bd8b-9939f4906b07__wakuorg_nwaku:latest.log
2026-03-16 04:57:49.799 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 5753
2026-03-16 04:57:49.799 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:57:49.925 ERROR [src.node.docker_mananger] Max retries reached for container 9e959f263d68. Exiting log stream.
2026-03-16 04:57:50.799 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:5753/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:50.802 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:57:50.802 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:57:50.802 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:5753/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:50.805 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.122.119/tcp/5754/p2p/16Uiu2HAm3p2Vx46425yrdnikSHzhrU883Bg6mMiCxTtZhqb5rKbP","/ip4/172.18.122.119/tcp/5755/ws/p2p/16Uiu2HAm3p2Vx46425yrdnikSHzhrU883Bg6mMiCxTtZhqb5rKbP"],"enrUri":"enr:-L24QFs44nEnldVi_Qa5nJSyDyUJ3Pu_zHOyPU6h3EIyM0dAE4-WaX-Iqm4627Hy2YDuTJ8LP7KBx_wpcfkhQMIFkDECgmlkgnY0gmlwhKwSeneKbXVsdGlhZGRyc5YACASsEnp3BhZ6AAoErBJ6dwYWe90DgnJzhQACAQAAiXNlY3AyNTZrMaECfJd5pWaopfRPEPFUH7a_xnqm8k6dDHBaT7P4Odlrd3qDdGNwghZ6g3VkcIIWfIV3YWt1MgU"}'
2026-03-16 04:57:50.805 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:57:50.812 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:57:50.812 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-16_04-57-49__f3fab322-5193-41d1-bd8b-9939f4906b07__wakuorg_nwaku:latest.log
2026-03-16 04:57:50.812 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:57:50.813 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:57:50.814 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:57:50.814 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.67.56
2026-03-16 04:57:50.814 DEBUG [src.node.docker_mananger] Generated ports ['27009', '27010', '27011', '27012', '27013']
2026-03-16 04:57:50.814 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:57:50.815 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:57:50.815 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:57:50.815 DEBUG [src.node.docker_mananger] docker run -i -t -p 27009:27009 -p 27010:27010 -p 27011:27011 -p 27012:27012 -p 27013:27013 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=27011 --rest-port=27009 --tcp-port=27010 --discv5-udp-port=27012 --rest-address=0.0.0.0 --nat=extip:172.18.67.56 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=cebefbab8a20bb399bcfaddd4d9ff561eaabddcf3ebcc1fcd54dcb88a458adff --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=27013 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QFs44nEnldVi_Qa5nJSyDyUJ3Pu_zHOyPU6h3EIyM0dAE4-WaX-Iqm4627Hy2YDuTJ8LP7KBx_wpcfkhQMIFkDECgmlkgnY0gmlwhKwSeneKbXVsdGlhZGRyc5YACASsEnp3BhZ6AAoErBJ6dwYWe90DgnJzhQACAQAAiXNlY3AyNTZrMaECfJd5pWaopfRPEPFUH7a_xnqm8k6dDHBaT7P4Odlrd3qDdGNwghZ6g3VkcIIWfIV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-16 04:57:51.015 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.67.56 waku 4b35c034c4213f5e2aefc68ce96ee3b4c17cc69d2d703d9f454076e92f0d4842
2026-03-16 04:57:51.053 DEBUG [src.node.docker_mananger] Container started with ID 4b35c034c421. Setting up logs at ./log/docker/node3_2026-03-16_04-57-49__f3fab322-5193-41d1-bd8b-9939f4906b07__wakuorg_nwaku:latest.log
2026-03-16 04:57:51.054 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 27009
2026-03-16 04:57:51.054 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:57:52.055 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:27009/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:52.067 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:57:52.168 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:27009/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:52.172 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:57:52.172 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:57:52.173 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:27009/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:52.176 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.67.56/tcp/27010/p2p/16Uiu2HAm6aanvuGpTvToyg3mdj7YFJZY8v6mKHEUA7VBsFiTgwER","/ip4/172.18.67.56/tcp/27011/ws/p2p/16Uiu2HAm6aanvuGpTvToyg3mdj7YFJZY8v6mKHEUA7VBsFiTgwER"],"enrUri":"enr:-L24QBDPF5DImtaYDLMl_3AYOLQjL3C5dTw_iPzQoPwyc9RZV56HnfdvPyYSswtvIrrNyy5TPqKuiPIoi5KJlYtu-MsCgmlkgnY0gmlwhKwSQziKbXVsdGlhZGRyc5YACASsEkM4BmmCAAoErBJDOAZpg90DgnJzhQACAQAAiXNlY3AyNTZrMaECpbjrDWithcOP1DaFgb91T-uQz0DDNCY1wRAkMeXgJXqDdGNwgmmCg3VkcIJphIV3YWt1MgE"}'
2026-03-16 04:57:52.176 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:57:52.177 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27009/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.122.119/tcp/5754/p2p/16Uiu2HAm3p2Vx46425yrdnikSHzhrU883Bg6mMiCxTtZhqb5rKbP"]'
2026-03-16 04:57:52.210 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:52.220 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:57:52.220 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-16_04-57-49__f3fab322-5193-41d1-bd8b-9939f4906b07__wakuorg_nwaku:latest.log
2026-03-16 04:57:52.221 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:57:52.221 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:57:52.223 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:57:52.223 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.86.223
2026-03-16 04:57:52.224 DEBUG [src.node.docker_mananger] Generated ports ['45362', '45363', '45364', '45365', '45366']
2026-03-16 04:57:52.224 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:57:52.224 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:57:52.224 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:57:52.224 DEBUG [src.node.docker_mananger] docker run -i -t -p 45362:45362 -p 45363:45363 -p 45364:45364 -p 45365:45365 -p 45366:45366 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=45364 --rest-port=45362 --tcp-port=45363 --discv5-udp-port=45365 --rest-address=0.0.0.0 --nat=extip:172.18.86.223 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=f31e3d0ca4acbe6847a2dfb1aa0f25a1c0aaf5c7bababbc14aa9fffab692e4c8 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=45366 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QFs44nEnldVi_Qa5nJSyDyUJ3Pu_zHOyPU6h3EIyM0dAE4-WaX-Iqm4627Hy2YDuTJ8LP7KBx_wpcfkhQMIFkDECgmlkgnY0gmlwhKwSeneKbXVsdGlhZGRyc5YACASsEnp3BhZ6AAoErBJ6dwYWe90DgnJzhQACAQAAiXNlY3AyNTZrMaECfJd5pWaopfRPEPFUH7a_xnqm8k6dDHBaT7P4Odlrd3qDdGNwghZ6g3VkcIIWfIV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-16 04:57:52.420 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.86.223 waku af89c844557cc2e0b9e042ecffc587a804a3dd2b4882e27fd2f37a238f79ceb3
2026-03-16 04:57:52.455 DEBUG [src.node.docker_mananger] Container started with ID af89c844557c. Setting up logs at ./log/docker/node4_2026-03-16_04-57-49__f3fab322-5193-41d1-bd8b-9939f4906b07__wakuorg_nwaku:latest.log
2026-03-16 04:57:52.455 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 45362
2026-03-16 04:57:52.456 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:57:53.457 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45362/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:53.466 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:57:53.567 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45362/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:53.569 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:57:53.569 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:57:53.569 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45362/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:53.572 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.86.223/tcp/45363/p2p/16Uiu2HAmLjDJxjoySDVTePfGQ87h5YeG2Pd3YNJewo6rdRPnUn7G","/ip4/172.18.86.223/tcp/45364/ws/p2p/16Uiu2HAmLjDJxjoySDVTePfGQ87h5YeG2Pd3YNJewo6rdRPnUn7G"],"enrUri":"enr:-L24QFX7_qGP4MyuCtj3JIzApTYlCEsBHjdoRi4sqP6EL9WsLcH5d417BL6HvqX-TSUNUKuQCJa77NpSQk8VgMReW8wCgmlkgnY0gmlwhKwSVt-KbXVsdGlhZGRyc5YACASsElbfBrEzAAoErBJW3waxNN0DgnJzhQACAQAAiXNlY3AyNTZrMaEDd_J478eeyNI4CoPJ-IIzACPNiihrBnjDSet0h_OsFYeDdGNwgrEzg3VkcIKxNYV3YWt1MgE"}'
2026-03-16 04:57:53.572 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:57:53.572 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45362/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.122.119/tcp/5754/p2p/16Uiu2HAm3p2Vx46425yrdnikSHzhrU883Bg6mMiCxTtZhqb5rKbP"]'
2026-03-16 04:57:53.599 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:53.614 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:57:53.614 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-03-16_04-57-49__f3fab322-5193-41d1-bd8b-9939f4906b07__wakuorg_nwaku:latest.log
2026-03-16 04:57:53.614 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:57:53.615 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:57:53.618 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:57:53.619 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.157.103
2026-03-16 04:57:53.619 DEBUG [src.node.docker_mananger] Generated ports ['11935', '11936', '11937', '11938', '11939']
2026-03-16 04:57:53.620 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:57:53.620 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:57:53.620 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:57:53.620 DEBUG [src.node.docker_mananger] docker run -i -t -p 11935:11935 -p 11936:11936 -p 11937:11937 -p 11938:11938 -p 11939:11939 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=11937 --rest-port=11935 --tcp-port=11936 --discv5-udp-port=11938 --rest-address=0.0.0.0 --nat=extip:172.18.157.103 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=30c938dedb3d2dcfcdb2bebed3dd8ebdb9bee9020bf63ff5961a7b6314cdd037 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=11939 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QFs44nEnldVi_Qa5nJSyDyUJ3Pu_zHOyPU6h3EIyM0dAE4-WaX-Iqm4627Hy2YDuTJ8LP7KBx_wpcfkhQMIFkDECgmlkgnY0gmlwhKwSeneKbXVsdGlhZGRyc5YACASsEnp3BhZ6AAoErBJ6dwYWe90DgnJzhQACAQAAiXNlY3AyNTZrMaECfJd5pWaopfRPEPFUH7a_xnqm8k6dDHBaT7P4Odlrd3qDdGNwghZ6g3VkcIIWfIV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-16 04:57:53.826 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.157.103 waku 59f8ddc474dbe1670656577be13896d2838ffeda91d7c6c8444fae4347e3823e
2026-03-16 04:57:53.863 DEBUG [src.node.docker_mananger] Container started with ID 59f8ddc474db. Setting up logs at ./log/docker/node5_2026-03-16_04-57-49__f3fab322-5193-41d1-bd8b-9939f4906b07__wakuorg_nwaku:latest.log
2026-03-16 04:57:53.863 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 11935
2026-03-16 04:57:53.864 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:57:54.865 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11935/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:54.867 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:57:54.968 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11935/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:54.970 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:57:55.071 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11935/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:55.076 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:57:55.077 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:57:55.077 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11935/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:55.080 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.157.103/tcp/11936/p2p/16Uiu2HAmREDBSxHXXEEjGCfEQbmGT1np2zJgPkvNthJ2U99fTQeZ","/ip4/172.18.157.103/tcp/11937/ws/p2p/16Uiu2HAmREDBSxHXXEEjGCfEQbmGT1np2zJgPkvNthJ2U99fTQeZ"],"enrUri":"enr:-L24QCYU-bTiKtwxDW-R_cdZhpT951QkzJDdUERhXrmpMIKvZu5BEujXoM1jWU0iCj5e3N6OP-DUMah_NRt_Nn_zPGACgmlkgnY0gmlwhKwSnWeKbXVsdGlhZGRyc5YACASsEp1nBi6gAAoErBKdZwYuod0DgnJzhQACAQAAiXNlY3AyNTZrMaEDus7qxy-fj_Y7CUc3dNafR0CD3JIkwdiqW-j9rlVFrK6DdGNwgi6gg3VkcIIuooV3YWt1MgE"}'
2026-03-16 04:57:55.080 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:57:55.080 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11935/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.122.119/tcp/5754/p2p/16Uiu2HAm3p2Vx46425yrdnikSHzhrU883Bg6mMiCxTtZhqb5rKbP"]'
2026-03-16 04:57:55.122 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:55.135 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:57:55.136 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node6_2026-03-16_04-57-49__f3fab322-5193-41d1-bd8b-9939f4906b07__wakuorg_nwaku:latest.log
2026-03-16 04:57:55.136 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:57:55.136 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:57:55.142 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:57:55.142 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.149.134
2026-03-16 04:57:55.143 DEBUG [src.node.docker_mananger] Generated ports ['50135', '50136', '50137', '50138', '50139']
2026-03-16 04:57:55.143 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:57:55.143 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:57:55.143 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:57:55.143 DEBUG [src.node.docker_mananger] docker run -i -t -p 50135:50135 -p 50136:50136 -p 50137:50137 -p 50138:50138 -p 50139:50139 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=50137 --rest-port=50135 --tcp-port=50136 --discv5-udp-port=50138 --rest-address=0.0.0.0 --nat=extip:172.18.149.134 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=2506281e752bda5e79f57c81cfbf9caba19aae0afbe8feb13ec7dc308eeba156 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=50139 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QFs44nEnldVi_Qa5nJSyDyUJ3Pu_zHOyPU6h3EIyM0dAE4-WaX-Iqm4627Hy2YDuTJ8LP7KBx_wpcfkhQMIFkDECgmlkgnY0gmlwhKwSeneKbXVsdGlhZGRyc5YACASsEnp3BhZ6AAoErBJ6dwYWe90DgnJzhQACAQAAiXNlY3AyNTZrMaECfJd5pWaopfRPEPFUH7a_xnqm8k6dDHBaT7P4Odlrd3qDdGNwghZ6g3VkcIIWfIV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-16 04:57:55.352 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.149.134 waku 2503af145714ee3645cec5461a9e964a97d30ea1aa16ea533cb4ef4c67883f69
2026-03-16 04:57:55.389 DEBUG [src.node.docker_mananger] Container started with ID 2503af145714. Setting up logs at ./log/docker/node6_2026-03-16_04-57-49__f3fab322-5193-41d1-bd8b-9939f4906b07__wakuorg_nwaku:latest.log
2026-03-16 04:57:55.390 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 50135
2026-03-16 04:57:55.390 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:57:56.391 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50135/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:56.407 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:57:56.507 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50135/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:56.510 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:57:56.510 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:57:56.510 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50135/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:56.512 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.149.134/tcp/50136/p2p/16Uiu2HAmCtWF47jsKczV1bAV72t648K5HaB8x8djx74V4cxCRrwi","/ip4/172.18.149.134/tcp/50137/ws/p2p/16Uiu2HAmCtWF47jsKczV1bAV72t648K5HaB8x8djx74V4cxCRrwi"],"enrUri":"enr:-L24QECJsfqS7JUubn0-1MgTnDSlBM--YdwrtDwe8oh2YyNnaNR5V7s80YpQvwzqpAlpIbI686nBsVKhaz8y9840aOwCgmlkgnY0gmlwhKwSlYaKbXVsdGlhZGRyc5YACASsEpWGBsPYAAoErBKVhgbD2d0DgnJzhQACAQAAiXNlY3AyNTZrMaEDA3ZZnh9LeI2V5XSb3ezWe6O8YvXRlHXXdW7VwQJBDVmDdGNwgsPYg3VkcILD2oV3YWt1MgE"}'
2026-03-16 04:57:56.513 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:57:56.513 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:50135/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.122.119/tcp/5754/p2p/16Uiu2HAm3p2Vx46425yrdnikSHzhrU883Bg6mMiCxTtZhqb5rKbP"]'
2026-03-16 04:57:56.565 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:56.576 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:57:56.576 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node7_2026-03-16_04-57-49__f3fab322-5193-41d1-bd8b-9939f4906b07__wakuorg_nwaku:latest.log
2026-03-16 04:57:56.576 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:57:56.577 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:57:56.580 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:57:56.581 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.120.234
2026-03-16 04:57:56.582 DEBUG [src.node.docker_mananger] Generated ports ['53274', '53275', '53276', '53277', '53278']
2026-03-16 04:57:56.582 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:57:56.582 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:57:56.582 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:57:56.582 DEBUG [src.node.docker_mananger] docker run -i -t -p 53274:53274 -p 53275:53275 -p 53276:53276 -p 53277:53277 -p 53278:53278 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=53276 --rest-port=53274 --tcp-port=53275 --discv5-udp-port=53277 --rest-address=0.0.0.0 --nat=extip:172.18.120.234 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=ba4f036daad7defd6f75e991c4de030e680f056db80bd371d3fc807fef8ae388 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=53278 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QFs44nEnldVi_Qa5nJSyDyUJ3Pu_zHOyPU6h3EIyM0dAE4-WaX-Iqm4627Hy2YDuTJ8LP7KBx_wpcfkhQMIFkDECgmlkgnY0gmlwhKwSeneKbXVsdGlhZGRyc5YACASsEnp3BhZ6AAoErBJ6dwYWe90DgnJzhQACAQAAiXNlY3AyNTZrMaECfJd5pWaopfRPEPFUH7a_xnqm8k6dDHBaT7P4Odlrd3qDdGNwghZ6g3VkcIIWfIV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-16 04:57:56.786 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.120.234 waku 30d63b1adda8328a161774e436e385f2cc57df7c048885729ded133afa0f5ec4
2026-03-16 04:57:56.821 DEBUG [src.node.docker_mananger] Container started with ID 30d63b1adda8. Setting up logs at ./log/docker/node7_2026-03-16_04-57-49__f3fab322-5193-41d1-bd8b-9939f4906b07__wakuorg_nwaku:latest.log
2026-03-16 04:57:56.822 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 53274
2026-03-16 04:57:56.822 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:57:57.823 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53274/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:57.860 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:57:57.961 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53274/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:57.964 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:57:57.964 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:57:57.965 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53274/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:57.967 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.120.234/tcp/53275/p2p/16Uiu2HAmK8owdB8mgaeNjrLxF4rSRNK9KjsDxpsk96T5cJAFnj7R","/ip4/172.18.120.234/tcp/53276/ws/p2p/16Uiu2HAmK8owdB8mgaeNjrLxF4rSRNK9KjsDxpsk96T5cJAFnj7R"],"enrUri":"enr:-L24QBQlhSNUZCQkvyirEgYKm5EX5VJ1HfRiRM1Xm3vOWbZHQz2WlaniVkc5lkOnEweKW0ybRgDqK0gHpe3PGWRAbKACgmlkgnY0gmlwhKwSeOqKbXVsdGlhZGRyc5YACASsEnjqBtAbAAoErBJ46gbQHN0DgnJzhQACAQAAiXNlY3AyNTZrMaEDYEadpo1TzQCq17clXaLmXRYiH447_Ry-TXl8gdhk4aSDdGNwgtAbg3VkcILQHYV3YWt1MgE"}'
2026-03-16 04:57:57.968 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:57:57.968 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53274/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.122.119/tcp/5754/p2p/16Uiu2HAm3p2Vx46425yrdnikSHzhrU883Bg6mMiCxTtZhqb5rKbP"]'
2026-03-16 04:57:58.014 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:58.025 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:57:58.028 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node8_2026-03-16_04-57-49__f3fab322-5193-41d1-bd8b-9939f4906b07__wakuorg_nwaku:latest.log
2026-03-16 04:57:58.028 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:57:58.029 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:57:58.034 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:57:58.035 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.149.14
2026-03-16 04:57:58.035 DEBUG [src.node.docker_mananger] Generated ports ['13267', '13268', '13269', '13270', '13271']
2026-03-16 04:57:58.037 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:57:58.039 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:57:58.039 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:57:58.040 DEBUG [src.node.docker_mananger] docker run -i -t -p 13267:13267 -p 13268:13268 -p 13269:13269 -p 13270:13270 -p 13271:13271 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=13269 --rest-port=13267 --tcp-port=13268 --discv5-udp-port=13270 --rest-address=0.0.0.0 --nat=extip:172.18.149.14 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=57bc35bcdf09dd4b6897a70fc5b77a57644a304cab8da7f3ed736df95c59ce7f --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=13271 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QFs44nEnldVi_Qa5nJSyDyUJ3Pu_zHOyPU6h3EIyM0dAE4-WaX-Iqm4627Hy2YDuTJ8LP7KBx_wpcfkhQMIFkDECgmlkgnY0gmlwhKwSeneKbXVsdGlhZGRyc5YACASsEnp3BhZ6AAoErBJ6dwYWe90DgnJzhQACAQAAiXNlY3AyNTZrMaECfJd5pWaopfRPEPFUH7a_xnqm8k6dDHBaT7P4Odlrd3qDdGNwghZ6g3VkcIIWfIV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-16 04:57:58.262 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.149.14 waku 2a3670be53d9df35f60c54526d3bd255dc0fb9e414221e123bf04a729fc141af
2026-03-16 04:57:58.299 DEBUG [src.node.docker_mananger] Container started with ID 2a3670be53d9. Setting up logs at ./log/docker/node8_2026-03-16_04-57-49__f3fab322-5193-41d1-bd8b-9939f4906b07__wakuorg_nwaku:latest.log
2026-03-16 04:57:58.300 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 13267
2026-03-16 04:57:58.300 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:57:59.301 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13267/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:59.304 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:57:59.404 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13267/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:59.407 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:57:59.507 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13267/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:59.510 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:57:59.510 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:57:59.510 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13267/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:57:59.513 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.149.14/tcp/13268/p2p/16Uiu2HAmDiGhmUesvrmqwywW562dfLdvkeWrk23i15gogkCNVQVZ","/ip4/172.18.149.14/tcp/13269/ws/p2p/16Uiu2HAmDiGhmUesvrmqwywW562dfLdvkeWrk23i15gogkCNVQVZ"],"enrUri":"enr:-L24QIG_3c1CvJTDMf4au0ov-0kY9IEX8g0cJKaCpy1lINumbjWrat92wcWypgsB6ih1plFxa2Vu7xTAWGh0DyinYH0CgmlkgnY0gmlwhKwSlQ6KbXVsdGlhZGRyc5YACASsEpUOBjPUAAoErBKVDgYz1d0DgnJzhQACAQAAiXNlY3AyNTZrMaEDD7LreYrnAdKwipmHx9H4x6m_pLopwSta0-Lf8S14G4SDdGNwgjPUg3VkcIIz1oV3YWt1MgE"}'
2026-03-16 04:57:59.513 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:57:59.513 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13267/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.122.119/tcp/5754/p2p/16Uiu2HAm3p2Vx46425yrdnikSHzhrU883Bg6mMiCxTtZhqb5rKbP"]'
2026-03-16 04:57:59.542 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:57:59.552 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:57:59.552 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node9_2026-03-16_04-57-49__f3fab322-5193-41d1-bd8b-9939f4906b07__wakuorg_nwaku:latest.log
2026-03-16 04:57:59.553 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:57:59.553 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:57:59.557 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:57:59.558 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.46.219
2026-03-16 04:57:59.558 DEBUG [src.node.docker_mananger] Generated ports ['54885', '54886', '54887', '54888', '54889']
2026-03-16 04:57:59.560 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:57:59.560 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:57:59.560 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:57:59.561 DEBUG [src.node.docker_mananger] docker run -i -t -p 54885:54885 -p 54886:54886 -p 54887:54887 -p 54888:54888 -p 54889:54889 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=54887 --rest-port=54885 --tcp-port=54886 --discv5-udp-port=54888 --rest-address=0.0.0.0 --nat=extip:172.18.46.219 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=f3dd1ab07dfd8effa0fecb396a2c9d22ebbf50c021c0d4ff14fd8db391e93fce --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=54889 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QFs44nEnldVi_Qa5nJSyDyUJ3Pu_zHOyPU6h3EIyM0dAE4-WaX-Iqm4627Hy2YDuTJ8LP7KBx_wpcfkhQMIFkDECgmlkgnY0gmlwhKwSeneKbXVsdGlhZGRyc5YACASsEnp3BhZ6AAoErBJ6dwYWe90DgnJzhQACAQAAiXNlY3AyNTZrMaECfJd5pWaopfRPEPFUH7a_xnqm8k6dDHBaT7P4Odlrd3qDdGNwghZ6g3VkcIIWfIV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-16 04:57:59.791 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.46.219 waku aba1d57f3190a114eb738e57bc023e8fd82fa0f3f35c3945aa1078dd5707cb7c
2026-03-16 04:57:59.837 DEBUG [src.node.docker_mananger] Container started with ID aba1d57f3190. Setting up logs at ./log/docker/node9_2026-03-16_04-57-49__f3fab322-5193-41d1-bd8b-9939f4906b07__wakuorg_nwaku:latest.log
2026-03-16 04:57:59.837 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 54885
2026-03-16 04:57:59.837 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:58:00.839 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54885/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:58:00.845 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:58:00.945 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54885/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:58:00.948 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:58:01.049 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54885/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:58:01.051 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:58:01.051 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:58:01.051 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54885/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:58:01.054 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.46.219/tcp/54886/p2p/16Uiu2HAkuvRCiscBJ963HifJHB3xoFBECAdRB7PFC3VF83iNZ8yw","/ip4/172.18.46.219/tcp/54887/ws/p2p/16Uiu2HAkuvRCiscBJ963HifJHB3xoFBECAdRB7PFC3VF83iNZ8yw"],"enrUri":"enr:-L24QBosOHLmd3RE9vVpW3yrzP6N7lC_8m4254PpIfX7VVeefY3IU9pPnoQG3_tcIog2AceS7IWYvv-hqRi4FvMWgrYCgmlkgnY0gmlwhKwSLtuKbXVsdGlhZGRyc5YACASsEi7bBtZmAAoErBIu2wbWZ90DgnJzhQACAQAAiXNlY3AyNTZrMaECB10ijPLPJmfkRJUi6mZTp4OXocAIo7Zgvwb2ui2rstKDdGNwgtZmg3VkcILWaIV3YWt1MgE"}'
2026-03-16 04:58:01.054 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:58:01.054 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54885/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.122.119/tcp/5754/p2p/16Uiu2HAm3p2Vx46425yrdnikSHzhrU883Bg6mMiCxTtZhqb5rKbP"]'
2026-03-16 04:58:01.076 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:58:01.091 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:58:01.092 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node10_2026-03-16_04-57-49__f3fab322-5193-41d1-bd8b-9939f4906b07__wakuorg_nwaku:latest.log
2026-03-16 04:58:01.093 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:58:01.093 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:58:01.096 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:58:01.097 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.43.66
2026-03-16 04:58:01.099 DEBUG [src.node.docker_mananger] Generated ports ['1201', '1202', '1203', '1204', '1205']
2026-03-16 04:58:01.101 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:58:01.102 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:58:01.103 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:58:01.104 DEBUG [src.node.docker_mananger] docker run -i -t -p 1201:1201 -p 1202:1202 -p 1203:1203 -p 1204:1204 -p 1205:1205 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=1203 --rest-port=1201 --tcp-port=1202 --discv5-udp-port=1204 --rest-address=0.0.0.0 --nat=extip:172.18.43.66 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=9efd2ebada385b1b8c43e3ef6be0cb8bdb3f86beb5a6ecaff6afcacb5d8dd07e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=1205 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QFs44nEnldVi_Qa5nJSyDyUJ3Pu_zHOyPU6h3EIyM0dAE4-WaX-Iqm4627Hy2YDuTJ8LP7KBx_wpcfkhQMIFkDECgmlkgnY0gmlwhKwSeneKbXVsdGlhZGRyc5YACASsEnp3BhZ6AAoErBJ6dwYWe90DgnJzhQACAQAAiXNlY3AyNTZrMaECfJd5pWaopfRPEPFUH7a_xnqm8k6dDHBaT7P4Odlrd3qDdGNwghZ6g3VkcIIWfIV3YWt1MgU --content-topic=/myapp/1/latest/proto
2026-03-16 04:58:01.331 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.43.66 waku 4e86e95fb99de87a090a6c7a0e9fd57ec9b6242a4db0cb6d171207165e912db8
2026-03-16 04:58:01.375 DEBUG [src.node.docker_mananger] Container started with ID 4e86e95fb99d. Setting up logs at ./log/docker/node10_2026-03-16_04-57-49__f3fab322-5193-41d1-bd8b-9939f4906b07__wakuorg_nwaku:latest.log
2026-03-16 04:58:01.375 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 1201
2026-03-16 04:58:01.376 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:58:02.377 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1201/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:58:02.383 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:58:02.483 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1201/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:58:02.488 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:58:02.589 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1201/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:58:02.592 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:58:02.593 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:58:02.593 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1201/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:58:02.595 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.43.66/tcp/1202/p2p/16Uiu2HAkuXzhiAy2Y8Z11RH4eZVG2f2wnuU2Ywm3LsiPjmRY8xy6","/ip4/172.18.43.66/tcp/1203/ws/p2p/16Uiu2HAkuXzhiAy2Y8Z11RH4eZVG2f2wnuU2Ywm3LsiPjmRY8xy6"],"enrUri":"enr:-L24QG7WjQuDMPyw0bfL0EYzTjDc_3-ZFgbbdG33FMdseFGuWUZhEwScxK-wOPfebhyJs5_rzA82YhcOOMW4Z8b3nLECgmlkgnY0gmlwhKwSK0KKbXVsdGlhZGRyc5YACASsEitCBgSyAAoErBIrQgYEs90DgnJzhQACAQAAiXNlY3AyNTZrMaECAZ6nmb7PV28tmBKQ_oEMyFLk8Prviak-Ze-O_mvrPnmDdGNwggSyg3VkcIIEtIV3YWt1MgE"}'
2026-03-16 04:58:02.595 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:58:02.596 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1201/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.122.119/tcp/5754/p2p/16Uiu2HAm3p2Vx46425yrdnikSHzhrU883Bg6mMiCxTtZhqb5rKbP"]'
2026-03-16 04:58:02.619 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:58:02.623 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:5753/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:58:02.632 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:58:02.632 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27009/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:58:02.636 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:58:02.637 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45362/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:58:02.649 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:58:02.651 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11935/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:58:02.656 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:58:02.657 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:50135/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:58:02.666 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:58:02.668 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53274/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:58:02.674 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:58:02.675 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13267/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:58:02.679 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:58:02.679 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54885/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:58:02.682 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:58:02.682 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1201/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:58:02.685 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:58:02.687 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:5753/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:58:02.711 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:58:02.711 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 04:58:02.813 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-16 04:58:02.813 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:5753/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:58:02.816 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773637082686960056,"ephemeral":false,"proof":""}]'
2026-03-16 04:58:02.818 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-16 04:58:02.818 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:27009/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:58:02.820 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773637082686960056,"ephemeral":false,"proof":""}]'
2026-03-16 04:58:02.822 DEBUG [src.steps.sharding] Checking that peer NODE_3:wakuorg/nwaku:latest can find the published message
2026-03-16 04:58:02.822 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45362/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:58:02.824 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773637082686960056,"ephemeral":false,"proof":""}]'
2026-03-16 04:58:02.826 DEBUG [src.steps.sharding] Checking that peer NODE_4:wakuorg/nwaku:latest can find the published message
2026-03-16 04:58:02.826 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11935/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:58:02.829 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773637082686960056,"ephemeral":false,"proof":""}]'
2026-03-16 04:58:02.831 DEBUG [src.steps.sharding] Checking that peer NODE_5:wakuorg/nwaku:latest can find the published message
2026-03-16 04:58:02.832 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50135/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:58:02.840 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773637082686960056,"ephemeral":false,"proof":""}]'
2026-03-16 04:58:02.843 DEBUG [src.steps.sharding] Checking that peer NODE_6:wakuorg/nwaku:latest can find the published message
2026-03-16 04:58:02.845 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53274/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:58:02.849 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773637082686960056,"ephemeral":false,"proof":""}]'
2026-03-16 04:58:02.852 DEBUG [src.steps.sharding] Checking that peer NODE_7:wakuorg/nwaku:latest can find the published message
2026-03-16 04:58:02.853 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13267/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:58:02.857 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773637082686960056,"ephemeral":false,"proof":""}]'
2026-03-16 04:58:02.859 DEBUG [src.steps.sharding] Checking that peer NODE_8:wakuorg/nwaku:latest can find the published message
2026-03-16 04:58:02.859 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54885/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:58:02.865 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773637082686960056,"ephemeral":false,"proof":""}]'
2026-03-16 04:58:02.867 DEBUG [src.steps.sharding] Checking that peer NODE_9:wakuorg/nwaku:latest can find the published message
2026-03-16 04:58:02.867 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1201/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:58:02.870 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773637082686960056,"ephemeral":false,"proof":""}]'
2026-03-16 04:58:02.873 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-16 04:58:02.875 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-16 04:58:02.875 DEBUG [src.node.waku_node] Stopping container with id d9e4eae2bfb5
2026-03-16 04:58:03.588 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:58:03.589 DEBUG [src.node.waku_node] Stopping container with id 4b35c034c421
2026-03-16 04:58:04.235 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:58:04.235 DEBUG [src.node.waku_node] Stopping container with id af89c844557c
2026-03-16 04:58:04.406 ERROR [src.node.docker_mananger] Max retries reached for container d9e4eae2bfb5. Exiting log stream.
2026-03-16 04:58:04.839 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:58:04.839 DEBUG [src.node.waku_node] Stopping container with id 59f8ddc474db
2026-03-16 04:58:05.262 ERROR [src.node.docker_mananger] Max retries reached for container 4b35c034c421. Exiting log stream.
2026-03-16 04:58:05.430 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:58:05.431 DEBUG [src.node.waku_node] Stopping container with id 2503af145714
2026-03-16 04:58:05.660 ERROR [src.node.docker_mananger] Max retries reached for container af89c844557c. Exiting log stream.
2026-03-16 04:58:06.245 ERROR [src.node.docker_mananger] Max retries reached for container 59f8ddc474db. Exiting log stream.
2026-03-16 04:58:16.030 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:58:16.032 DEBUG [src.node.waku_node] Stopping container with id 30d63b1adda8
2026-03-16 04:58:16.611 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:58:16.611 DEBUG [src.node.waku_node] Stopping container with id 2a3670be53d9
2026-03-16 04:58:16.849 ERROR [src.node.docker_mananger] Max retries reached for container 2503af145714. Exiting log stream.
2026-03-16 04:58:17.171 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:58:17.171 DEBUG [src.node.waku_node] Stopping container with id aba1d57f3190
2026-03-16 04:58:17.424 ERROR [src.node.docker_mananger] Max retries reached for container 30d63b1adda8. Exiting log stream.
2026-03-16 04:58:17.984 ERROR [src.node.docker_mananger] Max retries reached for container 2a3670be53d9. Exiting log stream.
2026-03-16 04:58:27.744 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:58:27.746 DEBUG [src.node.waku_node] Stopping container with id 4e86e95fb99d
2026-03-16 04:58:28.323 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:58:28.325 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-16 04:58:28.421 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:58:28.527 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:58:28.580 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:58:28.631 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:58:28.683 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:58:28.738 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:58:28.792 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:58:28.830 ERROR [src.node.docker_mananger] Max retries reached for container aba1d57f3190. Exiting log stream.
2026-03-16 04:58:28.836 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:58:28.885 DEBUG [src.node.docker_mananger] No errors found in the waku logs.