350 lines
62 KiB
Plaintext

2026-04-23 22:03:42.709 DEBUG [tests.conftest] Running fixture setup: test_id
2026-04-23 22:03:42.709 DEBUG [tests.conftest] Running test: test_static_shard_relay_10_nwaku_nodes with id: 2026-04-23_22-03-42__e2173aa9-461b-4c2d-ab9e-ad2c7b279625
2026-04-23 22:03:42.710 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-04-23 22:03:42.710 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-04-23 22:03:42.710 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-04-23 22:03:42.718 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 22:03:42.718 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-04-23_22-03-42__e2173aa9-461b-4c2d-ab9e-ad2c7b279625__wakuorg_nwaku:latest.log
2026-04-23 22:03:42.718 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 22:03:42.718 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 22:03:42.720 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 22:03:42.720 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.74.153
2026-04-23 22:03:42.720 DEBUG [src.node.docker_mananger] Generated ports ['38064', '38065', '38066', '38067', '38068']
2026-04-23 22:03:42.720 DEBUG [src.node.waku_node] Cluster id was resolved to: 199
2026-04-23 22:03:42.721 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-04-23 22:03:42.721 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 22:03:42.721 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 22:03:42.721 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 22:03:42.721 DEBUG [src.node.docker_mananger] docker run -i -t -p 38064:38064 -p 38065:38065 -p 38066:38066 -p 38067:38067 -p 38068:38068 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=38066 --rest-port=38064 --tcp-port=38065 --discv5-udp-port=38067 --rest-address=0.0.0.0 --nat=extip:172.18.74.153 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=1a1230ad51acf4daf8dfdc126fdfba7f4fdcfebdc5bfeacaea87c08df6c2126d --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=38068 --metrics-logging=true --relay=true --filter=true
2026-04-23 22:03:42.913 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.74.153 waku 29acb76269300f7c39771485703a274d261ef733304b027bd0de3aef74051ed3
2026-04-23 22:03:42.953 DEBUG [src.node.docker_mananger] Container started with ID 29acb7626930. Setting up logs at ./log/docker/node1_2026-04-23_22-03-42__e2173aa9-461b-4c2d-ab9e-ad2c7b279625__wakuorg_nwaku:latest.log
2026-04-23 22:03:42.954 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 38064
2026-04-23 22:03:42.954 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 22:03:43.054 ERROR [src.node.docker_mananger] Max retries reached for container eef483adae6d. Exiting log stream.
2026-04-23 22:03:43.517 ERROR [src.node.docker_mananger] Max retries reached for container 780b7533da13. Exiting log stream.
2026-04-23 22:03:43.955 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38064/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:03:43.958 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 22:03:43.958 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 22:03:43.958 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38064/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:03:43.961 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.74.153/tcp/38065/p2p/16Uiu2HAmC79UEgxEe5bYUf2pH69i9MUr7uDF2MtdG5GTgx8NNoss","/ip4/172.18.74.153/tcp/38066/ws/p2p/16Uiu2HAmC79UEgxEe5bYUf2pH69i9MUr7uDF2MtdG5GTgx8NNoss"],"enrUri":"enr:-L24QDrusRNh9LcS1I0MojMaKNzSQaqZSPZ5DRO_nqlPh6ZpHBssRGe_h4WtDRfZvh7BzCfRiCg5anrJ9ZrjNbDHFYkCgmlkgnY0gmlwhKwSSpmKbXVsdGlhZGRyc5YACASsEkqZBpSxAAoErBJKmQaUst0DgnJzhQDHAQAAiXNlY3AyNTZrMaEC99e50sH6m2MgwTT-TfRqYpwIhOZLTeCofS-WlHih0DaDdGNwgpSxg3VkcIKUs4V3YWt1MgU"}'
2026-04-23 22:03:43.961 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 22:03:43.968 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 22:03:43.968 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-04-23_22-03-42__e2173aa9-461b-4c2d-ab9e-ad2c7b279625__wakuorg_nwaku:latest.log
2026-04-23 22:03:43.968 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 22:03:43.969 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 22:03:43.970 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 22:03:43.970 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.8.241
2026-04-23 22:03:43.970 DEBUG [src.node.docker_mananger] Generated ports ['17012', '17013', '17014', '17015', '17016']
2026-04-23 22:03:43.971 DEBUG [src.node.waku_node] Cluster id was resolved to: 199
2026-04-23 22:03:43.971 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-04-23 22:03:43.971 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 22:03:43.971 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 22:03:43.971 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 22:03:43.971 DEBUG [src.node.docker_mananger] docker run -i -t -p 17012:17012 -p 17013:17013 -p 17014:17014 -p 17015:17015 -p 17016:17016 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=17014 --rest-port=17012 --tcp-port=17013 --discv5-udp-port=17015 --rest-address=0.0.0.0 --nat=extip:172.18.8.241 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=095be12ef0162cd580208a4f84ebf1a7e0aefeab4bbff9fb91bf96e11229f7bd --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=17016 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QDrusRNh9LcS1I0MojMaKNzSQaqZSPZ5DRO_nqlPh6ZpHBssRGe_h4WtDRfZvh7BzCfRiCg5anrJ9ZrjNbDHFYkCgmlkgnY0gmlwhKwSSpmKbXVsdGlhZGRyc5YACASsEkqZBpSxAAoErBJKmQaUst0DgnJzhQDHAQAAiXNlY3AyNTZrMaEC99e50sH6m2MgwTT-TfRqYpwIhOZLTeCofS-WlHih0DaDdGNwgpSxg3VkcIKUs4V3YWt1MgU
2026-04-23 22:03:44.183 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.8.241 waku bdd958192dc1d5296f87bda7d669b9aeed37c7f39f184d813d5bc838f3931ee2
2026-04-23 22:03:44.222 DEBUG [src.node.docker_mananger] Container started with ID bdd958192dc1. Setting up logs at ./log/docker/node3_2026-04-23_22-03-42__e2173aa9-461b-4c2d-ab9e-ad2c7b279625__wakuorg_nwaku:latest.log
2026-04-23 22:03:44.222 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 17012
2026-04-23 22:03:44.223 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 22:03:45.224 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17012/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:03:45.230 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 22:03:45.230 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 22:03:45.230 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17012/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:03:45.234 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.8.241/tcp/17013/p2p/16Uiu2HAm3uYYsoziayXcHFmmgGerFY57WvSC6K1SoyrAP3tpnanH","/ip4/172.18.8.241/tcp/17014/ws/p2p/16Uiu2HAm3uYYsoziayXcHFmmgGerFY57WvSC6K1SoyrAP3tpnanH"],"enrUri":"enr:-L24QGNS5EFmNnCThsknzDrU7uaqQfEnG2zJv8EW4uTfdduDc58Dkx-s0_HGVa_-Oai4Cc-cu04ocJUFSYK8m7bpYAgCgmlkgnY0gmlwhKwSCPGKbXVsdGlhZGRyc5YACASsEgjxBkJ1AAoErBII8QZCdt0DgnJzhQDHAQAAiXNlY3AyNTZrMaECfgFbfgy31JysJl1AEWj7PRg-uB8yHZVBYmuvCjd8wD6DdGNwgkJ1g3VkcIJCd4V3YWt1MgE"}'
2026-04-23 22:03:45.235 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 22:03:45.235 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17012/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.74.153/tcp/38065/p2p/16Uiu2HAmC79UEgxEe5bYUf2pH69i9MUr7uDF2MtdG5GTgx8NNoss"]'
2026-04-23 22:03:45.238 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 22:03:45.245 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 22:03:45.245 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-04-23_22-03-42__e2173aa9-461b-4c2d-ab9e-ad2c7b279625__wakuorg_nwaku:latest.log
2026-04-23 22:03:45.245 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 22:03:45.245 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 22:03:45.247 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 22:03:45.247 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.230.60
2026-04-23 22:03:45.247 DEBUG [src.node.docker_mananger] Generated ports ['22224', '22225', '22226', '22227', '22228']
2026-04-23 22:03:45.247 DEBUG [src.node.waku_node] Cluster id was resolved to: 199
2026-04-23 22:03:45.247 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-04-23 22:03:45.247 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 22:03:45.248 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 22:03:45.248 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 22:03:45.248 DEBUG [src.node.docker_mananger] docker run -i -t -p 22224:22224 -p 22225:22225 -p 22226:22226 -p 22227:22227 -p 22228:22228 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=22226 --rest-port=22224 --tcp-port=22225 --discv5-udp-port=22227 --rest-address=0.0.0.0 --nat=extip:172.18.230.60 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=fa23f2fc1e1af293adbea8ecd5ed8a14c5375e45de3d2cadeb10fab1d77e60c4 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=22228 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QDrusRNh9LcS1I0MojMaKNzSQaqZSPZ5DRO_nqlPh6ZpHBssRGe_h4WtDRfZvh7BzCfRiCg5anrJ9ZrjNbDHFYkCgmlkgnY0gmlwhKwSSpmKbXVsdGlhZGRyc5YACASsEkqZBpSxAAoErBJKmQaUst0DgnJzhQDHAQAAiXNlY3AyNTZrMaEC99e50sH6m2MgwTT-TfRqYpwIhOZLTeCofS-WlHih0DaDdGNwgpSxg3VkcIKUs4V3YWt1MgU
2026-04-23 22:03:45.439 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.230.60 waku 1743626024b8572c4507596cdb6072f4cc2d72ef455b5321627b2f5e4812df9b
2026-04-23 22:03:45.475 DEBUG [src.node.docker_mananger] Container started with ID 1743626024b8. Setting up logs at ./log/docker/node4_2026-04-23_22-03-42__e2173aa9-461b-4c2d-ab9e-ad2c7b279625__wakuorg_nwaku:latest.log
2026-04-23 22:03:45.475 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 22224
2026-04-23 22:03:45.476 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 22:03:46.477 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:22224/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:03:46.489 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 22:03:46.489 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 22:03:46.489 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:22224/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:03:46.494 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.230.60/tcp/22225/p2p/16Uiu2HAmJdp2RzAjz8Mm4Gfc2YUEXu7S35JDtXw3rNY1QkjL4osV","/ip4/172.18.230.60/tcp/22226/ws/p2p/16Uiu2HAmJdp2RzAjz8Mm4Gfc2YUEXu7S35JDtXw3rNY1QkjL4osV"],"enrUri":"enr:-L24QCMV6cTkXSCDEW5gjz1QBXLncJjxBlubf5Ryd2o1VUGZZbK121RryO3IQPwmeOpaQZ5w23gM7CYkkWjB-sN4EgMCgmlkgnY0gmlwhKwS5jyKbXVsdGlhZGRyc5YACASsEuY8BlbRAAoErBLmPAZW0t0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDWNjdtvacm2oF0trUqzNUZyo5iDVvKNRdNKTSIkA3exCDdGNwglbRg3VkcIJW04V3YWt1MgE"}'
2026-04-23 22:03:46.494 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 22:03:46.494 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22224/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.74.153/tcp/38065/p2p/16Uiu2HAmC79UEgxEe5bYUf2pH69i9MUr7uDF2MtdG5GTgx8NNoss"]'
2026-04-23 22:03:46.497 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 22:03:46.504 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 22:03:46.504 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-04-23_22-03-42__e2173aa9-461b-4c2d-ab9e-ad2c7b279625__wakuorg_nwaku:latest.log
2026-04-23 22:03:46.504 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 22:03:46.504 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 22:03:46.506 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 22:03:46.506 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.1.136
2026-04-23 22:03:46.506 DEBUG [src.node.docker_mananger] Generated ports ['28225', '28226', '28227', '28228', '28229']
2026-04-23 22:03:46.506 DEBUG [src.node.waku_node] Cluster id was resolved to: 199
2026-04-23 22:03:46.507 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-04-23 22:03:46.507 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 22:03:46.507 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 22:03:46.507 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 22:03:46.507 DEBUG [src.node.docker_mananger] docker run -i -t -p 28225:28225 -p 28226:28226 -p 28227:28227 -p 28228:28228 -p 28229:28229 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=28227 --rest-port=28225 --tcp-port=28226 --discv5-udp-port=28228 --rest-address=0.0.0.0 --nat=extip:172.18.1.136 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=21ae953c6925cad3abaae6341fddf802159afecf8c93b0f97e2bae72d9a30cdc --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=28229 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QDrusRNh9LcS1I0MojMaKNzSQaqZSPZ5DRO_nqlPh6ZpHBssRGe_h4WtDRfZvh7BzCfRiCg5anrJ9ZrjNbDHFYkCgmlkgnY0gmlwhKwSSpmKbXVsdGlhZGRyc5YACASsEkqZBpSxAAoErBJKmQaUst0DgnJzhQDHAQAAiXNlY3AyNTZrMaEC99e50sH6m2MgwTT-TfRqYpwIhOZLTeCofS-WlHih0DaDdGNwgpSxg3VkcIKUs4V3YWt1MgU
2026-04-23 22:03:46.718 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.1.136 waku 865fa1b28e055a77a30617c9fa887a061a700f6fbfc2e506ebc15afa0e59a183
2026-04-23 22:03:46.754 DEBUG [src.node.docker_mananger] Container started with ID 865fa1b28e05. Setting up logs at ./log/docker/node5_2026-04-23_22-03-42__e2173aa9-461b-4c2d-ab9e-ad2c7b279625__wakuorg_nwaku:latest.log
2026-04-23 22:03:46.755 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 28225
2026-04-23 22:03:46.755 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 22:03:47.757 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:28225/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:03:47.765 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 22:03:47.765 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 22:03:47.766 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:28225/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:03:47.770 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.1.136/tcp/28226/p2p/16Uiu2HAm8e8NqkGgW9KWYSa2xLZBugH3CyYtNegQwytnjuNBjP4m","/ip4/172.18.1.136/tcp/28227/ws/p2p/16Uiu2HAm8e8NqkGgW9KWYSa2xLZBugH3CyYtNegQwytnjuNBjP4m"],"enrUri":"enr:-L24QAmPWPWjwUn8zIXjKtcnFKg7BNPpTHDFOHM1RCOEDsndKEyo5UxZF57g9L_WN2RNKi1W1WtE6PAgaKSR0rHXGKICgmlkgnY0gmlwhKwSAYiKbXVsdGlhZGRyc5YACASsEgGIBm5CAAoErBIBiAZuQ90DgnJzhQDHAQAAiXNlY3AyNTZrMaECxFi_UuNG22h1u2BRHOq58uALHaMXgtyEnDkqKNKXjkKDdGNwgm5Cg3VkcIJuRIV3YWt1MgE"}'
2026-04-23 22:03:47.776 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 22:03:47.777 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:28225/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.74.153/tcp/38065/p2p/16Uiu2HAmC79UEgxEe5bYUf2pH69i9MUr7uDF2MtdG5GTgx8NNoss"]'
2026-04-23 22:03:47.780 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 22:03:47.787 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 22:03:47.787 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node6_2026-04-23_22-03-42__e2173aa9-461b-4c2d-ab9e-ad2c7b279625__wakuorg_nwaku:latest.log
2026-04-23 22:03:47.788 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 22:03:47.788 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 22:03:47.789 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 22:03:47.789 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.184.162
2026-04-23 22:03:47.789 DEBUG [src.node.docker_mananger] Generated ports ['14018', '14019', '14020', '14021', '14022']
2026-04-23 22:03:47.790 DEBUG [src.node.waku_node] Cluster id was resolved to: 199
2026-04-23 22:03:47.790 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-04-23 22:03:47.790 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 22:03:47.790 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 22:03:47.790 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 22:03:47.790 DEBUG [src.node.docker_mananger] docker run -i -t -p 14018:14018 -p 14019:14019 -p 14020:14020 -p 14021:14021 -p 14022:14022 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=14020 --rest-port=14018 --tcp-port=14019 --discv5-udp-port=14021 --rest-address=0.0.0.0 --nat=extip:172.18.184.162 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=ac7fad1d3d95c3df141b66ae6bea4aedfee3c168eb3f0d974f8d47bfd6550acc --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=14022 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QDrusRNh9LcS1I0MojMaKNzSQaqZSPZ5DRO_nqlPh6ZpHBssRGe_h4WtDRfZvh7BzCfRiCg5anrJ9ZrjNbDHFYkCgmlkgnY0gmlwhKwSSpmKbXVsdGlhZGRyc5YACASsEkqZBpSxAAoErBJKmQaUst0DgnJzhQDHAQAAiXNlY3AyNTZrMaEC99e50sH6m2MgwTT-TfRqYpwIhOZLTeCofS-WlHih0DaDdGNwgpSxg3VkcIKUs4V3YWt1MgU
2026-04-23 22:03:47.987 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.184.162 waku 38132a68ca5a6133b08dd2d830e329592d2137fb3ef0e250f3c3687b5fedbdc5
2026-04-23 22:03:48.023 DEBUG [src.node.docker_mananger] Container started with ID 38132a68ca5a. Setting up logs at ./log/docker/node6_2026-04-23_22-03-42__e2173aa9-461b-4c2d-ab9e-ad2c7b279625__wakuorg_nwaku:latest.log
2026-04-23 22:03:48.023 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 14018
2026-04-23 22:03:48.023 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 22:03:49.024 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14018/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:03:49.038 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 22:03:49.039 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 22:03:49.041 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14018/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:03:49.047 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.184.162/tcp/14019/p2p/16Uiu2HAm3RMc3rgPRSuGJvdqMhiuD6uiWecHyB6qHM4BEPouMneM","/ip4/172.18.184.162/tcp/14020/ws/p2p/16Uiu2HAm3RMc3rgPRSuGJvdqMhiuD6uiWecHyB6qHM4BEPouMneM"],"enrUri":"enr:-L24QNu1OIjTaoxN-AIH04xkyKcw30zc_SGkazrGKejNEpajGmbZDrGglXh9iF8nlYUBwmycmaclg5qnGWVsnp-vrj4CgmlkgnY0gmlwhKwSuKKKbXVsdGlhZGRyc5YACASsEriiBjbDAAoErBK4ogY2xN0DgnJzhQDHAQAAiXNlY3AyNTZrMaECdsi4BzGwWW8Ldq-8i4gHW07WL8NzBrn4UdJmwU9nRuqDdGNwgjbDg3VkcII2xYV3YWt1MgE"}'
2026-04-23 22:03:49.047 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 22:03:49.048 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14018/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.74.153/tcp/38065/p2p/16Uiu2HAmC79UEgxEe5bYUf2pH69i9MUr7uDF2MtdG5GTgx8NNoss"]'
2026-04-23 22:03:49.051 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 22:03:49.058 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 22:03:49.058 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node7_2026-04-23_22-03-42__e2173aa9-461b-4c2d-ab9e-ad2c7b279625__wakuorg_nwaku:latest.log
2026-04-23 22:03:49.058 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 22:03:49.058 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 22:03:49.060 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 22:03:49.060 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.184.109
2026-04-23 22:03:49.060 DEBUG [src.node.docker_mananger] Generated ports ['49095', '49096', '49097', '49098', '49099']
2026-04-23 22:03:49.060 DEBUG [src.node.waku_node] Cluster id was resolved to: 199
2026-04-23 22:03:49.060 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-04-23 22:03:49.061 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 22:03:49.061 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 22:03:49.061 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 22:03:49.061 DEBUG [src.node.docker_mananger] docker run -i -t -p 49095:49095 -p 49096:49096 -p 49097:49097 -p 49098:49098 -p 49099:49099 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=49097 --rest-port=49095 --tcp-port=49096 --discv5-udp-port=49098 --rest-address=0.0.0.0 --nat=extip:172.18.184.109 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=9cbde3b8b7a29dd0be5cdaddda1d0ebdaef7f5f79d578812d64d3347ea641d2b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=49099 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QDrusRNh9LcS1I0MojMaKNzSQaqZSPZ5DRO_nqlPh6ZpHBssRGe_h4WtDRfZvh7BzCfRiCg5anrJ9ZrjNbDHFYkCgmlkgnY0gmlwhKwSSpmKbXVsdGlhZGRyc5YACASsEkqZBpSxAAoErBJKmQaUst0DgnJzhQDHAQAAiXNlY3AyNTZrMaEC99e50sH6m2MgwTT-TfRqYpwIhOZLTeCofS-WlHih0DaDdGNwgpSxg3VkcIKUs4V3YWt1MgU
2026-04-23 22:03:49.262 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.184.109 waku 1551e4954b87e5df411fc4807f508534169c2ccf28a0ec17e3f6002084589f74
2026-04-23 22:03:49.297 DEBUG [src.node.docker_mananger] Container started with ID 1551e4954b87. Setting up logs at ./log/docker/node7_2026-04-23_22-03-42__e2173aa9-461b-4c2d-ab9e-ad2c7b279625__wakuorg_nwaku:latest.log
2026-04-23 22:03:49.297 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 49095
2026-04-23 22:03:49.297 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 22:03:50.298 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:49095/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:03:50.307 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 22:03:50.307 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 22:03:50.307 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:49095/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:03:50.311 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.184.109/tcp/49096/p2p/16Uiu2HAmFWb9nhCLkgKoJqdYvpq9DYJuk7WJn1pVZ5YKWLpf5mA9","/ip4/172.18.184.109/tcp/49097/ws/p2p/16Uiu2HAmFWb9nhCLkgKoJqdYvpq9DYJuk7WJn1pVZ5YKWLpf5mA9"],"enrUri":"enr:-L24QLskpKzch_I0ab49WsuZUBSpifAJW50KD7cUn1-_M5R4dL1ti0ZucLXSFB6bTI05aC7H8mRX76MAtXtTPKpbOPECgmlkgnY0gmlwhKwSuG2KbXVsdGlhZGRyc5YACASsErhtBr_IAAoErBK4bQa_yd0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDKmwvFJe7XZpMSx3_UdZ-YmiIKU5QIzpG_wXPcQrSJOKDdGNwgr_Ig3VkcIK_yoV3YWt1MgE"}'
2026-04-23 22:03:50.312 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 22:03:50.313 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:49095/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.74.153/tcp/38065/p2p/16Uiu2HAmC79UEgxEe5bYUf2pH69i9MUr7uDF2MtdG5GTgx8NNoss"]'
2026-04-23 22:03:50.316 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 22:03:50.325 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 22:03:50.325 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node8_2026-04-23_22-03-42__e2173aa9-461b-4c2d-ab9e-ad2c7b279625__wakuorg_nwaku:latest.log
2026-04-23 22:03:50.325 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 22:03:50.325 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 22:03:50.327 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 22:03:50.327 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.185.165
2026-04-23 22:03:50.327 DEBUG [src.node.docker_mananger] Generated ports ['28081', '28082', '28083', '28084', '28085']
2026-04-23 22:03:50.327 DEBUG [src.node.waku_node] Cluster id was resolved to: 199
2026-04-23 22:03:50.327 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-04-23 22:03:50.327 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 22:03:50.328 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 22:03:50.328 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 22:03:50.328 DEBUG [src.node.docker_mananger] docker run -i -t -p 28081:28081 -p 28082:28082 -p 28083:28083 -p 28084:28084 -p 28085:28085 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=28083 --rest-port=28081 --tcp-port=28082 --discv5-udp-port=28084 --rest-address=0.0.0.0 --nat=extip:172.18.185.165 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=bef3c64bf19839d9c3cc66dffaeaa8ff96ba3b4a8e6f57daa54b9342eed1d6bf --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=28085 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QDrusRNh9LcS1I0MojMaKNzSQaqZSPZ5DRO_nqlPh6ZpHBssRGe_h4WtDRfZvh7BzCfRiCg5anrJ9ZrjNbDHFYkCgmlkgnY0gmlwhKwSSpmKbXVsdGlhZGRyc5YACASsEkqZBpSxAAoErBJKmQaUst0DgnJzhQDHAQAAiXNlY3AyNTZrMaEC99e50sH6m2MgwTT-TfRqYpwIhOZLTeCofS-WlHih0DaDdGNwgpSxg3VkcIKUs4V3YWt1MgU
2026-04-23 22:03:50.550 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.185.165 waku 5dbe44069376690ae33e0fc79baf4a1812cfbf1ffc7affedd8c2c902ffe00a0b
2026-04-23 22:03:50.581 DEBUG [src.node.docker_mananger] Container started with ID 5dbe44069376. Setting up logs at ./log/docker/node8_2026-04-23_22-03-42__e2173aa9-461b-4c2d-ab9e-ad2c7b279625__wakuorg_nwaku:latest.log
2026-04-23 22:03:50.581 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 28081
2026-04-23 22:03:50.581 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 22:03:51.583 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:28081/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:03:51.588 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 22:03:51.589 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 22:03:51.589 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:28081/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:03:51.594 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.185.165/tcp/28082/p2p/16Uiu2HAm8DPeueR59CN6pA45ibgJt3Afar9dazMdeY59NGp6DQWp","/ip4/172.18.185.165/tcp/28083/ws/p2p/16Uiu2HAm8DPeueR59CN6pA45ibgJt3Afar9dazMdeY59NGp6DQWp"],"enrUri":"enr:-L24QGNanTr8x74R6ytu6-OdMdkIwW7boEm7-sGQZuyIYrCYFHrb-OBMf6C9X60ot8rUITkZaMOAdvEufA-i9CcRhxkCgmlkgnY0gmlwhKwSuaWKbXVsdGlhZGRyc5YACASsErmlBm2yAAoErBK5pQZts90DgnJzhQDHAQAAiXNlY3AyNTZrMaECvgKAO-6conVNr3uoteHKrxha7FUGV9XKuhkC1PDDds2DdGNwgm2yg3VkcIJttIV3YWt1MgE"}'
2026-04-23 22:03:51.594 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 22:03:51.595 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:28081/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.74.153/tcp/38065/p2p/16Uiu2HAmC79UEgxEe5bYUf2pH69i9MUr7uDF2MtdG5GTgx8NNoss"]'
2026-04-23 22:03:51.598 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 22:03:51.605 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 22:03:51.605 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node9_2026-04-23_22-03-42__e2173aa9-461b-4c2d-ab9e-ad2c7b279625__wakuorg_nwaku:latest.log
2026-04-23 22:03:51.605 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 22:03:51.606 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 22:03:51.607 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 22:03:51.607 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.92.41
2026-04-23 22:03:51.607 DEBUG [src.node.docker_mananger] Generated ports ['35798', '35799', '35800', '35801', '35802']
2026-04-23 22:03:51.607 DEBUG [src.node.waku_node] Cluster id was resolved to: 199
2026-04-23 22:03:51.607 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-04-23 22:03:51.608 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 22:03:51.608 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 22:03:51.608 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 22:03:51.608 DEBUG [src.node.docker_mananger] docker run -i -t -p 35798:35798 -p 35799:35799 -p 35800:35800 -p 35801:35801 -p 35802:35802 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=35800 --rest-port=35798 --tcp-port=35799 --discv5-udp-port=35801 --rest-address=0.0.0.0 --nat=extip:172.18.92.41 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=26560a102e5cacbd19ad89ac290e8988c268407a9c4b7fad557dffec901c8f7f --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=35802 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QDrusRNh9LcS1I0MojMaKNzSQaqZSPZ5DRO_nqlPh6ZpHBssRGe_h4WtDRfZvh7BzCfRiCg5anrJ9ZrjNbDHFYkCgmlkgnY0gmlwhKwSSpmKbXVsdGlhZGRyc5YACASsEkqZBpSxAAoErBJKmQaUst0DgnJzhQDHAQAAiXNlY3AyNTZrMaEC99e50sH6m2MgwTT-TfRqYpwIhOZLTeCofS-WlHih0DaDdGNwgpSxg3VkcIKUs4V3YWt1MgU
2026-04-23 22:03:51.804 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.92.41 waku ce4f0da5786b747d5910e7954ef4e4757ed31fbc18415bcb6be6b9f82fdf1d7e
2026-04-23 22:03:51.839 DEBUG [src.node.docker_mananger] Container started with ID ce4f0da5786b. Setting up logs at ./log/docker/node9_2026-04-23_22-03-42__e2173aa9-461b-4c2d-ab9e-ad2c7b279625__wakuorg_nwaku:latest.log
2026-04-23 22:03:51.839 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 35798
2026-04-23 22:03:51.839 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 22:03:52.840 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35798/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:03:52.851 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 22:03:52.853 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 22:03:52.853 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35798/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:03:52.856 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.92.41/tcp/35799/p2p/16Uiu2HAmQ2sbnq8TwDErPzPrA1j77T9RnMzGgYdwsQEVzyXrouSM","/ip4/172.18.92.41/tcp/35800/ws/p2p/16Uiu2HAmQ2sbnq8TwDErPzPrA1j77T9RnMzGgYdwsQEVzyXrouSM"],"enrUri":"enr:-L24QEUIcxz5WzZCwjWc5dYCyeOAT-sNud4TxnjYDDL5x_MiWv_UH4Tokc4j-nYhlKr9nzlwElNIAxqpLtYhUIVkyMMCgmlkgnY0gmlwhKwSXCmKbXVsdGlhZGRyc5YACASsElwpBovXAAoErBJcKQaL2N0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDqQuzpqmu6s5NFmCFL1ozgcijPzCGJM75laagWMuQ246DdGNwgovXg3VkcIKL2YV3YWt1MgE"}'
2026-04-23 22:03:52.857 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 22:03:52.857 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35798/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.74.153/tcp/38065/p2p/16Uiu2HAmC79UEgxEe5bYUf2pH69i9MUr7uDF2MtdG5GTgx8NNoss"]'
2026-04-23 22:03:52.860 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 22:03:52.867 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 22:03:52.867 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node10_2026-04-23_22-03-42__e2173aa9-461b-4c2d-ab9e-ad2c7b279625__wakuorg_nwaku:latest.log
2026-04-23 22:03:52.867 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 22:03:52.867 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 22:03:52.869 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 22:03:52.869 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.119.32
2026-04-23 22:03:52.869 DEBUG [src.node.docker_mananger] Generated ports ['15926', '15927', '15928', '15929', '15930']
2026-04-23 22:03:52.869 DEBUG [src.node.waku_node] Cluster id was resolved to: 199
2026-04-23 22:03:52.869 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-04-23 22:03:52.869 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 22:03:52.869 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 22:03:52.870 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 22:03:52.870 DEBUG [src.node.docker_mananger] docker run -i -t -p 15926:15926 -p 15927:15927 -p 15928:15928 -p 15929:15929 -p 15930:15930 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=15928 --rest-port=15926 --tcp-port=15927 --discv5-udp-port=15929 --rest-address=0.0.0.0 --nat=extip:172.18.119.32 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=0e4cfbd1da18eb12e30c90ffad2d24be0bb9a51069f9bcefa76da21f1a4261f0 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=15930 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QDrusRNh9LcS1I0MojMaKNzSQaqZSPZ5DRO_nqlPh6ZpHBssRGe_h4WtDRfZvh7BzCfRiCg5anrJ9ZrjNbDHFYkCgmlkgnY0gmlwhKwSSpmKbXVsdGlhZGRyc5YACASsEkqZBpSxAAoErBJKmQaUst0DgnJzhQDHAQAAiXNlY3AyNTZrMaEC99e50sH6m2MgwTT-TfRqYpwIhOZLTeCofS-WlHih0DaDdGNwgpSxg3VkcIKUs4V3YWt1MgU
2026-04-23 22:03:53.122 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.119.32 waku efce2b6e2762a43e3305748f902976ba1b30fdff81dfe4c9accadd195fe01d19
2026-04-23 22:03:53.159 DEBUG [src.node.docker_mananger] Container started with ID efce2b6e2762. Setting up logs at ./log/docker/node10_2026-04-23_22-03-42__e2173aa9-461b-4c2d-ab9e-ad2c7b279625__wakuorg_nwaku:latest.log
2026-04-23 22:03:53.160 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 15926
2026-04-23 22:03:53.160 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 22:03:54.163 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15926/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:03:54.169 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 22:03:54.169 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 22:03:54.169 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15926/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:03:54.173 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.119.32/tcp/15927/p2p/16Uiu2HAmNCWT9nJ7t6qGtztWo7VvCVmwmf5QDup6k31J4cbtqK2G","/ip4/172.18.119.32/tcp/15928/ws/p2p/16Uiu2HAmNCWT9nJ7t6qGtztWo7VvCVmwmf5QDup6k31J4cbtqK2G"],"enrUri":"enr:-L24QCLTifHjadpfhX0NpadINEBMfbu654750RsKeylWvCEEKwN569KQHq_Iqd2oIF7VQMaKJVu-QvS-CP9Kwx7fsaQCgmlkgnY0gmlwhKwSdyCKbXVsdGlhZGRyc5YACASsEncgBj43AAoErBJ3IAY-ON0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDjcw5Cjj-u1Q4izdd1vwox7xr7LF-uTYmOfHlQ9-2CQGDdGNwgj43g3VkcII-OYV3YWt1MgE"}'
2026-04-23 22:03:54.174 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 22:03:54.174 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:15926/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.74.153/tcp/38065/p2p/16Uiu2HAmC79UEgxEe5bYUf2pH69i9MUr7uDF2MtdG5GTgx8NNoss"]'
2026-04-23 22:03:54.179 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 22:03:54.186 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 22:03:54.186 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node11_2026-04-23_22-03-42__e2173aa9-461b-4c2d-ab9e-ad2c7b279625__wakuorg_nwaku:latest.log
2026-04-23 22:03:54.187 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 22:03:54.187 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 22:03:54.188 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 22:03:54.188 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.209.27
2026-04-23 22:03:54.188 DEBUG [src.node.docker_mananger] Generated ports ['43633', '43634', '43635', '43636', '43637']
2026-04-23 22:03:54.189 DEBUG [src.node.waku_node] Cluster id was resolved to: 199
2026-04-23 22:03:54.189 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-04-23 22:03:54.189 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 22:03:54.189 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 22:03:54.189 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 22:03:54.189 DEBUG [src.node.docker_mananger] docker run -i -t -p 43633:43633 -p 43634:43634 -p 43635:43635 -p 43636:43636 -p 43637:43637 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=43635 --rest-port=43633 --tcp-port=43634 --discv5-udp-port=43636 --rest-address=0.0.0.0 --nat=extip:172.18.209.27 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=1c238fddb09fa0fdfa894bcd8a1c12e3d28aa5ab8f5e67dadbff721fd848ff2f --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=43637 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QDrusRNh9LcS1I0MojMaKNzSQaqZSPZ5DRO_nqlPh6ZpHBssRGe_h4WtDRfZvh7BzCfRiCg5anrJ9ZrjNbDHFYkCgmlkgnY0gmlwhKwSSpmKbXVsdGlhZGRyc5YACASsEkqZBpSxAAoErBJKmQaUst0DgnJzhQDHAQAAiXNlY3AyNTZrMaEC99e50sH6m2MgwTT-TfRqYpwIhOZLTeCofS-WlHih0DaDdGNwgpSxg3VkcIKUs4V3YWt1MgU
2026-04-23 22:03:54.421 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.209.27 waku 8d698ee498c11439053f198c00b7c86b8a7a5bc32e127337827a73a1a7db6aa5
2026-04-23 22:03:54.457 DEBUG [src.node.docker_mananger] Container started with ID 8d698ee498c1. Setting up logs at ./log/docker/node11_2026-04-23_22-03-42__e2173aa9-461b-4c2d-ab9e-ad2c7b279625__wakuorg_nwaku:latest.log
2026-04-23 22:03:54.457 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 43633
2026-04-23 22:03:54.457 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 22:03:55.460 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43633/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:03:55.476 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 22:03:55.481 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 22:03:55.488 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43633/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:03:55.505 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.209.27/tcp/43634/p2p/16Uiu2HAkwAoZsLQVcgmR9eddYNxD6atPTf5mQcnyR2TAmeEmDqv9","/ip4/172.18.209.27/tcp/43635/ws/p2p/16Uiu2HAkwAoZsLQVcgmR9eddYNxD6atPTf5mQcnyR2TAmeEmDqv9"],"enrUri":"enr:-L24QAlv9PuO990m2ByfnXXk_WbItSNH6PZ3H0qnmosvflpIH-lWMg38EVudg_l8zlMNlxgqGEUt3NijWNAiT46x9TgCgmlkgnY0gmlwhKwS0RuKbXVsdGlhZGRyc5YACASsEtEbBqpyAAoErBLRGwaqc90DgnJzhQDHAQAAiXNlY3AyNTZrMaECGeg9rcZpRFmiUgg5DRdvAT_sgSYTCnVQzN5-IkY62sqDdGNwgqpyg3VkcIKqdIV3YWt1MgE"}'
2026-04-23 22:03:55.506 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 22:03:55.506 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43633/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.74.153/tcp/38065/p2p/16Uiu2HAmC79UEgxEe5bYUf2pH69i9MUr7uDF2MtdG5GTgx8NNoss"]'
2026-04-23 22:03:55.513 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 22:03:55.514 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38064/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/199/0"]'
2026-04-23 22:03:55.518 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 22:03:55.518 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17012/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/199/0"]'
2026-04-23 22:03:55.526 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 22:03:55.527 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22224/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/199/0"]'
2026-04-23 22:03:55.532 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 22:03:55.533 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:28225/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/199/0"]'
2026-04-23 22:03:55.539 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 22:03:55.540 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14018/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/199/0"]'
2026-04-23 22:03:55.542 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 22:03:55.542 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:49095/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/199/0"]'
2026-04-23 22:03:55.545 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 22:03:55.545 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:28081/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/199/0"]'
2026-04-23 22:03:55.548 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 22:03:55.548 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35798/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/199/0"]'
2026-04-23 22:03:55.551 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 22:03:55.551 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:15926/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/199/0"]'
2026-04-23 22:03:55.554 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 22:03:55.555 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43633/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/199/0"]'
2026-04-23 22:03:55.557 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 22:03:55.558 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38064/relay/v1/messages/%2Fwaku%2F2%2Frs%2F199%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-04-23 22:03:55.584 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 22:03:55.589 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-04-23 22:03:55.693 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-04-23 22:03:55.694 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38064/relay/v1/messages/%2Fwaku%2F2%2Frs%2F199%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:03:55.697 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981835558110301,"ephemeral":false,"proof":""}]'
2026-04-23 22:03:55.698 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-04-23 22:03:55.699 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17012/relay/v1/messages/%2Fwaku%2F2%2Frs%2F199%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:03:55.701 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981835558110301,"ephemeral":false,"proof":""}]'
2026-04-23 22:03:55.703 DEBUG [src.steps.sharding] Checking that peer NODE_3:wakuorg/nwaku:latest can find the published message
2026-04-23 22:03:55.703 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:22224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F199%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:03:55.706 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981835558110301,"ephemeral":false,"proof":""}]'
2026-04-23 22:03:55.707 DEBUG [src.steps.sharding] Checking that peer NODE_4:wakuorg/nwaku:latest can find the published message
2026-04-23 22:03:55.708 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:28225/relay/v1/messages/%2Fwaku%2F2%2Frs%2F199%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:03:55.710 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981835558110301,"ephemeral":false,"proof":""}]'
2026-04-23 22:03:55.712 DEBUG [src.steps.sharding] Checking that peer NODE_5:wakuorg/nwaku:latest can find the published message
2026-04-23 22:03:55.712 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14018/relay/v1/messages/%2Fwaku%2F2%2Frs%2F199%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:03:55.715 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981835558110301,"ephemeral":false,"proof":""}]'
2026-04-23 22:03:55.717 DEBUG [src.steps.sharding] Checking that peer NODE_6:wakuorg/nwaku:latest can find the published message
2026-04-23 22:03:55.718 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:49095/relay/v1/messages/%2Fwaku%2F2%2Frs%2F199%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:03:55.720 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981835558110301,"ephemeral":false,"proof":""}]'
2026-04-23 22:03:55.721 DEBUG [src.steps.sharding] Checking that peer NODE_7:wakuorg/nwaku:latest can find the published message
2026-04-23 22:03:55.721 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:28081/relay/v1/messages/%2Fwaku%2F2%2Frs%2F199%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:03:55.724 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981835558110301,"ephemeral":false,"proof":""}]'
2026-04-23 22:03:55.725 DEBUG [src.steps.sharding] Checking that peer NODE_8:wakuorg/nwaku:latest can find the published message
2026-04-23 22:03:55.726 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35798/relay/v1/messages/%2Fwaku%2F2%2Frs%2F199%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:03:55.728 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981835558110301,"ephemeral":false,"proof":""}]'
2026-04-23 22:03:55.730 DEBUG [src.steps.sharding] Checking that peer NODE_9:wakuorg/nwaku:latest can find the published message
2026-04-23 22:03:55.730 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15926/relay/v1/messages/%2Fwaku%2F2%2Frs%2F199%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:03:55.733 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981835558110301,"ephemeral":false,"proof":""}]'
2026-04-23 22:03:55.735 DEBUG [src.steps.sharding] Checking that peer NODE_10:wakuorg/nwaku:latest can find the published message
2026-04-23 22:03:55.735 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43633/relay/v1/messages/%2Fwaku%2F2%2Frs%2F199%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:03:55.739 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981835558110301,"ephemeral":false,"proof":""}]'
2026-04-23 22:03:55.743 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-04-23 22:03:55.744 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-04-23 22:03:55.744 DEBUG [src.node.waku_node] Stopping container with id 29acb7626930
2026-04-23 22:03:56.391 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 22:03:56.392 DEBUG [src.node.waku_node] Stopping container with id bdd958192dc1
2026-04-23 22:03:56.929 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 22:03:56.930 DEBUG [src.node.waku_node] Stopping container with id 1743626024b8
2026-04-23 22:03:57.212 ERROR [src.node.docker_mananger] Max retries reached for container 29acb7626930. Exiting log stream.
2026-04-23 22:03:57.462 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 22:03:57.462 DEBUG [src.node.waku_node] Stopping container with id 865fa1b28e05
2026-04-23 22:03:57.740 ERROR [src.node.docker_mananger] Max retries reached for container bdd958192dc1. Exiting log stream.
2026-04-23 22:03:57.966 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 22:03:57.968 DEBUG [src.node.waku_node] Stopping container with id 38132a68ca5a
2026-04-23 22:03:58.276 ERROR [src.node.docker_mananger] Max retries reached for container 1743626024b8. Exiting log stream.
2026-04-23 22:03:58.479 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 22:03:58.479 DEBUG [src.node.waku_node] Stopping container with id 1551e4954b87
2026-04-23 22:03:58.876 ERROR [src.node.docker_mananger] Max retries reached for container 865fa1b28e05. Exiting log stream.
2026-04-23 22:03:59.004 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 22:03:59.006 DEBUG [src.node.waku_node] Stopping container with id 5dbe44069376
2026-04-23 22:03:59.291 ERROR [src.node.docker_mananger] Max retries reached for container 38132a68ca5a. Exiting log stream.
2026-04-23 22:03:59.537 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 22:03:59.537 DEBUG [src.node.waku_node] Stopping container with id ce4f0da5786b
2026-04-23 22:03:59.886 ERROR [src.node.docker_mananger] Max retries reached for container 1551e4954b87. Exiting log stream.
2026-04-23 22:04:00.039 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 22:04:00.040 DEBUG [src.node.waku_node] Stopping container with id efce2b6e2762
2026-04-23 22:04:00.398 ERROR [src.node.docker_mananger] Max retries reached for container 5dbe44069376. Exiting log stream.
2026-04-23 22:04:00.530 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 22:04:00.530 DEBUG [src.node.waku_node] Stopping container with id 8d698ee498c1
2026-04-23 22:04:00.855 ERROR [src.node.docker_mananger] Max retries reached for container ce4f0da5786b. Exiting log stream.
2026-04-23 22:04:01.018 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 22:04:01.020 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-04-23 22:04:01.061 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 22:04:01.086 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 22:04:01.113 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 22:04:01.176 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 22:04:01.204 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 22:04:01.258 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 22:04:01.290 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 22:04:01.299 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 22:04:01.304 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 22:04:01.310 DEBUG [src.node.docker_mananger] No errors found in the waku logs.