350 lines
64 KiB
Plaintext

2026-02-28 04:28:30.604 DEBUG [tests.conftest] Running fixture setup: test_id
2026-02-28 04:28:30.605 DEBUG [tests.conftest] Running test: test_static_shard_relay_10_nwaku_nodes with id: 2026-02-28_04-28-30__1c6de10d-8291-4d41-8482-72964eb4c16c
2026-02-28 04:28:30.605 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-02-28 04:28:30.605 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-02-28 04:28:30.605 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-02-28 04:28:30.613 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-28 04:28:30.613 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-02-28_04-28-30__1c6de10d-8291-4d41-8482-72964eb4c16c__wakuorg_nwaku:latest.log
2026-02-28 04:28:30.613 DEBUG [src.node.waku_node] Starting Node...
2026-02-28 04:28:30.614 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-28 04:28:30.615 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-28 04:28:30.615 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.55.3
2026-02-28 04:28:30.615 DEBUG [src.node.docker_mananger] Generated ports ['15382', '15383', '15384', '15385', '15386']
2026-02-28 04:28:30.616 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-02-28 04:28:30.616 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-02-28 04:28:30.616 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-28 04:28:30.616 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-28 04:28:30.616 DEBUG [src.node.waku_node] Using volumes []
2026-02-28 04:28:30.616 DEBUG [src.node.docker_mananger] docker run -i -t -p 15382:15382 -p 15383:15383 -p 15384:15384 -p 15385:15385 -p 15386:15386 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=15384 --rest-port=15382 --tcp-port=15383 --discv5-udp-port=15385 --rest-address=0.0.0.0 --nat=extip:172.18.55.3 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=efa03b6bea5af9b37b25ebfdddb06cfeade4edce55f6de017d5ae0076692f640 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=15386 --metrics-logging=true --relay=true --filter=true
2026-02-28 04:28:30.818 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.55.3 waku cecc5650b07bb9e4a748d6bb4dd971910368f85196d9afa1f9d191405dbf2ae6
2026-02-28 04:28:30.848 ERROR [src.node.docker_mananger] Max retries reached for container ca151812f0c6. Exiting log stream.
2026-02-28 04:28:30.851 DEBUG [src.node.docker_mananger] Container started with ID cecc5650b07b. Setting up logs at ./log/docker/node1_2026-02-28_04-28-30__1c6de10d-8291-4d41-8482-72964eb4c16c__wakuorg_nwaku:latest.log
2026-02-28 04:28:30.852 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 15382
2026-02-28 04:28:30.852 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-28 04:28:31.404 ERROR [src.node.docker_mananger] Max retries reached for container 2fa9f49cd7e4. Exiting log stream.
2026-02-28 04:28:31.853 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15382/health" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:28:31.856 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-28 04:28:31.856 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-28 04:28:31.856 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15382/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:28:31.859 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.55.3/tcp/15383/p2p/16Uiu2HAmHQK1kfVFWuztKu7xJ7ZqtPh63hbVxXwC3CNhpUXXuth3","/ip4/172.18.55.3/tcp/15384/ws/p2p/16Uiu2HAmHQK1kfVFWuztKu7xJ7ZqtPh63hbVxXwC3CNhpUXXuth3"],"enrUri":"enr:-L24QErAqfaxai3bxp3AvhxcWGeCRTihdLdFe70cLbIdh1FZTLEZMq-ZHLp-ZXHAx93rGvj3chYM7hYnmlr9bH7h6C8CgmlkgnY0gmlwhKwSNwOKbXVsdGlhZGRyc5YACASsEjcDBjwXAAoErBI3AwY8GN0DgnJzhQACAQAAiXNlY3AyNTZrMaEDRofTM62KnrwsVueYFxwvg8MRY9u3NCj2TzSKXtabVD6DdGNwgjwXg3VkcII8GYV3YWt1MgU"}'
2026-02-28 04:28:31.859 INFO [src.node.waku_node] REST service is ready !!
2026-02-28 04:28:31.866 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-28 04:28:31.866 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-02-28_04-28-30__1c6de10d-8291-4d41-8482-72964eb4c16c__wakuorg_nwaku:latest.log
2026-02-28 04:28:31.866 DEBUG [src.node.waku_node] Starting Node...
2026-02-28 04:28:31.866 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-28 04:28:31.867 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-28 04:28:31.868 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.193.250
2026-02-28 04:28:31.868 DEBUG [src.node.docker_mananger] Generated ports ['43740', '43741', '43742', '43743', '43744']
2026-02-28 04:28:31.868 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-02-28 04:28:31.868 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-02-28 04:28:31.868 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-28 04:28:31.868 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-28 04:28:31.868 DEBUG [src.node.waku_node] Using volumes []
2026-02-28 04:28:31.869 DEBUG [src.node.docker_mananger] docker run -i -t -p 43740:43740 -p 43741:43741 -p 43742:43742 -p 43743:43743 -p 43744:43744 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=43742 --rest-port=43740 --tcp-port=43741 --discv5-udp-port=43743 --rest-address=0.0.0.0 --nat=extip:172.18.193.250 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=a2dace50afd590d1e5e6edc8c1f9ea7bdc92cdafbc1be0fa4ed1fd9cb5cfadb3 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=43744 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QErAqfaxai3bxp3AvhxcWGeCRTihdLdFe70cLbIdh1FZTLEZMq-ZHLp-ZXHAx93rGvj3chYM7hYnmlr9bH7h6C8CgmlkgnY0gmlwhKwSNwOKbXVsdGlhZGRyc5YACASsEjcDBjwXAAoErBI3AwY8GN0DgnJzhQACAQAAiXNlY3AyNTZrMaEDRofTM62KnrwsVueYFxwvg8MRY9u3NCj2TzSKXtabVD6DdGNwgjwXg3VkcII8GYV3YWt1MgU
2026-02-28 04:28:32.073 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.193.250 waku b7ef0d684b6dc7835158cc85da54eaaab04b5d40fcb913130ef4a431c8fb241a
2026-02-28 04:28:32.107 DEBUG [src.node.docker_mananger] Container started with ID b7ef0d684b6d. Setting up logs at ./log/docker/node3_2026-02-28_04-28-30__1c6de10d-8291-4d41-8482-72964eb4c16c__wakuorg_nwaku:latest.log
2026-02-28 04:28:32.108 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 43740
2026-02-28 04:28:32.108 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-28 04:28:33.108 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43740/health" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:28:33.133 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-28 04:28:33.135 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-28 04:28:33.136 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43740/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:28:33.139 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.193.250/tcp/43741/p2p/16Uiu2HAmKogBgVWNWHHwZ27zobnTtCtcsN3jbe2XjqfLzb31kS7g","/ip4/172.18.193.250/tcp/43742/ws/p2p/16Uiu2HAmKogBgVWNWHHwZ27zobnTtCtcsN3jbe2XjqfLzb31kS7g"],"enrUri":"enr:-L24QEfw-8kDzeiOiQzhlHR5-akPFRn1dCavfY_NckWCgHMhA7yltJrGmz_4PjgsK9FtIdGsX2ByHLIX6_QdGDSuxKcCgmlkgnY0gmlwhKwSwfqKbXVsdGlhZGRyc5YACASsEsH6BqrdAAoErBLB-gaq3t0DgnJzhQACAQAAiXNlY3AyNTZrMaEDajt-7CjIXI8XjmiI2favJaTeDs1pxR_cPx6pJG5J4_-DdGNwgqrdg3VkcIKq34V3YWt1MgE"}'
2026-02-28 04:28:33.139 INFO [src.node.waku_node] REST service is ready !!
2026-02-28 04:28:33.139 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43740/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.55.3/tcp/15383/p2p/16Uiu2HAmHQK1kfVFWuztKu7xJ7ZqtPh63hbVxXwC3CNhpUXXuth3"]'
2026-02-28 04:28:33.142 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:28:33.149 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-28 04:28:33.149 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-02-28_04-28-30__1c6de10d-8291-4d41-8482-72964eb4c16c__wakuorg_nwaku:latest.log
2026-02-28 04:28:33.149 DEBUG [src.node.waku_node] Starting Node...
2026-02-28 04:28:33.149 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-28 04:28:33.151 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-28 04:28:33.151 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.21.230
2026-02-28 04:28:33.151 DEBUG [src.node.docker_mananger] Generated ports ['31577', '31578', '31579', '31580', '31581']
2026-02-28 04:28:33.151 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-02-28 04:28:33.151 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-02-28 04:28:33.151 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-28 04:28:33.151 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-28 04:28:33.152 DEBUG [src.node.waku_node] Using volumes []
2026-02-28 04:28:33.152 DEBUG [src.node.docker_mananger] docker run -i -t -p 31577:31577 -p 31578:31578 -p 31579:31579 -p 31580:31580 -p 31581:31581 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=31579 --rest-port=31577 --tcp-port=31578 --discv5-udp-port=31580 --rest-address=0.0.0.0 --nat=extip:172.18.21.230 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=6a6bc5ce661e7c9e5abb5ec78d32ab16b9d8d0fc20c6e4d18ec6aa91c118e0fc --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=31581 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QErAqfaxai3bxp3AvhxcWGeCRTihdLdFe70cLbIdh1FZTLEZMq-ZHLp-ZXHAx93rGvj3chYM7hYnmlr9bH7h6C8CgmlkgnY0gmlwhKwSNwOKbXVsdGlhZGRyc5YACASsEjcDBjwXAAoErBI3AwY8GN0DgnJzhQACAQAAiXNlY3AyNTZrMaEDRofTM62KnrwsVueYFxwvg8MRY9u3NCj2TzSKXtabVD6DdGNwgjwXg3VkcII8GYV3YWt1MgU
2026-02-28 04:28:33.352 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.21.230 waku 87468dc47232c7565cad7ff5560c67dcca539292ea3d8201f51559cc7fa35515
2026-02-28 04:28:33.386 DEBUG [src.node.docker_mananger] Container started with ID 87468dc47232. Setting up logs at ./log/docker/node4_2026-02-28_04-28-30__1c6de10d-8291-4d41-8482-72964eb4c16c__wakuorg_nwaku:latest.log
2026-02-28 04:28:33.387 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 31577
2026-02-28 04:28:33.387 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-28 04:28:34.388 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31577/health" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:28:34.403 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-28 04:28:34.403 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-28 04:28:34.404 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31577/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:28:34.410 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.21.230/tcp/31578/p2p/16Uiu2HAm1jkgD85E8StnSX1TdC8Zw9ZzXmHgo2Ss6ZRW1RpL4xQD","/ip4/172.18.21.230/tcp/31579/ws/p2p/16Uiu2HAm1jkgD85E8StnSX1TdC8Zw9ZzXmHgo2Ss6ZRW1RpL4xQD"],"enrUri":"enr:-L24QLIWj_kKnS7A--vWpUTcZgq-dBlsvhTyVww_cO76-CnnUhaD5-6qebcGjoWYdo1HImh91kt2iJA_DW2oBpEbbh8CgmlkgnY0gmlwhKwSFeaKbXVsdGlhZGRyc5YACASsEhXmBntaAAoErBIV5gZ7W90DgnJzhQACAQAAiXNlY3AyNTZrMaECXcfjCGp1BD7h-Pz_DZKV6kbcM4iRQ06uKYHmkRhdAgaDdGNwgntag3VkcIJ7XIV3YWt1MgE"}'
2026-02-28 04:28:34.411 INFO [src.node.waku_node] REST service is ready !!
2026-02-28 04:28:34.411 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:31577/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.55.3/tcp/15383/p2p/16Uiu2HAmHQK1kfVFWuztKu7xJ7ZqtPh63hbVxXwC3CNhpUXXuth3"]'
2026-02-28 04:28:34.415 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:28:34.422 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-28 04:28:34.422 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-02-28_04-28-30__1c6de10d-8291-4d41-8482-72964eb4c16c__wakuorg_nwaku:latest.log
2026-02-28 04:28:34.422 DEBUG [src.node.waku_node] Starting Node...
2026-02-28 04:28:34.422 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-28 04:28:34.424 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-28 04:28:34.424 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.139.22
2026-02-28 04:28:34.424 DEBUG [src.node.docker_mananger] Generated ports ['16282', '16283', '16284', '16285', '16286']
2026-02-28 04:28:34.424 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-02-28 04:28:34.424 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-02-28 04:28:34.424 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-28 04:28:34.425 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-28 04:28:34.425 DEBUG [src.node.waku_node] Using volumes []
2026-02-28 04:28:34.425 DEBUG [src.node.docker_mananger] docker run -i -t -p 16282:16282 -p 16283:16283 -p 16284:16284 -p 16285:16285 -p 16286:16286 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=16284 --rest-port=16282 --tcp-port=16283 --discv5-udp-port=16285 --rest-address=0.0.0.0 --nat=extip:172.18.139.22 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=ec5bceecdc1efab4fbbaab1ca8ddcab24b9b7ba389f1bedfbd7c9ade9cc3873e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=16286 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QErAqfaxai3bxp3AvhxcWGeCRTihdLdFe70cLbIdh1FZTLEZMq-ZHLp-ZXHAx93rGvj3chYM7hYnmlr9bH7h6C8CgmlkgnY0gmlwhKwSNwOKbXVsdGlhZGRyc5YACASsEjcDBjwXAAoErBI3AwY8GN0DgnJzhQACAQAAiXNlY3AyNTZrMaEDRofTM62KnrwsVueYFxwvg8MRY9u3NCj2TzSKXtabVD6DdGNwgjwXg3VkcII8GYV3YWt1MgU
2026-02-28 04:28:34.626 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.139.22 waku 74e30e46cd80c88124b6d0b2407e77290d8e97ee6723204982cebbac213b5ef2
2026-02-28 04:28:34.659 DEBUG [src.node.docker_mananger] Container started with ID 74e30e46cd80. Setting up logs at ./log/docker/node5_2026-02-28_04-28-30__1c6de10d-8291-4d41-8482-72964eb4c16c__wakuorg_nwaku:latest.log
2026-02-28 04:28:34.659 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 16282
2026-02-28 04:28:34.659 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-28 04:28:35.660 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:16282/health" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:28:35.681 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-28 04:28:35.683 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-28 04:28:35.684 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:16282/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:28:35.688 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.139.22/tcp/16283/p2p/16Uiu2HAkxgciJgan9wDiSxYzCCNLXQTTJtbYKz5uY565UynoqPMM","/ip4/172.18.139.22/tcp/16284/ws/p2p/16Uiu2HAkxgciJgan9wDiSxYzCCNLXQTTJtbYKz5uY565UynoqPMM"],"enrUri":"enr:-L24QBSzS1xGNdtKUKkswFiiLrDgkcLp1lL_xth4jVTwixeJUIpyd60OlgEcgMOoj5NchJ8gj-A7RhyobmyRdDQMn3oCgmlkgnY0gmlwhKwSixaKbXVsdGlhZGRyc5YACASsEosWBj-bAAoErBKLFgY_nN0DgnJzhQACAQAAiXNlY3AyNTZrMaECMGcUMOC5XbjvfOwIBdN5pk9H5aqL8hhwWCEzbIS1OrSDdGNwgj-bg3VkcII_nYV3YWt1MgE"}'
2026-02-28 04:28:35.688 INFO [src.node.waku_node] REST service is ready !!
2026-02-28 04:28:35.689 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:16282/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.55.3/tcp/15383/p2p/16Uiu2HAmHQK1kfVFWuztKu7xJ7ZqtPh63hbVxXwC3CNhpUXXuth3"]'
2026-02-28 04:28:35.691 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:28:35.698 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-28 04:28:35.698 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node6_2026-02-28_04-28-30__1c6de10d-8291-4d41-8482-72964eb4c16c__wakuorg_nwaku:latest.log
2026-02-28 04:28:35.699 DEBUG [src.node.waku_node] Starting Node...
2026-02-28 04:28:35.699 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-28 04:28:35.700 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-28 04:28:35.700 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.144.80
2026-02-28 04:28:35.700 DEBUG [src.node.docker_mananger] Generated ports ['59839', '59840', '59841', '59842', '59843']
2026-02-28 04:28:35.700 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-02-28 04:28:35.701 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-02-28 04:28:35.701 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-28 04:28:35.701 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-28 04:28:35.701 DEBUG [src.node.waku_node] Using volumes []
2026-02-28 04:28:35.701 DEBUG [src.node.docker_mananger] docker run -i -t -p 59839:59839 -p 59840:59840 -p 59841:59841 -p 59842:59842 -p 59843:59843 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=59841 --rest-port=59839 --tcp-port=59840 --discv5-udp-port=59842 --rest-address=0.0.0.0 --nat=extip:172.18.144.80 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=2c6b3a850ddc7e7ccf034c4c63aaef60bb0ec8b2baf2aca8c4fd4aa945f9ae8f --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=59843 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QErAqfaxai3bxp3AvhxcWGeCRTihdLdFe70cLbIdh1FZTLEZMq-ZHLp-ZXHAx93rGvj3chYM7hYnmlr9bH7h6C8CgmlkgnY0gmlwhKwSNwOKbXVsdGlhZGRyc5YACASsEjcDBjwXAAoErBI3AwY8GN0DgnJzhQACAQAAiXNlY3AyNTZrMaEDRofTM62KnrwsVueYFxwvg8MRY9u3NCj2TzSKXtabVD6DdGNwgjwXg3VkcII8GYV3YWt1MgU
2026-02-28 04:28:35.908 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.144.80 waku 5de7286c1bae675d33bae615c7256af91514283dea4dd8a73861612eae35a3f3
2026-02-28 04:28:35.940 DEBUG [src.node.docker_mananger] Container started with ID 5de7286c1bae. Setting up logs at ./log/docker/node6_2026-02-28_04-28-30__1c6de10d-8291-4d41-8482-72964eb4c16c__wakuorg_nwaku:latest.log
2026-02-28 04:28:35.941 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 59839
2026-02-28 04:28:35.941 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-28 04:28:36.942 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:59839/health" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:28:36.962 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-28 04:28:36.965 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-28 04:28:36.965 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:59839/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:28:36.970 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.144.80/tcp/59840/p2p/16Uiu2HAmG3VjDBKnP6ib5yEhjQy5987f6sfDZyLAWUd8R7a8Gifk","/ip4/172.18.144.80/tcp/59841/ws/p2p/16Uiu2HAmG3VjDBKnP6ib5yEhjQy5987f6sfDZyLAWUd8R7a8Gifk"],"enrUri":"enr:-L24QDAgAiAycXGUpICjGb1RcDa4dZ5KMyKSzJZ5Jeq9J20hPfpO2-AlkXDEFGyFJUujIPJ6K6guaFaD0dozAkrFGU0CgmlkgnY0gmlwhKwSkFCKbXVsdGlhZGRyc5YACASsEpBQBunAAAoErBKQUAbpwd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDMlcOa5Hp9RTfR09Pr_4z1nnicmkBmWrQOv9kT6V0JXODdGNwgunAg3VkcILpwoV3YWt1MgE"}'
2026-02-28 04:28:36.970 INFO [src.node.waku_node] REST service is ready !!
2026-02-28 04:28:36.971 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59839/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.55.3/tcp/15383/p2p/16Uiu2HAmHQK1kfVFWuztKu7xJ7ZqtPh63hbVxXwC3CNhpUXXuth3"]'
2026-02-28 04:28:36.973 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:28:36.980 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-28 04:28:36.981 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node7_2026-02-28_04-28-30__1c6de10d-8291-4d41-8482-72964eb4c16c__wakuorg_nwaku:latest.log
2026-02-28 04:28:36.981 DEBUG [src.node.waku_node] Starting Node...
2026-02-28 04:28:36.981 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-28 04:28:36.982 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-28 04:28:36.982 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.139.73
2026-02-28 04:28:36.983 DEBUG [src.node.docker_mananger] Generated ports ['24062', '24063', '24064', '24065', '24066']
2026-02-28 04:28:36.983 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-02-28 04:28:36.983 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-02-28 04:28:36.983 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-28 04:28:36.983 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-28 04:28:36.983 DEBUG [src.node.waku_node] Using volumes []
2026-02-28 04:28:36.983 DEBUG [src.node.docker_mananger] docker run -i -t -p 24062:24062 -p 24063:24063 -p 24064:24064 -p 24065:24065 -p 24066:24066 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=24064 --rest-port=24062 --tcp-port=24063 --discv5-udp-port=24065 --rest-address=0.0.0.0 --nat=extip:172.18.139.73 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=8f08abace4c2d7cfd3c6a3d8fb050b87cdb9a37dfc3f39c25ec9fcb748e6ce6d --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=24066 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QErAqfaxai3bxp3AvhxcWGeCRTihdLdFe70cLbIdh1FZTLEZMq-ZHLp-ZXHAx93rGvj3chYM7hYnmlr9bH7h6C8CgmlkgnY0gmlwhKwSNwOKbXVsdGlhZGRyc5YACASsEjcDBjwXAAoErBI3AwY8GN0DgnJzhQACAQAAiXNlY3AyNTZrMaEDRofTM62KnrwsVueYFxwvg8MRY9u3NCj2TzSKXtabVD6DdGNwgjwXg3VkcII8GYV3YWt1MgU
2026-02-28 04:28:37.185 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.139.73 waku 9be1cf1ab216b56475a7e5b57b5124e9d52554b3b0273906a615284d1bd7c74c
2026-02-28 04:28:37.224 DEBUG [src.node.docker_mananger] Container started with ID 9be1cf1ab216. Setting up logs at ./log/docker/node7_2026-02-28_04-28-30__1c6de10d-8291-4d41-8482-72964eb4c16c__wakuorg_nwaku:latest.log
2026-02-28 04:28:37.225 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 24062
2026-02-28 04:28:37.225 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-28 04:28:38.226 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24062/health" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:28:38.243 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-28 04:28:38.246 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-28 04:28:38.247 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24062/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:28:38.250 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.139.73/tcp/24063/p2p/16Uiu2HAmF6xadFKmZgD6ziPaykuFaCM5NJPWbkxzjBQMvtvDCrwt","/ip4/172.18.139.73/tcp/24064/ws/p2p/16Uiu2HAmF6xadFKmZgD6ziPaykuFaCM5NJPWbkxzjBQMvtvDCrwt"],"enrUri":"enr:-L24QMYI5CcQqJIaj6_g1qMu9BkzX7gkAMT_sJDEz7Ics7hMQtZ3hVADCPELcFApTUNx0V4as_PVpvd7khi24z6vrroCgmlkgnY0gmlwhKwSi0mKbXVsdGlhZGRyc5YACASsEotJBl3_AAoErBKLSQZeAN0DgnJzhQACAQAAiXNlY3AyNTZrMaEDJF55NODg9j6dUhKPFbjnviHLpP6iqpp0M1qSenzppCuDdGNwgl3_g3VkcIJeAYV3YWt1MgE"}'
2026-02-28 04:28:38.250 INFO [src.node.waku_node] REST service is ready !!
2026-02-28 04:28:38.251 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24062/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.55.3/tcp/15383/p2p/16Uiu2HAmHQK1kfVFWuztKu7xJ7ZqtPh63hbVxXwC3CNhpUXXuth3"]'
2026-02-28 04:28:38.253 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:28:38.260 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-28 04:28:38.260 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node8_2026-02-28_04-28-30__1c6de10d-8291-4d41-8482-72964eb4c16c__wakuorg_nwaku:latest.log
2026-02-28 04:28:38.261 DEBUG [src.node.waku_node] Starting Node...
2026-02-28 04:28:38.261 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-28 04:28:38.262 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-28 04:28:38.262 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.157.236
2026-02-28 04:28:38.262 DEBUG [src.node.docker_mananger] Generated ports ['18904', '18905', '18906', '18907', '18908']
2026-02-28 04:28:38.262 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-02-28 04:28:38.262 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-02-28 04:28:38.263 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-28 04:28:38.263 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-28 04:28:38.263 DEBUG [src.node.waku_node] Using volumes []
2026-02-28 04:28:38.263 DEBUG [src.node.docker_mananger] docker run -i -t -p 18904:18904 -p 18905:18905 -p 18906:18906 -p 18907:18907 -p 18908:18908 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=18906 --rest-port=18904 --tcp-port=18905 --discv5-udp-port=18907 --rest-address=0.0.0.0 --nat=extip:172.18.157.236 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=cd34a1decedd5dbc3ac2c174ba3e0cee809457377a3dcba8aaed627bb513dbc2 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=18908 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QErAqfaxai3bxp3AvhxcWGeCRTihdLdFe70cLbIdh1FZTLEZMq-ZHLp-ZXHAx93rGvj3chYM7hYnmlr9bH7h6C8CgmlkgnY0gmlwhKwSNwOKbXVsdGlhZGRyc5YACASsEjcDBjwXAAoErBI3AwY8GN0DgnJzhQACAQAAiXNlY3AyNTZrMaEDRofTM62KnrwsVueYFxwvg8MRY9u3NCj2TzSKXtabVD6DdGNwgjwXg3VkcII8GYV3YWt1MgU
2026-02-28 04:28:38.468 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.157.236 waku e7760dfb9995cad56f378d4b145a23ccf7293a671d3496eea467282ad60ee831
2026-02-28 04:28:38.506 DEBUG [src.node.docker_mananger] Container started with ID e7760dfb9995. Setting up logs at ./log/docker/node8_2026-02-28_04-28-30__1c6de10d-8291-4d41-8482-72964eb4c16c__wakuorg_nwaku:latest.log
2026-02-28 04:28:38.507 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 18904
2026-02-28 04:28:38.507 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-28 04:28:39.508 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18904/health" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:28:39.524 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-28 04:28:39.527 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-28 04:28:39.528 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18904/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:28:39.534 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.157.236/tcp/18905/p2p/16Uiu2HAkykiQUhvDZ9n9JvvrKJh3wbkjrwKdLSnHVgtLHJyoS4Mc","/ip4/172.18.157.236/tcp/18906/ws/p2p/16Uiu2HAkykiQUhvDZ9n9JvvrKJh3wbkjrwKdLSnHVgtLHJyoS4Mc"],"enrUri":"enr:-L24QLvn9CQGKMMXgJP_XcHO8VfFdJRXbrrPBj4_lDJae1qFHHsi13ukSP8aFblBUj0S87zrl-3PNLZsLJmRVe3zcdwCgmlkgnY0gmlwhKwSneyKbXVsdGlhZGRyc5YACASsEp3sBknZAAoErBKd7AZJ2t0DgnJzhQACAQAAiXNlY3AyNTZrMaECQE-GlVMCzM4hPpxDYhCNhaNsteVm87hIbLnYFmTnHR-DdGNwgknZg3VkcIJJ24V3YWt1MgE"}'
2026-02-28 04:28:39.534 INFO [src.node.waku_node] REST service is ready !!
2026-02-28 04:28:39.535 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:18904/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.55.3/tcp/15383/p2p/16Uiu2HAmHQK1kfVFWuztKu7xJ7ZqtPh63hbVxXwC3CNhpUXXuth3"]'
2026-02-28 04:28:39.538 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:28:39.545 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-28 04:28:39.545 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node9_2026-02-28_04-28-30__1c6de10d-8291-4d41-8482-72964eb4c16c__wakuorg_nwaku:latest.log
2026-02-28 04:28:39.545 DEBUG [src.node.waku_node] Starting Node...
2026-02-28 04:28:39.545 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-28 04:28:39.547 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-28 04:28:39.547 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.249.83
2026-02-28 04:28:39.547 DEBUG [src.node.docker_mananger] Generated ports ['32685', '32686', '32687', '32688', '32689']
2026-02-28 04:28:39.547 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-02-28 04:28:39.547 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-02-28 04:28:39.547 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-28 04:28:39.548 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-28 04:28:39.548 DEBUG [src.node.waku_node] Using volumes []
2026-02-28 04:28:39.548 DEBUG [src.node.docker_mananger] docker run -i -t -p 32685:32685 -p 32686:32686 -p 32687:32687 -p 32688:32688 -p 32689:32689 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=32687 --rest-port=32685 --tcp-port=32686 --discv5-udp-port=32688 --rest-address=0.0.0.0 --nat=extip:172.18.249.83 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=bbbea8dc8a32a374e5ef9eb08ed0bb1a8e117f8afa9f75b89abf1c209f2f8d14 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=32689 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QErAqfaxai3bxp3AvhxcWGeCRTihdLdFe70cLbIdh1FZTLEZMq-ZHLp-ZXHAx93rGvj3chYM7hYnmlr9bH7h6C8CgmlkgnY0gmlwhKwSNwOKbXVsdGlhZGRyc5YACASsEjcDBjwXAAoErBI3AwY8GN0DgnJzhQACAQAAiXNlY3AyNTZrMaEDRofTM62KnrwsVueYFxwvg8MRY9u3NCj2TzSKXtabVD6DdGNwgjwXg3VkcII8GYV3YWt1MgU
2026-02-28 04:28:39.747 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.249.83 waku b635845d1b020cf032b612769b2042daf75ba704466d23704654a6ca2ac56ca9
2026-02-28 04:28:39.783 DEBUG [src.node.docker_mananger] Container started with ID b635845d1b02. Setting up logs at ./log/docker/node9_2026-02-28_04-28-30__1c6de10d-8291-4d41-8482-72964eb4c16c__wakuorg_nwaku:latest.log
2026-02-28 04:28:39.784 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 32685
2026-02-28 04:28:39.784 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-28 04:28:40.785 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32685/health" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:28:40.797 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-28 04:28:40.798 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-28 04:28:40.798 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32685/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:28:40.803 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.249.83/tcp/32686/p2p/16Uiu2HAmRvMgJf2Sg1cwRzKrGLoXgSVy1U5GWWSc1YQcGuDrVS7Y","/ip4/172.18.249.83/tcp/32687/ws/p2p/16Uiu2HAmRvMgJf2Sg1cwRzKrGLoXgSVy1U5GWWSc1YQcGuDrVS7Y"],"enrUri":"enr:-L24QJcIaf6LafoXLnK39CWEtZWo0VLUyPLcHv34U-wHL0MwRvCy5V5nazhb2xCGR0OftH4sho4T-AKJoCGnQC80zPoCgmlkgnY0gmlwhKwS-VOKbXVsdGlhZGRyc5YACASsEvlTBn-uAAoErBL5UwZ_r90DgnJzhQACAQAAiXNlY3AyNTZrMaEDxRfB9cbUq0K9baA6Ez5hsI0ZZaxN3AbQWPMunOrCcW-DdGNwgn-ug3VkcIJ_sIV3YWt1MgE"}'
2026-02-28 04:28:40.804 INFO [src.node.waku_node] REST service is ready !!
2026-02-28 04:28:40.805 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32685/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.55.3/tcp/15383/p2p/16Uiu2HAmHQK1kfVFWuztKu7xJ7ZqtPh63hbVxXwC3CNhpUXXuth3"]'
2026-02-28 04:28:40.809 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:28:40.818 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-28 04:28:40.818 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node10_2026-02-28_04-28-30__1c6de10d-8291-4d41-8482-72964eb4c16c__wakuorg_nwaku:latest.log
2026-02-28 04:28:40.818 DEBUG [src.node.waku_node] Starting Node...
2026-02-28 04:28:40.818 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-28 04:28:40.819 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-28 04:28:40.820 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.181.75
2026-02-28 04:28:40.820 DEBUG [src.node.docker_mananger] Generated ports ['35706', '35707', '35708', '35709', '35710']
2026-02-28 04:28:40.820 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-02-28 04:28:40.820 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-02-28 04:28:40.820 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-28 04:28:40.820 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-28 04:28:40.820 DEBUG [src.node.waku_node] Using volumes []
2026-02-28 04:28:40.820 DEBUG [src.node.docker_mananger] docker run -i -t -p 35706:35706 -p 35707:35707 -p 35708:35708 -p 35709:35709 -p 35710:35710 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=35708 --rest-port=35706 --tcp-port=35707 --discv5-udp-port=35709 --rest-address=0.0.0.0 --nat=extip:172.18.181.75 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=a7b9bd17f2cbebeffafc6dfdc8cdeebd135c8d87012bdbbd08d0bcced639ba38 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=35710 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QErAqfaxai3bxp3AvhxcWGeCRTihdLdFe70cLbIdh1FZTLEZMq-ZHLp-ZXHAx93rGvj3chYM7hYnmlr9bH7h6C8CgmlkgnY0gmlwhKwSNwOKbXVsdGlhZGRyc5YACASsEjcDBjwXAAoErBI3AwY8GN0DgnJzhQACAQAAiXNlY3AyNTZrMaEDRofTM62KnrwsVueYFxwvg8MRY9u3NCj2TzSKXtabVD6DdGNwgjwXg3VkcII8GYV3YWt1MgU
2026-02-28 04:28:41.061 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.181.75 waku 57283f4440940a8fa0545b9f6d0e62c37f1acd930983a585f8c5eb494188f736
2026-02-28 04:28:41.103 DEBUG [src.node.docker_mananger] Container started with ID 57283f444094. Setting up logs at ./log/docker/node10_2026-02-28_04-28-30__1c6de10d-8291-4d41-8482-72964eb4c16c__wakuorg_nwaku:latest.log
2026-02-28 04:28:41.103 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 35706
2026-02-28 04:28:41.103 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-28 04:28:42.108 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35706/health" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:28:42.131 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-28 04:28:42.138 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-28 04:28:42.143 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35706/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:28:42.153 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.181.75/tcp/35707/p2p/16Uiu2HAkwfStKoeQLGV8zDKJ4QLb6HzEBq5Ym1FRvNyhemGYLJDY","/ip4/172.18.181.75/tcp/35708/ws/p2p/16Uiu2HAkwfStKoeQLGV8zDKJ4QLb6HzEBq5Ym1FRvNyhemGYLJDY"],"enrUri":"enr:-L24QOKnvb5ry2R8mz9MhnY0jVBV0XNp7bSN2vD3B7-AWms0NSNClK4i9Kkw-TK4PuluN8VgLNLibrjaSYeN9vLtTp4CgmlkgnY0gmlwhKwStUuKbXVsdGlhZGRyc5YACASsErVLBot7AAoErBK1SwaLfN0DgnJzhQACAQAAiXNlY3AyNTZrMaECIT6zDYkZDsRSV86EgUXpQcdWQD9e89-G-RPw-wvOmAODdGNwgot7g3VkcIKLfYV3YWt1MgE"}'
2026-02-28 04:28:42.153 INFO [src.node.waku_node] REST service is ready !!
2026-02-28 04:28:42.156 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35706/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.55.3/tcp/15383/p2p/16Uiu2HAmHQK1kfVFWuztKu7xJ7ZqtPh63hbVxXwC3CNhpUXXuth3"]'
2026-02-28 04:28:42.164 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:28:42.175 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-28 04:28:42.179 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node11_2026-02-28_04-28-30__1c6de10d-8291-4d41-8482-72964eb4c16c__wakuorg_nwaku:latest.log
2026-02-28 04:28:42.179 DEBUG [src.node.waku_node] Starting Node...
2026-02-28 04:28:42.184 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-28 04:28:42.189 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-28 04:28:42.192 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.50.121
2026-02-28 04:28:42.193 DEBUG [src.node.docker_mananger] Generated ports ['34929', '34930', '34931', '34932', '34933']
2026-02-28 04:28:42.195 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-02-28 04:28:42.195 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-02-28 04:28:42.197 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-28 04:28:42.197 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-28 04:28:42.197 DEBUG [src.node.waku_node] Using volumes []
2026-02-28 04:28:42.198 DEBUG [src.node.docker_mananger] docker run -i -t -p 34929:34929 -p 34930:34930 -p 34931:34931 -p 34932:34932 -p 34933:34933 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=34931 --rest-port=34929 --tcp-port=34930 --discv5-udp-port=34932 --rest-address=0.0.0.0 --nat=extip:172.18.50.121 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=401cfed3bfa6a8cb8bfecbbea73d1afd5f0d8c28f3ee7ea897973d719b4a26af --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=34933 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QErAqfaxai3bxp3AvhxcWGeCRTihdLdFe70cLbIdh1FZTLEZMq-ZHLp-ZXHAx93rGvj3chYM7hYnmlr9bH7h6C8CgmlkgnY0gmlwhKwSNwOKbXVsdGlhZGRyc5YACASsEjcDBjwXAAoErBI3AwY8GN0DgnJzhQACAQAAiXNlY3AyNTZrMaEDRofTM62KnrwsVueYFxwvg8MRY9u3NCj2TzSKXtabVD6DdGNwgjwXg3VkcII8GYV3YWt1MgU
2026-02-28 04:28:42.409 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.50.121 waku 29a41567af55c25e0a1698ec22caa21b80e73e0d60ba6a364ae91d8272eb2f64
2026-02-28 04:28:42.526 DEBUG [src.node.docker_mananger] Container started with ID 29a41567af55. Setting up logs at ./log/docker/node11_2026-02-28_04-28-30__1c6de10d-8291-4d41-8482-72964eb4c16c__wakuorg_nwaku:latest.log
2026-02-28 04:28:42.533 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 34929
2026-02-28 04:28:42.563 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-28 04:28:43.564 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34929/health" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:28:43.567 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-28 04:28:43.567 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-28 04:28:43.567 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34929/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:28:43.570 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.50.121/tcp/34930/p2p/16Uiu2HAkyMPa3d3EB9Zr97hBYHm7mMXbD5oSsYtQEjUFk2JVjpw3","/ip4/172.18.50.121/tcp/34931/ws/p2p/16Uiu2HAkyMPa3d3EB9Zr97hBYHm7mMXbD5oSsYtQEjUFk2JVjpw3"],"enrUri":"enr:-L24QDh3uUQCEbCfdBAAc9hHi_Iy0qpAhHaYhpH6T0_k6BWCL66auFxGoSTlChgHu9SGEYF90H0T794Ze6Aw02rb6ooCgmlkgnY0gmlwhKwSMnmKbXVsdGlhZGRyc5YACASsEjJ5BohyAAoErBIyeQaIc90DgnJzhQACAQAAiXNlY3AyNTZrMaECOlXeySBVB0w3W0r1ReRRVCkzdW2oLTxLSxkH5La8c4qDdGNwgohyg3VkcIKIdIV3YWt1MgE"}'
2026-02-28 04:28:43.570 INFO [src.node.waku_node] REST service is ready !!
2026-02-28 04:28:43.570 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34929/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.55.3/tcp/15383/p2p/16Uiu2HAmHQK1kfVFWuztKu7xJ7ZqtPh63hbVxXwC3CNhpUXXuth3"]'
2026-02-28 04:28:43.573 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:28:43.574 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:15382/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0"]'
2026-02-28 04:28:43.576 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:28:43.577 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43740/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0"]'
2026-02-28 04:28:43.580 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:28:43.580 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:31577/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0"]'
2026-02-28 04:28:43.583 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:28:43.584 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:16282/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0"]'
2026-02-28 04:28:43.586 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:28:43.586 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59839/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0"]'
2026-02-28 04:28:43.589 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:28:43.589 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24062/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0"]'
2026-02-28 04:28:43.592 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:28:43.592 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:18904/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0"]'
2026-02-28 04:28:43.594 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:28:43.595 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32685/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0"]'
2026-02-28 04:28:43.597 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:28:43.597 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35706/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0"]'
2026-02-28 04:28:43.600 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:28:43.600 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34929/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0"]'
2026-02-28 04:28:43.602 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:28:43.603 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:15382/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-28 04:28:43.634 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:28:43.637 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-02-28 04:28:43.737 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-02-28 04:28:43.741 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15382/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:28:43.756 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772252923603387165,"ephemeral":false,"proof":""}]'
2026-02-28 04:28:43.761 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-02-28 04:28:43.763 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43740/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:28:43.775 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772252923603387165,"ephemeral":false,"proof":""}]'
2026-02-28 04:28:43.778 DEBUG [src.steps.sharding] Checking that peer NODE_3:wakuorg/nwaku:latest can find the published message
2026-02-28 04:28:43.779 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31577/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:28:43.789 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772252923603387165,"ephemeral":false,"proof":""}]'
2026-02-28 04:28:43.791 DEBUG [src.steps.sharding] Checking that peer NODE_4:wakuorg/nwaku:latest can find the published message
2026-02-28 04:28:43.792 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:16282/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:28:43.795 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772252923603387165,"ephemeral":false,"proof":""}]'
2026-02-28 04:28:43.797 DEBUG [src.steps.sharding] Checking that peer NODE_5:wakuorg/nwaku:latest can find the published message
2026-02-28 04:28:43.798 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:59839/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:28:43.801 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772252923603387165,"ephemeral":false,"proof":""}]'
2026-02-28 04:28:43.802 DEBUG [src.steps.sharding] Checking that peer NODE_6:wakuorg/nwaku:latest can find the published message
2026-02-28 04:28:43.803 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24062/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:28:43.806 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772252923603387165,"ephemeral":false,"proof":""}]'
2026-02-28 04:28:43.808 DEBUG [src.steps.sharding] Checking that peer NODE_7:wakuorg/nwaku:latest can find the published message
2026-02-28 04:28:43.809 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18904/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:28:43.812 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772252923603387165,"ephemeral":false,"proof":""}]'
2026-02-28 04:28:43.814 DEBUG [src.steps.sharding] Checking that peer NODE_8:wakuorg/nwaku:latest can find the published message
2026-02-28 04:28:43.815 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32685/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:28:43.819 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772252923603387165,"ephemeral":false,"proof":""}]'
2026-02-28 04:28:43.821 DEBUG [src.steps.sharding] Checking that peer NODE_9:wakuorg/nwaku:latest can find the published message
2026-02-28 04:28:43.822 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35706/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:28:43.826 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772252923603387165,"ephemeral":false,"proof":""}]'
2026-02-28 04:28:43.827 DEBUG [src.steps.sharding] Checking that peer NODE_10:wakuorg/nwaku:latest can find the published message
2026-02-28 04:28:43.828 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34929/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:28:43.833 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772252923603387165,"ephemeral":false,"proof":""}]'
2026-02-28 04:28:43.837 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-02-28 04:28:43.838 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-02-28 04:28:43.838 DEBUG [src.node.waku_node] Stopping container with id cecc5650b07b
2026-02-28 04:28:44.480 DEBUG [src.node.waku_node] Container stopped.
2026-02-28 04:28:44.480 DEBUG [src.node.waku_node] Stopping container with id b7ef0d684b6d
2026-02-28 04:28:45.126 DEBUG [src.node.waku_node] Container stopped.
2026-02-28 04:28:45.128 DEBUG [src.node.waku_node] Stopping container with id 87468dc47232
2026-02-28 04:28:45.440 ERROR [src.node.docker_mananger] Max retries reached for container cecc5650b07b. Exiting log stream.
2026-02-28 04:28:45.739 DEBUG [src.node.waku_node] Container stopped.
2026-02-28 04:28:45.740 DEBUG [src.node.waku_node] Stopping container with id 74e30e46cd80
2026-02-28 04:28:45.941 ERROR [src.node.docker_mananger] Max retries reached for container b7ef0d684b6d. Exiting log stream.
2026-02-28 04:28:46.327 DEBUG [src.node.waku_node] Container stopped.
2026-02-28 04:28:46.327 DEBUG [src.node.waku_node] Stopping container with id 5de7286c1bae
2026-02-28 04:28:46.555 ERROR [src.node.docker_mananger] Max retries reached for container 87468dc47232. Exiting log stream.
2026-02-28 04:28:47.217 ERROR [src.node.docker_mananger] Max retries reached for container 74e30e46cd80. Exiting log stream.
2026-02-28 04:28:56.907 DEBUG [src.node.waku_node] Container stopped.
2026-02-28 04:28:56.908 DEBUG [src.node.waku_node] Stopping container with id 9be1cf1ab216
2026-02-28 04:28:57.722 ERROR [src.node.docker_mananger] Max retries reached for container 5de7286c1bae. Exiting log stream.
2026-02-28 04:29:07.482 DEBUG [src.node.waku_node] Container stopped.
2026-02-28 04:29:07.483 DEBUG [src.node.waku_node] Stopping container with id e7760dfb9995
2026-02-28 04:29:08.047 DEBUG [src.node.waku_node] Container stopped.
2026-02-28 04:29:08.049 DEBUG [src.node.waku_node] Stopping container with id b635845d1b02
2026-02-28 04:29:08.296 ERROR [src.node.docker_mananger] Max retries reached for container 9be1cf1ab216. Exiting log stream.
2026-02-28 04:29:08.674 DEBUG [src.node.waku_node] Container stopped.
2026-02-28 04:29:08.674 DEBUG [src.node.waku_node] Stopping container with id 57283f444094
2026-02-28 04:29:08.859 ERROR [src.node.docker_mananger] Max retries reached for container e7760dfb9995. Exiting log stream.
2026-02-28 04:29:09.220 DEBUG [src.node.waku_node] Container stopped.
2026-02-28 04:29:09.223 DEBUG [src.node.waku_node] Stopping container with id 29a41567af55
2026-02-28 04:29:09.541 ERROR [src.node.docker_mananger] Max retries reached for container b635845d1b02. Exiting log stream.
2026-02-28 04:29:09.809 DEBUG [src.node.waku_node] Container stopped.
2026-02-28 04:29:09.812 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-02-28 04:29:09.881 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-28 04:29:09.902 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-28 04:29:09.925 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-28 04:29:09.969 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-28 04:29:09.984 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-28 04:29:10.003 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-28 04:29:10.032 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-28 04:29:10.059 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-28 04:29:10.065 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-28 04:29:10.072 DEBUG [src.node.docker_mananger] No errors found in the waku logs.