2026-03-18 09:27:31 +00:00

270 lines
49 KiB
Plaintext

2026-03-18 09:15:52.575 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-18 09:15:52.576 DEBUG [tests.conftest] Running test: test_store_sync_long_chain with id: 2026-03-18_09-15-52__5bf9d9dc-a32b-42a8-932b-fe027ac90d89
2026-03-18 09:15:52.576 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-18 09:15:52.583 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0
2026-03-18 09:15:52.583 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-18_09-15-52__5bf9d9dc-a32b-42a8-932b-fe027ac90d89__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-18 09:15:52.589 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0
2026-03-18 09:15:52.590 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-18_09-15-52__5bf9d9dc-a32b-42a8-932b-fe027ac90d89__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-18 09:15:52.596 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0
2026-03-18 09:15:52.596 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-18_09-15-52__5bf9d9dc-a32b-42a8-932b-fe027ac90d89__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-18 09:15:52.597 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-18 09:15:52.597 DEBUG [src.node.waku_node] Starting Node...
2026-03-18 09:15:52.598 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-18 09:15:52.599 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-18 09:15:52.599 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.186.202
2026-03-18 09:15:52.599 DEBUG [src.node.docker_mananger] Generated ports ['13020', '13021', '13022', '13023', '13024']
2026-03-18 09:15:52.599 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-18 09:15:52.600 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-18 09:15:52.600 DEBUG [src.node.waku_node] Using volumes []
2026-03-18 09:15:52.600 DEBUG [src.node.docker_mananger] docker run -i -t -p 13020:13020 -p 13021:13021 -p 13022:13022 -p 13023:13023 -p 13024:13024 harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=13022 --rest-port=13020 --tcp-port=13021 --discv5-udp-port=13023 --rest-address=0.0.0.0 --nat=extip:172.18.186.202 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=ff73e5ff1e5cedb77cb2c2dfeaa36eee398d2b067ca7bbfceea8cd7ee575d5c1 --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=13024 --metrics-logging=true --store-sync-relay-jitter=0 --relay=true --dns-discovery=false
2026-03-18 09:15:52.792 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.186.202 waku c3c73e45cb0e20e3e8fe31f5bee263e8676b10b728e63e44d6aa36adc6ae6135
2026-03-18 09:15:52.815 ERROR [src.node.docker_mananger] Max retries reached for container 5d493b691d4d. Exiting log stream.
2026-03-18 09:15:52.828 DEBUG [src.node.docker_mananger] Container started with ID c3c73e45cb0e. Setting up logs at ./log/docker/node1_2026-03-18_09-15-52__5bf9d9dc-a32b-42a8-932b-fe027ac90d89__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-18 09:15:52.829 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0. REST: 13020
2026-03-18 09:15:52.829 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-18 09:15:53.361 ERROR [src.node.docker_mananger] Max retries reached for container 314cdc07f9ec. Exiting log stream.
2026-03-18 09:15:53.829 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13020/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:15:53.832 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-18 09:15:53.832 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-18 09:15:53.833 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13020/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:15:53.835 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.186.202/tcp/13021/p2p/16Uiu2HAkyRgZqR9PibPKrjzXVNNQVVYE9UYhRt4vUg5NSzRYjra3","/ip4/172.18.186.202/tcp/13022/ws/p2p/16Uiu2HAkyRgZqR9PibPKrjzXVNNQVVYE9UYhRt4vUg5NSzRYjra3"],"enrUri":"enr:-L24QMMWvOqdbouno8YsqRPnHUJPoOyu1BKyftAPF2C4a0yJE16gly6BSoFRmKYPfRBAGBq6FWhEIbEb6ZDM7FYA4rQCgmlkgnY0gmlwhKwSusqKbXVsdGlhZGRyc5YACASsErrKBjLdAAoErBK6ygYy3t0DgnJzhQDGAQAAiXNlY3AyNTZrMaECO29pTlffeQosZafycINJEIUrWx0l7lN5ZdgTkB0M_aCDdGNwgjLdg3VkcIIy34V3YWt1MhM"}'
2026-03-18 09:15:53.835 INFO [src.node.waku_node] REST service is ready !!
2026-03-18 09:15:53.835 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13020/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/0"]'
2026-03-18 09:15:53.854 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 09:15:53.861 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0
2026-03-18 09:15:53.861 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-18_09-15-52__5bf9d9dc-a32b-42a8-932b-fe027ac90d89__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-18 09:15:53.867 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0
2026-03-18 09:15:53.867 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-03-18_09-15-52__5bf9d9dc-a32b-42a8-932b-fe027ac90d89__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-18 09:15:53.874 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0
2026-03-18 09:15:53.874 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node6_2026-03-18_09-15-52__5bf9d9dc-a32b-42a8-932b-fe027ac90d89__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-18 09:15:53.881 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0
2026-03-18 09:15:53.881 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node7_2026-03-18_09-15-52__5bf9d9dc-a32b-42a8-932b-fe027ac90d89__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-18 09:15:53.887 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0
2026-03-18 09:15:53.887 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node8_2026-03-18_09-15-52__5bf9d9dc-a32b-42a8-932b-fe027ac90d89__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-18 09:15:53.887 DEBUG [src.node.waku_node] Starting Node...
2026-03-18 09:15:53.887 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-18 09:15:53.889 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-18 09:15:53.889 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.229.133
2026-03-18 09:15:53.889 DEBUG [src.node.docker_mananger] Generated ports ['4697', '4698', '4699', '4700', '4701']
2026-03-18 09:15:53.889 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-18 09:15:53.889 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-18 09:15:53.889 DEBUG [src.node.waku_node] Using volumes []
2026-03-18 09:15:53.889 DEBUG [src.node.docker_mananger] docker run -i -t -p 4697:4697 -p 4698:4698 -p 4699:4699 -p 4700:4700 -p 4701:4701 harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=4699 --rest-port=4697 --tcp-port=4698 --discv5-udp-port=4700 --rest-address=0.0.0.0 --nat=extip:172.18.229.133 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=ada36bab04c32a3a21dbed96659c8eebaeead31e92051f1a0b94df36b9da9e2d --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=4701 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false
2026-03-18 09:15:54.086 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.229.133 waku 22866f7b2e6733fab05a659637996a6e7bb2ababe4cba1f2e5a961d42a0bcc89
2026-03-18 09:15:54.127 DEBUG [src.node.docker_mananger] Container started with ID 22866f7b2e67. Setting up logs at ./log/docker/node2_2026-03-18_09-15-52__5bf9d9dc-a32b-42a8-932b-fe027ac90d89__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-18 09:15:54.128 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0. REST: 4697
2026-03-18 09:15:54.129 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-18 09:15:55.130 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:4697/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:15:55.132 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-18 09:15:55.133 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-18 09:15:55.133 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:4697/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:15:55.136 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.229.133/tcp/4698/p2p/16Uiu2HAm1uHX2KBbGYrBAHkBnuUQNDfgCAGbKShH9Zxua6ghEQ11","/ip4/172.18.229.133/tcp/4699/ws/p2p/16Uiu2HAm1uHX2KBbGYrBAHkBnuUQNDfgCAGbKShH9Zxua6ghEQ11"],"enrUri":"enr:-L24QDcE1M8I4jPUWhD2FpLTe2eh0iv7uuwlhSUQS2-cKLUwNUPmScw7CC1_vQurbsMaAfRHGjxurIqNQ64vWvVZu-0CgmlkgnY0gmlwhKwS5YWKbXVsdGlhZGRyc5YACASsEuWFBhJaAAoErBLlhQYSW90DgnJzhQDGAQAAiXNlY3AyNTZrMaECYDj8onDzviIU1NsYmC15JuVMzIQVDEj30kY1oB7Iu-SDdGNwghJag3VkcIISXIV3YWt1MhI"}'
2026-03-18 09:15:55.136 INFO [src.node.waku_node] REST service is ready !!
2026-03-18 09:15:55.136 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:4697/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.186.202/tcp/13021/p2p/16Uiu2HAkyRgZqR9PibPKrjzXVNNQVVYE9UYhRt4vUg5NSzRYjra3"]'
2026-03-18 09:15:55.175 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 09:15:55.176 DEBUG [src.node.waku_node] Starting Node...
2026-03-18 09:15:55.179 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-18 09:15:55.183 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-18 09:15:55.184 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.24.95
2026-03-18 09:15:55.184 DEBUG [src.node.docker_mananger] Generated ports ['6980', '6981', '6982', '6983', '6984']
2026-03-18 09:15:55.185 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-18 09:15:55.185 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-18 09:15:55.185 DEBUG [src.node.waku_node] Using volumes []
2026-03-18 09:15:55.186 DEBUG [src.node.docker_mananger] docker run -i -t -p 6980:6980 -p 6981:6981 -p 6982:6982 -p 6983:6983 -p 6984:6984 harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=6982 --rest-port=6980 --tcp-port=6981 --discv5-udp-port=6983 --rest-address=0.0.0.0 --nat=extip:172.18.24.95 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=7e6702c2c42e0cecbf4610c703db10fa37dd2c928c3aa56b49be2ddbb9eebeaf --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=6984 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false
2026-03-18 09:15:55.390 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.24.95 waku 970edc685a6cea8a3949cfa2a37d420f2bb230b112d62e870f7354c5f88bd254
2026-03-18 09:15:55.432 DEBUG [src.node.docker_mananger] Container started with ID 970edc685a6c. Setting up logs at ./log/docker/node3_2026-03-18_09-15-52__5bf9d9dc-a32b-42a8-932b-fe027ac90d89__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-18 09:15:55.432 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0. REST: 6980
2026-03-18 09:15:55.433 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-18 09:15:56.433 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6980/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:15:56.436 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-18 09:15:56.436 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-18 09:15:56.436 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6980/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:15:56.439 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.24.95/tcp/6981/p2p/16Uiu2HAmTFhTBua5NKjhWWd5aMLe9tncA82me3ZupVngpN1BUsnA","/ip4/172.18.24.95/tcp/6982/ws/p2p/16Uiu2HAmTFhTBua5NKjhWWd5aMLe9tncA82me3ZupVngpN1BUsnA"],"enrUri":"enr:-L24QKENgQeZW7OyNM3K5u7Rk4ml2HCGEjoXcmGFlVAWHOnjLTNnEVklVN9Li3XSj5K20cEovmrLe0zJw5FsRrKx7B8CgmlkgnY0gmlwhKwSGF-KbXVsdGlhZGRyc5YACASsEhhfBhtFAAoErBIYXwYbRt0DgnJzhQDGAQAAiXNlY3AyNTZrMaED2OfWnHwrfhPgQfMhqaEVGqp0K8rSrc2RjcDSIACKsduDdGNwghtFg3VkcIIbR4V3YWt1MhI"}'
2026-03-18 09:15:56.439 INFO [src.node.waku_node] REST service is ready !!
2026-03-18 09:15:56.440 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:6980/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.229.133/tcp/4698/p2p/16Uiu2HAm1uHX2KBbGYrBAHkBnuUQNDfgCAGbKShH9Zxua6ghEQ11"]'
2026-03-18 09:15:56.479 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 09:15:56.480 DEBUG [src.node.waku_node] Starting Node...
2026-03-18 09:15:56.480 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-18 09:15:56.484 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-18 09:15:56.484 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.145.74
2026-03-18 09:15:56.485 DEBUG [src.node.docker_mananger] Generated ports ['37070', '37071', '37072', '37073', '37074']
2026-03-18 09:15:56.485 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-18 09:15:56.485 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-18 09:15:56.485 DEBUG [src.node.waku_node] Using volumes []
2026-03-18 09:15:56.485 DEBUG [src.node.docker_mananger] docker run -i -t -p 37070:37070 -p 37071:37071 -p 37072:37072 -p 37073:37073 -p 37074:37074 harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=37072 --rest-port=37070 --tcp-port=37071 --discv5-udp-port=37073 --rest-address=0.0.0.0 --nat=extip:172.18.145.74 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=d3cc6f3a5cdb8fda5f3c7cebc60db8c2860f8fa6e666c8f37b5b8cf75ac4dcee --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=37074 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false
2026-03-18 09:15:56.694 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.145.74 waku 5dee1b4db7d6653c13174730f295f76c5ec615a382c999408339a51a9a05bf63
2026-03-18 09:15:56.731 DEBUG [src.node.docker_mananger] Container started with ID 5dee1b4db7d6. Setting up logs at ./log/docker/node4_2026-03-18_09-15-52__5bf9d9dc-a32b-42a8-932b-fe027ac90d89__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-18 09:15:56.732 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0. REST: 37070
2026-03-18 09:15:56.732 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-18 09:15:57.732 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37070/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:15:57.736 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-18 09:15:57.736 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-18 09:15:57.736 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37070/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:15:57.738 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.145.74/tcp/37071/p2p/16Uiu2HAm4SnXiAHUbKgHd1nB6FUTgpDpoTennbTASb4Ao2oG9izM","/ip4/172.18.145.74/tcp/37072/ws/p2p/16Uiu2HAm4SnXiAHUbKgHd1nB6FUTgpDpoTennbTASb4Ao2oG9izM"],"enrUri":"enr:-L24QCwtMlXzrmuL4UIDCXrkoruYXAQQLstxDo_VeRh_5MX7dtjOev8_myL4pM0lfUsxvxcoJ3s4ANdkhVEuTzFEXPQCgmlkgnY0gmlwhKwSkUqKbXVsdGlhZGRyc5YACASsEpFKBpDPAAoErBKRSgaQ0N0DgnJzhQDGAQAAiXNlY3AyNTZrMaEChgIrafMFUFo-Tx8_CNFpvsD9Quff1u2Z9yrNf_IaH_KDdGNwgpDPg3VkcIKQ0YV3YWt1MhI"}'
2026-03-18 09:15:57.739 INFO [src.node.waku_node] REST service is ready !!
2026-03-18 09:15:57.739 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37070/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.24.95/tcp/6981/p2p/16Uiu2HAmTFhTBua5NKjhWWd5aMLe9tncA82me3ZupVngpN1BUsnA"]'
2026-03-18 09:15:57.768 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 09:15:57.771 DEBUG [src.node.waku_node] Starting Node...
2026-03-18 09:15:57.771 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-18 09:15:57.776 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-18 09:15:57.777 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.116.52
2026-03-18 09:15:57.778 DEBUG [src.node.docker_mananger] Generated ports ['54996', '54997', '54998', '54999', '55000']
2026-03-18 09:15:57.778 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-18 09:15:57.780 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-18 09:15:57.781 DEBUG [src.node.waku_node] Using volumes []
2026-03-18 09:15:57.781 DEBUG [src.node.docker_mananger] docker run -i -t -p 54996:54996 -p 54997:54997 -p 54998:54998 -p 54999:54999 -p 55000:55000 harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=54998 --rest-port=54996 --tcp-port=54997 --discv5-udp-port=54999 --rest-address=0.0.0.0 --nat=extip:172.18.116.52 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=2c8e8da1a7c911f342ad417e2cdeea29c230c1b6a3aeacd7ea2a3d2a26ff52ec --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=55000 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false
2026-03-18 09:15:57.992 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.116.52 waku 8a8b5fd0213973c166e7da3f9e2aa350141483255cad4375bfd3bd235ce216ac
2026-03-18 09:15:58.028 DEBUG [src.node.docker_mananger] Container started with ID 8a8b5fd02139. Setting up logs at ./log/docker/node5_2026-03-18_09-15-52__5bf9d9dc-a32b-42a8-932b-fe027ac90d89__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-18 09:15:58.029 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0. REST: 54996
2026-03-18 09:15:58.030 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-18 09:15:59.031 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54996/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:15:59.034 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-18 09:15:59.034 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-18 09:15:59.034 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54996/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:15:59.037 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.116.52/tcp/54997/p2p/16Uiu2HAmArGVw7eSddQ8rbTLgxqwG5TkB3eHy7zm45qCw1eGHFSy","/ip4/172.18.116.52/tcp/54998/ws/p2p/16Uiu2HAmArGVw7eSddQ8rbTLgxqwG5TkB3eHy7zm45qCw1eGHFSy"],"enrUri":"enr:-L24QJK6qjitXr8fpQ6Kyo_T7Jvltx9MJ39dZ5TREIm-tTKzTPLvMG0vro8nbSS81JB3VThNQQT01KI45QYohBWOSyYCgmlkgnY0gmlwhKwSdDSKbXVsdGlhZGRyc5YACASsEnQ0BtbVAAoErBJ0NAbW1t0DgnJzhQDGAQAAiXNlY3AyNTZrMaEC5SxGWnMpYSz8dV0H9NJAUvq8wDht-8AEE3mZcHhD7mqDdGNwgtbVg3VkcILW14V3YWt1MhI"}'
2026-03-18 09:15:59.037 INFO [src.node.waku_node] REST service is ready !!
2026-03-18 09:15:59.037 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54996/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.145.74/tcp/37071/p2p/16Uiu2HAm4SnXiAHUbKgHd1nB6FUTgpDpoTennbTASb4Ao2oG9izM"]'
2026-03-18 09:15:59.071 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 09:15:59.072 DEBUG [src.node.waku_node] Starting Node...
2026-03-18 09:15:59.072 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-18 09:15:59.079 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-18 09:15:59.079 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.191.248
2026-03-18 09:15:59.079 DEBUG [src.node.docker_mananger] Generated ports ['18908', '18909', '18910', '18911', '18912']
2026-03-18 09:15:59.079 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-18 09:15:59.079 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-18 09:15:59.080 DEBUG [src.node.waku_node] Using volumes []
2026-03-18 09:15:59.081 DEBUG [src.node.docker_mananger] docker run -i -t -p 18908:18908 -p 18909:18909 -p 18910:18910 -p 18911:18911 -p 18912:18912 harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=18910 --rest-port=18908 --tcp-port=18909 --discv5-udp-port=18911 --rest-address=0.0.0.0 --nat=extip:172.18.191.248 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=05bedb558d4cb1d550aaaa5c28ac6fb2fc72271595f6d68d8cb8c8cb3ae3ea3f --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=18912 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false
2026-03-18 09:15:59.278 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.191.248 waku 4df0830d2780378ff27a91b38707965e99f54c0ae8f2df4a92c48cd29866af7b
2026-03-18 09:15:59.317 DEBUG [src.node.docker_mananger] Container started with ID 4df0830d2780. Setting up logs at ./log/docker/node6_2026-03-18_09-15-52__5bf9d9dc-a32b-42a8-932b-fe027ac90d89__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-18 09:15:59.317 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0. REST: 18908
2026-03-18 09:15:59.317 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-18 09:16:00.318 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18908/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:16:00.321 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-18 09:16:00.321 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-18 09:16:00.321 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18908/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:16:00.324 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.191.248/tcp/18909/p2p/16Uiu2HAm3ucr6PrPpGn4W3hHr1cy6hmxGk46MZDCefdWiYLpkgVb","/ip4/172.18.191.248/tcp/18910/ws/p2p/16Uiu2HAm3ucr6PrPpGn4W3hHr1cy6hmxGk46MZDCefdWiYLpkgVb"],"enrUri":"enr:-L24QKxFzTG9H_0vy8Idp0jCn-wnYKpe9CtW6J_bhTBWZ0KhP0ltZnx7RLntVNgRp2OD5QDtiPLdiutf59YsiMzA4fQCgmlkgnY0gmlwhKwSv_iKbXVsdGlhZGRyc5YACASsEr_4BkndAAoErBK_-AZJ3t0DgnJzhQDGAQAAiXNlY3AyNTZrMaECfgY3QeYkyVmbitpz0A2LV-wfhPsInP8XMUaYgcZ7cb6DdGNwgkndg3VkcIJJ34V3YWt1MhI"}'
2026-03-18 09:16:00.324 INFO [src.node.waku_node] REST service is ready !!
2026-03-18 09:16:00.324 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:18908/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.116.52/tcp/54997/p2p/16Uiu2HAmArGVw7eSddQ8rbTLgxqwG5TkB3eHy7zm45qCw1eGHFSy"]'
2026-03-18 09:16:00.356 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 09:16:00.357 DEBUG [src.node.waku_node] Starting Node...
2026-03-18 09:16:00.361 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-18 09:16:00.363 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-18 09:16:00.364 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.86.168
2026-03-18 09:16:00.364 DEBUG [src.node.docker_mananger] Generated ports ['21793', '21794', '21795', '21796', '21797']
2026-03-18 09:16:00.364 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-18 09:16:00.365 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-18 09:16:00.366 DEBUG [src.node.waku_node] Using volumes []
2026-03-18 09:16:00.367 DEBUG [src.node.docker_mananger] docker run -i -t -p 21793:21793 -p 21794:21794 -p 21795:21795 -p 21796:21796 -p 21797:21797 harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=21795 --rest-port=21793 --tcp-port=21794 --discv5-udp-port=21796 --rest-address=0.0.0.0 --nat=extip:172.18.86.168 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=dd5ab370fb2f9bcedc6b1b221b37e1c8d28dfaf0de9ee0ee89d0c9ed3123697e --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=21797 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false
2026-03-18 09:16:00.569 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.86.168 waku e257acab967509114bd83912cc395015e9a286e76340d4e2675f59ba0afebdb1
2026-03-18 09:16:00.606 DEBUG [src.node.docker_mananger] Container started with ID e257acab9675. Setting up logs at ./log/docker/node7_2026-03-18_09-15-52__5bf9d9dc-a32b-42a8-932b-fe027ac90d89__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-18 09:16:00.606 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0. REST: 21793
2026-03-18 09:16:00.607 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-18 09:16:01.609 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:21793/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:16:01.612 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-18 09:16:01.612 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-18 09:16:01.612 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:21793/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:16:01.615 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.86.168/tcp/21794/p2p/16Uiu2HAmSQH5hVCRBvkzpXdsfuvQ8rCKhUWTjzYKCwprfc7iF5fT","/ip4/172.18.86.168/tcp/21795/ws/p2p/16Uiu2HAmSQH5hVCRBvkzpXdsfuvQ8rCKhUWTjzYKCwprfc7iF5fT"],"enrUri":"enr:-L24QJKC5pa5UDBtPlXbxAQS2MEdmMkKdmKA0Qd9wNQ4kp7TBQWIUWoLe1z7zNyMn3nOO4k2vTxR_QEakFec7sAQNQ4CgmlkgnY0gmlwhKwSVqiKbXVsdGlhZGRyc5YACASsElaoBlUiAAoErBJWqAZVI90DgnJzhQDGAQAAiXNlY3AyNTZrMaEDzD7SpjhxEivFHY6m_lYQQyYv5RShbSMegEuQJR96tYaDdGNwglUig3VkcIJVJIV3YWt1MhI"}'
2026-03-18 09:16:01.615 INFO [src.node.waku_node] REST service is ready !!
2026-03-18 09:16:01.615 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21793/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.191.248/tcp/18909/p2p/16Uiu2HAm3ucr6PrPpGn4W3hHr1cy6hmxGk46MZDCefdWiYLpkgVb"]'
2026-03-18 09:16:01.648 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 09:16:01.648 DEBUG [src.node.waku_node] Starting Node...
2026-03-18 09:16:01.649 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-18 09:16:01.652 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-18 09:16:01.652 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.144.201
2026-03-18 09:16:01.653 DEBUG [src.node.docker_mananger] Generated ports ['64811', '64812', '64813', '64814', '64815']
2026-03-18 09:16:01.653 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-18 09:16:01.654 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-18 09:16:01.654 DEBUG [src.node.waku_node] Using volumes []
2026-03-18 09:16:01.655 DEBUG [src.node.docker_mananger] docker run -i -t -p 64811:64811 -p 64812:64812 -p 64813:64813 -p 64814:64814 -p 64815:64815 harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=64813 --rest-port=64811 --tcp-port=64812 --discv5-udp-port=64814 --rest-address=0.0.0.0 --nat=extip:172.18.144.201 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=a4b27e6a5e3fbc03275efcb4cf0bf6640debb0da8ebaff48a3f6e5fbcffeecd3 --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=64815 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false
2026-03-18 09:16:01.862 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.144.201 waku 1a17236eb9c0fd822f40f7b2d3a15d4edcd00888f30b583d2e7d00e9775cd131
2026-03-18 09:16:01.897 DEBUG [src.node.docker_mananger] Container started with ID 1a17236eb9c0. Setting up logs at ./log/docker/node8_2026-03-18_09-15-52__5bf9d9dc-a32b-42a8-932b-fe027ac90d89__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-18 09:16:01.898 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0. REST: 64811
2026-03-18 09:16:01.898 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-18 09:16:02.898 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64811/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:16:02.901 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-18 09:16:02.902 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-18 09:16:02.902 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64811/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:16:02.904 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.144.201/tcp/64812/p2p/16Uiu2HAmRZWKYbHuvAQ4rwCCQnka4gmeRZy9m6ktYZHTCV7dYmLW","/ip4/172.18.144.201/tcp/64813/ws/p2p/16Uiu2HAmRZWKYbHuvAQ4rwCCQnka4gmeRZy9m6ktYZHTCV7dYmLW"],"enrUri":"enr:-L24QHi1sa6nyzol8y_mlMf8JxxWEhvUx9RWA1SNrz6LQCqDA9TXkN_en4mbo5hVzsGVVfJT1ckC0sI_xcSYTDVdKAgCgmlkgnY0gmlwhKwSkMmKbXVsdGlhZGRyc5YACASsEpDJBv0sAAoErBKQyQb9Ld0DgnJzhQDGAQAAiXNlY3AyNTZrMaEDv8BVEPBSxd-dNjB9lbbTYGppjCs9o1lJbOIc5_EXTfODdGNwgv0sg3VkcIL9LoV3YWt1MhI"}'
2026-03-18 09:16:02.905 INFO [src.node.waku_node] REST service is ready !!
2026-03-18 09:16:02.905 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:64811/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.86.168/tcp/21794/p2p/16Uiu2HAmSQH5hVCRBvkzpXdsfuvQ8rCKhUWTjzYKCwprfc7iF5fT"]'
2026-03-18 09:16:02.943 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 09:16:02.945 DEBUG [src.steps.store] Relaying message
2026-03-18 09:16:02.946 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13020/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 09:16:02.953 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 09:16:02.953 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-18 09:16:03.153 DEBUG [src.steps.store] Relaying message
2026-03-18 09:16:03.154 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13020/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 09:16:03.158 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 09:16:03.158 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-18 09:16:03.359 DEBUG [src.steps.store] Relaying message
2026-03-18 09:16:03.360 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13020/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 09:16:03.364 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 09:16:03.365 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-18 09:16:03.565 DEBUG [src.steps.store] Relaying message
2026-03-18 09:16:03.566 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13020/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 09:16:03.570 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 09:16:03.570 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-18 09:16:03.771 DEBUG [src.steps.store] Relaying message
2026-03-18 09:16:03.771 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13020/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 09:16:03.776 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 09:16:03.776 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-18 09:16:03.977 DEBUG [src.steps.store] Relaying message
2026-03-18 09:16:03.977 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13020/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 09:16:03.981 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 09:16:03.981 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-18 09:16:04.182 DEBUG [src.steps.store] Relaying message
2026-03-18 09:16:04.182 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13020/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 09:16:04.186 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 09:16:04.187 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-18 09:16:04.387 DEBUG [src.steps.store] Relaying message
2026-03-18 09:16:04.388 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13020/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 09:16:04.392 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 09:16:04.392 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-18 09:16:04.593 DEBUG [src.steps.store] Relaying message
2026-03-18 09:16:04.593 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13020/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 09:16:04.597 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 09:16:04.597 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-18 09:16:04.798 DEBUG [src.steps.store] Relaying message
2026-03-18 09:16:04.798 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13020/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 09:16:04.803 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 09:16:04.803 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-18 09:16:05.003 DEBUG [src.libs.common] Sleeping for 90 seconds
2026-03-18 09:17:35.004 DEBUG [src.steps.store] Checking that peer harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the stored messages
2026-03-18 09:17:35.004 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64811/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F198%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:17:35.008 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x4f59d0405e47ad9b380114664cd2756fcd15e3b3adbeda15d2ceef20734445b2"},{"messageHash":"0x0d1d3a6b6aa9da7375a454f33ee074631887ba77338189e18146f994557c1524"},{"messageHash":"0x138b0d17fb9e5df78f1d79d19bfb3ac8951703e69bd7ad7df528154cd5c2ab93"},{"messageHash":"0xf9fe920e9a48820ea64e61947ded4bcac43fb8a491d79b45758177a64c0e410b"},{"messageHash":"0x69c869c954c2b7e2cde151738cb87a5c57e87e9ae12c23e53ecefe10ae486d4f"},{"messageHash":"0x234db630d9c3325158f38e42889b201316c9b6fcde453c8c7350a7ca14a75079"},{"messageHash":"0x1706d1de312040115ba91498e5ca1de225bdc85c4796383a954313cdd449014c"},{"messageHash":"0x4913b593981c8dd77d7fb2ebcd95570882a9477d71c1c6d248f23c5dec4621d4"},{"messageHash":"0x79de5302a9896296dea9d5ffb0fd3196a46c5f3d18a8f1bf6040bf764bda6105"},{"messageHash":"0xab015d200028ca235ecbf4dcb4bcd4904f0808afa6f65831a2f56c44abf1e910"}]}'
2026-03-18 09:17:35.008 DEBUG [src.steps.store] messages length is 10
2026-03-18 09:17:35.011 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-18 09:17:35.012 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-18 09:17:35.013 DEBUG [src.node.waku_node] Stopping container with id c3c73e45cb0e
2026-03-18 09:17:35.586 DEBUG [src.node.waku_node] Container stopped.
2026-03-18 09:17:35.589 DEBUG [src.node.waku_node] Stopping container with id 22866f7b2e67
2026-03-18 09:17:36.172 DEBUG [src.node.waku_node] Container stopped.
2026-03-18 09:17:36.174 DEBUG [src.node.waku_node] Stopping container with id 970edc685a6c
2026-03-18 09:17:36.400 ERROR [src.node.docker_mananger] Max retries reached for container c3c73e45cb0e. Exiting log stream.
2026-03-18 09:17:36.731 DEBUG [src.node.waku_node] Container stopped.
2026-03-18 09:17:36.734 DEBUG [src.node.waku_node] Stopping container with id 5dee1b4db7d6
2026-03-18 09:17:36.987 ERROR [src.node.docker_mananger] Max retries reached for container 22866f7b2e67. Exiting log stream.
2026-03-18 09:17:37.296 DEBUG [src.node.waku_node] Container stopped.
2026-03-18 09:17:37.297 DEBUG [src.node.waku_node] Stopping container with id 8a8b5fd02139
2026-03-18 09:17:37.545 ERROR [src.node.docker_mananger] Max retries reached for container 970edc685a6c. Exiting log stream.
2026-03-18 09:17:37.842 DEBUG [src.node.waku_node] Container stopped.
2026-03-18 09:17:37.844 DEBUG [src.node.waku_node] Stopping container with id 4df0830d2780
2026-03-18 09:17:38.118 ERROR [src.node.docker_mananger] Max retries reached for container 5dee1b4db7d6. Exiting log stream.
2026-03-18 09:17:38.398 DEBUG [src.node.waku_node] Container stopped.
2026-03-18 09:17:38.399 DEBUG [src.node.waku_node] Stopping container with id e257acab9675
2026-03-18 09:17:38.830 ERROR [src.node.docker_mananger] Max retries reached for container 8a8b5fd02139. Exiting log stream.
2026-03-18 09:17:38.984 DEBUG [src.node.waku_node] Container stopped.
2026-03-18 09:17:38.984 DEBUG [src.node.waku_node] Stopping container with id 1a17236eb9c0
2026-03-18 09:17:39.212 ERROR [src.node.docker_mananger] Max retries reached for container 4df0830d2780. Exiting log stream.
2026-03-18 09:17:39.565 DEBUG [src.node.waku_node] Container stopped.
2026-03-18 09:17:39.568 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-18 09:17:39.611 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-18 09:17:39.663 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-18 09:17:39.707 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-18 09:17:39.750 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-18 09:17:39.837 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-18 09:17:39.878 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-18 09:17:39.929 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-18 09:17:39.959 ERROR [src.node.docker_mananger] Max retries reached for container e257acab9675. Exiting log stream.
2026-03-18 09:17:39.959 DEBUG [src.node.docker_mananger] No errors found in the waku logs.