2026-02-25 15:39:14 +00:00

269 lines
48 KiB
Plaintext

2026-02-25 15:31:04.195 DEBUG [tests.conftest] Running fixture setup: test_id
2026-02-25 15:31:04.195 DEBUG [tests.conftest] Running test: test_store_sync_long_chain with id: 2026-02-25_15-31-04__36166133-4c2e-4bf8-aabf-371eae1807ec
2026-02-25 15:31:04.195 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-02-25 15:31:04.202 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 15:31:04.202 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-02-25_15-31-04__36166133-4c2e-4bf8-aabf-371eae1807ec__wakuorg_nwaku:latest.log
2026-02-25 15:31:04.209 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 15:31:04.209 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-02-25_15-31-04__36166133-4c2e-4bf8-aabf-371eae1807ec__wakuorg_nwaku:latest.log
2026-02-25 15:31:04.215 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 15:31:04.215 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-02-25_15-31-04__36166133-4c2e-4bf8-aabf-371eae1807ec__wakuorg_nwaku:latest.log
2026-02-25 15:31:04.215 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-02-25 15:31:04.216 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 15:31:04.216 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 15:31:04.217 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 15:31:04.218 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.24.206
2026-02-25 15:31:04.218 DEBUG [src.node.docker_mananger] Generated ports ['38876', '38877', '38878', '38879', '38880']
2026-02-25 15:31:04.218 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 15:31:04.218 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 15:31:04.218 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 15:31:04.218 DEBUG [src.node.docker_mananger] docker run -i -t -p 38876:38876 -p 38877:38877 -p 38878:38878 -p 38879:38879 -p 38880:38880 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=38878 --rest-port=38876 --tcp-port=38877 --discv5-udp-port=38879 --rest-address=0.0.0.0 --nat=extip:172.18.24.206 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=f0be87a2fd1134dc7cd1e7a4c5bd2c6ca2f3b7dbec6ecf52eedf6425aaade24b --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=38880 --metrics-logging=true --store-sync-relay-jitter=0 --relay=true --dns-discovery=false
2026-02-25 15:31:04.398 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.24.206 waku 2ca69ce6bba1d5bae3f1be7d4ccdc9b895adce5fe957829d2732e4836cc2d073
2026-02-25 15:31:04.429 DEBUG [src.node.docker_mananger] Container started with ID 2ca69ce6bba1. Setting up logs at ./log/docker/node1_2026-02-25_15-31-04__36166133-4c2e-4bf8-aabf-371eae1807ec__wakuorg_nwaku:latest.log
2026-02-25 15:31:04.430 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 38876
2026-02-25 15:31:04.431 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 15:31:04.436 ERROR [src.node.docker_mananger] Max retries reached for container b974183a6d16. Exiting log stream.
2026-02-25 15:31:04.986 ERROR [src.node.docker_mananger] Max retries reached for container b14b8e412506. Exiting log stream.
2026-02-25 15:31:05.431 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38876/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:31:05.434 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 15:31:05.434 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 15:31:05.435 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38876/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:31:05.437 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.24.206/tcp/38877/p2p/16Uiu2HAm7Jn1zMyqJ2gQMtn8BahH1y48rPkuuAMakKeorVRFfdNw","/ip4/172.18.24.206/tcp/38878/ws/p2p/16Uiu2HAm7Jn1zMyqJ2gQMtn8BahH1y48rPkuuAMakKeorVRFfdNw"],"enrUri":"enr:-L24QEUUdCE0xK3fcJFImV4ozvtJejEUsJvoR6Kw6lcWBxqyLaBYVltvM7ez8Iu_YVUiGV5qtKNIOdPDrIKUPsEJINcCgmlkgnY0gmlwhKwSGM6KbXVsdGlhZGRyc5YACASsEhjOBpfdAAoErBIYzgaX3t0DgnJzhQADAQAAiXNlY3AyNTZrMaECsIgBJk__0G_wubRneekU61dZLQYGIyrlCGVlKUZD71iDdGNwgpfdg3VkcIKX34V3YWt1MhM"}'
2026-02-25 15:31:05.437 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 15:31:05.437 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38876/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-02-25 15:31:05.455 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:31:05.461 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 15:31:05.461 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-02-25_15-31-04__36166133-4c2e-4bf8-aabf-371eae1807ec__wakuorg_nwaku:latest.log
2026-02-25 15:31:05.467 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 15:31:05.467 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-02-25_15-31-04__36166133-4c2e-4bf8-aabf-371eae1807ec__wakuorg_nwaku:latest.log
2026-02-25 15:31:05.473 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 15:31:05.473 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node6_2026-02-25_15-31-04__36166133-4c2e-4bf8-aabf-371eae1807ec__wakuorg_nwaku:latest.log
2026-02-25 15:31:05.478 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 15:31:05.479 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node7_2026-02-25_15-31-04__36166133-4c2e-4bf8-aabf-371eae1807ec__wakuorg_nwaku:latest.log
2026-02-25 15:31:05.484 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 15:31:05.484 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node8_2026-02-25_15-31-04__36166133-4c2e-4bf8-aabf-371eae1807ec__wakuorg_nwaku:latest.log
2026-02-25 15:31:05.484 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 15:31:05.485 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 15:31:05.486 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 15:31:05.486 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.235.23
2026-02-25 15:31:05.486 DEBUG [src.node.docker_mananger] Generated ports ['3077', '3078', '3079', '3080', '3081']
2026-02-25 15:31:05.486 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 15:31:05.487 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 15:31:05.487 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 15:31:05.487 DEBUG [src.node.docker_mananger] docker run -i -t -p 3077:3077 -p 3078:3078 -p 3079:3079 -p 3080:3080 -p 3081:3081 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=3079 --rest-port=3077 --tcp-port=3078 --discv5-udp-port=3080 --rest-address=0.0.0.0 --nat=extip:172.18.235.23 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=bf19e56d4ef29f8d0d5d7feb0d0f2bdee1c75579c11b16744ac04ffbd7b383a2 --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=3081 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false
2026-02-25 15:31:05.669 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.235.23 waku 621ccd5ff29afc3d57ef6c0ff0fbcaacabf461af9a7523b3908c5dbf768a06bd
2026-02-25 15:31:05.703 DEBUG [src.node.docker_mananger] Container started with ID 621ccd5ff29a. Setting up logs at ./log/docker/node2_2026-02-25_15-31-04__36166133-4c2e-4bf8-aabf-371eae1807ec__wakuorg_nwaku:latest.log
2026-02-25 15:31:05.704 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 3077
2026-02-25 15:31:05.705 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 15:31:06.705 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3077/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:31:06.708 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 15:31:06.709 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 15:31:06.709 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3077/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:31:06.711 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.235.23/tcp/3078/p2p/16Uiu2HAm6gpePbpXpUSCTcShh4YEgyEmafPKf7m9F35ZDjCMtqPB","/ip4/172.18.235.23/tcp/3079/ws/p2p/16Uiu2HAm6gpePbpXpUSCTcShh4YEgyEmafPKf7m9F35ZDjCMtqPB"],"enrUri":"enr:-L24QNH0YowQn5PB787p3SCkJfrIU4uHkhfD3z5-xvlpi0uvHwL8rVtJhWCvQz8Se8DoB69VTKTuin4RAk6ubzOsdSQCgmlkgnY0gmlwhKwS6xeKbXVsdGlhZGRyc5YACASsEusXBgwGAAoErBLrFwYMB90DgnJzhQADAQAAiXNlY3AyNTZrMaECp1IQ_3sNpAIl4hDAvGt3l7McvzHFB_OVVu6iGruNaV6DdGNwggwGg3VkcIIMCIV3YWt1MhI"}'
2026-02-25 15:31:06.711 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 15:31:06.712 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3077/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.24.206/tcp/38877/p2p/16Uiu2HAm7Jn1zMyqJ2gQMtn8BahH1y48rPkuuAMakKeorVRFfdNw"]'
2026-02-25 15:31:06.744 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:31:06.745 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 15:31:06.745 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 15:31:06.749 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 15:31:06.749 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.19.68
2026-02-25 15:31:06.750 DEBUG [src.node.docker_mananger] Generated ports ['57480', '57481', '57482', '57483', '57484']
2026-02-25 15:31:06.751 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 15:31:06.752 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 15:31:06.754 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 15:31:06.755 DEBUG [src.node.docker_mananger] docker run -i -t -p 57480:57480 -p 57481:57481 -p 57482:57482 -p 57483:57483 -p 57484:57484 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=57482 --rest-port=57480 --tcp-port=57481 --discv5-udp-port=57483 --rest-address=0.0.0.0 --nat=extip:172.18.19.68 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ceef01baefc1fd2ad39c0ebf3d2a8f3b94ce0dedfaef7deebef8a6f8dbfaefcb --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=57484 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false
2026-02-25 15:31:06.954 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.19.68 waku 94f3f49f60b87813f633a028889463c8dcccb19ca92921ba15dea43137646294
2026-02-25 15:31:06.987 DEBUG [src.node.docker_mananger] Container started with ID 94f3f49f60b8. Setting up logs at ./log/docker/node3_2026-02-25_15-31-04__36166133-4c2e-4bf8-aabf-371eae1807ec__wakuorg_nwaku:latest.log
2026-02-25 15:31:06.987 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 57480
2026-02-25 15:31:06.989 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 15:31:07.989 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57480/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:31:07.992 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 15:31:07.992 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 15:31:07.992 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57480/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:31:07.994 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.19.68/tcp/57481/p2p/16Uiu2HAmKmDVnSLYDqnKYp8nkawgjztD5o5nyHBQ3otCYfrzMUtc","/ip4/172.18.19.68/tcp/57482/ws/p2p/16Uiu2HAmKmDVnSLYDqnKYp8nkawgjztD5o5nyHBQ3otCYfrzMUtc"],"enrUri":"enr:-L24QLlWVkZd3LeQTidQe61iUSa77FnWp_AyVMsJ8msiaxvtGFLXCqCDE0sXAR1_Vw1r5wFphYREJXMqjEfYFE4WudkCgmlkgnY0gmlwhKwSE0SKbXVsdGlhZGRyc5YACASsEhNEBuCJAAoErBITRAbgit0DgnJzhQADAQAAiXNlY3AyNTZrMaEDaZooeA32-19K4o7hKNk5dRiLowib0mvTtk3s_vLZyc2DdGNwguCJg3VkcILgi4V3YWt1MhI"}'
2026-02-25 15:31:07.995 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 15:31:07.995 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57480/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.235.23/tcp/3078/p2p/16Uiu2HAm6gpePbpXpUSCTcShh4YEgyEmafPKf7m9F35ZDjCMtqPB"]'
2026-02-25 15:31:08.029 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:31:08.030 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 15:31:08.032 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 15:31:08.034 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 15:31:08.034 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.193.178
2026-02-25 15:31:08.034 DEBUG [src.node.docker_mananger] Generated ports ['12977', '12978', '12979', '12980', '12981']
2026-02-25 15:31:08.035 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 15:31:08.035 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 15:31:08.036 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 15:31:08.036 DEBUG [src.node.docker_mananger] docker run -i -t -p 12977:12977 -p 12978:12978 -p 12979:12979 -p 12980:12980 -p 12981:12981 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=12979 --rest-port=12977 --tcp-port=12978 --discv5-udp-port=12980 --rest-address=0.0.0.0 --nat=extip:172.18.193.178 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=5a8ce3a91e48f07dca92c1ed2cff268dc48bfaa8dfeb573fcfdcd5a38c6b5fde --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=12981 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false
2026-02-25 15:31:08.224 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.193.178 waku c303f3697f167ada5a08cdb982339a2805d35daa230ed07861d8bcdb29cced04
2026-02-25 15:31:08.255 DEBUG [src.node.docker_mananger] Container started with ID c303f3697f16. Setting up logs at ./log/docker/node4_2026-02-25_15-31-04__36166133-4c2e-4bf8-aabf-371eae1807ec__wakuorg_nwaku:latest.log
2026-02-25 15:31:08.256 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 12977
2026-02-25 15:31:08.257 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 15:31:09.258 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12977/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:31:09.261 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 15:31:09.261 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 15:31:09.261 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12977/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:31:09.263 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.193.178/tcp/12978/p2p/16Uiu2HAmB9KawLsX5oWv3WPdSEYq6kDzSvvV5aF8MMHDmw55CKrU","/ip4/172.18.193.178/tcp/12979/ws/p2p/16Uiu2HAmB9KawLsX5oWv3WPdSEYq6kDzSvvV5aF8MMHDmw55CKrU"],"enrUri":"enr:-L24QGtH_S_cZlAVylrvHoH05LI4I08oWuoIyUzr_MPME3j_WXa17FfMKRdFlEjztINucpSMtm8Z4H2-lAuK03F1t_4CgmlkgnY0gmlwhKwSwbKKbXVsdGlhZGRyc5YACASsEsGyBjKyAAoErBLBsgYys90DgnJzhQADAQAAiXNlY3AyNTZrMaEC6YqjY0rylpJ9RTk5E8ptTiXLjDI8PeHvMPMnR8UkLbWDdGNwgjKyg3VkcIIytIV3YWt1MhI"}'
2026-02-25 15:31:09.263 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 15:31:09.264 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12977/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.19.68/tcp/57481/p2p/16Uiu2HAmKmDVnSLYDqnKYp8nkawgjztD5o5nyHBQ3otCYfrzMUtc"]'
2026-02-25 15:31:09.293 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:31:09.294 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 15:31:09.296 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 15:31:09.300 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 15:31:09.301 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.231.214
2026-02-25 15:31:09.301 DEBUG [src.node.docker_mananger] Generated ports ['58629', '58630', '58631', '58632', '58633']
2026-02-25 15:31:09.301 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 15:31:09.302 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 15:31:09.302 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 15:31:09.302 DEBUG [src.node.docker_mananger] docker run -i -t -p 58629:58629 -p 58630:58630 -p 58631:58631 -p 58632:58632 -p 58633:58633 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=58631 --rest-port=58629 --tcp-port=58630 --discv5-udp-port=58632 --rest-address=0.0.0.0 --nat=extip:172.18.231.214 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=8f54fd0c9dc5fbd1c050af83fdb6c3a90dae8f4eaea9cc0af52049efac515d31 --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=58633 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false
2026-02-25 15:31:09.501 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.231.214 waku e8074412229d760020c44a57ab5d50566d854e5591df5bf79fb077a37cdb37e7
2026-02-25 15:31:09.529 DEBUG [src.node.docker_mananger] Container started with ID e8074412229d. Setting up logs at ./log/docker/node5_2026-02-25_15-31-04__36166133-4c2e-4bf8-aabf-371eae1807ec__wakuorg_nwaku:latest.log
2026-02-25 15:31:09.529 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 58629
2026-02-25 15:31:09.529 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 15:31:10.531 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58629/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:31:10.534 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 15:31:10.534 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 15:31:10.534 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58629/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:31:10.536 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.231.214/tcp/58630/p2p/16Uiu2HAm5T1tUfdhaWe1u7uUq7BhYJPXFg7rQUS9rCFTq1WSA8nu","/ip4/172.18.231.214/tcp/58631/ws/p2p/16Uiu2HAm5T1tUfdhaWe1u7uUq7BhYJPXFg7rQUS9rCFTq1WSA8nu"],"enrUri":"enr:-L24QGvEk6dmFyYzz2NS8RmwJwnSz-lqsQ1abvQKyxVvnZ3TfEI9O9Bn6Qswv0KAIA_DjnAz446EM5rMkLdLvTGcmacCgmlkgnY0gmlwhKwS59aKbXVsdGlhZGRyc5YACASsEufWBuUGAAoErBLn1gblB90DgnJzhQADAQAAiXNlY3AyNTZrMaEClOz15FvEBl53xIdfE2-tQvMxspal-XghSmm2812DPXqDdGNwguUGg3VkcILlCIV3YWt1MhI"}'
2026-02-25 15:31:10.536 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 15:31:10.537 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:58629/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.193.178/tcp/12978/p2p/16Uiu2HAmB9KawLsX5oWv3WPdSEYq6kDzSvvV5aF8MMHDmw55CKrU"]'
2026-02-25 15:31:10.568 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:31:10.568 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 15:31:10.570 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 15:31:10.573 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 15:31:10.573 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.116.2
2026-02-25 15:31:10.573 DEBUG [src.node.docker_mananger] Generated ports ['55282', '55283', '55284', '55285', '55286']
2026-02-25 15:31:10.574 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 15:31:10.574 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 15:31:10.574 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 15:31:10.574 DEBUG [src.node.docker_mananger] docker run -i -t -p 55282:55282 -p 55283:55283 -p 55284:55284 -p 55285:55285 -p 55286:55286 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=55284 --rest-port=55282 --tcp-port=55283 --discv5-udp-port=55285 --rest-address=0.0.0.0 --nat=extip:172.18.116.2 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=551d07928b5e81e445dacf7e6aebaac7dff5fab89aa659bb8c9ab3f533ed5309 --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=55286 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false
2026-02-25 15:31:10.766 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.116.2 waku ac60c24d6ec7bc8dcb19d6bbe88fdea01c0bf160688db5fab2850694a5fb2791
2026-02-25 15:31:10.797 DEBUG [src.node.docker_mananger] Container started with ID ac60c24d6ec7. Setting up logs at ./log/docker/node6_2026-02-25_15-31-04__36166133-4c2e-4bf8-aabf-371eae1807ec__wakuorg_nwaku:latest.log
2026-02-25 15:31:10.798 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 55282
2026-02-25 15:31:10.798 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 15:31:11.798 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55282/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:31:11.801 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 15:31:11.801 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 15:31:11.802 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55282/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:31:11.804 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.116.2/tcp/55283/p2p/16Uiu2HAmGMGBU2hbYPYn2ATV2C3BgRwNxHQwDUVVZA97QvsngTMv","/ip4/172.18.116.2/tcp/55284/ws/p2p/16Uiu2HAmGMGBU2hbYPYn2ATV2C3BgRwNxHQwDUVVZA97QvsngTMv"],"enrUri":"enr:-L24QBikHvLoRqeAvQVdmzYieN3LCAtdnymiSaUT2KvgONL_V2pXdu5R3mWmw-lssF1336_j4J8xqUSChIePXCy-oUwCgmlkgnY0gmlwhKwSdAKKbXVsdGlhZGRyc5YACASsEnQCBtfzAAoErBJ0AgbX9N0DgnJzhQADAQAAiXNlY3AyNTZrMaEDNuQxYfDg-tLTKFEQmWZSPO77YhSHWRWoZ75JBdHc8k2DdGNwgtfzg3VkcILX9YV3YWt1MhI"}'
2026-02-25 15:31:11.804 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 15:31:11.804 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:55282/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.231.214/tcp/58630/p2p/16Uiu2HAm5T1tUfdhaWe1u7uUq7BhYJPXFg7rQUS9rCFTq1WSA8nu"]'
2026-02-25 15:31:11.838 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:31:11.840 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 15:31:11.841 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 15:31:11.845 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 15:31:11.846 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.23.200
2026-02-25 15:31:11.846 DEBUG [src.node.docker_mananger] Generated ports ['6353', '6354', '6355', '6356', '6357']
2026-02-25 15:31:11.846 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 15:31:11.847 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 15:31:11.847 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 15:31:11.848 DEBUG [src.node.docker_mananger] docker run -i -t -p 6353:6353 -p 6354:6354 -p 6355:6355 -p 6356:6356 -p 6357:6357 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=6355 --rest-port=6353 --tcp-port=6354 --discv5-udp-port=6356 --rest-address=0.0.0.0 --nat=extip:172.18.23.200 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=def135c7065aa14bacffd0fb2ec2bf7dd393fdf001caffc73a7abc52d1fc546d --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=6357 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false
2026-02-25 15:31:12.050 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.23.200 waku 12b9559cbd185eed56df3624e4ab213739a61715990fd06a27b67be1f65296c2
2026-02-25 15:31:12.082 DEBUG [src.node.docker_mananger] Container started with ID 12b9559cbd18. Setting up logs at ./log/docker/node7_2026-02-25_15-31-04__36166133-4c2e-4bf8-aabf-371eae1807ec__wakuorg_nwaku:latest.log
2026-02-25 15:31:12.083 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 6353
2026-02-25 15:31:12.083 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 15:31:13.084 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6353/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:31:13.086 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 15:31:13.087 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 15:31:13.087 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6353/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:31:13.089 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.23.200/tcp/6354/p2p/16Uiu2HAm4zddab3WQCybfpmNDJeJL6F529rEqFmQ9VSJeD4hfWh2","/ip4/172.18.23.200/tcp/6355/ws/p2p/16Uiu2HAm4zddab3WQCybfpmNDJeJL6F529rEqFmQ9VSJeD4hfWh2"],"enrUri":"enr:-L24QPUvXAKkw32He-_NgsKDah6kOgtSMvx5gnhSTpb1SHY0Ks3N2QPw0F0zxMkOa0kkg2JXZhWudapzoaxLYHIPY2UCgmlkgnY0gmlwhKwSF8iKbXVsdGlhZGRyc5YACASsEhfIBhjSAAoErBIXyAYY090DgnJzhQADAQAAiXNlY3AyNTZrMaECjiqxjZ9cFY9x17kG59bBOgSCCafDI8zb5YIlvnEV_fWDdGNwghjSg3VkcIIY1IV3YWt1MhI"}'
2026-02-25 15:31:13.089 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 15:31:13.090 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:6353/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.116.2/tcp/55283/p2p/16Uiu2HAmGMGBU2hbYPYn2ATV2C3BgRwNxHQwDUVVZA97QvsngTMv"]'
2026-02-25 15:31:13.124 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:31:13.124 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 15:31:13.124 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 15:31:13.127 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 15:31:13.128 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.147.216
2026-02-25 15:31:13.128 DEBUG [src.node.docker_mananger] Generated ports ['51728', '51729', '51730', '51731', '51732']
2026-02-25 15:31:13.128 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 15:31:13.128 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 15:31:13.128 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 15:31:13.130 DEBUG [src.node.docker_mananger] docker run -i -t -p 51728:51728 -p 51729:51729 -p 51730:51730 -p 51731:51731 -p 51732:51732 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=51730 --rest-port=51728 --tcp-port=51729 --discv5-udp-port=51731 --rest-address=0.0.0.0 --nat=extip:172.18.147.216 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=fc2575ed1bcb6acd9c5c9bcd3817432cdd5e247edab2ffcdc5be245bfefaedf8 --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=51732 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false
2026-02-25 15:31:13.326 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.147.216 waku 619bba2f8c587ba185ac9d0b7275665867af7a15618292b9b3eadea38beedce4
2026-02-25 15:31:13.362 DEBUG [src.node.docker_mananger] Container started with ID 619bba2f8c58. Setting up logs at ./log/docker/node8_2026-02-25_15-31-04__36166133-4c2e-4bf8-aabf-371eae1807ec__wakuorg_nwaku:latest.log
2026-02-25 15:31:13.362 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 51728
2026-02-25 15:31:13.363 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 15:31:14.364 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:51728/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:31:14.367 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 15:31:14.367 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 15:31:14.367 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:51728/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:31:14.369 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.147.216/tcp/51729/p2p/16Uiu2HAm3Drwdysc11EK4c9TuVxtEfjD5F8M1kHSdhn3nxzRU9AV","/ip4/172.18.147.216/tcp/51730/ws/p2p/16Uiu2HAm3Drwdysc11EK4c9TuVxtEfjD5F8M1kHSdhn3nxzRU9AV"],"enrUri":"enr:-L24QMk2P8W01H6HyNqe2VIzmE2-Txmr3iU5oCvGV4nft7Apav283D6jbxZw75BPPuiFnLJF1XZvKiYwxdgeba7FUCgCgmlkgnY0gmlwhKwSk9iKbXVsdGlhZGRyc5YACASsEpPYBsoRAAoErBKT2AbKEt0DgnJzhQADAQAAiXNlY3AyNTZrMaECc9br4rVFH2re1HfMA_nF0nO2Os6ZCvKvEnzxiltLa96DdGNwgsoRg3VkcILKE4V3YWt1MhI"}'
2026-02-25 15:31:14.370 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 15:31:14.370 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:51728/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.23.200/tcp/6354/p2p/16Uiu2HAm4zddab3WQCybfpmNDJeJL6F529rEqFmQ9VSJeD4hfWh2"]'
2026-02-25 15:31:14.404 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:31:14.405 DEBUG [src.steps.store] Relaying message
2026-02-25 15:31:14.405 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38876/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 15:31:14.412 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:31:14.413 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 15:31:14.614 DEBUG [src.steps.store] Relaying message
2026-02-25 15:31:14.614 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38876/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 15:31:14.618 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:31:14.618 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 15:31:14.819 DEBUG [src.steps.store] Relaying message
2026-02-25 15:31:14.819 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38876/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 15:31:14.823 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:31:14.823 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 15:31:15.023 DEBUG [src.steps.store] Relaying message
2026-02-25 15:31:15.024 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38876/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 15:31:15.028 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:31:15.028 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 15:31:15.228 DEBUG [src.steps.store] Relaying message
2026-02-25 15:31:15.229 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38876/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 15:31:15.232 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:31:15.233 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 15:31:15.433 DEBUG [src.steps.store] Relaying message
2026-02-25 15:31:15.434 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38876/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 15:31:15.438 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:31:15.438 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 15:31:15.638 DEBUG [src.steps.store] Relaying message
2026-02-25 15:31:15.639 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38876/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 15:31:15.643 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:31:15.643 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 15:31:15.843 DEBUG [src.steps.store] Relaying message
2026-02-25 15:31:15.844 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38876/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 15:31:15.849 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:31:15.849 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 15:31:16.049 DEBUG [src.steps.store] Relaying message
2026-02-25 15:31:16.050 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38876/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 15:31:16.054 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:31:16.054 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 15:31:16.255 DEBUG [src.steps.store] Relaying message
2026-02-25 15:31:16.255 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38876/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 15:31:16.259 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:31:16.259 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 15:31:16.460 DEBUG [src.libs.common] Sleeping for 90 seconds
2026-02-25 15:32:46.460 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-02-25 15:32:46.461 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:51728/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:32:46.464 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0xd1e4f9976ac038545db08d598c83e1820b66bd658ed350d156852ac1a9c5e5b1"},{"messageHash":"0x7b6210445c306b76ba8b74ec6d1545cf594bf8d5a28e1fc39a2e49951d7c2fe8"},{"messageHash":"0x9ef5f5e4a3c5a3675a7e9208369a0dd2556a595c6be1a509f477450351f4b5b0"},{"messageHash":"0xf4b4002310eb406ed0fa3d5508a5183577523354ac6833edd582c029f0408cb0"},{"messageHash":"0x90cb07eb608b8acfd958b7cc9ae7f86e63fdc8c83460fe5162769d429beb4aa9"},{"messageHash":"0x320e034b1592ec16bc7e9d2457c6c0da5cf9dc3d4577c6e4d79408186d36422f"},{"messageHash":"0x927fae7b70d19a61e9cdec8bb596f4132eee9cb858d707dae16e8bf77e21d7c2"},{"messageHash":"0xeeef6b7208c635d8b69293f6d4706d51613ac8b1bec2dee2840e6c36d2cafa10"},{"messageHash":"0xa6321e67edf1f84147c8e5b5a7047b667df4db36a586a3647963ceb9dfd6fe68"},{"messageHash":"0x77feb1e9b54c0941833ad7282021efe31c2d7b5e9d05d67fd489ce41a8bc8eb6"}]}'
2026-02-25 15:32:46.464 DEBUG [src.steps.store] messages length is 10
2026-02-25 15:32:46.467 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-02-25 15:32:46.468 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-02-25 15:32:46.468 DEBUG [src.node.waku_node] Stopping container with id 2ca69ce6bba1
2026-02-25 15:32:47.075 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 15:32:47.075 DEBUG [src.node.waku_node] Stopping container with id 621ccd5ff29a
2026-02-25 15:32:47.679 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 15:32:47.681 DEBUG [src.node.waku_node] Stopping container with id 94f3f49f60b8
2026-02-25 15:32:48.019 ERROR [src.node.docker_mananger] Max retries reached for container 2ca69ce6bba1. Exiting log stream.
2026-02-25 15:32:48.255 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 15:32:48.257 DEBUG [src.node.waku_node] Stopping container with id c303f3697f16
2026-02-25 15:32:48.664 ERROR [src.node.docker_mananger] Max retries reached for container 621ccd5ff29a. Exiting log stream.
2026-02-25 15:32:48.835 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 15:32:48.835 DEBUG [src.node.waku_node] Stopping container with id e8074412229d
2026-02-25 15:32:49.223 ERROR [src.node.docker_mananger] Max retries reached for container 94f3f49f60b8. Exiting log stream.
2026-02-25 15:32:49.373 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 15:32:49.373 DEBUG [src.node.waku_node] Stopping container with id ac60c24d6ec7
2026-02-25 15:32:49.647 ERROR [src.node.docker_mananger] Max retries reached for container c303f3697f16. Exiting log stream.
2026-02-25 15:32:49.950 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 15:32:49.952 DEBUG [src.node.waku_node] Stopping container with id 12b9559cbd18
2026-02-25 15:32:50.186 ERROR [src.node.docker_mananger] Max retries reached for container e8074412229d. Exiting log stream.
2026-02-25 15:32:50.497 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 15:32:50.497 DEBUG [src.node.waku_node] Stopping container with id 619bba2f8c58
2026-02-25 15:32:50.766 ERROR [src.node.docker_mananger] Max retries reached for container ac60c24d6ec7. Exiting log stream.
2026-02-25 15:32:51.065 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 15:32:51.068 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-02-25 15:32:51.138 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 15:32:51.241 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 15:32:51.338 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 15:32:51.386 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 15:32:51.428 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 15:32:51.470 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 15:32:51.517 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 15:32:51.550 DEBUG [src.node.docker_mananger] No errors found in the waku logs.