269 lines
49 KiB
Plaintext
Raw Blame History

This file contains invisible Unicode characters

This file contains invisible Unicode characters that are indistinguishable to humans but may be processed differently by a computer. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

DEBUG  tests.conftest:conftest.py:51 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:57 Running test: test_store_sync_long_chain with id: 2026-03-27_04-56-37__d8e4fb56-9ae8-4707-926c-c9ef92709b93
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node1_2026-03-27_04-56-37__d8e4fb56-9ae8-4707-926c-c9ef92709b93__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node2_2026-03-27_04-56-37__d8e4fb56-9ae8-4707-926c-c9ef92709b93__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node3_2026-03-27_04-56-37__d8e4fb56-9ae8-4707-926c-c9ef92709b93__wakuorg_nwaku:latest.log
DEBUG  src.steps.store:store.py:31 Running fixture setup: store_setup
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.145.31
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['60059', '60060', '60061', '60062', '60063']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 60059:60059 -p 60060:60060 -p 60061:60061 -p 60062:60062 -p 60063:60063 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=60061 --rest-port=60059 --tcp-port=60060 --discv5-udp-port=60062 --rest-address=0.0.0.0 --nat=extip:172.18.145.31 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=a6ce3f6af5323fb367bf3e681a7660ad8e3b5116ccab264c66510232fba7d8f3 --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=60063 --metrics-logging=true --store-sync-relay-jitter=0 --relay=true --dns-discovery=false
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 80b928777b16. Exiting log stream.
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.145.31 waku 02e36e6caecfbc18993b14496e8e68ec096e21264f297f68f9fcfc339e6969fa
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 02e36e6caecf. Setting up logs at ./log/docker/node1_2026-03-27_04-56-37__d8e4fb56-9ae8-4707-926c-c9ef92709b93__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 60059
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 9443f71a59b4. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:60059/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:60059/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.145.31/tcp/60060/p2p/16Uiu2HAmAsvY6L4n9J7p4rcAGjoPoisvMu2SAazYhHpQZdxLnkhW","/ip4/172.18.145.31/tcp/60061/ws/p2p/16Uiu2HAmAsvY6L4n9J7p4rcAGjoPoisvMu2SAazYhHpQZdxLnkhW"],"enrUri":"enr:-L24QGh2esOv5VBqqCWVSooOnGIeDa8CXjFRZ0lkwIq6G5sWeLVXT5Xmd8j9wCfBhWk11fEyOEhKJMw2VIXVggJnHXYCgmlkgnY0gmlwhKwSkR-KbXVsdGlhZGRyc5YACASsEpEfBuqcAAoErBKRHwbqnd0DgnJzhQADAQAAiXNlY3AyNTZrMaEC5ZjdTKFNwM6qj2ty4pZpW23hqe342g4y_NHjOl4m8tGDdGNwguqcg3VkcILqnoV3YWt1MhM"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:60059/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node4_2026-03-27_04-56-37__d8e4fb56-9ae8-4707-926c-c9ef92709b93__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node5_2026-03-27_04-56-37__d8e4fb56-9ae8-4707-926c-c9ef92709b93__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node6_2026-03-27_04-56-37__d8e4fb56-9ae8-4707-926c-c9ef92709b93__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node7_2026-03-27_04-56-37__d8e4fb56-9ae8-4707-926c-c9ef92709b93__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node8_2026-03-27_04-56-37__d8e4fb56-9ae8-4707-926c-c9ef92709b93__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.161.214
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['6784', '6785', '6786', '6787', '6788']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 6784:6784 -p 6785:6785 -p 6786:6786 -p 6787:6787 -p 6788:6788 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=6786 --rest-port=6784 --tcp-port=6785 --discv5-udp-port=6787 --rest-address=0.0.0.0 --nat=extip:172.18.161.214 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=7cab58d7dda1b75c26ff07fcbbc057ad526cae62be4bd7d22550f3980ff46f54 --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=6788 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.161.214 waku cd95718e7c7f6a5aabddde8304362e477291d34c4c31d6f76270180260c7db8b
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID cd95718e7c7f. Setting up logs at ./log/docker/node2_2026-03-27_04-56-37__d8e4fb56-9ae8-4707-926c-c9ef92709b93__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 6784
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:6784/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:6784/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.161.214/tcp/6785/p2p/16Uiu2HAmCt5jaZiwjAZAdxvKXGY9Zq5eHcgARtVz2pcTgR3DSkPP","/ip4/172.18.161.214/tcp/6786/ws/p2p/16Uiu2HAmCt5jaZiwjAZAdxvKXGY9Zq5eHcgARtVz2pcTgR3DSkPP"],"enrUri":"enr:-L24QEzHVnKGswEakcziDKhFalbFDvR_YGDn5Mnei0nOC_v-Xe-0aHF-vi-Ct0DkoP-Caa_Gfe_uxuMsWk0sazTSm0gCgmlkgnY0gmlwhKwSodaKbXVsdGlhZGRyc5YACASsEqHWBhqBAAoErBKh1gYagt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDA1qjeVHe2s3-xu1aYDXmuaaBnA-mknOZ4Ujfu1el24aDdGNwghqBg3VkcIIag4V3YWt1MhI"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:6784/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.145.31/tcp/60060/p2p/16Uiu2HAmAsvY6L4n9J7p4rcAGjoPoisvMu2SAazYhHpQZdxLnkhW"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.252.61
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['42491', '42492', '42493', '42494', '42495']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 42491:42491 -p 42492:42492 -p 42493:42493 -p 42494:42494 -p 42495:42495 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=42493 --rest-port=42491 --tcp-port=42492 --discv5-udp-port=42494 --rest-address=0.0.0.0 --nat=extip:172.18.252.61 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=9ed263cdaec0ffcde7aed832f701b9bb4c19ec4fce0f0bfb4e4ec04bc12df8d1 --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=42495 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.252.61 waku d6e8b504b40c60e5a5099b1ce049ee17e5b2822642ac848eef4acf93b1b12c43
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID d6e8b504b40c. Setting up logs at ./log/docker/node3_2026-03-27_04-56-37__d8e4fb56-9ae8-4707-926c-c9ef92709b93__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 42491
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:42491/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:42491/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.252.61/tcp/42492/p2p/16Uiu2HAm9ExuKehPCnKaSFHDufwY7UC2n1GTPH6xRKYs49YUFfjr","/ip4/172.18.252.61/tcp/42493/ws/p2p/16Uiu2HAm9ExuKehPCnKaSFHDufwY7UC2n1GTPH6xRKYs49YUFfjr"],"enrUri":"enr:-L24QKFlImLMFcghELrpd4zd-Rwjr1gNXm7jub8qf8xoGwfqJq42zLF3ApoxJ1YfJ6ojqAQFh0SHA81SoK_Toq5espECgmlkgnY0gmlwhKwS_D2KbXVsdGlhZGRyc5YACASsEvw9BqX8AAoErBL8PQal_d0DgnJzhQADAQAAiXNlY3AyNTZrMaECzUVc5MYawWcWT6CQogQ8D2wbblj4jL_KWUSWb0L_q82DdGNwgqX8g3VkcIKl_oV3YWt1MhI"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:42491/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.161.214/tcp/6785/p2p/16Uiu2HAmCt5jaZiwjAZAdxvKXGY9Zq5eHcgARtVz2pcTgR3DSkPP"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.95.188
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['1963', '1964', '1965', '1966', '1967']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 1963:1963 -p 1964:1964 -p 1965:1965 -p 1966:1966 -p 1967:1967 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=1965 --rest-port=1963 --tcp-port=1964 --discv5-udp-port=1966 --rest-address=0.0.0.0 --nat=extip:172.18.95.188 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=dcf609c31fe1fe404cacafc315d3d541c0fc077eabc92c45fefe46be20bbacd8 --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=1967 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.95.188 waku 173c68ad5c9e51a581fba7ce85b06d255273c4c1bad5d5874d6272b9278b8eeb
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 173c68ad5c9e. Setting up logs at ./log/docker/node4_2026-03-27_04-56-37__d8e4fb56-9ae8-4707-926c-c9ef92709b93__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 1963
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:1963/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:1963/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.95.188/tcp/1964/p2p/16Uiu2HAmBjyygoVxLC57R9i4PXbUMtRwhgLVpdHQz68RqXRivv1K","/ip4/172.18.95.188/tcp/1965/ws/p2p/16Uiu2HAmBjyygoVxLC57R9i4PXbUMtRwhgLVpdHQz68RqXRivv1K"],"enrUri":"enr:-L24QAFQU7pJP9CC2XFMe7EzZrhDWil7S-zfWYFEe4fmOoibPBa2qPWIQor61zR4tvix0rztMAz7gIUAbU0JDbxPbnYCgmlkgnY0gmlwhKwSX7yKbXVsdGlhZGRyc5YACASsEl-8BgesAAoErBJfvAYHrd0DgnJzhQADAQAAiXNlY3AyNTZrMaEC8mvLxPncMegdfE-Yb0fpxlfumIfVqTJ3sCLqakqXLt6DdGNwggesg3VkcIIHroV3YWt1MhI"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:1963/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.252.61/tcp/42492/p2p/16Uiu2HAm9ExuKehPCnKaSFHDufwY7UC2n1GTPH6xRKYs49YUFfjr"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.198.41
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['24111', '24112', '24113', '24114', '24115']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 24111:24111 -p 24112:24112 -p 24113:24113 -p 24114:24114 -p 24115:24115 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=24113 --rest-port=24111 --tcp-port=24112 --discv5-udp-port=24114 --rest-address=0.0.0.0 --nat=extip:172.18.198.41 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=bdedb5de8ada9cf2b98251ba376c3d082f6c33fa0eadcfc3bf2c960b3bc95c34 --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=24115 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.198.41 waku 4c61462e1c57f0f56cf9babd397d104d5f87fc56ba82e583fbfcb8205ed9a95f
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 4c61462e1c57. Setting up logs at ./log/docker/node5_2026-03-27_04-56-37__d8e4fb56-9ae8-4707-926c-c9ef92709b93__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 24111
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:24111/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:24111/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.198.41/tcp/24112/p2p/16Uiu2HAmTVC91UcFrUQneypSh915UeSEp74xjLuvUAMednX8gvjH","/ip4/172.18.198.41/tcp/24113/ws/p2p/16Uiu2HAmTVC91UcFrUQneypSh915UeSEp74xjLuvUAMednX8gvjH"],"enrUri":"enr:-L24QJ0i2dX1P3yTbp-o8ZKCPTrNbdrEtyKJsRYgJgvxUq17Zo642oOQdNz_6evsvsJCP8r27l3UxWrOqrwy0menHakCgmlkgnY0gmlwhKwSximKbXVsdGlhZGRyc5YACASsEsYpBl4wAAoErBLGKQZeMd0DgnJzhQADAQAAiXNlY3AyNTZrMaED3FzTKFDcNm_eDsV1MsvlXT9G7k59lbQeFQLFf5qc7pCDdGNwgl4wg3VkcIJeMoV3YWt1MhI"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:24111/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.95.188/tcp/1964/p2p/16Uiu2HAmBjyygoVxLC57R9i4PXbUMtRwhgLVpdHQz68RqXRivv1K"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.214.86
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['33185', '33186', '33187', '33188', '33189']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 33185:33185 -p 33186:33186 -p 33187:33187 -p 33188:33188 -p 33189:33189 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=33187 --rest-port=33185 --tcp-port=33186 --discv5-udp-port=33188 --rest-address=0.0.0.0 --nat=extip:172.18.214.86 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=7bce9bccf0ad4a04aa65dfbc5b06d30acecc3ddf9db3dc748c4c7c0fcab6befb --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=33189 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.214.86 waku b0b5137e8a35376076d580785a2414add6487fe6fa783ecfca897b09aca116ca
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID b0b5137e8a35. Setting up logs at ./log/docker/node6_2026-03-27_04-56-37__d8e4fb56-9ae8-4707-926c-c9ef92709b93__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 33185
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:33185/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:33185/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.214.86/tcp/33186/p2p/16Uiu2HAmJivb1eniBELiKQnrNjic9W4LeFj4H5535psdbAwcrK48","/ip4/172.18.214.86/tcp/33187/ws/p2p/16Uiu2HAmJivb1eniBELiKQnrNjic9W4LeFj4H5535psdbAwcrK48"],"enrUri":"enr:-L24QLGDPvYh8Ipb1ljnGreePnZGrNPXH-zQizNSePZ1zB8fKNOPCPtIVR2C2_qrLF1qzxeajJziVwVxhEJqQvRf0koCgmlkgnY0gmlwhKwS1laKbXVsdGlhZGRyc5YACASsEtZWBoGiAAoErBLWVgaBo90DgnJzhQADAQAAiXNlY3AyNTZrMaEDWigwgpB4h3XiS68W5u02f5GaIWrZIZ8E6UrBuDBImRWDdGNwgoGig3VkcIKBpIV3YWt1MhI"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:33185/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.198.41/tcp/24112/p2p/16Uiu2HAmTVC91UcFrUQneypSh915UeSEp74xjLuvUAMednX8gvjH"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.250.167
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['13120', '13121', '13122', '13123', '13124']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 13120:13120 -p 13121:13121 -p 13122:13122 -p 13123:13123 -p 13124:13124 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=13122 --rest-port=13120 --tcp-port=13121 --discv5-udp-port=13123 --rest-address=0.0.0.0 --nat=extip:172.18.250.167 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=caffc3a68819dfadbdd7f86ae9d60965c987d44b265ebe235283ab7b7e5c76df --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=13124 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.250.167 waku 68eb1f35f6f05103ac104e1f661ac8170a5c7a6519b99f93264cee94e48e1bb1
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 68eb1f35f6f0. Setting up logs at ./log/docker/node7_2026-03-27_04-56-37__d8e4fb56-9ae8-4707-926c-c9ef92709b93__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 13120
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:13120/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:13120/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.250.167/tcp/13121/p2p/16Uiu2HAmMq2dn6qUquvDUzwP2Dbr7RJ6XtRaxoKvudXub2h35vQQ","/ip4/172.18.250.167/tcp/13122/ws/p2p/16Uiu2HAmMq2dn6qUquvDUzwP2Dbr7RJ6XtRaxoKvudXub2h35vQQ"],"enrUri":"enr:-L24QIaNb9w9lFNGcRMIQIxztWl2tTziO8F8pHmhQyPrp8DuLmDs3XhhsGKyaVQsog6o4XLhNGaYqFBMFxOs_3O3m5ECgmlkgnY0gmlwhKwS-qeKbXVsdGlhZGRyc5YACASsEvqnBjNBAAoErBL6pwYzQt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDiEuSwk3ecPPdNKKOD093ffG558y8jH-vy6L4bhnI7MGDdGNwgjNBg3VkcIIzQ4V3YWt1MhI"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:13120/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.214.86/tcp/33186/p2p/16Uiu2HAmJivb1eniBELiKQnrNjic9W4LeFj4H5535psdbAwcrK48"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.41.219
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['27607', '27608', '27609', '27610', '27611']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 27607:27607 -p 27608:27608 -p 27609:27609 -p 27610:27610 -p 27611:27611 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=27609 --rest-port=27607 --tcp-port=27608 --discv5-udp-port=27610 --rest-address=0.0.0.0 --nat=extip:172.18.41.219 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=da9b8b7573beb12a445d9f894bbd2056e6bf2e4e35aeb4deb155afdb522775fd --store-sync=true --store=true --store-sync-range=120 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=27611 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.41.219 waku 930d3d1cf102974c8feabca2a0f6cf16347c92f6f8ac398e0766ba18c74cfc95
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 930d3d1cf102. Setting up logs at ./log/docker/node8_2026-03-27_04-56-37__d8e4fb56-9ae8-4707-926c-c9ef92709b93__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 27607
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:27607/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:27607/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.41.219/tcp/27608/p2p/16Uiu2HAm57dNM7K2yqWcC1BJr43UFAxeCNmK54MJppGojoAFPw8k","/ip4/172.18.41.219/tcp/27609/ws/p2p/16Uiu2HAm57dNM7K2yqWcC1BJr43UFAxeCNmK54MJppGojoAFPw8k"],"enrUri":"enr:-L24QB1HRahK6byeqRx2oUu_MQKhYeOQtmEy6cD47kD-ahgxag2ZPbECZ5Im-sJM5tuLzryrXdKcSl37v1KLgxbKNTcCgmlkgnY0gmlwhKwSKduKbXVsdGlhZGRyc5YACASsEinbBmvYAAoErBIp2wZr2d0DgnJzhQADAQAAiXNlY3AyNTZrMaECj_V2V8vD5C7CpoWEr_oCqP-UNEQBPfRarCTntB8IUMmDdGNwgmvYg3VkcIJr2oV3YWt1MhI"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:27607/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.250.167/tcp/13121/p2p/16Uiu2HAmMq2dn6qUquvDUzwP2Dbr7RJ6XtRaxoKvudXub2h35vQQ"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:60059/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.2 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:60059/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.2 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:60059/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.2 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:60059/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.2 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:60059/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.2 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:60059/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.2 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:60059/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.2 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:60059/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.2 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:60059/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.2 seconds
DEBUG  src.steps.store:store.py:132 Relaying message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:60059/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.2 seconds
DEBUG  src.libs.common:common.py:47 Sleeping for 90 seconds
DEBUG  src.steps.store:store.py:211 Checking that peer wakuorg/nwaku:latest can find the stored messages
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:27607/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x87e2ab7937b67f8f684e87ae91a5af0887505bae4145528a7937c4f26c4deca1"},{"messageHash":"0x5806c6ec12095c7f4ed0ca0fb1049b10f68164aa3fcd17f926b278dc874f634d"},{"messageHash":"0x64049d51b45c2ee814afb6d85f7992be2a18600edc01c1e7ebc875c2b4a58982"},{"messageHash":"0x980692f651b4004d05e7b3e8d2c353fbe133ce0f53d2b15e51c544a7761dae80"},{"messageHash":"0x9a8ca17c40dbb8d2a6e56df8b49eeca56fa6919d7f9427787ffb226fd9cc7c60"},{"messageHash":"0xe62a6f9227d5945c681720b9642088723d521f081be4a59874c5f88d07122728"},{"messageHash":"0x9e7b191d9cca3c3834beaea613d2a91a1004d64d0d529169f15a69fe3267488c"},{"messageHash":"0x0154db3292a35a42c392afc6e69659c5bda250b1000ea2adce24f0e4bce27f3e"},{"messageHash":"0x36a411855d58a095e80d60da4a3170a3a648a4984b8106c87c9cd923adf463db"},{"messageHash":"0x8acd6ee44dbe804ad7164026f4b6fdbe15f3bcd8f126732f2ab584ada2f89df2"}]}'
DEBUG  src.steps.store:store.py:228 messages length is 10
DEBUG  tests.conftest:conftest.py:59 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:83 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 02e36e6caecf
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id cd95718e7c7f
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id d6e8b504b40c
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 02e36e6caecf. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 173c68ad5c9e
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container cd95718e7c7f. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 4c61462e1c57
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container d6e8b504b40c. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id b0b5137e8a35
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 173c68ad5c9e. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 68eb1f35f6f0
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 4c61462e1c57. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 930d3d1cf102
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container b0b5137e8a35. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  tests.conftest:conftest.py:98 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 68eb1f35f6f0. Exiting log stream.