261 lines
51 KiB
Plaintext
Raw Blame History

This file contains invisible Unicode characters

This file contains invisible Unicode characters that are indistinguishable to humans but may be processed differently by a computer. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

DEBUG  tests.conftest:conftest.py:51 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:57 Running test: test_light_push_after_light_push_node_restarts with id: 2026-03-03_04-34-32__0e22b9c0-1a3d-4904-88c7-5f1ba96638f9
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.steps.light_push:light_push.py:28 Running fixture setup: light_push_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/receiving_node1_2026-03-03_04-34-32__0e22b9c0-1a3d-4904-88c7-5f1ba96638f9__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.118.199
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['38682', '38683', '38684', '38685', '38686']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 38682:38682 -p 38683:38683 -p 38684:38684 -p 38685:38685 -p 38686:38686 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=38684 --rest-port=38682 --tcp-port=38683 --discv5-udp-port=38685 --rest-address=0.0.0.0 --nat=extip:172.18.118.199 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=bb6a84779cec9fe66077afdd0aaebb3fcadef47cc4a7f3fdc36c29dc78efd87b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=38686 --metrics-logging=true --lightpush=true --relay=true
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.118.199 waku 08ae7219780b6b75372a19758447077fa2848db4f757568f2001fc63da09f9b2
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 08ae7219780b. Setting up logs at ./log/docker/receiving_node1_2026-03-03_04-34-32__0e22b9c0-1a3d-4904-88c7-5f1ba96638f9__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 38682
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container a3dfdf39a454. Exiting log stream.
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container d5f830712bcf. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:38682/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:38682/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.118.199/tcp/38683/p2p/16Uiu2HAmEFeDj3LiteLNoKaDwGu6usbpUz1SXmuVPeZ8DDcK3Fwo","/ip4/172.18.118.199/tcp/38684/ws/p2p/16Uiu2HAmEFeDj3LiteLNoKaDwGu6usbpUz1SXmuVPeZ8DDcK3Fwo"],"enrUri":"enr:-L24QGshAnyewXoYmli0DoaJHC026S7y_-SCiUJw9Gb3rTOSAVXaK_lRM7Ld5V_dsJVnX5pDF2e7xR-wR7pPbzlamgECgmlkgnY0gmlwhKwSdseKbXVsdGlhZGRyc5YACASsEnbHBpcbAAoErBJ2xwaXHN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDF7xA8wQaFbEXnx27qzRckzB-T0q1H2HtqADsQoMYDLKDdGNwgpcbg3VkcIKXHYV3YWt1Mgk"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/receiving_node2_2026-03-03_04-34-32__0e22b9c0-1a3d-4904-88c7-5f1ba96638f9__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.155.39
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['4952', '4953', '4954', '4955', '4956']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 4952:4952 -p 4953:4953 -p 4954:4954 -p 4955:4955 -p 4956:4956 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=4954 --rest-port=4952 --tcp-port=4953 --discv5-udp-port=4955 --rest-address=0.0.0.0 --nat=extip:172.18.155.39 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=becc1b01fcaccedafaeb65c0bddffd292df7fefeea44ec25bce5ae7bf8999d54 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=4956 --metrics-logging=true --lightpush=false --relay=true
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.155.39 waku aa25e4dccc77f29505f3d6d5ae8f3ca0b67d718645e24b32414308365fe469eb
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID aa25e4dccc77. Setting up logs at ./log/docker/receiving_node2_2026-03-03_04-34-32__0e22b9c0-1a3d-4904-88c7-5f1ba96638f9__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 4952
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:4952/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:4952/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.155.39/tcp/4953/p2p/16Uiu2HAkvoryBQDzfp8bYpkZuZatcLc5GN7Li93hxuQk4oBfTNxh","/ip4/172.18.155.39/tcp/4954/ws/p2p/16Uiu2HAkvoryBQDzfp8bYpkZuZatcLc5GN7Li93hxuQk4oBfTNxh"],"enrUri":"enr:-L24QNI-o56-4xH-Z6Kjupf4o-EgzXKL5cyjXLRhI9UX63c_Iuurw5ZKYgXlxCfNZqqu-rSR12bDzCG9qnolHQRMKrcCgmlkgnY0gmlwhKwSmyeKbXVsdGlhZGRyc5YACASsEpsnBhNZAAoErBKbJwYTWt0DgnJzhQADAQAAiXNlY3AyNTZrMaECFIrj-FIGrZ12IhAur0IIZjti2p6miweRyavUVKvlWUKDdGNwghNZg3VkcIITW4V3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:4952/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.118.199/tcp/38683/p2p/16Uiu2HAmEFeDj3LiteLNoKaDwGu6usbpUz1SXmuVPeZ8DDcK3Fwo"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/lightpush_node1_2026-03-03_04-34-32__0e22b9c0-1a3d-4904-88c7-5f1ba96638f9__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.169.192
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['42779', '42780', '42781', '42782', '42783']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 42779:42779 -p 42780:42780 -p 42781:42781 -p 42782:42782 -p 42783:42783 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=42781 --rest-port=42779 --tcp-port=42780 --discv5-udp-port=42782 --rest-address=0.0.0.0 --nat=extip:172.18.169.192 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=f549cacff409ecdac602be59ebc0ff84426442e6f920ef24fc4c9febf58aa8e4 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=42783 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QGshAnyewXoYmli0DoaJHC026S7y_-SCiUJw9Gb3rTOSAVXaK_lRM7Ld5V_dsJVnX5pDF2e7xR-wR7pPbzlamgECgmlkgnY0gmlwhKwSdseKbXVsdGlhZGRyc5YACASsEnbHBpcbAAoErBJ2xwaXHN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDF7xA8wQaFbEXnx27qzRckzB-T0q1H2HtqADsQoMYDLKDdGNwgpcbg3VkcIKXHYV3YWt1Mgk --lightpushnode=/ip4/172.18.118.199/tcp/38683/p2p/16Uiu2HAmEFeDj3LiteLNoKaDwGu6usbpUz1SXmuVPeZ8DDcK3Fwo --lightpush=true --relay=true
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.169.192 waku 3450ceb06f9edb65f26646921c1be8da4de12d079b16714dbaef3b9c386f9652
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 3450ceb06f9e. Setting up logs at ./log/docker/lightpush_node1_2026-03-03_04-34-32__0e22b9c0-1a3d-4904-88c7-5f1ba96638f9__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 42779
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:42779/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:42779/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.169.192/tcp/42780/p2p/16Uiu2HAmQj5GUe6a4mztewZVC9bLQgBUkMqAkh6WFjTXbQT6bXq7","/ip4/172.18.169.192/tcp/42781/ws/p2p/16Uiu2HAmQj5GUe6a4mztewZVC9bLQgBUkMqAkh6WFjTXbQT6bXq7"],"enrUri":"enr:-L24QLUgWiOZSl9d9pZo6CE9q8tDl3_tc9zzVOzQ92E0_INFJTbEbKOZ7kQNPdAjuDYufxDzZAWKJnsMIRVn8iX7t5oCgmlkgnY0gmlwhKwSqcCKbXVsdGlhZGRyc5YACASsEqnABqccAAoErBKpwAanHd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDs1ggROKSBZ5irTNJxNNDcLvL-EUM6ZGas5uC2nClgL6DdGNwgqccg3VkcIKnHoV3YWt1Mgk"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:42779/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.118.199/tcp/38683/p2p/16Uiu2HAmEFeDj3LiteLNoKaDwGu6usbpUz1SXmuVPeZ8DDcK3Fwo"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:42779/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.155.39/tcp/4953/p2p/16Uiu2HAkvoryBQDzfp8bYpkZuZatcLc5GN7Li93hxuQk4oBfTNxh"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:38682/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:4952/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:42779/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.steps.light_push:light_push.py:121 Lightpushing message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:42779/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/3/0", "message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "contentTopic": "/myapp/1/latest/proto", "timestamp": 1772512476393274641}}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.1 seconds
DEBUG  src.steps.light_push:light_push.py:125 Checking that peer NODE_1:wakuorg/nwaku:latest can find the lightpushed message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:38682/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512476393274641,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.light_push:light_push.py:125 Checking that peer NODE_2:wakuorg/nwaku:latest can find the lightpushed message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:4952/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512476393274641,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.light_push:light_push.py:125 Checking that peer NODE_3:wakuorg/nwaku:latest can find the lightpushed message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:42779/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512476393274641,"ephemeral":false,"proof":""}]'
DEBUG  src.node.waku_node:waku_node.py:257 Restarting container with id 3450ceb06f9e
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:42779/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:42779/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:42779/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.169.192/tcp/42780/p2p/16Uiu2HAmQj5GUe6a4mztewZVC9bLQgBUkMqAkh6WFjTXbQT6bXq7","/ip4/172.18.169.192/tcp/42781/ws/p2p/16Uiu2HAmQj5GUe6a4mztewZVC9bLQgBUkMqAkh6WFjTXbQT6bXq7"],"enrUri":"enr:-L24QLUgWiOZSl9d9pZo6CE9q8tDl3_tc9zzVOzQ92E0_INFJTbEbKOZ7kQNPdAjuDYufxDzZAWKJnsMIRVn8iX7t5oCgmlkgnY0gmlwhKwSqcCKbXVsdGlhZGRyc5YACASsEqnABqccAAoErBKpwAanHd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDs1ggROKSBZ5irTNJxNNDcLvL-EUM6ZGas5uC2nClgL6DdGNwgqccg3VkcIKnHoV3YWt1Mgk"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.steps.light_push:light_push.py:121 Lightpushing message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:42779/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/3/0", "message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "contentTopic": "/myapp/1/latest/proto", "timestamp": 1772512477668855458}}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.1 seconds
DEBUG  src.steps.light_push:light_push.py:125 Checking that peer NODE_1:wakuorg/nwaku:latest can find the lightpushed message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:38682/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512477668855458,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.light_push:light_push.py:125 Checking that peer NODE_2:wakuorg/nwaku:latest can find the lightpushed message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:4952/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512477668855458,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.light_push:light_push.py:125 Checking that peer NODE_3:wakuorg/nwaku:latest can find the lightpushed message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:42779/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512477668855458,"ephemeral":false,"proof":""},{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512476393274641,"ephemeral":false,"proof":""}]'
DEBUG  tests.conftest:conftest.py:59 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:83 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 08ae7219780b
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id aa25e4dccc77
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 3450ceb06f9e
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 08ae7219780b. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  tests.conftest:conftest.py:98 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  tests.conftest:conftest.py:73 Running fixture teardown: attach_logs_on_fail
DEBUG  tests.conftest:conftest.py:74 Test failed, attempting to attach logs to the allure reports
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/lightpush_node1_2026-03-03_04-34-32__0e22b9c0-1a3d-4904-88c7-5f1ba96638f9__wakuorg_nwaku:latest.log
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/receiving_node2_2026-03-03_04-34-32__0e22b9c0-1a3d-4904-88c7-5f1ba96638f9__wakuorg_nwaku:latest.log
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/receiving_node1_2026-03-03_04-34-32__0e22b9c0-1a3d-4904-88c7-5f1ba96638f9__wakuorg_nwaku:latest.log
DEBUG  tests.conftest:conftest.py:51 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:57 Running test: test_light_push_after_light_push_node_restarts with id: 2026-03-03_04-34-39__5264cae9-c3b3-4026-9858-a33a9147de77
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.steps.light_push:light_push.py:28 Running fixture setup: light_push_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/receiving_node1_2026-03-03_04-34-39__5264cae9-c3b3-4026-9858-a33a9147de77__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.72.235
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['42570', '42571', '42572', '42573', '42574']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 42570:42570 -p 42571:42571 -p 42572:42572 -p 42573:42573 -p 42574:42574 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=42572 --rest-port=42570 --tcp-port=42571 --discv5-udp-port=42573 --rest-address=0.0.0.0 --nat=extip:172.18.72.235 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=8bd807d48a2bd53e2ceaff4ed7a90c9afc977161aa74ca8a2aeb6c75ecce080d --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=42574 --metrics-logging=true --lightpush=true --relay=true
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container aa25e4dccc77. Exiting log stream.
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.72.235 waku 91317380b8c6ef1ae5433aff59f921e0275bf95d9ae5c400d269bbab8dec8c61
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 91317380b8c6. Setting up logs at ./log/docker/receiving_node1_2026-03-03_04-34-39__5264cae9-c3b3-4026-9858-a33a9147de77__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 42570
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 3450ceb06f9e. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:42570/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:42570/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.72.235/tcp/42571/p2p/16Uiu2HAm58Lrs741GULYeDztFKNggkLFoBJienzkycVbWgg7whZh","/ip4/172.18.72.235/tcp/42572/ws/p2p/16Uiu2HAm58Lrs741GULYeDztFKNggkLFoBJienzkycVbWgg7whZh"],"enrUri":"enr:-L24QOcl1LC-Wi_k_PxSv_PFsJ8Ep1WCKBX039g2I9pRMAWdHgPBp7EUJB9FcY2xdHDszRh7pji2c3aDW4IH0Driec0CgmlkgnY0gmlwhKwSSOuKbXVsdGlhZGRyc5YACASsEkjrBqZLAAoErBJI6wamTN0DgnJzhQADAQAAiXNlY3AyNTZrMaECkCRgh0L7pH-RhMQrtR0nTYbhLPMdi_x4B_HZ34RPLXiDdGNwgqZLg3VkcIKmTYV3YWt1Mgk"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/receiving_node2_2026-03-03_04-34-39__5264cae9-c3b3-4026-9858-a33a9147de77__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.185.123
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['4710', '4711', '4712', '4713', '4714']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 4710:4710 -p 4711:4711 -p 4712:4712 -p 4713:4713 -p 4714:4714 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=4712 --rest-port=4710 --tcp-port=4711 --discv5-udp-port=4713 --rest-address=0.0.0.0 --nat=extip:172.18.185.123 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=e0bcacc94bb44eb2626b31db47aa335f6565bee3b2dc5239194ffdd2be5bbbf4 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=4714 --metrics-logging=true --lightpush=false --relay=true
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.185.123 waku 269f6b88967922a63607a1b517c12e5521a1096132f377e041c77c723b7b7d39
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 269f6b889679. Setting up logs at ./log/docker/receiving_node2_2026-03-03_04-34-39__5264cae9-c3b3-4026-9858-a33a9147de77__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 4710
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:4710/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:4710/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.185.123/tcp/4711/p2p/16Uiu2HAmV7M1pXYifuCV2Dm55mFiZeDmriUhhRjDiii4kT9uniDo","/ip4/172.18.185.123/tcp/4712/ws/p2p/16Uiu2HAmV7M1pXYifuCV2Dm55mFiZeDmriUhhRjDiii4kT9uniDo"],"enrUri":"enr:-L24QIL_7LdyKkIdLpmP4TNb7_lGLcxwf6NiLVbhiy89brGrNOwu04bmZYR_9nr7LrchrpAdaCSYSFvjP8eeRoc2jFQCgmlkgnY0gmlwhKwSuXuKbXVsdGlhZGRyc5YACASsErl7BhJnAAoErBK5ewYSaN0DgnJzhQADAQAAiXNlY3AyNTZrMaED9Ht1AtyTRxU1KvBBnmlNc9mblGsX4wO7YQKL9h6AifKDdGNwghJng3VkcIISaYV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:4710/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.72.235/tcp/42571/p2p/16Uiu2HAm58Lrs741GULYeDztFKNggkLFoBJienzkycVbWgg7whZh"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/lightpush_node1_2026-03-03_04-34-39__5264cae9-c3b3-4026-9858-a33a9147de77__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.20.52
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['2615', '2616', '2617', '2618', '2619']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 2615:2615 -p 2616:2616 -p 2617:2617 -p 2618:2618 -p 2619:2619 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=2617 --rest-port=2615 --tcp-port=2616 --discv5-udp-port=2618 --rest-address=0.0.0.0 --nat=extip:172.18.20.52 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=cb38bdeac0abf1c4e6d2bd49e9fbbfafec362900c884dfeb43b1e92eb6cbfa6d --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=2619 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QOcl1LC-Wi_k_PxSv_PFsJ8Ep1WCKBX039g2I9pRMAWdHgPBp7EUJB9FcY2xdHDszRh7pji2c3aDW4IH0Driec0CgmlkgnY0gmlwhKwSSOuKbXVsdGlhZGRyc5YACASsEkjrBqZLAAoErBJI6wamTN0DgnJzhQADAQAAiXNlY3AyNTZrMaECkCRgh0L7pH-RhMQrtR0nTYbhLPMdi_x4B_HZ34RPLXiDdGNwgqZLg3VkcIKmTYV3YWt1Mgk --lightpushnode=/ip4/172.18.72.235/tcp/42571/p2p/16Uiu2HAm58Lrs741GULYeDztFKNggkLFoBJienzkycVbWgg7whZh --lightpush=true --relay=true
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.20.52 waku a94162245888203f213c6c21a004f8adfb7fa1f6152a1b67f73849e1b7750a2e
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID a94162245888. Setting up logs at ./log/docker/lightpush_node1_2026-03-03_04-34-39__5264cae9-c3b3-4026-9858-a33a9147de77__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 2615
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:2615/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:2615/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.20.52/tcp/2616/p2p/16Uiu2HAmTsrwnoYKB32n8sqkHuDgc2WSevLB6SjPt9Gj2Azv941Z","/ip4/172.18.20.52/tcp/2617/ws/p2p/16Uiu2HAmTsrwnoYKB32n8sqkHuDgc2WSevLB6SjPt9Gj2Azv941Z"],"enrUri":"enr:-L24QBCrKn1l85u3F9dq9IrD38nLyW5Sl8BFpnmnGM6DJhjqemDwzTk_PapJ9BFMFKZ3FZAkzrIxGZRW3AaeMz9D-gcCgmlkgnY0gmlwhKwSFDSKbXVsdGlhZGRyc5YACASsEhQ0Bgo4AAoErBIUNAYKOd0DgnJzhQADAQAAiXNlY3AyNTZrMaED4it7OxmE8XfiuDqvcLu5l7H-Ix8eJLiNNZv_fmXiyHyDdGNwggo4g3VkcIIKOoV3YWt1Mgk"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:2615/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.72.235/tcp/42571/p2p/16Uiu2HAm58Lrs741GULYeDztFKNggkLFoBJienzkycVbWgg7whZh"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:2615/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.185.123/tcp/4711/p2p/16Uiu2HAmV7M1pXYifuCV2Dm55mFiZeDmriUhhRjDiii4kT9uniDo"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:42570/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:4710/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:2615/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.steps.light_push:light_push.py:121 Lightpushing message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:2615/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/3/0", "message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "contentTopic": "/myapp/1/latest/proto", "timestamp": 1772512483436003979}}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.1 seconds
DEBUG  src.steps.light_push:light_push.py:125 Checking that peer NODE_1:wakuorg/nwaku:latest can find the lightpushed message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:42570/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512483436003979,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.light_push:light_push.py:125 Checking that peer NODE_2:wakuorg/nwaku:latest can find the lightpushed message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:4710/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512483436003979,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.light_push:light_push.py:125 Checking that peer NODE_3:wakuorg/nwaku:latest can find the lightpushed message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:2615/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512483436003979,"ephemeral":false,"proof":""}]'
DEBUG  src.node.waku_node:waku_node.py:257 Restarting container with id a94162245888
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:2615/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:2615/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:2615/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.20.52/tcp/2616/p2p/16Uiu2HAmTsrwnoYKB32n8sqkHuDgc2WSevLB6SjPt9Gj2Azv941Z","/ip4/172.18.20.52/tcp/2617/ws/p2p/16Uiu2HAmTsrwnoYKB32n8sqkHuDgc2WSevLB6SjPt9Gj2Azv941Z"],"enrUri":"enr:-L24QBCrKn1l85u3F9dq9IrD38nLyW5Sl8BFpnmnGM6DJhjqemDwzTk_PapJ9BFMFKZ3FZAkzrIxGZRW3AaeMz9D-gcCgmlkgnY0gmlwhKwSFDSKbXVsdGlhZGRyc5YACASsEhQ0Bgo4AAoErBIUNAYKOd0DgnJzhQADAQAAiXNlY3AyNTZrMaED4it7OxmE8XfiuDqvcLu5l7H-Ix8eJLiNNZv_fmXiyHyDdGNwggo4g3VkcIIKOoV3YWt1Mgk"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.steps.light_push:light_push.py:121 Lightpushing message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:2615/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/3/0", "message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "contentTopic": "/myapp/1/latest/proto", "timestamp": 1772512484465928661}}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.1 seconds
DEBUG  src.steps.light_push:light_push.py:125 Checking that peer NODE_1:wakuorg/nwaku:latest can find the lightpushed message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:42570/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512484465928661,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.light_push:light_push.py:125 Checking that peer NODE_2:wakuorg/nwaku:latest can find the lightpushed message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:4710/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512484465928661,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.light_push:light_push.py:125 Checking that peer NODE_3:wakuorg/nwaku:latest can find the lightpushed message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:2615/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512484465928661,"ephemeral":false,"proof":""}]'
DEBUG  tests.conftest:conftest.py:59 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:83 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 91317380b8c6
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 269f6b889679
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id a94162245888
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 91317380b8c6. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  tests.conftest:conftest.py:98 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.