261 lines
51 KiB
Plaintext
Raw Blame History

This file contains invisible Unicode characters

This file contains invisible Unicode characters that are indistinguishable to humans but may be processed differently by a computer. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

DEBUG  tests.conftest:conftest.py:51 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:57 Running test: test_light_push_after_light_push_node_restarts with id: 2026-03-14_04-33-16__628d9ec2-28f3-4cce-a107-3fe227f40ee1
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.steps.light_push:light_push.py:28 Running fixture setup: light_push_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/receiving_node1_2026-03-14_04-33-16__628d9ec2-28f3-4cce-a107-3fe227f40ee1__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.249.197
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['31643', '31644', '31645', '31646', '31647']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 31643:31643 -p 31644:31644 -p 31645:31645 -p 31646:31646 -p 31647:31647 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=31645 --rest-port=31643 --tcp-port=31644 --discv5-udp-port=31646 --rest-address=0.0.0.0 --nat=extip:172.18.249.197 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=f9c65afcdbfadffeb8a6d7b0c6059bfac61dae345f12e56884cced9407e1b02b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=31647 --metrics-logging=true --lightpush=true --relay=true
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 6b5c9c7bf608. Exiting log stream.
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.249.197 waku 86feba41282f637a5ac8104cb653dd372ccf3c2fb56768d8a2e1f04f50ab5b8f
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 86feba41282f. Setting up logs at ./log/docker/receiving_node1_2026-03-14_04-33-16__628d9ec2-28f3-4cce-a107-3fe227f40ee1__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 31643
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 94c843fc0466. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:31643/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:31643/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.249.197/tcp/31644/p2p/16Uiu2HAmNdYTPbTH83M8p4BAN9w31DnrEVTqy9FWoq7pw5PpTZCP","/ip4/172.18.249.197/tcp/31645/ws/p2p/16Uiu2HAmNdYTPbTH83M8p4BAN9w31DnrEVTqy9FWoq7pw5PpTZCP"],"enrUri":"enr:-L24QJhJOxqI15bdQKqqLLKu_GIjk02Ke7bF_jDSvVGFnu7MQuYhTiGZNIluqroH5B5HEzbG9_ixSKRG0nDszBbZsmwCgmlkgnY0gmlwhKwS-cWKbXVsdGlhZGRyc5YACASsEvnFBnucAAoErBL5xQZ7nd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDlDYCU6qrDM18xzu8tRRjf97lDf903UVEqIEM98IF69SDdGNwgnucg3VkcIJ7noV3YWt1Mgk"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/receiving_node2_2026-03-14_04-33-16__628d9ec2-28f3-4cce-a107-3fe227f40ee1__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.83.151
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['17324', '17325', '17326', '17327', '17328']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 17324:17324 -p 17325:17325 -p 17326:17326 -p 17327:17327 -p 17328:17328 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=17326 --rest-port=17324 --tcp-port=17325 --discv5-udp-port=17327 --rest-address=0.0.0.0 --nat=extip:172.18.83.151 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=f44ae6d2b21eda7f490614bec51deafbe9c0c8bbaa0eb8fab13f6144efe7d549 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=17328 --metrics-logging=true --lightpush=false --relay=true
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.83.151 waku c26488f80671d5345f77d7737fabf6b42f93ab30ce0d3d8f05e98f83d3250ab4
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID c26488f80671. Setting up logs at ./log/docker/receiving_node2_2026-03-14_04-33-16__628d9ec2-28f3-4cce-a107-3fe227f40ee1__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 17324
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:17324/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:17324/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.83.151/tcp/17325/p2p/16Uiu2HAkymXhPAb1UnpJAJWLVXoqNatqMDmHQpgnvnQTpANRM6MS","/ip4/172.18.83.151/tcp/17326/ws/p2p/16Uiu2HAkymXhPAb1UnpJAJWLVXoqNatqMDmHQpgnvnQTpANRM6MS"],"enrUri":"enr:-L24QM9E1o5SX9j_sKjpYqWEGOuTa0GIRJiwjjfBd7yJ-WWDGZRd-oHqKF5yP5xCYoG_tvaH7V_6ItseiQ5WXW5IDfwCgmlkgnY0gmlwhKwSU5eKbXVsdGlhZGRyc5YACASsElOXBkOtAAoErBJTlwZDrt0DgnJzhQADAQAAiXNlY3AyNTZrMaECQIT_kvlOK03pbFuUpRafBDw3amiCVyD_g2OWhewI8tWDdGNwgkOtg3VkcIJDr4V3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:17324/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.249.197/tcp/31644/p2p/16Uiu2HAmNdYTPbTH83M8p4BAN9w31DnrEVTqy9FWoq7pw5PpTZCP"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/lightpush_node1_2026-03-14_04-33-16__628d9ec2-28f3-4cce-a107-3fe227f40ee1__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.152.9
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['13198', '13199', '13200', '13201', '13202']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 13198:13198 -p 13199:13199 -p 13200:13200 -p 13201:13201 -p 13202:13202 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=13200 --rest-port=13198 --tcp-port=13199 --discv5-udp-port=13201 --rest-address=0.0.0.0 --nat=extip:172.18.152.9 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=24c6261ba61c1ccd517e8445ba6ad5ba26c6fdd12e3d75aa3b14bc8ffacf9d0f --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=13202 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QJhJOxqI15bdQKqqLLKu_GIjk02Ke7bF_jDSvVGFnu7MQuYhTiGZNIluqroH5B5HEzbG9_ixSKRG0nDszBbZsmwCgmlkgnY0gmlwhKwS-cWKbXVsdGlhZGRyc5YACASsEvnFBnucAAoErBL5xQZ7nd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDlDYCU6qrDM18xzu8tRRjf97lDf903UVEqIEM98IF69SDdGNwgnucg3VkcIJ7noV3YWt1Mgk --lightpushnode=/ip4/172.18.249.197/tcp/31644/p2p/16Uiu2HAmNdYTPbTH83M8p4BAN9w31DnrEVTqy9FWoq7pw5PpTZCP --lightpush=true --relay=true
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.152.9 waku 35e9ed8d49feed3d464d98bfc3045f8b79f36ff3072f1a30262ce56524b07770
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 35e9ed8d49fe. Setting up logs at ./log/docker/lightpush_node1_2026-03-14_04-33-16__628d9ec2-28f3-4cce-a107-3fe227f40ee1__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 13198
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:13198/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:13198/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.152.9/tcp/13199/p2p/16Uiu2HAmGKYUXYsqjpoZA5TedC3e8tJsqDL7jKKPJRVY7kWu9CJB","/ip4/172.18.152.9/tcp/13200/ws/p2p/16Uiu2HAmGKYUXYsqjpoZA5TedC3e8tJsqDL7jKKPJRVY7kWu9CJB"],"enrUri":"enr:-L24QAvZWQcqaXpvJA5ZajGlo7urdkH0wq0o1LBypN4IGOogQXtRWwBcEgwQ53wrR4owQqUOPywqGLztevepqA9rRgMCgmlkgnY0gmlwhKwSmAmKbXVsdGlhZGRyc5YACASsEpgJBjOPAAoErBKYCQYzkN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDNnN0g9T6jYhQxQMQj1btSFZL3DSxPMxuO4bvzShDCtCDdGNwgjOPg3VkcIIzkYV3YWt1Mgk"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:13198/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.249.197/tcp/31644/p2p/16Uiu2HAmNdYTPbTH83M8p4BAN9w31DnrEVTqy9FWoq7pw5PpTZCP"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:13198/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.83.151/tcp/17325/p2p/16Uiu2HAkymXhPAb1UnpJAJWLVXoqNatqMDmHQpgnvnQTpANRM6MS"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:31643/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:17324/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:13198/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.steps.light_push:light_push.py:121 Lightpushing message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:13198/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/3/0", "message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "contentTopic": "/myapp/1/latest/proto", "timestamp": 1773462800318525408}}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.1 seconds
DEBUG  src.steps.light_push:light_push.py:125 Checking that peer NODE_1:wakuorg/nwaku:latest can find the lightpushed message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:31643/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773462800318525408,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.light_push:light_push.py:125 Checking that peer NODE_2:wakuorg/nwaku:latest can find the lightpushed message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:17324/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773462800318525408,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.light_push:light_push.py:125 Checking that peer NODE_3:wakuorg/nwaku:latest can find the lightpushed message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:13198/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773462800318525408,"ephemeral":false,"proof":""}]'
DEBUG  src.node.waku_node:waku_node.py:257 Restarting container with id 35e9ed8d49fe
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:13198/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:13198/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:13198/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.152.9/tcp/13199/p2p/16Uiu2HAmGKYUXYsqjpoZA5TedC3e8tJsqDL7jKKPJRVY7kWu9CJB","/ip4/172.18.152.9/tcp/13200/ws/p2p/16Uiu2HAmGKYUXYsqjpoZA5TedC3e8tJsqDL7jKKPJRVY7kWu9CJB"],"enrUri":"enr:-L24QAvZWQcqaXpvJA5ZajGlo7urdkH0wq0o1LBypN4IGOogQXtRWwBcEgwQ53wrR4owQqUOPywqGLztevepqA9rRgMCgmlkgnY0gmlwhKwSmAmKbXVsdGlhZGRyc5YACASsEpgJBjOPAAoErBKYCQYzkN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDNnN0g9T6jYhQxQMQj1btSFZL3DSxPMxuO4bvzShDCtCDdGNwgjOPg3VkcIIzkYV3YWt1Mgk"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.steps.light_push:light_push.py:121 Lightpushing message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:13198/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/3/0", "message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "contentTopic": "/myapp/1/latest/proto", "timestamp": 1773462801619301020}}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.1 seconds
DEBUG  src.steps.light_push:light_push.py:125 Checking that peer NODE_1:wakuorg/nwaku:latest can find the lightpushed message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:31643/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773462801619301020,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.light_push:light_push.py:125 Checking that peer NODE_2:wakuorg/nwaku:latest can find the lightpushed message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:17324/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773462801619301020,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.light_push:light_push.py:125 Checking that peer NODE_3:wakuorg/nwaku:latest can find the lightpushed message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:13198/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773462801619301020,"ephemeral":false,"proof":""},{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773462800318525408,"ephemeral":false,"proof":""}]'
DEBUG  tests.conftest:conftest.py:59 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:83 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 86feba41282f
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id c26488f80671
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 35e9ed8d49fe
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 86feba41282f. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  tests.conftest:conftest.py:98 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  tests.conftest:conftest.py:73 Running fixture teardown: attach_logs_on_fail
DEBUG  tests.conftest:conftest.py:74 Test failed, attempting to attach logs to the allure reports
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/receiving_node1_2026-03-14_04-33-16__628d9ec2-28f3-4cce-a107-3fe227f40ee1__wakuorg_nwaku:latest.log
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/receiving_node2_2026-03-14_04-33-16__628d9ec2-28f3-4cce-a107-3fe227f40ee1__wakuorg_nwaku:latest.log
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/lightpush_node1_2026-03-14_04-33-16__628d9ec2-28f3-4cce-a107-3fe227f40ee1__wakuorg_nwaku:latest.log
DEBUG  tests.conftest:conftest.py:51 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:57 Running test: test_light_push_after_light_push_node_restarts with id: 2026-03-14_04-33-23__7c29f64f-ed31-43e9-894d-938416dbc87b
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.steps.light_push:light_push.py:28 Running fixture setup: light_push_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/receiving_node1_2026-03-14_04-33-23__7c29f64f-ed31-43e9-894d-938416dbc87b__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.14.49
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['10614', '10615', '10616', '10617', '10618']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 10614:10614 -p 10615:10615 -p 10616:10616 -p 10617:10617 -p 10618:10618 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=10616 --rest-port=10614 --tcp-port=10615 --discv5-udp-port=10617 --rest-address=0.0.0.0 --nat=extip:172.18.14.49 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=cdea9cbed3773e4bdafcd91937673be5009df3a0aac4caf92f2d3df5bc57ee51 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=10618 --metrics-logging=true --lightpush=true --relay=true
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container c26488f80671. Exiting log stream.
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.14.49 waku df4f10e32c1ea20f262982a64ba3aee62a625011b9c0af868e0c81dd56c649b8
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID df4f10e32c1e. Setting up logs at ./log/docker/receiving_node1_2026-03-14_04-33-23__7c29f64f-ed31-43e9-894d-938416dbc87b__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 10614
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 35e9ed8d49fe. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:10614/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:10614/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.14.49/tcp/10615/p2p/16Uiu2HAkzwKNMuw3Gq97GusEZcxTr74b5R3zYcLaYUngRA4Mw13r","/ip4/172.18.14.49/tcp/10616/ws/p2p/16Uiu2HAkzwKNMuw3Gq97GusEZcxTr74b5R3zYcLaYUngRA4Mw13r"],"enrUri":"enr:-L24QCKGqs25CIBxnrt4_sP8DBcV-IfjLrSFIeCZgC22oxqVbEi9nkNnCa60QSNLF3rTo4_-IOcpGl1CJgAajmfWbBACgmlkgnY0gmlwhKwSDjGKbXVsdGlhZGRyc5YACASsEg4xBil3AAoErBIOMQYpeN0DgnJzhQADAQAAiXNlY3AyNTZrMaECUeKN2JlbQbHT8XJuTeyTQJJSRaKlC6phT7raG0ggjHWDdGNwgil3g3VkcIIpeYV3YWt1Mgk"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/receiving_node2_2026-03-14_04-33-23__7c29f64f-ed31-43e9-894d-938416dbc87b__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.28.85
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['14707', '14708', '14709', '14710', '14711']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 14707:14707 -p 14708:14708 -p 14709:14709 -p 14710:14710 -p 14711:14711 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=14709 --rest-port=14707 --tcp-port=14708 --discv5-udp-port=14710 --rest-address=0.0.0.0 --nat=extip:172.18.28.85 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=bcdf5bdf2af00de5b4aa3a8be72ef40f8dc03d6b50fccf39cf94c4bde4eff2ef --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=14711 --metrics-logging=true --lightpush=false --relay=true
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.28.85 waku 483ce5291d378d8f38f863eabc17a426e7766c645db1c40531e51855650b6bd6
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 483ce5291d37. Setting up logs at ./log/docker/receiving_node2_2026-03-14_04-33-23__7c29f64f-ed31-43e9-894d-938416dbc87b__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 14707
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:14707/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:14707/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.28.85/tcp/14708/p2p/16Uiu2HAkvGSZjpRnqNFtAsxDuBaxqRWUVqnw2XZTMDf13kyDMd8w","/ip4/172.18.28.85/tcp/14709/ws/p2p/16Uiu2HAkvGSZjpRnqNFtAsxDuBaxqRWUVqnw2XZTMDf13kyDMd8w"],"enrUri":"enr:-L24QJrTX-n3_gKxJ5PctgEC1lCCGdnQaWelM8zGZ1vkFTNmXr2-_kjImZ48OJJ6dYvlkF4DOTYe3mAXquBCDyjhA4ECgmlkgnY0gmlwhKwSHFWKbXVsdGlhZGRyc5YACASsEhxVBjl0AAoErBIcVQY5dd0DgnJzhQADAQAAiXNlY3AyNTZrMaECDH5Ko5cYIHlFGLn1bZ-ND2Oerz_4yOUYTzCnn1i1i3yDdGNwgjl0g3VkcII5doV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:14707/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.14.49/tcp/10615/p2p/16Uiu2HAkzwKNMuw3Gq97GusEZcxTr74b5R3zYcLaYUngRA4Mw13r"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/lightpush_node1_2026-03-14_04-33-23__7c29f64f-ed31-43e9-894d-938416dbc87b__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.49.118
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['63978', '63979', '63980', '63981', '63982']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 63978:63978 -p 63979:63979 -p 63980:63980 -p 63981:63981 -p 63982:63982 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=63980 --rest-port=63978 --tcp-port=63979 --discv5-udp-port=63981 --rest-address=0.0.0.0 --nat=extip:172.18.49.118 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=9535465cca86a99c6edc3f7c17e7cbe1dba3fc7906bbeba2cead609bcba4fe7a --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=63982 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QCKGqs25CIBxnrt4_sP8DBcV-IfjLrSFIeCZgC22oxqVbEi9nkNnCa60QSNLF3rTo4_-IOcpGl1CJgAajmfWbBACgmlkgnY0gmlwhKwSDjGKbXVsdGlhZGRyc5YACASsEg4xBil3AAoErBIOMQYpeN0DgnJzhQADAQAAiXNlY3AyNTZrMaECUeKN2JlbQbHT8XJuTeyTQJJSRaKlC6phT7raG0ggjHWDdGNwgil3g3VkcIIpeYV3YWt1Mgk --lightpushnode=/ip4/172.18.14.49/tcp/10615/p2p/16Uiu2HAkzwKNMuw3Gq97GusEZcxTr74b5R3zYcLaYUngRA4Mw13r --lightpush=true --relay=true
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.49.118 waku 5c537f06c5fd56d2aaf46f20b4e9d807ead9fd1afb44f600973706b9ab7c5e7c
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 5c537f06c5fd. Setting up logs at ./log/docker/lightpush_node1_2026-03-14_04-33-23__7c29f64f-ed31-43e9-894d-938416dbc87b__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 63978
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:63978/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:63978/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.49.118/tcp/63979/p2p/16Uiu2HAm6tz8UUcbSh8RoY1V7AU266CD2Z1DXvTuYEhhccUtj4uB","/ip4/172.18.49.118/tcp/63980/ws/p2p/16Uiu2HAm6tz8UUcbSh8RoY1V7AU266CD2Z1DXvTuYEhhccUtj4uB"],"enrUri":"enr:-L24QMD5yQ0YSmgyEExvvvXt4pxR-b9G_Lil-aFNxQfMbuJuaJViq8G0DuDtFzmcncL9SfTb5luG0uByDVCRfvqNRGwCgmlkgnY0gmlwhKwSMXaKbXVsdGlhZGRyc5YACASsEjF2BvnrAAoErBIxdgb57N0DgnJzhQADAQAAiXNlY3AyNTZrMaECqm_CiyChw21oUoLvShlGygJut-efrdpfJP-OqTEGDh6DdGNwgvnrg3VkcIL57YV3YWt1Mgk"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:63978/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.14.49/tcp/10615/p2p/16Uiu2HAkzwKNMuw3Gq97GusEZcxTr74b5R3zYcLaYUngRA4Mw13r"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:63978/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.28.85/tcp/14708/p2p/16Uiu2HAkvGSZjpRnqNFtAsxDuBaxqRWUVqnw2XZTMDf13kyDMd8w"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:10614/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:14707/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:63978/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.steps.light_push:light_push.py:121 Lightpushing message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:63978/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/3/0", "message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "contentTopic": "/myapp/1/latest/proto", "timestamp": 1773462807549390440}}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.1 seconds
DEBUG  src.steps.light_push:light_push.py:125 Checking that peer NODE_1:wakuorg/nwaku:latest can find the lightpushed message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:10614/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773462807549390440,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.light_push:light_push.py:125 Checking that peer NODE_2:wakuorg/nwaku:latest can find the lightpushed message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:14707/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773462807549390440,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.light_push:light_push.py:125 Checking that peer NODE_3:wakuorg/nwaku:latest can find the lightpushed message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:63978/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773462807549390440,"ephemeral":false,"proof":""}]'
DEBUG  src.node.waku_node:waku_node.py:257 Restarting container with id 5c537f06c5fd
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:63978/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:63978/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:63978/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.49.118/tcp/63979/p2p/16Uiu2HAm6tz8UUcbSh8RoY1V7AU266CD2Z1DXvTuYEhhccUtj4uB","/ip4/172.18.49.118/tcp/63980/ws/p2p/16Uiu2HAm6tz8UUcbSh8RoY1V7AU266CD2Z1DXvTuYEhhccUtj4uB"],"enrUri":"enr:-L24QMD5yQ0YSmgyEExvvvXt4pxR-b9G_Lil-aFNxQfMbuJuaJViq8G0DuDtFzmcncL9SfTb5luG0uByDVCRfvqNRGwCgmlkgnY0gmlwhKwSMXaKbXVsdGlhZGRyc5YACASsEjF2BvnrAAoErBIxdgb57N0DgnJzhQADAQAAiXNlY3AyNTZrMaECqm_CiyChw21oUoLvShlGygJut-efrdpfJP-OqTEGDh6DdGNwgvnrg3VkcIL57YV3YWt1Mgk"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.steps.light_push:light_push.py:121 Lightpushing message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:63978/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/3/0", "message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "contentTopic": "/myapp/1/latest/proto", "timestamp": 1773462808557898859}}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.1 seconds
DEBUG  src.steps.light_push:light_push.py:125 Checking that peer NODE_1:wakuorg/nwaku:latest can find the lightpushed message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:10614/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773462808557898859,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.light_push:light_push.py:125 Checking that peer NODE_2:wakuorg/nwaku:latest can find the lightpushed message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:14707/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773462808557898859,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.light_push:light_push.py:125 Checking that peer NODE_3:wakuorg/nwaku:latest can find the lightpushed message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:63978/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773462808557898859,"ephemeral":false,"proof":""}]'
DEBUG  tests.conftest:conftest.py:59 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:83 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id df4f10e32c1e
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 483ce5291d37
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 5c537f06c5fd
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container df4f10e32c1e. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  tests.conftest:conftest.py:98 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.