129 lines
24 KiB
Plaintext

2026-03-17 04:36:16.342 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-17 04:36:16.342 DEBUG [tests.conftest] Running test: test_light_push_after_light_push_node_restarts with id: 2026-03-17_04-36-16__749c7754-3bca-49d0-8f9c-7e7b30580972
2026-03-17 04:36:16.342 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-17 04:36:16.342 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-03-17 04:36:16.350 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-17 04:36:16.350 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node1_2026-03-17_04-36-16__749c7754-3bca-49d0-8f9c-7e7b30580972__wakuorg_nwaku:latest.log
2026-03-17 04:36:16.350 DEBUG [src.node.waku_node] Starting Node...
2026-03-17 04:36:16.350 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-17 04:36:16.351 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-17 04:36:16.352 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.123.139
2026-03-17 04:36:16.352 DEBUG [src.node.docker_mananger] Generated ports ['30214', '30215', '30216', '30217', '30218']
2026-03-17 04:36:16.352 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-17 04:36:16.352 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-17 04:36:16.352 DEBUG [src.node.waku_node] Using volumes []
2026-03-17 04:36:16.352 DEBUG [src.node.docker_mananger] docker run -i -t -p 30214:30214 -p 30215:30215 -p 30216:30216 -p 30217:30217 -p 30218:30218 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=30216 --rest-port=30214 --tcp-port=30215 --discv5-udp-port=30217 --rest-address=0.0.0.0 --nat=extip:172.18.123.139 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=bfb1ffe0e398c0c263d9006a6ddda61cd9bfe2d60c552d15eebea7bfbd84bfdf --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=30218 --metrics-logging=true --lightpush=true --relay=true
2026-03-17 04:36:16.551 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.123.139 waku 28e57a1bfe577ba49c219166c87fa891b199e85f316e79b37534ea787d57845c
2026-03-17 04:36:16.586 DEBUG [src.node.docker_mananger] Container started with ID 28e57a1bfe57. Setting up logs at ./log/docker/receiving_node1_2026-03-17_04-36-16__749c7754-3bca-49d0-8f9c-7e7b30580972__wakuorg_nwaku:latest.log
2026-03-17 04:36:16.587 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 30214
2026-03-17 04:36:16.589 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-17 04:36:16.594 ERROR [src.node.docker_mananger] Max retries reached for container a6454bc21749. Exiting log stream.
2026-03-17 04:36:17.125 ERROR [src.node.docker_mananger] Max retries reached for container 0fb28dc22c12. Exiting log stream.
2026-03-17 04:36:17.593 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30214/health" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:36:17.595 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-17 04:36:17.596 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-17 04:36:17.596 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30214/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:36:17.598 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.123.139/tcp/30215/p2p/16Uiu2HAmRmXnXw7Pi7A64cFD5H9eB4wYFmtyjTwVZvssCJJzNWoT","/ip4/172.18.123.139/tcp/30216/ws/p2p/16Uiu2HAmRmXnXw7Pi7A64cFD5H9eB4wYFmtyjTwVZvssCJJzNWoT"],"enrUri":"enr:-L24QEDsgU9rHxbKaoBNPzplyokBesvVjLC5QszG8_IgcPsUXCJoiunclrZYnrTa1AQdKK4Q4o7GD98vUtmLdYtXr5kCgmlkgnY0gmlwhKwSe4uKbXVsdGlhZGRyc5YACASsEnuLBnYHAAoErBJ7iwZ2CN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDwtT1dru4swM39o3qUF6BkyiuAoAw6fRxEj9XbJa1PNKDdGNwgnYHg3VkcIJ2CYV3YWt1Mgk"}'
2026-03-17 04:36:17.598 INFO [src.node.waku_node] REST service is ready !!
2026-03-17 04:36:17.606 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-17 04:36:17.606 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node2_2026-03-17_04-36-16__749c7754-3bca-49d0-8f9c-7e7b30580972__wakuorg_nwaku:latest.log
2026-03-17 04:36:17.606 DEBUG [src.node.waku_node] Starting Node...
2026-03-17 04:36:17.606 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-17 04:36:17.607 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-17 04:36:17.608 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.206.21
2026-03-17 04:36:17.608 DEBUG [src.node.docker_mananger] Generated ports ['17979', '17980', '17981', '17982', '17983']
2026-03-17 04:36:17.608 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-17 04:36:17.608 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-17 04:36:17.608 DEBUG [src.node.waku_node] Using volumes []
2026-03-17 04:36:17.608 DEBUG [src.node.docker_mananger] docker run -i -t -p 17979:17979 -p 17980:17980 -p 17981:17981 -p 17982:17982 -p 17983:17983 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=17981 --rest-port=17979 --tcp-port=17980 --discv5-udp-port=17982 --rest-address=0.0.0.0 --nat=extip:172.18.206.21 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=d6ebf0a59263a57aaddbfcec213faf704adcc0bec56dd2aafe6e18b8ebe2a9e5 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=17983 --metrics-logging=true --lightpush=false --relay=true
2026-03-17 04:36:17.794 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.206.21 waku 5093cf0b6b95af2c6e461364c68066ce41a2be757b930508957977e0fbc4e3cd
2026-03-17 04:36:17.827 DEBUG [src.node.docker_mananger] Container started with ID 5093cf0b6b95. Setting up logs at ./log/docker/receiving_node2_2026-03-17_04-36-16__749c7754-3bca-49d0-8f9c-7e7b30580972__wakuorg_nwaku:latest.log
2026-03-17 04:36:17.827 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 17979
2026-03-17 04:36:17.827 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-17 04:36:18.829 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17979/health" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:36:18.831 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-17 04:36:18.832 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-17 04:36:18.832 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17979/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:36:18.834 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.206.21/tcp/17980/p2p/16Uiu2HAmEQzqCfEQXdGhSQ8WmMxRR5co7W355XMAuNfMBpKhBptF","/ip4/172.18.206.21/tcp/17981/ws/p2p/16Uiu2HAmEQzqCfEQXdGhSQ8WmMxRR5co7W355XMAuNfMBpKhBptF"],"enrUri":"enr:-L24QILFlrjoutD6-6D_HIhdGkMMHJ3se0MBEZEvC4SEf06SKBKzFOCqeXVla1YTqQ5fyn7JAZ_OcScv5i8B8Bc3nekCgmlkgnY0gmlwhKwSzhWKbXVsdGlhZGRyc5YACASsEs4VBkY8AAoErBLOFQZGPd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDGiHJYvV56tJj9GDQGXuI5liRyo8Fm-mEPWynRk7hjUiDdGNwgkY8g3VkcIJGPoV3YWt1MgE"}'
2026-03-17 04:36:18.834 INFO [src.node.waku_node] REST service is ready !!
2026-03-17 04:36:18.835 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17979/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.123.139/tcp/30215/p2p/16Uiu2HAmRmXnXw7Pi7A64cFD5H9eB4wYFmtyjTwVZvssCJJzNWoT"]'
2026-03-17 04:36:18.876 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-17 04:36:18.885 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-17 04:36:18.885 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/lightpush_node1_2026-03-17_04-36-16__749c7754-3bca-49d0-8f9c-7e7b30580972__wakuorg_nwaku:latest.log
2026-03-17 04:36:18.885 DEBUG [src.node.waku_node] Starting Node...
2026-03-17 04:36:18.885 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-17 04:36:18.887 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-17 04:36:18.887 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.195.76
2026-03-17 04:36:18.887 DEBUG [src.node.docker_mananger] Generated ports ['8627', '8628', '8629', '8630', '8631']
2026-03-17 04:36:18.887 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-17 04:36:18.887 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-17 04:36:18.888 DEBUG [src.node.waku_node] Using volumes []
2026-03-17 04:36:18.888 DEBUG [src.node.docker_mananger] docker run -i -t -p 8627:8627 -p 8628:8628 -p 8629:8629 -p 8630:8630 -p 8631:8631 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=8629 --rest-port=8627 --tcp-port=8628 --discv5-udp-port=8630 --rest-address=0.0.0.0 --nat=extip:172.18.195.76 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ebeedece66a4fab28df2cc8a4ebc938c155ba1bd549bd19f7a3db9d40fcb7697 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=8631 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QEDsgU9rHxbKaoBNPzplyokBesvVjLC5QszG8_IgcPsUXCJoiunclrZYnrTa1AQdKK4Q4o7GD98vUtmLdYtXr5kCgmlkgnY0gmlwhKwSe4uKbXVsdGlhZGRyc5YACASsEnuLBnYHAAoErBJ7iwZ2CN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDwtT1dru4swM39o3qUF6BkyiuAoAw6fRxEj9XbJa1PNKDdGNwgnYHg3VkcIJ2CYV3YWt1Mgk --lightpushnode=/ip4/172.18.123.139/tcp/30215/p2p/16Uiu2HAmRmXnXw7Pi7A64cFD5H9eB4wYFmtyjTwVZvssCJJzNWoT --lightpush=true --relay=true
2026-03-17 04:36:19.102 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.195.76 waku 182d5b8a22a36a2e429634eba411815e370119dec5d250f82b2c7235aae893f2
2026-03-17 04:36:19.138 DEBUG [src.node.docker_mananger] Container started with ID 182d5b8a22a3. Setting up logs at ./log/docker/lightpush_node1_2026-03-17_04-36-16__749c7754-3bca-49d0-8f9c-7e7b30580972__wakuorg_nwaku:latest.log
2026-03-17 04:36:19.138 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 8627
2026-03-17 04:36:19.138 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-17 04:36:20.140 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:8627/health" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:36:20.155 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-17 04:36:20.160 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-17 04:36:20.162 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:8627/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:36:20.174 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.195.76/tcp/8628/p2p/16Uiu2HAkyQ8zaR6as29nEXef4KC7LzFQwbAgHwVHfknEXz6Q1Ry8","/ip4/172.18.195.76/tcp/8629/ws/p2p/16Uiu2HAkyQ8zaR6as29nEXef4KC7LzFQwbAgHwVHfknEXz6Q1Ry8"],"enrUri":"enr:-L24QAh9CeNEmN0XDoeS99eJdmUI95zzHS7uqmF1-JtzYVSJTzpnSziV7Y0Wnwp19248hOk1iHY2CPUGRZuQCOo4o4MCgmlkgnY0gmlwhKwSw0yKbXVsdGlhZGRyc5YACASsEsNMBiG0AAoErBLDTAYhtd0DgnJzhQADAQAAiXNlY3AyNTZrMaECOwohXxq3pWHaLuUvOdPzuqhAEhIbVjEMD_qFe6i4eueDdGNwgiG0g3VkcIIhtoV3YWt1Mgk"}'
2026-03-17 04:36:20.175 INFO [src.node.waku_node] REST service is ready !!
2026-03-17 04:36:20.175 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:8627/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.123.139/tcp/30215/p2p/16Uiu2HAmRmXnXw7Pi7A64cFD5H9eB4wYFmtyjTwVZvssCJJzNWoT"]'
2026-03-17 04:36:20.183 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-17 04:36:20.183 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:8627/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.206.21/tcp/17980/p2p/16Uiu2HAmEQzqCfEQXdGhSQ8WmMxRR5co7W355XMAuNfMBpKhBptF"]'
2026-03-17 04:36:20.214 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-17 04:36:20.215 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30214/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-17 04:36:20.221 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-17 04:36:20.222 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17979/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-17 04:36:20.226 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-17 04:36:20.226 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:8627/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-17 04:36:20.228 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-17 04:36:20.230 DEBUG [src.steps.light_push] Lightpushing message
2026-03-17 04:36:20.230 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:8627/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/3/0", "message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "contentTopic": "/myapp/1/latest/proto", "timestamp": 1773722180230105630}}'
2026-03-17 04:36:20.244 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-17 04:36:20.247 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-17 04:36:20.347 DEBUG [src.steps.light_push] Checking that peer NODE_1:wakuorg/nwaku:latest can find the lightpushed message
2026-03-17 04:36:20.347 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30214/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:36:20.350 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773722180230105630,"ephemeral":false,"proof":""}]'
2026-03-17 04:36:20.352 DEBUG [src.steps.light_push] Checking that peer NODE_2:wakuorg/nwaku:latest can find the lightpushed message
2026-03-17 04:36:20.352 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17979/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:36:20.354 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773722180230105630,"ephemeral":false,"proof":""}]'
2026-03-17 04:36:20.356 DEBUG [src.steps.light_push] Checking that peer NODE_3:wakuorg/nwaku:latest can find the lightpushed message
2026-03-17 04:36:20.356 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:8627/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:36:20.358 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773722180230105630,"ephemeral":false,"proof":""}]'
2026-03-17 04:36:20.359 DEBUG [src.node.waku_node] Restarting container with id 182d5b8a22a3
2026-03-17 04:36:21.134 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:8627/health" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:36:21.236 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:8627/health" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:36:21.239 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-17 04:36:21.239 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-17 04:36:21.239 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:8627/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:36:21.242 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.195.76/tcp/8628/p2p/16Uiu2HAkyQ8zaR6as29nEXef4KC7LzFQwbAgHwVHfknEXz6Q1Ry8","/ip4/172.18.195.76/tcp/8629/ws/p2p/16Uiu2HAkyQ8zaR6as29nEXef4KC7LzFQwbAgHwVHfknEXz6Q1Ry8"],"enrUri":"enr:-L24QAh9CeNEmN0XDoeS99eJdmUI95zzHS7uqmF1-JtzYVSJTzpnSziV7Y0Wnwp19248hOk1iHY2CPUGRZuQCOo4o4MCgmlkgnY0gmlwhKwSw0yKbXVsdGlhZGRyc5YACASsEsNMBiG0AAoErBLDTAYhtd0DgnJzhQADAQAAiXNlY3AyNTZrMaECOwohXxq3pWHaLuUvOdPzuqhAEhIbVjEMD_qFe6i4eueDdGNwgiG0g3VkcIIhtoV3YWt1Mgk"}'
2026-03-17 04:36:21.242 INFO [src.node.waku_node] REST service is ready !!
2026-03-17 04:36:21.242 DEBUG [src.steps.light_push] Lightpushing message
2026-03-17 04:36:21.242 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:8627/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/3/0", "message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "contentTopic": "/myapp/1/latest/proto", "timestamp": 1773722181242696853}}'
2026-03-17 04:36:21.256 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-17 04:36:21.256 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-17 04:36:21.357 DEBUG [src.steps.light_push] Checking that peer NODE_1:wakuorg/nwaku:latest can find the lightpushed message
2026-03-17 04:36:21.357 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30214/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:36:21.360 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773722181242696853,"ephemeral":false,"proof":""}]'
2026-03-17 04:36:21.361 DEBUG [src.steps.light_push] Checking that peer NODE_2:wakuorg/nwaku:latest can find the lightpushed message
2026-03-17 04:36:21.361 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17979/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:36:21.364 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773722181242696853,"ephemeral":false,"proof":""}]'
2026-03-17 04:36:21.365 DEBUG [src.steps.light_push] Checking that peer NODE_3:wakuorg/nwaku:latest can find the lightpushed message
2026-03-17 04:36:21.365 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:8627/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:36:21.368 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773722181242696853,"ephemeral":false,"proof":""}]'
2026-03-17 04:36:21.370 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-17 04:36:21.371 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-17 04:36:21.372 DEBUG [src.node.waku_node] Stopping container with id 28e57a1bfe57
2026-03-17 04:36:21.941 DEBUG [src.node.waku_node] Container stopped.
2026-03-17 04:36:21.942 DEBUG [src.node.waku_node] Stopping container with id 5093cf0b6b95
2026-03-17 04:36:22.500 DEBUG [src.node.waku_node] Container stopped.
2026-03-17 04:36:22.502 DEBUG [src.node.waku_node] Stopping container with id 182d5b8a22a3
2026-03-17 04:36:22.756 ERROR [src.node.docker_mananger] Max retries reached for container 28e57a1bfe57. Exiting log stream.
2026-03-17 04:36:23.040 DEBUG [src.node.waku_node] Container stopped.
2026-03-17 04:36:23.042 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-17 04:36:23.058 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-17 04:36:23.066 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-17 04:36:23.094 DEBUG [src.node.docker_mananger] No errors found in the waku logs.