129 lines
24 KiB
Plaintext

2026-03-04 04:33:19.341 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-04 04:33:19.341 DEBUG [tests.conftest] Running test: test_light_push_after_light_push_node_restarts with id: 2026-03-04_04-33-19__8c3d2336-132d-477c-9916-5ede97c8fe7e
2026-03-04 04:33:19.342 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-04 04:33:19.342 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-03-04 04:33:19.349 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-04 04:33:19.349 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node1_2026-03-04_04-33-19__8c3d2336-132d-477c-9916-5ede97c8fe7e__wakuorg_nwaku:latest.log
2026-03-04 04:33:19.349 DEBUG [src.node.waku_node] Starting Node...
2026-03-04 04:33:19.350 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-04 04:33:19.351 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-04 04:33:19.351 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.26.77
2026-03-04 04:33:19.351 DEBUG [src.node.docker_mananger] Generated ports ['10495', '10496', '10497', '10498', '10499']
2026-03-04 04:33:19.352 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-04 04:33:19.352 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-04 04:33:19.352 DEBUG [src.node.waku_node] Using volumes []
2026-03-04 04:33:19.352 DEBUG [src.node.docker_mananger] docker run -i -t -p 10495:10495 -p 10496:10496 -p 10497:10497 -p 10498:10498 -p 10499:10499 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=10497 --rest-port=10495 --tcp-port=10496 --discv5-udp-port=10498 --rest-address=0.0.0.0 --nat=extip:172.18.26.77 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=37908b8c6c87fcee223e9b5afbfcdcdd5bf7cbfd274c16eff7bffad9de1e9937 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=10499 --metrics-logging=true --lightpush=true --relay=true
2026-03-04 04:33:19.542 ERROR [src.node.docker_mananger] Max retries reached for container 0703cefe653f. Exiting log stream.
2026-03-04 04:33:19.545 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.26.77 waku 902faa89bbadb11c1e4d5c7db8ed7857dcda06b6920bf7bdcedb3202169db6d7
2026-03-04 04:33:19.580 DEBUG [src.node.docker_mananger] Container started with ID 902faa89bbad. Setting up logs at ./log/docker/receiving_node1_2026-03-04_04-33-19__8c3d2336-132d-477c-9916-5ede97c8fe7e__wakuorg_nwaku:latest.log
2026-03-04 04:33:19.581 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 10495
2026-03-04 04:33:19.582 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-04 04:33:20.149 ERROR [src.node.docker_mananger] Max retries reached for container 3b68b54ea9e8. Exiting log stream.
2026-03-04 04:33:20.583 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10495/health" -H "Content-Type: application/json" -d 'None'
2026-03-04 04:33:20.585 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-04 04:33:20.586 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-04 04:33:20.586 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10495/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-04 04:33:20.588 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.26.77/tcp/10496/p2p/16Uiu2HAm2tFc6p1Hm1VPLMYHDMRddqyd95gVhfgMtbFyLJfDb6WB","/ip4/172.18.26.77/tcp/10497/ws/p2p/16Uiu2HAm2tFc6p1Hm1VPLMYHDMRddqyd95gVhfgMtbFyLJfDb6WB"],"enrUri":"enr:-L24QOuUw-Lu_YOVteB3-VqWNVmvU77sShNDAwFzFi00xjviS77jUWMuprg7D0GvjOdZvyX1ZGvmad5m8qFYbLU41FECgmlkgnY0gmlwhKwSGk2KbXVsdGlhZGRyc5YACASsEhpNBikAAAoErBIaTQYpAd0DgnJzhQADAQAAiXNlY3AyNTZrMaECbtDuOIDyjZdRx58K5lDXmbG3kwEm_v0x0QMiOLBzieCDdGNwgikAg3VkcIIpAoV3YWt1Mgk"}'
2026-03-04 04:33:20.588 INFO [src.node.waku_node] REST service is ready !!
2026-03-04 04:33:20.596 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-04 04:33:20.596 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node2_2026-03-04_04-33-19__8c3d2336-132d-477c-9916-5ede97c8fe7e__wakuorg_nwaku:latest.log
2026-03-04 04:33:20.596 DEBUG [src.node.waku_node] Starting Node...
2026-03-04 04:33:20.596 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-04 04:33:20.597 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-04 04:33:20.598 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.165.40
2026-03-04 04:33:20.598 DEBUG [src.node.docker_mananger] Generated ports ['55303', '55304', '55305', '55306', '55307']
2026-03-04 04:33:20.598 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-04 04:33:20.598 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-04 04:33:20.598 DEBUG [src.node.waku_node] Using volumes []
2026-03-04 04:33:20.598 DEBUG [src.node.docker_mananger] docker run -i -t -p 55303:55303 -p 55304:55304 -p 55305:55305 -p 55306:55306 -p 55307:55307 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=55305 --rest-port=55303 --tcp-port=55304 --discv5-udp-port=55306 --rest-address=0.0.0.0 --nat=extip:172.18.165.40 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=47802d55c9b4cbea141f5baff5d9aa4d48fa23986212b4ea22a5b4d3ad51fa0f --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=55307 --metrics-logging=true --lightpush=false --relay=true
2026-03-04 04:33:20.799 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.165.40 waku 3fd6f6f7a9e8b37a1da732c0183b29ee04f08bda4662bf8677f80a586fc839ff
2026-03-04 04:33:20.832 DEBUG [src.node.docker_mananger] Container started with ID 3fd6f6f7a9e8. Setting up logs at ./log/docker/receiving_node2_2026-03-04_04-33-19__8c3d2336-132d-477c-9916-5ede97c8fe7e__wakuorg_nwaku:latest.log
2026-03-04 04:33:20.832 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 55303
2026-03-04 04:33:20.832 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-04 04:33:21.833 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55303/health" -H "Content-Type: application/json" -d 'None'
2026-03-04 04:33:21.837 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-04 04:33:21.837 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-04 04:33:21.837 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55303/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-04 04:33:21.839 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.165.40/tcp/55304/p2p/16Uiu2HAm28hDu8j1EnamfHZaaHW8Ee1waFJAMXxC6hDYPWxfqp4Y","/ip4/172.18.165.40/tcp/55305/ws/p2p/16Uiu2HAm28hDu8j1EnamfHZaaHW8Ee1waFJAMXxC6hDYPWxfqp4Y"],"enrUri":"enr:-L24QOxIaN1t99Y0x_EuE3FKyS8rKgP9q9f92yKFoEAvlgSBI4YNJIUnfoo2cYw9m7ygFkB9vB-RE0KwotU8d2Y_qIECgmlkgnY0gmlwhKwSpSiKbXVsdGlhZGRyc5YACASsEqUoBtgIAAoErBKlKAbYCd0DgnJzhQADAQAAiXNlY3AyNTZrMaECY6hXJoYpUqbkLtfrZwcohEh-dDrYuJkuFSToQ7aIsumDdGNwgtgIg3VkcILYCoV3YWt1MgE"}'
2026-03-04 04:33:21.839 INFO [src.node.waku_node] REST service is ready !!
2026-03-04 04:33:21.840 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:55303/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.26.77/tcp/10496/p2p/16Uiu2HAm2tFc6p1Hm1VPLMYHDMRddqyd95gVhfgMtbFyLJfDb6WB"]'
2026-03-04 04:33:21.877 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-04 04:33:21.890 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-04 04:33:21.890 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/lightpush_node1_2026-03-04_04-33-19__8c3d2336-132d-477c-9916-5ede97c8fe7e__wakuorg_nwaku:latest.log
2026-03-04 04:33:21.890 DEBUG [src.node.waku_node] Starting Node...
2026-03-04 04:33:21.891 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-04 04:33:21.892 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-04 04:33:21.892 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.251.136
2026-03-04 04:33:21.892 DEBUG [src.node.docker_mananger] Generated ports ['60373', '60374', '60375', '60376', '60377']
2026-03-04 04:33:21.893 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-04 04:33:21.893 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-04 04:33:21.893 DEBUG [src.node.waku_node] Using volumes []
2026-03-04 04:33:21.893 DEBUG [src.node.docker_mananger] docker run -i -t -p 60373:60373 -p 60374:60374 -p 60375:60375 -p 60376:60376 -p 60377:60377 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=60375 --rest-port=60373 --tcp-port=60374 --discv5-udp-port=60376 --rest-address=0.0.0.0 --nat=extip:172.18.251.136 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=c366cc5c7bbedfc5f8dd72fb896cae3d30e3456103b82de3cfc36badcb6c8b67 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=60377 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QOuUw-Lu_YOVteB3-VqWNVmvU77sShNDAwFzFi00xjviS77jUWMuprg7D0GvjOdZvyX1ZGvmad5m8qFYbLU41FECgmlkgnY0gmlwhKwSGk2KbXVsdGlhZGRyc5YACASsEhpNBikAAAoErBIaTQYpAd0DgnJzhQADAQAAiXNlY3AyNTZrMaECbtDuOIDyjZdRx58K5lDXmbG3kwEm_v0x0QMiOLBzieCDdGNwgikAg3VkcIIpAoV3YWt1Mgk --lightpushnode=/ip4/172.18.26.77/tcp/10496/p2p/16Uiu2HAm2tFc6p1Hm1VPLMYHDMRddqyd95gVhfgMtbFyLJfDb6WB --lightpush=true --relay=true
2026-03-04 04:33:22.099 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.251.136 waku 3d079addd790fbd26a7bfd87d903c81485aa036959e8e74dc4ac04fc9beb36b7
2026-03-04 04:33:22.137 DEBUG [src.node.docker_mananger] Container started with ID 3d079addd790. Setting up logs at ./log/docker/lightpush_node1_2026-03-04_04-33-19__8c3d2336-132d-477c-9916-5ede97c8fe7e__wakuorg_nwaku:latest.log
2026-03-04 04:33:22.137 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 60373
2026-03-04 04:33:22.138 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-04 04:33:23.139 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60373/health" -H "Content-Type: application/json" -d 'None'
2026-03-04 04:33:23.141 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-04 04:33:23.142 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-04 04:33:23.142 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60373/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-04 04:33:23.144 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.251.136/tcp/60374/p2p/16Uiu2HAm1pmXZs5dhQs7d6hFqrAyqvcpZByyBNQVHGQ63XB25VCC","/ip4/172.18.251.136/tcp/60375/ws/p2p/16Uiu2HAm1pmXZs5dhQs7d6hFqrAyqvcpZByyBNQVHGQ63XB25VCC"],"enrUri":"enr:-L24QItLdRXECytbLSwyeHuDpWYlmTpSmRaijJ9MgCsjShcLMnUdNv1f8n5IlvfwoyrvZII6aojQgJ8GC_TSe5nCZ6MCgmlkgnY0gmlwhKwS-4iKbXVsdGlhZGRyc5YACASsEvuIBuvWAAoErBL7iAbr190DgnJzhQADAQAAiXNlY3AyNTZrMaECXxDAzA_8mtW6tj3dPUXUfyuadXfVdd3_V-4sR97Yh-mDdGNwguvWg3VkcILr2IV3YWt1Mgk"}'
2026-03-04 04:33:23.145 INFO [src.node.waku_node] REST service is ready !!
2026-03-04 04:33:23.145 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:60373/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.26.77/tcp/10496/p2p/16Uiu2HAm2tFc6p1Hm1VPLMYHDMRddqyd95gVhfgMtbFyLJfDb6WB"]'
2026-03-04 04:33:23.186 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-04 04:33:23.188 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:60373/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.165.40/tcp/55304/p2p/16Uiu2HAm28hDu8j1EnamfHZaaHW8Ee1waFJAMXxC6hDYPWxfqp4Y"]'
2026-03-04 04:33:23.215 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-04 04:33:23.216 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:10495/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-04 04:33:23.222 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-04 04:33:23.223 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:55303/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-04 04:33:23.229 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-04 04:33:23.229 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:60373/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-04 04:33:23.233 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-04 04:33:23.235 DEBUG [src.steps.light_push] Lightpushing message
2026-03-04 04:33:23.237 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:60373/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/3/0", "message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "contentTopic": "/myapp/1/latest/proto", "timestamp": 1772598803235706248}}'
2026-03-04 04:33:23.251 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-04 04:33:23.254 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-04 04:33:23.355 DEBUG [src.steps.light_push] Checking that peer NODE_1:wakuorg/nwaku:latest can find the lightpushed message
2026-03-04 04:33:23.355 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10495/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-04 04:33:23.358 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772598803235706248,"ephemeral":false,"proof":""}]'
2026-03-04 04:33:23.359 DEBUG [src.steps.light_push] Checking that peer NODE_2:wakuorg/nwaku:latest can find the lightpushed message
2026-03-04 04:33:23.360 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55303/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-04 04:33:23.362 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772598803235706248,"ephemeral":false,"proof":""}]'
2026-03-04 04:33:23.364 DEBUG [src.steps.light_push] Checking that peer NODE_3:wakuorg/nwaku:latest can find the lightpushed message
2026-03-04 04:33:23.364 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60373/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-04 04:33:23.366 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772598803235706248,"ephemeral":false,"proof":""}]'
2026-03-04 04:33:23.368 DEBUG [src.node.waku_node] Restarting container with id 3d079addd790
2026-03-04 04:33:24.155 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60373/health" -H "Content-Type: application/json" -d 'None'
2026-03-04 04:33:24.258 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60373/health" -H "Content-Type: application/json" -d 'None'
2026-03-04 04:33:24.261 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-04 04:33:24.262 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-04 04:33:24.262 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60373/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-04 04:33:24.264 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.251.136/tcp/60374/p2p/16Uiu2HAm1pmXZs5dhQs7d6hFqrAyqvcpZByyBNQVHGQ63XB25VCC","/ip4/172.18.251.136/tcp/60375/ws/p2p/16Uiu2HAm1pmXZs5dhQs7d6hFqrAyqvcpZByyBNQVHGQ63XB25VCC"],"enrUri":"enr:-L24QItLdRXECytbLSwyeHuDpWYlmTpSmRaijJ9MgCsjShcLMnUdNv1f8n5IlvfwoyrvZII6aojQgJ8GC_TSe5nCZ6MCgmlkgnY0gmlwhKwS-4iKbXVsdGlhZGRyc5YACASsEvuIBuvWAAoErBL7iAbr190DgnJzhQADAQAAiXNlY3AyNTZrMaECXxDAzA_8mtW6tj3dPUXUfyuadXfVdd3_V-4sR97Yh-mDdGNwguvWg3VkcILr2IV3YWt1Mgk"}'
2026-03-04 04:33:24.264 INFO [src.node.waku_node] REST service is ready !!
2026-03-04 04:33:24.265 DEBUG [src.steps.light_push] Lightpushing message
2026-03-04 04:33:24.265 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:60373/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/3/0", "message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "contentTopic": "/myapp/1/latest/proto", "timestamp": 1772598804265412831}}'
2026-03-04 04:33:24.278 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-04 04:33:24.279 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-04 04:33:24.379 DEBUG [src.steps.light_push] Checking that peer NODE_1:wakuorg/nwaku:latest can find the lightpushed message
2026-03-04 04:33:24.379 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10495/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-04 04:33:24.382 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772598804265412831,"ephemeral":false,"proof":""}]'
2026-03-04 04:33:24.384 DEBUG [src.steps.light_push] Checking that peer NODE_2:wakuorg/nwaku:latest can find the lightpushed message
2026-03-04 04:33:24.384 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55303/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-04 04:33:24.387 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772598804265412831,"ephemeral":false,"proof":""}]'
2026-03-04 04:33:24.388 DEBUG [src.steps.light_push] Checking that peer NODE_3:wakuorg/nwaku:latest can find the lightpushed message
2026-03-04 04:33:24.388 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60373/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-04 04:33:24.391 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772598804265412831,"ephemeral":false,"proof":""}]'
2026-03-04 04:33:24.394 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-04 04:33:24.395 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-04 04:33:24.395 DEBUG [src.node.waku_node] Stopping container with id 902faa89bbad
2026-03-04 04:33:24.981 DEBUG [src.node.waku_node] Container stopped.
2026-03-04 04:33:24.982 DEBUG [src.node.waku_node] Stopping container with id 3fd6f6f7a9e8
2026-03-04 04:33:25.544 DEBUG [src.node.waku_node] Container stopped.
2026-03-04 04:33:25.547 DEBUG [src.node.waku_node] Stopping container with id 3d079addd790
2026-03-04 04:33:25.794 ERROR [src.node.docker_mananger] Max retries reached for container 902faa89bbad. Exiting log stream.
2026-03-04 04:33:26.078 DEBUG [src.node.waku_node] Container stopped.
2026-03-04 04:33:26.079 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-04 04:33:26.094 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-04 04:33:26.102 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-04 04:33:26.131 DEBUG [src.node.docker_mananger] No errors found in the waku logs.