129 lines
24 KiB
Plaintext

2026-03-08 04:33:26.536 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-08 04:33:26.537 DEBUG [tests.conftest] Running test: test_light_push_after_light_push_node_restarts with id: 2026-03-08_04-33-26__1a6b57ee-67fb-4690-b2ab-e9dbdfee464e
2026-03-08 04:33:26.540 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-08 04:33:26.541 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-03-08 04:33:26.550 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-08 04:33:26.550 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node1_2026-03-08_04-33-26__1a6b57ee-67fb-4690-b2ab-e9dbdfee464e__wakuorg_nwaku:latest.log
2026-03-08 04:33:26.550 DEBUG [src.node.waku_node] Starting Node...
2026-03-08 04:33:26.551 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-08 04:33:26.554 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-08 04:33:26.555 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.174.132
2026-03-08 04:33:26.555 DEBUG [src.node.docker_mananger] Generated ports ['23894', '23895', '23896', '23897', '23898']
2026-03-08 04:33:26.556 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-08 04:33:26.558 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-08 04:33:26.558 DEBUG [src.node.waku_node] Using volumes []
2026-03-08 04:33:26.558 DEBUG [src.node.docker_mananger] docker run -i -t -p 23894:23894 -p 23895:23895 -p 23896:23896 -p 23897:23897 -p 23898:23898 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=23896 --rest-port=23894 --tcp-port=23895 --discv5-udp-port=23897 --rest-address=0.0.0.0 --nat=extip:172.18.174.132 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ca3390fe4af229be22d7e88b96aacfe904ce2f0c2e541f31eeff9fd2751fcb55 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=23898 --metrics-logging=true --lightpush=true --relay=true
2026-03-08 04:33:26.741 ERROR [src.node.docker_mananger] Max retries reached for container 5f4b21a5059a. Exiting log stream.
2026-03-08 04:33:26.763 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.174.132 waku adcc5d0f9086058b864e0c9c0cab6556463ead5c963c305c36c992471346a3c9
2026-03-08 04:33:26.803 DEBUG [src.node.docker_mananger] Container started with ID adcc5d0f9086. Setting up logs at ./log/docker/receiving_node1_2026-03-08_04-33-26__1a6b57ee-67fb-4690-b2ab-e9dbdfee464e__wakuorg_nwaku:latest.log
2026-03-08 04:33:26.804 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 23894
2026-03-08 04:33:26.805 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-08 04:33:27.383 ERROR [src.node.docker_mananger] Max retries reached for container 337c87ac30d9. Exiting log stream.
2026-03-08 04:33:27.805 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:23894/health" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:33:27.809 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-08 04:33:27.809 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-08 04:33:27.809 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:23894/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:33:27.811 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.174.132/tcp/23895/p2p/16Uiu2HAmFEUqsEwnNMagM8k7XQm29YWoHDV9dNDWCs5hWqkyApq7","/ip4/172.18.174.132/tcp/23896/ws/p2p/16Uiu2HAmFEUqsEwnNMagM8k7XQm29YWoHDV9dNDWCs5hWqkyApq7"],"enrUri":"enr:-L24QB4BOherxfsMUbGx8XS2G8KtwsZpQLuvxOm6MOvqGA9WXpZsalDNTLm5hNvfu9jkUhZUUlRinl42BFWptdAcL3ECgmlkgnY0gmlwhKwSroSKbXVsdGlhZGRyc5YACASsEq6EBl1XAAoErBKuhAZdWN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDJkvB4nL_YeNwhQnyl4tAaVcNuyRVYj4jQc26MdpA-cqDdGNwgl1Xg3VkcIJdWYV3YWt1Mgk"}'
2026-03-08 04:33:27.812 INFO [src.node.waku_node] REST service is ready !!
2026-03-08 04:33:27.819 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-08 04:33:27.819 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node2_2026-03-08_04-33-26__1a6b57ee-67fb-4690-b2ab-e9dbdfee464e__wakuorg_nwaku:latest.log
2026-03-08 04:33:27.820 DEBUG [src.node.waku_node] Starting Node...
2026-03-08 04:33:27.820 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-08 04:33:27.821 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-08 04:33:27.821 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.252.22
2026-03-08 04:33:27.822 DEBUG [src.node.docker_mananger] Generated ports ['2547', '2548', '2549', '2550', '2551']
2026-03-08 04:33:27.822 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-08 04:33:27.822 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-08 04:33:27.822 DEBUG [src.node.waku_node] Using volumes []
2026-03-08 04:33:27.822 DEBUG [src.node.docker_mananger] docker run -i -t -p 2547:2547 -p 2548:2548 -p 2549:2549 -p 2550:2550 -p 2551:2551 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=2549 --rest-port=2547 --tcp-port=2548 --discv5-udp-port=2550 --rest-address=0.0.0.0 --nat=extip:172.18.252.22 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=54ca842ea8b4bebfb68d0a26b6a68c5c5bf790eca1f8df0ec8fc15edf023078e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=2551 --metrics-logging=true --lightpush=false --relay=true
2026-03-08 04:33:28.014 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.252.22 waku 25c229e97cfdd92647fe4806f33a8927d1fcd9e8fb3b0fa047fa7165063aca3d
2026-03-08 04:33:28.049 DEBUG [src.node.docker_mananger] Container started with ID 25c229e97cfd. Setting up logs at ./log/docker/receiving_node2_2026-03-08_04-33-26__1a6b57ee-67fb-4690-b2ab-e9dbdfee464e__wakuorg_nwaku:latest.log
2026-03-08 04:33:28.049 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 2547
2026-03-08 04:33:28.050 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-08 04:33:29.050 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2547/health" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:33:29.053 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-08 04:33:29.054 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-08 04:33:29.054 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2547/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:33:29.056 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.252.22/tcp/2548/p2p/16Uiu2HAm5aSciSTxkEh682pjQY5kFMirCUUqxWK4QbKtm5hXkx8U","/ip4/172.18.252.22/tcp/2549/ws/p2p/16Uiu2HAm5aSciSTxkEh682pjQY5kFMirCUUqxWK4QbKtm5hXkx8U"],"enrUri":"enr:-L24QKjwpObz_0DdZ5kO1P0wn3WR8tfFO5_vPb3KoY56idMjH6x1Hi1WHlV9MgRn2iq5ObCmgtY_KY4lIWr1umBKi2ECgmlkgnY0gmlwhKwS_BaKbXVsdGlhZGRyc5YACASsEvwWBgn0AAoErBL8FgYJ9d0DgnJzhQADAQAAiXNlY3AyNTZrMaECltP8ifwrueV2iYNWjKloCcxcgKZ4L4BND7z_zBqPoAWDdGNwggn0g3VkcIIJ9oV3YWt1MgE"}'
2026-03-08 04:33:29.056 INFO [src.node.waku_node] REST service is ready !!
2026-03-08 04:33:29.057 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:2547/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.174.132/tcp/23895/p2p/16Uiu2HAmFEUqsEwnNMagM8k7XQm29YWoHDV9dNDWCs5hWqkyApq7"]'
2026-03-08 04:33:29.097 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:33:29.106 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-08 04:33:29.106 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/lightpush_node1_2026-03-08_04-33-26__1a6b57ee-67fb-4690-b2ab-e9dbdfee464e__wakuorg_nwaku:latest.log
2026-03-08 04:33:29.106 DEBUG [src.node.waku_node] Starting Node...
2026-03-08 04:33:29.106 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-08 04:33:29.108 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-08 04:33:29.108 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.2.85
2026-03-08 04:33:29.108 DEBUG [src.node.docker_mananger] Generated ports ['6527', '6528', '6529', '6530', '6531']
2026-03-08 04:33:29.108 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-08 04:33:29.109 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-08 04:33:29.109 DEBUG [src.node.waku_node] Using volumes []
2026-03-08 04:33:29.109 DEBUG [src.node.docker_mananger] docker run -i -t -p 6527:6527 -p 6528:6528 -p 6529:6529 -p 6530:6530 -p 6531:6531 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=6529 --rest-port=6527 --tcp-port=6528 --discv5-udp-port=6530 --rest-address=0.0.0.0 --nat=extip:172.18.2.85 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=5efbfd2d115a924e79cbbd8407c2cbd78e427ff2e4d1c37ca0ee4c43c2233c7b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=6531 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QB4BOherxfsMUbGx8XS2G8KtwsZpQLuvxOm6MOvqGA9WXpZsalDNTLm5hNvfu9jkUhZUUlRinl42BFWptdAcL3ECgmlkgnY0gmlwhKwSroSKbXVsdGlhZGRyc5YACASsEq6EBl1XAAoErBKuhAZdWN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDJkvB4nL_YeNwhQnyl4tAaVcNuyRVYj4jQc26MdpA-cqDdGNwgl1Xg3VkcIJdWYV3YWt1Mgk --lightpushnode=/ip4/172.18.174.132/tcp/23895/p2p/16Uiu2HAmFEUqsEwnNMagM8k7XQm29YWoHDV9dNDWCs5hWqkyApq7 --lightpush=true --relay=true
2026-03-08 04:33:29.309 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.2.85 waku d9d706bd29ea9ce634f2b19fd10efe43180e562725d4261b2b434f28d8e869e7
2026-03-08 04:33:29.343 DEBUG [src.node.docker_mananger] Container started with ID d9d706bd29ea. Setting up logs at ./log/docker/lightpush_node1_2026-03-08_04-33-26__1a6b57ee-67fb-4690-b2ab-e9dbdfee464e__wakuorg_nwaku:latest.log
2026-03-08 04:33:29.343 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 6527
2026-03-08 04:33:29.343 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-08 04:33:30.344 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6527/health" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:33:30.348 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-08 04:33:30.348 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-08 04:33:30.348 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6527/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:33:30.351 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.2.85/tcp/6528/p2p/16Uiu2HAmC2MWTewusRFmjB5FuSvfDSrWnZnKHrXev6jPkNr87rPa","/ip4/172.18.2.85/tcp/6529/ws/p2p/16Uiu2HAmC2MWTewusRFmjB5FuSvfDSrWnZnKHrXev6jPkNr87rPa"],"enrUri":"enr:-L24QOh7sS3l55hxp20a7uv3FyPz7mXA_U4HONfaEGJGQksiQtRiVFc3qUS92EK1IYx-Q72ovm_DOrRQhscsEEry-XMCgmlkgnY0gmlwhKwSAlWKbXVsdGlhZGRyc5YACASsEgJVBhmAAAoErBICVQYZgd0DgnJzhQADAQAAiXNlY3AyNTZrMaEC9p1vAZJ-kS4psMa1AD0lX4dolLBDDzdi4gkLuQKP0cGDdGNwghmAg3VkcIIZgoV3YWt1Mgk"}'
2026-03-08 04:33:30.351 INFO [src.node.waku_node] REST service is ready !!
2026-03-08 04:33:30.352 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:6527/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.174.132/tcp/23895/p2p/16Uiu2HAmFEUqsEwnNMagM8k7XQm29YWoHDV9dNDWCs5hWqkyApq7"]'
2026-03-08 04:33:30.391 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:33:30.393 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:6527/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.252.22/tcp/2548/p2p/16Uiu2HAm5aSciSTxkEh682pjQY5kFMirCUUqxWK4QbKtm5hXkx8U"]'
2026-03-08 04:33:30.423 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:33:30.426 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:23894/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-08 04:33:30.433 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:33:30.433 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:2547/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-08 04:33:30.439 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:33:30.439 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:6527/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-08 04:33:30.447 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:33:30.450 DEBUG [src.steps.light_push] Lightpushing message
2026-03-08 04:33:30.450 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:6527/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/3/0", "message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "contentTopic": "/myapp/1/latest/proto", "timestamp": 1772944410450168183}}'
2026-03-08 04:33:30.464 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:33:30.465 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-08 04:33:30.565 DEBUG [src.steps.light_push] Checking that peer NODE_1:wakuorg/nwaku:latest can find the lightpushed message
2026-03-08 04:33:30.566 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:23894/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:33:30.569 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772944410450168183,"ephemeral":false,"proof":""}]'
2026-03-08 04:33:30.570 DEBUG [src.steps.light_push] Checking that peer NODE_2:wakuorg/nwaku:latest can find the lightpushed message
2026-03-08 04:33:30.570 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2547/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:33:30.573 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772944410450168183,"ephemeral":false,"proof":""}]'
2026-03-08 04:33:30.574 DEBUG [src.steps.light_push] Checking that peer NODE_3:wakuorg/nwaku:latest can find the lightpushed message
2026-03-08 04:33:30.575 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6527/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:33:30.577 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772944410450168183,"ephemeral":false,"proof":""}]'
2026-03-08 04:33:30.579 DEBUG [src.node.waku_node] Restarting container with id d9d706bd29ea
2026-03-08 04:33:31.363 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6527/health" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:33:31.465 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6527/health" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:33:31.468 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-08 04:33:31.468 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-08 04:33:31.468 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6527/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:33:31.471 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.2.85/tcp/6528/p2p/16Uiu2HAmC2MWTewusRFmjB5FuSvfDSrWnZnKHrXev6jPkNr87rPa","/ip4/172.18.2.85/tcp/6529/ws/p2p/16Uiu2HAmC2MWTewusRFmjB5FuSvfDSrWnZnKHrXev6jPkNr87rPa"],"enrUri":"enr:-L24QOh7sS3l55hxp20a7uv3FyPz7mXA_U4HONfaEGJGQksiQtRiVFc3qUS92EK1IYx-Q72ovm_DOrRQhscsEEry-XMCgmlkgnY0gmlwhKwSAlWKbXVsdGlhZGRyc5YACASsEgJVBhmAAAoErBICVQYZgd0DgnJzhQADAQAAiXNlY3AyNTZrMaEC9p1vAZJ-kS4psMa1AD0lX4dolLBDDzdi4gkLuQKP0cGDdGNwghmAg3VkcIIZgoV3YWt1Mgk"}'
2026-03-08 04:33:31.471 INFO [src.node.waku_node] REST service is ready !!
2026-03-08 04:33:31.472 DEBUG [src.steps.light_push] Lightpushing message
2026-03-08 04:33:31.472 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:6527/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/3/0", "message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "contentTopic": "/myapp/1/latest/proto", "timestamp": 1772944411472120029}}'
2026-03-08 04:33:31.486 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:33:31.487 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-08 04:33:31.587 DEBUG [src.steps.light_push] Checking that peer NODE_1:wakuorg/nwaku:latest can find the lightpushed message
2026-03-08 04:33:31.587 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:23894/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:33:31.590 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772944411472120029,"ephemeral":false,"proof":""}]'
2026-03-08 04:33:31.592 DEBUG [src.steps.light_push] Checking that peer NODE_2:wakuorg/nwaku:latest can find the lightpushed message
2026-03-08 04:33:31.592 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2547/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:33:31.595 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772944411472120029,"ephemeral":false,"proof":""}]'
2026-03-08 04:33:31.596 DEBUG [src.steps.light_push] Checking that peer NODE_3:wakuorg/nwaku:latest can find the lightpushed message
2026-03-08 04:33:31.596 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6527/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:33:31.598 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772944411472120029,"ephemeral":false,"proof":""}]'
2026-03-08 04:33:31.601 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-08 04:33:31.602 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-08 04:33:31.602 DEBUG [src.node.waku_node] Stopping container with id adcc5d0f9086
2026-03-08 04:33:32.203 DEBUG [src.node.waku_node] Container stopped.
2026-03-08 04:33:32.204 DEBUG [src.node.waku_node] Stopping container with id 25c229e97cfd
2026-03-08 04:33:32.786 DEBUG [src.node.waku_node] Container stopped.
2026-03-08 04:33:32.786 DEBUG [src.node.waku_node] Stopping container with id d9d706bd29ea
2026-03-08 04:33:33.060 ERROR [src.node.docker_mananger] Max retries reached for container adcc5d0f9086. Exiting log stream.
2026-03-08 04:33:33.356 DEBUG [src.node.waku_node] Container stopped.
2026-03-08 04:33:33.360 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-08 04:33:33.387 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-08 04:33:33.402 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-08 04:33:33.430 DEBUG [src.node.docker_mananger] No errors found in the waku logs.