276 lines
52 KiB
Plaintext

2026-03-11 04:33:43.208 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-11 04:33:43.208 DEBUG [tests.conftest] Running test: test_multiple_lightpush_nodes with id: 2026-03-11_04-33-43__a20c59fb-312b-477f-9052-f33c67d01566
2026-03-11 04:33:43.208 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-11 04:33:43.209 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-03-11 04:33:43.217 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-11 04:33:43.217 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node1_2026-03-11_04-33-43__a20c59fb-312b-477f-9052-f33c67d01566__wakuorg_nwaku:latest.log
2026-03-11 04:33:43.217 DEBUG [src.node.waku_node] Starting Node...
2026-03-11 04:33:43.217 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-11 04:33:43.219 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-11 04:33:43.219 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.35.68
2026-03-11 04:33:43.219 DEBUG [src.node.docker_mananger] Generated ports ['33718', '33719', '33720', '33721', '33722']
2026-03-11 04:33:43.219 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-11 04:33:43.219 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-11 04:33:43.219 DEBUG [src.node.waku_node] Using volumes []
2026-03-11 04:33:43.220 DEBUG [src.node.docker_mananger] docker run -i -t -p 33718:33718 -p 33719:33719 -p 33720:33720 -p 33721:33721 -p 33722:33722 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=33720 --rest-port=33718 --tcp-port=33719 --discv5-udp-port=33721 --rest-address=0.0.0.0 --nat=extip:172.18.35.68 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=e9fcc5b4e215a3061b995b42cab413ddddd37bbd09e0b8e09c9951c5f9a69f85 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=33722 --metrics-logging=true --lightpush=true --relay=true
2026-03-11 04:33:43.408 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.35.68 waku 9b68cd0edace76bf8d60133f8f2a31645dd5b7c93394cba9cef0091c6cab815d
2026-03-11 04:33:43.441 DEBUG [src.node.docker_mananger] Container started with ID 9b68cd0edace. Setting up logs at ./log/docker/receiving_node1_2026-03-11_04-33-43__a20c59fb-312b-477f-9052-f33c67d01566__wakuorg_nwaku:latest.log
2026-03-11 04:33:43.442 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 33718
2026-03-11 04:33:43.442 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-11 04:33:43.463 ERROR [src.node.docker_mananger] Max retries reached for container ef7ba03ab394. Exiting log stream.
2026-03-11 04:33:44.010 ERROR [src.node.docker_mananger] Max retries reached for container 9c2c732156ca. Exiting log stream.
2026-03-11 04:33:44.443 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:33718/health" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:44.446 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-11 04:33:44.447 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-11 04:33:44.447 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:33718/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:44.449 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.35.68/tcp/33719/p2p/16Uiu2HAmVVvW4hiV4g4vSBey6qg9H8ERAZfdeKikFhwvxfZYoCzq","/ip4/172.18.35.68/tcp/33720/ws/p2p/16Uiu2HAmVVvW4hiV4g4vSBey6qg9H8ERAZfdeKikFhwvxfZYoCzq"],"enrUri":"enr:-L24QHtcl58_2iqjanSbk0z5EKKF4w-VB4KvhZ--SQBEDVnPUnkv8P8TgyjJpp64JGhmH30ROTrmoeJxDqHP7DiSbAsCgmlkgnY0gmlwhKwSI0SKbXVsdGlhZGRyc5YACASsEiNEBoO3AAoErBIjRAaDuN0DgnJzhQADAQAAiXNlY3AyNTZrMaED-kQZRWNM07SEifKU1xMd1XChaUVLmnmuSKrFYIvZucaDdGNwgoO3g3VkcIKDuYV3YWt1Mgk"}'
2026-03-11 04:33:44.449 INFO [src.node.waku_node] REST service is ready !!
2026-03-11 04:33:44.456 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-11 04:33:44.457 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node2_2026-03-11_04-33-43__a20c59fb-312b-477f-9052-f33c67d01566__wakuorg_nwaku:latest.log
2026-03-11 04:33:44.457 DEBUG [src.node.waku_node] Starting Node...
2026-03-11 04:33:44.457 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-11 04:33:44.458 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-11 04:33:44.458 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.205.125
2026-03-11 04:33:44.458 DEBUG [src.node.docker_mananger] Generated ports ['14924', '14925', '14926', '14927', '14928']
2026-03-11 04:33:44.459 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-11 04:33:44.459 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-11 04:33:44.459 DEBUG [src.node.waku_node] Using volumes []
2026-03-11 04:33:44.459 DEBUG [src.node.docker_mananger] docker run -i -t -p 14924:14924 -p 14925:14925 -p 14926:14926 -p 14927:14927 -p 14928:14928 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=14926 --rest-port=14924 --tcp-port=14925 --discv5-udp-port=14927 --rest-address=0.0.0.0 --nat=extip:172.18.205.125 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ca73fafd3318bcf51c9aca2e58d10cc8ebb29aac3c03f6beebc60cea3aa11cb8 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=14928 --metrics-logging=true --lightpush=false --relay=true
2026-03-11 04:33:44.650 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.205.125 waku ebc47f0bfb9705a16bf1b0d2c2a0ff74de3a592ff164302362eeaa6ca2c65260
2026-03-11 04:33:44.682 DEBUG [src.node.docker_mananger] Container started with ID ebc47f0bfb97. Setting up logs at ./log/docker/receiving_node2_2026-03-11_04-33-43__a20c59fb-312b-477f-9052-f33c67d01566__wakuorg_nwaku:latest.log
2026-03-11 04:33:44.682 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 14924
2026-03-11 04:33:44.682 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-11 04:33:45.683 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14924/health" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:45.686 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-11 04:33:45.686 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-11 04:33:45.686 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14924/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:45.688 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.205.125/tcp/14925/p2p/16Uiu2HAkuojGu3DY4LEXRNa1E6xqeBb6ZZneT7Hot2uZuEnF47qs","/ip4/172.18.205.125/tcp/14926/ws/p2p/16Uiu2HAkuojGu3DY4LEXRNa1E6xqeBb6ZZneT7Hot2uZuEnF47qs"],"enrUri":"enr:-L24QLcx1i4PY5N27iofUTx7SCkHeY159C_W0AkJyN-VRTBzAoRzgjJw8eKNaHu27BOlua_DHVkK6HhUo0fpbUhMlRkCgmlkgnY0gmlwhKwSzX2KbXVsdGlhZGRyc5YACASsEs19BjpNAAoErBLNfQY6Tt0DgnJzhQADAQAAiXNlY3AyNTZrMaECBaaA3EQ1WuvqIEkkaeS4Rhpz3M3kqxbJK28DPqzro6KDdGNwgjpNg3VkcII6T4V3YWt1MgE"}'
2026-03-11 04:33:45.688 INFO [src.node.waku_node] REST service is ready !!
2026-03-11 04:33:45.689 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14924/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.35.68/tcp/33719/p2p/16Uiu2HAmVVvW4hiV4g4vSBey6qg9H8ERAZfdeKikFhwvxfZYoCzq"]'
2026-03-11 04:33:45.727 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-11 04:33:45.739 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-11 04:33:45.740 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/lightpush_node1_2026-03-11_04-33-43__a20c59fb-312b-477f-9052-f33c67d01566__wakuorg_nwaku:latest.log
2026-03-11 04:33:45.740 DEBUG [src.node.waku_node] Starting Node...
2026-03-11 04:33:45.740 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-11 04:33:45.741 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-11 04:33:45.741 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.12.84
2026-03-11 04:33:45.742 DEBUG [src.node.docker_mananger] Generated ports ['58131', '58132', '58133', '58134', '58135']
2026-03-11 04:33:45.742 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-11 04:33:45.742 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-11 04:33:45.742 DEBUG [src.node.waku_node] Using volumes []
2026-03-11 04:33:45.742 DEBUG [src.node.docker_mananger] docker run -i -t -p 58131:58131 -p 58132:58132 -p 58133:58133 -p 58134:58134 -p 58135:58135 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=58133 --rest-port=58131 --tcp-port=58132 --discv5-udp-port=58134 --rest-address=0.0.0.0 --nat=extip:172.18.12.84 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=2babaad297eefd748f1cec8a7eafa7f869ead1a3feede46ab17b3e025ce2e011 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=58135 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QHtcl58_2iqjanSbk0z5EKKF4w-VB4KvhZ--SQBEDVnPUnkv8P8TgyjJpp64JGhmH30ROTrmoeJxDqHP7DiSbAsCgmlkgnY0gmlwhKwSI0SKbXVsdGlhZGRyc5YACASsEiNEBoO3AAoErBIjRAaDuN0DgnJzhQADAQAAiXNlY3AyNTZrMaED-kQZRWNM07SEifKU1xMd1XChaUVLmnmuSKrFYIvZucaDdGNwgoO3g3VkcIKDuYV3YWt1Mgk --lightpushnode=/ip4/172.18.35.68/tcp/33719/p2p/16Uiu2HAmVVvW4hiV4g4vSBey6qg9H8ERAZfdeKikFhwvxfZYoCzq --lightpush=true --relay=true
2026-03-11 04:33:45.945 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.12.84 waku f0065e3d01efe235d539546b0a6808b5adb4d523af9996c6d0749511e8fd5944
2026-03-11 04:33:45.981 DEBUG [src.node.docker_mananger] Container started with ID f0065e3d01ef. Setting up logs at ./log/docker/lightpush_node1_2026-03-11_04-33-43__a20c59fb-312b-477f-9052-f33c67d01566__wakuorg_nwaku:latest.log
2026-03-11 04:33:45.981 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 58131
2026-03-11 04:33:45.981 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-11 04:33:46.982 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58131/health" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:46.985 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-11 04:33:46.985 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-11 04:33:46.985 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58131/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:46.987 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.12.84/tcp/58132/p2p/16Uiu2HAm2xvQ28oCmqBvXtzqsDoDkQCLWZfitNoCCLY5icJdVAMC","/ip4/172.18.12.84/tcp/58133/ws/p2p/16Uiu2HAm2xvQ28oCmqBvXtzqsDoDkQCLWZfitNoCCLY5icJdVAMC"],"enrUri":"enr:-L24QOqfKVbM9xPQwx6U8x158wSBbO2lPBmGK5qBJYYoysQkVb6YCaZBF5ViwbQ4M26v3JOoIR4_Q7fe5Cmdt_8H1BQCgmlkgnY0gmlwhKwSDFSKbXVsdGlhZGRyc5YACASsEgxUBuMUAAoErBIMVAbjFd0DgnJzhQADAQAAiXNlY3AyNTZrMaECcAMdn5OPIIVjbo7JZyFARq3u0IxH7RyKfIp-rs9SpFeDdGNwguMUg3VkcILjFoV3YWt1Mgk"}'
2026-03-11 04:33:46.988 INFO [src.node.waku_node] REST service is ready !!
2026-03-11 04:33:46.988 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:58131/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.35.68/tcp/33719/p2p/16Uiu2HAmVVvW4hiV4g4vSBey6qg9H8ERAZfdeKikFhwvxfZYoCzq"]'
2026-03-11 04:33:47.026 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-11 04:33:47.028 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:58131/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.205.125/tcp/14925/p2p/16Uiu2HAkuojGu3DY4LEXRNa1E6xqeBb6ZZneT7Hot2uZuEnF47qs"]'
2026-03-11 04:33:47.052 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-11 04:33:47.066 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-11 04:33:47.066 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/lightpush_node2_2026-03-11_04-33-43__a20c59fb-312b-477f-9052-f33c67d01566__wakuorg_nwaku:latest.log
2026-03-11 04:33:47.067 DEBUG [src.node.waku_node] Starting Node...
2026-03-11 04:33:47.067 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-11 04:33:47.069 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-11 04:33:47.070 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.61.28
2026-03-11 04:33:47.070 DEBUG [src.node.docker_mananger] Generated ports ['53575', '53576', '53577', '53578', '53579']
2026-03-11 04:33:47.071 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-11 04:33:47.071 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-11 04:33:47.072 DEBUG [src.node.waku_node] Using volumes []
2026-03-11 04:33:47.073 DEBUG [src.node.docker_mananger] docker run -i -t -p 53575:53575 -p 53576:53576 -p 53577:53577 -p 53578:53578 -p 53579:53579 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=53577 --rest-port=53575 --tcp-port=53576 --discv5-udp-port=53578 --rest-address=0.0.0.0 --nat=extip:172.18.61.28 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=0ebb2acb8adfc0f8450c3ac98b6f52defdbe6b1b7eaacd0fd2fdc1a15facbd14 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=53579 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QHtcl58_2iqjanSbk0z5EKKF4w-VB4KvhZ--SQBEDVnPUnkv8P8TgyjJpp64JGhmH30ROTrmoeJxDqHP7DiSbAsCgmlkgnY0gmlwhKwSI0SKbXVsdGlhZGRyc5YACASsEiNEBoO3AAoErBIjRAaDuN0DgnJzhQADAQAAiXNlY3AyNTZrMaED-kQZRWNM07SEifKU1xMd1XChaUVLmnmuSKrFYIvZucaDdGNwgoO3g3VkcIKDuYV3YWt1Mgk --lightpushnode=/ip4/172.18.35.68/tcp/33719/p2p/16Uiu2HAmVVvW4hiV4g4vSBey6qg9H8ERAZfdeKikFhwvxfZYoCzq --lightpush=true --relay=true
2026-03-11 04:33:47.275 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.61.28 waku f49fd692515622a312682de85c2f5df96ca98b2428a4b3447d2c44a7fb08f682
2026-03-11 04:33:47.310 DEBUG [src.node.docker_mananger] Container started with ID f49fd6925156. Setting up logs at ./log/docker/lightpush_node2_2026-03-11_04-33-43__a20c59fb-312b-477f-9052-f33c67d01566__wakuorg_nwaku:latest.log
2026-03-11 04:33:47.310 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 53575
2026-03-11 04:33:47.311 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-11 04:33:48.311 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53575/health" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:48.314 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-11 04:33:48.314 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-11 04:33:48.314 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53575/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:48.317 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.61.28/tcp/53576/p2p/16Uiu2HAkxqjCMVboCk8tAPt75C18LNTqwPEe6y3cjDvzsvmjWT64","/ip4/172.18.61.28/tcp/53577/ws/p2p/16Uiu2HAkxqjCMVboCk8tAPt75C18LNTqwPEe6y3cjDvzsvmjWT64"],"enrUri":"enr:-L24QPSkz_dvisiBwA_C9RV2HFFGve4jwEtI8KfVGvdz69FnfSMfP_1WfG6MIqB_KNMndtRaNVKHgv0Qq3uM-j_dScUCgmlkgnY0gmlwhKwSPRyKbXVsdGlhZGRyc5YACASsEj0cBtFIAAoErBI9HAbRSd0DgnJzhQADAQAAiXNlY3AyNTZrMaECMryjHfMXytcmhCd1JALrF7Fva-MMTLNtS4gdTqALzLWDdGNwgtFIg3VkcILRSoV3YWt1Mgk"}'
2026-03-11 04:33:48.317 INFO [src.node.waku_node] REST service is ready !!
2026-03-11 04:33:48.317 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53575/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.35.68/tcp/33719/p2p/16Uiu2HAmVVvW4hiV4g4vSBey6qg9H8ERAZfdeKikFhwvxfZYoCzq"]'
2026-03-11 04:33:48.374 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-11 04:33:48.380 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53575/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.205.125/tcp/14925/p2p/16Uiu2HAkuojGu3DY4LEXRNa1E6xqeBb6ZZneT7Hot2uZuEnF47qs"]'
2026-03-11 04:33:48.413 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-11 04:33:48.424 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-11 04:33:48.424 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/lightpush_node3_2026-03-11_04-33-43__a20c59fb-312b-477f-9052-f33c67d01566__wakuorg_nwaku:latest.log
2026-03-11 04:33:48.425 DEBUG [src.node.waku_node] Starting Node...
2026-03-11 04:33:48.425 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-11 04:33:48.426 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-11 04:33:48.426 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.64.243
2026-03-11 04:33:48.426 DEBUG [src.node.docker_mananger] Generated ports ['61888', '61889', '61890', '61891', '61892']
2026-03-11 04:33:48.427 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-11 04:33:48.427 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-11 04:33:48.427 DEBUG [src.node.waku_node] Using volumes []
2026-03-11 04:33:48.427 DEBUG [src.node.docker_mananger] docker run -i -t -p 61888:61888 -p 61889:61889 -p 61890:61890 -p 61891:61891 -p 61892:61892 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=61890 --rest-port=61888 --tcp-port=61889 --discv5-udp-port=61891 --rest-address=0.0.0.0 --nat=extip:172.18.64.243 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=2444eddfdab251f486fc68ea80d6ffc3439fe8c6e6fee1600dd7eace77abcb80 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=61892 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QHtcl58_2iqjanSbk0z5EKKF4w-VB4KvhZ--SQBEDVnPUnkv8P8TgyjJpp64JGhmH30ROTrmoeJxDqHP7DiSbAsCgmlkgnY0gmlwhKwSI0SKbXVsdGlhZGRyc5YACASsEiNEBoO3AAoErBIjRAaDuN0DgnJzhQADAQAAiXNlY3AyNTZrMaED-kQZRWNM07SEifKU1xMd1XChaUVLmnmuSKrFYIvZucaDdGNwgoO3g3VkcIKDuYV3YWt1Mgk --lightpushnode=/ip4/172.18.35.68/tcp/33719/p2p/16Uiu2HAmVVvW4hiV4g4vSBey6qg9H8ERAZfdeKikFhwvxfZYoCzq --lightpush=true --relay=true
2026-03-11 04:33:48.630 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.64.243 waku b48c8956fa7c0094ed6ec4c0f7f643f8ccb9a5c58a9a6f9d657edbeaf87c7546
2026-03-11 04:33:48.665 DEBUG [src.node.docker_mananger] Container started with ID b48c8956fa7c. Setting up logs at ./log/docker/lightpush_node3_2026-03-11_04-33-43__a20c59fb-312b-477f-9052-f33c67d01566__wakuorg_nwaku:latest.log
2026-03-11 04:33:48.665 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 61888
2026-03-11 04:33:48.666 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-11 04:33:49.666 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61888/health" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:49.669 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-11 04:33:49.669 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-11 04:33:49.669 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61888/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:49.672 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.64.243/tcp/61889/p2p/16Uiu2HAkvYqT66jag3LJMTgU4mbssuoHoGrJLkomEzwpJZUtYviR","/ip4/172.18.64.243/tcp/61890/ws/p2p/16Uiu2HAkvYqT66jag3LJMTgU4mbssuoHoGrJLkomEzwpJZUtYviR"],"enrUri":"enr:-L24QDGL1-3Kn8Mo8R5B0cl3hqOWqdos-K6msJV-4KTW1z2_Gjw0EXW97zKKEV09TXuhVJLCCTteEXzYmZbX4uiPt_MCgmlkgnY0gmlwhKwSQPOKbXVsdGlhZGRyc5YACASsEkDzBvHBAAoErBJA8wbxwt0DgnJzhQADAQAAiXNlY3AyNTZrMaECELF2Bq5eD1vEt9BxJtqgd6gUMCOnPSegeha7TSJq4D6DdGNwgvHBg3VkcILxw4V3YWt1Mgk"}'
2026-03-11 04:33:49.672 INFO [src.node.waku_node] REST service is ready !!
2026-03-11 04:33:49.672 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61888/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.35.68/tcp/33719/p2p/16Uiu2HAmVVvW4hiV4g4vSBey6qg9H8ERAZfdeKikFhwvxfZYoCzq"]'
2026-03-11 04:33:49.720 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-11 04:33:49.722 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61888/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.205.125/tcp/14925/p2p/16Uiu2HAkuojGu3DY4LEXRNa1E6xqeBb6ZZneT7Hot2uZuEnF47qs"]'
2026-03-11 04:33:49.755 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-11 04:33:49.770 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-11 04:33:49.770 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/lightpush_node4_2026-03-11_04-33-43__a20c59fb-312b-477f-9052-f33c67d01566__wakuorg_nwaku:latest.log
2026-03-11 04:33:49.770 DEBUG [src.node.waku_node] Starting Node...
2026-03-11 04:33:49.770 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-11 04:33:49.772 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-11 04:33:49.772 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.196.80
2026-03-11 04:33:49.772 DEBUG [src.node.docker_mananger] Generated ports ['46118', '46119', '46120', '46121', '46122']
2026-03-11 04:33:49.772 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-11 04:33:49.772 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-11 04:33:49.772 DEBUG [src.node.waku_node] Using volumes []
2026-03-11 04:33:49.773 DEBUG [src.node.docker_mananger] docker run -i -t -p 46118:46118 -p 46119:46119 -p 46120:46120 -p 46121:46121 -p 46122:46122 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=46120 --rest-port=46118 --tcp-port=46119 --discv5-udp-port=46121 --rest-address=0.0.0.0 --nat=extip:172.18.196.80 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ee7de7f1561afad197acbedf4ef8ce216f685b8253db7da6ca3ebeba1b969467 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=46122 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QHtcl58_2iqjanSbk0z5EKKF4w-VB4KvhZ--SQBEDVnPUnkv8P8TgyjJpp64JGhmH30ROTrmoeJxDqHP7DiSbAsCgmlkgnY0gmlwhKwSI0SKbXVsdGlhZGRyc5YACASsEiNEBoO3AAoErBIjRAaDuN0DgnJzhQADAQAAiXNlY3AyNTZrMaED-kQZRWNM07SEifKU1xMd1XChaUVLmnmuSKrFYIvZucaDdGNwgoO3g3VkcIKDuYV3YWt1Mgk --lightpushnode=/ip4/172.18.35.68/tcp/33719/p2p/16Uiu2HAmVVvW4hiV4g4vSBey6qg9H8ERAZfdeKikFhwvxfZYoCzq --lightpush=true --relay=true
2026-03-11 04:33:49.970 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.196.80 waku 45203d39c340bc60201a3c09cd41a363b132e127f73d77e04ef0d7c8ba327634
2026-03-11 04:33:50.006 DEBUG [src.node.docker_mananger] Container started with ID 45203d39c340. Setting up logs at ./log/docker/lightpush_node4_2026-03-11_04-33-43__a20c59fb-312b-477f-9052-f33c67d01566__wakuorg_nwaku:latest.log
2026-03-11 04:33:50.006 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 46118
2026-03-11 04:33:50.007 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-11 04:33:51.008 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:46118/health" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:51.011 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-11 04:33:51.011 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-11 04:33:51.011 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:46118/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:51.014 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.196.80/tcp/46119/p2p/16Uiu2HAkuYS2kdkfNfGmKM8gqkP6gp98v1bCYt2bW3r5cREXuCgX","/ip4/172.18.196.80/tcp/46120/ws/p2p/16Uiu2HAkuYS2kdkfNfGmKM8gqkP6gp98v1bCYt2bW3r5cREXuCgX"],"enrUri":"enr:-L24QJ34PltRMNyc84mnLgE_yelgsgdujHqQYkOtsMQ3XXwDIfQxYjI389floVbgPXfYS-APb5noiRefnU0odpVOhY8CgmlkgnY0gmlwhKwSxFCKbXVsdGlhZGRyc5YACASsEsRQBrQnAAoErBLEUAa0KN0DgnJzhQADAQAAiXNlY3AyNTZrMaECAbtLI3w8YdpKh4XMLYFrANsY3LkDK0gjdD0rnE3N_iCDdGNwgrQng3VkcIK0KYV3YWt1Mgk"}'
2026-03-11 04:33:51.014 INFO [src.node.waku_node] REST service is ready !!
2026-03-11 04:33:51.014 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:46118/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.35.68/tcp/33719/p2p/16Uiu2HAmVVvW4hiV4g4vSBey6qg9H8ERAZfdeKikFhwvxfZYoCzq"]'
2026-03-11 04:33:51.057 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-11 04:33:51.059 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:46118/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.205.125/tcp/14925/p2p/16Uiu2HAkuojGu3DY4LEXRNa1E6xqeBb6ZZneT7Hot2uZuEnF47qs"]'
2026-03-11 04:33:51.086 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-11 04:33:51.087 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33718/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-11 04:33:51.094 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-11 04:33:51.095 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14924/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-11 04:33:51.102 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-11 04:33:51.103 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:58131/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-11 04:33:51.107 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-11 04:33:51.109 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53575/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-11 04:33:51.114 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-11 04:33:51.115 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61888/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-11 04:33:51.118 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-11 04:33:51.119 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:46118/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-11 04:33:51.123 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-11 04:33:51.123 DEBUG [src.steps.light_push] Lightpushing message
2026-03-11 04:33:51.124 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:58131/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/3/0", "message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "contentTopic": "/myapp/1/latest/proto", "timestamp": 1773203631123782473}}'
2026-03-11 04:33:51.146 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-11 04:33:51.147 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-11 04:33:51.248 DEBUG [src.steps.light_push] Checking that peer NODE_1:wakuorg/nwaku:latest can find the lightpushed message
2026-03-11 04:33:51.249 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:33718/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:51.251 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773203631123782473,"ephemeral":false,"proof":""}]'
2026-03-11 04:33:51.253 DEBUG [src.steps.light_push] Checking that peer NODE_2:wakuorg/nwaku:latest can find the lightpushed message
2026-03-11 04:33:51.253 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14924/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:51.255 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773203631123782473,"ephemeral":false,"proof":""}]'
2026-03-11 04:33:51.256 DEBUG [src.steps.light_push] Checking that peer NODE_3:wakuorg/nwaku:latest can find the lightpushed message
2026-03-11 04:33:51.256 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58131/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:51.258 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773203631123782473,"ephemeral":false,"proof":""}]'
2026-03-11 04:33:51.260 DEBUG [src.steps.light_push] Checking that peer NODE_4:wakuorg/nwaku:latest can find the lightpushed message
2026-03-11 04:33:51.260 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53575/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:51.262 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773203631123782473,"ephemeral":false,"proof":""}]'
2026-03-11 04:33:51.264 DEBUG [src.steps.light_push] Checking that peer NODE_5:wakuorg/nwaku:latest can find the lightpushed message
2026-03-11 04:33:51.264 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61888/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:51.266 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773203631123782473,"ephemeral":false,"proof":""}]'
2026-03-11 04:33:51.267 DEBUG [src.steps.light_push] Checking that peer NODE_6:wakuorg/nwaku:latest can find the lightpushed message
2026-03-11 04:33:51.267 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:46118/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:51.270 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773203631123782473,"ephemeral":false,"proof":""}]'
2026-03-11 04:33:51.271 DEBUG [src.steps.light_push] Lightpushing message
2026-03-11 04:33:51.272 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53575/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/3/0", "message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "contentTopic": "/myapp/1/latest/proto", "timestamp": 1773203631271784468}}'
2026-03-11 04:33:51.291 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-11 04:33:51.292 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-11 04:33:51.393 DEBUG [src.steps.light_push] Checking that peer NODE_1:wakuorg/nwaku:latest can find the lightpushed message
2026-03-11 04:33:51.393 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:33718/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:51.396 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773203631271784468,"ephemeral":false,"proof":""}]'
2026-03-11 04:33:51.397 DEBUG [src.steps.light_push] Checking that peer NODE_2:wakuorg/nwaku:latest can find the lightpushed message
2026-03-11 04:33:51.397 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14924/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:51.399 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773203631271784468,"ephemeral":false,"proof":""}]'
2026-03-11 04:33:51.401 DEBUG [src.steps.light_push] Checking that peer NODE_3:wakuorg/nwaku:latest can find the lightpushed message
2026-03-11 04:33:51.401 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58131/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:51.403 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773203631271784468,"ephemeral":false,"proof":""}]'
2026-03-11 04:33:51.404 DEBUG [src.steps.light_push] Checking that peer NODE_4:wakuorg/nwaku:latest can find the lightpushed message
2026-03-11 04:33:51.405 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53575/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:51.407 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773203631271784468,"ephemeral":false,"proof":""}]'
2026-03-11 04:33:51.408 DEBUG [src.steps.light_push] Checking that peer NODE_5:wakuorg/nwaku:latest can find the lightpushed message
2026-03-11 04:33:51.408 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61888/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:51.411 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773203631271784468,"ephemeral":false,"proof":""}]'
2026-03-11 04:33:51.412 DEBUG [src.steps.light_push] Checking that peer NODE_6:wakuorg/nwaku:latest can find the lightpushed message
2026-03-11 04:33:51.412 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:46118/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:51.415 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773203631271784468,"ephemeral":false,"proof":""}]'
2026-03-11 04:33:51.416 DEBUG [src.steps.light_push] Lightpushing message
2026-03-11 04:33:51.416 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61888/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/3/0", "message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "contentTopic": "/myapp/1/latest/proto", "timestamp": 1773203631416663327}}'
2026-03-11 04:33:51.439 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-11 04:33:51.440 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-11 04:33:51.540 DEBUG [src.steps.light_push] Checking that peer NODE_1:wakuorg/nwaku:latest can find the lightpushed message
2026-03-11 04:33:51.540 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:33718/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:51.543 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773203631416663327,"ephemeral":false,"proof":""}]'
2026-03-11 04:33:51.545 DEBUG [src.steps.light_push] Checking that peer NODE_2:wakuorg/nwaku:latest can find the lightpushed message
2026-03-11 04:33:51.545 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14924/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:51.547 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773203631416663327,"ephemeral":false,"proof":""}]'
2026-03-11 04:33:51.549 DEBUG [src.steps.light_push] Checking that peer NODE_3:wakuorg/nwaku:latest can find the lightpushed message
2026-03-11 04:33:51.549 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58131/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:51.551 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773203631416663327,"ephemeral":false,"proof":""}]'
2026-03-11 04:33:51.553 DEBUG [src.steps.light_push] Checking that peer NODE_4:wakuorg/nwaku:latest can find the lightpushed message
2026-03-11 04:33:51.553 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53575/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:51.555 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773203631416663327,"ephemeral":false,"proof":""}]'
2026-03-11 04:33:51.557 DEBUG [src.steps.light_push] Checking that peer NODE_5:wakuorg/nwaku:latest can find the lightpushed message
2026-03-11 04:33:51.557 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61888/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:51.559 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773203631416663327,"ephemeral":false,"proof":""}]'
2026-03-11 04:33:51.561 DEBUG [src.steps.light_push] Checking that peer NODE_6:wakuorg/nwaku:latest can find the lightpushed message
2026-03-11 04:33:51.561 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:46118/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:51.563 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773203631416663327,"ephemeral":false,"proof":""}]'
2026-03-11 04:33:51.565 DEBUG [src.steps.light_push] Lightpushing message
2026-03-11 04:33:51.565 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:46118/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/3/0", "message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "contentTopic": "/myapp/1/latest/proto", "timestamp": 1773203631565461797}}'
2026-03-11 04:33:51.586 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-11 04:33:51.588 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-11 04:33:51.688 DEBUG [src.steps.light_push] Checking that peer NODE_1:wakuorg/nwaku:latest can find the lightpushed message
2026-03-11 04:33:51.688 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:33718/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:51.691 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773203631565461797,"ephemeral":false,"proof":""}]'
2026-03-11 04:33:51.692 DEBUG [src.steps.light_push] Checking that peer NODE_2:wakuorg/nwaku:latest can find the lightpushed message
2026-03-11 04:33:51.692 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14924/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:51.695 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773203631565461797,"ephemeral":false,"proof":""}]'
2026-03-11 04:33:51.696 DEBUG [src.steps.light_push] Checking that peer NODE_3:wakuorg/nwaku:latest can find the lightpushed message
2026-03-11 04:33:51.696 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58131/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:51.698 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773203631565461797,"ephemeral":false,"proof":""}]'
2026-03-11 04:33:51.700 DEBUG [src.steps.light_push] Checking that peer NODE_4:wakuorg/nwaku:latest can find the lightpushed message
2026-03-11 04:33:51.700 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53575/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:51.702 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773203631565461797,"ephemeral":false,"proof":""}]'
2026-03-11 04:33:51.703 DEBUG [src.steps.light_push] Checking that peer NODE_5:wakuorg/nwaku:latest can find the lightpushed message
2026-03-11 04:33:51.704 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61888/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:51.706 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773203631565461797,"ephemeral":false,"proof":""}]'
2026-03-11 04:33:51.707 DEBUG [src.steps.light_push] Checking that peer NODE_6:wakuorg/nwaku:latest can find the lightpushed message
2026-03-11 04:33:51.707 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:46118/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-11 04:33:51.710 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773203631565461797,"ephemeral":false,"proof":""}]'
2026-03-11 04:33:51.712 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-11 04:33:51.713 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-11 04:33:51.713 DEBUG [src.node.waku_node] Stopping container with id 9b68cd0edace
2026-03-11 04:33:52.303 DEBUG [src.node.waku_node] Container stopped.
2026-03-11 04:33:52.303 DEBUG [src.node.waku_node] Stopping container with id ebc47f0bfb97
2026-03-11 04:33:52.932 DEBUG [src.node.waku_node] Container stopped.
2026-03-11 04:33:52.933 DEBUG [src.node.waku_node] Stopping container with id f0065e3d01ef
2026-03-11 04:33:53.219 ERROR [src.node.docker_mananger] Max retries reached for container 9b68cd0edace. Exiting log stream.
2026-03-11 04:33:53.532 DEBUG [src.node.waku_node] Container stopped.
2026-03-11 04:33:53.535 DEBUG [src.node.waku_node] Stopping container with id f49fd6925156
2026-03-11 04:33:53.747 ERROR [src.node.docker_mananger] Max retries reached for container ebc47f0bfb97. Exiting log stream.
2026-03-11 04:33:54.104 DEBUG [src.node.waku_node] Container stopped.
2026-03-11 04:33:54.105 DEBUG [src.node.waku_node] Stopping container with id b48c8956fa7c
2026-03-11 04:33:54.393 ERROR [src.node.docker_mananger] Max retries reached for container f0065e3d01ef. Exiting log stream.
2026-03-11 04:33:54.675 DEBUG [src.node.waku_node] Container stopped.
2026-03-11 04:33:54.675 DEBUG [src.node.waku_node] Stopping container with id 45203d39c340
2026-03-11 04:33:54.959 ERROR [src.node.docker_mananger] Max retries reached for container f49fd6925156. Exiting log stream.
2026-03-11 04:33:55.211 DEBUG [src.node.waku_node] Container stopped.
2026-03-11 04:33:55.214 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-11 04:33:55.252 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-11 04:33:55.270 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-11 04:33:55.289 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-11 04:33:55.307 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-11 04:33:55.326 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-11 04:33:55.335 DEBUG [src.node.docker_mananger] No errors found in the waku logs.