276 lines
51 KiB
Plaintext

2026-04-23 21:57:37.911 DEBUG [tests.conftest] Running fixture setup: test_id
2026-04-23 21:57:37.911 DEBUG [tests.conftest] Running test: test_multiple_lightpush_nodes with id: 2026-04-23_21-57-37__7b4d4bb0-5568-405a-87d5-9167ba380950
2026-04-23 21:57:37.911 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-04-23 21:57:37.912 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-04-23 21:57:37.918 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 21:57:37.919 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node1_2026-04-23_21-57-37__7b4d4bb0-5568-405a-87d5-9167ba380950__wakuorg_nwaku:latest.log
2026-04-23 21:57:37.919 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 21:57:37.919 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 21:57:37.920 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 21:57:37.920 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.133.29
2026-04-23 21:57:37.921 DEBUG [src.node.docker_mananger] Generated ports ['11396', '11397', '11398', '11399', '11400']
2026-04-23 21:57:37.921 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 21:57:37.921 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 21:57:37.921 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 21:57:37.921 DEBUG [src.node.docker_mananger] docker run -i -t -p 11396:11396 -p 11397:11397 -p 11398:11398 -p 11399:11399 -p 11400:11400 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=11398 --rest-port=11396 --tcp-port=11397 --discv5-udp-port=11399 --rest-address=0.0.0.0 --nat=extip:172.18.133.29 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=f98e8447f41a8b3091dad5f68fd229cbf2aa94a733fbabafd2fa1fed9beefb9a --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=11400 --metrics-logging=true --lightpush=true --relay=true
2026-04-23 21:57:38.108 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.133.29 waku 3a92f8424a071bcbaf128cbba9ea033a68d44c7612ef53f1d4a1aed78eefb334
2026-04-23 21:57:38.145 DEBUG [src.node.docker_mananger] Container started with ID 3a92f8424a07. Setting up logs at ./log/docker/receiving_node1_2026-04-23_21-57-37__7b4d4bb0-5568-405a-87d5-9167ba380950__wakuorg_nwaku:latest.log
2026-04-23 21:57:38.146 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 11396
2026-04-23 21:57:38.147 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 21:57:38.262 ERROR [src.node.docker_mananger] Max retries reached for container ec4b47e74ec8. Exiting log stream.
2026-04-23 21:57:38.719 ERROR [src.node.docker_mananger] Max retries reached for container 1b34503348e9. Exiting log stream.
2026-04-23 21:57:39.147 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11396/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:39.150 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 21:57:39.150 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 21:57:39.151 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11396/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:39.153 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.133.29/tcp/11397/p2p/16Uiu2HAm7yDMaesxjR7LzA6Y5Qh5eVQigJM2bB47mxpadt47JBRu","/ip4/172.18.133.29/tcp/11398/ws/p2p/16Uiu2HAm7yDMaesxjR7LzA6Y5Qh5eVQigJM2bB47mxpadt47JBRu"],"enrUri":"enr:-L24QDV9N9SvgJJs90kfN_8QB98Lks4jpbItRRjCuFtn5q2rWeouFZFCDmM3FxsWmCEC42_ViYhQFMzqSpr8zM8v3ogCgmlkgnY0gmlwhKwShR2KbXVsdGlhZGRyc5YACASsEoUdBiyFAAoErBKFHQYsht0DgnJzhQDGAQAAiXNlY3AyNTZrMaECumC5iYYZxiUFQJNkXMFhIRIc8c0IIg6mJ_GfB-lWcLSDdGNwgiyFg3VkcIIsh4V3YWt1Mgk"}'
2026-04-23 21:57:39.153 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 21:57:39.160 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 21:57:39.160 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node2_2026-04-23_21-57-37__7b4d4bb0-5568-405a-87d5-9167ba380950__wakuorg_nwaku:latest.log
2026-04-23 21:57:39.160 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 21:57:39.160 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 21:57:39.162 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 21:57:39.162 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.27.0
2026-04-23 21:57:39.162 DEBUG [src.node.docker_mananger] Generated ports ['47996', '47997', '47998', '47999', '48000']
2026-04-23 21:57:39.162 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 21:57:39.162 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 21:57:39.162 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 21:57:39.163 DEBUG [src.node.docker_mananger] docker run -i -t -p 47996:47996 -p 47997:47997 -p 47998:47998 -p 47999:47999 -p 48000:48000 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=47998 --rest-port=47996 --tcp-port=47997 --discv5-udp-port=47999 --rest-address=0.0.0.0 --nat=extip:172.18.27.0 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=fb2f8b672e91ca3e2c62c8aaa3d797327bd7d3c6a9c8867b84770eca8ae5d433 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=48000 --metrics-logging=true --lightpush=false --relay=true
2026-04-23 21:57:39.349 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.27.0 waku 266d190596e47dcd7aab819300e9ca8fddd662e5578f12a40211e4b8a0a92eb4
2026-04-23 21:57:39.382 DEBUG [src.node.docker_mananger] Container started with ID 266d190596e4. Setting up logs at ./log/docker/receiving_node2_2026-04-23_21-57-37__7b4d4bb0-5568-405a-87d5-9167ba380950__wakuorg_nwaku:latest.log
2026-04-23 21:57:39.382 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 47996
2026-04-23 21:57:39.383 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 21:57:40.383 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:47996/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:40.386 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 21:57:40.387 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 21:57:40.387 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:47996/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:40.389 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.27.0/tcp/47997/p2p/16Uiu2HAmDftoYAJHfMhmBhfUGH9nWhcQqtRVQt6TMPevX3JAQ8aZ","/ip4/172.18.27.0/tcp/47998/ws/p2p/16Uiu2HAmDftoYAJHfMhmBhfUGH9nWhcQqtRVQt6TMPevX3JAQ8aZ"],"enrUri":"enr:-L24QDZd--2yhl9kBbCnOTK-BfE36fa6apK9CZU4RXaLGSRVHWRIy7gVEs6F2t0DNJaCOJKb4XBZ0gf6rAwwHJ0AM3oCgmlkgnY0gmlwhKwSGwCKbXVsdGlhZGRyc5YACASsEhsABrt9AAoErBIbAAa7ft0DgnJzhQDGAQAAiXNlY3AyNTZrMaEDDxb-xrFfApt1gTQmZRGtAJknZLeVpGncRQOzS_EZ-N6DdGNwgrt9g3VkcIK7f4V3YWt1MgE"}'
2026-04-23 21:57:40.390 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 21:57:40.390 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:47996/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.133.29/tcp/11397/p2p/16Uiu2HAm7yDMaesxjR7LzA6Y5Qh5eVQigJM2bB47mxpadt47JBRu"]'
2026-04-23 21:57:40.419 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 21:57:40.428 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 21:57:40.428 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/lightpush_node1_2026-04-23_21-57-37__7b4d4bb0-5568-405a-87d5-9167ba380950__wakuorg_nwaku:latest.log
2026-04-23 21:57:40.429 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 21:57:40.429 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 21:57:40.433 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 21:57:40.434 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.248.170
2026-04-23 21:57:40.434 DEBUG [src.node.docker_mananger] Generated ports ['24091', '24092', '24093', '24094', '24095']
2026-04-23 21:57:40.434 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 21:57:40.434 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 21:57:40.435 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 21:57:40.435 DEBUG [src.node.docker_mananger] docker run -i -t -p 24091:24091 -p 24092:24092 -p 24093:24093 -p 24094:24094 -p 24095:24095 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=24093 --rest-port=24091 --tcp-port=24092 --discv5-udp-port=24094 --rest-address=0.0.0.0 --nat=extip:172.18.248.170 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=7ebd88b20edaf4b203df49facdea4121784efdd2cd08661092cab7804ce836ad --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=24095 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QDV9N9SvgJJs90kfN_8QB98Lks4jpbItRRjCuFtn5q2rWeouFZFCDmM3FxsWmCEC42_ViYhQFMzqSpr8zM8v3ogCgmlkgnY0gmlwhKwShR2KbXVsdGlhZGRyc5YACASsEoUdBiyFAAoErBKFHQYsht0DgnJzhQDGAQAAiXNlY3AyNTZrMaECumC5iYYZxiUFQJNkXMFhIRIc8c0IIg6mJ_GfB-lWcLSDdGNwgiyFg3VkcIIsh4V3YWt1Mgk --lightpushnode=/ip4/172.18.133.29/tcp/11397/p2p/16Uiu2HAm7yDMaesxjR7LzA6Y5Qh5eVQigJM2bB47mxpadt47JBRu --lightpush=true --relay=true
2026-04-23 21:57:40.626 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.248.170 waku 265c1b0eae18c7db5ca45eb6b868bc16ef4a8c13c321e73c310c019cf9fd223a
2026-04-23 21:57:40.658 DEBUG [src.node.docker_mananger] Container started with ID 265c1b0eae18. Setting up logs at ./log/docker/lightpush_node1_2026-04-23_21-57-37__7b4d4bb0-5568-405a-87d5-9167ba380950__wakuorg_nwaku:latest.log
2026-04-23 21:57:40.659 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 24091
2026-04-23 21:57:40.659 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 21:57:41.659 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24091/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:41.662 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 21:57:41.663 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 21:57:41.663 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24091/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:41.665 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.248.170/tcp/24092/p2p/16Uiu2HAm1WSD57VaL6Vu2ut1LHJm1NYcUSwqbkvn9JWDVqUCiRXM","/ip4/172.18.248.170/tcp/24093/ws/p2p/16Uiu2HAm1WSD57VaL6Vu2ut1LHJm1NYcUSwqbkvn9JWDVqUCiRXM"],"enrUri":"enr:-L24QBCIhzyVevbiHKvpZcEs4q_w05qM8ELLTa_5C-zOEmjuBeOVASOz-0pxjwldvXxU1Wi1YNt4o7br4qaAaDUlW-8CgmlkgnY0gmlwhKwS-KqKbXVsdGlhZGRyc5YACASsEviqBl4cAAoErBL4qgZeHd0DgnJzhQDGAQAAiXNlY3AyNTZrMaECWl50YVGmIh_CQIJilA1HjHH5RVRgGVaq0F_X8pF1bjiDdGNwgl4cg3VkcIJeHoV3YWt1Mgk"}'
2026-04-23 21:57:41.666 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 21:57:41.666 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24091/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.133.29/tcp/11397/p2p/16Uiu2HAm7yDMaesxjR7LzA6Y5Qh5eVQigJM2bB47mxpadt47JBRu"]'
2026-04-23 21:57:41.694 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 21:57:41.694 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24091/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.27.0/tcp/47997/p2p/16Uiu2HAmDftoYAJHfMhmBhfUGH9nWhcQqtRVQt6TMPevX3JAQ8aZ"]'
2026-04-23 21:57:41.732 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 21:57:41.743 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 21:57:41.743 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/lightpush_node2_2026-04-23_21-57-37__7b4d4bb0-5568-405a-87d5-9167ba380950__wakuorg_nwaku:latest.log
2026-04-23 21:57:41.743 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 21:57:41.743 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 21:57:41.745 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 21:57:41.745 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.84.71
2026-04-23 21:57:41.745 DEBUG [src.node.docker_mananger] Generated ports ['63043', '63044', '63045', '63046', '63047']
2026-04-23 21:57:41.745 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 21:57:41.745 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 21:57:41.745 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 21:57:41.745 DEBUG [src.node.docker_mananger] docker run -i -t -p 63043:63043 -p 63044:63044 -p 63045:63045 -p 63046:63046 -p 63047:63047 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=63045 --rest-port=63043 --tcp-port=63044 --discv5-udp-port=63046 --rest-address=0.0.0.0 --nat=extip:172.18.84.71 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=e8f53b51650f21f8eb44e1d0d8f5f88da4df21d84d0cc8cded76efc9ab29ae10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=63047 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QDV9N9SvgJJs90kfN_8QB98Lks4jpbItRRjCuFtn5q2rWeouFZFCDmM3FxsWmCEC42_ViYhQFMzqSpr8zM8v3ogCgmlkgnY0gmlwhKwShR2KbXVsdGlhZGRyc5YACASsEoUdBiyFAAoErBKFHQYsht0DgnJzhQDGAQAAiXNlY3AyNTZrMaECumC5iYYZxiUFQJNkXMFhIRIc8c0IIg6mJ_GfB-lWcLSDdGNwgiyFg3VkcIIsh4V3YWt1Mgk --lightpushnode=/ip4/172.18.133.29/tcp/11397/p2p/16Uiu2HAm7yDMaesxjR7LzA6Y5Qh5eVQigJM2bB47mxpadt47JBRu --lightpush=true --relay=true
2026-04-23 21:57:41.941 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.84.71 waku d91cdeadc1916862037cc3a7da47669b51137cf1d960009a7c677cafaa04c038
2026-04-23 21:57:41.981 DEBUG [src.node.docker_mananger] Container started with ID d91cdeadc191. Setting up logs at ./log/docker/lightpush_node2_2026-04-23_21-57-37__7b4d4bb0-5568-405a-87d5-9167ba380950__wakuorg_nwaku:latest.log
2026-04-23 21:57:41.982 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 63043
2026-04-23 21:57:41.982 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 21:57:42.983 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63043/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:42.986 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 21:57:42.986 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 21:57:42.987 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63043/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:42.989 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.84.71/tcp/63044/p2p/16Uiu2HAmHVzgQBhnH9p5Wtay3e9rSpLK9qqhX7msju7A2ujQXcpv","/ip4/172.18.84.71/tcp/63045/ws/p2p/16Uiu2HAmHVzgQBhnH9p5Wtay3e9rSpLK9qqhX7msju7A2ujQXcpv"],"enrUri":"enr:-L24QFG4uZN6JyLKVGDtNkZ-z39H7IxBzE-v4qyWUGNo-f2-AlvfLNKy2vRE--mDIYaU3JXiowd2buaHAXE64yGMwAwCgmlkgnY0gmlwhKwSVEeKbXVsdGlhZGRyc5YACASsElRHBvZEAAoErBJURwb2Rd0DgnJzhQDGAQAAiXNlY3AyNTZrMaEDR_yUdQTK634TWZABDUDU1kg2aq9n73dqsDA5nGIjdKeDdGNwgvZEg3VkcIL2RoV3YWt1Mgk"}'
2026-04-23 21:57:42.989 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 21:57:42.990 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63043/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.133.29/tcp/11397/p2p/16Uiu2HAm7yDMaesxjR7LzA6Y5Qh5eVQigJM2bB47mxpadt47JBRu"]'
2026-04-23 21:57:43.034 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 21:57:43.034 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63043/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.27.0/tcp/47997/p2p/16Uiu2HAmDftoYAJHfMhmBhfUGH9nWhcQqtRVQt6TMPevX3JAQ8aZ"]'
2026-04-23 21:57:43.068 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 21:57:43.080 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 21:57:43.080 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/lightpush_node3_2026-04-23_21-57-37__7b4d4bb0-5568-405a-87d5-9167ba380950__wakuorg_nwaku:latest.log
2026-04-23 21:57:43.081 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 21:57:43.083 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 21:57:43.086 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 21:57:43.086 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.67.75
2026-04-23 21:57:43.086 DEBUG [src.node.docker_mananger] Generated ports ['18139', '18140', '18141', '18142', '18143']
2026-04-23 21:57:43.087 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 21:57:43.087 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 21:57:43.087 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 21:57:43.087 DEBUG [src.node.docker_mananger] docker run -i -t -p 18139:18139 -p 18140:18140 -p 18141:18141 -p 18142:18142 -p 18143:18143 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=18141 --rest-port=18139 --tcp-port=18140 --discv5-udp-port=18142 --rest-address=0.0.0.0 --nat=extip:172.18.67.75 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=4662b276acd584e8de8b0dfdab6ffcd9fdfb981f70f2abfb8469f195bd5bd3ad --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=18143 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QDV9N9SvgJJs90kfN_8QB98Lks4jpbItRRjCuFtn5q2rWeouFZFCDmM3FxsWmCEC42_ViYhQFMzqSpr8zM8v3ogCgmlkgnY0gmlwhKwShR2KbXVsdGlhZGRyc5YACASsEoUdBiyFAAoErBKFHQYsht0DgnJzhQDGAQAAiXNlY3AyNTZrMaECumC5iYYZxiUFQJNkXMFhIRIc8c0IIg6mJ_GfB-lWcLSDdGNwgiyFg3VkcIIsh4V3YWt1Mgk --lightpushnode=/ip4/172.18.133.29/tcp/11397/p2p/16Uiu2HAm7yDMaesxjR7LzA6Y5Qh5eVQigJM2bB47mxpadt47JBRu --lightpush=true --relay=true
2026-04-23 21:57:43.293 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.67.75 waku e95344fdac179d6d54f9c81bd535cfb9bbfac24b07171dadd89637481b4ad4dc
2026-04-23 21:57:43.326 DEBUG [src.node.docker_mananger] Container started with ID e95344fdac17. Setting up logs at ./log/docker/lightpush_node3_2026-04-23_21-57-37__7b4d4bb0-5568-405a-87d5-9167ba380950__wakuorg_nwaku:latest.log
2026-04-23 21:57:43.327 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 18139
2026-04-23 21:57:43.327 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 21:57:44.327 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18139/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:44.330 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 21:57:44.331 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 21:57:44.331 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18139/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:44.333 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.67.75/tcp/18140/p2p/16Uiu2HAmKp2ivx2wqS2S8rubVhVwBsXWDCud5AxkhFNjRRrCMZxN","/ip4/172.18.67.75/tcp/18141/ws/p2p/16Uiu2HAmKp2ivx2wqS2S8rubVhVwBsXWDCud5AxkhFNjRRrCMZxN"],"enrUri":"enr:-L24QNfapBxFQIdBAfNbXpJydzjcYkbFdZBhPYKkohB_s7VNL3Xi6E6HUHEu3IbwkgMENCLabZHpEEtFsavexIE71h8CgmlkgnY0gmlwhKwSQ0uKbXVsdGlhZGRyc5YACASsEkNLBkbcAAoErBJDSwZG3d0DgnJzhQDGAQAAiXNlY3AyNTZrMaEDalK4FJVH-Vs7gioDHruZhxci6Ett629JdOf_8cy6dXuDdGNwgkbcg3VkcIJG3oV3YWt1Mgk"}'
2026-04-23 21:57:44.334 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 21:57:44.334 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:18139/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.133.29/tcp/11397/p2p/16Uiu2HAm7yDMaesxjR7LzA6Y5Qh5eVQigJM2bB47mxpadt47JBRu"]'
2026-04-23 21:57:44.383 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 21:57:44.383 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:18139/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.27.0/tcp/47997/p2p/16Uiu2HAmDftoYAJHfMhmBhfUGH9nWhcQqtRVQt6TMPevX3JAQ8aZ"]'
2026-04-23 21:57:44.412 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 21:57:44.432 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 21:57:44.432 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/lightpush_node4_2026-04-23_21-57-37__7b4d4bb0-5568-405a-87d5-9167ba380950__wakuorg_nwaku:latest.log
2026-04-23 21:57:44.432 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 21:57:44.433 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 21:57:44.436 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 21:57:44.436 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.162.16
2026-04-23 21:57:44.436 DEBUG [src.node.docker_mananger] Generated ports ['44610', '44611', '44612', '44613', '44614']
2026-04-23 21:57:44.437 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 21:57:44.437 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 21:57:44.437 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 21:57:44.439 DEBUG [src.node.docker_mananger] docker run -i -t -p 44610:44610 -p 44611:44611 -p 44612:44612 -p 44613:44613 -p 44614:44614 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=44612 --rest-port=44610 --tcp-port=44611 --discv5-udp-port=44613 --rest-address=0.0.0.0 --nat=extip:172.18.162.16 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=aa82bd55a0c48ec37a9bc76f5cd7c538aecdac1ffce7ebfb5f46a172caefb4c2 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=44614 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QDV9N9SvgJJs90kfN_8QB98Lks4jpbItRRjCuFtn5q2rWeouFZFCDmM3FxsWmCEC42_ViYhQFMzqSpr8zM8v3ogCgmlkgnY0gmlwhKwShR2KbXVsdGlhZGRyc5YACASsEoUdBiyFAAoErBKFHQYsht0DgnJzhQDGAQAAiXNlY3AyNTZrMaECumC5iYYZxiUFQJNkXMFhIRIc8c0IIg6mJ_GfB-lWcLSDdGNwgiyFg3VkcIIsh4V3YWt1Mgk --lightpushnode=/ip4/172.18.133.29/tcp/11397/p2p/16Uiu2HAm7yDMaesxjR7LzA6Y5Qh5eVQigJM2bB47mxpadt47JBRu --lightpush=true --relay=true
2026-04-23 21:57:44.630 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.162.16 waku 2208eafff3c8a90f53c5873e3dfe2d1b5a950a33912c161671e2f65e37c370c2
2026-04-23 21:57:44.670 DEBUG [src.node.docker_mananger] Container started with ID 2208eafff3c8. Setting up logs at ./log/docker/lightpush_node4_2026-04-23_21-57-37__7b4d4bb0-5568-405a-87d5-9167ba380950__wakuorg_nwaku:latest.log
2026-04-23 21:57:44.671 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 44610
2026-04-23 21:57:44.671 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 21:57:45.672 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44610/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:45.675 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 21:57:45.675 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 21:57:45.676 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44610/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:45.678 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.162.16/tcp/44611/p2p/16Uiu2HAm77h3ekhRMPusCCb2pojeNt7PSGNokTLnrmK7VzYg3W7x","/ip4/172.18.162.16/tcp/44612/ws/p2p/16Uiu2HAm77h3ekhRMPusCCb2pojeNt7PSGNokTLnrmK7VzYg3W7x"],"enrUri":"enr:-L24QB1sudfE38Su-v8axkG8Zr3Ft8hHvAbC-hAfGywmaIZcd2_zu7q4Un4TllpzMbKKuwfCeRBm6pWTx0vCDNK7HWkCgmlkgnY0gmlwhKwSohCKbXVsdGlhZGRyc5YACASsEqIQBq5DAAoErBKiEAauRN0DgnJzhQDGAQAAiXNlY3AyNTZrMaECrbD-lbh63dmimqgubODUHgx1TmyEOVVC6X0oKKJUWweDdGNwgq5Dg3VkcIKuRYV3YWt1Mgk"}'
2026-04-23 21:57:45.678 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 21:57:45.679 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44610/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.133.29/tcp/11397/p2p/16Uiu2HAm7yDMaesxjR7LzA6Y5Qh5eVQigJM2bB47mxpadt47JBRu"]'
2026-04-23 21:57:45.722 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 21:57:45.722 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44610/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.27.0/tcp/47997/p2p/16Uiu2HAmDftoYAJHfMhmBhfUGH9nWhcQqtRVQt6TMPevX3JAQ8aZ"]'
2026-04-23 21:57:45.756 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 21:57:45.760 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11396/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/0"]'
2026-04-23 21:57:45.766 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 21:57:45.767 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:47996/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/0"]'
2026-04-23 21:57:45.772 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 21:57:45.773 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24091/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/0"]'
2026-04-23 21:57:45.778 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 21:57:45.779 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63043/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/0"]'
2026-04-23 21:57:45.783 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 21:57:45.784 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:18139/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/0"]'
2026-04-23 21:57:45.788 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 21:57:45.788 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44610/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/0"]'
2026-04-23 21:57:45.797 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 21:57:45.798 DEBUG [src.steps.light_push] Lightpushing message
2026-04-23 21:57:45.798 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24091/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/198/0", "message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "contentTopic": "/myapp/1/latest/proto", "timestamp": 1776981465798038339}}'
2026-04-23 21:57:45.820 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 21:57:45.821 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-04-23 21:57:45.922 DEBUG [src.steps.light_push] Checking that peer NODE_1:wakuorg/nwaku:latest can find the lightpushed message
2026-04-23 21:57:45.922 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11396/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:45.925 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981465798038339,"ephemeral":false,"proof":""}]'
2026-04-23 21:57:45.928 DEBUG [src.steps.light_push] Checking that peer NODE_2:wakuorg/nwaku:latest can find the lightpushed message
2026-04-23 21:57:45.928 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:47996/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:45.930 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981465798038339,"ephemeral":false,"proof":""}]'
2026-04-23 21:57:45.932 DEBUG [src.steps.light_push] Checking that peer NODE_3:wakuorg/nwaku:latest can find the lightpushed message
2026-04-23 21:57:45.932 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24091/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:45.934 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981465798038339,"ephemeral":false,"proof":""}]'
2026-04-23 21:57:45.935 DEBUG [src.steps.light_push] Checking that peer NODE_4:wakuorg/nwaku:latest can find the lightpushed message
2026-04-23 21:57:45.936 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63043/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:45.938 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981465798038339,"ephemeral":false,"proof":""}]'
2026-04-23 21:57:45.939 DEBUG [src.steps.light_push] Checking that peer NODE_5:wakuorg/nwaku:latest can find the lightpushed message
2026-04-23 21:57:45.939 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18139/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:45.942 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981465798038339,"ephemeral":false,"proof":""}]'
2026-04-23 21:57:45.943 DEBUG [src.steps.light_push] Checking that peer NODE_6:wakuorg/nwaku:latest can find the lightpushed message
2026-04-23 21:57:45.943 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44610/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:45.945 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981465798038339,"ephemeral":false,"proof":""}]'
2026-04-23 21:57:45.947 DEBUG [src.steps.light_push] Lightpushing message
2026-04-23 21:57:45.947 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63043/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/198/0", "message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "contentTopic": "/myapp/1/latest/proto", "timestamp": 1776981465947401037}}'
2026-04-23 21:57:45.967 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 21:57:45.968 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-04-23 21:57:46.068 DEBUG [src.steps.light_push] Checking that peer NODE_1:wakuorg/nwaku:latest can find the lightpushed message
2026-04-23 21:57:46.068 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11396/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:46.071 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981465947401037,"ephemeral":false,"proof":""}]'
2026-04-23 21:57:46.072 DEBUG [src.steps.light_push] Checking that peer NODE_2:wakuorg/nwaku:latest can find the lightpushed message
2026-04-23 21:57:46.072 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:47996/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:46.075 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981465947401037,"ephemeral":false,"proof":""}]'
2026-04-23 21:57:46.076 DEBUG [src.steps.light_push] Checking that peer NODE_3:wakuorg/nwaku:latest can find the lightpushed message
2026-04-23 21:57:46.076 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24091/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:46.078 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981465947401037,"ephemeral":false,"proof":""}]'
2026-04-23 21:57:46.080 DEBUG [src.steps.light_push] Checking that peer NODE_4:wakuorg/nwaku:latest can find the lightpushed message
2026-04-23 21:57:46.080 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63043/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:46.082 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981465947401037,"ephemeral":false,"proof":""}]'
2026-04-23 21:57:46.083 DEBUG [src.steps.light_push] Checking that peer NODE_5:wakuorg/nwaku:latest can find the lightpushed message
2026-04-23 21:57:46.083 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18139/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:46.085 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981465947401037,"ephemeral":false,"proof":""}]'
2026-04-23 21:57:46.087 DEBUG [src.steps.light_push] Checking that peer NODE_6:wakuorg/nwaku:latest can find the lightpushed message
2026-04-23 21:57:46.087 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44610/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:46.089 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981465947401037,"ephemeral":false,"proof":""}]'
2026-04-23 21:57:46.091 DEBUG [src.steps.light_push] Lightpushing message
2026-04-23 21:57:46.091 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:18139/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/198/0", "message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "contentTopic": "/myapp/1/latest/proto", "timestamp": 1776981466091259433}}'
2026-04-23 21:57:46.113 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 21:57:46.114 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-04-23 21:57:46.214 DEBUG [src.steps.light_push] Checking that peer NODE_1:wakuorg/nwaku:latest can find the lightpushed message
2026-04-23 21:57:46.214 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11396/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:46.217 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981466091259433,"ephemeral":false,"proof":""}]'
2026-04-23 21:57:46.218 DEBUG [src.steps.light_push] Checking that peer NODE_2:wakuorg/nwaku:latest can find the lightpushed message
2026-04-23 21:57:46.219 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:47996/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:46.221 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981466091259433,"ephemeral":false,"proof":""}]'
2026-04-23 21:57:46.222 DEBUG [src.steps.light_push] Checking that peer NODE_3:wakuorg/nwaku:latest can find the lightpushed message
2026-04-23 21:57:46.222 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24091/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:46.225 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981466091259433,"ephemeral":false,"proof":""}]'
2026-04-23 21:57:46.226 DEBUG [src.steps.light_push] Checking that peer NODE_4:wakuorg/nwaku:latest can find the lightpushed message
2026-04-23 21:57:46.227 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63043/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:46.229 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981466091259433,"ephemeral":false,"proof":""}]'
2026-04-23 21:57:46.230 DEBUG [src.steps.light_push] Checking that peer NODE_5:wakuorg/nwaku:latest can find the lightpushed message
2026-04-23 21:57:46.230 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18139/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:46.233 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981466091259433,"ephemeral":false,"proof":""}]'
2026-04-23 21:57:46.234 DEBUG [src.steps.light_push] Checking that peer NODE_6:wakuorg/nwaku:latest can find the lightpushed message
2026-04-23 21:57:46.234 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44610/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:46.236 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981466091259433,"ephemeral":false,"proof":""}]'
2026-04-23 21:57:46.238 DEBUG [src.steps.light_push] Lightpushing message
2026-04-23 21:57:46.238 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44610/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/198/0", "message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "contentTopic": "/myapp/1/latest/proto", "timestamp": 1776981466238398787}}'
2026-04-23 21:57:46.262 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 21:57:46.263 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-04-23 21:57:46.367 DEBUG [src.steps.light_push] Checking that peer NODE_1:wakuorg/nwaku:latest can find the lightpushed message
2026-04-23 21:57:46.368 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11396/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:46.370 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981466238398787,"ephemeral":false,"proof":""}]'
2026-04-23 21:57:46.372 DEBUG [src.steps.light_push] Checking that peer NODE_2:wakuorg/nwaku:latest can find the lightpushed message
2026-04-23 21:57:46.372 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:47996/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:46.375 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981466238398787,"ephemeral":false,"proof":""}]'
2026-04-23 21:57:46.376 DEBUG [src.steps.light_push] Checking that peer NODE_3:wakuorg/nwaku:latest can find the lightpushed message
2026-04-23 21:57:46.376 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24091/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:46.378 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981466238398787,"ephemeral":false,"proof":""}]'
2026-04-23 21:57:46.380 DEBUG [src.steps.light_push] Checking that peer NODE_4:wakuorg/nwaku:latest can find the lightpushed message
2026-04-23 21:57:46.380 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63043/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:46.382 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981466238398787,"ephemeral":false,"proof":""}]'
2026-04-23 21:57:46.383 DEBUG [src.steps.light_push] Checking that peer NODE_5:wakuorg/nwaku:latest can find the lightpushed message
2026-04-23 21:57:46.384 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18139/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:46.386 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981466238398787,"ephemeral":false,"proof":""}]'
2026-04-23 21:57:46.387 DEBUG [src.steps.light_push] Checking that peer NODE_6:wakuorg/nwaku:latest can find the lightpushed message
2026-04-23 21:57:46.387 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44610/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F0" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:57:46.390 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1776981466238398787,"ephemeral":false,"proof":""}]'
2026-04-23 21:57:46.392 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-04-23 21:57:46.393 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-04-23 21:57:46.393 DEBUG [src.node.waku_node] Stopping container with id 3a92f8424a07
2026-04-23 21:57:46.888 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 21:57:46.889 DEBUG [src.node.waku_node] Stopping container with id 266d190596e4
2026-04-23 21:57:47.383 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 21:57:47.389 DEBUG [src.node.waku_node] Stopping container with id 265c1b0eae18
2026-04-23 21:57:47.707 ERROR [src.node.docker_mananger] Max retries reached for container 3a92f8424a07. Exiting log stream.
2026-04-23 21:57:47.878 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 21:57:47.881 DEBUG [src.node.waku_node] Stopping container with id d91cdeadc191
2026-04-23 21:57:48.199 ERROR [src.node.docker_mananger] Max retries reached for container 266d190596e4. Exiting log stream.
2026-04-23 21:57:48.336 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 21:57:48.337 DEBUG [src.node.waku_node] Stopping container with id e95344fdac17
2026-04-23 21:57:48.693 ERROR [src.node.docker_mananger] Max retries reached for container 265c1b0eae18. Exiting log stream.
2026-04-23 21:57:48.759 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 21:57:48.760 DEBUG [src.node.waku_node] Stopping container with id 2208eafff3c8
2026-04-23 21:57:49.152 ERROR [src.node.docker_mananger] Max retries reached for container d91cdeadc191. Exiting log stream.
2026-04-23 21:57:49.205 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 21:57:49.207 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-04-23 21:57:49.233 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 21:57:49.259 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 21:57:49.271 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 21:57:49.284 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 21:57:49.296 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 21:57:49.309 DEBUG [src.node.docker_mananger] No errors found in the waku logs.