167 lines
32 KiB
Plaintext

2026-02-13 04:38:40.268 DEBUG [tests.conftest] Running fixture setup: test_id
2026-02-13 04:38:40.268 DEBUG [tests.conftest] Running test: test_all_nodes_subscribed_to_the_topic with id: 2026-02-13_04-38-40__3ab8d8a9-fdf3-4d5c-881e-70a0eef7d8dd
2026-02-13 04:38:40.269 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-02-13 04:38:40.269 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-02-13 04:38:40.270 DEBUG [src.steps.filter] Running fixture setup: setup_main_relay_node
2026-02-13 04:38:40.280 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-13 04:38:40.281 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-02-13_04-38-40__3ab8d8a9-fdf3-4d5c-881e-70a0eef7d8dd__wakuorg_nwaku:latest.log
2026-02-13 04:38:40.281 DEBUG [src.node.waku_node] Starting Node...
2026-02-13 04:38:40.282 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-13 04:38:40.284 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-13 04:38:40.285 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.173.206
2026-02-13 04:38:40.285 DEBUG [src.node.docker_mananger] Generated ports ['32070', '32071', '32072', '32073', '32074']
2026-02-13 04:38:40.285 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-13 04:38:40.285 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-13 04:38:40.286 DEBUG [src.node.waku_node] Using volumes []
2026-02-13 04:38:40.286 DEBUG [src.node.docker_mananger] docker run -i -t -p 32070:32070 -p 32071:32071 -p 32072:32072 -p 32073:32073 -p 32074:32074 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=32072 --rest-port=32070 --tcp-port=32071 --discv5-udp-port=32073 --rest-address=0.0.0.0 --nat=extip:172.18.173.206 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=e3a14b69f51a305466c4acae6d2ad4dee923c4421fc5fab52b56f19de75ec29b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=32074 --metrics-logging=true --relay=true --filter=true
2026-02-13 04:38:40.510 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.173.206 waku e1b32a7c5644c399f89d9680a46e6428c22ade425fa57799c35a35d8e652cb85
2026-02-13 04:38:40.559 DEBUG [src.node.docker_mananger] Container started with ID e1b32a7c5644. Setting up logs at ./log/docker/node1_2026-02-13_04-38-40__3ab8d8a9-fdf3-4d5c-881e-70a0eef7d8dd__wakuorg_nwaku:latest.log
2026-02-13 04:38:40.559 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 32070
2026-02-13 04:38:40.560 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-13 04:38:40.862 ERROR [src.node.docker_mananger] Max retries reached for container 2f5bc8f1ee51. Exiting log stream.
2026-02-13 04:38:41.257 ERROR [src.node.docker_mananger] Max retries reached for container 13b838f86e28. Exiting log stream.
2026-02-13 04:38:41.560 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32070/health" -H "Content-Type: application/json" -d 'None'
2026-02-13 04:38:41.563 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-02-13 04:38:41.564 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-13 04:38:41.564 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32070/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-13 04:38:41.566 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.173.206/tcp/32071/p2p/16Uiu2HAmTxksFT4daa7A84NJPAhMjbekJ1bjUVGmBjXgsbJynBBu","/ip4/172.18.173.206/tcp/32072/ws/p2p/16Uiu2HAmTxksFT4daa7A84NJPAhMjbekJ1bjUVGmBjXgsbJynBBu"],"enrUri":"enr:-L24QNo3R4mu0da506QComaer_EfcfbU46l7NORBV4JdejtNY36wUOdxMGw43YZInMcEDyJ9LjGDSPAVFLz8-gZkDh4CgmlkgnY0gmlwhKwSrc6KbXVsdGlhZGRyc5YACASsEq3OBn1HAAoErBKtzgZ9SN0DgnJzhQADAQAAiXNlY3AyNTZrMaED42yDPsJMWt6ipz2LFovL5oTR3rUGJVcx4lN_uYFqNoiDdGNwgn1Hg3VkcIJ9SYV3YWt1MgU"}'
2026-02-13 04:38:41.566 INFO [src.node.waku_node] REST service is ready !!
2026-02-13 04:38:41.567 DEBUG [src.steps.filter] Running fixture setup: setup_main_filter_node
2026-02-13 04:38:41.574 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-13 04:38:41.574 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-02-13_04-38-40__3ab8d8a9-fdf3-4d5c-881e-70a0eef7d8dd__wakuorg_nwaku:latest.log
2026-02-13 04:38:41.574 DEBUG [src.node.waku_node] Starting Node...
2026-02-13 04:38:41.574 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-13 04:38:41.576 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-13 04:38:41.576 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.4.163
2026-02-13 04:38:41.576 DEBUG [src.node.docker_mananger] Generated ports ['13048', '13049', '13050', '13051', '13052']
2026-02-13 04:38:41.576 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-13 04:38:41.576 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-13 04:38:41.576 DEBUG [src.node.waku_node] Using volumes []
2026-02-13 04:38:41.576 DEBUG [src.node.docker_mananger] docker run -i -t -p 13048:13048 -p 13049:13049 -p 13050:13050 -p 13051:13051 -p 13052:13052 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=13050 --rest-port=13048 --tcp-port=13049 --discv5-udp-port=13051 --rest-address=0.0.0.0 --nat=extip:172.18.4.163 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=27082cda5bf01dae0ee66f595c0a8a2610a58dd3b5c48dec5c961362efd7ea40 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=13052 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QNo3R4mu0da506QComaer_EfcfbU46l7NORBV4JdejtNY36wUOdxMGw43YZInMcEDyJ9LjGDSPAVFLz8-gZkDh4CgmlkgnY0gmlwhKwSrc6KbXVsdGlhZGRyc5YACASsEq3OBn1HAAoErBKtzgZ9SN0DgnJzhQADAQAAiXNlY3AyNTZrMaED42yDPsJMWt6ipz2LFovL5oTR3rUGJVcx4lN_uYFqNoiDdGNwgn1Hg3VkcIJ9SYV3YWt1MgU --filternode=/ip4/172.18.173.206/tcp/32071/p2p/16Uiu2HAmTxksFT4daa7A84NJPAhMjbekJ1bjUVGmBjXgsbJynBBu
2026-02-13 04:38:41.774 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.4.163 waku 4405e87e22ecd6df4669935d4760498be31cddf442255e3b7a3e1f8616ff1379
2026-02-13 04:38:41.823 DEBUG [src.node.docker_mananger] Container started with ID 4405e87e22ec. Setting up logs at ./log/docker/node2_2026-02-13_04-38-40__3ab8d8a9-fdf3-4d5c-881e-70a0eef7d8dd__wakuorg_nwaku:latest.log
2026-02-13 04:38:41.824 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 13048
2026-02-13 04:38:41.824 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-13 04:38:42.825 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13048/health" -H "Content-Type: application/json" -d 'None'
2026-02-13 04:38:42.830 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"}]}'
2026-02-13 04:38:42.830 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-13 04:38:42.830 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13048/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-13 04:38:42.833 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.4.163/tcp/13049/p2p/16Uiu2HAm2FjhPpX6HJW9kGNDmKyoFTXJ7Us7o3j5DMWUqYDgoQty","/ip4/172.18.4.163/tcp/13050/ws/p2p/16Uiu2HAm2FjhPpX6HJW9kGNDmKyoFTXJ7Us7o3j5DMWUqYDgoQty"],"enrUri":"enr:-L24QGm3YzEGnoqryCYidO3FV0TIuWwb-i91-eW4bUsvrH7PbBDVi8NOCF2TO6Kp2__NuaoEPxrqd84mh61aqDG6QdwCgmlkgnY0gmlwhKwSBKOKbXVsdGlhZGRyc5YACASsEgSjBjL5AAoErBIEowYy-t0DgnJzhQADAQAAiXNlY3AyNTZrMaECZXY0GPzRrqQ4mCQek_kbOaXiv7X3NLl7UvaJgEVfJOKDdGNwgjL5g3VkcIIy-4V3YWt1MgA"}'
2026-02-13 04:38:42.833 INFO [src.node.waku_node] REST service is ready !!
2026-02-13 04:38:42.833 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13048/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.173.206/tcp/32071/p2p/16Uiu2HAmTxksFT4daa7A84NJPAhMjbekJ1bjUVGmBjXgsbJynBBu"]'
2026-02-13 04:38:42.866 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-13 04:38:42.884 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-13 04:38:42.886 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-02-13_04-38-40__3ab8d8a9-fdf3-4d5c-881e-70a0eef7d8dd__wakuorg_nwaku:latest.log
2026-02-13 04:38:42.887 DEBUG [src.node.waku_node] Starting Node...
2026-02-13 04:38:42.888 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-13 04:38:42.890 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-13 04:38:42.890 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.187.125
2026-02-13 04:38:42.890 DEBUG [src.node.docker_mananger] Generated ports ['53361', '53362', '53363', '53364', '53365']
2026-02-13 04:38:42.891 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-13 04:38:42.891 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-13 04:38:42.891 DEBUG [src.node.waku_node] Using volumes []
2026-02-13 04:38:42.891 DEBUG [src.node.docker_mananger] docker run -i -t -p 53361:53361 -p 53362:53362 -p 53363:53363 -p 53364:53364 -p 53365:53365 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=53363 --rest-port=53361 --tcp-port=53362 --discv5-udp-port=53364 --rest-address=0.0.0.0 --nat=extip:172.18.187.125 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ddddf07ae5c45f436efa96f5c4f30c3f86bcbcb76dc9c5f1bfacdfbaf2f0eef8 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=53365 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QNo3R4mu0da506QComaer_EfcfbU46l7NORBV4JdejtNY36wUOdxMGw43YZInMcEDyJ9LjGDSPAVFLz8-gZkDh4CgmlkgnY0gmlwhKwSrc6KbXVsdGlhZGRyc5YACASsEq3OBn1HAAoErBKtzgZ9SN0DgnJzhQADAQAAiXNlY3AyNTZrMaED42yDPsJMWt6ipz2LFovL5oTR3rUGJVcx4lN_uYFqNoiDdGNwgn1Hg3VkcIJ9SYV3YWt1MgU --filternode=/ip4/172.18.173.206/tcp/32071/p2p/16Uiu2HAmTxksFT4daa7A84NJPAhMjbekJ1bjUVGmBjXgsbJynBBu
2026-02-13 04:38:43.087 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.187.125 waku afaa67c3c0c279ca45ffa042362d1f6aa3b154812b794aa87120cdf8c3141d45
2026-02-13 04:38:43.133 DEBUG [src.node.docker_mananger] Container started with ID afaa67c3c0c2. Setting up logs at ./log/docker/node3_2026-02-13_04-38-40__3ab8d8a9-fdf3-4d5c-881e-70a0eef7d8dd__wakuorg_nwaku:latest.log
2026-02-13 04:38:43.133 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 53361
2026-02-13 04:38:43.134 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-13 04:38:44.134 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53361/health" -H "Content-Type: application/json" -d 'None'
2026-02-13 04:38:44.138 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"}]}'
2026-02-13 04:38:44.138 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-13 04:38:44.139 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53361/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-13 04:38:44.141 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.187.125/tcp/53362/p2p/16Uiu2HAmLmJP2PFHzdT5FeuBFvXTJubHGQ8q78EJpHB3xiodr1TX","/ip4/172.18.187.125/tcp/53363/ws/p2p/16Uiu2HAmLmJP2PFHzdT5FeuBFvXTJubHGQ8q78EJpHB3xiodr1TX"],"enrUri":"enr:-L24QEYcvAkkxPrKX28lPXFGjDqjZrGbUlbz5wL0-BpnBX5lS-AEmqSIDi_DCc362OM6oEZRTjfiRFnm7-UFDDrWs40CgmlkgnY0gmlwhKwSu32KbXVsdGlhZGRyc5YACASsErt9BtByAAoErBK7fQbQc90DgnJzhQADAQAAiXNlY3AyNTZrMaEDeHtd41BrT10DZvbkqW0QvR7YqVUcaWtq5bZqWBXpMGqDdGNwgtByg3VkcILQdIV3YWt1MgA"}'
2026-02-13 04:38:44.141 INFO [src.node.waku_node] REST service is ready !!
2026-02-13 04:38:44.141 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53361/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.173.206/tcp/32071/p2p/16Uiu2HAmTxksFT4daa7A84NJPAhMjbekJ1bjUVGmBjXgsbJynBBu"]'
2026-02-13 04:38:44.172 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-13 04:38:44.184 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-13 04:38:44.184 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-02-13_04-38-40__3ab8d8a9-fdf3-4d5c-881e-70a0eef7d8dd__wakuorg_nwaku:latest.log
2026-02-13 04:38:44.185 DEBUG [src.node.waku_node] Starting Node...
2026-02-13 04:38:44.185 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-13 04:38:44.189 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-13 04:38:44.190 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.225.43
2026-02-13 04:38:44.190 DEBUG [src.node.docker_mananger] Generated ports ['8024', '8025', '8026', '8027', '8028']
2026-02-13 04:38:44.190 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-13 04:38:44.191 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-13 04:38:44.192 DEBUG [src.node.waku_node] Using volumes []
2026-02-13 04:38:44.192 DEBUG [src.node.docker_mananger] docker run -i -t -p 8024:8024 -p 8025:8025 -p 8026:8026 -p 8027:8027 -p 8028:8028 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=8026 --rest-port=8024 --tcp-port=8025 --discv5-udp-port=8027 --rest-address=0.0.0.0 --nat=extip:172.18.225.43 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=46e67c156e897fd9dacf753efe3caabaf247bbe6e2c8cdcba5300dfe679dd4bd --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=8028 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QNo3R4mu0da506QComaer_EfcfbU46l7NORBV4JdejtNY36wUOdxMGw43YZInMcEDyJ9LjGDSPAVFLz8-gZkDh4CgmlkgnY0gmlwhKwSrc6KbXVsdGlhZGRyc5YACASsEq3OBn1HAAoErBKtzgZ9SN0DgnJzhQADAQAAiXNlY3AyNTZrMaED42yDPsJMWt6ipz2LFovL5oTR3rUGJVcx4lN_uYFqNoiDdGNwgn1Hg3VkcIJ9SYV3YWt1MgU --filternode=/ip4/172.18.173.206/tcp/32071/p2p/16Uiu2HAmTxksFT4daa7A84NJPAhMjbekJ1bjUVGmBjXgsbJynBBu
2026-02-13 04:38:44.393 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.225.43 waku 43c4c0eefd9aae9831f4f0c7f8dee2219cba8c40b6ef5eb1da033829c87b357b
2026-02-13 04:38:44.440 DEBUG [src.node.docker_mananger] Container started with ID 43c4c0eefd9a. Setting up logs at ./log/docker/node4_2026-02-13_04-38-40__3ab8d8a9-fdf3-4d5c-881e-70a0eef7d8dd__wakuorg_nwaku:latest.log
2026-02-13 04:38:44.441 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 8024
2026-02-13 04:38:44.441 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-13 04:38:45.442 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:8024/health" -H "Content-Type: application/json" -d 'None'
2026-02-13 04:38:45.446 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"}]}'
2026-02-13 04:38:45.446 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-13 04:38:45.447 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:8024/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-13 04:38:45.449 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.225.43/tcp/8025/p2p/16Uiu2HAm94vsKJ5y3ef37D11EV6KkoUgZfAfLdD7MjUo1YuGkQ2K","/ip4/172.18.225.43/tcp/8026/ws/p2p/16Uiu2HAm94vsKJ5y3ef37D11EV6KkoUgZfAfLdD7MjUo1YuGkQ2K"],"enrUri":"enr:-L24QO0mdcQHLjoUUOPTQSqRggdQe-jO0P_Eid8_4svxWna7CUF7t2yYySI8He48HBHOVLHiYdjEJ-wBFG_h8JNnwswCgmlkgnY0gmlwhKwS4SuKbXVsdGlhZGRyc5YACASsEuErBh9ZAAoErBLhKwYfWt0DgnJzhQADAQAAiXNlY3AyNTZrMaECyrNBFxf33sHq-lWY6fMW-rmQffEYX0-mnOQmlrw9EXCDdGNwgh9Zg3VkcIIfW4V3YWt1MgA"}'
2026-02-13 04:38:45.449 INFO [src.node.waku_node] REST service is ready !!
2026-02-13 04:38:45.450 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:8024/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.173.206/tcp/32071/p2p/16Uiu2HAmTxksFT4daa7A84NJPAhMjbekJ1bjUVGmBjXgsbJynBBu"]'
2026-02-13 04:38:45.484 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-13 04:38:45.493 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-13 04:38:45.494 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-02-13_04-38-40__3ab8d8a9-fdf3-4d5c-881e-70a0eef7d8dd__wakuorg_nwaku:latest.log
2026-02-13 04:38:45.494 DEBUG [src.node.waku_node] Starting Node...
2026-02-13 04:38:45.494 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-13 04:38:45.497 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-13 04:38:45.497 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.217.152
2026-02-13 04:38:45.497 DEBUG [src.node.docker_mananger] Generated ports ['41573', '41574', '41575', '41576', '41577']
2026-02-13 04:38:45.498 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-13 04:38:45.498 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-13 04:38:45.498 DEBUG [src.node.waku_node] Using volumes []
2026-02-13 04:38:45.498 DEBUG [src.node.docker_mananger] docker run -i -t -p 41573:41573 -p 41574:41574 -p 41575:41575 -p 41576:41576 -p 41577:41577 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=41575 --rest-port=41573 --tcp-port=41574 --discv5-udp-port=41576 --rest-address=0.0.0.0 --nat=extip:172.18.217.152 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=0fa39dafceea69898cfae0ebb1580ded94f4b21efbed8ece2efe4b32bdb659e0 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=41577 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QNo3R4mu0da506QComaer_EfcfbU46l7NORBV4JdejtNY36wUOdxMGw43YZInMcEDyJ9LjGDSPAVFLz8-gZkDh4CgmlkgnY0gmlwhKwSrc6KbXVsdGlhZGRyc5YACASsEq3OBn1HAAoErBKtzgZ9SN0DgnJzhQADAQAAiXNlY3AyNTZrMaED42yDPsJMWt6ipz2LFovL5oTR3rUGJVcx4lN_uYFqNoiDdGNwgn1Hg3VkcIJ9SYV3YWt1MgU --filternode=/ip4/172.18.173.206/tcp/32071/p2p/16Uiu2HAmTxksFT4daa7A84NJPAhMjbekJ1bjUVGmBjXgsbJynBBu
2026-02-13 04:38:45.696 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.217.152 waku a39a3a161bc48a8b3ecc3fa3f686cd9079dfa3b9c691a73b91cbb99cd4d6dec7
2026-02-13 04:38:45.743 DEBUG [src.node.docker_mananger] Container started with ID a39a3a161bc4. Setting up logs at ./log/docker/node5_2026-02-13_04-38-40__3ab8d8a9-fdf3-4d5c-881e-70a0eef7d8dd__wakuorg_nwaku:latest.log
2026-02-13 04:38:45.744 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 41573
2026-02-13 04:38:45.744 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-13 04:38:46.745 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:41573/health" -H "Content-Type: application/json" -d 'None'
2026-02-13 04:38:46.748 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"}]}'
2026-02-13 04:38:46.749 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-13 04:38:46.749 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:41573/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-13 04:38:46.751 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.217.152/tcp/41574/p2p/16Uiu2HAm43wgyxAgpogvFiYJHdNh4MqBC77GzC9D6gPZ91GYBxAw","/ip4/172.18.217.152/tcp/41575/ws/p2p/16Uiu2HAm43wgyxAgpogvFiYJHdNh4MqBC77GzC9D6gPZ91GYBxAw"],"enrUri":"enr:-L24QKgYOIT9aSHd-5Rtw9hmQHAAAwGqWXSFS1oI7ObatKk-fFBmoq0t6g2Iw-FUBvueEwZ79v-lOtw1emo32W-g1IYCgmlkgnY0gmlwhKwS2ZiKbXVsdGlhZGRyc5YACASsEtmYBqJmAAoErBLZmAaiZ90DgnJzhQADAQAAiXNlY3AyNTZrMaECgCgrBrBUkt34122h-O8qbF09XPjs8Uw8SAeBx6uHZ9yDdGNwgqJmg3VkcIKiaIV3YWt1MgA"}'
2026-02-13 04:38:46.751 INFO [src.node.waku_node] REST service is ready !!
2026-02-13 04:38:46.752 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:41573/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.173.206/tcp/32071/p2p/16Uiu2HAmTxksFT4daa7A84NJPAhMjbekJ1bjUVGmBjXgsbJynBBu"]'
2026-02-13 04:38:46.787 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-13 04:38:46.787 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32070/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-13 04:38:46.792 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-13 04:38:46.795 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13048/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "e7efe5eb-2b88-4a76-ac36-d7d4ba11cc79", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-02-13 04:38:46.807 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"e7efe5eb-2b88-4a76-ac36-d7d4ba11cc79","statusDesc":"OK"}'
2026-02-13 04:38:46.809 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53361/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "43143040-7db8-4ccc-a2ff-a7849c13147b", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-02-13 04:38:46.819 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"43143040-7db8-4ccc-a2ff-a7849c13147b","statusDesc":"OK"}'
2026-02-13 04:38:46.819 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:8024/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "47263592-df5c-4323-8f40-dbcd22fa43c3", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-02-13 04:38:46.829 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"47263592-df5c-4323-8f40-dbcd22fa43c3","statusDesc":"OK"}'
2026-02-13 04:38:46.830 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:41573/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "d9c52075-1b32-4815-9387-2134b0945f1a", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-02-13 04:38:46.842 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"d9c52075-1b32-4815-9387-2134b0945f1a","statusDesc":"OK"}'
2026-02-13 04:38:46.842 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32070/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-13 04:38:46.860 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-13 04:38:46.861 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-02-13 04:38:46.961 DEBUG [src.steps.filter] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-02-13 04:38:46.962 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13048/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-02-13 04:38:46.964 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1770957526842637136,"ephemeral":false}]'
2026-02-13 04:38:46.965 DEBUG [src.steps.filter] Checking that peer NODE_3:wakuorg/nwaku:latest can find the published message
2026-02-13 04:38:46.966 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53361/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-02-13 04:38:46.968 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1770957526842637136,"ephemeral":false}]'
2026-02-13 04:38:46.970 DEBUG [src.steps.filter] Checking that peer NODE_4:wakuorg/nwaku:latest can find the published message
2026-02-13 04:38:46.970 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:8024/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-02-13 04:38:46.972 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1770957526842637136,"ephemeral":false}]'
2026-02-13 04:38:46.974 DEBUG [src.steps.filter] Checking that peer NODE_5:wakuorg/nwaku:latest can find the published message
2026-02-13 04:38:46.974 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:41573/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-02-13 04:38:46.976 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1770957526842637136,"ephemeral":false}]'
2026-02-13 04:38:46.979 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-02-13 04:38:46.980 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-02-13 04:38:46.980 DEBUG [src.node.waku_node] Stopping container with id e1b32a7c5644
2026-02-13 04:38:47.273 DEBUG [src.node.waku_node] Container stopped.
2026-02-13 04:38:47.273 DEBUG [src.node.waku_node] Stopping container with id 4405e87e22ec
2026-02-13 04:38:47.535 DEBUG [src.node.waku_node] Container stopped.
2026-02-13 04:38:47.536 DEBUG [src.node.waku_node] Stopping container with id afaa67c3c0c2
2026-02-13 04:38:47.800 DEBUG [src.node.waku_node] Container stopped.
2026-02-13 04:38:47.801 DEBUG [src.node.waku_node] Stopping container with id 43c4c0eefd9a
2026-02-13 04:38:48.054 DEBUG [src.node.waku_node] Container stopped.
2026-02-13 04:38:48.054 DEBUG [src.node.waku_node] Stopping container with id a39a3a161bc4
2026-02-13 04:38:48.143 ERROR [src.node.docker_mananger] Max retries reached for container e1b32a7c5644. Exiting log stream.
2026-02-13 04:38:48.309 DEBUG [src.node.waku_node] Container stopped.
2026-02-13 04:38:48.311 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-02-13 04:38:48.337 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-13 04:38:48.346 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-13 04:38:48.355 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-13 04:38:48.359 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-13 04:38:48.365 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-13 04:38:48.371 ERROR [src.node.docker_mananger] Max retries reached for container 4405e87e22ec. Exiting log stream.