124 lines
21 KiB
Plaintext

2026-03-05 04:38:48.774 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-05 04:38:48.775 DEBUG [tests.conftest] Running test: test_metrics_after_light_push with id: 2026-03-05_04-38-48__5fbae7c9-1007-4dce-a62a-39eb9202cc51
2026-03-05 04:38:48.775 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-05 04:38:48.775 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-03-05 04:38:48.776 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-03-05 04:38:48.776 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-05 04:38:48.776 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-05 04:38:48.783 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:38:48.783 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node1_2026-03-05_04-38-48__5fbae7c9-1007-4dce-a62a-39eb9202cc51__wakuorg_nwaku:latest.log
2026-03-05 04:38:48.784 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:38:48.784 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:38:48.785 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:38:48.785 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.164.78
2026-03-05 04:38:48.785 DEBUG [src.node.docker_mananger] Generated ports ['64708', '64709', '64710', '64711', '64712']
2026-03-05 04:38:48.786 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:38:48.786 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:38:48.786 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:38:48.786 DEBUG [src.node.docker_mananger] docker run -i -t -p 64708:64708 -p 64709:64709 -p 64710:64710 -p 64711:64711 -p 64712:64712 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=64710 --rest-port=64708 --tcp-port=64709 --discv5-udp-port=64711 --rest-address=0.0.0.0 --nat=extip:172.18.164.78 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=a55aa8f6a68e68b31a9cd8aa80aa8c560ef240c20ae4b9aa7cecc37f7e673bf6 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=64712 --metrics-logging=true --lightpush=true --relay=true
2026-03-05 04:38:48.977 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.164.78 waku 6f9ba02d996be8da3ab0819183bfcf05963723c442236df70f1c45bcebc945d2
2026-03-05 04:38:49.011 DEBUG [src.node.docker_mananger] Container started with ID 6f9ba02d996b. Setting up logs at ./log/docker/receiving_node1_2026-03-05_04-38-48__5fbae7c9-1007-4dce-a62a-39eb9202cc51__wakuorg_nwaku:latest.log
2026-03-05 04:38:49.012 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 64708
2026-03-05 04:38:49.012 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:38:49.019 ERROR [src.node.docker_mananger] Max retries reached for container dfcb281b4f03. Exiting log stream.
2026-03-05 04:38:49.528 ERROR [src.node.docker_mananger] Max retries reached for container f815b5040bdc. Exiting log stream.
2026-03-05 04:38:50.012 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64708/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:38:50.015 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:38:50.015 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:38:50.015 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64708/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:38:50.018 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.164.78/tcp/64709/p2p/16Uiu2HAmVGbkEKEgZQYWW7FGWwTnYppCms4yuc21xChEmWKU6cmC","/ip4/172.18.164.78/tcp/64710/ws/p2p/16Uiu2HAmVGbkEKEgZQYWW7FGWwTnYppCms4yuc21xChEmWKU6cmC"],"enrUri":"enr:-L24QGrkELl8Es9dPidgF5c4_o2F5gZ-m9yACvd59ZyRq-eCI_WVAH_YOPfXP-HwI3fbPhFsY1a00gWV_S9yutlgykQCgmlkgnY0gmlwhKwSpE6KbXVsdGlhZGRyc5YACASsEqROBvzFAAoErBKkTgb8xt0DgnJzhQADAQAAiXNlY3AyNTZrMaED9tpXSvwyu9vgEh_8NAyxECDHgRmFMUXFWlGHvQZfoueDdGNwgvzFg3VkcIL8x4V3YWt1Mgk"}'
2026-03-05 04:38:50.018 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:38:50.025 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:38:50.025 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node2_2026-03-05_04-38-48__5fbae7c9-1007-4dce-a62a-39eb9202cc51__wakuorg_nwaku:latest.log
2026-03-05 04:38:50.025 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:38:50.026 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:38:50.027 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:38:50.027 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.186.48
2026-03-05 04:38:50.027 DEBUG [src.node.docker_mananger] Generated ports ['63083', '63084', '63085', '63086', '63087']
2026-03-05 04:38:50.027 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:38:50.028 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:38:50.028 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:38:50.028 DEBUG [src.node.docker_mananger] docker run -i -t -p 63083:63083 -p 63084:63084 -p 63085:63085 -p 63086:63086 -p 63087:63087 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=63085 --rest-port=63083 --tcp-port=63084 --discv5-udp-port=63086 --rest-address=0.0.0.0 --nat=extip:172.18.186.48 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=e1ccc8d623f3fb4cc414fdbafc5e0c6cadbb1af19bbdd21cbc208add686bec5d --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=63087 --metrics-logging=true --lightpush=false --relay=true
2026-03-05 04:38:50.219 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.186.48 waku 3c7ef8812c72e20d9cb3e4834fa60dc17dc40f04ecefd0862f8d4aa19aa5a736
2026-03-05 04:38:50.257 DEBUG [src.node.docker_mananger] Container started with ID 3c7ef8812c72. Setting up logs at ./log/docker/receiving_node2_2026-03-05_04-38-48__5fbae7c9-1007-4dce-a62a-39eb9202cc51__wakuorg_nwaku:latest.log
2026-03-05 04:38:50.257 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 63083
2026-03-05 04:38:50.257 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:38:51.258 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63083/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:38:51.261 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:38:51.261 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:38:51.261 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63083/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:38:51.263 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.186.48/tcp/63084/p2p/16Uiu2HAmUQn56LHLTPN7JFvXHNy8GtN2tQ3kmf5Ttn2unGBqwmv6","/ip4/172.18.186.48/tcp/63085/ws/p2p/16Uiu2HAmUQn56LHLTPN7JFvXHNy8GtN2tQ3kmf5Ttn2unGBqwmv6"],"enrUri":"enr:-L24QLuQQhAaxAYQCRC7kMHxfa3QhsiBpeYSyzc2R6mJDTpwBoj5tO6TbdN0Ch7MevtJPIt2lVXU7wG4cE1xgpH_6ycCgmlkgnY0gmlwhKwSujCKbXVsdGlhZGRyc5YACASsErowBvZsAAoErBK6MAb2bd0DgnJzhQADAQAAiXNlY3AyNTZrMaED6hb5rJ8RZQ-Uc-3kzmIHLW5nIHhmEVFiHH6bsDNIbieDdGNwgvZsg3VkcIL2boV3YWt1MgE"}'
2026-03-05 04:38:51.264 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:38:51.264 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63083/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.164.78/tcp/64709/p2p/16Uiu2HAmVGbkEKEgZQYWW7FGWwTnYppCms4yuc21xChEmWKU6cmC"]'
2026-03-05 04:38:51.303 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:38:51.311 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:38:51.311 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/lightpush_node1_2026-03-05_04-38-48__5fbae7c9-1007-4dce-a62a-39eb9202cc51__wakuorg_nwaku:latest.log
2026-03-05 04:38:51.311 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:38:51.311 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:38:51.313 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:38:51.313 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.53.224
2026-03-05 04:38:51.313 DEBUG [src.node.docker_mananger] Generated ports ['40296', '40297', '40298', '40299', '40300']
2026-03-05 04:38:51.313 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:38:51.313 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:38:51.314 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:38:51.314 DEBUG [src.node.docker_mananger] docker run -i -t -p 40296:40296 -p 40297:40297 -p 40298:40298 -p 40299:40299 -p 40300:40300 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=40298 --rest-port=40296 --tcp-port=40297 --discv5-udp-port=40299 --rest-address=0.0.0.0 --nat=extip:172.18.53.224 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=1e5a798bed7bec30f898faceaa60b51f65c66eba0c5bb526b78b9f740a216675 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=40300 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QGrkELl8Es9dPidgF5c4_o2F5gZ-m9yACvd59ZyRq-eCI_WVAH_YOPfXP-HwI3fbPhFsY1a00gWV_S9yutlgykQCgmlkgnY0gmlwhKwSpE6KbXVsdGlhZGRyc5YACASsEqROBvzFAAoErBKkTgb8xt0DgnJzhQADAQAAiXNlY3AyNTZrMaED9tpXSvwyu9vgEh_8NAyxECDHgRmFMUXFWlGHvQZfoueDdGNwgvzFg3VkcIL8x4V3YWt1Mgk --lightpushnode=/ip4/172.18.164.78/tcp/64709/p2p/16Uiu2HAmVGbkEKEgZQYWW7FGWwTnYppCms4yuc21xChEmWKU6cmC --lightpush=true --relay=true
2026-03-05 04:38:51.515 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.53.224 waku 9378ea9fbed4406e4bff98b49120eccd3539d899227e7e3132b2e7c6d4cb036a
2026-03-05 04:38:51.548 DEBUG [src.node.docker_mananger] Container started with ID 9378ea9fbed4. Setting up logs at ./log/docker/lightpush_node1_2026-03-05_04-38-48__5fbae7c9-1007-4dce-a62a-39eb9202cc51__wakuorg_nwaku:latest.log
2026-03-05 04:38:51.549 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 40296
2026-03-05 04:38:51.549 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:38:52.550 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40296/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:38:52.559 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:38:52.560 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:38:52.562 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40296/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:38:52.581 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.53.224/tcp/40297/p2p/16Uiu2HAmMFp6wzjnozAvtwXfSLxwFMXZcWwSZeyVCTa2HGdeQvRM","/ip4/172.18.53.224/tcp/40298/ws/p2p/16Uiu2HAmMFp6wzjnozAvtwXfSLxwFMXZcWwSZeyVCTa2HGdeQvRM"],"enrUri":"enr:-L24QGvq5oLwGB03O5LnPlY1xyqiazCj_oLXXt5PZZWGDJLiWBei_kCfDQS5EzCdaAa3jXziybv4xd9IgcGQ_DNUD4kCgmlkgnY0gmlwhKwSNeCKbXVsdGlhZGRyc5YACASsEjXgBp1pAAoErBI14Aadat0DgnJzhQADAQAAiXNlY3AyNTZrMaEDf8k8s9Kpz1ZX1qQ6KsqwhJ9uKQwZ384vWhMENynLZiCDdGNwgp1pg3VkcIKda4V3YWt1Mgk"}'
2026-03-05 04:38:52.584 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:38:52.584 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:40296/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.164.78/tcp/64709/p2p/16Uiu2HAmVGbkEKEgZQYWW7FGWwTnYppCms4yuc21xChEmWKU6cmC"]'
2026-03-05 04:38:52.589 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:38:52.589 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:40296/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.186.48/tcp/63084/p2p/16Uiu2HAmUQn56LHLTPN7JFvXHNy8GtN2tQ3kmf5Ttn2unGBqwmv6"]'
2026-03-05 04:38:52.614 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:38:52.617 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:64708/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-05 04:38:52.628 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:38:52.628 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63083/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-05 04:38:52.636 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:38:52.637 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:40296/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-05 04:38:52.649 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:38:52.652 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:40296/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/3/1", "message": {"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": 1772685532652065618}}'
2026-03-05 04:38:52.669 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:38:52.670 DEBUG [src.libs.common] Sleeping for 0.5 seconds
2026-03-05 04:38:53.170 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64708/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:38:53.173 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772685532652065618,"ephemeral":false,"proof":""}]'
2026-03-05 04:38:53.173 DEBUG [src.libs.common] Sleeping for 5 seconds
2026-03-05 04:38:58.174 DEBUG [src.steps.metrics] Checking metric: waku_service_peers{protocol="/vac/waku/lightpush/2.0.0-beta1",peerId="/ip4/172.18.164.78/tcp/64709"} has 1
2026-03-05 04:38:58.179 DEBUG [src.steps.metrics] Found metric: waku_service_peers{protocol="/vac/waku/lightpush/2.0.0-beta1",peerId="/ip4/172.18.164.78/tcp/64709"} with value 1.0
2026-03-05 04:38:58.179 DEBUG [src.steps.metrics] Checking metric: libp2p_peers has 1
2026-03-05 04:38:58.182 DEBUG [src.steps.metrics] Found metric: libp2p_peers with value 2.0
2026-03-05 04:38:58.182 DEBUG [src.steps.metrics] Checking metric: waku_peer_store_size has 1
2026-03-05 04:38:58.186 DEBUG [src.steps.metrics] Found metric: waku_peer_store_size with value 2.0
2026-03-05 04:38:58.186 DEBUG [src.steps.metrics] Checking metric: libp2p_peers has 1
2026-03-05 04:38:58.190 DEBUG [src.steps.metrics] Found metric: libp2p_peers with value 2.0
2026-03-05 04:38:58.190 DEBUG [src.steps.metrics] Checking metric: libp2p_pubsub_peers has 1
2026-03-05 04:38:58.193 DEBUG [src.steps.metrics] Found metric: libp2p_pubsub_peers with value 2.0
2026-03-05 04:38:58.194 DEBUG [src.steps.metrics] Checking metric: libp2p_pubsub_topics has 1
2026-03-05 04:38:58.197 DEBUG [src.steps.metrics] Found metric: libp2p_pubsub_topics with value 2.0
2026-03-05 04:38:58.197 DEBUG [src.steps.metrics] Checking metric: libp2p_pubsub_subscriptions_total has 1
2026-03-05 04:38:58.200 DEBUG [src.steps.metrics] Found metric: libp2p_pubsub_subscriptions_total with value 2.0
2026-03-05 04:38:58.201 DEBUG [src.steps.metrics] Checking metric: waku_peer_store_size has 1
2026-03-05 04:38:58.204 DEBUG [src.steps.metrics] Found metric: waku_peer_store_size with value 2.0
2026-03-05 04:38:58.204 DEBUG [src.steps.metrics] Checking metric: waku_histogram_message_size_count has 1
2026-03-05 04:38:58.208 DEBUG [src.steps.metrics] Found metric: waku_histogram_message_size_count with value 1.0
2026-03-05 04:38:58.208 DEBUG [src.steps.metrics] Checking metric: waku_node_messages_total{type="relay"} has 1
2026-03-05 04:38:58.211 DEBUG [src.steps.metrics] Found metric: waku_node_messages_total{type="relay"} with value 1.0
2026-03-05 04:38:58.213 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-05 04:38:58.214 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-05 04:38:58.214 DEBUG [src.node.waku_node] Stopping container with id 6f9ba02d996b
2026-03-05 04:38:58.799 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:38:58.800 DEBUG [src.node.waku_node] Stopping container with id 3c7ef8812c72
2026-03-05 04:38:59.335 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:38:59.337 DEBUG [src.node.waku_node] Stopping container with id 9378ea9fbed4
2026-03-05 04:38:59.612 ERROR [src.node.docker_mananger] Max retries reached for container 6f9ba02d996b. Exiting log stream.
2026-03-05 04:38:59.849 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:38:59.850 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-05 04:38:59.861 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:38:59.879 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:38:59.889 DEBUG [src.node.docker_mananger] No errors found in the waku logs.