124 lines
21 KiB
Plaintext

2026-02-27 04:38:57.933 DEBUG [tests.conftest] Running fixture setup: test_id
2026-02-27 04:38:57.934 DEBUG [tests.conftest] Running test: test_metrics_after_light_push with id: 2026-02-27_04-38-57__20210766-d5ce-4c20-b247-bef8ef0291fd
2026-02-27 04:38:57.935 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-02-27 04:38:57.935 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-02-27 04:38:57.936 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-02-27 04:38:57.936 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-02-27 04:38:57.937 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-02-27 04:38:57.948 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-27 04:38:57.948 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node1_2026-02-27_04-38-57__20210766-d5ce-4c20-b247-bef8ef0291fd__wakuorg_nwaku:latest.log
2026-02-27 04:38:57.948 DEBUG [src.node.waku_node] Starting Node...
2026-02-27 04:38:57.949 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-27 04:38:57.951 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-27 04:38:57.951 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.30.191
2026-02-27 04:38:57.951 DEBUG [src.node.docker_mananger] Generated ports ['63210', '63211', '63212', '63213', '63214']
2026-02-27 04:38:57.951 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-27 04:38:57.952 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-27 04:38:57.952 DEBUG [src.node.waku_node] Using volumes []
2026-02-27 04:38:57.952 DEBUG [src.node.docker_mananger] docker run -i -t -p 63210:63210 -p 63211:63211 -p 63212:63212 -p 63213:63213 -p 63214:63214 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=63212 --rest-port=63210 --tcp-port=63211 --discv5-udp-port=63213 --rest-address=0.0.0.0 --nat=extip:172.18.30.191 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=442d9c1fefe7ec9d2ddaad29ba7192cdaca5d695f3ca69f355e96f2fb63c2554 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=63214 --metrics-logging=true --lightpush=true --relay=true
2026-02-27 04:38:58.087 ERROR [src.node.docker_mananger] Max retries reached for container 9254b9d35935. Exiting log stream.
2026-02-27 04:38:58.162 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.30.191 waku 58e9e4f719174a0a26d2ae35bdbd8b0e2fcab7034f2ed573de14f293964245d0
2026-02-27 04:38:58.198 DEBUG [src.node.docker_mananger] Container started with ID 58e9e4f71917. Setting up logs at ./log/docker/receiving_node1_2026-02-27_04-38-57__20210766-d5ce-4c20-b247-bef8ef0291fd__wakuorg_nwaku:latest.log
2026-02-27 04:38:58.199 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 63210
2026-02-27 04:38:58.200 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-27 04:38:58.779 ERROR [src.node.docker_mananger] Max retries reached for container 984bfd260b52. Exiting log stream.
2026-02-27 04:38:59.200 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63210/health" -H "Content-Type: application/json" -d 'None'
2026-02-27 04:38:59.203 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-27 04:38:59.204 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-27 04:38:59.204 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63210/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-27 04:38:59.206 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.30.191/tcp/63211/p2p/16Uiu2HAmPqoQFNaft1k9YLBA2xX2PLFd11ZQtkrUmKKKfvTxmjSb","/ip4/172.18.30.191/tcp/63212/ws/p2p/16Uiu2HAmPqoQFNaft1k9YLBA2xX2PLFd11ZQtkrUmKKKfvTxmjSb"],"enrUri":"enr:-L24QDqSKkS-neEGINIDud1lEkf9yPMNsSFaP4IRDYNP81INKwpzhhN2op9CXAtkcBmLMpGxy336V9bJK1uqvhrnM3ICgmlkgnY0gmlwhKwSHr-KbXVsdGlhZGRyc5YACASsEh6_BvbrAAoErBIevwb27N0DgnJzhQADAQAAiXNlY3AyNTZrMaEDpjWQpdKwYTDks3GcaKNQ06ML5eedKZY9EhSAfgtS5YSDdGNwgvbrg3VkcIL27YV3YWt1Mgk"}'
2026-02-27 04:38:59.207 INFO [src.node.waku_node] REST service is ready !!
2026-02-27 04:38:59.215 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-27 04:38:59.215 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node2_2026-02-27_04-38-57__20210766-d5ce-4c20-b247-bef8ef0291fd__wakuorg_nwaku:latest.log
2026-02-27 04:38:59.215 DEBUG [src.node.waku_node] Starting Node...
2026-02-27 04:38:59.215 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-27 04:38:59.217 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-27 04:38:59.217 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.27.96
2026-02-27 04:38:59.217 DEBUG [src.node.docker_mananger] Generated ports ['14405', '14406', '14407', '14408', '14409']
2026-02-27 04:38:59.217 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-27 04:38:59.217 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-27 04:38:59.217 DEBUG [src.node.waku_node] Using volumes []
2026-02-27 04:38:59.217 DEBUG [src.node.docker_mananger] docker run -i -t -p 14405:14405 -p 14406:14406 -p 14407:14407 -p 14408:14408 -p 14409:14409 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=14407 --rest-port=14405 --tcp-port=14406 --discv5-udp-port=14408 --rest-address=0.0.0.0 --nat=extip:172.18.27.96 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=15e7bab1cda4d1ff9a3e457fce5060de56d44dacdadfe1fcffdd4d4aa953248b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=14409 --metrics-logging=true --lightpush=false --relay=true
2026-02-27 04:38:59.419 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.27.96 waku 74ffcdec1e694f25c82501e0a8a7e02ceb132d36eed9f907c9437dcf9e248342
2026-02-27 04:38:59.456 DEBUG [src.node.docker_mananger] Container started with ID 74ffcdec1e69. Setting up logs at ./log/docker/receiving_node2_2026-02-27_04-38-57__20210766-d5ce-4c20-b247-bef8ef0291fd__wakuorg_nwaku:latest.log
2026-02-27 04:38:59.457 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 14405
2026-02-27 04:38:59.458 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-27 04:39:00.458 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14405/health" -H "Content-Type: application/json" -d 'None'
2026-02-27 04:39:00.461 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-27 04:39:00.461 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-27 04:39:00.462 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14405/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-27 04:39:00.464 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.27.96/tcp/14406/p2p/16Uiu2HAm243qyT8FEHWSTGu714Th1fkjeeQ8CxhQZwUbYu893bZT","/ip4/172.18.27.96/tcp/14407/ws/p2p/16Uiu2HAm243qyT8FEHWSTGu714Th1fkjeeQ8CxhQZwUbYu893bZT"],"enrUri":"enr:-L24QNyJZ5yzGWIXrLE1Xc1Ll0sHzYhitP3slQkOxnaJaZI8JGey5VxiX7H-zQ9YasL1almv_sW1Bg3uNEYv4lkEZugCgmlkgnY0gmlwhKwSG2CKbXVsdGlhZGRyc5YACASsEhtgBjhGAAoErBIbYAY4R90DgnJzhQADAQAAiXNlY3AyNTZrMaECYnfA9CaGpDgp3Kwf-Zz0IPoejWQau8Jb0xCeuzFXjNKDdGNwgjhGg3VkcII4SIV3YWt1MgE"}'
2026-02-27 04:39:00.465 INFO [src.node.waku_node] REST service is ready !!
2026-02-27 04:39:00.465 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14405/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.30.191/tcp/63211/p2p/16Uiu2HAmPqoQFNaft1k9YLBA2xX2PLFd11ZQtkrUmKKKfvTxmjSb"]'
2026-02-27 04:39:00.505 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-27 04:39:00.518 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-27 04:39:00.518 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/lightpush_node1_2026-02-27_04-38-57__20210766-d5ce-4c20-b247-bef8ef0291fd__wakuorg_nwaku:latest.log
2026-02-27 04:39:00.518 DEBUG [src.node.waku_node] Starting Node...
2026-02-27 04:39:00.518 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-27 04:39:00.520 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-27 04:39:00.520 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.130.123
2026-02-27 04:39:00.520 DEBUG [src.node.docker_mananger] Generated ports ['20696', '20697', '20698', '20699', '20700']
2026-02-27 04:39:00.520 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-27 04:39:00.521 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-27 04:39:00.521 DEBUG [src.node.waku_node] Using volumes []
2026-02-27 04:39:00.521 DEBUG [src.node.docker_mananger] docker run -i -t -p 20696:20696 -p 20697:20697 -p 20698:20698 -p 20699:20699 -p 20700:20700 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=20698 --rest-port=20696 --tcp-port=20697 --discv5-udp-port=20699 --rest-address=0.0.0.0 --nat=extip:172.18.130.123 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=dda898d0eadbb6a9e7daef7d3eaceeefeeabe6f38d2f532e0833df0af87c711c --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=20700 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QDqSKkS-neEGINIDud1lEkf9yPMNsSFaP4IRDYNP81INKwpzhhN2op9CXAtkcBmLMpGxy336V9bJK1uqvhrnM3ICgmlkgnY0gmlwhKwSHr-KbXVsdGlhZGRyc5YACASsEh6_BvbrAAoErBIevwb27N0DgnJzhQADAQAAiXNlY3AyNTZrMaEDpjWQpdKwYTDks3GcaKNQ06ML5eedKZY9EhSAfgtS5YSDdGNwgvbrg3VkcIL27YV3YWt1Mgk --lightpushnode=/ip4/172.18.30.191/tcp/63211/p2p/16Uiu2HAmPqoQFNaft1k9YLBA2xX2PLFd11ZQtkrUmKKKfvTxmjSb --lightpush=true --relay=true
2026-02-27 04:39:00.750 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.130.123 waku 1e38de901113a6d80696edb466c2a864feea1f9169550e0bf96b71e9bbffcef3
2026-02-27 04:39:00.795 DEBUG [src.node.docker_mananger] Container started with ID 1e38de901113. Setting up logs at ./log/docker/lightpush_node1_2026-02-27_04-38-57__20210766-d5ce-4c20-b247-bef8ef0291fd__wakuorg_nwaku:latest.log
2026-02-27 04:39:00.796 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 20696
2026-02-27 04:39:00.796 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-27 04:39:01.798 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20696/health" -H "Content-Type: application/json" -d 'None'
2026-02-27 04:39:01.806 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-27 04:39:01.807 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-27 04:39:01.810 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20696/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-27 04:39:01.830 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.130.123/tcp/20697/p2p/16Uiu2HAkyQopKuVAjorhxGYUPkua7Kk1KtQDX5heJ2ZkRm64nNcg","/ip4/172.18.130.123/tcp/20698/ws/p2p/16Uiu2HAkyQopKuVAjorhxGYUPkua7Kk1KtQDX5heJ2ZkRm64nNcg"],"enrUri":"enr:-L24QGHkPIfZKPfFPHcdKjqMa-apqBmJLf4EXWoTxJ4lpUL2ASTSzTc3E6aiJwCmk-pcia32WuCYOTV_EpSKQxAvLykCgmlkgnY0gmlwhKwSgnuKbXVsdGlhZGRyc5YACASsEoJ7BlDZAAoErBKCewZQ2t0DgnJzhQADAQAAiXNlY3AyNTZrMaECOzYHKSnV5ryTI_-L8Bf7VZC4mnbRQoTeWyam-7MlnmGDdGNwglDZg3VkcIJQ24V3YWt1Mgk"}'
2026-02-27 04:39:01.831 INFO [src.node.waku_node] REST service is ready !!
2026-02-27 04:39:01.831 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20696/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.30.191/tcp/63211/p2p/16Uiu2HAmPqoQFNaft1k9YLBA2xX2PLFd11ZQtkrUmKKKfvTxmjSb"]'
2026-02-27 04:39:01.839 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-27 04:39:01.840 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20696/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.27.96/tcp/14406/p2p/16Uiu2HAm243qyT8FEHWSTGu714Th1fkjeeQ8CxhQZwUbYu893bZT"]'
2026-02-27 04:39:01.862 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-27 04:39:01.863 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63210/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-27 04:39:01.876 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-27 04:39:01.877 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14405/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-27 04:39:01.886 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-27 04:39:01.888 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20696/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-27 04:39:01.900 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-27 04:39:01.905 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20696/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/3/1", "message": {"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": 1772167141904926211}}'
2026-02-27 04:39:01.922 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-27 04:39:01.924 DEBUG [src.libs.common] Sleeping for 0.5 seconds
2026-02-27 04:39:02.424 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63210/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-02-27 04:39:02.427 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772167141904926211,"ephemeral":false,"proof":""}]'
2026-02-27 04:39:02.427 DEBUG [src.libs.common] Sleeping for 5 seconds
2026-02-27 04:39:07.428 DEBUG [src.steps.metrics] Checking metric: waku_service_peers{protocol="/vac/waku/lightpush/2.0.0-beta1",peerId="/ip4/172.18.30.191/tcp/63211"} has 1
2026-02-27 04:39:07.434 DEBUG [src.steps.metrics] Found metric: waku_service_peers{protocol="/vac/waku/lightpush/2.0.0-beta1",peerId="/ip4/172.18.30.191/tcp/63211"} with value 1.0
2026-02-27 04:39:07.434 DEBUG [src.steps.metrics] Checking metric: libp2p_peers has 1
2026-02-27 04:39:07.438 DEBUG [src.steps.metrics] Found metric: libp2p_peers with value 2.0
2026-02-27 04:39:07.438 DEBUG [src.steps.metrics] Checking metric: waku_peer_store_size has 1
2026-02-27 04:39:07.441 DEBUG [src.steps.metrics] Found metric: waku_peer_store_size with value 2.0
2026-02-27 04:39:07.442 DEBUG [src.steps.metrics] Checking metric: libp2p_peers has 1
2026-02-27 04:39:07.446 DEBUG [src.steps.metrics] Found metric: libp2p_peers with value 2.0
2026-02-27 04:39:07.446 DEBUG [src.steps.metrics] Checking metric: libp2p_pubsub_peers has 1
2026-02-27 04:39:07.449 DEBUG [src.steps.metrics] Found metric: libp2p_pubsub_peers with value 2.0
2026-02-27 04:39:07.450 DEBUG [src.steps.metrics] Checking metric: libp2p_pubsub_topics has 1
2026-02-27 04:39:07.453 DEBUG [src.steps.metrics] Found metric: libp2p_pubsub_topics with value 2.0
2026-02-27 04:39:07.454 DEBUG [src.steps.metrics] Checking metric: libp2p_pubsub_subscriptions_total has 1
2026-02-27 04:39:07.457 DEBUG [src.steps.metrics] Found metric: libp2p_pubsub_subscriptions_total with value 2.0
2026-02-27 04:39:07.457 DEBUG [src.steps.metrics] Checking metric: waku_peer_store_size has 1
2026-02-27 04:39:07.461 DEBUG [src.steps.metrics] Found metric: waku_peer_store_size with value 2.0
2026-02-27 04:39:07.461 DEBUG [src.steps.metrics] Checking metric: waku_histogram_message_size_count has 1
2026-02-27 04:39:07.464 DEBUG [src.steps.metrics] Found metric: waku_histogram_message_size_count with value 1.0
2026-02-27 04:39:07.465 DEBUG [src.steps.metrics] Checking metric: waku_node_messages_total{type="relay"} has 1
2026-02-27 04:39:07.468 DEBUG [src.steps.metrics] Found metric: waku_node_messages_total{type="relay"} with value 1.0
2026-02-27 04:39:07.470 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-02-27 04:39:07.471 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-02-27 04:39:07.471 DEBUG [src.node.waku_node] Stopping container with id 58e9e4f71917
2026-02-27 04:39:08.106 DEBUG [src.node.waku_node] Container stopped.
2026-02-27 04:39:08.106 DEBUG [src.node.waku_node] Stopping container with id 74ffcdec1e69
2026-02-27 04:39:08.676 DEBUG [src.node.waku_node] Container stopped.
2026-02-27 04:39:08.677 DEBUG [src.node.waku_node] Stopping container with id 1e38de901113
2026-02-27 04:39:08.923 ERROR [src.node.docker_mananger] Max retries reached for container 58e9e4f71917. Exiting log stream.
2026-02-27 04:39:09.244 DEBUG [src.node.waku_node] Container stopped.
2026-02-27 04:39:09.247 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-02-27 04:39:09.256 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-27 04:39:09.265 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-27 04:39:09.274 DEBUG [src.node.docker_mananger] No errors found in the waku logs.