124 lines
21 KiB
Plaintext

2026-03-15 04:53:06.846 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-15 04:53:06.846 DEBUG [tests.conftest] Running test: test_metrics_after_light_push with id: 2026-03-15_04-53-06__cf2d2aab-5d51-4535-8d37-34b65e884767
2026-03-15 04:53:06.846 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-15 04:53:06.846 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-03-15 04:53:06.847 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-03-15 04:53:06.847 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-15 04:53:06.847 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-15 04:53:06.853 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-15 04:53:06.853 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node1_2026-03-15_04-53-06__cf2d2aab-5d51-4535-8d37-34b65e884767__wakuorg_nwaku:latest.log
2026-03-15 04:53:06.853 DEBUG [src.node.waku_node] Starting Node...
2026-03-15 04:53:06.853 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-15 04:53:06.855 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-15 04:53:06.855 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.28.14
2026-03-15 04:53:06.855 DEBUG [src.node.docker_mananger] Generated ports ['21084', '21085', '21086', '21087', '21088']
2026-03-15 04:53:06.855 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-15 04:53:06.855 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-15 04:53:06.855 DEBUG [src.node.waku_node] Using volumes []
2026-03-15 04:53:06.855 DEBUG [src.node.docker_mananger] docker run -i -t -p 21084:21084 -p 21085:21085 -p 21086:21086 -p 21087:21087 -p 21088:21088 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=21086 --rest-port=21084 --tcp-port=21085 --discv5-udp-port=21087 --rest-address=0.0.0.0 --nat=extip:172.18.28.14 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=bee6efe1fd0236ab02faef9dd0e9c5893fef3c014afa8a4fe12a7ae353d3d6ba --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=21088 --metrics-logging=true --lightpush=true --relay=true
2026-03-15 04:53:07.005 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.28.14 waku bdeefb38c6915966773ca539f0b909f301a1d8b33ca3785a3d6fc4a0fe2bf764
2026-03-15 04:53:07.031 DEBUG [src.node.docker_mananger] Container started with ID bdeefb38c691. Setting up logs at ./log/docker/receiving_node1_2026-03-15_04-53-06__cf2d2aab-5d51-4535-8d37-34b65e884767__wakuorg_nwaku:latest.log
2026-03-15 04:53:07.031 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 21084
2026-03-15 04:53:07.032 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-15 04:53:07.135 ERROR [src.node.docker_mananger] Max retries reached for container 297aba5f6fe7. Exiting log stream.
2026-03-15 04:53:07.610 ERROR [src.node.docker_mananger] Max retries reached for container 71d53ff55801. Exiting log stream.
2026-03-15 04:53:08.032 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:21084/health" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:53:08.035 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-15 04:53:08.035 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-15 04:53:08.035 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:21084/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:53:08.037 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.28.14/tcp/21085/p2p/16Uiu2HAmHTQAZM5te9H9v1bkQgrXhXu1uAY9tKv2xFgys26d4gB1","/ip4/172.18.28.14/tcp/21086/ws/p2p/16Uiu2HAmHTQAZM5te9H9v1bkQgrXhXu1uAY9tKv2xFgys26d4gB1"],"enrUri":"enr:-L24QEAkggOFd9FKP-EfV7kmfssO5mBu4W_BU-0MfnKMOTUMUQPj9b8lTo28SntHa-fQUaMrS_ascBQlcZ0upZ7glpQCgmlkgnY0gmlwhKwSHA6KbXVsdGlhZGRyc5YACASsEhwOBlJdAAoErBIcDgZSXt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDR1JkgZqKeXkbpVM1AlISN_l0iTNCpTd58lj9c4UgVNiDdGNwglJdg3VkcIJSX4V3YWt1Mgk"}'
2026-03-15 04:53:08.037 INFO [src.node.waku_node] REST service is ready !!
2026-03-15 04:53:08.044 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-15 04:53:08.044 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node2_2026-03-15_04-53-06__cf2d2aab-5d51-4535-8d37-34b65e884767__wakuorg_nwaku:latest.log
2026-03-15 04:53:08.044 DEBUG [src.node.waku_node] Starting Node...
2026-03-15 04:53:08.045 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-15 04:53:08.046 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-15 04:53:08.046 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.143.230
2026-03-15 04:53:08.046 DEBUG [src.node.docker_mananger] Generated ports ['61022', '61023', '61024', '61025', '61026']
2026-03-15 04:53:08.046 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-15 04:53:08.046 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-15 04:53:08.046 DEBUG [src.node.waku_node] Using volumes []
2026-03-15 04:53:08.046 DEBUG [src.node.docker_mananger] docker run -i -t -p 61022:61022 -p 61023:61023 -p 61024:61024 -p 61025:61025 -p 61026:61026 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=61024 --rest-port=61022 --tcp-port=61023 --discv5-udp-port=61025 --rest-address=0.0.0.0 --nat=extip:172.18.143.230 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=c731e9e47aaab42b54ef8a79f0de7a7ab6df79c20f960cf9dee064ccf2217d1e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=61026 --metrics-logging=true --lightpush=false --relay=true
2026-03-15 04:53:08.205 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.143.230 waku be5b29ca0d4be51dc446a1a7ef6d5ccae1fde9fd91b2f810ba87cd256e777770
2026-03-15 04:53:08.231 DEBUG [src.node.docker_mananger] Container started with ID be5b29ca0d4b. Setting up logs at ./log/docker/receiving_node2_2026-03-15_04-53-06__cf2d2aab-5d51-4535-8d37-34b65e884767__wakuorg_nwaku:latest.log
2026-03-15 04:53:08.231 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 61022
2026-03-15 04:53:08.231 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-15 04:53:09.232 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61022/health" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:53:09.234 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-15 04:53:09.235 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-15 04:53:09.235 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61022/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:53:09.237 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.143.230/tcp/61023/p2p/16Uiu2HAmQkTnMChDCmRbdHxTKiaJTKfiBZ26PwdkWVX1DKqUDhqC","/ip4/172.18.143.230/tcp/61024/ws/p2p/16Uiu2HAmQkTnMChDCmRbdHxTKiaJTKfiBZ26PwdkWVX1DKqUDhqC"],"enrUri":"enr:-L24QJwrmtmAv_rtXaz_u6mf-IOSQ8arOr_ESw14W4EASJuUQ4Nw61bFtQFa1XXE0JS5kGRMb25fS59SoffU7EX1FkkCgmlkgnY0gmlwhKwSj-aKbXVsdGlhZGRyc5YACASsEo_mBu5fAAoErBKP5gbuYN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDs7MqKN7EHIVVBspJO6wmawh150vX-yyBVOR70PYmQ5uDdGNwgu5fg3VkcILuYYV3YWt1MgE"}'
2026-03-15 04:53:09.237 INFO [src.node.waku_node] REST service is ready !!
2026-03-15 04:53:09.237 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61022/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.28.14/tcp/21085/p2p/16Uiu2HAmHTQAZM5te9H9v1bkQgrXhXu1uAY9tKv2xFgys26d4gB1"]'
2026-03-15 04:53:09.268 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-15 04:53:09.278 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-15 04:53:09.278 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/lightpush_node1_2026-03-15_04-53-06__cf2d2aab-5d51-4535-8d37-34b65e884767__wakuorg_nwaku:latest.log
2026-03-15 04:53:09.278 DEBUG [src.node.waku_node] Starting Node...
2026-03-15 04:53:09.278 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-15 04:53:09.279 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-15 04:53:09.279 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.81.223
2026-03-15 04:53:09.279 DEBUG [src.node.docker_mananger] Generated ports ['21158', '21159', '21160', '21161', '21162']
2026-03-15 04:53:09.280 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-15 04:53:09.280 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-15 04:53:09.280 DEBUG [src.node.waku_node] Using volumes []
2026-03-15 04:53:09.280 DEBUG [src.node.docker_mananger] docker run -i -t -p 21158:21158 -p 21159:21159 -p 21160:21160 -p 21161:21161 -p 21162:21162 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=21160 --rest-port=21158 --tcp-port=21159 --discv5-udp-port=21161 --rest-address=0.0.0.0 --nat=extip:172.18.81.223 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=4f5e71bdc3f95ecc701d16bef4f3d0c71416bf25fed6f2da3faa0a3cfe50d54a --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=21162 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QEAkggOFd9FKP-EfV7kmfssO5mBu4W_BU-0MfnKMOTUMUQPj9b8lTo28SntHa-fQUaMrS_ascBQlcZ0upZ7glpQCgmlkgnY0gmlwhKwSHA6KbXVsdGlhZGRyc5YACASsEhwOBlJdAAoErBIcDgZSXt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDR1JkgZqKeXkbpVM1AlISN_l0iTNCpTd58lj9c4UgVNiDdGNwglJdg3VkcIJSX4V3YWt1Mgk --lightpushnode=/ip4/172.18.28.14/tcp/21085/p2p/16Uiu2HAmHTQAZM5te9H9v1bkQgrXhXu1uAY9tKv2xFgys26d4gB1 --lightpush=true --relay=true
2026-03-15 04:53:09.445 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.81.223 waku db77dfbbc0ba21b270a9fa11feb2499218eadac3c78738b65be6219dd1fc399e
2026-03-15 04:53:09.470 DEBUG [src.node.docker_mananger] Container started with ID db77dfbbc0ba. Setting up logs at ./log/docker/lightpush_node1_2026-03-15_04-53-06__cf2d2aab-5d51-4535-8d37-34b65e884767__wakuorg_nwaku:latest.log
2026-03-15 04:53:09.470 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 21158
2026-03-15 04:53:09.470 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-15 04:53:10.471 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:21158/health" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:53:10.473 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-15 04:53:10.473 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-15 04:53:10.474 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:21158/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:53:10.476 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.81.223/tcp/21159/p2p/16Uiu2HAm3CnihYnqy69ftHRtYdC9ZhuAw2zaBfpn7R47ttuBMyEj","/ip4/172.18.81.223/tcp/21160/ws/p2p/16Uiu2HAm3CnihYnqy69ftHRtYdC9ZhuAw2zaBfpn7R47ttuBMyEj"],"enrUri":"enr:-L24QALcQ2LJEHcb4ZJcZNH-t82o4x1Kr4cCXoBLGdtKox7IFx-nYlQN3oQYPcYe5FdtpfRFHZNWicVUD499ANrHmlECgmlkgnY0gmlwhKwSUd-KbXVsdGlhZGRyc5YACASsElHfBlKnAAoErBJR3wZSqN0DgnJzhQADAQAAiXNlY3AyNTZrMaECc5CQyTO_5e-y4N-neVEAot9bPODBOIP-xNFOvaqy33yDdGNwglKng3VkcIJSqYV3YWt1Mgk"}'
2026-03-15 04:53:10.476 INFO [src.node.waku_node] REST service is ready !!
2026-03-15 04:53:10.476 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21158/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.28.14/tcp/21085/p2p/16Uiu2HAmHTQAZM5te9H9v1bkQgrXhXu1uAY9tKv2xFgys26d4gB1"]'
2026-03-15 04:53:10.530 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-15 04:53:10.531 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21158/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.143.230/tcp/61023/p2p/16Uiu2HAmQkTnMChDCmRbdHxTKiaJTKfiBZ26PwdkWVX1DKqUDhqC"]'
2026-03-15 04:53:10.555 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-15 04:53:10.556 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21084/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-15 04:53:10.563 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-15 04:53:10.563 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61022/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-15 04:53:10.572 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-15 04:53:10.572 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21158/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-15 04:53:10.580 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-15 04:53:10.581 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21158/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/3/1", "message": {"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": 1773550390580985335}}'
2026-03-15 04:53:10.598 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-15 04:53:10.598 DEBUG [src.libs.common] Sleeping for 0.5 seconds
2026-03-15 04:53:11.098 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:21084/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:53:11.101 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1773550390580985335,"ephemeral":false,"proof":""}]'
2026-03-15 04:53:11.101 DEBUG [src.libs.common] Sleeping for 5 seconds
2026-03-15 04:53:16.102 DEBUG [src.steps.metrics] Checking metric: waku_service_peers{protocol="/vac/waku/lightpush/2.0.0-beta1",peerId="/ip4/172.18.28.14/tcp/21085"} has 1
2026-03-15 04:53:16.106 DEBUG [src.steps.metrics] Found metric: waku_service_peers{protocol="/vac/waku/lightpush/2.0.0-beta1",peerId="/ip4/172.18.28.14/tcp/21085"} with value 1.0
2026-03-15 04:53:16.106 DEBUG [src.steps.metrics] Checking metric: libp2p_peers has 1
2026-03-15 04:53:16.109 DEBUG [src.steps.metrics] Found metric: libp2p_peers with value 2.0
2026-03-15 04:53:16.110 DEBUG [src.steps.metrics] Checking metric: waku_peer_store_size has 1
2026-03-15 04:53:16.113 DEBUG [src.steps.metrics] Found metric: waku_peer_store_size with value 2.0
2026-03-15 04:53:16.113 DEBUG [src.steps.metrics] Checking metric: libp2p_peers has 1
2026-03-15 04:53:16.116 DEBUG [src.steps.metrics] Found metric: libp2p_peers with value 2.0
2026-03-15 04:53:16.116 DEBUG [src.steps.metrics] Checking metric: libp2p_pubsub_peers has 1
2026-03-15 04:53:16.120 DEBUG [src.steps.metrics] Found metric: libp2p_pubsub_peers with value 2.0
2026-03-15 04:53:16.120 DEBUG [src.steps.metrics] Checking metric: libp2p_pubsub_topics has 1
2026-03-15 04:53:16.123 DEBUG [src.steps.metrics] Found metric: libp2p_pubsub_topics with value 2.0
2026-03-15 04:53:16.123 DEBUG [src.steps.metrics] Checking metric: libp2p_pubsub_subscriptions_total has 1
2026-03-15 04:53:16.126 DEBUG [src.steps.metrics] Found metric: libp2p_pubsub_subscriptions_total with value 2.0
2026-03-15 04:53:16.126 DEBUG [src.steps.metrics] Checking metric: waku_peer_store_size has 1
2026-03-15 04:53:16.129 DEBUG [src.steps.metrics] Found metric: waku_peer_store_size with value 2.0
2026-03-15 04:53:16.130 DEBUG [src.steps.metrics] Checking metric: waku_histogram_message_size_count has 1
2026-03-15 04:53:16.132 DEBUG [src.steps.metrics] Found metric: waku_histogram_message_size_count with value 1.0
2026-03-15 04:53:16.133 DEBUG [src.steps.metrics] Checking metric: waku_node_messages_total{type="relay"} has 1
2026-03-15 04:53:16.136 DEBUG [src.steps.metrics] Found metric: waku_node_messages_total{type="relay"} with value 1.0
2026-03-15 04:53:16.137 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-15 04:53:16.139 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-15 04:53:16.139 DEBUG [src.node.waku_node] Stopping container with id bdeefb38c691
2026-03-15 04:53:16.597 DEBUG [src.node.waku_node] Container stopped.
2026-03-15 04:53:16.597 DEBUG [src.node.waku_node] Stopping container with id be5b29ca0d4b
2026-03-15 04:53:17.049 DEBUG [src.node.waku_node] Container stopped.
2026-03-15 04:53:17.049 DEBUG [src.node.waku_node] Stopping container with id db77dfbbc0ba
2026-03-15 04:53:17.409 ERROR [src.node.docker_mananger] Max retries reached for container bdeefb38c691. Exiting log stream.
2026-03-15 04:53:17.499 DEBUG [src.node.waku_node] Container stopped.
2026-03-15 04:53:17.501 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-15 04:53:17.511 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-15 04:53:17.519 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-15 04:53:17.528 DEBUG [src.node.docker_mananger] No errors found in the waku logs.