167 lines
35 KiB
Plaintext
Raw Blame History

This file contains invisible Unicode characters

This file contains invisible Unicode characters that are indistinguishable to humans but may be processed differently by a computer. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

DEBUG  tests.conftest:conftest.py:51 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:57 Running test: test_relay_packet_loss_correlated_vs_uncorrelated with id: 2026-03-29_04-51-51__1ad4b411-085b-4aae-a7ff-ee703818ae57
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.steps.relay:relay.py:28 Running fixture setup: relay_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node1_2026-03-29_04-51-51__1ad4b411-085b-4aae-a7ff-ee703818ae57__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node2_2026-03-29_04-51-51__1ad4b411-085b-4aae-a7ff-ee703818ae57__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node3_2026-03-29_04-51-51__1ad4b411-085b-4aae-a7ff-ee703818ae57__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node4_2026-03-29_04-51-51__1ad4b411-085b-4aae-a7ff-ee703818ae57__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.236.179
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['46013', '46014', '46015', '46016', '46017']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 46013:46013 -p 46014:46014 -p 46015:46015 -p 46016:46016 -p 46017:46017 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=46015 --rest-port=46013 --tcp-port=46014 --discv5-udp-port=46016 --rest-address=0.0.0.0 --nat=extip:172.18.236.179 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=6acace50dd6a8e0affde1f5fd8c2741a3d4dc7cdf9480dc7b39ae0a089ff50a5 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=46017 --metrics-logging=true --relay=true
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.236.179 waku 7ef36150c3e892fca39fb7fe7e25abbdfbe0c7b31114c0d810ba3f667cd1d518
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 93ebd1b4174f. Exiting log stream.
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 7ef36150c3e8. Setting up logs at ./log/docker/node1_2026-03-29_04-51-51__1ad4b411-085b-4aae-a7ff-ee703818ae57__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 46013
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container f18df0c1c063. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:46013/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:46013/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.236.179/tcp/46014/p2p/16Uiu2HAmRFrBo65kXiaY7LuQxfS4ApSBUFTsV4CtssZeqsSQMkHg","/ip4/172.18.236.179/tcp/46015/ws/p2p/16Uiu2HAmRFrBo65kXiaY7LuQxfS4ApSBUFTsV4CtssZeqsSQMkHg"],"enrUri":"enr:-L24QBzTOt0z6QUZBWVWJPvLU7MzQ840CkFVqoF8SCGVEImcHgBDQEKfFfJouub2CY90pM-_OylPaZTpqPFMcG4rsewCgmlkgnY0gmlwhKwS7LOKbXVsdGlhZGRyc5YACASsEuyzBrO-AAoErBLsswazv90DgnJzhQADAQAAiXNlY3AyNTZrMaEDuzpXOORGnK3pM1vqJNOqDKa2csTJlNEZOaC4q5biKoODdGNwgrO-g3VkcIKzwIV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.124.114
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['34700', '34701', '34702', '34703', '34704']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 34700:34700 -p 34701:34701 -p 34702:34702 -p 34703:34703 -p 34704:34704 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=34702 --rest-port=34700 --tcp-port=34701 --discv5-udp-port=34703 --rest-address=0.0.0.0 --nat=extip:172.18.124.114 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=c3deec1da6e4abaca459d82aabed4c58abaebafedddbddbdcceafaaf3fbdb318 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=34704 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QBzTOt0z6QUZBWVWJPvLU7MzQ840CkFVqoF8SCGVEImcHgBDQEKfFfJouub2CY90pM-_OylPaZTpqPFMcG4rsewCgmlkgnY0gmlwhKwS7LOKbXVsdGlhZGRyc5YACASsEuyzBrO-AAoErBLsswazv90DgnJzhQADAQAAiXNlY3AyNTZrMaEDuzpXOORGnK3pM1vqJNOqDKa2csTJlNEZOaC4q5biKoODdGNwgrO-g3VkcIKzwIV3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.124.114 waku b46cf8ca9e2ab77df583225570601a9d47a01a5552acebe532e77c1466d01ed8
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID b46cf8ca9e2a. Setting up logs at ./log/docker/node2_2026-03-29_04-51-51__1ad4b411-085b-4aae-a7ff-ee703818ae57__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 34700
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:34700/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:34700/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.124.114/tcp/34701/p2p/16Uiu2HAkzuniRdpqHhz67b5GjK1GYQnvaRX11jUB8ifHwTRJnMtN","/ip4/172.18.124.114/tcp/34702/ws/p2p/16Uiu2HAkzuniRdpqHhz67b5GjK1GYQnvaRX11jUB8ifHwTRJnMtN"],"enrUri":"enr:-L24QN4ZHQqVBtlwXX5ZCpZAw-d3aPwdmJzssHzuuEZOwzSmGQnTSEetp8G4olQE9yZZ7DHVu_i8ajdetbaSIx8qQY0CgmlkgnY0gmlwhKwSfHKKbXVsdGlhZGRyc5YACASsEnxyBoeNAAoErBJ8cgaHjt0DgnJzhQADAQAAiXNlY3AyNTZrMaECUX5QB384heE4bqagrIAPLmJdMAv3OrWR72a_I6uj8guDdGNwgoeNg3VkcIKHj4V3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.118.212
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['15431', '15432', '15433', '15434', '15435']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 15431:15431 -p 15432:15432 -p 15433:15433 -p 15434:15434 -p 15435:15435 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=15433 --rest-port=15431 --tcp-port=15432 --discv5-udp-port=15434 --rest-address=0.0.0.0 --nat=extip:172.18.118.212 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=f9a0fd6cbc37a52be0d7f9de5f3f1dcfaccb3df45cbffcfef3de4737bdfe5cc9 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=15435 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QN4ZHQqVBtlwXX5ZCpZAw-d3aPwdmJzssHzuuEZOwzSmGQnTSEetp8G4olQE9yZZ7DHVu_i8ajdetbaSIx8qQY0CgmlkgnY0gmlwhKwSfHKKbXVsdGlhZGRyc5YACASsEnxyBoeNAAoErBJ8cgaHjt0DgnJzhQADAQAAiXNlY3AyNTZrMaECUX5QB384heE4bqagrIAPLmJdMAv3OrWR72a_I6uj8guDdGNwgoeNg3VkcIKHj4V3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.118.212 waku 8ccfdf3e66a1d55a4a2b1e2ff6168b415e901179ffea298c5c913ce9f468caa9
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 8ccfdf3e66a1. Setting up logs at ./log/docker/node3_2026-03-29_04-51-51__1ad4b411-085b-4aae-a7ff-ee703818ae57__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 15431
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:15431/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:15431/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.118.212/tcp/15432/p2p/16Uiu2HAmQm3xuY47KXfoxgVdSsewtgSLWVqpgbYYT3PGKkTsAJod","/ip4/172.18.118.212/tcp/15433/ws/p2p/16Uiu2HAmQm3xuY47KXfoxgVdSsewtgSLWVqpgbYYT3PGKkTsAJod"],"enrUri":"enr:-L24QN5ueJOwuqoG8GnWv8h-VoiAtYWLOGA9xFVn1g2CJQGldB4-ojwoYhv7zMKuceW0j0uzPR1UNTuZ2Jh6NFXT6voCgmlkgnY0gmlwhKwSdtSKbXVsdGlhZGRyc5YACASsEnbUBjxIAAoErBJ21AY8Sd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDs9nQfjH1ylj1bwgBcTyCHpVH5J66cm4oo1P0Ybn68XyDdGNwgjxIg3VkcII8SoV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.22.245
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['14584', '14585', '14586', '14587', '14588']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 14584:14584 -p 14585:14585 -p 14586:14586 -p 14587:14587 -p 14588:14588 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=14586 --rest-port=14584 --tcp-port=14585 --discv5-udp-port=14587 --rest-address=0.0.0.0 --nat=extip:172.18.22.245 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=efc603a3fd354f4e52102356ad9efdb597bd5a8afdcc8d228faaabc61ffd6b72 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=14588 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QN5ueJOwuqoG8GnWv8h-VoiAtYWLOGA9xFVn1g2CJQGldB4-ojwoYhv7zMKuceW0j0uzPR1UNTuZ2Jh6NFXT6voCgmlkgnY0gmlwhKwSdtSKbXVsdGlhZGRyc5YACASsEnbUBjxIAAoErBJ21AY8Sd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDs9nQfjH1ylj1bwgBcTyCHpVH5J66cm4oo1P0Ybn68XyDdGNwgjxIg3VkcII8SoV3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.22.245 waku 9fa217b785983024a6b98e6686f2036e7aa0d7641e1f02056c0dd3ecce38bfd4
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 9fa217b78598. Setting up logs at ./log/docker/node4_2026-03-29_04-51-51__1ad4b411-085b-4aae-a7ff-ee703818ae57__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 14584
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:14584/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:14584/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.22.245/tcp/14585/p2p/16Uiu2HAmF66m31amXvQmTGj3wm3XyeMPKKy6Xtcn9FwEVYqrruUN","/ip4/172.18.22.245/tcp/14586/ws/p2p/16Uiu2HAmF66m31amXvQmTGj3wm3XyeMPKKy6Xtcn9FwEVYqrruUN"],"enrUri":"enr:-L24QH0mQK2eiTEu9CyFKS8JitzoMDlDmjSOoALIWf4T4dxkJzgYWwXnowxHHx8izRTXlLOVWb1uYkfArDjZFpPzdNICgmlkgnY0gmlwhKwSFvWKbXVsdGlhZGRyc5YACASsEhb1Bjj5AAoErBIW9QY4-t0DgnJzhQADAQAAiXNlY3AyNTZrMaEDJCYkJu15qrRzv19dADh3f0PR-yMBG_GwRILKK8bCmfuDdGNwgjj5g3VkcII4-4V3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:46013/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:34700/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:15431/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:14584/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:46013/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.124.114/tcp/59042/p2p/16Uiu2HAkzuniRdpqHhz67b5GjK1GYQnvaRX11jUB8ifHwTRJnMtN","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"UnknownOrigin"}]'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:34700/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.236.179/tcp/46014/p2p/16Uiu2HAmRFrBo65kXiaY7LuQxfS4ApSBUFTsV4CtssZeqsSQMkHg","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"Discv5"},{"multiaddr":"/ip4/172.18.118.212/tcp/38204/p2p/16Uiu2HAmQm3xuY47KXfoxgVdSsewtgSLWVqpgbYYT3PGKkTsAJod","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"UnknownOrigin"}]'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:15431/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.22.245/tcp/59436/p2p/16Uiu2HAmF66m31amXvQmTGj3wm3XyeMPKKy6Xtcn9FwEVYqrruUN","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.124.114/tcp/34701/p2p/16Uiu2HAkzuniRdpqHhz67b5GjK1GYQnvaRX11jUB8ifHwTRJnMtN","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"Discv5"}]'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:14584/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.118.212/tcp/15432/p2p/16Uiu2HAmQm3xuY47KXfoxgVdSsewtgSLWVqpgbYYT3PGKkTsAJod","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"Discv5"}]'
DEBUG  src.libs.common:common.py:47 Sleeping for 20 seconds
INFO  src.steps.network_conditions:network_conditions.py:22 TC exec: ['sudo', '-n', 'nsenter', '-t', '8185', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
INFO  src.steps.network_conditions:network_conditions.py:22 TC exec: ['sudo', '-n', 'nsenter', '-t', '8185', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'loss', '50.0%']
INFO  src.steps.network_conditions:network_conditions.py:22 TC exec: ['sudo', '-n', 'nsenter', '-t', '8185', '-n', 'tc', '-s', 'qdisc', 'show', 'dev', 'eth0']
DEBUG  src.steps.network_conditions:network_conditions.py:71 tc -s qdisc show dev eth0:
qdisc netem 8002: root refcnt 5 limit 1000 loss 50%
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:14584/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[]'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:46013/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:46013/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:46013/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:46013/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:46013/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 30.0 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:14584/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774759936611013717,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774759937648484565,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774759937676627517,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774759939154698344,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774759939161814491,"ephemeral":false,"proof":""}]'
INFO  src.steps.network_conditions:network_conditions.py:22 TC exec: ['sudo', '-n', 'nsenter', '-t', '8185', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
INFO  src.steps.network_conditions:network_conditions.py:22 TC exec: ['sudo', '-n', 'nsenter', '-t', '8185', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
INFO  src.steps.network_conditions:network_conditions.py:22 TC exec: ['sudo', '-n', 'nsenter', '-t', '8185', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'loss', '50.0%', '75.0%']
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:14584/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[]'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:46013/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:46013/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:46013/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:46013/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:46013/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 30.0 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:14584/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774759969230280880,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774759969242823817,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774759969256259953,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774759969276003104,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774759969294003158,"ephemeral":false,"proof":""}]'
INFO  src.steps.network_conditions:network_conditions.py:22 TC exec: ['sudo', '-n', 'nsenter', '-t', '8185', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
DEBUG  tests.e2e.test_network_conditions:test_network_conditions.py:449 uncorrelated=5 correlated=5
DEBUG  tests.conftest:conftest.py:59 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:83 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 7ef36150c3e8
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id b46cf8ca9e2a
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 8ccfdf3e66a1
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 7ef36150c3e8. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 9fa217b78598
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container b46cf8ca9e2a. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  tests.conftest:conftest.py:98 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.