225 lines
48 KiB
Plaintext
Raw Blame History

This file contains invisible Unicode characters

This file contains invisible Unicode characters that are indistinguishable to humans but may be processed differently by a computer. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

DEBUG  tests.conftest:conftest.py:51 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:57 Running test: test_relay_7_nodes_3sec_latency with id: 2026-03-02_04-34-28__b36e315a-e93d-48ad-9ed2-d4c72f77f877
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.steps.relay:relay.py:28 Running fixture setup: relay_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node1_2026-03-02_04-34-28__b36e315a-e93d-48ad-9ed2-d4c72f77f877__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node2_2026-03-02_04-34-28__b36e315a-e93d-48ad-9ed2-d4c72f77f877__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node1_2026-03-02_04-34-28__b36e315a-e93d-48ad-9ed2-d4c72f77f877__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node2_2026-03-02_04-34-28__b36e315a-e93d-48ad-9ed2-d4c72f77f877__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node3_2026-03-02_04-34-28__b36e315a-e93d-48ad-9ed2-d4c72f77f877__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node4_2026-03-02_04-34-28__b36e315a-e93d-48ad-9ed2-d4c72f77f877__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node5_2026-03-02_04-34-28__b36e315a-e93d-48ad-9ed2-d4c72f77f877__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node6_2026-03-02_04-34-28__b36e315a-e93d-48ad-9ed2-d4c72f77f877__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node7_2026-03-02_04-34-28__b36e315a-e93d-48ad-9ed2-d4c72f77f877__wakuorg_nwaku:latest.log
INFO  tests.e2e.test_network_conditions:test_network_conditions.py:63 Starting nodes with chain bootstrap
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.250.73
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['2849', '2850', '2851', '2852', '2853']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 2849:2849 -p 2850:2850 -p 2851:2851 -p 2852:2852 -p 2853:2853 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=2851 --rest-port=2849 --tcp-port=2850 --discv5-udp-port=2852 --rest-address=0.0.0.0 --nat=extip:172.18.250.73 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ae5e009b062febba81c14ea419cdb4ad4e936ee9bffde9a2fe9d8caf2ddd7303 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=2853 --metrics-logging=true --relay=true
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container a01fbcdca8eb. Exiting log stream.
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.250.73 waku 38b773269b5e69eb54266ea85ce98a6f0f0950852c328de92581f57bd5b08d75
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 38b773269b5e. Setting up logs at ./log/docker/node1_2026-03-02_04-34-28__b36e315a-e93d-48ad-9ed2-d4c72f77f877__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 2849
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container ed3fb8b8051b. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:2849/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:2849/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.250.73/tcp/2850/p2p/16Uiu2HAkxL88H8zD7P2L3TkuZjbgkmQTpcZsivAjRrPBmnVVhUit","/ip4/172.18.250.73/tcp/2851/ws/p2p/16Uiu2HAkxL88H8zD7P2L3TkuZjbgkmQTpcZsivAjRrPBmnVVhUit"],"enrUri":"enr:-L24QIojoClGCjYgvlT1C2eVf3AnzMT4J2t6UhK1eJxE14BTardvYddVGowrGfRz4p48JMAnavm1AGrSSfNI1WAh3bECgmlkgnY0gmlwhKwS-kmKbXVsdGlhZGRyc5YACASsEvpJBgsiAAoErBL6SQYLI90DgnJzhQADAQAAiXNlY3AyNTZrMaECKycjv6NAW3NBH_KlCY3F7ncqfEGJOyOuwOpcyXNNPwmDdGNwggsig3VkcIILJIV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.40.101
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['53084', '53085', '53086', '53087', '53088']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 53084:53084 -p 53085:53085 -p 53086:53086 -p 53087:53087 -p 53088:53088 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=53086 --rest-port=53084 --tcp-port=53085 --discv5-udp-port=53087 --rest-address=0.0.0.0 --nat=extip:172.18.40.101 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=a83a3eedfecafd687e4cdc3cc55edabbd8ea1a2ec3b4fab0fead7912fe9dc1da --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=53088 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QIojoClGCjYgvlT1C2eVf3AnzMT4J2t6UhK1eJxE14BTardvYddVGowrGfRz4p48JMAnavm1AGrSSfNI1WAh3bECgmlkgnY0gmlwhKwS-kmKbXVsdGlhZGRyc5YACASsEvpJBgsiAAoErBL6SQYLI90DgnJzhQADAQAAiXNlY3AyNTZrMaECKycjv6NAW3NBH_KlCY3F7ncqfEGJOyOuwOpcyXNNPwmDdGNwggsig3VkcIILJIV3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.40.101 waku 4d306ceb7e8af74ce30aa56309de47b114418aec90c3b25252aa67987f1c9c23
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 4d306ceb7e8a. Setting up logs at ./log/docker/node2_2026-03-02_04-34-28__b36e315a-e93d-48ad-9ed2-d4c72f77f877__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 53084
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:53084/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:53084/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.40.101/tcp/53085/p2p/16Uiu2HAmH1ZkUpFEUwdWDqLjieA3WPp1unKikcq9GS76Uiots1Zv","/ip4/172.18.40.101/tcp/53086/ws/p2p/16Uiu2HAmH1ZkUpFEUwdWDqLjieA3WPp1unKikcq9GS76Uiots1Zv"],"enrUri":"enr:-L24QOjnGkD3O-D59VdcMydrBt9adQ59hm3v2vO0SZXantEseArp3cn7yO6_wOwh9-LE8khtqRquAcxux4uR9ClHG9ICgmlkgnY0gmlwhKwSKGWKbXVsdGlhZGRyc5YACASsEihlBs9dAAoErBIoZQbPXt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDQLQhE2RRUyNRKYN06mr1vSXONrZU5GNPTHjgt4sBOPWDdGNwgs9dg3VkcILPX4V3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.5.232
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['55672', '55673', '55674', '55675', '55676']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 55672:55672 -p 55673:55673 -p 55674:55674 -p 55675:55675 -p 55676:55676 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=55674 --rest-port=55672 --tcp-port=55673 --discv5-udp-port=55675 --rest-address=0.0.0.0 --nat=extip:172.18.5.232 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=8ec4bcfeff5ad971daf9ae2d0f30605376cc45bc4f653d7fddf9e4c7d5b26cd1 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=55676 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QOjnGkD3O-D59VdcMydrBt9adQ59hm3v2vO0SZXantEseArp3cn7yO6_wOwh9-LE8khtqRquAcxux4uR9ClHG9ICgmlkgnY0gmlwhKwSKGWKbXVsdGlhZGRyc5YACASsEihlBs9dAAoErBIoZQbPXt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDQLQhE2RRUyNRKYN06mr1vSXONrZU5GNPTHjgt4sBOPWDdGNwgs9dg3VkcILPX4V3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.5.232 waku a4cbe3e1acb76386b8030c24f492a4ca431d15e50e589387300d26f5684d2144
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID a4cbe3e1acb7. Setting up logs at ./log/docker/node3_2026-03-02_04-34-28__b36e315a-e93d-48ad-9ed2-d4c72f77f877__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 55672
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:55672/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:55672/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.5.232/tcp/55673/p2p/16Uiu2HAmByAit4n6G8wWABsQApMq46v8Arhx1ZRvMnYqFLBEbXA9","/ip4/172.18.5.232/tcp/55674/ws/p2p/16Uiu2HAmByAit4n6G8wWABsQApMq46v8Arhx1ZRvMnYqFLBEbXA9"],"enrUri":"enr:-L24QLF3ETkjikM4cQY5sEzxTQlj2rCRNbovXA7EcmwAJoS8G1eUhzGobfnZ7YwRwZJh0KgUJSp3FChP8ruB24ZPywgCgmlkgnY0gmlwhKwSBeiKbXVsdGlhZGRyc5YACASsEgXoBtl5AAoErBIF6AbZet0DgnJzhQADAQAAiXNlY3AyNTZrMaEC9cx-30fdM5vFjYeR-IoTCqanTV5-A60JujBKlwyeC2qDdGNwgtl5g3VkcILZe4V3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.218.254
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['4657', '4658', '4659', '4660', '4661']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 4657:4657 -p 4658:4658 -p 4659:4659 -p 4660:4660 -p 4661:4661 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=4659 --rest-port=4657 --tcp-port=4658 --discv5-udp-port=4660 --rest-address=0.0.0.0 --nat=extip:172.18.218.254 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=36d2e380c64d46c9ed1e2eeb8efb6ba2af7cf4a382b3dfedf1eaa43cda4ed9c1 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=4661 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QLF3ETkjikM4cQY5sEzxTQlj2rCRNbovXA7EcmwAJoS8G1eUhzGobfnZ7YwRwZJh0KgUJSp3FChP8ruB24ZPywgCgmlkgnY0gmlwhKwSBeiKbXVsdGlhZGRyc5YACASsEgXoBtl5AAoErBIF6AbZet0DgnJzhQADAQAAiXNlY3AyNTZrMaEC9cx-30fdM5vFjYeR-IoTCqanTV5-A60JujBKlwyeC2qDdGNwgtl5g3VkcILZe4V3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.218.254 waku 012fff8877d49402b8d33f4b39b9e9ca61b918d267de480b0250412b3000be89
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 012fff8877d4. Setting up logs at ./log/docker/node4_2026-03-02_04-34-28__b36e315a-e93d-48ad-9ed2-d4c72f77f877__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 4657
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:4657/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:4657/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.218.254/tcp/4658/p2p/16Uiu2HAkuytYJULuUeKsjfghqmoYFW3s9pHMjpXmphMkYTV6wVJZ","/ip4/172.18.218.254/tcp/4659/ws/p2p/16Uiu2HAkuytYJULuUeKsjfghqmoYFW3s9pHMjpXmphMkYTV6wVJZ"],"enrUri":"enr:-L24QAXEMB8-4OMbuF60QFQVuM9xCMvJl7DtZrECPF1zwvtGCqNAXe9ikwPT9jz0vf99rRvwwKn03ssS7z9mnp2DGv8CgmlkgnY0gmlwhKwS2v6KbXVsdGlhZGRyc5YACASsEtr-BhIyAAoErBLa_gYSM90DgnJzhQADAQAAiXNlY3AyNTZrMaECCEDJv92SyQIslneSvntxGRvJXBwP1gfHw5jZPJNOyiqDdGNwghIyg3VkcIISNIV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.133.99
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['48054', '48055', '48056', '48057', '48058']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 48054:48054 -p 48055:48055 -p 48056:48056 -p 48057:48057 -p 48058:48058 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=48056 --rest-port=48054 --tcp-port=48055 --discv5-udp-port=48057 --rest-address=0.0.0.0 --nat=extip:172.18.133.99 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=fc20d990ab1dcf0d5cd131bb06dacd85a8e416ac15dea117bde87bc5673d1ca0 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=48058 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QAXEMB8-4OMbuF60QFQVuM9xCMvJl7DtZrECPF1zwvtGCqNAXe9ikwPT9jz0vf99rRvwwKn03ssS7z9mnp2DGv8CgmlkgnY0gmlwhKwS2v6KbXVsdGlhZGRyc5YACASsEtr-BhIyAAoErBLa_gYSM90DgnJzhQADAQAAiXNlY3AyNTZrMaECCEDJv92SyQIslneSvntxGRvJXBwP1gfHw5jZPJNOyiqDdGNwghIyg3VkcIISNIV3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.133.99 waku dfa7bf1642a4ba1239b1a535c1ec409fe820e945aaf9d526960eeb26e939f4cd
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID dfa7bf1642a4. Setting up logs at ./log/docker/node5_2026-03-02_04-34-28__b36e315a-e93d-48ad-9ed2-d4c72f77f877__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 48054
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:48054/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:48054/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.133.99/tcp/48055/p2p/16Uiu2HAmDugFQadZs8w7E3dz9RnjHvVnRbUV2XaGvMBWscRqa78J","/ip4/172.18.133.99/tcp/48056/ws/p2p/16Uiu2HAmDugFQadZs8w7E3dz9RnjHvVnRbUV2XaGvMBWscRqa78J"],"enrUri":"enr:-L24QOIyK2Q4DZvHyVyxzv-CJedKwSWJb4qaK7fFNSpplmnqOQXCOTjHv-4NRPS665L-hIk5EQFoFqwTtgwD2v8pcogCgmlkgnY0gmlwhKwShWOKbXVsdGlhZGRyc5YACASsEoVjBru3AAoErBKFYwa7uN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDEp7uhR3ITjHgm6P0KHP7DM_B4Z0kPjYD4xUB_OtxOmeDdGNwgru3g3VkcIK7uYV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.249.188
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['36620', '36621', '36622', '36623', '36624']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 36620:36620 -p 36621:36621 -p 36622:36622 -p 36623:36623 -p 36624:36624 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=36622 --rest-port=36620 --tcp-port=36621 --discv5-udp-port=36623 --rest-address=0.0.0.0 --nat=extip:172.18.249.188 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=9faabdd4fafcccaf8ac9fb65598d81c3158210c0f2bdddeebf32e04ba2967058 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=36624 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QOIyK2Q4DZvHyVyxzv-CJedKwSWJb4qaK7fFNSpplmnqOQXCOTjHv-4NRPS665L-hIk5EQFoFqwTtgwD2v8pcogCgmlkgnY0gmlwhKwShWOKbXVsdGlhZGRyc5YACASsEoVjBru3AAoErBKFYwa7uN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDEp7uhR3ITjHgm6P0KHP7DM_B4Z0kPjYD4xUB_OtxOmeDdGNwgru3g3VkcIK7uYV3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.249.188 waku 7bae90d972584f9681390474cf5b909f5120cba6e77668c16f1e2fb999971fc3
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 7bae90d97258. Setting up logs at ./log/docker/node6_2026-03-02_04-34-28__b36e315a-e93d-48ad-9ed2-d4c72f77f877__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 36620
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:36620/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:36620/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.249.188/tcp/36621/p2p/16Uiu2HAmKNW1HcPVmwAqGxqNSF1Lsy9i4wdMD8Bgko5D4s4iogAK","/ip4/172.18.249.188/tcp/36622/ws/p2p/16Uiu2HAmKNW1HcPVmwAqGxqNSF1Lsy9i4wdMD8Bgko5D4s4iogAK"],"enrUri":"enr:-L24QL_9gBUn5YXgwqrk1m0b0HLrZjgTc2mBNL4YiKqOC18SQj-84LzIS2dZJt6Cg-choHtjHj46gIhSdspny5IZ42cCgmlkgnY0gmlwhKwS-byKbXVsdGlhZGRyc5YACASsEvm8Bo8NAAoErBL5vAaPDt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDY8h3RHUqZ_v5fnVED-eXZyigEzhwblAdIEnaiD8D2jiDdGNwgo8Ng3VkcIKPD4V3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.122.250
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['49218', '49219', '49220', '49221', '49222']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 49218:49218 -p 49219:49219 -p 49220:49220 -p 49221:49221 -p 49222:49222 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=49220 --rest-port=49218 --tcp-port=49219 --discv5-udp-port=49221 --rest-address=0.0.0.0 --nat=extip:172.18.122.250 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=0ab352b114c3fb9252711d979d00f9ddcef2d58faadeca7ded9e84ed53dfba40 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=49222 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QL_9gBUn5YXgwqrk1m0b0HLrZjgTc2mBNL4YiKqOC18SQj-84LzIS2dZJt6Cg-choHtjHj46gIhSdspny5IZ42cCgmlkgnY0gmlwhKwS-byKbXVsdGlhZGRyc5YACASsEvm8Bo8NAAoErBL5vAaPDt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDY8h3RHUqZ_v5fnVED-eXZyigEzhwblAdIEnaiD8D2jiDdGNwgo8Ng3VkcIKPD4V3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.122.250 waku 38801277d3493818089c3e598bbab1f629940d8897509ae39c76d162c3bc9059
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 38801277d349. Setting up logs at ./log/docker/node7_2026-03-02_04-34-28__b36e315a-e93d-48ad-9ed2-d4c72f77f877__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 49218
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:49218/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:49218/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.122.250/tcp/49219/p2p/16Uiu2HAm1qVBtt1dB3F5KKAW8Ls378QzbXBf9tQiuBBwZ6PZUL11","/ip4/172.18.122.250/tcp/49220/ws/p2p/16Uiu2HAm1qVBtt1dB3F5KKAW8Ls378QzbXBf9tQiuBBwZ6PZUL11"],"enrUri":"enr:-L24QFzUNQvd-ip5R6_2Mt-KqpnUURBsvzXcRWpYQQNjjqeUXKCTyx7S6Kp7jexw1uh-Ak5jf7mDtX7XriIu7i5J7lACgmlkgnY0gmlwhKwSevqKbXVsdGlhZGRyc5YACASsEnr6BsBDAAoErBJ6-gbARN0DgnJzhQADAQAAiXNlY3AyNTZrMaECXz_b8dgnAGLrdX9HEgCxFR_K7uDQwpNkSswssBckmuSDdGNwgsBDg3VkcILARYV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  tests.e2e.test_network_conditions:test_network_conditions.py:72 Subscribing all nodes to relay topic
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:2849/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:53084/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:55672/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:4657/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:48054/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:36620/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:49218/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  tests.e2e.test_network_conditions:test_network_conditions.py:76 Waiting for autoconnection
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:2849/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.40.101/tcp/43828/p2p/16Uiu2HAmH1ZkUpFEUwdWDqLjieA3WPp1unKikcq9GS76Uiots1Zv","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"UnknownOrigin"}]'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:53084/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.250.73/tcp/2850/p2p/16Uiu2HAkxL88H8zD7P2L3TkuZjbgkmQTpcZsivAjRrPBmnVVhUit","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"Discv5"},{"multiaddr":"/ip4/172.18.5.232/tcp/49022/p2p/16Uiu2HAmByAit4n6G8wWABsQApMq46v8Arhx1ZRvMnYqFLBEbXA9","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"UnknownOrigin"}]'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:55672/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.218.254/tcp/35742/p2p/16Uiu2HAkuytYJULuUeKsjfghqmoYFW3s9pHMjpXmphMkYTV6wVJZ","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.40.101/tcp/53085/p2p/16Uiu2HAmH1ZkUpFEUwdWDqLjieA3WPp1unKikcq9GS76Uiots1Zv","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"Discv5"}]'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:4657/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.5.232/tcp/55673/p2p/16Uiu2HAmByAit4n6G8wWABsQApMq46v8Arhx1ZRvMnYqFLBEbXA9","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"Discv5"},{"multiaddr":"/ip4/172.18.133.99/tcp/59786/p2p/16Uiu2HAmDugFQadZs8w7E3dz9RnjHvVnRbUV2XaGvMBWscRqa78J","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"UnknownOrigin"}]'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:48054/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.218.254/tcp/4658/p2p/16Uiu2HAkuytYJULuUeKsjfghqmoYFW3s9pHMjpXmphMkYTV6wVJZ","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"Discv5"},{"multiaddr":"/ip4/172.18.249.188/tcp/48812/p2p/16Uiu2HAmKNW1HcPVmwAqGxqNSF1Lsy9i4wdMD8Bgko5D4s4iogAK","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"UnknownOrigin"}]'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:36620/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.122.250/tcp/37636/p2p/16Uiu2HAm1qVBtt1dB3F5KKAW8Ls378QzbXBf9tQiuBBwZ6PZUL11","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.133.99/tcp/48055/p2p/16Uiu2HAmDugFQadZs8w7E3dz9RnjHvVnRbUV2XaGvMBWscRqa78J","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"Discv5"}]'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:49218/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.249.188/tcp/36621/p2p/16Uiu2HAmKNW1HcPVmwAqGxqNSF1Lsy9i4wdMD8Bgko5D4s4iogAK","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"Discv5"}]'
DEBUG  src.libs.common:common.py:47 Sleeping for 60 seconds
INFO  tests.e2e.test_network_conditions:test_network_conditions.py:79 Applying 3s latency to node3
INFO  src.steps.network_conditions:network_conditions.py:22 TC exec: ['sudo', '-n', 'nsenter', '-t', '4848', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
INFO  src.steps.network_conditions:network_conditions.py:22 TC exec: ['sudo', '-n', 'nsenter', '-t', '4848', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'delay', '3000ms']
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:55672/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[]'
INFO  tests.e2e.test_network_conditions:test_network_conditions.py:86 Observed GET latency on node3: 6.00s
DEBUG  tests.conftest:conftest.py:59 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:83 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 38b773269b5e
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 4d306ceb7e8a
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id a4cbe3e1acb7
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 38b773269b5e. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 012fff8877d4
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 4d306ceb7e8a. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id dfa7bf1642a4
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container a4cbe3e1acb7. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 7bae90d97258
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 012fff8877d4. Exiting log stream.
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container dfa7bf1642a4. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 38801277d349
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  tests.conftest:conftest.py:98 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 7bae90d97258. Exiting log stream.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.