132 lines
27 KiB
Plaintext
Raw Blame History

This file contains invisible Unicode characters

This file contains invisible Unicode characters that are indistinguishable to humans but may be processed differently by a computer. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

DEBUG  tests.conftest:conftest.py:51 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:57 Running test: test_relay_4_nodes_sender_latency with id: 2026-02-26_04-35-32__104c5654-9846-40f8-a7ea-2fb47cfedda3
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.steps.relay:relay.py:28 Running fixture setup: relay_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node1_2026-02-26_04-35-32__104c5654-9846-40f8-a7ea-2fb47cfedda3__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node2_2026-02-26_04-35-32__104c5654-9846-40f8-a7ea-2fb47cfedda3__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node3_2026-02-26_04-35-32__104c5654-9846-40f8-a7ea-2fb47cfedda3__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node4_2026-02-26_04-35-32__104c5654-9846-40f8-a7ea-2fb47cfedda3__wakuorg_nwaku:latest.log
INFO  tests.e2e.test_network_conditions:test_network_conditions.py:94 Starting 4 nodes with relay enabled (bootstrap chain)
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.81.168
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['35470', '35471', '35472', '35473', '35474']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 35470:35470 -p 35471:35471 -p 35472:35472 -p 35473:35473 -p 35474:35474 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=35472 --rest-port=35470 --tcp-port=35471 --discv5-udp-port=35473 --rest-address=0.0.0.0 --nat=extip:172.18.81.168 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=fbccdfb5e36e6b91e79fdc6f320f0597c5c9437d44e2bc81783dfc47d715b87f --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=35474 --metrics-logging=true --relay=true
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container fc5ec0c6e90d. Exiting log stream.
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.81.168 waku 2ae515046df921f16753200bc29681e6863949fd27b58ddeeb16c0d881c5e548
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 2ae515046df9. Setting up logs at ./log/docker/node1_2026-02-26_04-35-32__104c5654-9846-40f8-a7ea-2fb47cfedda3__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 35470
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:35470/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:35470/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.81.168/tcp/35471/p2p/16Uiu2HAm9gZbs8Jb1WynGvicdraBKajhkbLZPFRzuQSiMv3UNFgu","/ip4/172.18.81.168/tcp/35472/ws/p2p/16Uiu2HAm9gZbs8Jb1WynGvicdraBKajhkbLZPFRzuQSiMv3UNFgu"],"enrUri":"enr:-L24QMr-CBdqn_LUGKE3xf-5nFnIOjaGzPFGtcodCR-dRQ4oB1hpDvsuOsaKkgEnUODnmguTxp64hVAp7tqmNUmt1A8CgmlkgnY0gmlwhKwSUaiKbXVsdGlhZGRyc5YACASsElGoBoqPAAoErBJRqAaKkN0DgnJzhQADAQAAiXNlY3AyNTZrMaEC09QeDU3muvV07SWNeFtG0QRHd4_-rjun2HBasEfcznqDdGNwgoqPg3VkcIKKkYV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.219.134
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['26729', '26730', '26731', '26732', '26733']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 26729:26729 -p 26730:26730 -p 26731:26731 -p 26732:26732 -p 26733:26733 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=26731 --rest-port=26729 --tcp-port=26730 --discv5-udp-port=26732 --rest-address=0.0.0.0 --nat=extip:172.18.219.134 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=4d580288a3d9bffe0e5c26975d5be9ead1e2d1f265ea9ed42ebfba999c8fb848 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=26733 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QMr-CBdqn_LUGKE3xf-5nFnIOjaGzPFGtcodCR-dRQ4oB1hpDvsuOsaKkgEnUODnmguTxp64hVAp7tqmNUmt1A8CgmlkgnY0gmlwhKwSUaiKbXVsdGlhZGRyc5YACASsElGoBoqPAAoErBJRqAaKkN0DgnJzhQADAQAAiXNlY3AyNTZrMaEC09QeDU3muvV07SWNeFtG0QRHd4_-rjun2HBasEfcznqDdGNwgoqPg3VkcIKKkYV3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.219.134 waku f18026adc46a84a54694b86ec2d9434758ee5240d7fbb17d8e89b8c88add2183
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID f18026adc46a. Setting up logs at ./log/docker/node2_2026-02-26_04-35-32__104c5654-9846-40f8-a7ea-2fb47cfedda3__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 26729
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:26729/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:26729/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.219.134/tcp/26730/p2p/16Uiu2HAm1GVGJLu7zJmATLq5ArcCinLhFFDyLY1sJfRVm3dpMrrx","/ip4/172.18.219.134/tcp/26731/ws/p2p/16Uiu2HAm1GVGJLu7zJmATLq5ArcCinLhFFDyLY1sJfRVm3dpMrrx"],"enrUri":"enr:-L24QCys185leERpRUtcGwOwTLsy6gbXch8oDDhnkqQvKI88b232NYEaStHf1pzcIa6UT5fH1oD-8NcyPGt7wbd2QpoCgmlkgnY0gmlwhKwS24aKbXVsdGlhZGRyc5YACASsEtuGBmhqAAoErBLbhgZoa90DgnJzhQADAQAAiXNlY3AyNTZrMaECVsvHQFlP0MDsRlDcejdGukkOEt12UnYjfU-xnsvmcUWDdGNwgmhqg3VkcIJobIV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.210.84
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['9400', '9401', '9402', '9403', '9404']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 9400:9400 -p 9401:9401 -p 9402:9402 -p 9403:9403 -p 9404:9404 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=9402 --rest-port=9400 --tcp-port=9401 --discv5-udp-port=9403 --rest-address=0.0.0.0 --nat=extip:172.18.210.84 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=b6efb56fa61a56afaa33eaaae70085ff07f8cb031fddfaddec4cb2fdb5ece8f1 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=9404 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QCys185leERpRUtcGwOwTLsy6gbXch8oDDhnkqQvKI88b232NYEaStHf1pzcIa6UT5fH1oD-8NcyPGt7wbd2QpoCgmlkgnY0gmlwhKwS24aKbXVsdGlhZGRyc5YACASsEtuGBmhqAAoErBLbhgZoa90DgnJzhQADAQAAiXNlY3AyNTZrMaECVsvHQFlP0MDsRlDcejdGukkOEt12UnYjfU-xnsvmcUWDdGNwgmhqg3VkcIJobIV3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.210.84 waku a51841c422d9a81ed13baa1174ab1582b6fb514ced256e3a0c62eebe82c0d8f8
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID a51841c422d9. Setting up logs at ./log/docker/node3_2026-02-26_04-35-32__104c5654-9846-40f8-a7ea-2fb47cfedda3__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 9400
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:9400/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:9400/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.210.84/tcp/9401/p2p/16Uiu2HAmJQNuDkuCKZqy472rTPN83F51z6gkQehVPqfoUxitV7GS","/ip4/172.18.210.84/tcp/9402/ws/p2p/16Uiu2HAmJQNuDkuCKZqy472rTPN83F51z6gkQehVPqfoUxitV7GS"],"enrUri":"enr:-L24QAw-cM2Q9Ull6I306yap9zzYWxwc6vNa3x0iz6vk6OM8G2uWLnqraonRj_v4ORoyUQESh4PG4OXJKVElZ7bMkfsCgmlkgnY0gmlwhKwS0lSKbXVsdGlhZGRyc5YACASsEtJUBiS5AAoErBLSVAYkut0DgnJzhQADAQAAiXNlY3AyNTZrMaEDVWfoSrzrR3rMjpnkPRP_VWOlXVGXD7nqgMAUu5bBrMeDdGNwgiS5g3VkcIIku4V3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.96.201
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['2676', '2677', '2678', '2679', '2680']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 2676:2676 -p 2677:2677 -p 2678:2678 -p 2679:2679 -p 2680:2680 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=2678 --rest-port=2676 --tcp-port=2677 --discv5-udp-port=2679 --rest-address=0.0.0.0 --nat=extip:172.18.96.201 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=69ce936cfac0ed616cdef487658ca039cd3e0ad47aced527a3b8eccfac3b3ed5 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=2680 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QAw-cM2Q9Ull6I306yap9zzYWxwc6vNa3x0iz6vk6OM8G2uWLnqraonRj_v4ORoyUQESh4PG4OXJKVElZ7bMkfsCgmlkgnY0gmlwhKwS0lSKbXVsdGlhZGRyc5YACASsEtJUBiS5AAoErBLSVAYkut0DgnJzhQADAQAAiXNlY3AyNTZrMaEDVWfoSrzrR3rMjpnkPRP_VWOlXVGXD7nqgMAUu5bBrMeDdGNwgiS5g3VkcIIku4V3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.96.201 waku 56a79e7c241f6c43bbef1c948ca84e8a31d69f4ebc7921c900d63d6468f12409
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 56a79e7c241f. Setting up logs at ./log/docker/node4_2026-02-26_04-35-32__104c5654-9846-40f8-a7ea-2fb47cfedda3__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 2676
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:2676/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:2676/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.96.201/tcp/2677/p2p/16Uiu2HAm9VjYy5rvMj9jVnVPuaVsZoVopzgbfUnp7dXjwHsp62T1","/ip4/172.18.96.201/tcp/2678/ws/p2p/16Uiu2HAm9VjYy5rvMj9jVnVPuaVsZoVopzgbfUnp7dXjwHsp62T1"],"enrUri":"enr:-L24QLmRB2nfL5_cK1iWl17XZ3OFHIBt9pnw-5KL_65t688mIjvGmDiurEvFDfdUvjHt5skw8_6NFkaKkazS7zaC_TUCgmlkgnY0gmlwhKwSYMmKbXVsdGlhZGRyc5YACASsEmDJBgp1AAoErBJgyQYKdt0DgnJzhQADAQAAiXNlY3AyNTZrMaEC0Q36oqsInqKzxjExxA0KGloNwO2FnQhGEzD-UdLVFgCDdGNwggp1g3VkcIIKd4V3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:35470/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:26729/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:9400/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:2676/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:35470/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.219.134/tcp/49004/p2p/16Uiu2HAm1GVGJLu7zJmATLq5ArcCinLhFFDyLY1sJfRVm3dpMrrx","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"UnknownOrigin"}]'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:26729/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.210.84/tcp/45452/p2p/16Uiu2HAmJQNuDkuCKZqy472rTPN83F51z6gkQehVPqfoUxitV7GS","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.81.168/tcp/35471/p2p/16Uiu2HAm9gZbs8Jb1WynGvicdraBKajhkbLZPFRzuQSiMv3UNFgu","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"Discv5"}]'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:9400/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.219.134/tcp/26730/p2p/16Uiu2HAm1GVGJLu7zJmATLq5ArcCinLhFFDyLY1sJfRVm3dpMrrx","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"Discv5"},{"multiaddr":"/ip4/172.18.96.201/tcp/45726/p2p/16Uiu2HAm9VjYy5rvMj9jVnVPuaVsZoVopzgbfUnp7dXjwHsp62T1","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"UnknownOrigin"}]'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:2676/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.210.84/tcp/9401/p2p/16Uiu2HAmJQNuDkuCKZqy472rTPN83F51z6gkQehVPqfoUxitV7GS","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"Discv5"}]'
DEBUG  src.libs.common:common.py:47 Sleeping for 40 seconds
INFO  tests.e2e.test_network_conditions:test_network_conditions.py:108 Applying 3000ms latency on sender node1
INFO  src.steps.network_conditions:network_conditions.py:22 TC exec: ['sudo', '-n', 'nsenter', '-t', '8962', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
INFO  src.steps.network_conditions:network_conditions.py:22 TC exec: ['sudo', '-n', 'nsenter', '-t', '8962', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'delay', '3000ms']
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:35470/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:2676/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772080577849579243,"ephemeral":false,"proof":""}]'
INFO  src.steps.network_conditions:network_conditions.py:22 TC exec: ['sudo', '-n', 'nsenter', '-t', '8962', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
DEBUG  tests.conftest:conftest.py:59 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:83 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 2ae515046df9
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id f18026adc46a
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id a51841c422d9
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 2ae515046df9. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 56a79e7c241f
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container f18026adc46a. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  tests.conftest:conftest.py:98 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.