132 lines
27 KiB
Plaintext
Raw Blame History

This file contains invisible Unicode characters

This file contains invisible Unicode characters that are indistinguishable to humans but may be processed differently by a computer. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

DEBUG  tests.conftest:conftest.py:51 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:57 Running test: test_relay_4_nodes_sender_latency with id: 2026-02-03_04-34-07__143dadc3-a4a7-4597-811d-0cd277078110
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.steps.relay:relay.py:28 Running fixture setup: relay_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node1_2026-02-03_04-34-07__143dadc3-a4a7-4597-811d-0cd277078110__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node2_2026-02-03_04-34-07__143dadc3-a4a7-4597-811d-0cd277078110__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node3_2026-02-03_04-34-07__143dadc3-a4a7-4597-811d-0cd277078110__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node4_2026-02-03_04-34-07__143dadc3-a4a7-4597-811d-0cd277078110__wakuorg_nwaku:latest.log
INFO  tests.e2e.test_network_conditions:test_network_conditions.py:94 Starting 4 nodes with relay enabled (bootstrap chain)
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.106.230
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['48095', '48096', '48097', '48098', '48099']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 48095:48095 -p 48096:48096 -p 48097:48097 -p 48098:48098 -p 48099:48099 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=48097 --rest-port=48095 --tcp-port=48096 --discv5-udp-port=48098 --rest-address=0.0.0.0 --nat=extip:172.18.106.230 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=7e433abed416c0a2e8f683acec0ec606f8003b1ce04046d3efe71524ef8b41ec --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=48099 --metrics-logging=true --relay=true
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.106.230 waku 4e8857df294f67758f550b542203c32e0905cbc4aee85bdee68db284fdf3fac2
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 4e8857df294f. Setting up logs at ./log/docker/node1_2026-02-03_04-34-07__143dadc3-a4a7-4597-811d-0cd277078110__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 48095
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container eca6e4ddd10c. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:48095/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:48095/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.106.230/tcp/48096/p2p/16Uiu2HAmRano2Hqqtyt92gENNEAuEeddQypwiKXvQFiFSPScYP7s","/ip4/172.18.106.230/tcp/48097/ws/p2p/16Uiu2HAmRano2Hqqtyt92gENNEAuEeddQypwiKXvQFiFSPScYP7s"],"enrUri":"enr:-L24QGM64qsdwG6Q0SxBMkS-HbJaVXV7YiXOP9eiCtU0C59VKb_Im-xejISdrJSnYct_ujyak5DSoM1utZV-ed7FhawCgmlkgnY0gmlwhKwSauaKbXVsdGlhZGRyc5YACASsEmrmBrvgAAoErBJq5ga74d0DgnJzhQADAQAAiXNlY3AyNTZrMaEDwBSKP1IFgrkfYv6romqxoV-rYmZw8LLptgHuoDn3O06DdGNwgrvgg3VkcIK74oV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.35.236
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['6592', '6593', '6594', '6595', '6596']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 6592:6592 -p 6593:6593 -p 6594:6594 -p 6595:6595 -p 6596:6596 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=6594 --rest-port=6592 --tcp-port=6593 --discv5-udp-port=6595 --rest-address=0.0.0.0 --nat=extip:172.18.35.236 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=a9d0bfcca60edece1ffb2d68fc11f0f33bf625731babbb8bb9abbf88745a04c0 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=6596 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QGM64qsdwG6Q0SxBMkS-HbJaVXV7YiXOP9eiCtU0C59VKb_Im-xejISdrJSnYct_ujyak5DSoM1utZV-ed7FhawCgmlkgnY0gmlwhKwSauaKbXVsdGlhZGRyc5YACASsEmrmBrvgAAoErBJq5ga74d0DgnJzhQADAQAAiXNlY3AyNTZrMaEDwBSKP1IFgrkfYv6romqxoV-rYmZw8LLptgHuoDn3O06DdGNwgrvgg3VkcIK74oV3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.35.236 waku 903e532829287d4752a76c567d5b81a6c64876e2c779b35032364f49a1bad86f
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 903e53282928. Setting up logs at ./log/docker/node2_2026-02-03_04-34-07__143dadc3-a4a7-4597-811d-0cd277078110__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 6592
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:6592/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:6592/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.35.236/tcp/6593/p2p/16Uiu2HAmDdtyDdz51fDrQtRw7Msj48SxFyubVhMSqNiYZi8D964R","/ip4/172.18.35.236/tcp/6594/ws/p2p/16Uiu2HAmDdtyDdz51fDrQtRw7Msj48SxFyubVhMSqNiYZi8D964R"],"enrUri":"enr:-L24QC45QfAWH2DUovDKwUkyZYJBCqUnz_0VmkdWgkebLq18cidMSYFMiTgAN3QWVXKWC2JwxANjyjeX6UCVOC__jfoCgmlkgnY0gmlwhKwSI-yKbXVsdGlhZGRyc5YACASsEiPsBhnBAAoErBIj7AYZwt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDDpQFtwq1N5gYQoVi80pyHAZ-HVEx0VS0OcvVD1QoJRqDdGNwghnBg3VkcIIZw4V3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.97.134
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['4531', '4532', '4533', '4534', '4535']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 4531:4531 -p 4532:4532 -p 4533:4533 -p 4534:4534 -p 4535:4535 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=4533 --rest-port=4531 --tcp-port=4532 --discv5-udp-port=4534 --rest-address=0.0.0.0 --nat=extip:172.18.97.134 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=4a447db2f9dcbcbacdee7bc3ebdb6cbe8dc36ab3ec13c2ab4a826fb8e4fe6d02 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=4535 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QC45QfAWH2DUovDKwUkyZYJBCqUnz_0VmkdWgkebLq18cidMSYFMiTgAN3QWVXKWC2JwxANjyjeX6UCVOC__jfoCgmlkgnY0gmlwhKwSI-yKbXVsdGlhZGRyc5YACASsEiPsBhnBAAoErBIj7AYZwt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDDpQFtwq1N5gYQoVi80pyHAZ-HVEx0VS0OcvVD1QoJRqDdGNwghnBg3VkcIIZw4V3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.97.134 waku 2ef7e59b57949fd1eaa8a2dae1049f8f699baa534f141d50c578e459936f50e3
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 2ef7e59b5794. Setting up logs at ./log/docker/node3_2026-02-03_04-34-07__143dadc3-a4a7-4597-811d-0cd277078110__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 4531
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:4531/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:4531/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.97.134/tcp/4532/p2p/16Uiu2HAmMStvdiqBpgDnfYBs5wthp3wBrRRKicHAkBaMa8AbPtRo","/ip4/172.18.97.134/tcp/4533/ws/p2p/16Uiu2HAmMStvdiqBpgDnfYBs5wthp3wBrRRKicHAkBaMa8AbPtRo"],"enrUri":"enr:-L24QEHyYrudvAFxwYtJxi_E1MBdAG9sDEBtfgK3KjgmXy5Ue7r6klEgOjZel2R8rxZt28-iM5xG6n3B5SzkLYIMkMYCgmlkgnY0gmlwhKwSYYaKbXVsdGlhZGRyc5YACASsEmGGBhG0AAoErBJhhgYRtd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDgqAUFQFEnx7I3cD5LuicZJy6qQBvqgwW19ZKw_XCRjqDdGNwghG0g3VkcIIRtoV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.237.27
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['45216', '45217', '45218', '45219', '45220']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 45216:45216 -p 45217:45217 -p 45218:45218 -p 45219:45219 -p 45220:45220 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=45218 --rest-port=45216 --tcp-port=45217 --discv5-udp-port=45219 --rest-address=0.0.0.0 --nat=extip:172.18.237.27 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=fa6cbade0eb1f4bfb80f5dcdd1caf1cdfbd9dcb4ee33dc3ac2b56ae6bccf9493 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=45220 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QEHyYrudvAFxwYtJxi_E1MBdAG9sDEBtfgK3KjgmXy5Ue7r6klEgOjZel2R8rxZt28-iM5xG6n3B5SzkLYIMkMYCgmlkgnY0gmlwhKwSYYaKbXVsdGlhZGRyc5YACASsEmGGBhG0AAoErBJhhgYRtd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDgqAUFQFEnx7I3cD5LuicZJy6qQBvqgwW19ZKw_XCRjqDdGNwghG0g3VkcIIRtoV3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.237.27 waku 4863232d702131098ba0486f032380b8e06224c7ca3828993a7130ae9a8429c3
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 4863232d7021. Setting up logs at ./log/docker/node4_2026-02-03_04-34-07__143dadc3-a4a7-4597-811d-0cd277078110__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 45216
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:45216/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:45216/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.237.27/tcp/45217/p2p/16Uiu2HAm9CVn7RHhtRPw4we5a8jr8L3Nc8H1CcEfFmuKqaZJcQd4","/ip4/172.18.237.27/tcp/45218/ws/p2p/16Uiu2HAm9CVn7RHhtRPw4we5a8jr8L3Nc8H1CcEfFmuKqaZJcQd4"],"enrUri":"enr:-L24QOXE3MUA5qLlwhLfWrPOmIwOEdQqtbZOGNdaiA2QF_dKA-TAdyOGfmKRTehZG2zRL-I32NvbswzrkO3lgl15xGsCgmlkgnY0gmlwhKwS7RuKbXVsdGlhZGRyc5YACASsEu0bBrChAAoErBLtGwawot0DgnJzhQADAQAAiXNlY3AyNTZrMaECzKOIG9nvxNHOiU6xX3uWbQnYejm5BjP6ZRcN3VbevC-DdGNwgrChg3VkcIKwo4V3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:48095/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:6592/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:4531/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:45216/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:48095/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.35.236/tcp/50462/p2p/16Uiu2HAmDdtyDdz51fDrQtRw7Msj48SxFyubVhMSqNiYZi8D964R","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"UnknownOrigin"}]'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:6592/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.97.134/tcp/59552/p2p/16Uiu2HAmMStvdiqBpgDnfYBs5wthp3wBrRRKicHAkBaMa8AbPtRo","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.106.230/tcp/48096/p2p/16Uiu2HAmRano2Hqqtyt92gENNEAuEeddQypwiKXvQFiFSPScYP7s","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"Discv5"}]'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:4531/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.237.27/tcp/44894/p2p/16Uiu2HAm9CVn7RHhtRPw4we5a8jr8L3Nc8H1CcEfFmuKqaZJcQd4","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.35.236/tcp/6593/p2p/16Uiu2HAmDdtyDdz51fDrQtRw7Msj48SxFyubVhMSqNiYZi8D964R","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"Discv5"}]'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:45216/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.97.134/tcp/4532/p2p/16Uiu2HAmMStvdiqBpgDnfYBs5wthp3wBrRRKicHAkBaMa8AbPtRo","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"Discv5"}]'
DEBUG  src.libs.common:common.py:47 Sleeping for 40 seconds
INFO  tests.e2e.test_network_conditions:test_network_conditions.py:108 Applying 3000ms latency on sender node1
INFO  src.steps.network_conditions:network_conditions.py:22 TC exec: ['sudo', '-n', 'nsenter', '-t', '9373', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
INFO  src.steps.network_conditions:network_conditions.py:22 TC exec: ['sudo', '-n', 'nsenter', '-t', '9373', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'delay', '3000ms']
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:48095/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:45216/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1770093292529812130,"ephemeral":false,"proof":""}]'
INFO  src.steps.network_conditions:network_conditions.py:22 TC exec: ['sudo', '-n', 'nsenter', '-t', '9373', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
DEBUG  tests.conftest:conftest.py:59 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:83 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 4e8857df294f
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 903e53282928
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 2ef7e59b5794
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 4e8857df294f. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 4863232d7021
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 903e53282928. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  tests.conftest:conftest.py:98 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.