2026-04-22 15:08:14 +00:00

147 lines
28 KiB
Plaintext
Raw Blame History

This file contains invisible Unicode characters

This file contains invisible Unicode characters that are indistinguishable to humans but may be processed differently by a computer. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

DEBUG  tests.conftest:conftest.py:51 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:57 Running test: test_relay_4_nodes_sender_packet_loss with id: 2026-04-22_14-38-49__227def78-e8ff-4387-8878-c7b473e29835
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.steps.relay:relay.py:28 Running fixture setup: relay_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:108 WakuNode instance initialized with log path ./log/docker/node1_2026-04-22_14-38-49__227def78-e8ff-4387-8878-c7b473e29835__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:108 WakuNode instance initialized with log path ./log/docker/node2_2026-04-22_14-38-49__227def78-e8ff-4387-8878-c7b473e29835__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:108 WakuNode instance initialized with log path ./log/docker/node3_2026-04-22_14-38-49__227def78-e8ff-4387-8878-c7b473e29835__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:108 WakuNode instance initialized with log path ./log/docker/node4_2026-04-22_14-38-49__227def78-e8ff-4387-8878-c7b473e29835__wakuorg_nwaku:latest.log
INFO  tests.e2e.test_network_conditions:test_network_conditions.py:285 Starting 4 nodes with relay enabled (bootstrap chain)
DEBUG  src.node.waku_node:waku_node.py:116 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.140.136
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['63869', '63870', '63871', '63872', '63873']
DEBUG  src.node.waku_node:waku_node.py:606 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:211 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:217 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 63869:63869 -p 63870:63870 -p 63871:63871 -p 63872:63872 -p 63873:63873 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=63871 --rest-port=63869 --tcp-port=63870 --discv5-udp-port=63872 --rest-address=0.0.0.0 --nat=extip:172.18.140.136 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=c7deede9fec13b7bac5107ccb73d2a0fb4e018ba4b3a5bee018c61bd5be44706 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=63873 --metrics-logging=true --relay=true
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.140.136 waku 82a9d2bce88370c9aea2fffa963f5e2b36477483f080ddd77bd9d0e1058911b5
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 82a9d2bce883. Setting up logs at ./log/docker/node1_2026-04-22_14-38-49__227def78-e8ff-4387-8878-c7b473e29835__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:228 Started container from image wakuorg/nwaku:latest. REST: 63869
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 597aec67c001. Exiting log stream.
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container a782516f8a51. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:63869/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:412 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:63869/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.140.136/tcp/63870/p2p/16Uiu2HAm9fgGXXakmx2iorhhRPUsczwVDCHsgx94xiJvURr9iqGp","/ip4/172.18.140.136/tcp/63871/ws/p2p/16Uiu2HAm9fgGXXakmx2iorhhRPUsczwVDCHsgx94xiJvURr9iqGp"],"enrUri":"enr:-L24QHUb47N_jTjY0vQmZTKZJJ-Ith7jyCrfRx3yILxJwkqmdXPA8rr_7oHfyLbqT3u-E_ai2IpA8V1CPQJrWgh8TbgCgmlkgnY0gmlwhKwSjIiKbXVsdGlhZGRyc5YACASsEoyIBvl-AAoErBKMiAb5f90DgnJzhQDGAQAAiXNlY3AyNTZrMaEC05oTE3_fy9TBX9s3j70qjBVevJcBdy49o6QjsBfog12DdGNwgvl-g3VkcIL5gIV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:417 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:116 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.22.161
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['2138', '2139', '2140', '2141', '2142']
DEBUG  src.node.waku_node:waku_node.py:606 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:211 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:217 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 2138:2138 -p 2139:2139 -p 2140:2140 -p 2141:2141 -p 2142:2142 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=2140 --rest-port=2138 --tcp-port=2139 --discv5-udp-port=2141 --rest-address=0.0.0.0 --nat=extip:172.18.22.161 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=a383ef268f2f9aa6efd8afa4c2bc2ce0e6ffbf5641bfb63db906b92ffd55004c --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=2142 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QHUb47N_jTjY0vQmZTKZJJ-Ith7jyCrfRx3yILxJwkqmdXPA8rr_7oHfyLbqT3u-E_ai2IpA8V1CPQJrWgh8TbgCgmlkgnY0gmlwhKwSjIiKbXVsdGlhZGRyc5YACASsEoyIBvl-AAoErBKMiAb5f90DgnJzhQDGAQAAiXNlY3AyNTZrMaEC05oTE3_fy9TBX9s3j70qjBVevJcBdy49o6QjsBfog12DdGNwgvl-g3VkcIL5gIV3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.22.161 waku f0da8128864220f91841787d78faf215f31d7712fc225ac00c2c74e0b9eff3c9
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID f0da81288642. Setting up logs at ./log/docker/node2_2026-04-22_14-38-49__227def78-e8ff-4387-8878-c7b473e29835__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:228 Started container from image wakuorg/nwaku:latest. REST: 2138
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:2138/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:412 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:2138/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.22.161/tcp/2139/p2p/16Uiu2HAmQ1ZoPGdS2szorFM6SbxJ1b26UgQQC2FVZcT6t3stMMyQ","/ip4/172.18.22.161/tcp/2140/ws/p2p/16Uiu2HAmQ1ZoPGdS2szorFM6SbxJ1b26UgQQC2FVZcT6t3stMMyQ"],"enrUri":"enr:-L24QPCB-I_UyGq5MawlPQq3r6nJIkqJY_NgzHRUy1uYvlBjZ2ODLDYUQ-MAiXBojZ6BI464XFUTCHzVkcam2IFOyOUCgmlkgnY0gmlwhKwSFqGKbXVsdGlhZGRyc5YACASsEhahBghbAAoErBIWoQYIXN0DgnJzhQDGAQAAiXNlY3AyNTZrMaEDqLX-iu8NUTba304XmYW2bl02UKQb5nAgLtWnt3U3CyeDdGNwgghbg3VkcIIIXYV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:417 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:116 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.142.224
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['10139', '10140', '10141', '10142', '10143']
DEBUG  src.node.waku_node:waku_node.py:606 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:211 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:217 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 10139:10139 -p 10140:10140 -p 10141:10141 -p 10142:10142 -p 10143:10143 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=10141 --rest-port=10139 --tcp-port=10140 --discv5-udp-port=10142 --rest-address=0.0.0.0 --nat=extip:172.18.142.224 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=a99bbbebad790fcc90106aa8cf9f22ca94e4375a94eacd1b1cbbaddabfa23acd --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=10143 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QPCB-I_UyGq5MawlPQq3r6nJIkqJY_NgzHRUy1uYvlBjZ2ODLDYUQ-MAiXBojZ6BI464XFUTCHzVkcam2IFOyOUCgmlkgnY0gmlwhKwSFqGKbXVsdGlhZGRyc5YACASsEhahBghbAAoErBIWoQYIXN0DgnJzhQDGAQAAiXNlY3AyNTZrMaEDqLX-iu8NUTba304XmYW2bl02UKQb5nAgLtWnt3U3CyeDdGNwgghbg3VkcIIIXYV3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.142.224 waku 9f04499fe08e818d0c5746ebbc4ed52c9519e4bb304eb1a8516ac2f69e23b4a3
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 9f04499fe08e. Setting up logs at ./log/docker/node3_2026-04-22_14-38-49__227def78-e8ff-4387-8878-c7b473e29835__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:228 Started container from image wakuorg/nwaku:latest. REST: 10139
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:10139/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:412 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:10139/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.142.224/tcp/10140/p2p/16Uiu2HAmGXUeZygibsa8RYF4mmj38DBPgSTUfEj9yeGwhWmAeM3o","/ip4/172.18.142.224/tcp/10141/ws/p2p/16Uiu2HAmGXUeZygibsa8RYF4mmj38DBPgSTUfEj9yeGwhWmAeM3o"],"enrUri":"enr:-L24QPoO1AAqOVavWUG-qLEp29IJivpDB0yo1KVDlwgnrDjJXy83VGqnme8nvNPbYFrK5lEv9oKd_DC4Wbq4cjTcOnUCgmlkgnY0gmlwhKwSjuCKbXVsdGlhZGRyc5YACASsEo7gBiecAAoErBKO4AYnnd0DgnJzhQDGAQAAiXNlY3AyNTZrMaEDOYIZCShGy4SHIZHodFL5qNTIBjm3G2C0MihmpQeUBYqDdGNwgiecg3VkcIInnoV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:417 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:116 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.177.51
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['47704', '47705', '47706', '47707', '47708']
DEBUG  src.node.waku_node:waku_node.py:606 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:211 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:217 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 47704:47704 -p 47705:47705 -p 47706:47706 -p 47707:47707 -p 47708:47708 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=47706 --rest-port=47704 --tcp-port=47705 --discv5-udp-port=47707 --rest-address=0.0.0.0 --nat=extip:172.18.177.51 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=aeab1d0ea98cbdc4767db5fb3ed8ee0dbc58eaa13bd961a8a66df86a64a1ba51 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=47708 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QPoO1AAqOVavWUG-qLEp29IJivpDB0yo1KVDlwgnrDjJXy83VGqnme8nvNPbYFrK5lEv9oKd_DC4Wbq4cjTcOnUCgmlkgnY0gmlwhKwSjuCKbXVsdGlhZGRyc5YACASsEo7gBiecAAoErBKO4AYnnd0DgnJzhQDGAQAAiXNlY3AyNTZrMaEDOYIZCShGy4SHIZHodFL5qNTIBjm3G2C0MihmpQeUBYqDdGNwgiecg3VkcIInnoV3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.177.51 waku 7563377c546f6ad2f4fac056cf1f16b7c9a89841ba35621ba3c37c8b8b5e0b23
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 7563377c546f. Setting up logs at ./log/docker/node4_2026-04-22_14-38-49__227def78-e8ff-4387-8878-c7b473e29835__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:228 Started container from image wakuorg/nwaku:latest. REST: 47704
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:47704/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:412 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:47704/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.177.51/tcp/47705/p2p/16Uiu2HAmVGNQyweUEToZuxP3zcZ2sasGsfQWmE9iNiFZmEG8mWw5","/ip4/172.18.177.51/tcp/47706/ws/p2p/16Uiu2HAmVGNQyweUEToZuxP3zcZ2sasGsfQWmE9iNiFZmEG8mWw5"],"enrUri":"enr:-L24QO0xwbeOazkSfE8jNG1fL00RqjL0QWNIu_cegzYJ96KLBArMwgB-ofP7bFnmgkHxli560wMPHjNlu3tmbtzSO6QCgmlkgnY0gmlwhKwSsTOKbXVsdGlhZGRyc5YACASsErEzBrpZAAoErBKxMwa6Wt0DgnJzhQDGAQAAiXNlY3AyNTZrMaED9stEQGG1EqH4TLr9rwsVmUvtPhtWW0RNVvx-HfwFz0SDdGNwgrpZg3VkcIK6W4V3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:417 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:63869/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:2138/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:10139/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:47704/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:63869/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.22.161/tcp/35984/p2p/16Uiu2HAmQ1ZoPGdS2szorFM6SbxJ1b26UgQQC2FVZcT6t3stMMyQ","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-\\"v0.38.0-16-g260def\\"","origin":"UnknownOrigin"}]'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:2138/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.140.136/tcp/63870/p2p/16Uiu2HAm9fgGXXakmx2iorhhRPUsczwVDCHsgx94xiJvURr9iqGp","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-\\"v0.38.0-16-g260def\\"","origin":"Discv5"},{"multiaddr":"/ip4/172.18.142.224/tcp/36054/p2p/16Uiu2HAmGXUeZygibsa8RYF4mmj38DBPgSTUfEj9yeGwhWmAeM3o","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-\\"v0.38.0-16-g260def\\"","origin":"UnknownOrigin"}]'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:10139/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.177.51/tcp/52828/p2p/16Uiu2HAmVGNQyweUEToZuxP3zcZ2sasGsfQWmE9iNiFZmEG8mWw5","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-\\"v0.38.0-16-g260def\\"","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.22.161/tcp/2139/p2p/16Uiu2HAmQ1ZoPGdS2szorFM6SbxJ1b26UgQQC2FVZcT6t3stMMyQ","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-\\"v0.38.0-16-g260def\\"","origin":"Discv5"}]'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:47704/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.142.224/tcp/10140/p2p/16Uiu2HAmGXUeZygibsa8RYF4mmj38DBPgSTUfEj9yeGwhWmAeM3o","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-\\"v0.38.0-16-g260def\\"","origin":"Discv5"}]'
DEBUG  src.libs.common:common.py:47 Sleeping for 20 seconds
INFO  tests.e2e.test_network_conditions:test_network_conditions.py:298 Applying 30.0% packet loss on sender node1
INFO  src.steps.network_conditions:network_conditions.py:23 TC exec: ['sudo', '-n', 'nsenter', '-t', '23443', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
INFO  src.steps.network_conditions:network_conditions.py:23 TC exec: ['sudo', '-n', 'nsenter', '-t', '23443', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'loss', '30.0%']
INFO  src.steps.network_conditions:network_conditions.py:23 TC exec: ['sudo', '-n', 'nsenter', '-t', '23443', '-n', 'tc', '-s', 'qdisc', 'show', 'dev', 'eth0']
DEBUG  src.steps.network_conditions:network_conditions.py:72 tc -s qdisc show dev eth0:
qdisc netem 8002: root refcnt 5 limit 1000 loss 30%
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:47704/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[]'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:63869/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.steps.network_conditions:network_conditions.py:23 TC exec: ['sudo', '-n', 'nsenter', '-t', '23443', '-n', 'tc', '-s', 'qdisc', 'show', 'dev', 'eth0']
DEBUG  src.steps.network_conditions:network_conditions.py:40 tc -s qdisc show dev eth0:
qdisc netem 8002: root refcnt 5 limit 1000 loss 30%
Sent 500 bytes 5 pkt (dropped 1, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:47704/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1776868755052963029,"ephemeral":false,"proof":""}]'
INFO  tests.e2e.test_network_conditions:test_network_conditions.py:319 Node4 received messages from node1 after 0 trails
INFO  src.steps.network_conditions:network_conditions.py:23 TC exec: ['sudo', '-n', 'nsenter', '-t', '23443', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
DEBUG  tests.conftest:conftest.py:59 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:83 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:343 Stopping container with id 82a9d2bce883
DEBUG  src.node.waku_node:waku_node.py:355 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:343 Stopping container with id f0da81288642
DEBUG  src.node.waku_node:waku_node.py:355 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:343 Stopping container with id 9f04499fe08e
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 82a9d2bce883. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:355 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:343 Stopping container with id 7563377c546f
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container f0da81288642. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:355 Container stopped.
DEBUG  tests.conftest:conftest.py:98 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.