133 lines
27 KiB
Plaintext

2026-02-28 04:26:33.045 DEBUG [tests.conftest] Running fixture setup: test_id
2026-02-28 04:26:33.045 DEBUG [tests.conftest] Running test: test_relay_4_nodes_sender_latency with id: 2026-02-28_04-26-33__d118c9a3-9f01-4200-9566-19b7fd9895a0
2026-02-28 04:26:33.046 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-02-28 04:26:33.046 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-02-28 04:26:33.053 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-28 04:26:33.053 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-02-28_04-26-33__d118c9a3-9f01-4200-9566-19b7fd9895a0__wakuorg_nwaku:latest.log
2026-02-28 04:26:33.059 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-28 04:26:33.060 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-02-28_04-26-33__d118c9a3-9f01-4200-9566-19b7fd9895a0__wakuorg_nwaku:latest.log
2026-02-28 04:26:33.066 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-28 04:26:33.066 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-02-28_04-26-33__d118c9a3-9f01-4200-9566-19b7fd9895a0__wakuorg_nwaku:latest.log
2026-02-28 04:26:33.072 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-28 04:26:33.073 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-02-28_04-26-33__d118c9a3-9f01-4200-9566-19b7fd9895a0__wakuorg_nwaku:latest.log
2026-02-28 04:26:33.073 INFO [tests.e2e.test_network_conditions] Starting 4 nodes with relay enabled (bootstrap chain)
2026-02-28 04:26:33.073 DEBUG [src.node.waku_node] Starting Node...
2026-02-28 04:26:33.073 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-28 04:26:33.074 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-28 04:26:33.075 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.253.176
2026-02-28 04:26:33.075 DEBUG [src.node.docker_mananger] Generated ports ['19075', '19076', '19077', '19078', '19079']
2026-02-28 04:26:33.075 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-28 04:26:33.075 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-28 04:26:33.075 DEBUG [src.node.waku_node] Using volumes []
2026-02-28 04:26:33.075 DEBUG [src.node.docker_mananger] docker run -i -t -p 19075:19075 -p 19076:19076 -p 19077:19077 -p 19078:19078 -p 19079:19079 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=19077 --rest-port=19075 --tcp-port=19076 --discv5-udp-port=19078 --rest-address=0.0.0.0 --nat=extip:172.18.253.176 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=bb4e32ad3c3cb6addea8a54ea5ac20bb5d21fba6a0da1a5e1e229d0abc776cbd --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=19079 --metrics-logging=true --relay=true
2026-02-28 04:26:33.245 ERROR [src.node.docker_mananger] Max retries reached for container 588316bb7bae. Exiting log stream.
2026-02-28 04:26:33.269 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.253.176 waku 6695e4c84dbe074c00ee383c8f5e16db196b181fd8ef1d6716f45233a45dddfb
2026-02-28 04:26:33.303 DEBUG [src.node.docker_mananger] Container started with ID 6695e4c84dbe. Setting up logs at ./log/docker/node1_2026-02-28_04-26-33__d118c9a3-9f01-4200-9566-19b7fd9895a0__wakuorg_nwaku:latest.log
2026-02-28 04:26:33.303 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 19075
2026-02-28 04:26:33.304 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-28 04:26:34.305 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19075/health" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:26:34.307 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-28 04:26:34.308 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-28 04:26:34.308 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19075/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:26:34.310 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.253.176/tcp/19076/p2p/16Uiu2HAmNCZ3VeU5fhZ8VkFJQbb27RtwbPkxmpt28hyDDHHEoXL9","/ip4/172.18.253.176/tcp/19077/ws/p2p/16Uiu2HAmNCZ3VeU5fhZ8VkFJQbb27RtwbPkxmpt28hyDDHHEoXL9"],"enrUri":"enr:-L24QK3enFdAnIQeuc4gDLHr1byFwy84e2Vt01EewGe01u8nd1Y1x6LZ6V-lO6JsQ1wElO9_coiPi66Rx3y5Qhy4rAcCgmlkgnY0gmlwhKwS_bCKbXVsdGlhZGRyc5YACASsEv2wBkqEAAoErBL9sAZKhd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDjc8nWl8I0M2hK_T4GGJZQ-eH-Gjo_3GcEzowmkKpq46DdGNwgkqEg3VkcIJKhoV3YWt1MgE"}'
2026-02-28 04:26:34.310 INFO [src.node.waku_node] REST service is ready !!
2026-02-28 04:26:34.311 DEBUG [src.node.waku_node] Starting Node...
2026-02-28 04:26:34.311 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-28 04:26:34.312 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-28 04:26:34.312 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.154.49
2026-02-28 04:26:34.312 DEBUG [src.node.docker_mananger] Generated ports ['23224', '23225', '23226', '23227', '23228']
2026-02-28 04:26:34.313 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-28 04:26:34.313 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-28 04:26:34.313 DEBUG [src.node.waku_node] Using volumes []
2026-02-28 04:26:34.313 DEBUG [src.node.docker_mananger] docker run -i -t -p 23224:23224 -p 23225:23225 -p 23226:23226 -p 23227:23227 -p 23228:23228 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=23226 --rest-port=23224 --tcp-port=23225 --discv5-udp-port=23227 --rest-address=0.0.0.0 --nat=extip:172.18.154.49 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=dd419aa5bd8e6170d8ebda88ccbb8dec05acdcb73deac0ad6adaed3b06da0372 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=23228 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QK3enFdAnIQeuc4gDLHr1byFwy84e2Vt01EewGe01u8nd1Y1x6LZ6V-lO6JsQ1wElO9_coiPi66Rx3y5Qhy4rAcCgmlkgnY0gmlwhKwS_bCKbXVsdGlhZGRyc5YACASsEv2wBkqEAAoErBL9sAZKhd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDjc8nWl8I0M2hK_T4GGJZQ-eH-Gjo_3GcEzowmkKpq46DdGNwgkqEg3VkcIJKhoV3YWt1MgE
2026-02-28 04:26:34.513 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.154.49 waku 8e94d17f19f9cee0458793cb41fe1184b19e4e0d833237cb4511472ab36d02d6
2026-02-28 04:26:34.547 DEBUG [src.node.docker_mananger] Container started with ID 8e94d17f19f9. Setting up logs at ./log/docker/node2_2026-02-28_04-26-33__d118c9a3-9f01-4200-9566-19b7fd9895a0__wakuorg_nwaku:latest.log
2026-02-28 04:26:34.547 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 23224
2026-02-28 04:26:34.548 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-28 04:26:35.548 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:23224/health" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:26:35.577 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-28 04:26:35.577 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-28 04:26:35.578 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:23224/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:26:35.585 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.154.49/tcp/23225/p2p/16Uiu2HAm7BN8XpBAj24v434uGxiqMkTATBTewQ9WDZjKeVk2Whrc","/ip4/172.18.154.49/tcp/23226/ws/p2p/16Uiu2HAm7BN8XpBAj24v434uGxiqMkTATBTewQ9WDZjKeVk2Whrc"],"enrUri":"enr:-L24QDVAYVMflNtjwFcJuVvzx3--CbHxU9WZJ0oTLfYBH_JTBCq53i-ObB_mlI3nlXEugV_VnyGFxefKczXnn5x3F1UCgmlkgnY0gmlwhKwSmjGKbXVsdGlhZGRyc5YACASsEpoxBlq5AAoErBKaMQZaut0DgnJzhQADAQAAiXNlY3AyNTZrMaECrqHt8oJAgmqmtaK-0iHccUJjZJ2kgu9TM0bMWRrTN9WDdGNwglq5g3VkcIJau4V3YWt1MgE"}'
2026-02-28 04:26:35.586 INFO [src.node.waku_node] REST service is ready !!
2026-02-28 04:26:35.587 DEBUG [src.node.waku_node] Starting Node...
2026-02-28 04:26:35.587 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-28 04:26:35.590 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-28 04:26:35.590 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.155.73
2026-02-28 04:26:35.591 DEBUG [src.node.docker_mananger] Generated ports ['64984', '64985', '64986', '64987', '64988']
2026-02-28 04:26:35.592 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-28 04:26:35.592 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-28 04:26:35.592 DEBUG [src.node.waku_node] Using volumes []
2026-02-28 04:26:35.592 DEBUG [src.node.docker_mananger] docker run -i -t -p 64984:64984 -p 64985:64985 -p 64986:64986 -p 64987:64987 -p 64988:64988 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=64986 --rest-port=64984 --tcp-port=64985 --discv5-udp-port=64987 --rest-address=0.0.0.0 --nat=extip:172.18.155.73 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=a2bdf8049ac9c5139299a1f1baba7919f0b4bee3cddebd26b1ab7d0fb842f7ed --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=64988 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QDVAYVMflNtjwFcJuVvzx3--CbHxU9WZJ0oTLfYBH_JTBCq53i-ObB_mlI3nlXEugV_VnyGFxefKczXnn5x3F1UCgmlkgnY0gmlwhKwSmjGKbXVsdGlhZGRyc5YACASsEpoxBlq5AAoErBKaMQZaut0DgnJzhQADAQAAiXNlY3AyNTZrMaECrqHt8oJAgmqmtaK-0iHccUJjZJ2kgu9TM0bMWRrTN9WDdGNwglq5g3VkcIJau4V3YWt1MgE
2026-02-28 04:26:35.791 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.155.73 waku 4a8e309f2add86cacb89a9691e79071d4a88556276ccc6bd1c53c57ae6c2c020
2026-02-28 04:26:35.827 DEBUG [src.node.docker_mananger] Container started with ID 4a8e309f2add. Setting up logs at ./log/docker/node3_2026-02-28_04-26-33__d118c9a3-9f01-4200-9566-19b7fd9895a0__wakuorg_nwaku:latest.log
2026-02-28 04:26:35.827 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 64984
2026-02-28 04:26:35.827 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-28 04:26:36.829 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64984/health" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:26:36.846 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-28 04:26:36.847 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-28 04:26:36.847 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64984/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:26:36.855 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.155.73/tcp/64985/p2p/16Uiu2HAmG91x88hN2nDQbXwHYSqLvpkjb2RqPcxQWRXUMoBxR5qv","/ip4/172.18.155.73/tcp/64986/ws/p2p/16Uiu2HAmG91x88hN2nDQbXwHYSqLvpkjb2RqPcxQWRXUMoBxR5qv"],"enrUri":"enr:-L24QATQZ4V1S9Hqt7c1JYqF30VkODAYnz8N6-VWz9BhIF2dAFTCgfXGIEp09ZleWoQsARZxIdGDU0Tvuow5rgui_qACgmlkgnY0gmlwhKwSm0mKbXVsdGlhZGRyc5YACASsEptJBv3ZAAoErBKbSQb92t0DgnJzhQADAQAAiXNlY3AyNTZrMaEDM8EiGrc0thMlucHewmxNsY1-BS5Dv8mgDLTl4qr26pWDdGNwgv3Zg3VkcIL924V3YWt1MgE"}'
2026-02-28 04:26:36.856 INFO [src.node.waku_node] REST service is ready !!
2026-02-28 04:26:36.856 DEBUG [src.node.waku_node] Starting Node...
2026-02-28 04:26:36.856 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-28 04:26:36.858 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-28 04:26:36.858 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.18.128
2026-02-28 04:26:36.858 DEBUG [src.node.docker_mananger] Generated ports ['32998', '32999', '33000', '33001', '33002']
2026-02-28 04:26:36.858 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-28 04:26:36.859 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-28 04:26:36.859 DEBUG [src.node.waku_node] Using volumes []
2026-02-28 04:26:36.859 DEBUG [src.node.docker_mananger] docker run -i -t -p 32998:32998 -p 32999:32999 -p 33000:33000 -p 33001:33001 -p 33002:33002 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=33000 --rest-port=32998 --tcp-port=32999 --discv5-udp-port=33001 --rest-address=0.0.0.0 --nat=extip:172.18.18.128 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=295fd8e55400fb3d18f59d4f8aa6764b5cd47c8d20de41e53daeeedb7c7f2ccd --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=33002 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QATQZ4V1S9Hqt7c1JYqF30VkODAYnz8N6-VWz9BhIF2dAFTCgfXGIEp09ZleWoQsARZxIdGDU0Tvuow5rgui_qACgmlkgnY0gmlwhKwSm0mKbXVsdGlhZGRyc5YACASsEptJBv3ZAAoErBKbSQb92t0DgnJzhQADAQAAiXNlY3AyNTZrMaEDM8EiGrc0thMlucHewmxNsY1-BS5Dv8mgDLTl4qr26pWDdGNwgv3Zg3VkcIL924V3YWt1MgE
2026-02-28 04:26:37.061 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.18.128 waku 10af44d366ff3a77d6cff73329db1d42d531436b941af7cea48791b33ca6f5b9
2026-02-28 04:26:37.095 DEBUG [src.node.docker_mananger] Container started with ID 10af44d366ff. Setting up logs at ./log/docker/node4_2026-02-28_04-26-33__d118c9a3-9f01-4200-9566-19b7fd9895a0__wakuorg_nwaku:latest.log
2026-02-28 04:26:37.095 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 32998
2026-02-28 04:26:37.096 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-28 04:26:38.097 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32998/health" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:26:38.115 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-28 04:26:38.116 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-28 04:26:38.116 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32998/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:26:38.124 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.18.128/tcp/32999/p2p/16Uiu2HAmGLaYusGGWG5UWQ1cHDMSTt8igDqySHpUEdcmpzWwfLze","/ip4/172.18.18.128/tcp/33000/ws/p2p/16Uiu2HAmGLaYusGGWG5UWQ1cHDMSTt8igDqySHpUEdcmpzWwfLze"],"enrUri":"enr:-L24QHJxuKitEZew7HtveXpm845UDRbCmQQVvHVuEL7xwgAhO8mGCn2HRP0n20tQ0coK34L3cPjnsIjighbjmTltrIYCgmlkgnY0gmlwhKwSEoCKbXVsdGlhZGRyc5YACASsEhKABoDnAAoErBISgAaA6N0DgnJzhQADAQAAiXNlY3AyNTZrMaEDNrdiAWIatRysQVOfEGkjM2py-c4-hniXD8S3zEPzkOuDdGNwgoDng3VkcIKA6YV3YWt1MgE"}'
2026-02-28 04:26:38.125 INFO [src.node.waku_node] REST service is ready !!
2026-02-28 04:26:38.125 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:19075/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-28 04:26:38.129 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:26:38.130 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:23224/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-28 04:26:38.137 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:26:38.139 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:64984/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-28 04:26:38.146 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:26:38.147 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32998/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-28 04:26:38.155 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:26:38.156 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19075/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:26:38.160 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.154.49/tcp/32820/p2p/16Uiu2HAm7BN8XpBAj24v434uGxiqMkTATBTewQ9WDZjKeVk2Whrc","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"UnknownOrigin"}]'
2026-02-28 04:26:38.160 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:23224/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:26:38.163 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.253.176/tcp/19076/p2p/16Uiu2HAmNCZ3VeU5fhZ8VkFJQbb27RtwbPkxmpt28hyDDHHEoXL9","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"Discv5"},{"multiaddr":"/ip4/172.18.155.73/tcp/50752/p2p/16Uiu2HAmG91x88hN2nDQbXwHYSqLvpkjb2RqPcxQWRXUMoBxR5qv","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"UnknownOrigin"}]'
2026-02-28 04:26:38.163 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64984/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:26:38.166 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.18.128/tcp/53444/p2p/16Uiu2HAmGLaYusGGWG5UWQ1cHDMSTt8igDqySHpUEdcmpzWwfLze","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.154.49/tcp/23225/p2p/16Uiu2HAm7BN8XpBAj24v434uGxiqMkTATBTewQ9WDZjKeVk2Whrc","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"Discv5"}]'
2026-02-28 04:26:38.167 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32998/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:26:38.169 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.155.73/tcp/64985/p2p/16Uiu2HAmG91x88hN2nDQbXwHYSqLvpkjb2RqPcxQWRXUMoBxR5qv","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"Discv5"}]'
2026-02-28 04:26:38.169 DEBUG [src.libs.common] Sleeping for 40 seconds
2026-02-28 04:27:18.170 INFO [tests.e2e.test_network_conditions] Applying 3000ms latency on sender node1
2026-02-28 04:27:18.172 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '9087', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-02-28 04:27:18.232 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '9087', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'delay', '3000ms']
2026-02-28 04:27:18.247 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:19075/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-28 04:27:24.254 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:27:24.255 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32998/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:27:24.257 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772252838247248965,"ephemeral":false,"proof":""}]'
2026-02-28 04:27:24.259 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '9087', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-02-28 04:27:24.270 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-02-28 04:27:24.271 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-02-28 04:27:24.271 DEBUG [src.node.waku_node] Stopping container with id 6695e4c84dbe
2026-02-28 04:27:24.875 DEBUG [src.node.waku_node] Container stopped.
2026-02-28 04:27:24.878 DEBUG [src.node.waku_node] Stopping container with id 8e94d17f19f9
2026-02-28 04:27:25.491 DEBUG [src.node.waku_node] Container stopped.
2026-02-28 04:27:25.492 DEBUG [src.node.waku_node] Stopping container with id 4a8e309f2add
2026-02-28 04:27:25.693 ERROR [src.node.docker_mananger] Max retries reached for container 6695e4c84dbe. Exiting log stream.
2026-02-28 04:27:26.038 DEBUG [src.node.waku_node] Container stopped.
2026-02-28 04:27:26.039 DEBUG [src.node.waku_node] Stopping container with id 10af44d366ff
2026-02-28 04:27:26.304 ERROR [src.node.docker_mananger] Max retries reached for container 8e94d17f19f9. Exiting log stream.
2026-02-28 04:27:26.567 DEBUG [src.node.waku_node] Container stopped.
2026-02-28 04:27:26.569 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-02-28 04:27:26.611 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-28 04:27:26.648 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-28 04:27:26.688 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-28 04:27:26.724 DEBUG [src.node.docker_mananger] No errors found in the waku logs.