133 lines
27 KiB
Plaintext

2026-03-14 04:33:19.661 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-14 04:33:19.662 DEBUG [tests.conftest] Running test: test_relay_4_nodes_sender_latency with id: 2026-03-14_04-33-19__d3927d35-61cc-4bfe-90b8-93363a326c70
2026-03-14 04:33:19.662 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-14 04:33:19.662 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-14 04:33:19.669 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-14 04:33:19.669 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-14_04-33-19__d3927d35-61cc-4bfe-90b8-93363a326c70__wakuorg_nwaku:latest.log
2026-03-14 04:33:19.675 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-14 04:33:19.675 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-14_04-33-19__d3927d35-61cc-4bfe-90b8-93363a326c70__wakuorg_nwaku:latest.log
2026-03-14 04:33:19.681 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-14 04:33:19.682 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-14_04-33-19__d3927d35-61cc-4bfe-90b8-93363a326c70__wakuorg_nwaku:latest.log
2026-03-14 04:33:19.687 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-14 04:33:19.687 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-14_04-33-19__d3927d35-61cc-4bfe-90b8-93363a326c70__wakuorg_nwaku:latest.log
2026-03-14 04:33:19.687 INFO [tests.e2e.test_network_conditions] Starting 4 nodes with relay enabled (bootstrap chain)
2026-03-14 04:33:19.688 DEBUG [src.node.waku_node] Starting Node...
2026-03-14 04:33:19.688 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-14 04:33:19.689 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-14 04:33:19.689 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.68.98
2026-03-14 04:33:19.689 DEBUG [src.node.docker_mananger] Generated ports ['48918', '48919', '48920', '48921', '48922']
2026-03-14 04:33:19.690 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-14 04:33:19.690 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-14 04:33:19.690 DEBUG [src.node.waku_node] Using volumes []
2026-03-14 04:33:19.690 DEBUG [src.node.docker_mananger] docker run -i -t -p 48918:48918 -p 48919:48919 -p 48920:48920 -p 48921:48921 -p 48922:48922 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=48920 --rest-port=48918 --tcp-port=48919 --discv5-udp-port=48921 --rest-address=0.0.0.0 --nat=extip:172.18.68.98 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=dcfcb99ea86c68d0e3d5a2ea37d2caa3a4b939ef5e1ae6b803e92c4b17d7c483 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=48922 --metrics-logging=true --relay=true
2026-03-14 04:33:19.732 ERROR [src.node.docker_mananger] Max retries reached for container 5495c4a36428. Exiting log stream.
2026-03-14 04:33:19.880 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.68.98 waku 7719d93baa4e997e49f84769273f43ec2e1eddff187f1dc2efdd38bc77454bc4
2026-03-14 04:33:19.915 DEBUG [src.node.docker_mananger] Container started with ID 7719d93baa4e. Setting up logs at ./log/docker/node1_2026-03-14_04-33-19__d3927d35-61cc-4bfe-90b8-93363a326c70__wakuorg_nwaku:latest.log
2026-03-14 04:33:19.916 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 48918
2026-03-14 04:33:19.916 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-14 04:33:20.916 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48918/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:33:20.919 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-14 04:33:20.919 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-14 04:33:20.920 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48918/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:33:20.922 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.68.98/tcp/48919/p2p/16Uiu2HAm2HZJHTW1bd9cxqrh7ZYPuqozA7frwM5iMp1iETLCj56i","/ip4/172.18.68.98/tcp/48920/ws/p2p/16Uiu2HAm2HZJHTW1bd9cxqrh7ZYPuqozA7frwM5iMp1iETLCj56i"],"enrUri":"enr:-L24QMig9vdj0TEZqk3CpK2YLBvX_9a7w8O47bBsMLuxnLXHS1WlGrj9X0YSPvCeK0aFWZTNw9DrBDpXF9CJt7EvchsCgmlkgnY0gmlwhKwSRGKKbXVsdGlhZGRyc5YACASsEkRiBr8XAAoErBJEYga_GN0DgnJzhQADAQAAiXNlY3AyNTZrMaECZe2biYmA3Jx3crwRDfTHxHq1xRghcmAXv2p7r1mJSvuDdGNwgr8Xg3VkcIK_GYV3YWt1MgE"}'
2026-03-14 04:33:20.922 INFO [src.node.waku_node] REST service is ready !!
2026-03-14 04:33:20.922 DEBUG [src.node.waku_node] Starting Node...
2026-03-14 04:33:20.922 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-14 04:33:20.924 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-14 04:33:20.924 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.57.120
2026-03-14 04:33:20.924 DEBUG [src.node.docker_mananger] Generated ports ['14969', '14970', '14971', '14972', '14973']
2026-03-14 04:33:20.924 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-14 04:33:20.924 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-14 04:33:20.924 DEBUG [src.node.waku_node] Using volumes []
2026-03-14 04:33:20.925 DEBUG [src.node.docker_mananger] docker run -i -t -p 14969:14969 -p 14970:14970 -p 14971:14971 -p 14972:14972 -p 14973:14973 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=14971 --rest-port=14969 --tcp-port=14970 --discv5-udp-port=14972 --rest-address=0.0.0.0 --nat=extip:172.18.57.120 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ad87fecbebdada3e293e210cf5a09ac8c439267f9d48a0eda4fcd26ebd76fbdf --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=14973 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QMig9vdj0TEZqk3CpK2YLBvX_9a7w8O47bBsMLuxnLXHS1WlGrj9X0YSPvCeK0aFWZTNw9DrBDpXF9CJt7EvchsCgmlkgnY0gmlwhKwSRGKKbXVsdGlhZGRyc5YACASsEkRiBr8XAAoErBJEYga_GN0DgnJzhQADAQAAiXNlY3AyNTZrMaECZe2biYmA3Jx3crwRDfTHxHq1xRghcmAXv2p7r1mJSvuDdGNwgr8Xg3VkcIK_GYV3YWt1MgE
2026-03-14 04:33:21.114 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.57.120 waku c90d9e09e124c5a166f32e1ceb1a742c3d5cb11896c0e87f3aff8fcc6fb1da3d
2026-03-14 04:33:21.149 DEBUG [src.node.docker_mananger] Container started with ID c90d9e09e124. Setting up logs at ./log/docker/node2_2026-03-14_04-33-19__d3927d35-61cc-4bfe-90b8-93363a326c70__wakuorg_nwaku:latest.log
2026-03-14 04:33:21.149 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 14969
2026-03-14 04:33:21.149 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-14 04:33:22.152 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14969/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:33:22.168 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-14 04:33:22.169 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-14 04:33:22.169 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14969/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:33:22.177 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.57.120/tcp/14970/p2p/16Uiu2HAmKd25sGfTUMf3mzkR4LusKN92to9y4DRcLxMgqBJJhifX","/ip4/172.18.57.120/tcp/14971/ws/p2p/16Uiu2HAmKd25sGfTUMf3mzkR4LusKN92to9y4DRcLxMgqBJJhifX"],"enrUri":"enr:-L24QAvv4iRYc-EdlPd65OuQ7uQlzS7ypslGzXqKFik4kicQfSmwYP5WhWSAtzGXh0_RhPBZxGFbEybw2rsuFPwrXJoCgmlkgnY0gmlwhKwSOXiKbXVsdGlhZGRyc5YACASsEjl4Bjp6AAoErBI5eAY6e90DgnJzhQADAQAAiXNlY3AyNTZrMaEDZ4CbjMaGn21Fvm0uWmkZmXsmC-_Ldw_-scnA398JsO6DdGNwgjp6g3VkcII6fIV3YWt1MgE"}'
2026-03-14 04:33:22.177 INFO [src.node.waku_node] REST service is ready !!
2026-03-14 04:33:22.177 DEBUG [src.node.waku_node] Starting Node...
2026-03-14 04:33:22.178 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-14 04:33:22.179 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-14 04:33:22.179 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.60.141
2026-03-14 04:33:22.179 DEBUG [src.node.docker_mananger] Generated ports ['42683', '42684', '42685', '42686', '42687']
2026-03-14 04:33:22.180 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-14 04:33:22.180 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-14 04:33:22.180 DEBUG [src.node.waku_node] Using volumes []
2026-03-14 04:33:22.180 DEBUG [src.node.docker_mananger] docker run -i -t -p 42683:42683 -p 42684:42684 -p 42685:42685 -p 42686:42686 -p 42687:42687 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=42685 --rest-port=42683 --tcp-port=42684 --discv5-udp-port=42686 --rest-address=0.0.0.0 --nat=extip:172.18.60.141 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=3c30ccaa36a930ff22808769b04df4fe3c435e8b31db71a2affcb6480177ebcf --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=42687 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QAvv4iRYc-EdlPd65OuQ7uQlzS7ypslGzXqKFik4kicQfSmwYP5WhWSAtzGXh0_RhPBZxGFbEybw2rsuFPwrXJoCgmlkgnY0gmlwhKwSOXiKbXVsdGlhZGRyc5YACASsEjl4Bjp6AAoErBI5eAY6e90DgnJzhQADAQAAiXNlY3AyNTZrMaEDZ4CbjMaGn21Fvm0uWmkZmXsmC-_Ldw_-scnA398JsO6DdGNwgjp6g3VkcII6fIV3YWt1MgE
2026-03-14 04:33:22.374 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.60.141 waku 321b336ad0c7b4fcd0b39a66dd4caf44019c3e8accf0935831434727da2d8267
2026-03-14 04:33:22.409 DEBUG [src.node.docker_mananger] Container started with ID 321b336ad0c7. Setting up logs at ./log/docker/node3_2026-03-14_04-33-19__d3927d35-61cc-4bfe-90b8-93363a326c70__wakuorg_nwaku:latest.log
2026-03-14 04:33:22.410 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 42683
2026-03-14 04:33:22.410 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-14 04:33:23.410 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42683/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:33:23.424 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-14 04:33:23.425 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-14 04:33:23.426 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42683/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:33:23.436 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.60.141/tcp/42684/p2p/16Uiu2HAmNXkJEwSGEVQ9so4amaa2QeoyCoc1fwV6Qv1aet9vj7TM","/ip4/172.18.60.141/tcp/42685/ws/p2p/16Uiu2HAmNXkJEwSGEVQ9so4amaa2QeoyCoc1fwV6Qv1aet9vj7TM"],"enrUri":"enr:-L24QCbNIcQp5weudw9kDNzu32ZH4fcHR32JlrrrfZZqkF0QZtuJ4iAxPOjPX9IbSn-U1j_WwYSfa-nSmUs2bpE2WY8CgmlkgnY0gmlwhKwSPI2KbXVsdGlhZGRyc5YACASsEjyNBqa8AAoErBI8jQamvd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDkrnqEIbwZsGbyH877ER4xriEcFc46UsbF3MI-KfcwPCDdGNwgqa8g3VkcIKmvoV3YWt1MgE"}'
2026-03-14 04:33:23.436 INFO [src.node.waku_node] REST service is ready !!
2026-03-14 04:33:23.437 DEBUG [src.node.waku_node] Starting Node...
2026-03-14 04:33:23.437 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-14 04:33:23.438 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-14 04:33:23.438 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.216.23
2026-03-14 04:33:23.438 DEBUG [src.node.docker_mananger] Generated ports ['17705', '17706', '17707', '17708', '17709']
2026-03-14 04:33:23.439 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-14 04:33:23.439 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-14 04:33:23.439 DEBUG [src.node.waku_node] Using volumes []
2026-03-14 04:33:23.439 DEBUG [src.node.docker_mananger] docker run -i -t -p 17705:17705 -p 17706:17706 -p 17707:17707 -p 17708:17708 -p 17709:17709 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=17707 --rest-port=17705 --tcp-port=17706 --discv5-udp-port=17708 --rest-address=0.0.0.0 --nat=extip:172.18.216.23 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=8b049e75af7cf967b31b940e3e4e4950fd2d874568e198efcb04c9d68b81a6cc --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=17709 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QCbNIcQp5weudw9kDNzu32ZH4fcHR32JlrrrfZZqkF0QZtuJ4iAxPOjPX9IbSn-U1j_WwYSfa-nSmUs2bpE2WY8CgmlkgnY0gmlwhKwSPI2KbXVsdGlhZGRyc5YACASsEjyNBqa8AAoErBI8jQamvd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDkrnqEIbwZsGbyH877ER4xriEcFc46UsbF3MI-KfcwPCDdGNwgqa8g3VkcIKmvoV3YWt1MgE
2026-03-14 04:33:23.644 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.216.23 waku a683705389b8e84803086becf3246e1baeaf4080b22d15cdca1cbec35180b52d
2026-03-14 04:33:23.678 DEBUG [src.node.docker_mananger] Container started with ID a683705389b8. Setting up logs at ./log/docker/node4_2026-03-14_04-33-19__d3927d35-61cc-4bfe-90b8-93363a326c70__wakuorg_nwaku:latest.log
2026-03-14 04:33:23.678 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 17705
2026-03-14 04:33:23.678 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-14 04:33:24.681 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17705/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:33:24.697 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-14 04:33:24.698 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-14 04:33:24.699 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17705/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:33:24.706 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.216.23/tcp/17706/p2p/16Uiu2HAmEaB6jwi8rNudLGjM7ZmJmT4bLsUtg7XXwVX8uJeVzwG7","/ip4/172.18.216.23/tcp/17707/ws/p2p/16Uiu2HAmEaB6jwi8rNudLGjM7ZmJmT4bLsUtg7XXwVX8uJeVzwG7"],"enrUri":"enr:-L24QLv-DBiP-TNr1L8gBFabTeMuihWaZgd4dHCB_vY2Iz3sK_4G7iUbvdWFAhL5-yyGP7ADkCRkwPjdPDD9qkmh9y0CgmlkgnY0gmlwhKwS2BeKbXVsdGlhZGRyc5YACASsEtgXBkUqAAoErBLYFwZFK90DgnJzhQADAQAAiXNlY3AyNTZrMaEDHHufuWJV2B9g9A4cq8sFD5ncv_qh5Jl9NNiSrjFzCQyDdGNwgkUqg3VkcIJFLIV3YWt1MgE"}'
2026-03-14 04:33:24.706 INFO [src.node.waku_node] REST service is ready !!
2026-03-14 04:33:24.707 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48918/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-14 04:33:24.712 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:33:24.713 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14969/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-14 04:33:24.719 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:33:24.722 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:42683/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-14 04:33:24.730 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:33:24.731 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17705/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-14 04:33:24.736 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:33:24.737 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48918/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:33:24.740 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.57.120/tcp/46912/p2p/16Uiu2HAmKd25sGfTUMf3mzkR4LusKN92to9y4DRcLxMgqBJJhifX","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.37.1-81-g96f1c4","origin":"UnknownOrigin"}]'
2026-03-14 04:33:24.741 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14969/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:33:24.743 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.68.98/tcp/48919/p2p/16Uiu2HAm2HZJHTW1bd9cxqrh7ZYPuqozA7frwM5iMp1iETLCj56i","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.37.1-81-g96f1c4","origin":"Discv5"},{"multiaddr":"/ip4/172.18.60.141/tcp/36906/p2p/16Uiu2HAmNXkJEwSGEVQ9so4amaa2QeoyCoc1fwV6Qv1aet9vj7TM","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.37.1-81-g96f1c4","origin":"UnknownOrigin"}]'
2026-03-14 04:33:24.743 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42683/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:33:24.745 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.216.23/tcp/38532/p2p/16Uiu2HAmEaB6jwi8rNudLGjM7ZmJmT4bLsUtg7XXwVX8uJeVzwG7","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.37.1-81-g96f1c4","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.57.120/tcp/14970/p2p/16Uiu2HAmKd25sGfTUMf3mzkR4LusKN92to9y4DRcLxMgqBJJhifX","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.37.1-81-g96f1c4","origin":"Discv5"}]'
2026-03-14 04:33:24.746 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17705/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:33:24.748 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.60.141/tcp/42684/p2p/16Uiu2HAmNXkJEwSGEVQ9so4amaa2QeoyCoc1fwV6Qv1aet9vj7TM","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.37.1-81-g96f1c4","origin":"Discv5"}]'
2026-03-14 04:33:24.748 DEBUG [src.libs.common] Sleeping for 40 seconds
2026-03-14 04:34:04.749 INFO [tests.e2e.test_network_conditions] Applying 3000ms latency on sender node1
2026-03-14 04:34:04.751 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '9571', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-14 04:34:04.806 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '9571', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'delay', '3000ms']
2026-03-14 04:34:04.819 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48918/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-14 04:34:10.826 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:34:10.827 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17705/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:34:10.829 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1773462844819865387,"ephemeral":false,"proof":""}]'
2026-03-14 04:34:10.831 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '9571', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-14 04:34:10.842 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-14 04:34:10.843 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-14 04:34:10.843 DEBUG [src.node.waku_node] Stopping container with id 7719d93baa4e
2026-03-14 04:34:11.429 DEBUG [src.node.waku_node] Container stopped.
2026-03-14 04:34:11.432 DEBUG [src.node.waku_node] Stopping container with id c90d9e09e124
2026-03-14 04:34:12.032 DEBUG [src.node.waku_node] Container stopped.
2026-03-14 04:34:12.032 DEBUG [src.node.waku_node] Stopping container with id 321b336ad0c7
2026-03-14 04:34:12.243 ERROR [src.node.docker_mananger] Max retries reached for container 7719d93baa4e. Exiting log stream.
2026-03-14 04:34:12.616 DEBUG [src.node.waku_node] Container stopped.
2026-03-14 04:34:12.617 DEBUG [src.node.waku_node] Stopping container with id a683705389b8
2026-03-14 04:34:12.845 ERROR [src.node.docker_mananger] Max retries reached for container c90d9e09e124. Exiting log stream.
2026-03-14 04:34:13.149 DEBUG [src.node.waku_node] Container stopped.
2026-03-14 04:34:13.150 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-14 04:34:13.192 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-14 04:34:13.229 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-14 04:34:13.270 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-14 04:34:13.307 DEBUG [src.node.docker_mananger] No errors found in the waku logs.