2026-04-22 16:13:15 +00:00

148 lines
27 KiB
Plaintext

2026-04-22 15:46:13.655 DEBUG [tests.conftest] Running fixture setup: test_id
2026-04-22 15:46:13.655 DEBUG [tests.conftest] Running test: test_relay_4_nodes_sender_packet_loss with id: 2026-04-22_15-46-13__0ccc64bb-c0fa-46e8-9984-d8e002003828
2026-04-22 15:46:13.655 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-04-22 15:46:13.655 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-04-22 15:46:13.664 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-22 15:46:13.664 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-04-22_15-46-13__0ccc64bb-c0fa-46e8-9984-d8e002003828__wakuorg_nwaku:latest.log
2026-04-22 15:46:13.669 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-22 15:46:13.669 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-04-22_15-46-13__0ccc64bb-c0fa-46e8-9984-d8e002003828__wakuorg_nwaku:latest.log
2026-04-22 15:46:13.675 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-22 15:46:13.675 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-04-22_15-46-13__0ccc64bb-c0fa-46e8-9984-d8e002003828__wakuorg_nwaku:latest.log
2026-04-22 15:46:13.680 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-22 15:46:13.680 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-04-22_15-46-13__0ccc64bb-c0fa-46e8-9984-d8e002003828__wakuorg_nwaku:latest.log
2026-04-22 15:46:13.680 INFO [tests.e2e.test_network_conditions] Starting 4 nodes with relay enabled (bootstrap chain)
2026-04-22 15:46:13.680 DEBUG [src.node.waku_node] Starting Node...
2026-04-22 15:46:13.681 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-22 15:46:13.682 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-22 15:46:13.682 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.153.220
2026-04-22 15:46:13.682 DEBUG [src.node.docker_mananger] Generated ports ['7305', '7306', '7307', '7308', '7309']
2026-04-22 15:46:13.682 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-22 15:46:13.682 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-22 15:46:13.682 DEBUG [src.node.waku_node] Using volumes []
2026-04-22 15:46:13.682 DEBUG [src.node.docker_mananger] docker run -i -t -p 7305:7305 -p 7306:7306 -p 7307:7307 -p 7308:7308 -p 7309:7309 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=7307 --rest-port=7305 --tcp-port=7306 --discv5-udp-port=7308 --rest-address=0.0.0.0 --nat=extip:172.18.153.220 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=15369beb9d53a5d6afd8593a4e5d6823aa6a5ddfaf2516cfaf6fc4d72f3fcd3d --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=7309 --metrics-logging=true --relay=true
2026-04-22 15:46:13.836 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.153.220 waku 160597bf16da8338039647dd01ea79fe2990db1418d01c02bd000b509122e226
2026-04-22 15:46:13.866 DEBUG [src.node.docker_mananger] Container started with ID 160597bf16da. Setting up logs at ./log/docker/node1_2026-04-22_15-46-13__0ccc64bb-c0fa-46e8-9984-d8e002003828__wakuorg_nwaku:latest.log
2026-04-22 15:46:13.867 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 7305
2026-04-22 15:46:13.867 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-22 15:46:14.063 ERROR [src.node.docker_mananger] Max retries reached for container b15c649f0327. Exiting log stream.
2026-04-22 15:46:14.442 ERROR [src.node.docker_mananger] Max retries reached for container 0c168cd9dd4a. Exiting log stream.
2026-04-22 15:46:14.867 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:7305/health" -H "Content-Type: application/json" -d 'None'
2026-04-22 15:46:14.870 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-22 15:46:14.870 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-22 15:46:14.870 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:7305/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-22 15:46:14.872 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.153.220/tcp/7306/p2p/16Uiu2HAmCTQeYV1sr9p6oe6pt2BDtE8T3zsMobxFd9a3LgmGYXpd","/ip4/172.18.153.220/tcp/7307/ws/p2p/16Uiu2HAmCTQeYV1sr9p6oe6pt2BDtE8T3zsMobxFd9a3LgmGYXpd"],"enrUri":"enr:-L24QPyxeKfSLvGIOEoHSc7HtwqYNWxqv3bXXsqjNR5kIAiAKv4JR3EW2C5YQ-VkRNPXDYzcM7i1iouL03xULqCHpDgCgmlkgnY0gmlwhKwSmdyKbXVsdGlhZGRyc5YACASsEpncBhyKAAoErBKZ3AYci90DgnJzhQDGAQAAiXNlY3AyNTZrMaEC_QiA59bdubxDsgY20lfqzRFkAs22g9fSNyRsA5PRMoqDdGNwghyKg3VkcIIcjIV3YWt1MgE"}'
2026-04-22 15:46:14.873 INFO [src.node.waku_node] REST service is ready !!
2026-04-22 15:46:14.873 DEBUG [src.node.waku_node] Starting Node...
2026-04-22 15:46:14.873 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-22 15:46:14.874 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-22 15:46:14.874 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.11.79
2026-04-22 15:46:14.874 DEBUG [src.node.docker_mananger] Generated ports ['1115', '1116', '1117', '1118', '1119']
2026-04-22 15:46:14.874 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-22 15:46:14.874 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-22 15:46:14.874 DEBUG [src.node.waku_node] Using volumes []
2026-04-22 15:46:14.875 DEBUG [src.node.docker_mananger] docker run -i -t -p 1115:1115 -p 1116:1116 -p 1117:1117 -p 1118:1118 -p 1119:1119 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=1117 --rest-port=1115 --tcp-port=1116 --discv5-udp-port=1118 --rest-address=0.0.0.0 --nat=extip:172.18.11.79 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=cddb553f5b40a53dfab3abab5fd9d2f2e4bfc4b0bee2782f2aceacbe9672b1ea --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=1119 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QPyxeKfSLvGIOEoHSc7HtwqYNWxqv3bXXsqjNR5kIAiAKv4JR3EW2C5YQ-VkRNPXDYzcM7i1iouL03xULqCHpDgCgmlkgnY0gmlwhKwSmdyKbXVsdGlhZGRyc5YACASsEpncBhyKAAoErBKZ3AYci90DgnJzhQDGAQAAiXNlY3AyNTZrMaEC_QiA59bdubxDsgY20lfqzRFkAs22g9fSNyRsA5PRMoqDdGNwghyKg3VkcIIcjIV3YWt1MgE
2026-04-22 15:46:15.029 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.11.79 waku d4ac2d96e08fb6b94a1501dd47013c327b4a4f9f4a643b81a243706dfd67a369
2026-04-22 15:46:15.058 DEBUG [src.node.docker_mananger] Container started with ID d4ac2d96e08f. Setting up logs at ./log/docker/node2_2026-04-22_15-46-13__0ccc64bb-c0fa-46e8-9984-d8e002003828__wakuorg_nwaku:latest.log
2026-04-22 15:46:15.059 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 1115
2026-04-22 15:46:15.059 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-22 15:46:16.059 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1115/health" -H "Content-Type: application/json" -d 'None'
2026-04-22 15:46:16.067 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-22 15:46:16.069 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-22 15:46:16.069 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1115/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-22 15:46:16.074 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.11.79/tcp/1116/p2p/16Uiu2HAkxLDkG4WZzqznbDyaGkCUpNYFjMMMff82Wezmk7HBxRy3","/ip4/172.18.11.79/tcp/1117/ws/p2p/16Uiu2HAkxLDkG4WZzqznbDyaGkCUpNYFjMMMff82Wezmk7HBxRy3"],"enrUri":"enr:-L24QKsEbIAwroGJv6W2hYralprPxu0pPC4A8G_pYqdWOP05SUzDkUOh0osgYDu4JDUaYwLgPdPNmFqu5kbbRQGghucCgmlkgnY0gmlwhKwSC0-KbXVsdGlhZGRyc5YACASsEgtPBgRcAAoErBILTwYEXd0DgnJzhQDGAQAAiXNlY3AyNTZrMaECKy1-nxUOAwirpfUwLPb0ADk8yy73SqzuybxfLycwrkqDdGNwggRcg3VkcIIEXoV3YWt1MgE"}'
2026-04-22 15:46:16.075 INFO [src.node.waku_node] REST service is ready !!
2026-04-22 15:46:16.075 DEBUG [src.node.waku_node] Starting Node...
2026-04-22 15:46:16.075 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-22 15:46:16.078 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-22 15:46:16.078 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.203.89
2026-04-22 15:46:16.078 DEBUG [src.node.docker_mananger] Generated ports ['9336', '9337', '9338', '9339', '9340']
2026-04-22 15:46:16.078 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-22 15:46:16.078 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-22 15:46:16.078 DEBUG [src.node.waku_node] Using volumes []
2026-04-22 15:46:16.078 DEBUG [src.node.docker_mananger] docker run -i -t -p 9336:9336 -p 9337:9337 -p 9338:9338 -p 9339:9339 -p 9340:9340 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=9338 --rest-port=9336 --tcp-port=9337 --discv5-udp-port=9339 --rest-address=0.0.0.0 --nat=extip:172.18.203.89 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=66eeaf1cef8cf020ccbace67cf66b1ea3e3f864caebe7e5ee9eaf0142a43bfe7 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=9340 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QKsEbIAwroGJv6W2hYralprPxu0pPC4A8G_pYqdWOP05SUzDkUOh0osgYDu4JDUaYwLgPdPNmFqu5kbbRQGghucCgmlkgnY0gmlwhKwSC0-KbXVsdGlhZGRyc5YACASsEgtPBgRcAAoErBILTwYEXd0DgnJzhQDGAQAAiXNlY3AyNTZrMaECKy1-nxUOAwirpfUwLPb0ADk8yy73SqzuybxfLycwrkqDdGNwggRcg3VkcIIEXoV3YWt1MgE
2026-04-22 15:46:16.227 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.203.89 waku bc09a76caab27fa1f3985e88cd45ae89d4f56017289e5703e7205b9955f9ffab
2026-04-22 15:46:16.255 DEBUG [src.node.docker_mananger] Container started with ID bc09a76caab2. Setting up logs at ./log/docker/node3_2026-04-22_15-46-13__0ccc64bb-c0fa-46e8-9984-d8e002003828__wakuorg_nwaku:latest.log
2026-04-22 15:46:16.255 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 9336
2026-04-22 15:46:16.255 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-22 15:46:17.256 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9336/health" -H "Content-Type: application/json" -d 'None'
2026-04-22 15:46:17.265 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-22 15:46:17.266 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-22 15:46:17.266 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9336/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-22 15:46:17.268 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.203.89/tcp/9337/p2p/16Uiu2HAmEZKk1DckxM6p6mbSaKAPZB8swC4FNvnHa4rFktcfCBAm","/ip4/172.18.203.89/tcp/9338/ws/p2p/16Uiu2HAmEZKk1DckxM6p6mbSaKAPZB8swC4FNvnHa4rFktcfCBAm"],"enrUri":"enr:-L24QF5zJCCm8o8VfGbi9WK_kJTNdXJQvC-wyK_zBc_p0CmyLKbIe6OqxWF3Ncu4BPveT1qGGug7Cvo4KM8kcOgFawACgmlkgnY0gmlwhKwSy1mKbXVsdGlhZGRyc5YACASsEstZBiR5AAoErBLLWQYket0DgnJzhQDGAQAAiXNlY3AyNTZrMaEDHEPQsBqu88nQyCMLsz91zQC_wuqYvFNtqFliv75OqNaDdGNwgiR5g3VkcIIke4V3YWt1MgE"}'
2026-04-22 15:46:17.269 INFO [src.node.waku_node] REST service is ready !!
2026-04-22 15:46:17.269 DEBUG [src.node.waku_node] Starting Node...
2026-04-22 15:46:17.269 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-22 15:46:17.270 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-22 15:46:17.270 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.106.211
2026-04-22 15:46:17.270 DEBUG [src.node.docker_mananger] Generated ports ['42010', '42011', '42012', '42013', '42014']
2026-04-22 15:46:17.270 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-22 15:46:17.271 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-22 15:46:17.271 DEBUG [src.node.waku_node] Using volumes []
2026-04-22 15:46:17.271 DEBUG [src.node.docker_mananger] docker run -i -t -p 42010:42010 -p 42011:42011 -p 42012:42012 -p 42013:42013 -p 42014:42014 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=42012 --rest-port=42010 --tcp-port=42011 --discv5-udp-port=42013 --rest-address=0.0.0.0 --nat=extip:172.18.106.211 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=0863b0442bfafc2aec31f5b30eee9faaeed3b0db1a81abcfe9b1836dc55b284a --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=42014 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QF5zJCCm8o8VfGbi9WK_kJTNdXJQvC-wyK_zBc_p0CmyLKbIe6OqxWF3Ncu4BPveT1qGGug7Cvo4KM8kcOgFawACgmlkgnY0gmlwhKwSy1mKbXVsdGlhZGRyc5YACASsEstZBiR5AAoErBLLWQYket0DgnJzhQDGAQAAiXNlY3AyNTZrMaEDHEPQsBqu88nQyCMLsz91zQC_wuqYvFNtqFliv75OqNaDdGNwgiR5g3VkcIIke4V3YWt1MgE
2026-04-22 15:46:17.432 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.106.211 waku ab66f260f3ce5455ecc77634cb50c1095a207db856123195a191fc43acd4187e
2026-04-22 15:46:17.457 DEBUG [src.node.docker_mananger] Container started with ID ab66f260f3ce. Setting up logs at ./log/docker/node4_2026-04-22_15-46-13__0ccc64bb-c0fa-46e8-9984-d8e002003828__wakuorg_nwaku:latest.log
2026-04-22 15:46:17.458 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 42010
2026-04-22 15:46:17.459 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-22 15:46:18.461 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42010/health" -H "Content-Type: application/json" -d 'None'
2026-04-22 15:46:18.473 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-22 15:46:18.475 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-22 15:46:18.475 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42010/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-22 15:46:18.479 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.106.211/tcp/42011/p2p/16Uiu2HAkvtQNUzfRJzJfsfJeEW8diTkneUdZtdEX3y8gZa47zqW9","/ip4/172.18.106.211/tcp/42012/ws/p2p/16Uiu2HAkvtQNUzfRJzJfsfJeEW8diTkneUdZtdEX3y8gZa47zqW9"],"enrUri":"enr:-L24QL-mCwbYRde6-JHQCFrslUj7Dd0jZ0X-3zoKBn3rKxMcC08KTmCTBozherLSV4q18yJTzJiBYBtWnCUxdCxlScYCgmlkgnY0gmlwhKwSatOKbXVsdGlhZGRyc5YACASsEmrTBqQbAAoErBJq0wakHN0DgnJzhQDGAQAAiXNlY3AyNTZrMaECFbS4SDc7OhvLUB5McjnVr1x5D4-2EYT4FnjtFBEHqsKDdGNwgqQbg3VkcIKkHYV3YWt1MgE"}'
2026-04-22 15:46:18.480 INFO [src.node.waku_node] REST service is ready !!
2026-04-22 15:46:18.480 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:7305/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/1"]'
2026-04-22 15:46:18.484 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-22 15:46:18.484 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1115/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/1"]'
2026-04-22 15:46:18.493 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-22 15:46:18.493 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:9336/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/1"]'
2026-04-22 15:46:18.500 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-22 15:46:18.500 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:42010/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/1"]'
2026-04-22 15:46:18.507 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-22 15:46:18.507 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:7305/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-04-22 15:46:18.510 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.11.79/tcp/38560/p2p/16Uiu2HAkxLDkG4WZzqznbDyaGkCUpNYFjMMMff82Wezmk7HBxRy3","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-\\"v0.38.0-16-g260def\\"","origin":"UnknownOrigin"}]'
2026-04-22 15:46:18.511 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1115/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-04-22 15:46:18.513 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.203.89/tcp/51886/p2p/16Uiu2HAmEZKk1DckxM6p6mbSaKAPZB8swC4FNvnHa4rFktcfCBAm","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-\\"v0.38.0-16-g260def\\"","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.153.220/tcp/7306/p2p/16Uiu2HAmCTQeYV1sr9p6oe6pt2BDtE8T3zsMobxFd9a3LgmGYXpd","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-\\"v0.38.0-16-g260def\\"","origin":"Discv5"}]'
2026-04-22 15:46:18.513 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9336/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-04-22 15:46:18.515 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.106.211/tcp/46610/p2p/16Uiu2HAkvtQNUzfRJzJfsfJeEW8diTkneUdZtdEX3y8gZa47zqW9","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-\\"v0.38.0-16-g260def\\"","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.11.79/tcp/1116/p2p/16Uiu2HAkxLDkG4WZzqznbDyaGkCUpNYFjMMMff82Wezmk7HBxRy3","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-\\"v0.38.0-16-g260def\\"","origin":"Discv5"}]'
2026-04-22 15:46:18.515 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42010/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-04-22 15:46:18.517 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.203.89/tcp/9337/p2p/16Uiu2HAmEZKk1DckxM6p6mbSaKAPZB8swC4FNvnHa4rFktcfCBAm","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-\\"v0.38.0-16-g260def\\"","origin":"Discv5"}]'
2026-04-22 15:46:18.517 DEBUG [src.libs.common] Sleeping for 20 seconds
2026-04-22 15:46:38.517 INFO [tests.e2e.test_network_conditions] Applying 30.0% packet loss on sender node1
2026-04-22 15:46:38.519 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '23478', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-04-22 15:46:38.528 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '23478', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'loss', '30.0%']
2026-04-22 15:46:38.536 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '23478', '-n', 'tc', '-s', 'qdisc', 'show', 'dev', 'eth0']
2026-04-22 15:46:38.542 DEBUG [src.steps.network_conditions] tc -s qdisc show dev eth0:
qdisc netem 8002: root refcnt 5 limit 1000 loss 30%
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
2026-04-22 15:46:38.542 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42010/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d 'None'
2026-04-22 15:46:38.545 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[]'
2026-04-22 15:46:38.545 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:7305/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-04-22 15:46:38.553 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-22 15:46:38.560 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '23478', '-n', 'tc', '-s', 'qdisc', 'show', 'dev', 'eth0']
2026-04-22 15:46:38.569 DEBUG [src.steps.network_conditions] tc -s qdisc show dev eth0:
qdisc netem 8002: root refcnt 5 limit 1000 loss 30%
Sent 500 bytes 5 pkt (dropped 1, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
2026-04-22 15:46:38.570 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42010/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d 'None'
2026-04-22 15:46:38.572 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1776872798545486391,"ephemeral":false,"proof":""}]'
2026-04-22 15:46:38.572 INFO [tests.e2e.test_network_conditions] Node4 received messages from node1 after 0 trails
2026-04-22 15:46:38.573 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '23478', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-04-22 15:46:38.581 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-04-22 15:46:38.582 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-04-22 15:46:38.582 DEBUG [src.node.waku_node] Stopping container with id 160597bf16da
2026-04-22 15:46:38.986 DEBUG [src.node.waku_node] Container stopped.
2026-04-22 15:46:38.988 DEBUG [src.node.waku_node] Stopping container with id d4ac2d96e08f
2026-04-22 15:46:39.392 DEBUG [src.node.waku_node] Container stopped.
2026-04-22 15:46:39.393 DEBUG [src.node.waku_node] Stopping container with id bc09a76caab2
2026-04-22 15:46:39.790 DEBUG [src.node.waku_node] Container stopped.
2026-04-22 15:46:39.791 DEBUG [src.node.waku_node] Stopping container with id ab66f260f3ce
2026-04-22 15:46:39.809 ERROR [src.node.docker_mananger] Max retries reached for container 160597bf16da. Exiting log stream.
2026-04-22 15:46:40.210 DEBUG [src.node.waku_node] Container stopped.
2026-04-22 15:46:40.212 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-04-22 15:46:40.245 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-22 15:46:40.272 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-22 15:46:40.299 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-22 15:46:40.299 ERROR [src.node.docker_mananger] Max retries reached for container d4ac2d96e08f. Exiting log stream.
2026-04-22 15:46:40.323 DEBUG [src.node.docker_mananger] No errors found in the waku logs.