148 lines
28 KiB
Plaintext

2026-03-03 04:33:09.973 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-03 04:33:09.974 DEBUG [tests.conftest] Running test: test_relay_4_nodes_sender_packet_loss with id: 2026-03-03_04-33-09__60fbe92d-8aa1-4058-b9ff-18d6a8718217
2026-03-03 04:33:09.974 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-03 04:33:09.975 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-03 04:33:09.981 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:33:09.982 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-03_04-33-09__60fbe92d-8aa1-4058-b9ff-18d6a8718217__wakuorg_nwaku:latest.log
2026-03-03 04:33:09.987 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:33:09.987 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-03_04-33-09__60fbe92d-8aa1-4058-b9ff-18d6a8718217__wakuorg_nwaku:latest.log
2026-03-03 04:33:09.994 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:33:09.994 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-03_04-33-09__60fbe92d-8aa1-4058-b9ff-18d6a8718217__wakuorg_nwaku:latest.log
2026-03-03 04:33:09.999 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:33:09.999 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-03_04-33-09__60fbe92d-8aa1-4058-b9ff-18d6a8718217__wakuorg_nwaku:latest.log
2026-03-03 04:33:10.000 INFO [tests.e2e.test_network_conditions] Starting 4 nodes with relay enabled (bootstrap chain)
2026-03-03 04:33:10.000 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:33:10.000 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:33:10.001 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-03 04:33:10.001 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.9.19
2026-03-03 04:33:10.002 DEBUG [src.node.docker_mananger] Generated ports ['25745', '25746', '25747', '25748', '25749']
2026-03-03 04:33:10.002 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:33:10.002 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:33:10.002 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:33:10.002 DEBUG [src.node.docker_mananger] docker run -i -t -p 25745:25745 -p 25746:25746 -p 25747:25747 -p 25748:25748 -p 25749:25749 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=25747 --rest-port=25745 --tcp-port=25746 --discv5-udp-port=25748 --rest-address=0.0.0.0 --nat=extip:172.18.9.19 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=f78ba6bcfd925ae998eeefdc4f8b57a6ceda3cb98b69ade36dc3d8bfee0e16cc --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=25749 --metrics-logging=true --relay=true
2026-03-03 04:33:10.185 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.9.19 waku 753189323b81a978ccd408945a337ba5d3e5b96f34670e4d69aa7340c89d0e2e
2026-03-03 04:33:10.224 ERROR [src.node.docker_mananger] Max retries reached for container 98fc49f26790. Exiting log stream.
2026-03-03 04:33:10.224 DEBUG [src.node.docker_mananger] Container started with ID 753189323b81. Setting up logs at ./log/docker/node1_2026-03-03_04-33-09__60fbe92d-8aa1-4058-b9ff-18d6a8718217__wakuorg_nwaku:latest.log
2026-03-03 04:33:10.225 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 25745
2026-03-03 04:33:10.225 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:33:10.763 ERROR [src.node.docker_mananger] Max retries reached for container 5b4343c8632b. Exiting log stream.
2026-03-03 04:33:11.226 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25745/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:11.228 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:33:11.229 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:33:11.229 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25745/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:11.231 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.9.19/tcp/25746/p2p/16Uiu2HAm5Txf5HnERygv11uvxT2J1ftZzHuboeUBKGkevsecYANo","/ip4/172.18.9.19/tcp/25747/ws/p2p/16Uiu2HAm5Txf5HnERygv11uvxT2J1ftZzHuboeUBKGkevsecYANo"],"enrUri":"enr:-L24QAiZdRjpPS-N524NxxUGvAsfkOqMODQPqBzmP0Kw_RTEdXVttYXCjbfGQR4f5UEbhokutPAY-hxesDEwTtJRt_ACgmlkgnY0gmlwhKwSCROKbXVsdGlhZGRyc5YACASsEgkTBmSSAAoErBIJEwZkk90DgnJzhQADAQAAiXNlY3AyNTZrMaEClSrjTuy22C3Hr799aDKLr7YOUPMuw1wHCN3Zxkzd41yDdGNwgmSSg3VkcIJklIV3YWt1MgE"}'
2026-03-03 04:33:11.231 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:33:11.232 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:33:11.232 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:33:11.233 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-03 04:33:11.233 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.154.227
2026-03-03 04:33:11.233 DEBUG [src.node.docker_mananger] Generated ports ['16561', '16562', '16563', '16564', '16565']
2026-03-03 04:33:11.233 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:33:11.234 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:33:11.234 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:33:11.234 DEBUG [src.node.docker_mananger] docker run -i -t -p 16561:16561 -p 16562:16562 -p 16563:16563 -p 16564:16564 -p 16565:16565 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=16563 --rest-port=16561 --tcp-port=16562 --discv5-udp-port=16564 --rest-address=0.0.0.0 --nat=extip:172.18.154.227 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=fff5cff8a7635d1486e4fb90ede380b5eedde1d9583eac9270a5dc7b11d4cb71 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=16565 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QAiZdRjpPS-N524NxxUGvAsfkOqMODQPqBzmP0Kw_RTEdXVttYXCjbfGQR4f5UEbhokutPAY-hxesDEwTtJRt_ACgmlkgnY0gmlwhKwSCROKbXVsdGlhZGRyc5YACASsEgkTBmSSAAoErBIJEwZkk90DgnJzhQADAQAAiXNlY3AyNTZrMaEClSrjTuy22C3Hr799aDKLr7YOUPMuw1wHCN3Zxkzd41yDdGNwgmSSg3VkcIJklIV3YWt1MgE
2026-03-03 04:33:11.418 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.154.227 waku af25830b68bb696ec92f4a224dc22a8ba6387da9066270b79f262e18172e7316
2026-03-03 04:33:11.456 DEBUG [src.node.docker_mananger] Container started with ID af25830b68bb. Setting up logs at ./log/docker/node2_2026-03-03_04-33-09__60fbe92d-8aa1-4058-b9ff-18d6a8718217__wakuorg_nwaku:latest.log
2026-03-03 04:33:11.456 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 16561
2026-03-03 04:33:11.456 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:33:12.456 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:16561/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:12.470 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:33:12.471 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:33:12.474 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:16561/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:12.478 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.154.227/tcp/16562/p2p/16Uiu2HAm6kPk1URPdgiaFyJAQZZgr1gjxMC82shP8JRKBubGpEBx","/ip4/172.18.154.227/tcp/16563/ws/p2p/16Uiu2HAm6kPk1URPdgiaFyJAQZZgr1gjxMC82shP8JRKBubGpEBx"],"enrUri":"enr:-L24QLefOD_W8TmqyBqSSw1Q5qfnkH9cSOUH0VuytPhnsPt7GqIvU-gnJmruAYpZgb5vunnpEXt-zxezCxAkTtR5jbYCgmlkgnY0gmlwhKwSmuOKbXVsdGlhZGRyc5YACASsEprjBkCyAAoErBKa4wZAs90DgnJzhQADAQAAiXNlY3AyNTZrMaECqDw7SJaD1C54VDlKynxURLkuJEinpGuGzg8ZlAhJadeDdGNwgkCyg3VkcIJAtIV3YWt1MgE"}'
2026-03-03 04:33:12.479 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:33:12.479 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:33:12.480 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:33:12.482 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-03 04:33:12.483 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.63.250
2026-03-03 04:33:12.483 DEBUG [src.node.docker_mananger] Generated ports ['63322', '63323', '63324', '63325', '63326']
2026-03-03 04:33:12.483 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:33:12.483 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:33:12.483 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:33:12.484 DEBUG [src.node.docker_mananger] docker run -i -t -p 63322:63322 -p 63323:63323 -p 63324:63324 -p 63325:63325 -p 63326:63326 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=63324 --rest-port=63322 --tcp-port=63323 --discv5-udp-port=63325 --rest-address=0.0.0.0 --nat=extip:172.18.63.250 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=be1570cff08fb4870a385d4d1ece016c88bbbacebd3fcec009cbcd809dfedbaa --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=63326 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QLefOD_W8TmqyBqSSw1Q5qfnkH9cSOUH0VuytPhnsPt7GqIvU-gnJmruAYpZgb5vunnpEXt-zxezCxAkTtR5jbYCgmlkgnY0gmlwhKwSmuOKbXVsdGlhZGRyc5YACASsEprjBkCyAAoErBKa4wZAs90DgnJzhQADAQAAiXNlY3AyNTZrMaECqDw7SJaD1C54VDlKynxURLkuJEinpGuGzg8ZlAhJadeDdGNwgkCyg3VkcIJAtIV3YWt1MgE
2026-03-03 04:33:12.756 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.63.250 waku efd689f5dba70a28a1315b50863598d25431bdefcf200286facbbd43342be413
2026-03-03 04:33:12.790 DEBUG [src.node.docker_mananger] Container started with ID efd689f5dba7. Setting up logs at ./log/docker/node3_2026-03-03_04-33-09__60fbe92d-8aa1-4058-b9ff-18d6a8718217__wakuorg_nwaku:latest.log
2026-03-03 04:33:12.790 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 63322
2026-03-03 04:33:12.790 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:33:13.791 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63322/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:13.808 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:33:13.812 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:33:13.812 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63322/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:13.817 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.63.250/tcp/63323/p2p/16Uiu2HAmNYeQaSv9cTDDcPGrLxYYRmDwkLPYRiEtHLqHFDe4LBhG","/ip4/172.18.63.250/tcp/63324/ws/p2p/16Uiu2HAmNYeQaSv9cTDDcPGrLxYYRmDwkLPYRiEtHLqHFDe4LBhG"],"enrUri":"enr:-L24QCoJ7h4N8nhQAdS0I_imm_Cyw2_qWiz8wVt1N_gIfQ6XfeXXQXDJPVZiF9rSsSGOVIs8YESj6DdOgO3QrFao58ECgmlkgnY0gmlwhKwSP_qKbXVsdGlhZGRyc5YACASsEj_6BvdbAAoErBI_-gb3XN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDkvTVnRxgaQXrflDUq44igql9F_1X43w4pQIO1PMWLs-DdGNwgvdbg3VkcIL3XYV3YWt1MgE"}'
2026-03-03 04:33:13.818 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:33:13.818 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:33:13.818 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:33:13.820 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-03 04:33:13.820 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.25.162
2026-03-03 04:33:13.820 DEBUG [src.node.docker_mananger] Generated ports ['44585', '44586', '44587', '44588', '44589']
2026-03-03 04:33:13.820 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:33:13.820 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:33:13.821 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:33:13.821 DEBUG [src.node.docker_mananger] docker run -i -t -p 44585:44585 -p 44586:44586 -p 44587:44587 -p 44588:44588 -p 44589:44589 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=44587 --rest-port=44585 --tcp-port=44586 --discv5-udp-port=44588 --rest-address=0.0.0.0 --nat=extip:172.18.25.162 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=40daa81ee7deff58e2aa9fceb631d5b7acfb15bceaaa7fadc12ba0ae666d2d9b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=44589 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QCoJ7h4N8nhQAdS0I_imm_Cyw2_qWiz8wVt1N_gIfQ6XfeXXQXDJPVZiF9rSsSGOVIs8YESj6DdOgO3QrFao58ECgmlkgnY0gmlwhKwSP_qKbXVsdGlhZGRyc5YACASsEj_6BvdbAAoErBI_-gb3XN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDkvTVnRxgaQXrflDUq44igql9F_1X43w4pQIO1PMWLs-DdGNwgvdbg3VkcIL3XYV3YWt1MgE
2026-03-03 04:33:14.014 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.25.162 waku 62acdab35658907067bf460e86b896c0cff7a4dcae49570516b05306223a5aa3
2026-03-03 04:33:14.048 DEBUG [src.node.docker_mananger] Container started with ID 62acdab35658. Setting up logs at ./log/docker/node4_2026-03-03_04-33-09__60fbe92d-8aa1-4058-b9ff-18d6a8718217__wakuorg_nwaku:latest.log
2026-03-03 04:33:14.048 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 44585
2026-03-03 04:33:14.048 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:33:15.050 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44585/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:15.068 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:33:15.069 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:33:15.069 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44585/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:15.072 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.25.162/tcp/44586/p2p/16Uiu2HAmTjqfXanCqFMaNyiBkrbcVcGNXjWKhBhn3i3NSBvddXZt","/ip4/172.18.25.162/tcp/44587/ws/p2p/16Uiu2HAmTjqfXanCqFMaNyiBkrbcVcGNXjWKhBhn3i3NSBvddXZt"],"enrUri":"enr:-L24QGHqRjL8XuQg9RM-Oo4S4mhj8hAuLPNVdybFv_WzPl-kHccl9CzxvemOmxjYvgllRiOl2wHR-QfMdumMDemYi94CgmlkgnY0gmlwhKwSGaKKbXVsdGlhZGRyc5YACASsEhmiBq4qAAoErBIZogauK90DgnJzhQADAQAAiXNlY3AyNTZrMaED4B1jHPEeT-1LoK930BTLLek7T404WDcBNAOx7QNSYauDdGNwgq4qg3VkcIKuLIV3YWt1MgE"}'
2026-03-03 04:33:15.073 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:33:15.073 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:25745/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-03 04:33:15.077 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:33:15.077 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:16561/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-03 04:33:15.084 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:33:15.085 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63322/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-03 04:33:15.093 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:33:15.098 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44585/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-03 04:33:15.103 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:33:15.103 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25745/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:15.107 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.154.227/tcp/45812/p2p/16Uiu2HAm6kPk1URPdgiaFyJAQZZgr1gjxMC82shP8JRKBubGpEBx","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"UnknownOrigin"}]'
2026-03-03 04:33:15.108 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:16561/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:15.110 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.63.250/tcp/57226/p2p/16Uiu2HAmNYeQaSv9cTDDcPGrLxYYRmDwkLPYRiEtHLqHFDe4LBhG","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.9.19/tcp/25746/p2p/16Uiu2HAm5Txf5HnERygv11uvxT2J1ftZzHuboeUBKGkevsecYANo","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"Discv5"}]'
2026-03-03 04:33:15.110 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63322/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:15.113 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.25.162/tcp/51964/p2p/16Uiu2HAmTjqfXanCqFMaNyiBkrbcVcGNXjWKhBhn3i3NSBvddXZt","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.154.227/tcp/16562/p2p/16Uiu2HAm6kPk1URPdgiaFyJAQZZgr1gjxMC82shP8JRKBubGpEBx","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"Discv5"}]'
2026-03-03 04:33:15.113 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44585/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:15.115 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.63.250/tcp/63323/p2p/16Uiu2HAmNYeQaSv9cTDDcPGrLxYYRmDwkLPYRiEtHLqHFDe4LBhG","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"Discv5"}]'
2026-03-03 04:33:15.115 DEBUG [src.libs.common] Sleeping for 20 seconds
2026-03-03 04:33:35.115 INFO [tests.e2e.test_network_conditions] Applying 30.0% packet loss on sender node1
2026-03-03 04:33:35.117 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '4790', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-03 04:33:35.128 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '4790', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'loss', '30.0%']
2026-03-03 04:33:35.140 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '4790', '-n', 'tc', '-s', 'qdisc', 'show', 'dev', 'eth0']
2026-03-03 04:33:35.149 DEBUG [src.steps.network_conditions] tc -s qdisc show dev eth0:
qdisc netem 8002: root refcnt 5 limit 1000 loss 30%
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
2026-03-03 04:33:35.149 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44585/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:35.152 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[]'
2026-03-03 04:33:35.152 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:25745/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:33:36.570 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:33:36.572 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '4790', '-n', 'tc', '-s', 'qdisc', 'show', 'dev', 'eth0']
2026-03-03 04:33:36.582 DEBUG [src.steps.network_conditions] tc -s qdisc show dev eth0:
qdisc netem 8002: root refcnt 5 limit 1000 loss 30%
Sent 500 bytes 5 pkt (dropped 4, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
2026-03-03 04:33:36.582 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44585/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:36.584 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772512415152432414,"ephemeral":false,"proof":""}]'
2026-03-03 04:33:36.585 INFO [tests.e2e.test_network_conditions] Node4 received messages from node1 after 0 trails
2026-03-03 04:33:36.586 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '4790', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-03 04:33:36.596 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-03 04:33:36.597 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-03 04:33:36.597 DEBUG [src.node.waku_node] Stopping container with id 753189323b81
2026-03-03 04:33:37.169 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:33:37.170 DEBUG [src.node.waku_node] Stopping container with id af25830b68bb
2026-03-03 04:33:37.730 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:33:37.730 DEBUG [src.node.waku_node] Stopping container with id efd689f5dba7
2026-03-03 04:33:37.984 ERROR [src.node.docker_mananger] Max retries reached for container 753189323b81. Exiting log stream.
2026-03-03 04:33:38.258 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:33:38.259 DEBUG [src.node.waku_node] Stopping container with id 62acdab35658
2026-03-03 04:33:38.645 ERROR [src.node.docker_mananger] Max retries reached for container af25830b68bb. Exiting log stream.
2026-03-03 04:33:38.763 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:33:38.765 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-03 04:33:38.792 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-03 04:33:38.833 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-03 04:33:38.855 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-03 04:33:38.875 DEBUG [src.node.docker_mananger] No errors found in the waku logs.