181 lines
36 KiB
Plaintext

2026-03-10 04:37:54.718 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-10 04:37:54.719 DEBUG [tests.conftest] Running test: test_relay_4_nodes_sender_packet_loss_delivery_ratio_simple[loss60] with id: 2026-03-10_04-37-54__d8c4efce-4fb1-4999-bbce-445ab595f3da
2026-03-10 04:37:54.719 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-10 04:37:54.719 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-10 04:37:54.727 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-10 04:37:54.727 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-10_04-37-54__d8c4efce-4fb1-4999-bbce-445ab595f3da__wakuorg_nwaku:latest.log
2026-03-10 04:37:54.734 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-10 04:37:54.735 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-10_04-37-54__d8c4efce-4fb1-4999-bbce-445ab595f3da__wakuorg_nwaku:latest.log
2026-03-10 04:37:54.742 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-10 04:37:54.743 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-10_04-37-54__d8c4efce-4fb1-4999-bbce-445ab595f3da__wakuorg_nwaku:latest.log
2026-03-10 04:37:54.749 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-10 04:37:54.750 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-10_04-37-54__d8c4efce-4fb1-4999-bbce-445ab595f3da__wakuorg_nwaku:latest.log
2026-03-10 04:37:54.750 DEBUG [src.node.waku_node] Starting Node...
2026-03-10 04:37:54.750 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-10 04:37:54.751 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-10 04:37:54.752 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.130.16
2026-03-10 04:37:54.752 DEBUG [src.node.docker_mananger] Generated ports ['57486', '57487', '57488', '57489', '57490']
2026-03-10 04:37:54.752 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-10 04:37:54.752 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-10 04:37:54.752 DEBUG [src.node.waku_node] Using volumes []
2026-03-10 04:37:54.752 DEBUG [src.node.docker_mananger] docker run -i -t -p 57486:57486 -p 57487:57487 -p 57488:57488 -p 57489:57489 -p 57490:57490 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=57488 --rest-port=57486 --tcp-port=57487 --discv5-udp-port=57489 --rest-address=0.0.0.0 --nat=extip:172.18.130.16 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ace9afad87b07aaa07fc1efaec94cfef0fe6bf5ea31c0b1f5caca4eafccaf54b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=57490 --metrics-logging=true --relay=true
2026-03-10 04:37:54.948 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.130.16 waku 7e4839ed852543f91471695880360c0b9f280a4e12b63cda0285351c63021a46
2026-03-10 04:37:54.984 DEBUG [src.node.docker_mananger] Container started with ID 7e4839ed8525. Setting up logs at ./log/docker/node1_2026-03-10_04-37-54__d8c4efce-4fb1-4999-bbce-445ab595f3da__wakuorg_nwaku:latest.log
2026-03-10 04:37:54.985 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 57486
2026-03-10 04:37:54.985 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-10 04:37:55.985 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57486/health" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:37:55.988 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-10 04:37:55.989 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-10 04:37:55.989 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57486/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:37:55.991 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.130.16/tcp/57487/p2p/16Uiu2HAmTDkNexF4Ndg7wYQyLPs1o2mc4WKjiaMf8euxYUKZ1UEc","/ip4/172.18.130.16/tcp/57488/ws/p2p/16Uiu2HAmTDkNexF4Ndg7wYQyLPs1o2mc4WKjiaMf8euxYUKZ1UEc"],"enrUri":"enr:-L24QNz4PhfN-39L6JAqyGfpezSLrZQ3YkzlDmy9Edf95iMvWIhO7kr0bMk1423uJhoiTE-NrEqfLUOmipp2jhgeJ9ICgmlkgnY0gmlwhKwSghCKbXVsdGlhZGRyc5YACASsEoIQBuCPAAoErBKCEAbgkN0DgnJzhQADAQAAiXNlY3AyNTZrMaED2Gf6_bwEKvvTNr57hajU31OvjLumUYQsXP3i-z9JRmGDdGNwguCPg3VkcILgkYV3YWt1MgE"}'
2026-03-10 04:37:55.991 INFO [src.node.waku_node] REST service is ready !!
2026-03-10 04:37:55.992 DEBUG [src.node.waku_node] Starting Node...
2026-03-10 04:37:55.992 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-10 04:37:55.993 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-10 04:37:55.993 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.231.126
2026-03-10 04:37:55.994 DEBUG [src.node.docker_mananger] Generated ports ['11413', '11414', '11415', '11416', '11417']
2026-03-10 04:37:55.994 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-10 04:37:55.994 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-10 04:37:55.994 DEBUG [src.node.waku_node] Using volumes []
2026-03-10 04:37:55.994 DEBUG [src.node.docker_mananger] docker run -i -t -p 11413:11413 -p 11414:11414 -p 11415:11415 -p 11416:11416 -p 11417:11417 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=11415 --rest-port=11413 --tcp-port=11414 --discv5-udp-port=11416 --rest-address=0.0.0.0 --nat=extip:172.18.231.126 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=9ab7d180c1e7abcc5abc72adc6bd47d38175cbefb30a6b8f7ac1cf8faad2c293 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=11417 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QNz4PhfN-39L6JAqyGfpezSLrZQ3YkzlDmy9Edf95iMvWIhO7kr0bMk1423uJhoiTE-NrEqfLUOmipp2jhgeJ9ICgmlkgnY0gmlwhKwSghCKbXVsdGlhZGRyc5YACASsEoIQBuCPAAoErBKCEAbgkN0DgnJzhQADAQAAiXNlY3AyNTZrMaED2Gf6_bwEKvvTNr57hajU31OvjLumUYQsXP3i-z9JRmGDdGNwguCPg3VkcILgkYV3YWt1MgE
2026-03-10 04:37:56.192 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.231.126 waku 86cd8c6a08ec5117c3fd401606bedd9943531738b5e97d1adaaffd9031267929
2026-03-10 04:37:56.229 DEBUG [src.node.docker_mananger] Container started with ID 86cd8c6a08ec. Setting up logs at ./log/docker/node2_2026-03-10_04-37-54__d8c4efce-4fb1-4999-bbce-445ab595f3da__wakuorg_nwaku:latest.log
2026-03-10 04:37:56.229 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 11413
2026-03-10 04:37:56.230 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-10 04:37:57.230 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11413/health" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:37:57.252 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-10 04:37:57.257 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-10 04:37:57.258 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11413/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:37:57.264 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.231.126/tcp/11414/p2p/16Uiu2HAmQji3EiRADqTt9tqLaqQL3dYxsnvBE6uninTfaQVPnk2C","/ip4/172.18.231.126/tcp/11415/ws/p2p/16Uiu2HAmQji3EiRADqTt9tqLaqQL3dYxsnvBE6uninTfaQVPnk2C"],"enrUri":"enr:-L24QM4p3WG3HqH0tTzEy0pkd7IfoaQ7ZSPyd1yQQXiWPv1vDbb75G5XXc7GLd-e1cGdcFgWSYRAE3UNdtJPC9SYHt0CgmlkgnY0gmlwhKwS536KbXVsdGlhZGRyc5YACASsEud-BiyWAAoErBLnfgYsl90DgnJzhQADAQAAiXNlY3AyNTZrMaEDs4G0N2WMFcCn5zmlZ0EIUJ0ffJKan--v47fTSbMz63mDdGNwgiyWg3VkcIIsmIV3YWt1MgE"}'
2026-03-10 04:37:57.265 INFO [src.node.waku_node] REST service is ready !!
2026-03-10 04:37:57.266 DEBUG [src.node.waku_node] Starting Node...
2026-03-10 04:37:57.266 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-10 04:37:57.268 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-10 04:37:57.268 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.143.142
2026-03-10 04:37:57.269 DEBUG [src.node.docker_mananger] Generated ports ['21208', '21209', '21210', '21211', '21212']
2026-03-10 04:37:57.269 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-10 04:37:57.269 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-10 04:37:57.269 DEBUG [src.node.waku_node] Using volumes []
2026-03-10 04:37:57.269 DEBUG [src.node.docker_mananger] docker run -i -t -p 21208:21208 -p 21209:21209 -p 21210:21210 -p 21211:21211 -p 21212:21212 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=21210 --rest-port=21208 --tcp-port=21209 --discv5-udp-port=21211 --rest-address=0.0.0.0 --nat=extip:172.18.143.142 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=d6a3efd4cf35fbecc8cc8c77dac5fd50feefdcfdb31f7ac8245ddebceba36cf7 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=21212 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QM4p3WG3HqH0tTzEy0pkd7IfoaQ7ZSPyd1yQQXiWPv1vDbb75G5XXc7GLd-e1cGdcFgWSYRAE3UNdtJPC9SYHt0CgmlkgnY0gmlwhKwS536KbXVsdGlhZGRyc5YACASsEud-BiyWAAoErBLnfgYsl90DgnJzhQADAQAAiXNlY3AyNTZrMaEDs4G0N2WMFcCn5zmlZ0EIUJ0ffJKan--v47fTSbMz63mDdGNwgiyWg3VkcIIsmIV3YWt1MgE
2026-03-10 04:37:57.476 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.143.142 waku 7939d20e7bca1b55cececcb4a7334e00d2b734c219c568306547f237f4f0f7de
2026-03-10 04:37:57.516 DEBUG [src.node.docker_mananger] Container started with ID 7939d20e7bca. Setting up logs at ./log/docker/node3_2026-03-10_04-37-54__d8c4efce-4fb1-4999-bbce-445ab595f3da__wakuorg_nwaku:latest.log
2026-03-10 04:37:57.517 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 21208
2026-03-10 04:37:57.518 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-10 04:37:58.519 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:21208/health" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:37:58.528 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-10 04:37:58.528 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-10 04:37:58.529 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:21208/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:37:58.535 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.143.142/tcp/21209/p2p/16Uiu2HAmN6KxBBLUfJkXAAupUeg4xmSbbmrz5srq7cZQdAPBBoMA","/ip4/172.18.143.142/tcp/21210/ws/p2p/16Uiu2HAmN6KxBBLUfJkXAAupUeg4xmSbbmrz5srq7cZQdAPBBoMA"],"enrUri":"enr:-L24QMu19ufxCragcKfnKZ-iX2TdCcONprcgBx-mCqMX5EemcvXlWG8-NjdOaA1n-c5CZX4PlI10VO4L_4d85we1CT8CgmlkgnY0gmlwhKwSj46KbXVsdGlhZGRyc5YACASsEo-OBlLZAAoErBKPjgZS2t0DgnJzhQADAQAAiXNlY3AyNTZrMaEDjDbdtMUQO1NYfNI4vwe_Zw9ywRfHERpi65-LqaRDCjmDdGNwglLZg3VkcIJS24V3YWt1MgE"}'
2026-03-10 04:37:58.535 INFO [src.node.waku_node] REST service is ready !!
2026-03-10 04:37:58.535 DEBUG [src.node.waku_node] Starting Node...
2026-03-10 04:37:58.536 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-10 04:37:58.538 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-10 04:37:58.538 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.246.235
2026-03-10 04:37:58.538 DEBUG [src.node.docker_mananger] Generated ports ['47641', '47642', '47643', '47644', '47645']
2026-03-10 04:37:58.538 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-10 04:37:58.538 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-10 04:37:58.539 DEBUG [src.node.waku_node] Using volumes []
2026-03-10 04:37:58.539 DEBUG [src.node.docker_mananger] docker run -i -t -p 47641:47641 -p 47642:47642 -p 47643:47643 -p 47644:47644 -p 47645:47645 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=47643 --rest-port=47641 --tcp-port=47642 --discv5-udp-port=47644 --rest-address=0.0.0.0 --nat=extip:172.18.246.235 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=dcc5426fc8ad2d08faafaa5f60b29f9b93ea0dacfac67f4fcb993abe4d2a12e2 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=47645 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QMu19ufxCragcKfnKZ-iX2TdCcONprcgBx-mCqMX5EemcvXlWG8-NjdOaA1n-c5CZX4PlI10VO4L_4d85we1CT8CgmlkgnY0gmlwhKwSj46KbXVsdGlhZGRyc5YACASsEo-OBlLZAAoErBKPjgZS2t0DgnJzhQADAQAAiXNlY3AyNTZrMaEDjDbdtMUQO1NYfNI4vwe_Zw9ywRfHERpi65-LqaRDCjmDdGNwglLZg3VkcIJS24V3YWt1MgE
2026-03-10 04:37:58.756 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.246.235 waku a0165c7857a750acedb31316ec6e040f073ac4bb99e3fd91dcffb25a9624553a
2026-03-10 04:37:58.794 DEBUG [src.node.docker_mananger] Container started with ID a0165c7857a7. Setting up logs at ./log/docker/node4_2026-03-10_04-37-54__d8c4efce-4fb1-4999-bbce-445ab595f3da__wakuorg_nwaku:latest.log
2026-03-10 04:37:58.794 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 47641
2026-03-10 04:37:58.795 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-10 04:37:59.796 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:47641/health" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:37:59.810 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-10 04:37:59.811 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-10 04:37:59.812 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:47641/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:37:59.819 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.246.235/tcp/47642/p2p/16Uiu2HAm9ovgGnuLRuyLGrrc9dCtbPcPcKRgv6mRor4v8UUW1PA8","/ip4/172.18.246.235/tcp/47643/ws/p2p/16Uiu2HAm9ovgGnuLRuyLGrrc9dCtbPcPcKRgv6mRor4v8UUW1PA8"],"enrUri":"enr:-L24QBvkI_0XmUJKfL5OXME-5m9vVn586sTImsO9f2jCF5zkJLIwX9WwJsSZPrIzlmCH_ik04ohydyDYCBEgWzFbRr4CgmlkgnY0gmlwhKwS9uuKbXVsdGlhZGRyc5YACASsEvbrBroaAAoErBL26wa6G90DgnJzhQADAQAAiXNlY3AyNTZrMaEC1bcDhgTBgtjoqWYu3666t8Lnh_pByrcLAfA0AYGeLxmDdGNwgroag3VkcIK6HIV3YWt1MgE"}'
2026-03-10 04:37:59.820 INFO [src.node.waku_node] REST service is ready !!
2026-03-10 04:37:59.820 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57486/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-10 04:37:59.826 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:37:59.827 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11413/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-10 04:37:59.835 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:37:59.836 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21208/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-10 04:37:59.846 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:37:59.849 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:47641/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-10 04:37:59.856 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:37:59.858 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57486/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:37:59.861 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.231.126/tcp/57112/p2p/16Uiu2HAmQji3EiRADqTt9tqLaqQL3dYxsnvBE6uninTfaQVPnk2C","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"UnknownOrigin"}]'
2026-03-10 04:37:59.861 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11413/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:37:59.863 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.130.16/tcp/57487/p2p/16Uiu2HAmTDkNexF4Ndg7wYQyLPs1o2mc4WKjiaMf8euxYUKZ1UEc","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"Discv5"},{"multiaddr":"/ip4/172.18.143.142/tcp/46838/p2p/16Uiu2HAmN6KxBBLUfJkXAAupUeg4xmSbbmrz5srq7cZQdAPBBoMA","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"UnknownOrigin"}]'
2026-03-10 04:37:59.864 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:21208/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:37:59.866 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.246.235/tcp/49486/p2p/16Uiu2HAm9ovgGnuLRuyLGrrc9dCtbPcPcKRgv6mRor4v8UUW1PA8","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.231.126/tcp/11414/p2p/16Uiu2HAmQji3EiRADqTt9tqLaqQL3dYxsnvBE6uninTfaQVPnk2C","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"Discv5"}]'
2026-03-10 04:37:59.866 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:47641/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:37:59.869 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.143.142/tcp/21209/p2p/16Uiu2HAmN6KxBBLUfJkXAAupUeg4xmSbbmrz5srq7cZQdAPBBoMA","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"Discv5"}]'
2026-03-10 04:37:59.869 DEBUG [src.libs.common] Sleeping for 20 seconds
2026-03-10 04:38:19.871 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '14608', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-10 04:38:19.933 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '14608', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-10 04:38:19.944 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '14608', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'loss', '60.0%']
2026-03-10 04:38:19.961 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '14608', '-n', 'tc', '-s', 'qdisc', 'show', 'dev', 'eth0']
2026-03-10 04:38:19.972 DEBUG [src.steps.network_conditions] tc -s qdisc show dev eth0:
qdisc netem 8001: root refcnt 5 limit 1000 loss 60%
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
2026-03-10 04:38:19.972 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:47641/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:38:19.976 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[]'
2026-03-10 04:38:19.976 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57486/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:38:21.040 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:38:21.045 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57486/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:38:25.140 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:38:25.142 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57486/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:38:25.362 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:38:25.362 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57486/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:38:26.826 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:38:26.826 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57486/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:38:27.042 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:38:27.042 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57486/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:38:28.082 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:38:28.083 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57486/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:38:28.099 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:38:28.100 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57486/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:38:29.546 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:38:29.546 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57486/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:38:30.170 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:38:30.171 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57486/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:38:30.386 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:38:30.386 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57486/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:38:33.666 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:38:33.666 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57486/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:38:35.146 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:38:35.146 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57486/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:38:36.626 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:38:36.627 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57486/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:38:39.730 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:38:39.733 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57486/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:38:40.751 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:38:40.752 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57486/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:38:43.242 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:38:43.242 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57486/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:38:43.866 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:38:43.866 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57486/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:38:44.916 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:38:44.917 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57486/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:38:45.941 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:38:45.942 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57486/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:38:46.162 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:38:46.162 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57486/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:38:47.218 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:38:47.220 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57486/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:38:59.242 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:38:59.242 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57486/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:39:04.170 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:39:04.170 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57486/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:39:24.426 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-10 04:39:24.427 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-10 04:39:24.427 DEBUG [src.node.waku_node] Stopping container with id 7e4839ed8525
2026-03-10 04:39:24.971 DEBUG [src.node.waku_node] Container stopped.
2026-03-10 04:39:24.974 DEBUG [src.node.waku_node] Stopping container with id 86cd8c6a08ec
2026-03-10 04:39:25.516 DEBUG [src.node.waku_node] Container stopped.
2026-03-10 04:39:25.517 DEBUG [src.node.waku_node] Stopping container with id 7939d20e7bca
2026-03-10 04:39:25.785 ERROR [src.node.docker_mananger] Max retries reached for container 7e4839ed8525. Exiting log stream.
2026-03-10 04:39:26.046 DEBUG [src.node.waku_node] Container stopped.
2026-03-10 04:39:26.049 DEBUG [src.node.waku_node] Stopping container with id a0165c7857a7
2026-03-10 04:39:26.332 ERROR [src.node.docker_mananger] Max retries reached for container 86cd8c6a08ec. Exiting log stream.
2026-03-10 04:39:26.617 DEBUG [src.node.waku_node] Container stopped.
2026-03-10 04:39:26.618 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-10 04:39:26.688 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-10 04:39:26.763 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-10 04:39:26.841 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-10 04:39:26.916 DEBUG [src.node.docker_mananger] No errors found in the waku logs.