168 lines
34 KiB
Plaintext

2026-03-25 04:39:58.604 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-25 04:39:58.604 DEBUG [tests.conftest] Running test: test_relay_packet_loss_correlated_vs_uncorrelated with id: 2026-03-25_04-39-58__d3ab810e-5814-4791-bf3e-38deb07a18bb
2026-03-25 04:39:58.605 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-25 04:39:58.605 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-25 04:39:58.611 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-25 04:39:58.611 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-25_04-39-58__d3ab810e-5814-4791-bf3e-38deb07a18bb__wakuorg_nwaku:latest.log
2026-03-25 04:39:58.617 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-25 04:39:58.617 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-25_04-39-58__d3ab810e-5814-4791-bf3e-38deb07a18bb__wakuorg_nwaku:latest.log
2026-03-25 04:39:58.624 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-25 04:39:58.624 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-25_04-39-58__d3ab810e-5814-4791-bf3e-38deb07a18bb__wakuorg_nwaku:latest.log
2026-03-25 04:39:58.630 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-25 04:39:58.630 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-25_04-39-58__d3ab810e-5814-4791-bf3e-38deb07a18bb__wakuorg_nwaku:latest.log
2026-03-25 04:39:58.631 DEBUG [src.node.waku_node] Starting Node...
2026-03-25 04:39:58.631 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-25 04:39:58.632 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-25 04:39:58.632 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.191.17
2026-03-25 04:39:58.632 DEBUG [src.node.docker_mananger] Generated ports ['43832', '43833', '43834', '43835', '43836']
2026-03-25 04:39:58.633 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-25 04:39:58.633 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-25 04:39:58.633 DEBUG [src.node.waku_node] Using volumes []
2026-03-25 04:39:58.633 DEBUG [src.node.docker_mananger] docker run -i -t -p 43832:43832 -p 43833:43833 -p 43834:43834 -p 43835:43835 -p 43836:43836 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=43834 --rest-port=43832 --tcp-port=43833 --discv5-udp-port=43835 --rest-address=0.0.0.0 --nat=extip:172.18.191.17 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=e3737b5b7aad2dc4b1dfbb95cfbafeea12bc782b7dd7ec604841fec8b4c878f3 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=43836 --metrics-logging=true --relay=true
2026-03-25 04:39:58.821 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.191.17 waku aff946ec762b2985286192c9b3289e5f6fbaeaa86931253896c9e9c7e75531b9
2026-03-25 04:39:58.856 DEBUG [src.node.docker_mananger] Container started with ID aff946ec762b. Setting up logs at ./log/docker/node1_2026-03-25_04-39-58__d3ab810e-5814-4791-bf3e-38deb07a18bb__wakuorg_nwaku:latest.log
2026-03-25 04:39:58.857 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 43832
2026-03-25 04:39:58.857 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-25 04:39:58.889 ERROR [src.node.docker_mananger] Max retries reached for container ab047e590b5a. Exiting log stream.
2026-03-25 04:39:59.399 ERROR [src.node.docker_mananger] Max retries reached for container f1a544c7eb6d. Exiting log stream.
2026-03-25 04:39:59.858 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43832/health" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:39:59.860 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-25 04:39:59.861 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-25 04:39:59.861 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43832/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:39:59.863 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.191.17/tcp/43833/p2p/16Uiu2HAkzu4rWc6sYQH7mBmAiDyD3QkmsR4TviJTXQTAQmbVSPEG","/ip4/172.18.191.17/tcp/43834/ws/p2p/16Uiu2HAkzu4rWc6sYQH7mBmAiDyD3QkmsR4TviJTXQTAQmbVSPEG"],"enrUri":"enr:-L24QBCr6v-Vcccc6YpiWeWJCK43oN-AFzmQH_vQtMsvMqpvNkGONZ9c0fNZxXRn22MNMW37aBt8W37dSYL9rbz1S4QCgmlkgnY0gmlwhKwSvxGKbXVsdGlhZGRyc5YACASsEr8RBqs5AAoErBK_EQarOt0DgnJzhQADAQAAiXNlY3AyNTZrMaECUU77Dq2VL7oERaNeEsdKo9z4Ue48vWdYFFcLzABH_IGDdGNwgqs5g3VkcIKrO4V3YWt1MgE"}'
2026-03-25 04:39:59.864 INFO [src.node.waku_node] REST service is ready !!
2026-03-25 04:39:59.864 DEBUG [src.node.waku_node] Starting Node...
2026-03-25 04:39:59.864 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-25 04:39:59.865 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-25 04:39:59.865 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.118.135
2026-03-25 04:39:59.865 DEBUG [src.node.docker_mananger] Generated ports ['43806', '43807', '43808', '43809', '43810']
2026-03-25 04:39:59.866 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-25 04:39:59.866 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-25 04:39:59.866 DEBUG [src.node.waku_node] Using volumes []
2026-03-25 04:39:59.866 DEBUG [src.node.docker_mananger] docker run -i -t -p 43806:43806 -p 43807:43807 -p 43808:43808 -p 43809:43809 -p 43810:43810 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=43808 --rest-port=43806 --tcp-port=43807 --discv5-udp-port=43809 --rest-address=0.0.0.0 --nat=extip:172.18.118.135 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=4e230b31f02b40227a8c916bbfc5ba27152edfd2ff12e02c59fecc1e9434774b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=43810 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QBCr6v-Vcccc6YpiWeWJCK43oN-AFzmQH_vQtMsvMqpvNkGONZ9c0fNZxXRn22MNMW37aBt8W37dSYL9rbz1S4QCgmlkgnY0gmlwhKwSvxGKbXVsdGlhZGRyc5YACASsEr8RBqs5AAoErBK_EQarOt0DgnJzhQADAQAAiXNlY3AyNTZrMaECUU77Dq2VL7oERaNeEsdKo9z4Ue48vWdYFFcLzABH_IGDdGNwgqs5g3VkcIKrO4V3YWt1MgE
2026-03-25 04:40:00.050 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.118.135 waku 1a7cd715a4540f338b11412ad4503f980408f888340f1af0ae22cb8ab767a869
2026-03-25 04:40:00.088 DEBUG [src.node.docker_mananger] Container started with ID 1a7cd715a454. Setting up logs at ./log/docker/node2_2026-03-25_04-39-58__d3ab810e-5814-4791-bf3e-38deb07a18bb__wakuorg_nwaku:latest.log
2026-03-25 04:40:00.089 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 43806
2026-03-25 04:40:00.089 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-25 04:40:01.089 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43806/health" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:40:01.111 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-25 04:40:01.113 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-25 04:40:01.114 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43806/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:40:01.120 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.118.135/tcp/43807/p2p/16Uiu2HAmDCH2Hd68M7qA3DRpkcZtipYRMjfPvfKTLxGybhy1Nvee","/ip4/172.18.118.135/tcp/43808/ws/p2p/16Uiu2HAmDCH2Hd68M7qA3DRpkcZtipYRMjfPvfKTLxGybhy1Nvee"],"enrUri":"enr:-L24QDB8x92vUCfgVelktdwVexcfFWAYttyRgm01OjY0h5H5L2jX3EAA4H8X-KnrvTomhL39GrKcGr2fcYkRau5tQbcCgmlkgnY0gmlwhKwSdoeKbXVsdGlhZGRyc5YACASsEnaHBqsfAAoErBJ2hwarIN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDCAPbSZWH_dPjThxGaz7sUM3A-OCMBrjPNW7NDv3JEkODdGNwgqsfg3VkcIKrIYV3YWt1MgE"}'
2026-03-25 04:40:01.120 INFO [src.node.waku_node] REST service is ready !!
2026-03-25 04:40:01.121 DEBUG [src.node.waku_node] Starting Node...
2026-03-25 04:40:01.122 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-25 04:40:01.124 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-25 04:40:01.124 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.175.103
2026-03-25 04:40:01.124 DEBUG [src.node.docker_mananger] Generated ports ['1457', '1458', '1459', '1460', '1461']
2026-03-25 04:40:01.124 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-25 04:40:01.124 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-25 04:40:01.124 DEBUG [src.node.waku_node] Using volumes []
2026-03-25 04:40:01.125 DEBUG [src.node.docker_mananger] docker run -i -t -p 1457:1457 -p 1458:1458 -p 1459:1459 -p 1460:1460 -p 1461:1461 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=1459 --rest-port=1457 --tcp-port=1458 --discv5-udp-port=1460 --rest-address=0.0.0.0 --nat=extip:172.18.175.103 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=8dc2e992dfed2bb1fcfe1d11547db4dc7cce35fa2df9d9db211a72aa2edcca3e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=1461 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QDB8x92vUCfgVelktdwVexcfFWAYttyRgm01OjY0h5H5L2jX3EAA4H8X-KnrvTomhL39GrKcGr2fcYkRau5tQbcCgmlkgnY0gmlwhKwSdoeKbXVsdGlhZGRyc5YACASsEnaHBqsfAAoErBJ2hwarIN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDCAPbSZWH_dPjThxGaz7sUM3A-OCMBrjPNW7NDv3JEkODdGNwgqsfg3VkcIKrIYV3YWt1MgE
2026-03-25 04:40:01.317 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.175.103 waku 66577be3277b2f54e8f6f37547210ed4ac2af8d2c4acb04e37cf4018a96f92c1
2026-03-25 04:40:01.351 DEBUG [src.node.docker_mananger] Container started with ID 66577be3277b. Setting up logs at ./log/docker/node3_2026-03-25_04-39-58__d3ab810e-5814-4791-bf3e-38deb07a18bb__wakuorg_nwaku:latest.log
2026-03-25 04:40:01.352 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 1457
2026-03-25 04:40:01.352 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-25 04:40:02.353 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1457/health" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:40:02.367 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-25 04:40:02.367 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-25 04:40:02.368 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1457/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:40:02.375 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.175.103/tcp/1458/p2p/16Uiu2HAmQU9z2nYbrabNUSVTQRVsFtqvtZk8zcDsA1ogAaZZnnKw","/ip4/172.18.175.103/tcp/1459/ws/p2p/16Uiu2HAmQU9z2nYbrabNUSVTQRVsFtqvtZk8zcDsA1ogAaZZnnKw"],"enrUri":"enr:-L24QG4IF2C81IQIW65fXeuQSWGB9iV-ulmazSfiEsAIY2i0CoYiI8LlhuSOMNCj31rOdMRxq2cEM09XeZLh1hU6ggYCgmlkgnY0gmlwhKwSr2eKbXVsdGlhZGRyc5YACASsEq9nBgWyAAoErBKvZwYFs90DgnJzhQADAQAAiXNlY3AyNTZrMaEDr4W_L-ZFCd7b1ZdlMeNbnWnxVmddBUrOFhwIH831SmaDdGNwggWyg3VkcIIFtIV3YWt1MgE"}'
2026-03-25 04:40:02.376 INFO [src.node.waku_node] REST service is ready !!
2026-03-25 04:40:02.376 DEBUG [src.node.waku_node] Starting Node...
2026-03-25 04:40:02.377 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-25 04:40:02.380 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-25 04:40:02.380 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.15.69
2026-03-25 04:40:02.380 DEBUG [src.node.docker_mananger] Generated ports ['2210', '2211', '2212', '2213', '2214']
2026-03-25 04:40:02.380 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-25 04:40:02.380 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-25 04:40:02.380 DEBUG [src.node.waku_node] Using volumes []
2026-03-25 04:40:02.381 DEBUG [src.node.docker_mananger] docker run -i -t -p 2210:2210 -p 2211:2211 -p 2212:2212 -p 2213:2213 -p 2214:2214 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=2212 --rest-port=2210 --tcp-port=2211 --discv5-udp-port=2213 --rest-address=0.0.0.0 --nat=extip:172.18.15.69 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=b8bbaecdc7fa83c32ded09c8cdbd1fd436cbf94d3fcaea12b28ef9cc3ad4372e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=2214 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QG4IF2C81IQIW65fXeuQSWGB9iV-ulmazSfiEsAIY2i0CoYiI8LlhuSOMNCj31rOdMRxq2cEM09XeZLh1hU6ggYCgmlkgnY0gmlwhKwSr2eKbXVsdGlhZGRyc5YACASsEq9nBgWyAAoErBKvZwYFs90DgnJzhQADAQAAiXNlY3AyNTZrMaEDr4W_L-ZFCd7b1ZdlMeNbnWnxVmddBUrOFhwIH831SmaDdGNwggWyg3VkcIIFtIV3YWt1MgE
2026-03-25 04:40:02.570 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.15.69 waku 233b159b10f50b544d0b8e29816557d4d22be2eae5522f0eaea7e3f1df3ea5bf
2026-03-25 04:40:02.604 DEBUG [src.node.docker_mananger] Container started with ID 233b159b10f5. Setting up logs at ./log/docker/node4_2026-03-25_04-39-58__d3ab810e-5814-4791-bf3e-38deb07a18bb__wakuorg_nwaku:latest.log
2026-03-25 04:40:02.604 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 2210
2026-03-25 04:40:02.604 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-25 04:40:03.605 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2210/health" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:40:03.624 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-25 04:40:03.625 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-25 04:40:03.626 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2210/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:40:03.630 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.15.69/tcp/2211/p2p/16Uiu2HAkvRbcZDvscfGgUPPGfTypNdeM8sn5o45VpQBY1SdrLScU","/ip4/172.18.15.69/tcp/2212/ws/p2p/16Uiu2HAkvRbcZDvscfGgUPPGfTypNdeM8sn5o45VpQBY1SdrLScU"],"enrUri":"enr:-L24QOb6O8oCBp1aC9nsYBPyYi89wzqEDOVo1ITouzEinLLiGeeCddLXcWzPPYICOQcxMMVTS-fREGUTSpAzrjOlPDgCgmlkgnY0gmlwhKwSD0WKbXVsdGlhZGRyc5YACASsEg9FBgijAAoErBIPRQYIpN0DgnJzhQADAQAAiXNlY3AyNTZrMaECDtbABlC1uXY3mMJ_eU8I-Jmt0xMh6a9hnpS_7taqn1WDdGNwggijg3VkcIIIpYV3YWt1MgE"}'
2026-03-25 04:40:03.631 INFO [src.node.waku_node] REST service is ready !!
2026-03-25 04:40:03.631 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43832/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-25 04:40:03.636 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-25 04:40:03.637 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43806/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-25 04:40:03.643 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-25 04:40:03.643 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1457/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-25 04:40:03.653 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-25 04:40:03.655 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:2210/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-25 04:40:03.664 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-25 04:40:03.664 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43832/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:40:03.667 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.118.135/tcp/42354/p2p/16Uiu2HAmDCH2Hd68M7qA3DRpkcZtipYRMjfPvfKTLxGybhy1Nvee","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-11-g6a20ee","origin":"UnknownOrigin"}]'
2026-03-25 04:40:03.667 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43806/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:40:03.669 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.191.17/tcp/43833/p2p/16Uiu2HAkzu4rWc6sYQH7mBmAiDyD3QkmsR4TviJTXQTAQmbVSPEG","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-11-g6a20ee","origin":"Discv5"},{"multiaddr":"/ip4/172.18.175.103/tcp/48280/p2p/16Uiu2HAmQU9z2nYbrabNUSVTQRVsFtqvtZk8zcDsA1ogAaZZnnKw","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-11-g6a20ee","origin":"UnknownOrigin"}]'
2026-03-25 04:40:03.669 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1457/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:40:03.672 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.118.135/tcp/43807/p2p/16Uiu2HAmDCH2Hd68M7qA3DRpkcZtipYRMjfPvfKTLxGybhy1Nvee","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-11-g6a20ee","origin":"Discv5"},{"multiaddr":"/ip4/172.18.15.69/tcp/42940/p2p/16Uiu2HAkvRbcZDvscfGgUPPGfTypNdeM8sn5o45VpQBY1SdrLScU","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-11-g6a20ee","origin":"UnknownOrigin"}]'
2026-03-25 04:40:03.672 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2210/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:40:03.674 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.175.103/tcp/1458/p2p/16Uiu2HAmQU9z2nYbrabNUSVTQRVsFtqvtZk8zcDsA1ogAaZZnnKw","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-11-g6a20ee","origin":"Discv5"}]'
2026-03-25 04:40:03.674 DEBUG [src.libs.common] Sleeping for 20 seconds
2026-03-25 04:40:23.676 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '8296', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-25 04:40:23.687 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '8296', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'loss', '50.0%']
2026-03-25 04:40:23.697 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '8296', '-n', 'tc', '-s', 'qdisc', 'show', 'dev', 'eth0']
2026-03-25 04:40:23.706 DEBUG [src.steps.network_conditions] tc -s qdisc show dev eth0:
qdisc netem 8002: root refcnt 5 limit 1000 loss 50%
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
2026-03-25 04:40:23.706 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2210/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:40:23.709 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[]'
2026-03-25 04:40:23.709 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43832/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-25 04:40:24.329 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-25 04:40:24.329 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43832/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-25 04:40:25.545 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-25 04:40:25.545 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43832/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-25 04:40:26.560 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-25 04:40:26.560 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43832/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-25 04:40:29.016 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-25 04:40:29.017 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43832/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-25 04:40:29.225 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-25 04:40:29.225 DEBUG [src.libs.common] Sleeping for 30.0 seconds
2026-03-25 04:40:59.225 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2210/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:40:59.228 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774413623709567377,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774413624329518563,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774413625545558977,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774413626560579328,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774413629017362273,"ephemeral":false,"proof":""}]'
2026-03-25 04:40:59.230 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '8296', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-25 04:40:59.240 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '8296', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-25 04:40:59.251 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '8296', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'loss', '50.0%', '75.0%']
2026-03-25 04:40:59.260 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2210/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:40:59.262 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[]'
2026-03-25 04:40:59.263 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43832/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-25 04:40:59.271 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-25 04:40:59.272 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43832/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-25 04:40:59.287 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-25 04:40:59.290 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43832/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-25 04:41:01.374 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-25 04:41:01.376 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43832/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-25 04:41:04.451 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-25 04:41:04.454 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43832/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-25 04:41:05.088 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-25 04:41:05.088 DEBUG [src.libs.common] Sleeping for 30.0 seconds
2026-03-25 04:41:35.089 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2210/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:41:35.092 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774413659262959334,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774413659272793782,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774413659290194012,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774413661376769147,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774413664454748756,"ephemeral":false,"proof":""}]'
2026-03-25 04:41:35.093 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '8296', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-25 04:41:35.103 DEBUG [tests.e2e.test_network_conditions] uncorrelated=5 correlated=5
2026-03-25 04:41:35.105 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-25 04:41:35.106 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-25 04:41:35.106 DEBUG [src.node.waku_node] Stopping container with id aff946ec762b
2026-03-25 04:41:35.655 DEBUG [src.node.waku_node] Container stopped.
2026-03-25 04:41:35.656 DEBUG [src.node.waku_node] Stopping container with id 1a7cd715a454
2026-03-25 04:41:36.235 DEBUG [src.node.waku_node] Container stopped.
2026-03-25 04:41:36.237 DEBUG [src.node.waku_node] Stopping container with id 66577be3277b
2026-03-25 04:41:36.470 ERROR [src.node.docker_mananger] Max retries reached for container aff946ec762b. Exiting log stream.
2026-03-25 04:41:36.805 DEBUG [src.node.waku_node] Container stopped.
2026-03-25 04:41:36.806 DEBUG [src.node.waku_node] Stopping container with id 233b159b10f5
2026-03-25 04:41:37.055 ERROR [src.node.docker_mananger] Max retries reached for container 1a7cd715a454. Exiting log stream.
2026-03-25 04:41:37.349 DEBUG [src.node.waku_node] Container stopped.
2026-03-25 04:41:37.353 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-25 04:41:37.421 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-25 04:41:37.498 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-25 04:41:37.649 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-25 04:41:37.728 DEBUG [src.node.docker_mananger] No errors found in the waku logs.