2026-02-25 20:22:16 +00:00

168 lines
34 KiB
Plaintext

2026-02-25 20:06:22.717 DEBUG [tests.conftest] Running fixture setup: test_id
2026-02-25 20:06:22.717 DEBUG [tests.conftest] Running test: test_relay_packet_loss_correlated_vs_uncorrelated with id: 2026-02-25_20-06-22__2c99bb5e-5c52-4c3c-abb7-45ed6cbf8f33
2026-02-25 20:06:22.718 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-02-25 20:06:22.718 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-02-25 20:06:22.727 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 20:06:22.728 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-02-25_20-06-22__2c99bb5e-5c52-4c3c-abb7-45ed6cbf8f33__wakuorg_nwaku:latest.log
2026-02-25 20:06:22.736 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 20:06:22.737 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-02-25_20-06-22__2c99bb5e-5c52-4c3c-abb7-45ed6cbf8f33__wakuorg_nwaku:latest.log
2026-02-25 20:06:22.746 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 20:06:22.747 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-02-25_20-06-22__2c99bb5e-5c52-4c3c-abb7-45ed6cbf8f33__wakuorg_nwaku:latest.log
2026-02-25 20:06:22.757 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 20:06:22.757 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-02-25_20-06-22__2c99bb5e-5c52-4c3c-abb7-45ed6cbf8f33__wakuorg_nwaku:latest.log
2026-02-25 20:06:22.757 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 20:06:22.758 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 20:06:22.761 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 20:06:22.761 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.161.131
2026-02-25 20:06:22.762 DEBUG [src.node.docker_mananger] Generated ports ['30007', '30008', '30009', '30010', '30011']
2026-02-25 20:06:22.762 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 20:06:22.762 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 20:06:22.762 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 20:06:22.763 DEBUG [src.node.docker_mananger] docker run -i -t -p 30007:30007 -p 30008:30008 -p 30009:30009 -p 30010:30010 -p 30011:30011 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=30009 --rest-port=30007 --tcp-port=30008 --discv5-udp-port=30010 --rest-address=0.0.0.0 --nat=extip:172.18.161.131 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=2dc8fb9e6afcdceb96afc991da98f3bab12e08ccb3accbc60bb1eff0a53dfc1f --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=30011 --metrics-logging=true --relay=true
2026-02-25 20:06:22.952 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.161.131 waku b046092d69ce6d74cfa29a792a6d7eb1be3c8ddbdf3afc74149202561e662a48
2026-02-25 20:06:22.962 ERROR [src.node.docker_mananger] Max retries reached for container 5b386c3744d1. Exiting log stream.
2026-02-25 20:06:22.989 DEBUG [src.node.docker_mananger] Container started with ID b046092d69ce. Setting up logs at ./log/docker/node1_2026-02-25_20-06-22__2c99bb5e-5c52-4c3c-abb7-45ed6cbf8f33__wakuorg_nwaku:latest.log
2026-02-25 20:06:22.989 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 30007
2026-02-25 20:06:22.990 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 20:06:23.589 ERROR [src.node.docker_mananger] Max retries reached for container 76637384f92a. Exiting log stream.
2026-02-25 20:06:23.990 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30007/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:06:23.993 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 20:06:23.993 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 20:06:23.993 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30007/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:06:23.996 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.161.131/tcp/30008/p2p/16Uiu2HAmDka94ULVzre5m1trb4C3WSBbmxayRcP6TP7eRWE2JaFR","/ip4/172.18.161.131/tcp/30009/ws/p2p/16Uiu2HAmDka94ULVzre5m1trb4C3WSBbmxayRcP6TP7eRWE2JaFR"],"enrUri":"enr:-L24QCI_4Mw6jB_Te14ZyBtharJg2A5US-mzWR9bET9FPcicPrADZotHxwQfAFfyipavAbmK2nas9W7Z9rrprZY_VdwCgmlkgnY0gmlwhKwSoYOKbXVsdGlhZGRyc5YACASsEqGDBnU4AAoErBKhgwZ1Od0DgnJzhQADAQAAiXNlY3AyNTZrMaEDEEnL5pXLe6mvHKRyisLA6dDcoHuinVzIMRLIQBt7IgCDdGNwgnU4g3VkcIJ1OoV3YWt1MgE"}'
2026-02-25 20:06:23.996 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 20:06:23.996 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 20:06:23.996 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 20:06:23.998 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 20:06:23.998 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.104.164
2026-02-25 20:06:23.998 DEBUG [src.node.docker_mananger] Generated ports ['36049', '36050', '36051', '36052', '36053']
2026-02-25 20:06:23.998 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 20:06:23.998 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 20:06:23.998 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 20:06:23.999 DEBUG [src.node.docker_mananger] docker run -i -t -p 36049:36049 -p 36050:36050 -p 36051:36051 -p 36052:36052 -p 36053:36053 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=36051 --rest-port=36049 --tcp-port=36050 --discv5-udp-port=36052 --rest-address=0.0.0.0 --nat=extip:172.18.104.164 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=083ba4f90409580dbd1eac6fed53b628e99af2b24a02a141ebc6cbda494bef57 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=36053 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QCI_4Mw6jB_Te14ZyBtharJg2A5US-mzWR9bET9FPcicPrADZotHxwQfAFfyipavAbmK2nas9W7Z9rrprZY_VdwCgmlkgnY0gmlwhKwSoYOKbXVsdGlhZGRyc5YACASsEqGDBnU4AAoErBKhgwZ1Od0DgnJzhQADAQAAiXNlY3AyNTZrMaEDEEnL5pXLe6mvHKRyisLA6dDcoHuinVzIMRLIQBt7IgCDdGNwgnU4g3VkcIJ1OoV3YWt1MgE
2026-02-25 20:06:24.185 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.104.164 waku d894c574830fceed66e878eec3fa6a5df8d88c94e51453873919c06785b70046
2026-02-25 20:06:24.220 DEBUG [src.node.docker_mananger] Container started with ID d894c574830f. Setting up logs at ./log/docker/node2_2026-02-25_20-06-22__2c99bb5e-5c52-4c3c-abb7-45ed6cbf8f33__wakuorg_nwaku:latest.log
2026-02-25 20:06:24.221 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 36049
2026-02-25 20:06:24.221 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 20:06:25.223 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:36049/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:06:25.242 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 20:06:25.244 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 20:06:25.244 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:36049/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:06:25.251 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.104.164/tcp/36050/p2p/16Uiu2HAmNRrAxPs7CkwZzQCNa3H4e5cJfB3ABJdjEJ5aatrzTsZE","/ip4/172.18.104.164/tcp/36051/ws/p2p/16Uiu2HAmNRrAxPs7CkwZzQCNa3H4e5cJfB3ABJdjEJ5aatrzTsZE"],"enrUri":"enr:-L24QDboyHKmhmR4RIF04bjgzgUIWt2gK_6WcUuSFkSSygm1XuqWz25ODFPLOKgwwsMAi15MGBwtO8MCKwg7EAaVU-UCgmlkgnY0gmlwhKwSaKSKbXVsdGlhZGRyc5YACASsEmikBozSAAoErBJopAaM090DgnJzhQADAQAAiXNlY3AyNTZrMaEDkTcSWBkeFCyTlUlbyGvCtP_TIREa9FxNT2LBrSNiWtWDdGNwgozSg3VkcIKM1IV3YWt1MgE"}'
2026-02-25 20:06:25.252 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 20:06:25.252 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 20:06:25.252 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 20:06:25.255 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 20:06:25.255 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.199.81
2026-02-25 20:06:25.255 DEBUG [src.node.docker_mananger] Generated ports ['53054', '53055', '53056', '53057', '53058']
2026-02-25 20:06:25.255 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 20:06:25.256 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 20:06:25.257 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 20:06:25.257 DEBUG [src.node.docker_mananger] docker run -i -t -p 53054:53054 -p 53055:53055 -p 53056:53056 -p 53057:53057 -p 53058:53058 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=53056 --rest-port=53054 --tcp-port=53055 --discv5-udp-port=53057 --rest-address=0.0.0.0 --nat=extip:172.18.199.81 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=b809ccc5bf028cb43a383c0f840fcc3ac329aefc796faa62a5ecfb9a5c04cc0b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=53058 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QDboyHKmhmR4RIF04bjgzgUIWt2gK_6WcUuSFkSSygm1XuqWz25ODFPLOKgwwsMAi15MGBwtO8MCKwg7EAaVU-UCgmlkgnY0gmlwhKwSaKSKbXVsdGlhZGRyc5YACASsEmikBozSAAoErBJopAaM090DgnJzhQADAQAAiXNlY3AyNTZrMaEDkTcSWBkeFCyTlUlbyGvCtP_TIREa9FxNT2LBrSNiWtWDdGNwgozSg3VkcIKM1IV3YWt1MgE
2026-02-25 20:06:25.456 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.199.81 waku cb9230db91c8dca1dd642ef866b4ac29454c0f1bc362dd5b79ce5cd3128216c3
2026-02-25 20:06:25.490 DEBUG [src.node.docker_mananger] Container started with ID cb9230db91c8. Setting up logs at ./log/docker/node3_2026-02-25_20-06-22__2c99bb5e-5c52-4c3c-abb7-45ed6cbf8f33__wakuorg_nwaku:latest.log
2026-02-25 20:06:25.490 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 53054
2026-02-25 20:06:25.491 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 20:06:26.493 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53054/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:06:26.513 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 20:06:26.514 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 20:06:26.514 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53054/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:06:26.517 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.199.81/tcp/53055/p2p/16Uiu2HAm2ksKTVc6efrVPFv5M9ArQMGNQtQSa6wKfp57mt3UXxYW","/ip4/172.18.199.81/tcp/53056/ws/p2p/16Uiu2HAm2ksKTVc6efrVPFv5M9ArQMGNQtQSa6wKfp57mt3UXxYW"],"enrUri":"enr:-L24QNcdICAkSsWbKXbm3-LMxJNd_MMEtPsVa6yONwwNGbaaO8Crp4yMCid-OjbDqgjy87TVL2GfIbWduUDq7zAQil4CgmlkgnY0gmlwhKwSx1GKbXVsdGlhZGRyc5YACASsEsdRBs8_AAoErBLHUQbPQN0DgnJzhQADAQAAiXNlY3AyNTZrMaECbOyqOd_AElhINw5IIeBbL6gs2ZAJPy7UUEJgLvqcHT-DdGNwgs8_g3VkcILPQYV3YWt1MgE"}'
2026-02-25 20:06:26.517 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 20:06:26.518 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 20:06:26.518 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 20:06:26.519 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 20:06:26.520 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.122.85
2026-02-25 20:06:26.520 DEBUG [src.node.docker_mananger] Generated ports ['12326', '12327', '12328', '12329', '12330']
2026-02-25 20:06:26.520 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 20:06:26.520 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 20:06:26.520 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 20:06:26.520 DEBUG [src.node.docker_mananger] docker run -i -t -p 12326:12326 -p 12327:12327 -p 12328:12328 -p 12329:12329 -p 12330:12330 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=12328 --rest-port=12326 --tcp-port=12327 --discv5-udp-port=12329 --rest-address=0.0.0.0 --nat=extip:172.18.122.85 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=2c72aeffafd66314ab391cca3698d8aedd2336f47686cfba1acd3edffbdcf57f --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=12330 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QNcdICAkSsWbKXbm3-LMxJNd_MMEtPsVa6yONwwNGbaaO8Crp4yMCid-OjbDqgjy87TVL2GfIbWduUDq7zAQil4CgmlkgnY0gmlwhKwSx1GKbXVsdGlhZGRyc5YACASsEsdRBs8_AAoErBLHUQbPQN0DgnJzhQADAQAAiXNlY3AyNTZrMaECbOyqOd_AElhINw5IIeBbL6gs2ZAJPy7UUEJgLvqcHT-DdGNwgs8_g3VkcILPQYV3YWt1MgE
2026-02-25 20:06:26.716 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.122.85 waku 94b8525bb8aaf8110a6f4c9c67f800b2ecc4aa9667ee094f21865f331ac4d60d
2026-02-25 20:06:26.748 DEBUG [src.node.docker_mananger] Container started with ID 94b8525bb8aa. Setting up logs at ./log/docker/node4_2026-02-25_20-06-22__2c99bb5e-5c52-4c3c-abb7-45ed6cbf8f33__wakuorg_nwaku:latest.log
2026-02-25 20:06:26.748 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 12326
2026-02-25 20:06:26.748 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 20:06:27.749 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12326/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:06:27.766 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 20:06:27.768 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 20:06:27.770 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12326/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:06:27.774 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.122.85/tcp/12327/p2p/16Uiu2HAmV9U23iAg6TfVxPV2K5vhfBunVhhq8k4vyRkDT4Eez6b9","/ip4/172.18.122.85/tcp/12328/ws/p2p/16Uiu2HAmV9U23iAg6TfVxPV2K5vhfBunVhhq8k4vyRkDT4Eez6b9"],"enrUri":"enr:-L24QAgAXl1N68bG9k7mjtCVQ8NNpPjELufeWL8NNPsvKWpTE8zd8FD5o2QFBpDIxwM-uC3_k2VHmpGmQGeO2v5u6P0CgmlkgnY0gmlwhKwSelWKbXVsdGlhZGRyc5YACASsEnpVBjAnAAoErBJ6VQYwKN0DgnJzhQADAQAAiXNlY3AyNTZrMaED9QaJvZrGlvoZVf59iyagTAn3jEP2rluLLgiS6SoSFoiDdGNwgjAng3VkcIIwKYV3YWt1MgE"}'
2026-02-25 20:06:27.775 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 20:06:27.775 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30007/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-25 20:06:27.780 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:06:27.780 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:36049/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-25 20:06:27.789 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:06:27.790 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53054/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-25 20:06:27.797 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:06:27.798 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12326/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-25 20:06:27.805 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:06:27.806 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30007/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:06:27.811 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.104.164/tcp/39666/p2p/16Uiu2HAmNRrAxPs7CkwZzQCNa3H4e5cJfB3ABJdjEJ5aatrzTsZE","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"UnknownOrigin"}]'
2026-02-25 20:06:27.812 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:36049/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:06:27.817 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.161.131/tcp/30008/p2p/16Uiu2HAmDka94ULVzre5m1trb4C3WSBbmxayRcP6TP7eRWE2JaFR","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"Discv5"},{"multiaddr":"/ip4/172.18.199.81/tcp/41666/p2p/16Uiu2HAm2ksKTVc6efrVPFv5M9ArQMGNQtQSa6wKfp57mt3UXxYW","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"UnknownOrigin"}]'
2026-02-25 20:06:27.817 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53054/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:06:27.820 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.122.85/tcp/57712/p2p/16Uiu2HAmV9U23iAg6TfVxPV2K5vhfBunVhhq8k4vyRkDT4Eez6b9","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.104.164/tcp/36050/p2p/16Uiu2HAmNRrAxPs7CkwZzQCNa3H4e5cJfB3ABJdjEJ5aatrzTsZE","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"Discv5"}]'
2026-02-25 20:06:27.820 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12326/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:06:27.822 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.199.81/tcp/53055/p2p/16Uiu2HAm2ksKTVc6efrVPFv5M9ArQMGNQtQSa6wKfp57mt3UXxYW","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"Discv5"}]'
2026-02-25 20:06:27.823 DEBUG [src.libs.common] Sleeping for 20 seconds
2026-02-25 20:06:47.825 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '7570', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-02-25 20:06:47.836 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '7570', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'loss', '50.0%']
2026-02-25 20:06:47.846 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '7570', '-n', 'tc', '-s', 'qdisc', 'show', 'dev', 'eth0']
2026-02-25 20:06:47.855 DEBUG [src.steps.network_conditions] tc -s qdisc show dev eth0:
qdisc netem 8002: root refcnt 5 limit 1000 loss 50%
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
2026-02-25 20:06:47.856 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12326/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:06:47.858 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[]'
2026-02-25 20:06:47.859 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30007/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 20:06:49.281 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:06:49.282 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30007/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 20:06:50.753 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:06:50.754 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30007/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 20:06:52.225 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:06:52.226 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30007/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 20:06:52.233 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:06:52.234 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30007/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 20:06:52.457 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:06:52.458 DEBUG [src.libs.common] Sleeping for 30.0 seconds
2026-02-25 20:07:22.458 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12326/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:07:22.461 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772050007859272740,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772050009282109211,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772050010753885890,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772050012225999363,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772050012234112199,"ephemeral":false,"proof":""}]'
2026-02-25 20:07:22.463 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '7570', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-02-25 20:07:22.474 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '7570', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-02-25 20:07:22.485 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '7570', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'loss', '50.0%', '75.0%']
2026-02-25 20:07:22.494 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12326/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:07:22.497 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[]'
2026-02-25 20:07:22.497 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30007/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 20:07:26.634 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:07:26.636 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30007/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 20:07:26.652 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:07:26.655 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30007/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 20:07:26.674 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:07:26.675 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30007/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 20:07:26.684 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:07:26.685 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30007/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 20:07:26.696 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:07:26.698 DEBUG [src.libs.common] Sleeping for 30.0 seconds
2026-02-25 20:07:56.698 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12326/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:07:56.701 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772050042497445394,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772050046636601273,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772050046654960479,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772050046674991699,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772050046685542820,"ephemeral":false,"proof":""}]'
2026-02-25 20:07:56.703 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '7570', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-02-25 20:07:56.713 DEBUG [tests.e2e.test_network_conditions] uncorrelated=5 correlated=5
2026-02-25 20:07:56.715 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-02-25 20:07:56.715 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-02-25 20:07:56.716 DEBUG [src.node.waku_node] Stopping container with id b046092d69ce
2026-02-25 20:07:57.308 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 20:07:57.310 DEBUG [src.node.waku_node] Stopping container with id d894c574830f
2026-02-25 20:07:57.867 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 20:07:57.870 DEBUG [src.node.waku_node] Stopping container with id cb9230db91c8
2026-02-25 20:07:58.374 ERROR [src.node.docker_mananger] Max retries reached for container b046092d69ce. Exiting log stream.
2026-02-25 20:07:58.424 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 20:07:58.426 DEBUG [src.node.waku_node] Stopping container with id 94b8525bb8aa
2026-02-25 20:07:58.682 ERROR [src.node.docker_mananger] Max retries reached for container d894c574830f. Exiting log stream.
2026-02-25 20:07:58.946 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 20:07:58.949 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-02-25 20:07:59.083 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 20:07:59.157 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 20:07:59.304 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 20:07:59.375 DEBUG [src.node.docker_mananger] No errors found in the waku logs.