2026-02-25 07:41:35 +00:00

239 lines
47 KiB
Plaintext

2026-02-25 07:24:25.913 DEBUG [tests.conftest] Running fixture setup: test_id
2026-02-25 07:24:25.914 DEBUG [tests.conftest] Running test: test_latency_with_load_sender_side with id: 2026-02-25_07-24-25__69cd538c-fe3d-47d8-91ab-76fde12d202a
2026-02-25 07:24:25.914 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-02-25 07:24:25.915 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-02-25 07:24:25.924 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 07:24:25.925 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-02-25_07-24-25__69cd538c-fe3d-47d8-91ab-76fde12d202a__wakuorg_nwaku:latest.log
2026-02-25 07:24:25.934 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 07:24:25.935 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-02-25_07-24-25__69cd538c-fe3d-47d8-91ab-76fde12d202a__wakuorg_nwaku:latest.log
2026-02-25 07:24:25.943 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 07:24:25.944 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-02-25_07-24-25__69cd538c-fe3d-47d8-91ab-76fde12d202a__wakuorg_nwaku:latest.log
2026-02-25 07:24:25.952 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 07:24:25.953 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-02-25_07-24-25__69cd538c-fe3d-47d8-91ab-76fde12d202a__wakuorg_nwaku:latest.log
2026-02-25 07:24:25.955 INFO [tests.e2e.test_network_conditions] Starting 4 nodes with relay enabled
2026-02-25 07:24:25.955 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 07:24:25.955 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 07:24:25.957 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 07:24:25.958 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.254.8
2026-02-25 07:24:25.958 DEBUG [src.node.docker_mananger] Generated ports ['27466', '27467', '27468', '27469', '27470']
2026-02-25 07:24:25.959 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 07:24:25.959 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 07:24:25.960 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 07:24:25.960 DEBUG [src.node.docker_mananger] docker run -i -t -p 27466:27466 -p 27467:27467 -p 27468:27468 -p 27469:27469 -p 27470:27470 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=27468 --rest-port=27466 --tcp-port=27467 --discv5-udp-port=27469 --rest-address=0.0.0.0 --nat=extip:172.18.254.8 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=6d8fbecbdfceaeded8cd6f377651c845903aeacb65c6b24b94a011e4bbcfdc4c --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=27470 --metrics-logging=true --relay=true
2026-02-25 07:24:26.027 ERROR [src.node.docker_mananger] Max retries reached for container 1e3f57941cda. Exiting log stream.
2026-02-25 07:24:26.185 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.254.8 waku f19492a69146fbb9654a1a0cefb125991e757e9f60cfc0e231ef81ee97016df1
2026-02-25 07:24:26.218 DEBUG [src.node.docker_mananger] Container started with ID f19492a69146. Setting up logs at ./log/docker/node1_2026-02-25_07-24-25__69cd538c-fe3d-47d8-91ab-76fde12d202a__wakuorg_nwaku:latest.log
2026-02-25 07:24:26.219 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 27466
2026-02-25 07:24:26.220 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 07:24:26.994 ERROR [src.node.docker_mananger] Max retries reached for container 69aa94361df2. Exiting log stream.
2026-02-25 07:24:27.221 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:27466/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:24:27.223 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 07:24:27.224 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 07:24:27.224 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:27466/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:24:27.226 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.254.8/tcp/27467/p2p/16Uiu2HAmEviCKUp3uSkL8uJePTJsLCqQhyLX6h2WBRQCwggYtwQd","/ip4/172.18.254.8/tcp/27468/ws/p2p/16Uiu2HAmEviCKUp3uSkL8uJePTJsLCqQhyLX6h2WBRQCwggYtwQd"],"enrUri":"enr:-L24QO1sCcPLeuZ-dkSrEd0dMci5Ish2huWgroJL6hfUOBA7QD3PeeZY6CMeR7ryoL8SDQs_DYkImPs-gH3VoSD15pMCgmlkgnY0gmlwhKwS_giKbXVsdGlhZGRyc5YACASsEv4IBmtLAAoErBL-CAZrTN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDIb5mkc6yCcMLFKVpTbOqsfDwlx6ePCACEQ8qJxXoTPqDdGNwgmtLg3VkcIJrTYV3YWt1MgE"}'
2026-02-25 07:24:27.227 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 07:24:27.227 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 07:24:27.227 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 07:24:27.228 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 07:24:27.228 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.152.29
2026-02-25 07:24:27.229 DEBUG [src.node.docker_mananger] Generated ports ['49150', '49151', '49152', '49153', '49154']
2026-02-25 07:24:27.229 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 07:24:27.229 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 07:24:27.229 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 07:24:27.229 DEBUG [src.node.docker_mananger] docker run -i -t -p 49150:49150 -p 49151:49151 -p 49152:49152 -p 49153:49153 -p 49154:49154 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=49152 --rest-port=49150 --tcp-port=49151 --discv5-udp-port=49153 --rest-address=0.0.0.0 --nat=extip:172.18.152.29 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=4dc0fecbe73e13697fcfbc3df0bf0345f21d92c40a82fffc2e32d5c8dcff7aad --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=49154 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QO1sCcPLeuZ-dkSrEd0dMci5Ish2huWgroJL6hfUOBA7QD3PeeZY6CMeR7ryoL8SDQs_DYkImPs-gH3VoSD15pMCgmlkgnY0gmlwhKwS_giKbXVsdGlhZGRyc5YACASsEv4IBmtLAAoErBL-CAZrTN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDIb5mkc6yCcMLFKVpTbOqsfDwlx6ePCACEQ8qJxXoTPqDdGNwgmtLg3VkcIJrTYV3YWt1MgE
2026-02-25 07:24:27.425 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.152.29 waku bf3c0e8248fbed036a226960a12017a4ab4b604f966d53e2197424c915154124
2026-02-25 07:24:27.460 DEBUG [src.node.docker_mananger] Container started with ID bf3c0e8248fb. Setting up logs at ./log/docker/node2_2026-02-25_07-24-25__69cd538c-fe3d-47d8-91ab-76fde12d202a__wakuorg_nwaku:latest.log
2026-02-25 07:24:27.460 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 49150
2026-02-25 07:24:27.461 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 07:24:28.461 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:49150/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:24:28.480 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 07:24:28.481 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 07:24:28.481 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:49150/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:24:28.486 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.152.29/tcp/49151/p2p/16Uiu2HAm5m4k1htdjB27cZfEP72JSGeiumZVuPaSqYZEPqnNdQgW","/ip4/172.18.152.29/tcp/49152/ws/p2p/16Uiu2HAm5m4k1htdjB27cZfEP72JSGeiumZVuPaSqYZEPqnNdQgW"],"enrUri":"enr:-L24QDO93DjbtUbQKAFKCNJZNbfm027L3nv5cq09obKqNwf6UqlIyc6fOxjlvY0eE7KDyATF_streB_qTjuzcp74YIgCgmlkgnY0gmlwhKwSmB2KbXVsdGlhZGRyc5YACASsEpgdBr__AAoErBKYHQbAAN0DgnJzhQADAQAAiXNlY3AyNTZrMaECmYykZSoUEHPBAU29DNZn_9OJ9eRIRvu_DT84Mb3EUD-DdGNwgr__g3VkcILAAYV3YWt1MgE"}'
2026-02-25 07:24:28.487 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 07:24:28.488 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 07:24:28.488 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 07:24:28.492 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 07:24:28.493 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.240.97
2026-02-25 07:24:28.494 DEBUG [src.node.docker_mananger] Generated ports ['40855', '40856', '40857', '40858', '40859']
2026-02-25 07:24:28.494 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 07:24:28.494 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 07:24:28.494 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 07:24:28.494 DEBUG [src.node.docker_mananger] docker run -i -t -p 40855:40855 -p 40856:40856 -p 40857:40857 -p 40858:40858 -p 40859:40859 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=40857 --rest-port=40855 --tcp-port=40856 --discv5-udp-port=40858 --rest-address=0.0.0.0 --nat=extip:172.18.240.97 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=a9b3ff520c773cee719d0fff6b5a3e17e7b4d37ae1cf7d9b2eeb60c9fd5acb22 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=40859 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QO1sCcPLeuZ-dkSrEd0dMci5Ish2huWgroJL6hfUOBA7QD3PeeZY6CMeR7ryoL8SDQs_DYkImPs-gH3VoSD15pMCgmlkgnY0gmlwhKwS_giKbXVsdGlhZGRyc5YACASsEv4IBmtLAAoErBL-CAZrTN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDIb5mkc6yCcMLFKVpTbOqsfDwlx6ePCACEQ8qJxXoTPqDdGNwgmtLg3VkcIJrTYV3YWt1MgE
2026-02-25 07:24:28.691 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.240.97 waku f07481bfef45f34c5957d26b72d2e269aefc36c5e3f3c2cc78af43fb87aad91a
2026-02-25 07:24:28.722 DEBUG [src.node.docker_mananger] Container started with ID f07481bfef45. Setting up logs at ./log/docker/node3_2026-02-25_07-24-25__69cd538c-fe3d-47d8-91ab-76fde12d202a__wakuorg_nwaku:latest.log
2026-02-25 07:24:28.723 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 40855
2026-02-25 07:24:28.723 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 07:24:29.723 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40855/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:24:29.739 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 07:24:29.740 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 07:24:29.742 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40855/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:24:29.747 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.240.97/tcp/40856/p2p/16Uiu2HAmPsgX3ebLUkf68V9SzVJsvhJb7s9VqtAhjZEgpw7XWadp","/ip4/172.18.240.97/tcp/40857/ws/p2p/16Uiu2HAmPsgX3ebLUkf68V9SzVJsvhJb7s9VqtAhjZEgpw7XWadp"],"enrUri":"enr:-L24QMv7jrL3LpFFKrHZYV-wbXZkKEZYibQTC5I57IdAX89rJAFlYDnv59jORY6nh9yW5Dmn4HPpWd9vTtZtRVzI-7MCgmlkgnY0gmlwhKwS8GGKbXVsdGlhZGRyc5YACASsEvBhBp-YAAoErBLwYQafmd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDprDxuif2f4P6aB2UDAOrtqWeRNuUKfhUzPWhXe_0oiODdGNwgp-Yg3VkcIKfmoV3YWt1MgE"}'
2026-02-25 07:24:29.747 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 07:24:29.748 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 07:24:29.748 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 07:24:29.749 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 07:24:29.750 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.85.126
2026-02-25 07:24:29.750 DEBUG [src.node.docker_mananger] Generated ports ['31466', '31467', '31468', '31469', '31470']
2026-02-25 07:24:29.750 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 07:24:29.750 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 07:24:29.750 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 07:24:29.750 DEBUG [src.node.docker_mananger] docker run -i -t -p 31466:31466 -p 31467:31467 -p 31468:31468 -p 31469:31469 -p 31470:31470 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=31468 --rest-port=31466 --tcp-port=31467 --discv5-udp-port=31469 --rest-address=0.0.0.0 --nat=extip:172.18.85.126 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=a1c639badb2cca64fbcfffbaff4cfddcfbeeeb128fdaa06f2efdee302f3e40f7 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=31470 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QO1sCcPLeuZ-dkSrEd0dMci5Ish2huWgroJL6hfUOBA7QD3PeeZY6CMeR7ryoL8SDQs_DYkImPs-gH3VoSD15pMCgmlkgnY0gmlwhKwS_giKbXVsdGlhZGRyc5YACASsEv4IBmtLAAoErBL-CAZrTN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDIb5mkc6yCcMLFKVpTbOqsfDwlx6ePCACEQ8qJxXoTPqDdGNwgmtLg3VkcIJrTYV3YWt1MgE
2026-02-25 07:24:29.940 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.85.126 waku bf9695bab4d7585af891bf1f5d812653ab001a6a9915043d721afba362877373
2026-02-25 07:24:29.973 DEBUG [src.node.docker_mananger] Container started with ID bf9695bab4d7. Setting up logs at ./log/docker/node4_2026-02-25_07-24-25__69cd538c-fe3d-47d8-91ab-76fde12d202a__wakuorg_nwaku:latest.log
2026-02-25 07:24:29.974 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 31466
2026-02-25 07:24:29.974 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 07:24:30.974 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31466/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:24:30.991 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 07:24:30.991 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 07:24:30.991 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31466/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:24:30.996 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.85.126/tcp/31467/p2p/16Uiu2HAm9qPz5E6LTqLMhoCbokytDhi3hdfxyjK7eAcpNb8Feu1x","/ip4/172.18.85.126/tcp/31468/ws/p2p/16Uiu2HAm9qPz5E6LTqLMhoCbokytDhi3hdfxyjK7eAcpNb8Feu1x"],"enrUri":"enr:-L24QLt84JLm5s6BqsgZkn8PfrBSTrFrIgLNH78PVtvlALleSxPa6YNcNWyS71dNYceRfU2KbT5rL1ZtcvWMKk728KQCgmlkgnY0gmlwhKwSVX6KbXVsdGlhZGRyc5YACASsElV-BnrrAAoErBJVfgZ67N0DgnJzhQADAQAAiXNlY3AyNTZrMaEC1hd4eKGFDIlnFlrLyGh8ZLrxWxDxYF4QKcoGD7XKu4-DdGNwgnrrg3VkcIJ67YV3YWt1MgE"}'
2026-02-25 07:24:30.997 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 07:24:30.998 INFO [tests.e2e.test_network_conditions] Subscribing all nodes to relay topic
2026-02-25 07:24:30.998 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-25 07:24:31.005 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:24:31.005 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:49150/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-25 07:24:31.012 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:24:31.013 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:40855/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-25 07:24:31.020 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:24:31.021 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:31466/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-25 07:24:31.027 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:24:31.027 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:27466/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:24:31.031 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.240.97/tcp/49136/p2p/16Uiu2HAmPsgX3ebLUkf68V9SzVJsvhJb7s9VqtAhjZEgpw7XWadp","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.85.126/tcp/41762/p2p/16Uiu2HAm9qPz5E6LTqLMhoCbokytDhi3hdfxyjK7eAcpNb8Feu1x","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.152.29/tcp/38576/p2p/16Uiu2HAm5m4k1htdjB27cZfEP72JSGeiumZVuPaSqYZEPqnNdQgW","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"UnknownOrigin"}]'
2026-02-25 07:24:31.031 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:49150/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:24:31.034 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.254.8/tcp/27467/p2p/16Uiu2HAmEviCKUp3uSkL8uJePTJsLCqQhyLX6h2WBRQCwggYtwQd","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"Discv5"}]'
2026-02-25 07:24:31.034 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40855/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:24:31.036 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.254.8/tcp/27467/p2p/16Uiu2HAmEviCKUp3uSkL8uJePTJsLCqQhyLX6h2WBRQCwggYtwQd","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"Discv5"}]'
2026-02-25 07:24:31.037 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31466/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:24:31.039 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.254.8/tcp/27467/p2p/16Uiu2HAmEviCKUp3uSkL8uJePTJsLCqQhyLX6h2WBRQCwggYtwQd","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"Discv5"}]'
2026-02-25 07:24:31.039 DEBUG [src.libs.common] Sleeping for 30 seconds
2026-02-25 07:25:01.039 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:25:01.042 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[]'
2026-02-25 07:25:01.043 INFO [tests.e2e.test_network_conditions] Applying 3000ms latency on sender node1
2026-02-25 07:25:01.044 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '6771', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-02-25 07:25:01.055 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '6771', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-02-25 07:25:01.066 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '6771', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'delay', '3000ms']
2026-02-25 07:25:01.074 INFO [tests.e2e.test_network_conditions] Sending 50 messages from node1
2026-02-25 07:25:01.075 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:25:07.081 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:25:07.081 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:25:13.088 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:25:13.088 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:25:19.095 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:25:19.095 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:25:25.104 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:25:25.104 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:25:31.110 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:25:31.111 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:25:37.117 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:25:37.117 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:25:43.124 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:25:43.124 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:25:49.133 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:25:49.133 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:25:55.139 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:25:55.139 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:26:01.146 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:26:01.146 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:26:07.155 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:26:07.156 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:26:13.162 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:26:13.162 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:26:19.168 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:26:19.169 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:26:25.175 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:26:25.175 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:26:31.183 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:26:31.184 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:26:37.190 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:26:37.191 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:26:43.196 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:26:43.197 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:26:49.205 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:26:49.206 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:26:55.212 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:26:55.213 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:27:01.221 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:27:01.222 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:27:07.231 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:27:07.231 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:27:13.238 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:27:13.239 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:27:19.245 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:27:19.245 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:27:25.252 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:27:25.252 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:27:31.261 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:27:31.262 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:27:37.269 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:27:37.269 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:27:43.276 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:27:43.276 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:27:49.282 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:27:49.283 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:27:55.289 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:27:55.290 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:28:01.295 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:28:01.296 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:28:07.302 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:28:07.302 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:28:13.308 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:28:13.309 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:28:19.317 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:28:19.317 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:28:25.323 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:28:25.324 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:28:31.329 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:28:31.330 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:28:37.339 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:28:37.339 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:28:43.346 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:28:43.346 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:28:49.352 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:28:49.353 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:28:55.359 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:28:55.359 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:29:01.365 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:29:01.366 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:29:07.374 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:29:07.375 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:29:13.381 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:29:13.381 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:29:19.387 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:29:19.388 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:29:25.394 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:29:25.394 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:29:31.402 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:29:31.402 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:29:37.411 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:29:37.412 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:29:43.419 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:29:43.420 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:29:49.426 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:29:49.426 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:29:55.435 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:29:55.436 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:30:01.444 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:30:01.444 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31466/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:30:01.448 INFO [src.node.api_clients.base_client] Log line was discarded because it's longer than max_log_line_length=5000
2026-02-25 07:30:01.448 INFO [tests.e2e.test_network_conditions] Node4 received 50 messages (min_expected=25.0, total_sent=50)
2026-02-25 07:30:01.449 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '6771', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-02-25 07:30:01.461 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-02-25 07:30:01.462 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-02-25 07:30:01.462 DEBUG [src.node.waku_node] Stopping container with id f19492a69146
2026-02-25 07:30:02.027 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 07:30:02.027 DEBUG [src.node.waku_node] Stopping container with id bf3c0e8248fb
2026-02-25 07:30:02.584 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 07:30:02.587 DEBUG [src.node.waku_node] Stopping container with id f07481bfef45
2026-02-25 07:30:02.841 ERROR [src.node.docker_mananger] Max retries reached for container f19492a69146. Exiting log stream.
2026-02-25 07:30:03.142 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 07:30:03.142 DEBUG [src.node.waku_node] Stopping container with id bf9695bab4d7
2026-02-25 07:30:03.396 ERROR [src.node.docker_mananger] Max retries reached for container bf3c0e8248fb. Exiting log stream.
2026-02-25 07:30:03.692 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 07:30:03.694 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-02-25 07:30:03.932 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 07:30:04.196 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 07:30:04.444 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 07:30:04.447 ERROR [src.node.docker_mananger] Max retries reached for container f07481bfef45. Exiting log stream.
2026-02-25 07:30:04.697 DEBUG [src.node.docker_mananger] No errors found in the waku logs.