158 lines
33 KiB
Plaintext
Raw Blame History

This file contains invisible Unicode characters

This file contains invisible Unicode characters that are indistinguishable to humans but may be processed differently by a computer. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

DEBUG  tests.conftest:conftest.py:51 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:57 Running test: test_relay_4_nodes_two_publishers_compare_latency with id: 2026-04-23_21-57-06__cdfa6a93-e032-4e63-bfad-7bbe69b85972
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.steps.relay:relay.py:28 Running fixture setup: relay_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node1_2026-04-23_21-57-06__cdfa6a93-e032-4e63-bfad-7bbe69b85972__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node2_2026-04-23_21-57-06__cdfa6a93-e032-4e63-bfad-7bbe69b85972__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node3_2026-04-23_21-57-06__cdfa6a93-e032-4e63-bfad-7bbe69b85972__wakuorg_nwaku:latest.log
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node4_2026-04-23_21-57-06__cdfa6a93-e032-4e63-bfad-7bbe69b85972__wakuorg_nwaku:latest.log
INFO  tests.e2e.test_network_conditions:test_network_conditions.py:136 Starting 4 nodes
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.153.159
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['40776', '40777', '40778', '40779', '40780']
DEBUG  src.node.waku_node:waku_node.py:455 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:180 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:186 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 40776:40776 -p 40777:40777 -p 40778:40778 -p 40779:40779 -p 40780:40780 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=40778 --rest-port=40776 --tcp-port=40777 --discv5-udp-port=40779 --rest-address=0.0.0.0 --nat=extip:172.18.153.159 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=13d7c25b89ebeae6bdcd83aec47eff0cb7e52fc09bfbe048d2fb381e01f255e4 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=40780 --metrics-logging=true --relay=true
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.153.159 waku e3c7fcde18078c49b630f313e04dcd5629854ffb40f06abd4a69e51f06856427
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID e3c7fcde1807. Setting up logs at ./log/docker/node1_2026-04-23_21-57-06__cdfa6a93-e032-4e63-bfad-7bbe69b85972__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:197 Started container from image wakuorg/nwaku:latest. REST: 40776
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 826b6724403f. Exiting log stream.
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 80a46040de0a. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:40776/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:294 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:40776/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.153.159/tcp/40777/p2p/16Uiu2HAm1c7KrpdQp6XswN3dtccLvApgKqicXo2ApPk4ZmDPyTgk","/ip4/172.18.153.159/tcp/40778/ws/p2p/16Uiu2HAm1c7KrpdQp6XswN3dtccLvApgKqicXo2ApPk4ZmDPyTgk"],"enrUri":"enr:-L24QCvXDuBLnpVwf7_Ew9B1Tfs1DGr6ia6CAPCkWwTm3N8UN2w38CAUYeatSp2aJ2HjRz8Kw-bRhLRLM8nKCgHiXvgCgmlkgnY0gmlwhKwSmZ-KbXVsdGlhZGRyc5YACASsEpmfBp9JAAoErBKZnwafSt0DgnJzhQDGAQAAiXNlY3AyNTZrMaECW9KWo0hj18Ayb-NBx40vlEyas05nNY_neAx8Wske3kmDdGNwgp9Jg3VkcIKfS4V3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:299 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.76.234
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['9146', '9147', '9148', '9149', '9150']
DEBUG  src.node.waku_node:waku_node.py:455 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:180 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:186 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 9146:9146 -p 9147:9147 -p 9148:9148 -p 9149:9149 -p 9150:9150 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=9148 --rest-port=9146 --tcp-port=9147 --discv5-udp-port=9149 --rest-address=0.0.0.0 --nat=extip:172.18.76.234 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=4ca11f0bc1971a5e86fe7deba23f99293ed1cd8fadb25c3ce02bc77409672cbd --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=9150 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QCvXDuBLnpVwf7_Ew9B1Tfs1DGr6ia6CAPCkWwTm3N8UN2w38CAUYeatSp2aJ2HjRz8Kw-bRhLRLM8nKCgHiXvgCgmlkgnY0gmlwhKwSmZ-KbXVsdGlhZGRyc5YACASsEpmfBp9JAAoErBKZnwafSt0DgnJzhQDGAQAAiXNlY3AyNTZrMaECW9KWo0hj18Ayb-NBx40vlEyas05nNY_neAx8Wske3kmDdGNwgp9Jg3VkcIKfS4V3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.76.234 waku 37d130fc3e67af40d35cfcfe27d54e22d7c2689ca083ef71f90400abc82e8a1e
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 37d130fc3e67. Setting up logs at ./log/docker/node2_2026-04-23_21-57-06__cdfa6a93-e032-4e63-bfad-7bbe69b85972__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:197 Started container from image wakuorg/nwaku:latest. REST: 9146
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:9146/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:294 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:9146/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.76.234/tcp/9147/p2p/16Uiu2HAkvJsCsC51YveheYQDonjdRkR7xiYb9QKzaYdBvPBUKsSS","/ip4/172.18.76.234/tcp/9148/ws/p2p/16Uiu2HAkvJsCsC51YveheYQDonjdRkR7xiYb9QKzaYdBvPBUKsSS"],"enrUri":"enr:-L24QMX4IVMTuJDgKrTkZu_oFbvdFIWD4_czUeyy44MFSpH_Qe9EuJgjsS1Or_RU7AfsmW0pKrxMQdTdZSxiF9OKyyMCgmlkgnY0gmlwhKwSTOqKbXVsdGlhZGRyc5YACASsEkzqBiO7AAoErBJM6gYjvN0DgnJzhQDGAQAAiXNlY3AyNTZrMaECDR1QWKOKXYINAN5qNxOzo9qqMfJBFTh0SNY48BhZIouDdGNwgiO7g3VkcIIjvYV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:299 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.73.178
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['42832', '42833', '42834', '42835', '42836']
DEBUG  src.node.waku_node:waku_node.py:455 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:180 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:186 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 42832:42832 -p 42833:42833 -p 42834:42834 -p 42835:42835 -p 42836:42836 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=42834 --rest-port=42832 --tcp-port=42833 --discv5-udp-port=42835 --rest-address=0.0.0.0 --nat=extip:172.18.73.178 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=5cfae1f99021a5dafdc17ba3ba05804ddc9384bde3eabbe1cacc170c904fe2cd --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=42836 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QMX4IVMTuJDgKrTkZu_oFbvdFIWD4_czUeyy44MFSpH_Qe9EuJgjsS1Or_RU7AfsmW0pKrxMQdTdZSxiF9OKyyMCgmlkgnY0gmlwhKwSTOqKbXVsdGlhZGRyc5YACASsEkzqBiO7AAoErBJM6gYjvN0DgnJzhQDGAQAAiXNlY3AyNTZrMaECDR1QWKOKXYINAN5qNxOzo9qqMfJBFTh0SNY48BhZIouDdGNwgiO7g3VkcIIjvYV3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.73.178 waku fc5acce9eb7c3bbae1646a3bdc19c4476a3c20f24d6bbaeeda7b41609a808f5c
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID fc5acce9eb7c. Setting up logs at ./log/docker/node3_2026-04-23_21-57-06__cdfa6a93-e032-4e63-bfad-7bbe69b85972__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:197 Started container from image wakuorg/nwaku:latest. REST: 42832
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:42832/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:294 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:42832/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.73.178/tcp/42833/p2p/16Uiu2HAmSUG7genUGhbT1bN1YG3FUqyoPmjjzUpm2XQAVUhhKFDW","/ip4/172.18.73.178/tcp/42834/ws/p2p/16Uiu2HAmSUG7genUGhbT1bN1YG3FUqyoPmjjzUpm2XQAVUhhKFDW"],"enrUri":"enr:-L24QDAKUyrhoCHFM6EleN8GtTq32TXTibNnDMNmPwbxlLhwVWDhRDT9zXZV6UXlyyEwbaJEZSFg79M6q5JCrL2wTn8CgmlkgnY0gmlwhKwSSbKKbXVsdGlhZGRyc5YACASsEkmyBqdRAAoErBJJsganUt0DgnJzhQDGAQAAiXNlY3AyNTZrMaEDzUQN2OP_MjKS1AS3L840GfAM9_-Uq-5W6KDekNTtyt2DdGNwgqdRg3VkcIKnU4V3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:299 REST service is ready !!
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.122.7
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['53988', '53989', '53990', '53991', '53992']
DEBUG  src.node.waku_node:waku_node.py:455 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:180 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:186 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 53988:53988 -p 53989:53989 -p 53990:53990 -p 53991:53991 -p 53992:53992 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=53990 --rest-port=53988 --tcp-port=53989 --discv5-udp-port=53991 --rest-address=0.0.0.0 --nat=extip:172.18.122.7 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=cc094d4a0deffe31e0af91dac809c85e16fa7d87166cd1f7ccbe47cb7b45dc26 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=53992 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QDAKUyrhoCHFM6EleN8GtTq32TXTibNnDMNmPwbxlLhwVWDhRDT9zXZV6UXlyyEwbaJEZSFg79M6q5JCrL2wTn8CgmlkgnY0gmlwhKwSSbKKbXVsdGlhZGRyc5YACASsEkmyBqdRAAoErBJJsganUt0DgnJzhQDGAQAAiXNlY3AyNTZrMaEDzUQN2OP_MjKS1AS3L840GfAM9_-Uq-5W6KDekNTtyt2DdGNwgqdRg3VkcIKnU4V3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.122.7 waku d3d19efab03b98778c3bc63bce2825323282719690b2a05508895e186bc88081
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID d3d19efab03b. Setting up logs at ./log/docker/node4_2026-04-23_21-57-06__cdfa6a93-e032-4e63-bfad-7bbe69b85972__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:197 Started container from image wakuorg/nwaku:latest. REST: 53988
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:53988/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:294 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:53988/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.122.7/tcp/53989/p2p/16Uiu2HAkuV4WQCqMduATC6NzEkbZeGBvzFL2M7jaKcRF5n6kSm6R","/ip4/172.18.122.7/tcp/53990/ws/p2p/16Uiu2HAkuV4WQCqMduATC6NzEkbZeGBvzFL2M7jaKcRF5n6kSm6R"],"enrUri":"enr:-L24QIGcq0zTQRE39jr2NjLjgHN6pA-JuP2U8mWOL800d0e_DtvNJFXkJ2rHt0ut8H46n9H3r6cz310DAh3wpvTOVRECgmlkgnY0gmlwhKwSegeKbXVsdGlhZGRyc5YACASsEnoHBtLlAAoErBJ6BwbS5t0DgnJzhQDGAQAAiXNlY3AyNTZrMaECAN427561LeZU-kgSyvELscNfW3JLe4mUxC0nbWTZfGKDdGNwgtLlg3VkcILS54V3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:299 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:40776/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:9146/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:42832/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:53988/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:40776/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.76.234/tcp/34328/p2p/16Uiu2HAkvJsCsC51YveheYQDonjdRkR7xiYb9QKzaYdBvPBUKsSS","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-\\"v0.38.0-19-g820ccc\\"","origin":"UnknownOrigin"}]'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:9146/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.73.178/tcp/51284/p2p/16Uiu2HAmSUG7genUGhbT1bN1YG3FUqyoPmjjzUpm2XQAVUhhKFDW","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-\\"v0.38.0-19-g820ccc\\"","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.153.159/tcp/40777/p2p/16Uiu2HAm1c7KrpdQp6XswN3dtccLvApgKqicXo2ApPk4ZmDPyTgk","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-\\"v0.38.0-19-g820ccc\\"","origin":"Discv5"}]'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:42832/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.76.234/tcp/9147/p2p/16Uiu2HAkvJsCsC51YveheYQDonjdRkR7xiYb9QKzaYdBvPBUKsSS","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-\\"v0.38.0-19-g820ccc\\"","origin":"Discv5"},{"multiaddr":"/ip4/172.18.122.7/tcp/53150/p2p/16Uiu2HAkuV4WQCqMduATC6NzEkbZeGBvzFL2M7jaKcRF5n6kSm6R","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-\\"v0.38.0-19-g820ccc\\"","origin":"UnknownOrigin"}]'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:53988/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.73.178/tcp/42833/p2p/16Uiu2HAmSUG7genUGhbT1bN1YG3FUqyoPmjjzUpm2XQAVUhhKFDW","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-\\"v0.38.0-19-g820ccc\\"","origin":"Discv5"}]'
DEBUG  src.libs.common:common.py:47 Sleeping for 60 seconds
DEBUG  tests.e2e.test_network_conditions:test_network_conditions.py:150 Applying 3000ms latency on node1 only
INFO  src.steps.network_conditions:network_conditions.py:23 TC exec: ['sudo', '-n', 'nsenter', '-t', '23043', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
INFO  src.steps.network_conditions:network_conditions.py:23 TC exec: ['sudo', '-n', 'nsenter', '-t', '23043', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'delay', '3000ms']
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:53988/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[]'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:40776/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:9146/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.2 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:40776/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:9146/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.2 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:40776/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:9146/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.2 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:40776/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:9146/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.2 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:40776/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:9146/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.2 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:53988/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1776981491334422153,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1776981497344183265,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1776981497556832738,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1776981503566296953,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1776981503784626339,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1776981509793810109,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1776981510002291243,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1776981516011390957,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1776981516224785273,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1776981522234627022,"ephemeral":false,"proof":""}]'
INFO  src.steps.network_conditions:network_conditions.py:23 TC exec: ['sudo', '-n', 'nsenter', '-t', '23043', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
DEBUG  tests.conftest:conftest.py:59 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:83 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:241 Stopping container with id e3c7fcde1807
DEBUG  src.node.waku_node:waku_node.py:248 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:241 Stopping container with id 37d130fc3e67
DEBUG  src.node.waku_node:waku_node.py:248 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:241 Stopping container with id fc5acce9eb7c
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container e3c7fcde1807. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:248 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:241 Stopping container with id d3d19efab03b
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 37d130fc3e67. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:248 Container stopped.
DEBUG  tests.conftest:conftest.py:98 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.