2026-03-16 12:56:34 +00:00

132 lines
27 KiB
Plaintext

2026-03-16 12:34:51.694 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-16 12:34:51.695 DEBUG [tests.conftest] Running test: test_relay_4_nodes_sender_latency with id: 2026-03-16_12-34-51__eb950f01-f3fa-4079-b7ce-f488a37abd05
2026-03-16 12:34:51.695 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-16 12:34:51.695 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-16 12:34:51.702 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0
2026-03-16 12:34:51.702 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-16_12-34-51__eb950f01-f3fa-4079-b7ce-f488a37abd05__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:34:51.708 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0
2026-03-16 12:34:51.708 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-16_12-34-51__eb950f01-f3fa-4079-b7ce-f488a37abd05__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:34:51.714 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0
2026-03-16 12:34:51.715 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-16_12-34-51__eb950f01-f3fa-4079-b7ce-f488a37abd05__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:34:51.720 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0
2026-03-16 12:34:51.720 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-16_12-34-51__eb950f01-f3fa-4079-b7ce-f488a37abd05__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:34:51.720 INFO [tests.e2e.test_network_conditions] Starting 4 nodes with relay enabled (bootstrap chain)
2026-03-16 12:34:51.721 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 12:34:51.721 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 12:34:51.722 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 12:34:51.722 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.109.53
2026-03-16 12:34:51.722 DEBUG [src.node.docker_mananger] Generated ports ['36841', '36842', '36843', '36844', '36845']
2026-03-16 12:34:51.722 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 12:34:51.722 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 12:34:51.723 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 12:34:51.723 DEBUG [src.node.docker_mananger] docker run -i -t -p 36841:36841 -p 36842:36842 -p 36843:36843 -p 36844:36844 -p 36845:36845 harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=36843 --rest-port=36841 --tcp-port=36842 --discv5-udp-port=36844 --rest-address=0.0.0.0 --nat=extip:172.18.109.53 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=6885d1ba1823cb3fbfefcf25d016ec8f2c30ffad7b787bacd0936df0cb0cb76e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=36845 --metrics-logging=true --relay=true
2026-03-16 12:34:51.923 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.109.53 waku f4c70f703850cde32e8e58c75bb8149c47f83812794e284d4101b27ed81fdef9
2026-03-16 12:34:51.960 DEBUG [src.node.docker_mananger] Container started with ID f4c70f703850. Setting up logs at ./log/docker/node1_2026-03-16_12-34-51__eb950f01-f3fa-4079-b7ce-f488a37abd05__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:34:51.960 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0. REST: 36841
2026-03-16 12:34:51.961 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 12:34:52.961 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:36841/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:34:52.964 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 12:34:52.964 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 12:34:52.964 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:36841/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:34:52.967 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.109.53/tcp/36842/p2p/16Uiu2HAmNRcK8QuK6DzXFqwDGWDEBRD94GQcK749DGHBzBy6veDv","/ip4/172.18.109.53/tcp/36843/ws/p2p/16Uiu2HAmNRcK8QuK6DzXFqwDGWDEBRD94GQcK749DGHBzBy6veDv"],"enrUri":"enr:-L24QF6xavPoXCHvNgehv2_LIBCk9YsRZUJpOFD-qRtJAcW_AQ6pbHbClJEOHpViw7pmwWW2ZSxAzU315pGhtMGTBg0CgmlkgnY0gmlwhKwSbTWKbXVsdGlhZGRyc5YACASsEm01Bo_qAAoErBJtNQaP690DgnJzhQADAQAAiXNlY3AyNTZrMaEDkSdmsKCzgDiogy8LFVmQa67KRqhCmWND3SVmt-6NirmDdGNwgo_qg3VkcIKP7IV3YWt1MgE"}'
2026-03-16 12:34:52.967 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 12:34:52.967 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 12:34:52.967 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 12:34:52.969 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 12:34:52.969 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.111.59
2026-03-16 12:34:52.969 DEBUG [src.node.docker_mananger] Generated ports ['47433', '47434', '47435', '47436', '47437']
2026-03-16 12:34:52.969 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 12:34:52.969 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 12:34:52.970 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 12:34:52.970 DEBUG [src.node.docker_mananger] docker run -i -t -p 47433:47433 -p 47434:47434 -p 47435:47435 -p 47436:47436 -p 47437:47437 harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=47435 --rest-port=47433 --tcp-port=47434 --discv5-udp-port=47436 --rest-address=0.0.0.0 --nat=extip:172.18.111.59 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=c3e7e9ae3be4a246af06bb16ab27dfb8ce1000dc83faeed9aab3ccfbdce51f6c --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=47437 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QF6xavPoXCHvNgehv2_LIBCk9YsRZUJpOFD-qRtJAcW_AQ6pbHbClJEOHpViw7pmwWW2ZSxAzU315pGhtMGTBg0CgmlkgnY0gmlwhKwSbTWKbXVsdGlhZGRyc5YACASsEm01Bo_qAAoErBJtNQaP690DgnJzhQADAQAAiXNlY3AyNTZrMaEDkSdmsKCzgDiogy8LFVmQa67KRqhCmWND3SVmt-6NirmDdGNwgo_qg3VkcIKP7IV3YWt1MgE
2026-03-16 12:34:53.159 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.111.59 waku 8f9d15d3546b6d7209cacb0e69218a87b17c41be25eb01bf88d60c1d9e706677
2026-03-16 12:34:53.193 DEBUG [src.node.docker_mananger] Container started with ID 8f9d15d3546b. Setting up logs at ./log/docker/node2_2026-03-16_12-34-51__eb950f01-f3fa-4079-b7ce-f488a37abd05__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:34:53.194 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0. REST: 47433
2026-03-16 12:34:53.194 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 12:34:54.195 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:47433/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:34:54.212 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 12:34:54.212 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 12:34:54.213 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:47433/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:34:54.219 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.111.59/tcp/47434/p2p/16Uiu2HAmDrWfRWTfRAUv4Wdru9ECUSWruX8wXzn7of6Hzs3RYZQC","/ip4/172.18.111.59/tcp/47435/ws/p2p/16Uiu2HAmDrWfRWTfRAUv4Wdru9ECUSWruX8wXzn7of6Hzs3RYZQC"],"enrUri":"enr:-L24QBdc3SSg3QTjlarefPqr6Ks90eMJh4FByYvnIM11SCfANzwVMjw9it-eI0mIS9LFQzOtzXnvtXjaimKhCyTL8YwCgmlkgnY0gmlwhKwSbzuKbXVsdGlhZGRyc5YACASsEm87BrlKAAoErBJvOwa5S90DgnJzhQADAQAAiXNlY3AyNTZrMaEDEc9Ztr7T9ia1e_xg-g0-SNWYzl8dxfLlHZoMyhlIwlmDdGNwgrlKg3VkcIK5TIV3YWt1MgE"}'
2026-03-16 12:34:54.221 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 12:34:54.221 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 12:34:54.221 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 12:34:54.223 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 12:34:54.223 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.173.124
2026-03-16 12:34:54.223 DEBUG [src.node.docker_mananger] Generated ports ['2794', '2795', '2796', '2797', '2798']
2026-03-16 12:34:54.223 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 12:34:54.224 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 12:34:54.224 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 12:34:54.224 DEBUG [src.node.docker_mananger] docker run -i -t -p 2794:2794 -p 2795:2795 -p 2796:2796 -p 2797:2797 -p 2798:2798 harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=2796 --rest-port=2794 --tcp-port=2795 --discv5-udp-port=2797 --rest-address=0.0.0.0 --nat=extip:172.18.173.124 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=5caadbd4deaed95ab4006a08fc8660b2d35419469de8ca5ecd427888be6ac1bc --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=2798 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QBdc3SSg3QTjlarefPqr6Ks90eMJh4FByYvnIM11SCfANzwVMjw9it-eI0mIS9LFQzOtzXnvtXjaimKhCyTL8YwCgmlkgnY0gmlwhKwSbzuKbXVsdGlhZGRyc5YACASsEm87BrlKAAoErBJvOwa5S90DgnJzhQADAQAAiXNlY3AyNTZrMaEDEc9Ztr7T9ia1e_xg-g0-SNWYzl8dxfLlHZoMyhlIwlmDdGNwgrlKg3VkcIK5TIV3YWt1MgE
2026-03-16 12:34:54.416 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.173.124 waku d643ae98a4fe98193f91250b45a823d1125e743b3dd8fad56b8a88d0c3caba01
2026-03-16 12:34:54.451 DEBUG [src.node.docker_mananger] Container started with ID d643ae98a4fe. Setting up logs at ./log/docker/node3_2026-03-16_12-34-51__eb950f01-f3fa-4079-b7ce-f488a37abd05__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:34:54.451 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0. REST: 2794
2026-03-16 12:34:54.451 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 12:34:55.453 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2794/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:34:55.468 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 12:34:55.471 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 12:34:55.472 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2794/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:34:55.476 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.173.124/tcp/2795/p2p/16Uiu2HAmTEWdR3voUWog33fKzGHWLmqx2E3RXAR4iCVz8rcr7XDC","/ip4/172.18.173.124/tcp/2796/ws/p2p/16Uiu2HAmTEWdR3voUWog33fKzGHWLmqx2E3RXAR4iCVz8rcr7XDC"],"enrUri":"enr:-L24QAj4JIlChaSE0lSyrLhyJFWICxCQn1CWvTHzSFM15bBWYoypkvdngmCwMz9ESk_2cMJQ0grQ0VrPq08RdAbaWKkCgmlkgnY0gmlwhKwSrXyKbXVsdGlhZGRyc5YACASsEq18BgrrAAoErBKtfAYK7N0DgnJzhQADAQAAiXNlY3AyNTZrMaED2JoE5pVFNW2rhmuGNvqD3x84TCW3DS-QJ_n8cf5W75uDdGNwggrrg3VkcIIK7YV3YWt1MgE"}'
2026-03-16 12:34:55.477 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 12:34:55.478 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 12:34:55.479 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 12:34:55.480 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 12:34:55.480 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.30.167
2026-03-16 12:34:55.480 DEBUG [src.node.docker_mananger] Generated ports ['50127', '50128', '50129', '50130', '50131']
2026-03-16 12:34:55.481 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 12:34:55.481 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 12:34:55.481 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 12:34:55.481 DEBUG [src.node.docker_mananger] docker run -i -t -p 50127:50127 -p 50128:50128 -p 50129:50129 -p 50130:50130 -p 50131:50131 harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=50129 --rest-port=50127 --tcp-port=50128 --discv5-udp-port=50130 --rest-address=0.0.0.0 --nat=extip:172.18.30.167 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=6a880fce3dbb1bbd061c3c5dc47cb5df8dae24cceabcd28dfe1ede37cb561e0f --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=50131 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QAj4JIlChaSE0lSyrLhyJFWICxCQn1CWvTHzSFM15bBWYoypkvdngmCwMz9ESk_2cMJQ0grQ0VrPq08RdAbaWKkCgmlkgnY0gmlwhKwSrXyKbXVsdGlhZGRyc5YACASsEq18BgrrAAoErBKtfAYK7N0DgnJzhQADAQAAiXNlY3AyNTZrMaED2JoE5pVFNW2rhmuGNvqD3x84TCW3DS-QJ_n8cf5W75uDdGNwggrrg3VkcIIK7YV3YWt1MgE
2026-03-16 12:34:55.672 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.30.167 waku f5f71e5d38647b98124744eeb3989912cbf2b4cdcd319b44cee5a79bd1071772
2026-03-16 12:34:55.705 DEBUG [src.node.docker_mananger] Container started with ID f5f71e5d3864. Setting up logs at ./log/docker/node4_2026-03-16_12-34-51__eb950f01-f3fa-4079-b7ce-f488a37abd05__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:34:55.706 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0. REST: 50127
2026-03-16 12:34:55.706 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 12:34:56.707 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50127/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:34:56.726 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 12:34:56.727 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 12:34:56.727 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50127/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:34:56.735 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.30.167/tcp/50128/p2p/16Uiu2HAmMV2fwppHUWAJVV4FHYqwu2YVqR1NzuLKSZ1rCaKNAxSC","/ip4/172.18.30.167/tcp/50129/ws/p2p/16Uiu2HAmMV2fwppHUWAJVV4FHYqwu2YVqR1NzuLKSZ1rCaKNAxSC"],"enrUri":"enr:-L24QJNjuM-j_W6oRGKuUmW-pShsb5j_1KWOXPeOjj1UyFzwL7yz_uLq5-XIXbThOdASc1TXRhwLagrhx0MMMqjDkCICgmlkgnY0gmlwhKwSHqeKbXVsdGlhZGRyc5YACASsEh6nBsPQAAoErBIepwbD0d0DgnJzhQADAQAAiXNlY3AyNTZrMaEDgyv_1aluv27kTScua66JExDSIkJ3EZQMqb6vnpZylimDdGNwgsPQg3VkcILD0oV3YWt1MgE"}'
2026-03-16 12:34:56.735 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 12:34:56.735 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:36841/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-16 12:34:56.742 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:34:56.742 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:47433/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-16 12:34:56.748 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:34:56.749 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:2794/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-16 12:34:56.759 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:34:56.762 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:50127/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-16 12:34:56.768 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:34:56.769 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:36841/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:34:56.773 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.111.59/tcp/37942/p2p/16Uiu2HAmDrWfRWTfRAUv4Wdru9ECUSWruX8wXzn7of6Hzs3RYZQC","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0","origin":"UnknownOrigin"}]'
2026-03-16 12:34:56.774 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:47433/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:34:56.777 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.173.124/tcp/36286/p2p/16Uiu2HAmTEWdR3voUWog33fKzGHWLmqx2E3RXAR4iCVz8rcr7XDC","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.109.53/tcp/36842/p2p/16Uiu2HAmNRcK8QuK6DzXFqwDGWDEBRD94GQcK749DGHBzBy6veDv","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0","origin":"Discv5"}]'
2026-03-16 12:34:56.777 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2794/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:34:56.779 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.111.59/tcp/47434/p2p/16Uiu2HAmDrWfRWTfRAUv4Wdru9ECUSWruX8wXzn7of6Hzs3RYZQC","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0","origin":"Discv5"},{"multiaddr":"/ip4/172.18.30.167/tcp/47934/p2p/16Uiu2HAmMV2fwppHUWAJVV4FHYqwu2YVqR1NzuLKSZ1rCaKNAxSC","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0","origin":"UnknownOrigin"}]'
2026-03-16 12:34:56.779 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50127/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:34:56.782 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.173.124/tcp/2795/p2p/16Uiu2HAmTEWdR3voUWog33fKzGHWLmqx2E3RXAR4iCVz8rcr7XDC","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0","origin":"Discv5"}]'
2026-03-16 12:34:56.782 DEBUG [src.libs.common] Sleeping for 40 seconds
2026-03-16 12:35:36.782 INFO [tests.e2e.test_network_conditions] Applying 3000ms latency on sender node1
2026-03-16 12:35:36.784 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '9600', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-16 12:35:36.864 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '9600', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'delay', '3000ms']
2026-03-16 12:35:36.878 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:36841/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:35:42.885 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:35:42.885 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50127/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:35:42.887 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1773664536878726835,"ephemeral":false,"proof":""}]'
2026-03-16 12:35:42.889 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '9600', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-16 12:35:42.900 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-16 12:35:42.901 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-16 12:35:42.901 DEBUG [src.node.waku_node] Stopping container with id f4c70f703850
2026-03-16 12:35:43.471 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 12:35:43.471 DEBUG [src.node.waku_node] Stopping container with id 8f9d15d3546b
2026-03-16 12:35:44.058 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 12:35:44.060 DEBUG [src.node.waku_node] Stopping container with id d643ae98a4fe
2026-03-16 12:35:44.288 ERROR [src.node.docker_mananger] Max retries reached for container f4c70f703850. Exiting log stream.
2026-03-16 12:35:44.617 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 12:35:44.618 DEBUG [src.node.waku_node] Stopping container with id f5f71e5d3864
2026-03-16 12:35:44.872 ERROR [src.node.docker_mananger] Max retries reached for container 8f9d15d3546b. Exiting log stream.
2026-03-16 12:35:45.197 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 12:35:45.200 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-16 12:35:45.236 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 12:35:45.279 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 12:35:45.315 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 12:35:45.351 DEBUG [src.node.docker_mananger] No errors found in the waku logs.