logos-messaging/logos-messaging-interop-tests
1
0
Fork 0
mirror of https://github.com/logos-messaging/logos-messaging-interop-tests.git synced 2026-05-02 16:43:56 +00:00
Code Issues Packages Projects Releases Wiki Activity
logos-messaging-interop-tests/nim/1107/data/attachments/e8167e39d662c7e7.txt

226 lines
46 KiB
Plaintext
Raw Blame History

2026-03-07 04:29:39.523 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-07 04:29:39.524 DEBUG [tests.conftest] Running test: test_relay_7_nodes_3sec_latency with id: 2026-03-07_04-29-39__9452653e-f3a2-44af-b46f-21437ca76e64
2026-03-07 04:29:39.525 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-07 04:29:39.527 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-07 04:29:39.535 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-07 04:29:39.535 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-07_04-29-39__9452653e-f3a2-44af-b46f-21437ca76e64__wakuorg_nwaku:latest.log
2026-03-07 04:29:39.543 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-07 04:29:39.544 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-07_04-29-39__9452653e-f3a2-44af-b46f-21437ca76e64__wakuorg_nwaku:latest.log
2026-03-07 04:29:39.554 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-07 04:29:39.554 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-07_04-29-39__9452653e-f3a2-44af-b46f-21437ca76e64__wakuorg_nwaku:latest.log
2026-03-07 04:29:39.563 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-07 04:29:39.563 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-07_04-29-39__9452653e-f3a2-44af-b46f-21437ca76e64__wakuorg_nwaku:latest.log
2026-03-07 04:29:39.571 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-07 04:29:39.572 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-07_04-29-39__9452653e-f3a2-44af-b46f-21437ca76e64__wakuorg_nwaku:latest.log
2026-03-07 04:29:39.580 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-07 04:29:39.581 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-07_04-29-39__9452653e-f3a2-44af-b46f-21437ca76e64__wakuorg_nwaku:latest.log
2026-03-07 04:29:39.590 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-07 04:29:39.590 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-03-07_04-29-39__9452653e-f3a2-44af-b46f-21437ca76e64__wakuorg_nwaku:latest.log
2026-03-07 04:29:39.597 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-07 04:29:39.597 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node6_2026-03-07_04-29-39__9452653e-f3a2-44af-b46f-21437ca76e64__wakuorg_nwaku:latest.log
2026-03-07 04:29:39.606 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-07 04:29:39.606 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node7_2026-03-07_04-29-39__9452653e-f3a2-44af-b46f-21437ca76e64__wakuorg_nwaku:latest.log
2026-03-07 04:29:39.607 INFO [tests.e2e.test_network_conditions] Starting nodes with chain bootstrap
2026-03-07 04:29:39.607 DEBUG [src.node.waku_node] Starting Node...
2026-03-07 04:29:39.607 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-07 04:29:39.610 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-07 04:29:39.611 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.250.234
2026-03-07 04:29:39.611 DEBUG [src.node.docker_mananger] Generated ports ['25102', '25103', '25104', '25105', '25106']
2026-03-07 04:29:39.611 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-07 04:29:39.612 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-07 04:29:39.612 DEBUG [src.node.waku_node] Using volumes []
2026-03-07 04:29:39.612 DEBUG [src.node.docker_mananger] docker run -i -t -p 25102:25102 -p 25103:25103 -p 25104:25104 -p 25105:25105 -p 25106:25106 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=25104 --rest-port=25102 --tcp-port=25103 --discv5-udp-port=25105 --rest-address=0.0.0.0 --nat=extip:172.18.250.234 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=a2fbc048eeff0a872f24e66af2ab77d5e3fe07bad581940ab03eca9e2e49d63c --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=25106 --metrics-logging=true --relay=true
2026-03-07 04:29:39.755 ERROR [src.node.docker_mananger] Max retries reached for container aa98dd58a890. Exiting log stream.
2026-03-07 04:29:39.809 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.250.234 waku c5823e6248ba5228abbf13c14e148fd92a5f086cd71852e815466d752a09c3b3
2026-03-07 04:29:39.845 DEBUG [src.node.docker_mananger] Container started with ID c5823e6248ba. Setting up logs at ./log/docker/node1_2026-03-07_04-29-39__9452653e-f3a2-44af-b46f-21437ca76e64__wakuorg_nwaku:latest.log
2026-03-07 04:29:39.846 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 25102
2026-03-07 04:29:39.846 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-07 04:29:40.449 ERROR [src.node.docker_mananger] Max retries reached for container 4fb537ae31b1. Exiting log stream.
2026-03-07 04:29:40.847 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25102/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:40.850 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-07 04:29:40.851 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-07 04:29:40.851 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25102/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:40.853 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.250.234/tcp/25103/p2p/16Uiu2HAmJQMUvLBB29h833rpRGm3KVqwyGUnWzep5p1foyFTvbrZ","/ip4/172.18.250.234/tcp/25104/ws/p2p/16Uiu2HAmJQMUvLBB29h833rpRGm3KVqwyGUnWzep5p1foyFTvbrZ"],"enrUri":"enr:-L24QNdRK_jGuiOgbxcH0AkYNXvAfhps2zwTflfqjhH6yhn5WIhmbdEFj4ErTw3n0ImqgnKRAahUMGPL_dp60qOY0xMCgmlkgnY0gmlwhKwS-uqKbXVsdGlhZGRyc5YACASsEvrqBmIPAAoErBL66gZiEN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDVWZNjkWrRRthV52TJpNetYX21OghthtZzEapgNbMiaqDdGNwgmIPg3VkcIJiEYV3YWt1MgE"}'
2026-03-07 04:29:40.853 INFO [src.node.waku_node] REST service is ready !!
2026-03-07 04:29:40.853 DEBUG [src.node.waku_node] Starting Node...
2026-03-07 04:29:40.854 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-07 04:29:40.855 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-07 04:29:40.855 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.154.108
2026-03-07 04:29:40.855 DEBUG [src.node.docker_mananger] Generated ports ['9506', '9507', '9508', '9509', '9510']
2026-03-07 04:29:40.855 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-07 04:29:40.856 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-07 04:29:40.856 DEBUG [src.node.waku_node] Using volumes []
2026-03-07 04:29:40.856 DEBUG [src.node.docker_mananger] docker run -i -t -p 9506:9506 -p 9507:9507 -p 9508:9508 -p 9509:9509 -p 9510:9510 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=9508 --rest-port=9506 --tcp-port=9507 --discv5-udp-port=9509 --rest-address=0.0.0.0 --nat=extip:172.18.154.108 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ae070db57bd80b46c5fa0ba2ac9ae04dce24a32fba6c80507c6ceac1d5c5f270 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=9510 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QNdRK_jGuiOgbxcH0AkYNXvAfhps2zwTflfqjhH6yhn5WIhmbdEFj4ErTw3n0ImqgnKRAahUMGPL_dp60qOY0xMCgmlkgnY0gmlwhKwS-uqKbXVsdGlhZGRyc5YACASsEvrqBmIPAAoErBL66gZiEN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDVWZNjkWrRRthV52TJpNetYX21OghthtZzEapgNbMiaqDdGNwgmIPg3VkcIJiEYV3YWt1MgE
2026-03-07 04:29:41.044 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.154.108 waku 3cd435be1264c387525486eef733508c69085c8d3cb82ab962081951c6a44fa7
2026-03-07 04:29:41.082 DEBUG [src.node.docker_mananger] Container started with ID 3cd435be1264. Setting up logs at ./log/docker/node2_2026-03-07_04-29-39__9452653e-f3a2-44af-b46f-21437ca76e64__wakuorg_nwaku:latest.log
2026-03-07 04:29:41.083 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 9506
2026-03-07 04:29:41.083 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-07 04:29:42.083 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9506/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:42.102 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-07 04:29:42.105 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-07 04:29:42.106 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9506/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:42.112 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.154.108/tcp/9507/p2p/16Uiu2HAmMrD4cxoqNxaPdF8GnbkLJyKJJVpg5scQqHdtmDnx9WH2","/ip4/172.18.154.108/tcp/9508/ws/p2p/16Uiu2HAmMrD4cxoqNxaPdF8GnbkLJyKJJVpg5scQqHdtmDnx9WH2"],"enrUri":"enr:-L24QP9tLy6fv77zEVWgcRPmcgu-GM65FdLUB9azY_oxECCRC4mD12ebub_uUmcnGyCqk1VTUDE08DL209xR4rds_3gCgmlkgnY0gmlwhKwSmmyKbXVsdGlhZGRyc5YACASsEppsBiUjAAoErBKabAYlJN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDiJjyBz_avgEekZGohSri7Twu4UYGK2L6EUhBPB8N0YWDdGNwgiUjg3VkcIIlJYV3YWt1MgE"}'
2026-03-07 04:29:42.115 INFO [src.node.waku_node] REST service is ready !!
2026-03-07 04:29:42.115 DEBUG [src.node.waku_node] Starting Node...
2026-03-07 04:29:42.115 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-07 04:29:42.117 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-07 04:29:42.117 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.132.25
2026-03-07 04:29:42.117 DEBUG [src.node.docker_mananger] Generated ports ['37846', '37847', '37848', '37849', '37850']
2026-03-07 04:29:42.117 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-07 04:29:42.118 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-07 04:29:42.118 DEBUG [src.node.waku_node] Using volumes []
2026-03-07 04:29:42.118 DEBUG [src.node.docker_mananger] docker run -i -t -p 37846:37846 -p 37847:37847 -p 37848:37848 -p 37849:37849 -p 37850:37850 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=37848 --rest-port=37846 --tcp-port=37847 --discv5-udp-port=37849 --rest-address=0.0.0.0 --nat=extip:172.18.132.25 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=cba3bac825e2ab94f1dfa1eded4ff6f3604c4d64fdbaa4fadabd7ccc88cef037 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=37850 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QP9tLy6fv77zEVWgcRPmcgu-GM65FdLUB9azY_oxECCRC4mD12ebub_uUmcnGyCqk1VTUDE08DL209xR4rds_3gCgmlkgnY0gmlwhKwSmmyKbXVsdGlhZGRyc5YACASsEppsBiUjAAoErBKabAYlJN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDiJjyBz_avgEekZGohSri7Twu4UYGK2L6EUhBPB8N0YWDdGNwgiUjg3VkcIIlJYV3YWt1MgE
2026-03-07 04:29:42.312 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.132.25 waku e03b9cd5356d166a334afdbf5e3cd519291c58bf0fa3bc69e614e65eee9b058f
2026-03-07 04:29:42.346 DEBUG [src.node.docker_mananger] Container started with ID e03b9cd5356d. Setting up logs at ./log/docker/node3_2026-03-07_04-29-39__9452653e-f3a2-44af-b46f-21437ca76e64__wakuorg_nwaku:latest.log
2026-03-07 04:29:42.346 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 37846
2026-03-07 04:29:42.346 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-07 04:29:43.347 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37846/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:43.367 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-07 04:29:43.369 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-07 04:29:43.369 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37846/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:43.374 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.132.25/tcp/37847/p2p/16Uiu2HAkyHD4vZ67VMYt6KEQXDHw3GueEo4rDC7zD2eXq583iA1A","/ip4/172.18.132.25/tcp/37848/ws/p2p/16Uiu2HAkyHD4vZ67VMYt6KEQXDHw3GueEo4rDC7zD2eXq583iA1A"],"enrUri":"enr:-L24QOVZycoZcdRWDsZ7DsuwzO6XMiGHfFZP697y1aUyOMzFSyvx0nz08GGUr6LUc-iUXIjCSvAX-76J1MG-4z_ZlvQCgmlkgnY0gmlwhKwShBmKbXVsdGlhZGRyc5YACASsEoQZBpPXAAoErBKEGQaT2N0DgnJzhQADAQAAiXNlY3AyNTZrMaECOUOsGQGuOjyP0Y_KatVZ0G-MWs_6kg6FAn0EKHn2_TWDdGNwgpPXg3VkcIKT2YV3YWt1MgE"}'
2026-03-07 04:29:43.374 INFO [src.node.waku_node] REST service is ready !!
2026-03-07 04:29:43.375 DEBUG [src.node.waku_node] Starting Node...
2026-03-07 04:29:43.375 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-07 04:29:43.378 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-07 04:29:43.378 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.77.52
2026-03-07 04:29:43.378 DEBUG [src.node.docker_mananger] Generated ports ['56877', '56878', '56879', '56880', '56881']
2026-03-07 04:29:43.378 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-07 04:29:43.378 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-07 04:29:43.379 DEBUG [src.node.waku_node] Using volumes []
2026-03-07 04:29:43.379 DEBUG [src.node.docker_mananger] docker run -i -t -p 56877:56877 -p 56878:56878 -p 56879:56879 -p 56880:56880 -p 56881:56881 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=56879 --rest-port=56877 --tcp-port=56878 --discv5-udp-port=56880 --rest-address=0.0.0.0 --nat=extip:172.18.77.52 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=bf651cf3d9fec1b7e7f4da6df8cd7400cba7f32e95f0b2b208e6bbfbe82a3c9b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=56881 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QOVZycoZcdRWDsZ7DsuwzO6XMiGHfFZP697y1aUyOMzFSyvx0nz08GGUr6LUc-iUXIjCSvAX-76J1MG-4z_ZlvQCgmlkgnY0gmlwhKwShBmKbXVsdGlhZGRyc5YACASsEoQZBpPXAAoErBKEGQaT2N0DgnJzhQADAQAAiXNlY3AyNTZrMaECOUOsGQGuOjyP0Y_KatVZ0G-MWs_6kg6FAn0EKHn2_TWDdGNwgpPXg3VkcIKT2YV3YWt1MgE
2026-03-07 04:29:43.573 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.77.52 waku e3e21113eded1eb661dd2a8a028e52305e44c1b3b5e2491f5d89b6d4690c7ccd
2026-03-07 04:29:43.604 DEBUG [src.node.docker_mananger] Container started with ID e3e21113eded. Setting up logs at ./log/docker/node4_2026-03-07_04-29-39__9452653e-f3a2-44af-b46f-21437ca76e64__wakuorg_nwaku:latest.log
2026-03-07 04:29:43.605 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 56877
2026-03-07 04:29:43.605 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-07 04:29:44.606 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56877/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:44.628 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-07 04:29:44.629 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-07 04:29:44.630 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56877/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:44.635 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.77.52/tcp/56878/p2p/16Uiu2HAm13PonFwPRYb7RpCwz9M2oyUauE5A11Rny6xhP9ZmpLCN","/ip4/172.18.77.52/tcp/56879/ws/p2p/16Uiu2HAm13PonFwPRYb7RpCwz9M2oyUauE5A11Rny6xhP9ZmpLCN"],"enrUri":"enr:-L24QHrhD6gMgZFlV_rN2ikcPhQtfCTiKTPhSFyP0cY33AVWdzzsTStP4b841CGm-H4hXZc78NjWOeCo14-U5vkptQMCgmlkgnY0gmlwhKwSTTSKbXVsdGlhZGRyc5YACASsEk00Bt4uAAoErBJNNAbeL90DgnJzhQADAQAAiXNlY3AyNTZrMaECU3EOq-Fx7tz9NJkw-bCYfZhQ8D2EaUEMLg5ADJwhV1eDdGNwgt4ug3VkcILeMIV3YWt1MgE"}'
2026-03-07 04:29:44.635 INFO [src.node.waku_node] REST service is ready !!
2026-03-07 04:29:44.636 DEBUG [src.node.waku_node] Starting Node...
2026-03-07 04:29:44.636 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-07 04:29:44.637 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-07 04:29:44.637 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.243.98
2026-03-07 04:29:44.638 DEBUG [src.node.docker_mananger] Generated ports ['61751', '61752', '61753', '61754', '61755']
2026-03-07 04:29:44.638 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-07 04:29:44.638 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-07 04:29:44.638 DEBUG [src.node.waku_node] Using volumes []
2026-03-07 04:29:44.638 DEBUG [src.node.docker_mananger] docker run -i -t -p 61751:61751 -p 61752:61752 -p 61753:61753 -p 61754:61754 -p 61755:61755 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=61753 --rest-port=61751 --tcp-port=61752 --discv5-udp-port=61754 --rest-address=0.0.0.0 --nat=extip:172.18.243.98 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=8dd4ec6caa5fddc7fa3d7960feeffa08227bf67d755f30a7d61bb59f2dc519e4 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=61755 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QHrhD6gMgZFlV_rN2ikcPhQtfCTiKTPhSFyP0cY33AVWdzzsTStP4b841CGm-H4hXZc78NjWOeCo14-U5vkptQMCgmlkgnY0gmlwhKwSTTSKbXVsdGlhZGRyc5YACASsEk00Bt4uAAoErBJNNAbeL90DgnJzhQADAQAAiXNlY3AyNTZrMaECU3EOq-Fx7tz9NJkw-bCYfZhQ8D2EaUEMLg5ADJwhV1eDdGNwgt4ug3VkcILeMIV3YWt1MgE
2026-03-07 04:29:44.833 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.243.98 waku 34d7c793b1716e91a3b52609ba92ffd561198dc8c2a855c93cca37330570601c
2026-03-07 04:29:44.872 DEBUG [src.node.docker_mananger] Container started with ID 34d7c793b171. Setting up logs at ./log/docker/node5_2026-03-07_04-29-39__9452653e-f3a2-44af-b46f-21437ca76e64__wakuorg_nwaku:latest.log
2026-03-07 04:29:44.872 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 61751
2026-03-07 04:29:44.872 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-07 04:29:45.873 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61751/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:45.892 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-07 04:29:45.894 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-07 04:29:45.895 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61751/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:45.901 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.243.98/tcp/61752/p2p/16Uiu2HAkwhTpAJYbyEecqbemFFKBtBiutMwRGCpzS371zgPXMLsw","/ip4/172.18.243.98/tcp/61753/ws/p2p/16Uiu2HAkwhTpAJYbyEecqbemFFKBtBiutMwRGCpzS371zgPXMLsw"],"enrUri":"enr:-L24QAkQfE6E_jQAkoTW2YL390N43jaadZlIrBQYt0yfXn1pJL9BaUe5Kim1frxTy7FEjg4ArX4dCDxN5ZxYanGnQQkCgmlkgnY0gmlwhKwS82KKbXVsdGlhZGRyc5YACASsEvNiBvE4AAoErBLzYgbxOd0DgnJzhQADAQAAiXNlY3AyNTZrMaECIcLpG1zjVazRHkcUn_ExrxQsH9Evu1PYL4hcM-tTejaDdGNwgvE4g3VkcILxOoV3YWt1MgE"}'
2026-03-07 04:29:45.905 INFO [src.node.waku_node] REST service is ready !!
2026-03-07 04:29:45.905 DEBUG [src.node.waku_node] Starting Node...
2026-03-07 04:29:45.905 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-07 04:29:45.907 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-07 04:29:45.907 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.186.11
2026-03-07 04:29:45.908 DEBUG [src.node.docker_mananger] Generated ports ['1697', '1698', '1699', '1700', '1701']
2026-03-07 04:29:45.908 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-07 04:29:45.908 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-07 04:29:45.908 DEBUG [src.node.waku_node] Using volumes []
2026-03-07 04:29:45.908 DEBUG [src.node.docker_mananger] docker run -i -t -p 1697:1697 -p 1698:1698 -p 1699:1699 -p 1700:1700 -p 1701:1701 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=1699 --rest-port=1697 --tcp-port=1698 --discv5-udp-port=1700 --rest-address=0.0.0.0 --nat=extip:172.18.186.11 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=cde9f5100ecc6a69e8efefcaccca2f01ccbc915a0d6dfdbbbba54cc2a28bbab8 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=1701 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QAkQfE6E_jQAkoTW2YL390N43jaadZlIrBQYt0yfXn1pJL9BaUe5Kim1frxTy7FEjg4ArX4dCDxN5ZxYanGnQQkCgmlkgnY0gmlwhKwS82KKbXVsdGlhZGRyc5YACASsEvNiBvE4AAoErBLzYgbxOd0DgnJzhQADAQAAiXNlY3AyNTZrMaECIcLpG1zjVazRHkcUn_ExrxQsH9Evu1PYL4hcM-tTejaDdGNwgvE4g3VkcILxOoV3YWt1MgE
2026-03-07 04:29:46.107 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.186.11 waku 90b4592a4cb21032da24648d6b09db7a97475011d897ae5adcfdbaf52f5aa80f
2026-03-07 04:29:46.140 DEBUG [src.node.docker_mananger] Container started with ID 90b4592a4cb2. Setting up logs at ./log/docker/node6_2026-03-07_04-29-39__9452653e-f3a2-44af-b46f-21437ca76e64__wakuorg_nwaku:latest.log
2026-03-07 04:29:46.140 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 1697
2026-03-07 04:29:46.140 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-07 04:29:47.141 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1697/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:47.161 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-07 04:29:47.161 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-07 04:29:47.162 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1697/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:47.168 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.186.11/tcp/1698/p2p/16Uiu2HAmViLrHHoaP8y54tWTeYwUsQf3AvGNAFydZRus1UgTMHh4","/ip4/172.18.186.11/tcp/1699/ws/p2p/16Uiu2HAmViLrHHoaP8y54tWTeYwUsQf3AvGNAFydZRus1UgTMHh4"],"enrUri":"enr:-L24QA97dqPydJqQ9lgDtBJb6GTuk9TqpnTtPrmpDSO8elyNBH5_MMAU5UIuxwVK3mu05bQMBaY6jDizRSevU45Eh-0CgmlkgnY0gmlwhKwSuguKbXVsdGlhZGRyc5YACASsEroLBgaiAAoErBK6CwYGo90DgnJzhQADAQAAiXNlY3AyNTZrMaED_XKZdNj_Xei7iXWFE4KgUOM4MOrOUmQtrSNnEiLoCDODdGNwggaig3VkcIIGpIV3YWt1MgE"}'
2026-03-07 04:29:47.169 INFO [src.node.waku_node] REST service is ready !!
2026-03-07 04:29:47.169 DEBUG [src.node.waku_node] Starting Node...
2026-03-07 04:29:47.169 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-07 04:29:47.171 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-07 04:29:47.171 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.8.158
2026-03-07 04:29:47.171 DEBUG [src.node.docker_mananger] Generated ports ['63502', '63503', '63504', '63505', '63506']
2026-03-07 04:29:47.171 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-07 04:29:47.171 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-07 04:29:47.172 DEBUG [src.node.waku_node] Using volumes []
2026-03-07 04:29:47.172 DEBUG [src.node.docker_mananger] docker run -i -t -p 63502:63502 -p 63503:63503 -p 63504:63504 -p 63505:63505 -p 63506:63506 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=63504 --rest-port=63502 --tcp-port=63503 --discv5-udp-port=63505 --rest-address=0.0.0.0 --nat=extip:172.18.8.158 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=13b9e0db99ba7ace8a2c0f2faf1aa5de7cffbbf577a4d6b2c4bb8bb1abc02aae --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=63506 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QA97dqPydJqQ9lgDtBJb6GTuk9TqpnTtPrmpDSO8elyNBH5_MMAU5UIuxwVK3mu05bQMBaY6jDizRSevU45Eh-0CgmlkgnY0gmlwhKwSuguKbXVsdGlhZGRyc5YACASsEroLBgaiAAoErBK6CwYGo90DgnJzhQADAQAAiXNlY3AyNTZrMaED_XKZdNj_Xei7iXWFE4KgUOM4MOrOUmQtrSNnEiLoCDODdGNwggaig3VkcIIGpIV3YWt1MgE
2026-03-07 04:29:47.375 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.8.158 waku 4b848d8378f6cb78b197f5b1b95e4507a9bb83973af675125e7f0814c993ce82
2026-03-07 04:29:47.412 DEBUG [src.node.docker_mananger] Container started with ID 4b848d8378f6. Setting up logs at ./log/docker/node7_2026-03-07_04-29-39__9452653e-f3a2-44af-b46f-21437ca76e64__wakuorg_nwaku:latest.log
2026-03-07 04:29:47.413 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 63502
2026-03-07 04:29:47.413 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-07 04:29:48.415 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63502/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:48.438 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-07 04:29:48.438 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-07 04:29:48.439 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63502/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:48.443 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.8.158/tcp/63503/p2p/16Uiu2HAmJ1hJFhikxDdhHWQr4ptKSjSy1E6eC8cczjL4LAtqNtXp","/ip4/172.18.8.158/tcp/63504/ws/p2p/16Uiu2HAmJ1hJFhikxDdhHWQr4ptKSjSy1E6eC8cczjL4LAtqNtXp"],"enrUri":"enr:-L24QJf6nQVag64xVy5fB2mFuhRYcumlyTC-rJ7-wmgFLyDJZ-tJNibl2KVeIzV72hq-8o1Dt5DT8KqqiZ0d35padeECgmlkgnY0gmlwhKwSCJ6KbXVsdGlhZGRyc5YACASsEgieBvgPAAoErBIIngb4EN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDT5hZuT5efrTRafMaPn67wVhw5EiICWa5-swtqeI5XQ-DdGNwgvgPg3VkcIL4EYV3YWt1MgE"}'
2026-03-07 04:29:48.444 INFO [src.node.waku_node] REST service is ready !!
2026-03-07 04:29:48.445 INFO [tests.e2e.test_network_conditions] Subscribing all nodes to relay topic
2026-03-07 04:29:48.445 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:25102/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-07 04:29:48.452 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:29:48.453 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:9506/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-07 04:29:48.460 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:29:48.460 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37846/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-07 04:29:48.468 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:29:48.469 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:56877/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-07 04:29:48.477 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:29:48.477 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61751/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-07 04:29:48.487 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:29:48.487 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1697/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-07 04:29:48.499 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:29:48.499 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63502/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-07 04:29:48.507 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:29:48.507 INFO [tests.e2e.test_network_conditions] Waiting for autoconnection
2026-03-07 04:29:48.508 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25102/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:48.511 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.154.108/tcp/47052/p2p/16Uiu2HAmMrD4cxoqNxaPdF8GnbkLJyKJJVpg5scQqHdtmDnx9WH2","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"UnknownOrigin"}]'
2026-03-07 04:29:48.512 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9506/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:48.514 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.132.25/tcp/32772/p2p/16Uiu2HAkyHD4vZ67VMYt6KEQXDHw3GueEo4rDC7zD2eXq583iA1A","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.250.234/tcp/25103/p2p/16Uiu2HAmJQMUvLBB29h833rpRGm3KVqwyGUnWzep5p1foyFTvbrZ","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"Discv5"}]'
2026-03-07 04:29:48.514 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37846/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:48.517 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.154.108/tcp/9507/p2p/16Uiu2HAmMrD4cxoqNxaPdF8GnbkLJyKJJVpg5scQqHdtmDnx9WH2","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"Discv5"},{"multiaddr":"/ip4/172.18.77.52/tcp/51096/p2p/16Uiu2HAm13PonFwPRYb7RpCwz9M2oyUauE5A11Rny6xhP9ZmpLCN","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"UnknownOrigin"}]'
2026-03-07 04:29:48.517 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56877/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:48.519 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.132.25/tcp/37847/p2p/16Uiu2HAkyHD4vZ67VMYt6KEQXDHw3GueEo4rDC7zD2eXq583iA1A","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"Discv5"},{"multiaddr":"/ip4/172.18.243.98/tcp/60208/p2p/16Uiu2HAkwhTpAJYbyEecqbemFFKBtBiutMwRGCpzS371zgPXMLsw","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"UnknownOrigin"}]'
2026-03-07 04:29:48.520 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61751/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:48.522 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.186.11/tcp/60474/p2p/16Uiu2HAmViLrHHoaP8y54tWTeYwUsQf3AvGNAFydZRus1UgTMHh4","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.77.52/tcp/56878/p2p/16Uiu2HAm13PonFwPRYb7RpCwz9M2oyUauE5A11Rny6xhP9ZmpLCN","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"Discv5"}]'
2026-03-07 04:29:48.522 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1697/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:48.524 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.8.158/tcp/33394/p2p/16Uiu2HAmJ1hJFhikxDdhHWQr4ptKSjSy1E6eC8cczjL4LAtqNtXp","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.243.98/tcp/61752/p2p/16Uiu2HAkwhTpAJYbyEecqbemFFKBtBiutMwRGCpzS371zgPXMLsw","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"Discv5"}]'
2026-03-07 04:29:48.525 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63502/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:48.527 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.186.11/tcp/1698/p2p/16Uiu2HAmViLrHHoaP8y54tWTeYwUsQf3AvGNAFydZRus1UgTMHh4","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"Discv5"}]'
2026-03-07 04:29:48.527 DEBUG [src.libs.common] Sleeping for 60 seconds
2026-03-07 04:30:48.527 INFO [tests.e2e.test_network_conditions] Applying 3s latency to node3
2026-03-07 04:30:48.529 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '4694', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-07 04:30:48.605 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '4694', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'delay', '3000ms']
2026-03-07 04:30:48.620 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37846/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:30:54.623 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[]'
2026-03-07 04:30:54.624 INFO [tests.e2e.test_network_conditions] Observed GET latency on node3: 6.00s
2026-03-07 04:30:54.625 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-07 04:30:54.626 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-07 04:30:54.626 DEBUG [src.node.waku_node] Stopping container with id c5823e6248ba
2026-03-07 04:30:55.247 DEBUG [src.node.waku_node] Container stopped.
2026-03-07 04:30:55.248 DEBUG [src.node.waku_node] Stopping container with id 3cd435be1264
2026-03-07 04:30:55.860 DEBUG [src.node.waku_node] Container stopped.
2026-03-07 04:30:55.860 DEBUG [src.node.waku_node] Stopping container with id e03b9cd5356d
2026-03-07 04:30:56.374 ERROR [src.node.docker_mananger] Max retries reached for container c5823e6248ba. Exiting log stream.
2026-03-07 04:30:56.483 DEBUG [src.node.waku_node] Container stopped.
2026-03-07 04:30:56.484 DEBUG [src.node.waku_node] Stopping container with id e3e21113eded
2026-03-07 04:30:56.678 ERROR [src.node.docker_mananger] Max retries reached for container 3cd435be1264. Exiting log stream.
2026-03-07 04:30:57.070 DEBUG [src.node.waku_node] Container stopped.
2026-03-07 04:30:57.073 DEBUG [src.node.waku_node] Stopping container with id 34d7c793b171
2026-03-07 04:30:57.309 ERROR [src.node.docker_mananger] Max retries reached for container e03b9cd5356d. Exiting log stream.
2026-03-07 04:30:57.675 DEBUG [src.node.waku_node] Container stopped.
2026-03-07 04:30:57.676 DEBUG [src.node.waku_node] Stopping container with id 90b4592a4cb2
2026-03-07 04:30:58.188 ERROR [src.node.docker_mananger] Max retries reached for container e3e21113eded. Exiting log stream.
2026-03-07 04:30:58.489 ERROR [src.node.docker_mananger] Max retries reached for container 34d7c793b171. Exiting log stream.
2026-03-07 04:31:08.236 DEBUG [src.node.waku_node] Container stopped.
2026-03-07 04:31:08.239 DEBUG [src.node.waku_node] Stopping container with id 4b848d8378f6
2026-03-07 04:31:08.779 DEBUG [src.node.waku_node] Container stopped.
2026-03-07 04:31:08.783 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-07 04:31:08.954 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-07 04:31:09.035 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-07 04:31:09.116 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-07 04:31:09.276 ERROR [src.node.docker_mananger] Max retries reached for container 90b4592a4cb2. Exiting log stream.
2026-03-07 04:31:09.289 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-07 04:31:09.366 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-07 04:31:09.446 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-07 04:31:09.530 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
Reference in New Issue View Git Blame Copy Permalink