148 lines
27 KiB
Plaintext

2026-04-23 21:56:32.124 DEBUG [tests.conftest] Running fixture setup: test_id
2026-04-23 21:56:32.125 DEBUG [tests.conftest] Running test: test_relay_4_nodes_sender_packet_loss with id: 2026-04-23_21-56-32__05dcf4cb-10c0-492a-bfac-a22a0850f0ee
2026-04-23 21:56:32.126 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-04-23 21:56:32.126 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-04-23 21:56:32.138 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 21:56:32.138 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-04-23_21-56-32__05dcf4cb-10c0-492a-bfac-a22a0850f0ee__wakuorg_nwaku:latest.log
2026-04-23 21:56:32.149 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 21:56:32.150 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-04-23_21-56-32__05dcf4cb-10c0-492a-bfac-a22a0850f0ee__wakuorg_nwaku:latest.log
2026-04-23 21:56:32.160 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 21:56:32.161 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-04-23_21-56-32__05dcf4cb-10c0-492a-bfac-a22a0850f0ee__wakuorg_nwaku:latest.log
2026-04-23 21:56:32.166 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 21:56:32.167 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-04-23_21-56-32__05dcf4cb-10c0-492a-bfac-a22a0850f0ee__wakuorg_nwaku:latest.log
2026-04-23 21:56:32.167 INFO [tests.e2e.test_network_conditions] Starting 4 nodes with relay enabled (bootstrap chain)
2026-04-23 21:56:32.167 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 21:56:32.167 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 21:56:32.168 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 21:56:32.168 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.118.7
2026-04-23 21:56:32.169 DEBUG [src.node.docker_mananger] Generated ports ['63263', '63264', '63265', '63266', '63267']
2026-04-23 21:56:32.169 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 21:56:32.169 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 21:56:32.169 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 21:56:32.169 DEBUG [src.node.docker_mananger] docker run -i -t -p 63263:63263 -p 63264:63264 -p 63265:63265 -p 63266:63266 -p 63267:63267 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=63265 --rest-port=63263 --tcp-port=63264 --discv5-udp-port=63266 --rest-address=0.0.0.0 --nat=extip:172.18.118.7 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=ed284a1abb80c66b1d7bccacfbb3df1aded69c0abd88476cfeee512bb4ae5c87 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=63267 --metrics-logging=true --relay=true
2026-04-23 21:56:32.351 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.118.7 waku 948e614ff6a25e51f3e95b25a9fa086ebdc8c378ccd8c4497e974dd71992518e
2026-04-23 21:56:32.386 DEBUG [src.node.docker_mananger] Container started with ID 948e614ff6a2. Setting up logs at ./log/docker/node1_2026-04-23_21-56-32__05dcf4cb-10c0-492a-bfac-a22a0850f0ee__wakuorg_nwaku:latest.log
2026-04-23 21:56:32.387 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 63263
2026-04-23 21:56:32.387 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 21:56:32.487 ERROR [src.node.docker_mananger] Max retries reached for container 437c0809befc. Exiting log stream.
2026-04-23 21:56:32.971 ERROR [src.node.docker_mananger] Max retries reached for container b760db7ff54f. Exiting log stream.
2026-04-23 21:56:33.388 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63263/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:56:33.391 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 21:56:33.391 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 21:56:33.391 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63263/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:56:33.394 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.118.7/tcp/63264/p2p/16Uiu2HAmFwktR2ZFjmap5Xc1Z2JXMTvi2kLJz7B4BkEP37nnE91f","/ip4/172.18.118.7/tcp/63265/ws/p2p/16Uiu2HAmFwktR2ZFjmap5Xc1Z2JXMTvi2kLJz7B4BkEP37nnE91f"],"enrUri":"enr:-L24QFKO-_e-3YL6Z-B1Mkk1OyhgkB9wI-eLbANB7c1t_hiPFRDzo7DvuQGS_5KHQtjRe0kfre-K_Sx9LhE-7VoAF_8CgmlkgnY0gmlwhKwSdgeKbXVsdGlhZGRyc5YACASsEnYHBvcgAAoErBJ2Bwb3Id0DgnJzhQDGAQAAiXNlY3AyNTZrMaEDMN62IpQu42vd0WMLhJ7jm97yLuef_8c2am8-MGukxL6DdGNwgvcgg3VkcIL3IoV3YWt1MgE"}'
2026-04-23 21:56:33.394 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 21:56:33.394 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 21:56:33.394 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 21:56:33.396 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 21:56:33.396 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.93.144
2026-04-23 21:56:33.396 DEBUG [src.node.docker_mananger] Generated ports ['21466', '21467', '21468', '21469', '21470']
2026-04-23 21:56:33.396 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 21:56:33.396 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 21:56:33.397 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 21:56:33.397 DEBUG [src.node.docker_mananger] docker run -i -t -p 21466:21466 -p 21467:21467 -p 21468:21468 -p 21469:21469 -p 21470:21470 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=21468 --rest-port=21466 --tcp-port=21467 --discv5-udp-port=21469 --rest-address=0.0.0.0 --nat=extip:172.18.93.144 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=ce61f467e846edb3e3facd95bf7bc9fe7442ac854ddc4a4edf91631d19a8f2b0 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=21470 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QFKO-_e-3YL6Z-B1Mkk1OyhgkB9wI-eLbANB7c1t_hiPFRDzo7DvuQGS_5KHQtjRe0kfre-K_Sx9LhE-7VoAF_8CgmlkgnY0gmlwhKwSdgeKbXVsdGlhZGRyc5YACASsEnYHBvcgAAoErBJ2Bwb3Id0DgnJzhQDGAQAAiXNlY3AyNTZrMaEDMN62IpQu42vd0WMLhJ7jm97yLuef_8c2am8-MGukxL6DdGNwgvcgg3VkcIL3IoV3YWt1MgE
2026-04-23 21:56:33.587 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.93.144 waku 749f8e5901fca8e070310254cb0bfd97c88b0b99746fe17688a03357eed6a67b
2026-04-23 21:56:33.624 DEBUG [src.node.docker_mananger] Container started with ID 749f8e5901fc. Setting up logs at ./log/docker/node2_2026-04-23_21-56-32__05dcf4cb-10c0-492a-bfac-a22a0850f0ee__wakuorg_nwaku:latest.log
2026-04-23 21:56:33.625 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 21466
2026-04-23 21:56:33.625 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 21:56:34.628 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:21466/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:56:34.637 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 21:56:34.639 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 21:56:34.639 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:21466/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:56:34.642 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.93.144/tcp/21467/p2p/16Uiu2HAm4TKwMQYDToydNgEE1sEgYujVUPiLR9dkFzNcXxigcsF4","/ip4/172.18.93.144/tcp/21468/ws/p2p/16Uiu2HAm4TKwMQYDToydNgEE1sEgYujVUPiLR9dkFzNcXxigcsF4"],"enrUri":"enr:-L24QFDpkzkLLf6n1UEKPYze34uR74I5vnNqiZSzQ3I4KD__ey0u-xGAxyf5aaqTKayFfVl8vYVsRvPe3AwePb9QWsYCgmlkgnY0gmlwhKwSXZCKbXVsdGlhZGRyc5YACASsEl2QBlPbAAoErBJdkAZT3N0DgnJzhQDGAQAAiXNlY3AyNTZrMaEChiWuqx9OgcF5DqiAs4xPIgxk4iv3qdk1XcWKXmYt13-DdGNwglPbg3VkcIJT3YV3YWt1MgE"}'
2026-04-23 21:56:34.643 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 21:56:34.643 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 21:56:34.643 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 21:56:34.647 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 21:56:34.649 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.170.165
2026-04-23 21:56:34.650 DEBUG [src.node.docker_mananger] Generated ports ['52380', '52381', '52382', '52383', '52384']
2026-04-23 21:56:34.650 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 21:56:34.650 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 21:56:34.651 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 21:56:34.651 DEBUG [src.node.docker_mananger] docker run -i -t -p 52380:52380 -p 52381:52381 -p 52382:52382 -p 52383:52383 -p 52384:52384 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=52382 --rest-port=52380 --tcp-port=52381 --discv5-udp-port=52383 --rest-address=0.0.0.0 --nat=extip:172.18.170.165 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=b88bb8bb7f63ac5db6ec1ed99c92bec1a8c02f03bda52db2f9e034b89165bfc8 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=52384 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QFDpkzkLLf6n1UEKPYze34uR74I5vnNqiZSzQ3I4KD__ey0u-xGAxyf5aaqTKayFfVl8vYVsRvPe3AwePb9QWsYCgmlkgnY0gmlwhKwSXZCKbXVsdGlhZGRyc5YACASsEl2QBlPbAAoErBJdkAZT3N0DgnJzhQDGAQAAiXNlY3AyNTZrMaEChiWuqx9OgcF5DqiAs4xPIgxk4iv3qdk1XcWKXmYt13-DdGNwglPbg3VkcIJT3YV3YWt1MgE
2026-04-23 21:56:34.843 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.170.165 waku d1a0b1ab480a6080f0065d5d6e1880db1d66dcf49237fd8dc8d755b6a08b0fa4
2026-04-23 21:56:34.878 DEBUG [src.node.docker_mananger] Container started with ID d1a0b1ab480a. Setting up logs at ./log/docker/node3_2026-04-23_21-56-32__05dcf4cb-10c0-492a-bfac-a22a0850f0ee__wakuorg_nwaku:latest.log
2026-04-23 21:56:34.879 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 52380
2026-04-23 21:56:34.879 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 21:56:35.880 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:52380/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:56:35.886 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 21:56:35.886 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 21:56:35.887 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:52380/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:56:35.889 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.170.165/tcp/52381/p2p/16Uiu2HAmTX5LSRQykgit15szKU8hUcrhF8sbv6i7HorVnBHVJobQ","/ip4/172.18.170.165/tcp/52382/ws/p2p/16Uiu2HAmTX5LSRQykgit15szKU8hUcrhF8sbv6i7HorVnBHVJobQ"],"enrUri":"enr:-L24QNIFYMTiX1BlfmB44yCPSQegxbqJ2OXbyPgbbJd9jWMFdiVCkGcV1pGRsywz5i-4ONoWb_UURnIkPL42oOM8EqoCgmlkgnY0gmlwhKwSqqWKbXVsdGlhZGRyc5YACASsEqqlBsydAAoErBKqpQbMnt0DgnJzhQDGAQAAiXNlY3AyNTZrMaED3NhLWtrNXhEvh2RzF687sw44CgDthaAv9nIBPQsAbauDdGNwgsydg3VkcILMn4V3YWt1MgE"}'
2026-04-23 21:56:35.889 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 21:56:35.889 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 21:56:35.889 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 21:56:35.891 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 21:56:35.891 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.222.92
2026-04-23 21:56:35.891 DEBUG [src.node.docker_mananger] Generated ports ['48842', '48843', '48844', '48845', '48846']
2026-04-23 21:56:35.891 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 21:56:35.891 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 21:56:35.892 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 21:56:35.892 DEBUG [src.node.docker_mananger] docker run -i -t -p 48842:48842 -p 48843:48843 -p 48844:48844 -p 48845:48845 -p 48846:48846 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=48844 --rest-port=48842 --tcp-port=48843 --discv5-udp-port=48845 --rest-address=0.0.0.0 --nat=extip:172.18.222.92 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=3dfa79c2a1d2e4920f6610866bd9fe34e70fd75ece27bccbdc3fb686ac7826e6 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=48846 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QNIFYMTiX1BlfmB44yCPSQegxbqJ2OXbyPgbbJd9jWMFdiVCkGcV1pGRsywz5i-4ONoWb_UURnIkPL42oOM8EqoCgmlkgnY0gmlwhKwSqqWKbXVsdGlhZGRyc5YACASsEqqlBsydAAoErBKqpQbMnt0DgnJzhQDGAQAAiXNlY3AyNTZrMaED3NhLWtrNXhEvh2RzF687sw44CgDthaAv9nIBPQsAbauDdGNwgsydg3VkcILMn4V3YWt1MgE
2026-04-23 21:56:36.084 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.222.92 waku bc8ca297ab954362e8eb95440a438d80cf7b5d388a9f398549bedd0877ba8f5f
2026-04-23 21:56:36.115 DEBUG [src.node.docker_mananger] Container started with ID bc8ca297ab95. Setting up logs at ./log/docker/node4_2026-04-23_21-56-32__05dcf4cb-10c0-492a-bfac-a22a0850f0ee__wakuorg_nwaku:latest.log
2026-04-23 21:56:36.116 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 48842
2026-04-23 21:56:36.116 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 21:56:37.117 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48842/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:56:37.131 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 21:56:37.133 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 21:56:37.133 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48842/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:56:37.138 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.222.92/tcp/48843/p2p/16Uiu2HAmS7ZFAL7Z7eE63LM8idmbfanenEqXfTRpdkmToptabswf","/ip4/172.18.222.92/tcp/48844/ws/p2p/16Uiu2HAmS7ZFAL7Z7eE63LM8idmbfanenEqXfTRpdkmToptabswf"],"enrUri":"enr:-L24QIt7YsDBMoQTlEbG22CeAKTVWK3oRwCFtLUSc16wD7oKXQpzAIIZGIVIoht1nL0RKBj6FvBaAbwMl9WJhtqbWFsCgmlkgnY0gmlwhKwS3lyKbXVsdGlhZGRyc5YACASsEt5cBr7LAAoErBLeXAa-zN0DgnJzhQDGAQAAiXNlY3AyNTZrMaEDx_Y5jmFF7v7YFXn4LEDHF4hKyR0LbJ6gRHPSCiNza2qDdGNwgr7Lg3VkcIK-zYV3YWt1MgE"}'
2026-04-23 21:56:37.139 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 21:56:37.139 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63263/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/1"]'
2026-04-23 21:56:37.142 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 21:56:37.143 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21466/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/1"]'
2026-04-23 21:56:37.150 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 21:56:37.151 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:52380/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/1"]'
2026-04-23 21:56:37.158 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 21:56:37.159 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48842/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/1"]'
2026-04-23 21:56:37.169 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 21:56:37.169 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63263/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:56:37.173 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.93.144/tcp/46510/p2p/16Uiu2HAm4TKwMQYDToydNgEE1sEgYujVUPiLR9dkFzNcXxigcsF4","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-\\"v0.38.0-19-g820ccc\\"","origin":"UnknownOrigin"}]'
2026-04-23 21:56:37.173 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:21466/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:56:37.175 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.170.165/tcp/40570/p2p/16Uiu2HAmTX5LSRQykgit15szKU8hUcrhF8sbv6i7HorVnBHVJobQ","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-\\"v0.38.0-19-g820ccc\\"","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.118.7/tcp/63264/p2p/16Uiu2HAmFwktR2ZFjmap5Xc1Z2JXMTvi2kLJz7B4BkEP37nnE91f","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-\\"v0.38.0-19-g820ccc\\"","origin":"Discv5"}]'
2026-04-23 21:56:37.176 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:52380/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:56:37.178 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.222.92/tcp/39364/p2p/16Uiu2HAmS7ZFAL7Z7eE63LM8idmbfanenEqXfTRpdkmToptabswf","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-\\"v0.38.0-19-g820ccc\\"","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.93.144/tcp/21467/p2p/16Uiu2HAm4TKwMQYDToydNgEE1sEgYujVUPiLR9dkFzNcXxigcsF4","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-\\"v0.38.0-19-g820ccc\\"","origin":"Discv5"}]'
2026-04-23 21:56:37.178 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48842/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:56:37.180 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.170.165/tcp/52381/p2p/16Uiu2HAmTX5LSRQykgit15szKU8hUcrhF8sbv6i7HorVnBHVJobQ","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-\\"v0.38.0-19-g820ccc\\"","origin":"Discv5"}]'
2026-04-23 21:56:37.181 DEBUG [src.libs.common] Sleeping for 20 seconds
2026-04-23 21:56:57.181 INFO [tests.e2e.test_network_conditions] Applying 30.0% packet loss on sender node1
2026-04-23 21:56:57.183 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '23470', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-04-23 21:56:57.193 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '23470', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'loss', '30.0%']
2026-04-23 21:56:57.203 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '23470', '-n', 'tc', '-s', 'qdisc', 'show', 'dev', 'eth0']
2026-04-23 21:56:57.210 DEBUG [src.steps.network_conditions] tc -s qdisc show dev eth0:
qdisc netem 8002: root refcnt 5 limit 1000 loss 30%
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
2026-04-23 21:56:57.211 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48842/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:56:57.213 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[]'
2026-04-23 21:56:57.214 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63263/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-04-23 21:56:57.425 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 21:56:57.427 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '23470', '-n', 'tc', '-s', 'qdisc', 'show', 'dev', 'eth0']
2026-04-23 21:56:57.437 DEBUG [src.steps.network_conditions] tc -s qdisc show dev eth0:
qdisc netem 8002: root refcnt 5 limit 1000 loss 30%
Sent 566 bytes 6 pkt (dropped 2, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
2026-04-23 21:56:57.437 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48842/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d 'None'
2026-04-23 21:56:57.439 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1776981417214223197,"ephemeral":false,"proof":""}]'
2026-04-23 21:56:57.440 INFO [tests.e2e.test_network_conditions] Node4 received messages from node1 after 0 trails
2026-04-23 21:56:57.441 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '23470', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-04-23 21:56:57.451 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-04-23 21:56:57.452 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-04-23 21:56:57.452 DEBUG [src.node.waku_node] Stopping container with id 948e614ff6a2
2026-04-23 21:56:57.927 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 21:56:57.928 DEBUG [src.node.waku_node] Stopping container with id 749f8e5901fc
2026-04-23 21:56:58.406 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 21:56:58.409 DEBUG [src.node.waku_node] Stopping container with id d1a0b1ab480a
2026-04-23 21:56:58.739 ERROR [src.node.docker_mananger] Max retries reached for container 948e614ff6a2. Exiting log stream.
2026-04-23 21:56:58.831 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 21:56:58.832 DEBUG [src.node.waku_node] Stopping container with id bc8ca297ab95
2026-04-23 21:56:59.221 ERROR [src.node.docker_mananger] Max retries reached for container 749f8e5901fc. Exiting log stream.
2026-04-23 21:56:59.281 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 21:56:59.290 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-04-23 21:56:59.323 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 21:56:59.349 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 21:56:59.403 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 21:56:59.428 DEBUG [src.node.docker_mananger] No errors found in the waku logs.