159 lines
32 KiB
Plaintext

2026-03-30 04:55:53.281 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-30 04:55:53.282 DEBUG [tests.conftest] Running test: test_relay_4_nodes_two_publishers_compare_latency with id: 2026-03-30_04-55-53__ae4b731c-73e2-45a8-bfd9-93af56022203
2026-03-30 04:55:53.282 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-30 04:55:53.284 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-30 04:55:53.294 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-30 04:55:53.294 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-30_04-55-53__ae4b731c-73e2-45a8-bfd9-93af56022203__wakuorg_nwaku:latest.log
2026-03-30 04:55:53.301 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-30 04:55:53.302 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-30_04-55-53__ae4b731c-73e2-45a8-bfd9-93af56022203__wakuorg_nwaku:latest.log
2026-03-30 04:55:53.308 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-30 04:55:53.308 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-30_04-55-53__ae4b731c-73e2-45a8-bfd9-93af56022203__wakuorg_nwaku:latest.log
2026-03-30 04:55:53.314 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-30 04:55:53.314 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-30_04-55-53__ae4b731c-73e2-45a8-bfd9-93af56022203__wakuorg_nwaku:latest.log
2026-03-30 04:55:53.314 INFO [tests.e2e.test_network_conditions] Starting 4 nodes
2026-03-30 04:55:53.314 DEBUG [src.node.waku_node] Starting Node...
2026-03-30 04:55:53.314 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-30 04:55:53.315 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-30 04:55:53.315 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.155.12
2026-03-30 04:55:53.316 DEBUG [src.node.docker_mananger] Generated ports ['23779', '23780', '23781', '23782', '23783']
2026-03-30 04:55:53.316 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-30 04:55:53.316 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-30 04:55:53.316 DEBUG [src.node.waku_node] Using volumes []
2026-03-30 04:55:53.316 DEBUG [src.node.docker_mananger] docker run -i -t -p 23779:23779 -p 23780:23780 -p 23781:23781 -p 23782:23782 -p 23783:23783 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=23781 --rest-port=23779 --tcp-port=23780 --discv5-udp-port=23782 --rest-address=0.0.0.0 --nat=extip:172.18.155.12 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=05e502fab2b6fffbdcbb90e2f942f06d209b0bcd9e5d74aefef7e8b08395486c --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=23783 --metrics-logging=true --relay=true
2026-03-30 04:55:53.504 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.155.12 waku 62a4394cab6489cda2f3cc698a5d914c8158f09d312f42ffc14387092a984e29
2026-03-30 04:55:53.538 DEBUG [src.node.docker_mananger] Container started with ID 62a4394cab64. Setting up logs at ./log/docker/node1_2026-03-30_04-55-53__ae4b731c-73e2-45a8-bfd9-93af56022203__wakuorg_nwaku:latest.log
2026-03-30 04:55:53.539 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 23779
2026-03-30 04:55:53.539 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-30 04:55:53.680 ERROR [src.node.docker_mananger] Max retries reached for container 98f1a786851a. Exiting log stream.
2026-03-30 04:55:54.110 ERROR [src.node.docker_mananger] Max retries reached for container 1745b9f898a8. Exiting log stream.
2026-03-30 04:55:54.540 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:23779/health" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:55:54.544 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-30 04:55:54.544 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-30 04:55:54.544 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:23779/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:55:54.547 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.155.12/tcp/23780/p2p/16Uiu2HAmNZrTjBbG7BDA91y1gCRYZz3MjCppExP4oSeibq8WUqcm","/ip4/172.18.155.12/tcp/23781/ws/p2p/16Uiu2HAmNZrTjBbG7BDA91y1gCRYZz3MjCppExP4oSeibq8WUqcm"],"enrUri":"enr:-L24QImw2pB_AhCRmZme8s_xvHsVxhDuABvJAL-FbHr94s9lYZOrkoYR_XMzxkNDuJ74QzpkbTE33Ep1SjBykC6UHuYCgmlkgnY0gmlwhKwSmwyKbXVsdGlhZGRyc5YACASsEpsMBlzkAAoErBKbDAZc5d0DgnJzhQADAQAAiXNlY3AyNTZrMaEDk0QLi8sYCQ3KJHLns6cZ18Dp1moyU5aO6JQewMDyk0KDdGNwglzkg3VkcIJc5oV3YWt1MgE"}'
2026-03-30 04:55:54.547 INFO [src.node.waku_node] REST service is ready !!
2026-03-30 04:55:54.547 DEBUG [src.node.waku_node] Starting Node...
2026-03-30 04:55:54.547 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-30 04:55:54.549 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-30 04:55:54.549 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.124.63
2026-03-30 04:55:54.549 DEBUG [src.node.docker_mananger] Generated ports ['58838', '58839', '58840', '58841', '58842']
2026-03-30 04:55:54.549 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-30 04:55:54.549 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-30 04:55:54.549 DEBUG [src.node.waku_node] Using volumes []
2026-03-30 04:55:54.549 DEBUG [src.node.docker_mananger] docker run -i -t -p 58838:58838 -p 58839:58839 -p 58840:58840 -p 58841:58841 -p 58842:58842 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=58840 --rest-port=58838 --tcp-port=58839 --discv5-udp-port=58841 --rest-address=0.0.0.0 --nat=extip:172.18.124.63 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=571057cc619e3a4143caddb1b9ee1060ba6365f1a3ba47bdfac3d1ecbb89ea65 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=58842 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QImw2pB_AhCRmZme8s_xvHsVxhDuABvJAL-FbHr94s9lYZOrkoYR_XMzxkNDuJ74QzpkbTE33Ep1SjBykC6UHuYCgmlkgnY0gmlwhKwSmwyKbXVsdGlhZGRyc5YACASsEpsMBlzkAAoErBKbDAZc5d0DgnJzhQADAQAAiXNlY3AyNTZrMaEDk0QLi8sYCQ3KJHLns6cZ18Dp1moyU5aO6JQewMDyk0KDdGNwglzkg3VkcIJc5oV3YWt1MgE
2026-03-30 04:55:54.755 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.124.63 waku 6dd134615d46fb002ada4479468a793fc8f868d02276c12ea66b84766febc4fa
2026-03-30 04:55:54.792 DEBUG [src.node.docker_mananger] Container started with ID 6dd134615d46. Setting up logs at ./log/docker/node2_2026-03-30_04-55-53__ae4b731c-73e2-45a8-bfd9-93af56022203__wakuorg_nwaku:latest.log
2026-03-30 04:55:54.792 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 58838
2026-03-30 04:55:54.793 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-30 04:55:55.794 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58838/health" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:55:55.810 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-30 04:55:55.812 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-30 04:55:55.815 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58838/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:55:55.820 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.124.63/tcp/58839/p2p/16Uiu2HAm4H5aN1kSx1gB7N44CqEXK2PHbpLXDzhjKj7Hn5C3NTqB","/ip4/172.18.124.63/tcp/58840/ws/p2p/16Uiu2HAm4H5aN1kSx1gB7N44CqEXK2PHbpLXDzhjKj7Hn5C3NTqB"],"enrUri":"enr:-L24QDRgS6YMTlL2_YShOsiHIfAwJN48cMdb8nynOS83eylRbS1lV-vaESl81wCeUhusYBCNiDh-hh0jMte4t5BuU64CgmlkgnY0gmlwhKwSfD-KbXVsdGlhZGRyc5YACASsEnw_BuXXAAoErBJ8Pwbl2N0DgnJzhQADAQAAiXNlY3AyNTZrMaECg4Wimmunfz5Mvp4vZ90gB_sXqzXuFCcM3sfuZHKdo1qDdGNwguXXg3VkcILl2YV3YWt1MgE"}'
2026-03-30 04:55:55.820 INFO [src.node.waku_node] REST service is ready !!
2026-03-30 04:55:55.821 DEBUG [src.node.waku_node] Starting Node...
2026-03-30 04:55:55.821 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-30 04:55:55.822 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-30 04:55:55.823 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.110.94
2026-03-30 04:55:55.823 DEBUG [src.node.docker_mananger] Generated ports ['3509', '3510', '3511', '3512', '3513']
2026-03-30 04:55:55.823 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-30 04:55:55.823 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-30 04:55:55.823 DEBUG [src.node.waku_node] Using volumes []
2026-03-30 04:55:55.823 DEBUG [src.node.docker_mananger] docker run -i -t -p 3509:3509 -p 3510:3510 -p 3511:3511 -p 3512:3512 -p 3513:3513 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=3511 --rest-port=3509 --tcp-port=3510 --discv5-udp-port=3512 --rest-address=0.0.0.0 --nat=extip:172.18.110.94 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=695db8e9efdefb6d6e6fe22aff40104e1ed6dad9cf1ef63f5d055c8c180fe0b3 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=3513 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QDRgS6YMTlL2_YShOsiHIfAwJN48cMdb8nynOS83eylRbS1lV-vaESl81wCeUhusYBCNiDh-hh0jMte4t5BuU64CgmlkgnY0gmlwhKwSfD-KbXVsdGlhZGRyc5YACASsEnw_BuXXAAoErBJ8Pwbl2N0DgnJzhQADAQAAiXNlY3AyNTZrMaECg4Wimmunfz5Mvp4vZ90gB_sXqzXuFCcM3sfuZHKdo1qDdGNwguXXg3VkcILl2YV3YWt1MgE
2026-03-30 04:55:56.017 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.110.94 waku ad24a17846ff5f7903a63d8a829e8eac832d8fcb38ab031cdab731704e12fc42
2026-03-30 04:55:56.053 DEBUG [src.node.docker_mananger] Container started with ID ad24a17846ff. Setting up logs at ./log/docker/node3_2026-03-30_04-55-53__ae4b731c-73e2-45a8-bfd9-93af56022203__wakuorg_nwaku:latest.log
2026-03-30 04:55:56.053 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 3509
2026-03-30 04:55:56.054 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-30 04:55:57.056 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3509/health" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:55:57.076 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-30 04:55:57.078 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-30 04:55:57.078 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3509/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:55:57.085 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.110.94/tcp/3510/p2p/16Uiu2HAkxjRtHbYMvSwbnGBzKbFA1aoTtg6hc8kk4Q9us7taExhA","/ip4/172.18.110.94/tcp/3511/ws/p2p/16Uiu2HAkxjRtHbYMvSwbnGBzKbFA1aoTtg6hc8kk4Q9us7taExhA"],"enrUri":"enr:-L24QMSFvFUsk9m7fjEiZ-G4ThOT64TdnVdBvRDrTflIg73kEI8lLaPB-jg5V45_wpTpQhlmiIEGuEGCR0S2YQ4FEJwCgmlkgnY0gmlwhKwSbl6KbXVsdGlhZGRyc5YACASsEm5eBg22AAoErBJuXgYNt90DgnJzhQADAQAAiXNlY3AyNTZrMaECMR-UARxinPdTEWVv5IXWEA_qitIcDrH7G-jSdvV6SE2DdGNwgg22g3VkcIINuIV3YWt1MgE"}'
2026-03-30 04:55:57.085 INFO [src.node.waku_node] REST service is ready !!
2026-03-30 04:55:57.086 DEBUG [src.node.waku_node] Starting Node...
2026-03-30 04:55:57.086 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-30 04:55:57.087 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-30 04:55:57.087 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.95.133
2026-03-30 04:55:57.087 DEBUG [src.node.docker_mananger] Generated ports ['45437', '45438', '45439', '45440', '45441']
2026-03-30 04:55:57.088 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-30 04:55:57.088 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-30 04:55:57.088 DEBUG [src.node.waku_node] Using volumes []
2026-03-30 04:55:57.088 DEBUG [src.node.docker_mananger] docker run -i -t -p 45437:45437 -p 45438:45438 -p 45439:45439 -p 45440:45440 -p 45441:45441 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=45439 --rest-port=45437 --tcp-port=45438 --discv5-udp-port=45440 --rest-address=0.0.0.0 --nat=extip:172.18.95.133 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=dbb32b53f50176d0e9a11ca9cb1ad37f9ec00bc15eeafc8538014c31beb0bce5 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=45441 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QMSFvFUsk9m7fjEiZ-G4ThOT64TdnVdBvRDrTflIg73kEI8lLaPB-jg5V45_wpTpQhlmiIEGuEGCR0S2YQ4FEJwCgmlkgnY0gmlwhKwSbl6KbXVsdGlhZGRyc5YACASsEm5eBg22AAoErBJuXgYNt90DgnJzhQADAQAAiXNlY3AyNTZrMaECMR-UARxinPdTEWVv5IXWEA_qitIcDrH7G-jSdvV6SE2DdGNwgg22g3VkcIINuIV3YWt1MgE
2026-03-30 04:55:57.277 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.95.133 waku dce8acd3e19fd2297c247d141b2475cc3d7a7af41217bafbaad001eaf1cc8096
2026-03-30 04:55:57.313 DEBUG [src.node.docker_mananger] Container started with ID dce8acd3e19f. Setting up logs at ./log/docker/node4_2026-03-30_04-55-53__ae4b731c-73e2-45a8-bfd9-93af56022203__wakuorg_nwaku:latest.log
2026-03-30 04:55:57.313 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 45437
2026-03-30 04:55:57.314 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-30 04:55:58.314 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45437/health" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:55:58.323 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-30 04:55:58.324 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-30 04:55:58.327 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45437/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:55:58.331 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.95.133/tcp/45438/p2p/16Uiu2HAmS55GsCVzTHzQGAproad1n7vhx8iJ3dLTwdwEV1wL3WSa","/ip4/172.18.95.133/tcp/45439/ws/p2p/16Uiu2HAmS55GsCVzTHzQGAproad1n7vhx8iJ3dLTwdwEV1wL3WSa"],"enrUri":"enr:-L24QG4C_k9eFHI0DBsWY1dHM3m2E4Zq6MPdrwWULHVL46I1buOH_NuakzDpUsezt-pLEIBDxiKHOnZS3ZZoNK7XrxwCgmlkgnY0gmlwhKwSX4WKbXVsdGlhZGRyc5YACASsEl-FBrF-AAoErBJfhQaxf90DgnJzhQADAQAAiXNlY3AyNTZrMaEDx1NvzkgHVEuJDkyzI29POr6p3Bplw4MT9zQNwHCpLh-DdGNwgrF-g3VkcIKxgIV3YWt1MgE"}'
2026-03-30 04:55:58.331 INFO [src.node.waku_node] REST service is ready !!
2026-03-30 04:55:58.332 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:23779/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-30 04:55:58.338 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 04:55:58.339 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:58838/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-30 04:55:58.345 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 04:55:58.346 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3509/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-30 04:55:58.353 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 04:55:58.354 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45437/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-30 04:55:58.360 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 04:55:58.361 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:23779/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:55:58.363 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.124.63/tcp/58906/p2p/16Uiu2HAm4H5aN1kSx1gB7N44CqEXK2PHbpLXDzhjKj7Hn5C3NTqB","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"UnknownOrigin"}]'
2026-03-30 04:55:58.363 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58838/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:55:58.369 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.110.94/tcp/39390/p2p/16Uiu2HAkxjRtHbYMvSwbnGBzKbFA1aoTtg6hc8kk4Q9us7taExhA","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.155.12/tcp/23780/p2p/16Uiu2HAmNZrTjBbG7BDA91y1gCRYZz3MjCppExP4oSeibq8WUqcm","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"Discv5"}]'
2026-03-30 04:55:58.369 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3509/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:55:58.372 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.124.63/tcp/58839/p2p/16Uiu2HAm4H5aN1kSx1gB7N44CqEXK2PHbpLXDzhjKj7Hn5C3NTqB","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"Discv5"},{"multiaddr":"/ip4/172.18.95.133/tcp/44560/p2p/16Uiu2HAmS55GsCVzTHzQGAproad1n7vhx8iJ3dLTwdwEV1wL3WSa","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"UnknownOrigin"}]'
2026-03-30 04:55:58.372 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45437/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:55:58.374 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.110.94/tcp/3510/p2p/16Uiu2HAkxjRtHbYMvSwbnGBzKbFA1aoTtg6hc8kk4Q9us7taExhA","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"Discv5"}]'
2026-03-30 04:55:58.375 DEBUG [src.libs.common] Sleeping for 60 seconds
2026-03-30 04:56:58.375 DEBUG [tests.e2e.test_network_conditions] Applying 3000ms latency on node1 only
2026-03-30 04:56:58.377 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '5003', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-30 04:56:58.453 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '5003', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'delay', '3000ms']
2026-03-30 04:56:58.467 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45437/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:56:58.470 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[]'
2026-03-30 04:56:58.470 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:23779/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-30 04:57:04.477 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 04:57:04.477 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:58838/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-30 04:57:04.492 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 04:57:04.493 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-30 04:57:04.694 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:23779/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-30 04:57:10.700 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 04:57:10.701 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:58838/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-30 04:57:10.710 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 04:57:10.713 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-30 04:57:10.914 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:23779/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-30 04:57:16.923 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 04:57:16.923 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:58838/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-30 04:57:16.940 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 04:57:16.944 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-30 04:57:17.145 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:23779/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-30 04:57:23.152 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 04:57:23.152 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:58838/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-30 04:57:23.161 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 04:57:23.161 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-30 04:57:23.363 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:23779/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-30 04:57:29.369 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 04:57:29.370 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:58838/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-30 04:57:29.380 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 04:57:29.380 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-30 04:57:29.583 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45437/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:57:29.586 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774846618470708061,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774846624477620278,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774846624694014447,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774846630701074263,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774846630914283320,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774846636923693362,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774846637145587786,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774846643152533551,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774846643363060824,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774846649370217001,"ephemeral":false,"proof":""}]'
2026-03-30 04:57:29.588 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '5003', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-30 04:57:29.599 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-30 04:57:29.600 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-30 04:57:29.600 DEBUG [src.node.waku_node] Stopping container with id 62a4394cab64
2026-03-30 04:57:30.106 DEBUG [src.node.waku_node] Container stopped.
2026-03-30 04:57:30.107 DEBUG [src.node.waku_node] Stopping container with id 6dd134615d46
2026-03-30 04:57:30.619 DEBUG [src.node.waku_node] Container stopped.
2026-03-30 04:57:30.620 DEBUG [src.node.waku_node] Stopping container with id ad24a17846ff
2026-03-30 04:57:31.099 DEBUG [src.node.waku_node] Container stopped.
2026-03-30 04:57:31.099 DEBUG [src.node.waku_node] Stopping container with id dce8acd3e19f
2026-03-30 04:57:31.193 ERROR [src.node.docker_mananger] Max retries reached for container 62a4394cab64. Exiting log stream.
2026-03-30 04:57:31.437 ERROR [src.node.docker_mananger] Max retries reached for container 6dd134615d46. Exiting log stream.
2026-03-30 04:57:31.549 DEBUG [src.node.waku_node] Container stopped.
2026-03-30 04:57:31.550 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-30 04:57:31.700 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-30 04:57:31.778 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-30 04:57:31.928 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-30 04:57:32.000 DEBUG [src.node.docker_mananger] No errors found in the waku logs.