logos-messaging/logos-messaging-interop-tests
1
0
Fork 0
mirror of https://github.com/logos-messaging/logos-messaging-interop-tests.git synced 2026-05-05 10:03:16 +00:00
Code Issues Packages Projects Releases Wiki Activity
logos-messaging-interop-tests/nim/1127/data/attachments/549f17f2ae680ed1.txt

333 lines
66 KiB
Plaintext
Raw Blame History

2026-03-26 04:49:37.617 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-26 04:49:37.618 DEBUG [tests.conftest] Running test: test_relay_packet_loss_correlated_vs_uncorrelated with id: 2026-03-26_04-49-37__25816950-ea28-4cf7-92cc-31b041a53392
2026-03-26 04:49:37.618 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-26 04:49:37.619 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-26 04:49:37.626 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-26 04:49:37.626 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-26_04-49-37__25816950-ea28-4cf7-92cc-31b041a53392__wakuorg_nwaku:latest.log
2026-03-26 04:49:37.632 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-26 04:49:37.632 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-26_04-49-37__25816950-ea28-4cf7-92cc-31b041a53392__wakuorg_nwaku:latest.log
2026-03-26 04:49:37.639 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-26 04:49:37.639 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-26_04-49-37__25816950-ea28-4cf7-92cc-31b041a53392__wakuorg_nwaku:latest.log
2026-03-26 04:49:37.645 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-26 04:49:37.645 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-26_04-49-37__25816950-ea28-4cf7-92cc-31b041a53392__wakuorg_nwaku:latest.log
2026-03-26 04:49:37.645 DEBUG [src.node.waku_node] Starting Node...
2026-03-26 04:49:37.646 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-26 04:49:37.647 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-26 04:49:37.647 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.9.224
2026-03-26 04:49:37.647 DEBUG [src.node.docker_mananger] Generated ports ['54948', '54949', '54950', '54951', '54952']
2026-03-26 04:49:37.647 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-26 04:49:37.647 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-26 04:49:37.647 DEBUG [src.node.waku_node] Using volumes []
2026-03-26 04:49:37.648 DEBUG [src.node.docker_mananger] docker run -i -t -p 54948:54948 -p 54949:54949 -p 54950:54950 -p 54951:54951 -p 54952:54952 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=54950 --rest-port=54948 --tcp-port=54949 --discv5-udp-port=54951 --rest-address=0.0.0.0 --nat=extip:172.18.9.224 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=eaf6edda36eaa46e2a0cea44a4aac5c9ef6d6aaee19c19f0c1cbeb96b4bdba8e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=54952 --metrics-logging=true --relay=true
2026-03-26 04:49:37.836 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.9.224 waku 4afa45d29a0cfda0e48ab56c2b040dcf63e06b585ff8a8cdc7c0a5529eec58a9
2026-03-26 04:49:37.871 DEBUG [src.node.docker_mananger] Container started with ID 4afa45d29a0c. Setting up logs at ./log/docker/node1_2026-03-26_04-49-37__25816950-ea28-4cf7-92cc-31b041a53392__wakuorg_nwaku:latest.log
2026-03-26 04:49:37.872 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 54948
2026-03-26 04:49:37.872 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-26 04:49:37.882 ERROR [src.node.docker_mananger] Max retries reached for container 42515699d44a. Exiting log stream.
2026-03-26 04:49:38.412 ERROR [src.node.docker_mananger] Max retries reached for container 108d807d3839. Exiting log stream.
2026-03-26 04:49:38.872 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54948/health" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:49:38.875 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-26 04:49:38.875 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-26 04:49:38.876 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54948/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:49:38.878 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.9.224/tcp/54949/p2p/16Uiu2HAkyxXUDTZyyGAKXb5L4ddcZAwCwUDeZrr4XJmJXnkNvBx5","/ip4/172.18.9.224/tcp/54950/ws/p2p/16Uiu2HAkyxXUDTZyyGAKXb5L4ddcZAwCwUDeZrr4XJmJXnkNvBx5"],"enrUri":"enr:-L24QDIcceus-omB2w5wVWwqio9jDwrxqTPfQFyCYwNFVM5jJsD-aVS8_BJC9Dev6OPdyEngEVi1ZX6vITEST2ZbNjYCgmlkgnY0gmlwhKwSCeCKbXVsdGlhZGRyc5YACASsEgngBtalAAoErBIJ4AbWpt0DgnJzhQADAQAAiXNlY3AyNTZrMaECQ1Yhaw-_JeJ6pc8CF5IleETfBd3B9WfxOlxM1Idlj5qDdGNwgtalg3VkcILWp4V3YWt1MgE"}'
2026-03-26 04:49:38.878 INFO [src.node.waku_node] REST service is ready !!
2026-03-26 04:49:38.878 DEBUG [src.node.waku_node] Starting Node...
2026-03-26 04:49:38.878 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-26 04:49:38.880 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-26 04:49:38.880 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.99.241
2026-03-26 04:49:38.880 DEBUG [src.node.docker_mananger] Generated ports ['40540', '40541', '40542', '40543', '40544']
2026-03-26 04:49:38.880 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-26 04:49:38.881 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-26 04:49:38.881 DEBUG [src.node.waku_node] Using volumes []
2026-03-26 04:49:38.881 DEBUG [src.node.docker_mananger] docker run -i -t -p 40540:40540 -p 40541:40541 -p 40542:40542 -p 40543:40543 -p 40544:40544 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=40542 --rest-port=40540 --tcp-port=40541 --discv5-udp-port=40543 --rest-address=0.0.0.0 --nat=extip:172.18.99.241 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=1ad1e2dbbf5fe47fdfefb9c4cfb9d27a55d74d4ecd9f4dcabc5de9bbdbc9bcdb --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=40544 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QDIcceus-omB2w5wVWwqio9jDwrxqTPfQFyCYwNFVM5jJsD-aVS8_BJC9Dev6OPdyEngEVi1ZX6vITEST2ZbNjYCgmlkgnY0gmlwhKwSCeCKbXVsdGlhZGRyc5YACASsEgngBtalAAoErBIJ4AbWpt0DgnJzhQADAQAAiXNlY3AyNTZrMaECQ1Yhaw-_JeJ6pc8CF5IleETfBd3B9WfxOlxM1Idlj5qDdGNwgtalg3VkcILWp4V3YWt1MgE
2026-03-26 04:49:39.078 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.99.241 waku d8ad055edb4ecb616db031d3563386cf535e087b8f5f99dcf489749b00b655fd
2026-03-26 04:49:39.112 DEBUG [src.node.docker_mananger] Container started with ID d8ad055edb4e. Setting up logs at ./log/docker/node2_2026-03-26_04-49-37__25816950-ea28-4cf7-92cc-31b041a53392__wakuorg_nwaku:latest.log
2026-03-26 04:49:39.112 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 40540
2026-03-26 04:49:39.112 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-26 04:49:40.113 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40540/health" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:49:40.132 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-26 04:49:40.133 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-26 04:49:40.135 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40540/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:49:40.141 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.99.241/tcp/40541/p2p/16Uiu2HAkvif5qssxh63SviKk7ezJBfF325BpTDCWY1UJVsowefsB","/ip4/172.18.99.241/tcp/40542/ws/p2p/16Uiu2HAkvif5qssxh63SviKk7ezJBfF325BpTDCWY1UJVsowefsB"],"enrUri":"enr:-L24QK1U7dGrbl05TAqk4U5BGn4LlZi-_NwwZcSXZOcG1YCoNTKFfcI38kmjMpGGgS8SP0CrSGLc7OyF0yeMfvgdqewCgmlkgnY0gmlwhKwSY_GKbXVsdGlhZGRyc5YACASsEmPxBp5dAAoErBJj8QaeXt0DgnJzhQADAQAAiXNlY3AyNTZrMaECEzWMRJIHL84kvYFPbqL1bG4q9s4g0Xk1QcebTGxrgB6DdGNwgp5dg3VkcIKeX4V3YWt1MgE"}'
2026-03-26 04:49:40.142 INFO [src.node.waku_node] REST service is ready !!
2026-03-26 04:49:40.143 DEBUG [src.node.waku_node] Starting Node...
2026-03-26 04:49:40.143 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-26 04:49:40.146 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-26 04:49:40.147 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.167.64
2026-03-26 04:49:40.148 DEBUG [src.node.docker_mananger] Generated ports ['60990', '60991', '60992', '60993', '60994']
2026-03-26 04:49:40.148 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-26 04:49:40.148 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-26 04:49:40.148 DEBUG [src.node.waku_node] Using volumes []
2026-03-26 04:49:40.148 DEBUG [src.node.docker_mananger] docker run -i -t -p 60990:60990 -p 60991:60991 -p 60992:60992 -p 60993:60993 -p 60994:60994 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=60992 --rest-port=60990 --tcp-port=60991 --discv5-udp-port=60993 --rest-address=0.0.0.0 --nat=extip:172.18.167.64 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=a93e86b1b9e3d24be5b4d68fdce9ddcff04d4b5baf8d340580f9ef58116fc865 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=60994 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QK1U7dGrbl05TAqk4U5BGn4LlZi-_NwwZcSXZOcG1YCoNTKFfcI38kmjMpGGgS8SP0CrSGLc7OyF0yeMfvgdqewCgmlkgnY0gmlwhKwSY_GKbXVsdGlhZGRyc5YACASsEmPxBp5dAAoErBJj8QaeXt0DgnJzhQADAQAAiXNlY3AyNTZrMaECEzWMRJIHL84kvYFPbqL1bG4q9s4g0Xk1QcebTGxrgB6DdGNwgp5dg3VkcIKeX4V3YWt1MgE
2026-03-26 04:49:40.345 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.167.64 waku 8a874a0495391f2b50e980c95d015e4408fa103cf865a93816c6d745b00acc55
2026-03-26 04:49:40.383 DEBUG [src.node.docker_mananger] Container started with ID 8a874a049539. Setting up logs at ./log/docker/node3_2026-03-26_04-49-37__25816950-ea28-4cf7-92cc-31b041a53392__wakuorg_nwaku:latest.log
2026-03-26 04:49:40.383 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 60990
2026-03-26 04:49:40.384 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-26 04:49:41.384 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60990/health" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:49:41.400 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-26 04:49:41.402 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-26 04:49:41.405 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60990/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:49:41.409 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.167.64/tcp/60991/p2p/16Uiu2HAmGUyvkTgxzregyyxzdhVJufNqESbAeNapfQR3esyBvg7V","/ip4/172.18.167.64/tcp/60992/ws/p2p/16Uiu2HAmGUyvkTgxzregyyxzdhVJufNqESbAeNapfQR3esyBvg7V"],"enrUri":"enr:-L24QDKoFxiF4ZJxgUf69e47VYXqUMEgZg2bIuqildZpv-kHIiW6OU8LiX3FK2z1_n9BKkuMZMs8FzAKSVSD-K1o7hMCgmlkgnY0gmlwhKwSp0CKbXVsdGlhZGRyc5YACASsEqdABu4_AAoErBKnQAbuQN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDON52Ei_CaxPAtuoBn-AF-9FoyqBm0tGC1vCLXcYRFNyDdGNwgu4_g3VkcILuQYV3YWt1MgE"}'
2026-03-26 04:49:41.410 INFO [src.node.waku_node] REST service is ready !!
2026-03-26 04:49:41.411 DEBUG [src.node.waku_node] Starting Node...
2026-03-26 04:49:41.411 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-26 04:49:41.413 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-26 04:49:41.413 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.43.32
2026-03-26 04:49:41.413 DEBUG [src.node.docker_mananger] Generated ports ['25801', '25802', '25803', '25804', '25805']
2026-03-26 04:49:41.413 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-26 04:49:41.414 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-26 04:49:41.414 DEBUG [src.node.waku_node] Using volumes []
2026-03-26 04:49:41.414 DEBUG [src.node.docker_mananger] docker run -i -t -p 25801:25801 -p 25802:25802 -p 25803:25803 -p 25804:25804 -p 25805:25805 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=25803 --rest-port=25801 --tcp-port=25802 --discv5-udp-port=25804 --rest-address=0.0.0.0 --nat=extip:172.18.43.32 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=bf07c8bb54f9d9fb75ae3b5acebe0de4b213a2cacc36a086566a52c9b14d1ed8 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=25805 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QDKoFxiF4ZJxgUf69e47VYXqUMEgZg2bIuqildZpv-kHIiW6OU8LiX3FK2z1_n9BKkuMZMs8FzAKSVSD-K1o7hMCgmlkgnY0gmlwhKwSp0CKbXVsdGlhZGRyc5YACASsEqdABu4_AAoErBKnQAbuQN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDON52Ei_CaxPAtuoBn-AF-9FoyqBm0tGC1vCLXcYRFNyDdGNwgu4_g3VkcILuQYV3YWt1MgE
2026-03-26 04:49:41.613 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.43.32 waku 9f136348db4fd085afdca98f7d63aad6cb9b7e044588403345a1b072f67ab604
2026-03-26 04:49:41.648 DEBUG [src.node.docker_mananger] Container started with ID 9f136348db4f. Setting up logs at ./log/docker/node4_2026-03-26_04-49-37__25816950-ea28-4cf7-92cc-31b041a53392__wakuorg_nwaku:latest.log
2026-03-26 04:49:41.648 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 25801
2026-03-26 04:49:41.649 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-26 04:49:42.649 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25801/health" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:49:42.664 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-26 04:49:42.664 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-26 04:49:42.664 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25801/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:49:42.671 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.43.32/tcp/25802/p2p/16Uiu2HAmBEuK1Av3cTwRmzT7VhZ4BEwYNoJ83CGdzogduQVdQsMP","/ip4/172.18.43.32/tcp/25803/ws/p2p/16Uiu2HAmBEuK1Av3cTwRmzT7VhZ4BEwYNoJ83CGdzogduQVdQsMP"],"enrUri":"enr:-L24QA1ZXTnXYSb1vW5TTeDz9PcmGt6dxs40pTZwgQx3ofoIaN6V17nYus4a6E_LnZLrTwpbqFPb4-HVe4F9TCbKhccCgmlkgnY0gmlwhKwSKyCKbXVsdGlhZGRyc5YACASsEisgBmTKAAoErBIrIAZky90DgnJzhQADAQAAiXNlY3AyNTZrMaEC6vis8i0U_3sTSU54Nno5cVpgYfmMaAn29-SbEVBLTr6DdGNwgmTKg3VkcIJkzIV3YWt1MgE"}'
2026-03-26 04:49:42.672 INFO [src.node.waku_node] REST service is ready !!
2026-03-26 04:49:42.674 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54948/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-26 04:49:42.678 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-26 04:49:42.679 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:40540/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-26 04:49:42.685 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-26 04:49:42.686 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:60990/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-26 04:49:42.696 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-26 04:49:42.697 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:25801/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-26 04:49:42.705 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-26 04:49:42.705 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54948/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:49:42.709 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.99.241/tcp/51386/p2p/16Uiu2HAkvif5qssxh63SviKk7ezJBfF325BpTDCWY1UJVsowefsB","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-12-g0b8609","origin":"UnknownOrigin"}]'
2026-03-26 04:49:42.710 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40540/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:49:42.713 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.9.224/tcp/54949/p2p/16Uiu2HAkyxXUDTZyyGAKXb5L4ddcZAwCwUDeZrr4XJmJXnkNvBx5","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-12-g0b8609","origin":"Discv5"},{"multiaddr":"/ip4/172.18.167.64/tcp/38112/p2p/16Uiu2HAmGUyvkTgxzregyyxzdhVJufNqESbAeNapfQR3esyBvg7V","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-12-g0b8609","origin":"UnknownOrigin"}]'
2026-03-26 04:49:42.714 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60990/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:49:42.716 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.99.241/tcp/40541/p2p/16Uiu2HAkvif5qssxh63SviKk7ezJBfF325BpTDCWY1UJVsowefsB","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-12-g0b8609","origin":"Discv5"},{"multiaddr":"/ip4/172.18.43.32/tcp/52454/p2p/16Uiu2HAmBEuK1Av3cTwRmzT7VhZ4BEwYNoJ83CGdzogduQVdQsMP","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-12-g0b8609","origin":"UnknownOrigin"}]'
2026-03-26 04:49:42.716 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25801/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:49:42.718 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.167.64/tcp/60991/p2p/16Uiu2HAmGUyvkTgxzregyyxzdhVJufNqESbAeNapfQR3esyBvg7V","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-12-g0b8609","origin":"Discv5"}]'
2026-03-26 04:49:42.718 DEBUG [src.libs.common] Sleeping for 20 seconds
2026-03-26 04:50:02.721 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '8289', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-26 04:50:02.732 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '8289', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'loss', '50.0%']
2026-03-26 04:50:02.742 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '8289', '-n', 'tc', '-s', 'qdisc', 'show', 'dev', 'eth0']
2026-03-26 04:50:02.752 DEBUG [src.steps.network_conditions] tc -s qdisc show dev eth0:
qdisc netem 8002: root refcnt 5 limit 1000 loss 50%
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
2026-03-26 04:50:02.752 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25801/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:50:02.754 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[]'
2026-03-26 04:50:02.755 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54948/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-26 04:50:03.814 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-26 04:50:03.815 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54948/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-26 04:50:04.836 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-26 04:50:04.837 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54948/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-26 04:50:06.272 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-26 04:50:06.272 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54948/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-26 04:50:06.284 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-26 04:50:06.285 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54948/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-26 04:50:08.160 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-26 04:50:08.160 DEBUG [src.libs.common] Sleeping for 30.0 seconds
2026-03-26 04:50:38.160 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25801/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:50:38.163 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774500602755240441,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774500603815183863,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774500604836923368,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774500606272510338,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774500606284927834,"ephemeral":false,"proof":""}]'
2026-03-26 04:50:38.165 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '8289', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-26 04:50:38.177 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '8289', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-26 04:50:38.189 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '8289', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'loss', '50.0%', '75.0%']
2026-03-26 04:50:38.200 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25801/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:50:38.203 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[]'
2026-03-26 04:50:38.203 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54948/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-26 04:50:57.960 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-26 04:50:57.960 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54948/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-26 04:51:09.360 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-26 04:51:09.360 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54948/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-26 04:51:13.446 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-26 04:51:13.447 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54948/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-26 04:51:33.715 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-26 04:51:33.716 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-26 04:51:33.716 DEBUG [src.node.waku_node] Stopping container with id 4afa45d29a0c
2026-03-26 04:51:34.304 DEBUG [src.node.waku_node] Container stopped.
2026-03-26 04:51:34.307 DEBUG [src.node.waku_node] Stopping container with id d8ad055edb4e
2026-03-26 04:51:34.855 DEBUG [src.node.waku_node] Container stopped.
2026-03-26 04:51:34.855 DEBUG [src.node.waku_node] Stopping container with id 8a874a049539
2026-03-26 04:51:35.119 ERROR [src.node.docker_mananger] Max retries reached for container 4afa45d29a0c. Exiting log stream.
2026-03-26 04:51:35.399 DEBUG [src.node.waku_node] Container stopped.
2026-03-26 04:51:35.399 DEBUG [src.node.waku_node] Stopping container with id 9f136348db4f
2026-03-26 04:51:35.670 ERROR [src.node.docker_mananger] Max retries reached for container d8ad055edb4e. Exiting log stream.
2026-03-26 04:51:35.954 DEBUG [src.node.waku_node] Container stopped.
2026-03-26 04:51:35.958 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-26 04:51:36.041 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-26 04:51:36.122 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-26 04:51:36.206 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-26 04:51:36.289 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-26 04:51:36.291 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-26 04:51:36.292 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-26 04:51:36.292 DEBUG [src.libs.common] Attaching file ./log/docker/node4_2026-03-26_04-49-37__25816950-ea28-4cf7-92cc-31b041a53392__wakuorg_nwaku:latest.log
2026-03-26 04:51:36.294 DEBUG [src.libs.common] Attaching file ./log/docker/node3_2026-03-26_04-49-37__25816950-ea28-4cf7-92cc-31b041a53392__wakuorg_nwaku:latest.log
2026-03-26 04:51:36.296 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-26_04-49-37__25816950-ea28-4cf7-92cc-31b041a53392__wakuorg_nwaku:latest.log
2026-03-26 04:51:36.299 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-26_04-49-37__25816950-ea28-4cf7-92cc-31b041a53392__wakuorg_nwaku:latest.log
2026-03-26 04:51:36.304 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-26 04:51:36.304 DEBUG [tests.conftest] Running test: test_relay_packet_loss_correlated_vs_uncorrelated with id: 2026-03-26_04-51-36__a477e491-3032-4bc4-a17d-64ba58e55a00
2026-03-26 04:51:36.304 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-26 04:51:36.304 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-26 04:51:36.312 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-26 04:51:36.312 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-26_04-51-36__a477e491-3032-4bc4-a17d-64ba58e55a00__wakuorg_nwaku:latest.log
2026-03-26 04:51:36.320 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-26 04:51:36.320 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-26_04-51-36__a477e491-3032-4bc4-a17d-64ba58e55a00__wakuorg_nwaku:latest.log
2026-03-26 04:51:36.326 ERROR [src.node.docker_mananger] Max retries reached for container 8a874a049539. Exiting log stream.
2026-03-26 04:51:36.328 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-26 04:51:36.328 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-26_04-51-36__a477e491-3032-4bc4-a17d-64ba58e55a00__wakuorg_nwaku:latest.log
2026-03-26 04:51:36.334 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-26 04:51:36.334 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-26_04-51-36__a477e491-3032-4bc4-a17d-64ba58e55a00__wakuorg_nwaku:latest.log
2026-03-26 04:51:36.335 DEBUG [src.node.waku_node] Starting Node...
2026-03-26 04:51:36.335 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-26 04:51:36.336 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-26 04:51:36.336 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.253.139
2026-03-26 04:51:36.337 DEBUG [src.node.docker_mananger] Generated ports ['1681', '1682', '1683', '1684', '1685']
2026-03-26 04:51:36.337 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-26 04:51:36.337 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-26 04:51:36.337 DEBUG [src.node.waku_node] Using volumes []
2026-03-26 04:51:36.337 DEBUG [src.node.docker_mananger] docker run -i -t -p 1681:1681 -p 1682:1682 -p 1683:1683 -p 1684:1684 -p 1685:1685 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=1683 --rest-port=1681 --tcp-port=1682 --discv5-udp-port=1684 --rest-address=0.0.0.0 --nat=extip:172.18.253.139 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=bd04d2ffcbec5e3cceadca43fd18d8e548c2cc2efecc7e7da3721eada40fe3da --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=1685 --metrics-logging=true --relay=true
2026-03-26 04:51:36.536 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.253.139 waku b3f35a2feed001e6a6ce4adc93bab5c009297925bdee2576631430c9079a524e
2026-03-26 04:51:36.572 DEBUG [src.node.docker_mananger] Container started with ID b3f35a2feed0. Setting up logs at ./log/docker/node1_2026-03-26_04-51-36__a477e491-3032-4bc4-a17d-64ba58e55a00__wakuorg_nwaku:latest.log
2026-03-26 04:51:36.573 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 1681
2026-03-26 04:51:36.575 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-26 04:51:36.900 ERROR [src.node.docker_mananger] Max retries reached for container 9f136348db4f. Exiting log stream.
2026-03-26 04:51:37.575 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1681/health" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:51:37.578 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-26 04:51:37.578 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-26 04:51:37.579 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1681/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:51:37.581 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.253.139/tcp/1682/p2p/16Uiu2HAmM4tEcTHUVpfuQsxZhPrNiJEPkYF7QQ9uwHSJs5FztshJ","/ip4/172.18.253.139/tcp/1683/ws/p2p/16Uiu2HAmM4tEcTHUVpfuQsxZhPrNiJEPkYF7QQ9uwHSJs5FztshJ"],"enrUri":"enr:-L24QOfdJS3GuEBdTDoqFYV7Yn_AH-2Q6n5yO6NKCuV3Jf0UTO5WJPSuk-gENPpvPoK5_WD8pM3qeIk6tE8LEJuMVm8CgmlkgnY0gmlwhKwS_YuKbXVsdGlhZGRyc5YACASsEv2LBgaSAAoErBL9iwYGk90DgnJzhQADAQAAiXNlY3AyNTZrMaEDfPyFOoLIwxyQlppfQZrfQ0SHu9bZp_qoBkKdLlm4mHGDdGNwggaSg3VkcIIGlIV3YWt1MgE"}'
2026-03-26 04:51:37.581 INFO [src.node.waku_node] REST service is ready !!
2026-03-26 04:51:37.581 DEBUG [src.node.waku_node] Starting Node...
2026-03-26 04:51:37.581 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-26 04:51:37.583 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-26 04:51:37.583 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.200.206
2026-03-26 04:51:37.583 DEBUG [src.node.docker_mananger] Generated ports ['37010', '37011', '37012', '37013', '37014']
2026-03-26 04:51:37.583 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-26 04:51:37.583 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-26 04:51:37.584 DEBUG [src.node.waku_node] Using volumes []
2026-03-26 04:51:37.584 DEBUG [src.node.docker_mananger] docker run -i -t -p 37010:37010 -p 37011:37011 -p 37012:37012 -p 37013:37013 -p 37014:37014 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=37012 --rest-port=37010 --tcp-port=37011 --discv5-udp-port=37013 --rest-address=0.0.0.0 --nat=extip:172.18.200.206 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=f40b387dd069fe681f4f5f62c1ba4fbe156046b98362c5a5b8666c5fac5f0b9c --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=37014 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QOfdJS3GuEBdTDoqFYV7Yn_AH-2Q6n5yO6NKCuV3Jf0UTO5WJPSuk-gENPpvPoK5_WD8pM3qeIk6tE8LEJuMVm8CgmlkgnY0gmlwhKwS_YuKbXVsdGlhZGRyc5YACASsEv2LBgaSAAoErBL9iwYGk90DgnJzhQADAQAAiXNlY3AyNTZrMaEDfPyFOoLIwxyQlppfQZrfQ0SHu9bZp_qoBkKdLlm4mHGDdGNwggaSg3VkcIIGlIV3YWt1MgE
2026-03-26 04:51:37.787 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.200.206 waku 9eefc64abab1738a4355bd366f242e338d7c31ac045a14dc83b59314d6a0b3ba
2026-03-26 04:51:37.823 DEBUG [src.node.docker_mananger] Container started with ID 9eefc64abab1. Setting up logs at ./log/docker/node2_2026-03-26_04-51-36__a477e491-3032-4bc4-a17d-64ba58e55a00__wakuorg_nwaku:latest.log
2026-03-26 04:51:37.823 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 37010
2026-03-26 04:51:37.823 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-26 04:51:38.824 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37010/health" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:51:38.848 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-26 04:51:38.850 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-26 04:51:38.851 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37010/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:51:38.860 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.200.206/tcp/37011/p2p/16Uiu2HAmEGnYq26oSrieE8fyS99r3hwkPsMXxieVhmVzHxNtczHx","/ip4/172.18.200.206/tcp/37012/ws/p2p/16Uiu2HAmEGnYq26oSrieE8fyS99r3hwkPsMXxieVhmVzHxNtczHx"],"enrUri":"enr:-L24QEcZ2fx34oIXlYCA3j_6f_eCZjE0wmetaiiGzBmdUFMxGtBjkojTNqOi9Dhbe4rRaiwx2ONnyv_sHq4tx76FEbQCgmlkgnY0gmlwhKwSyM6KbXVsdGlhZGRyc5YACASsEsjOBpCTAAoErBLIzgaQlN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDGAdAp6wVpFTvxc9A0v6nafjBKCtykZvXhLq9BF9RJWODdGNwgpCTg3VkcIKQlYV3YWt1MgE"}'
2026-03-26 04:51:38.861 INFO [src.node.waku_node] REST service is ready !!
2026-03-26 04:51:38.861 DEBUG [src.node.waku_node] Starting Node...
2026-03-26 04:51:38.861 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-26 04:51:38.867 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-26 04:51:38.867 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.36.97
2026-03-26 04:51:38.867 DEBUG [src.node.docker_mananger] Generated ports ['64290', '64291', '64292', '64293', '64294']
2026-03-26 04:51:38.867 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-26 04:51:38.867 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-26 04:51:38.868 DEBUG [src.node.waku_node] Using volumes []
2026-03-26 04:51:38.868 DEBUG [src.node.docker_mananger] docker run -i -t -p 64290:64290 -p 64291:64291 -p 64292:64292 -p 64293:64293 -p 64294:64294 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=64292 --rest-port=64290 --tcp-port=64291 --discv5-udp-port=64293 --rest-address=0.0.0.0 --nat=extip:172.18.36.97 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=daa49f2c6bafa05e3bd9dc29cd68eaf067dfb0155e7dc0e73e22ea7edae06a61 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=64294 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QEcZ2fx34oIXlYCA3j_6f_eCZjE0wmetaiiGzBmdUFMxGtBjkojTNqOi9Dhbe4rRaiwx2ONnyv_sHq4tx76FEbQCgmlkgnY0gmlwhKwSyM6KbXVsdGlhZGRyc5YACASsEsjOBpCTAAoErBLIzgaQlN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDGAdAp6wVpFTvxc9A0v6nafjBKCtykZvXhLq9BF9RJWODdGNwgpCTg3VkcIKQlYV3YWt1MgE
2026-03-26 04:51:39.060 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.36.97 waku 2a69e3cca205fb692eadc194eade3fd7aa05454bab38c184db1f83204057ca57
2026-03-26 04:51:39.099 DEBUG [src.node.docker_mananger] Container started with ID 2a69e3cca205. Setting up logs at ./log/docker/node3_2026-03-26_04-51-36__a477e491-3032-4bc4-a17d-64ba58e55a00__wakuorg_nwaku:latest.log
2026-03-26 04:51:39.100 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 64290
2026-03-26 04:51:39.100 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-26 04:51:40.101 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64290/health" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:51:40.120 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-26 04:51:40.121 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-26 04:51:40.122 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64290/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:51:40.128 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.36.97/tcp/64291/p2p/16Uiu2HAmHKx9wT7iDef8zuoJG1nbjz21qtm5RoN91cqMsA76h7kz","/ip4/172.18.36.97/tcp/64292/ws/p2p/16Uiu2HAmHKx9wT7iDef8zuoJG1nbjz21qtm5RoN91cqMsA76h7kz"],"enrUri":"enr:-L24QB7A3wJl_wFtdWwMAmeKl_RPY2agSekn43MTi9VY006xXXn5YOb2OHGmyaWDZet4QZ7zjm7S73xL6KcIgdvVbnECgmlkgnY0gmlwhKwSJGGKbXVsdGlhZGRyc5YACASsEiRhBvsjAAoErBIkYQb7JN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDRWnqpP0Gy6BGupXlWCtrUGfhx1vkQ-q-m8-0AUZ3t1-DdGNwgvsjg3VkcIL7JYV3YWt1MgE"}'
2026-03-26 04:51:40.128 INFO [src.node.waku_node] REST service is ready !!
2026-03-26 04:51:40.128 DEBUG [src.node.waku_node] Starting Node...
2026-03-26 04:51:40.129 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-26 04:51:40.130 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-26 04:51:40.130 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.152.141
2026-03-26 04:51:40.130 DEBUG [src.node.docker_mananger] Generated ports ['61494', '61495', '61496', '61497', '61498']
2026-03-26 04:51:40.131 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-26 04:51:40.131 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-26 04:51:40.131 DEBUG [src.node.waku_node] Using volumes []
2026-03-26 04:51:40.131 DEBUG [src.node.docker_mananger] docker run -i -t -p 61494:61494 -p 61495:61495 -p 61496:61496 -p 61497:61497 -p 61498:61498 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=61496 --rest-port=61494 --tcp-port=61495 --discv5-udp-port=61497 --rest-address=0.0.0.0 --nat=extip:172.18.152.141 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=eada040da543fdcd76fa9787e5125aad198eae0b7efe6ab18d25eea8dca38bd5 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=61498 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QB7A3wJl_wFtdWwMAmeKl_RPY2agSekn43MTi9VY006xXXn5YOb2OHGmyaWDZet4QZ7zjm7S73xL6KcIgdvVbnECgmlkgnY0gmlwhKwSJGGKbXVsdGlhZGRyc5YACASsEiRhBvsjAAoErBIkYQb7JN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDRWnqpP0Gy6BGupXlWCtrUGfhx1vkQ-q-m8-0AUZ3t1-DdGNwgvsjg3VkcIL7JYV3YWt1MgE
2026-03-26 04:51:40.337 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.152.141 waku cef3b627c8392f8fc4b9216ae20e3fcf1ce447edb87213660bbdd30550819919
2026-03-26 04:51:40.373 DEBUG [src.node.docker_mananger] Container started with ID cef3b627c839. Setting up logs at ./log/docker/node4_2026-03-26_04-51-36__a477e491-3032-4bc4-a17d-64ba58e55a00__wakuorg_nwaku:latest.log
2026-03-26 04:51:40.374 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 61494
2026-03-26 04:51:40.374 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-26 04:51:41.375 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61494/health" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:51:41.386 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-26 04:51:41.387 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-26 04:51:41.387 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61494/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:51:41.395 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.152.141/tcp/61495/p2p/16Uiu2HAmJ6WvQ5gNTNgnTUBVxLpKM3R2A9uZWVVT2Zr7LnhFgSKy","/ip4/172.18.152.141/tcp/61496/ws/p2p/16Uiu2HAmJ6WvQ5gNTNgnTUBVxLpKM3R2A9uZWVVT2Zr7LnhFgSKy"],"enrUri":"enr:-L24QL5wzpnqNH5q6Cux05cUVBzQWV4RDTa_MzEr2-aX8VzeS92eQWyW8gwKtt1omck3oON9csYVKV5LXQCb7uVoRV4CgmlkgnY0gmlwhKwSmI2KbXVsdGlhZGRyc5YACASsEpiNBvA3AAoErBKYjQbwON0DgnJzhQADAQAAiXNlY3AyNTZrMaEDUNSFe9VsbuYc-Zesa8mNrt1uY0UiWoHZEXG4eHlkCYiDdGNwgvA3g3VkcILwOYV3YWt1MgE"}'
2026-03-26 04:51:41.396 INFO [src.node.waku_node] REST service is ready !!
2026-03-26 04:51:41.396 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1681/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-26 04:51:41.401 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-26 04:51:41.401 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37010/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-26 04:51:41.412 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-26 04:51:41.412 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:64290/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-26 04:51:41.419 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-26 04:51:41.423 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61494/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-26 04:51:41.431 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-26 04:51:41.432 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1681/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:51:41.435 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.200.206/tcp/57816/p2p/16Uiu2HAmEGnYq26oSrieE8fyS99r3hwkPsMXxieVhmVzHxNtczHx","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-12-g0b8609","origin":"UnknownOrigin"}]'
2026-03-26 04:51:41.436 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37010/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:51:41.439 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.36.97/tcp/51358/p2p/16Uiu2HAmHKx9wT7iDef8zuoJG1nbjz21qtm5RoN91cqMsA76h7kz","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-12-g0b8609","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.253.139/tcp/1682/p2p/16Uiu2HAmM4tEcTHUVpfuQsxZhPrNiJEPkYF7QQ9uwHSJs5FztshJ","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-12-g0b8609","origin":"Discv5"}]'
2026-03-26 04:51:41.439 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64290/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:51:41.442 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.152.141/tcp/46284/p2p/16Uiu2HAmJ6WvQ5gNTNgnTUBVxLpKM3R2A9uZWVVT2Zr7LnhFgSKy","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-12-g0b8609","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.200.206/tcp/37011/p2p/16Uiu2HAmEGnYq26oSrieE8fyS99r3hwkPsMXxieVhmVzHxNtczHx","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-12-g0b8609","origin":"Discv5"}]'
2026-03-26 04:51:41.442 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61494/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:51:41.444 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.36.97/tcp/64291/p2p/16Uiu2HAmHKx9wT7iDef8zuoJG1nbjz21qtm5RoN91cqMsA76h7kz","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-12-g0b8609","origin":"Discv5"}]'
2026-03-26 04:51:41.445 DEBUG [src.libs.common] Sleeping for 20 seconds
2026-03-26 04:52:01.447 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '10127', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-26 04:52:01.458 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '10127', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'loss', '50.0%']
2026-03-26 04:52:01.469 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '10127', '-n', 'tc', '-s', 'qdisc', 'show', 'dev', 'eth0']
2026-03-26 04:52:01.478 DEBUG [src.steps.network_conditions] tc -s qdisc show dev eth0:
qdisc netem 8004: root refcnt 5 limit 1000 loss 50%
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
2026-03-26 04:52:01.479 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61494/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:52:01.481 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[]'
2026-03-26 04:52:01.482 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1681/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-26 04:52:02.944 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-26 04:52:02.944 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1681/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-26 04:52:04.623 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-26 04:52:04.624 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1681/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-26 04:52:04.635 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-26 04:52:04.636 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1681/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-26 04:52:04.660 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-26 04:52:04.662 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1681/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-26 04:52:05.935 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-26 04:52:05.936 DEBUG [src.libs.common] Sleeping for 30.0 seconds
2026-03-26 04:52:35.936 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61494/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:52:35.939 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774500721481940508,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774500722944627958,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774500724624251394,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774500724636537792,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774500724662505334,"ephemeral":false,"proof":""}]'
2026-03-26 04:52:35.941 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '10127', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-26 04:52:35.953 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '10127', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-26 04:52:35.965 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '10127', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'loss', '50.0%', '75.0%']
2026-03-26 04:52:35.975 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61494/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:52:35.978 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[]'
2026-03-26 04:52:35.978 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1681/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-26 04:52:41.376 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-26 04:52:41.376 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1681/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-26 04:52:41.386 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-26 04:52:41.390 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1681/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-26 04:52:41.608 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-26 04:52:41.608 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1681/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-26 04:52:44.320 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-26 04:52:44.320 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1681/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-26 04:53:04.112 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-26 04:53:04.112 DEBUG [src.libs.common] Sleeping for 30.0 seconds
2026-03-26 04:53:34.112 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61494/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:53:34.115 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774500755978793883,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774500761376761350,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774500761390186591,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774500761608479124,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774500764320727967,"ephemeral":false,"proof":""}]'
2026-03-26 04:53:34.117 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '10127', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-26 04:53:34.127 DEBUG [tests.e2e.test_network_conditions] uncorrelated=5 correlated=5
2026-03-26 04:53:34.128 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-26 04:53:34.129 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-26 04:53:34.130 DEBUG [src.node.waku_node] Stopping container with id b3f35a2feed0
2026-03-26 04:53:34.720 DEBUG [src.node.waku_node] Container stopped.
2026-03-26 04:53:34.721 DEBUG [src.node.waku_node] Stopping container with id 9eefc64abab1
2026-03-26 04:53:35.340 DEBUG [src.node.waku_node] Container stopped.
2026-03-26 04:53:35.343 DEBUG [src.node.waku_node] Stopping container with id 2a69e3cca205
2026-03-26 04:53:35.539 ERROR [src.node.docker_mananger] Max retries reached for container b3f35a2feed0. Exiting log stream.
2026-03-26 04:53:35.915 DEBUG [src.node.waku_node] Container stopped.
2026-03-26 04:53:35.916 DEBUG [src.node.waku_node] Stopping container with id cef3b627c839
2026-03-26 04:53:36.155 ERROR [src.node.docker_mananger] Max retries reached for container 9eefc64abab1. Exiting log stream.
2026-03-26 04:53:36.489 DEBUG [src.node.waku_node] Container stopped.
2026-03-26 04:53:36.491 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-26 04:53:36.577 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-26 04:53:36.668 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-26 04:53:36.751 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-26 04:53:36.836 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
Reference in New Issue View Git Blame Copy Permalink