logos-messaging/logos-messaging-interop-tests
1
0
Fork 0
mirror of https://github.com/logos-messaging/logos-messaging-interop-tests.git synced 2026-05-05 18:09:25 +00:00
Code Issues Packages Projects Releases Wiki Activity
logos-messaging-interop-tests/nim/1104/data/attachments/cb2aaeb2493dac71.txt

330 lines
66 KiB
Plaintext
Raw Blame History

2026-03-05 04:34:50.140 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-05 04:34:50.140 DEBUG [tests.conftest] Running test: test_relay_packet_loss_correlated_vs_uncorrelated with id: 2026-03-05_04-34-50__0ccf0f26-0cbc-4a58-a87e-dcfe61b61175
2026-03-05 04:34:50.141 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-05 04:34:50.141 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-05 04:34:50.148 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:34:50.148 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-05_04-34-50__0ccf0f26-0cbc-4a58-a87e-dcfe61b61175__wakuorg_nwaku:latest.log
2026-03-05 04:34:50.155 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:34:50.155 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-05_04-34-50__0ccf0f26-0cbc-4a58-a87e-dcfe61b61175__wakuorg_nwaku:latest.log
2026-03-05 04:34:50.161 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:34:50.162 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-05_04-34-50__0ccf0f26-0cbc-4a58-a87e-dcfe61b61175__wakuorg_nwaku:latest.log
2026-03-05 04:34:50.168 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:34:50.168 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-05_04-34-50__0ccf0f26-0cbc-4a58-a87e-dcfe61b61175__wakuorg_nwaku:latest.log
2026-03-05 04:34:50.168 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:34:50.168 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:34:50.170 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:34:50.170 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.87.147
2026-03-05 04:34:50.170 DEBUG [src.node.docker_mananger] Generated ports ['16985', '16986', '16987', '16988', '16989']
2026-03-05 04:34:50.170 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:34:50.170 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:34:50.170 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:34:50.170 DEBUG [src.node.docker_mananger] docker run -i -t -p 16985:16985 -p 16986:16986 -p 16987:16987 -p 16988:16988 -p 16989:16989 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=16987 --rest-port=16985 --tcp-port=16986 --discv5-udp-port=16988 --rest-address=0.0.0.0 --nat=extip:172.18.87.147 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=aa700df48ea6541cd7a5afefeb2c95e3bf77971d7b710ee80fcbf3a5025caa80 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=16989 --metrics-logging=true --relay=true
2026-03-05 04:34:50.358 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.87.147 waku db104bb4c5e8332a685d40bc5db31712e58cd4180d372f2b4f41ecb823ebd2aa
2026-03-05 04:34:50.391 DEBUG [src.node.docker_mananger] Container started with ID db104bb4c5e8. Setting up logs at ./log/docker/node1_2026-03-05_04-34-50__0ccf0f26-0cbc-4a58-a87e-dcfe61b61175__wakuorg_nwaku:latest.log
2026-03-05 04:34:50.393 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 16985
2026-03-05 04:34:50.393 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:34:50.394 ERROR [src.node.docker_mananger] Max retries reached for container b56b508006af. Exiting log stream.
2026-03-05 04:34:50.910 ERROR [src.node.docker_mananger] Max retries reached for container 5a39f862aa41. Exiting log stream.
2026-03-05 04:34:51.395 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:16985/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:51.398 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:34:51.399 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:34:51.399 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:16985/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:51.401 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.87.147/tcp/16986/p2p/16Uiu2HAmVjTZgMjt6Mtbhgv4RpPoCLa6N6UFTiBd5YJcpSUY2DCP","/ip4/172.18.87.147/tcp/16987/ws/p2p/16Uiu2HAmVjTZgMjt6Mtbhgv4RpPoCLa6N6UFTiBd5YJcpSUY2DCP"],"enrUri":"enr:-L24QJ_ucnp_qoCFOsKbp2lr92AXX0_pdVH7Qs329l9QT2P8IDGkui8SisWq9VYStBrc8F2XpoFx-gYnPs727dIXtIICgmlkgnY0gmlwhKwSV5OKbXVsdGlhZGRyc5YACASsEleTBkJaAAoErBJXkwZCW90DgnJzhQADAQAAiXNlY3AyNTZrMaED_bvFge_ZRirkv4vRacxJRgcJBEvhIrABo96OCmZdmfyDdGNwgkJag3VkcIJCXIV3YWt1MgE"}'
2026-03-05 04:34:51.401 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:34:51.401 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:34:51.402 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:34:51.403 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:34:51.403 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.190.145
2026-03-05 04:34:51.403 DEBUG [src.node.docker_mananger] Generated ports ['14735', '14736', '14737', '14738', '14739']
2026-03-05 04:34:51.403 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:34:51.404 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:34:51.404 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:34:51.404 DEBUG [src.node.docker_mananger] docker run -i -t -p 14735:14735 -p 14736:14736 -p 14737:14737 -p 14738:14738 -p 14739:14739 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=14737 --rest-port=14735 --tcp-port=14736 --discv5-udp-port=14738 --rest-address=0.0.0.0 --nat=extip:172.18.190.145 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=5717b5945a8e1c1e420766bb33d9bee67955bc2d176ddcbdfdbfbbd6a70beff8 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=14739 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QJ_ucnp_qoCFOsKbp2lr92AXX0_pdVH7Qs329l9QT2P8IDGkui8SisWq9VYStBrc8F2XpoFx-gYnPs727dIXtIICgmlkgnY0gmlwhKwSV5OKbXVsdGlhZGRyc5YACASsEleTBkJaAAoErBJXkwZCW90DgnJzhQADAQAAiXNlY3AyNTZrMaED_bvFge_ZRirkv4vRacxJRgcJBEvhIrABo96OCmZdmfyDdGNwgkJag3VkcIJCXIV3YWt1MgE
2026-03-05 04:34:51.598 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.190.145 waku c420507e4d572eb770fe1afadae8ef4ce946e574ff01929f449d6f39816630f4
2026-03-05 04:34:51.632 DEBUG [src.node.docker_mananger] Container started with ID c420507e4d57. Setting up logs at ./log/docker/node2_2026-03-05_04-34-50__0ccf0f26-0cbc-4a58-a87e-dcfe61b61175__wakuorg_nwaku:latest.log
2026-03-05 04:34:51.632 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 14735
2026-03-05 04:34:51.632 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:34:52.635 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14735/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:52.662 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:34:52.665 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:34:52.668 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14735/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:52.672 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.190.145/tcp/14736/p2p/16Uiu2HAmA9U4VRZr5iRY7NDJof4vkiUQvKTAo5vDf1riMboMHYDo","/ip4/172.18.190.145/tcp/14737/ws/p2p/16Uiu2HAmA9U4VRZr5iRY7NDJof4vkiUQvKTAo5vDf1riMboMHYDo"],"enrUri":"enr:-L24QJlRuSe4zx6h0ChTFJuJ1X6Q_mJzypgl8qnksXcAYUhWCDm1tpk55IEiHRdzMEEwIQZgttGCI5HjLhfv-CqQWuECgmlkgnY0gmlwhKwSvpGKbXVsdGlhZGRyc5YACASsEr6RBjmQAAoErBK-kQY5kd0DgnJzhQADAQAAiXNlY3AyNTZrMaEC2riIuY5J1GIm0MD9PZx0yznPHk7af0bU_csFCJ4DvkKDdGNwgjmQg3VkcII5koV3YWt1MgE"}'
2026-03-05 04:34:52.672 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:34:52.672 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:34:52.673 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:34:52.675 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:34:52.675 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.240.175
2026-03-05 04:34:52.675 DEBUG [src.node.docker_mananger] Generated ports ['42914', '42915', '42916', '42917', '42918']
2026-03-05 04:34:52.676 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:34:52.676 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:34:52.676 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:34:52.676 DEBUG [src.node.docker_mananger] docker run -i -t -p 42914:42914 -p 42915:42915 -p 42916:42916 -p 42917:42917 -p 42918:42918 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=42916 --rest-port=42914 --tcp-port=42915 --discv5-udp-port=42917 --rest-address=0.0.0.0 --nat=extip:172.18.240.175 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=840dc4a4eec6cd7adcab97e72bc61ee6009243bf4bacec9ebffcee7eebfee33b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=42918 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QJlRuSe4zx6h0ChTFJuJ1X6Q_mJzypgl8qnksXcAYUhWCDm1tpk55IEiHRdzMEEwIQZgttGCI5HjLhfv-CqQWuECgmlkgnY0gmlwhKwSvpGKbXVsdGlhZGRyc5YACASsEr6RBjmQAAoErBK-kQY5kd0DgnJzhQADAQAAiXNlY3AyNTZrMaEC2riIuY5J1GIm0MD9PZx0yznPHk7af0bU_csFCJ4DvkKDdGNwgjmQg3VkcII5koV3YWt1MgE
2026-03-05 04:34:52.882 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.240.175 waku 75b794054056a8b432a810bf13c6b5f858f7b109392cbb39c69af4ca89d60003
2026-03-05 04:34:52.917 DEBUG [src.node.docker_mananger] Container started with ID 75b794054056. Setting up logs at ./log/docker/node3_2026-03-05_04-34-50__0ccf0f26-0cbc-4a58-a87e-dcfe61b61175__wakuorg_nwaku:latest.log
2026-03-05 04:34:52.917 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 42914
2026-03-05 04:34:52.917 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:34:53.919 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42914/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:53.933 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:34:53.936 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:34:53.938 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42914/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:53.941 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.240.175/tcp/42915/p2p/16Uiu2HAm2T6KVAw9HgjW5j1Q6rZnXjVpW5DHwJWVFejKB3EDcg1e","/ip4/172.18.240.175/tcp/42916/ws/p2p/16Uiu2HAm2T6KVAw9HgjW5j1Q6rZnXjVpW5DHwJWVFejKB3EDcg1e"],"enrUri":"enr:-L24QKZ31rMDLLsYortSuf7RDUJ-FY5s7c1zwFHEkjoL41rPJY3pKapxf56AKFMFqH7_4vZZbTw_0hpkW7SucQSSZfwCgmlkgnY0gmlwhKwS8K-KbXVsdGlhZGRyc5YACASsEvCvBqejAAoErBLwrwanpN0DgnJzhQADAQAAiXNlY3AyNTZrMaECaF7o-90KYBzT15aDThPeGxDezttRQ6ZNfwGSUmknWXmDdGNwgqejg3VkcIKnpYV3YWt1MgE"}'
2026-03-05 04:34:53.942 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:34:53.945 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:34:53.945 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:34:53.947 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:34:53.947 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.216.185
2026-03-05 04:34:53.947 DEBUG [src.node.docker_mananger] Generated ports ['33725', '33726', '33727', '33728', '33729']
2026-03-05 04:34:53.948 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:34:53.948 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:34:53.948 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:34:53.948 DEBUG [src.node.docker_mananger] docker run -i -t -p 33725:33725 -p 33726:33726 -p 33727:33727 -p 33728:33728 -p 33729:33729 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=33727 --rest-port=33725 --tcp-port=33726 --discv5-udp-port=33728 --rest-address=0.0.0.0 --nat=extip:172.18.216.185 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ecbebace1c3bdbebf7c3cac3b4eb1acd9827f43cafdb9ac86d6dcb9acbfdf2c4 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=33729 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QKZ31rMDLLsYortSuf7RDUJ-FY5s7c1zwFHEkjoL41rPJY3pKapxf56AKFMFqH7_4vZZbTw_0hpkW7SucQSSZfwCgmlkgnY0gmlwhKwS8K-KbXVsdGlhZGRyc5YACASsEvCvBqejAAoErBLwrwanpN0DgnJzhQADAQAAiXNlY3AyNTZrMaECaF7o-90KYBzT15aDThPeGxDezttRQ6ZNfwGSUmknWXmDdGNwgqejg3VkcIKnpYV3YWt1MgE
2026-03-05 04:34:54.144 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.216.185 waku b3c08e9c52cb1380e71ade5d727d0b82c155a6ce5cd58d89064e957b6e31aa9a
2026-03-05 04:34:54.182 DEBUG [src.node.docker_mananger] Container started with ID b3c08e9c52cb. Setting up logs at ./log/docker/node4_2026-03-05_04-34-50__0ccf0f26-0cbc-4a58-a87e-dcfe61b61175__wakuorg_nwaku:latest.log
2026-03-05 04:34:54.182 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 33725
2026-03-05 04:34:54.183 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:34:55.184 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:33725/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:55.202 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:34:55.205 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:34:55.206 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:33725/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:55.212 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.216.185/tcp/33726/p2p/16Uiu2HAmD6XjFsRnkewnPr2YvYtFDdXAWbCWnmCrWtLNTxbCRXie","/ip4/172.18.216.185/tcp/33727/ws/p2p/16Uiu2HAmD6XjFsRnkewnPr2YvYtFDdXAWbCWnmCrWtLNTxbCRXie"],"enrUri":"enr:-L24QAwJOzHtfOiBDPhWkToXPU4HO93WKxnQc2Np6QPXWwIfe4gmvQ3gA2MlZ0g4PKvPYFKU4oXsJnQYi4BKvdyoyHkCgmlkgnY0gmlwhKwS2LmKbXVsdGlhZGRyc5YACASsEti5BoO-AAoErBLYuQaDv90DgnJzhQADAQAAiXNlY3AyNTZrMaEDBosAEu8V--SS3VurK7rs9LaBd6WVFUDKjbBEEhCdBheDdGNwgoO-g3VkcIKDwIV3YWt1MgE"}'
2026-03-05 04:34:55.214 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:34:55.214 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:16985/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-05 04:34:55.218 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:34:55.219 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14735/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-05 04:34:55.229 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:34:55.231 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:42914/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-05 04:34:55.238 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:34:55.239 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33725/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-05 04:34:55.247 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:34:55.249 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:16985/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:55.252 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.190.145/tcp/48036/p2p/16Uiu2HAmA9U4VRZr5iRY7NDJof4vkiUQvKTAo5vDf1riMboMHYDo","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"UnknownOrigin"}]'
2026-03-05 04:34:55.253 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14735/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:55.255 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.87.147/tcp/16986/p2p/16Uiu2HAmVjTZgMjt6Mtbhgv4RpPoCLa6N6UFTiBd5YJcpSUY2DCP","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"Discv5"},{"multiaddr":"/ip4/172.18.240.175/tcp/35840/p2p/16Uiu2HAm2T6KVAw9HgjW5j1Q6rZnXjVpW5DHwJWVFejKB3EDcg1e","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"UnknownOrigin"}]'
2026-03-05 04:34:55.255 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42914/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:55.257 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.216.185/tcp/34720/p2p/16Uiu2HAmD6XjFsRnkewnPr2YvYtFDdXAWbCWnmCrWtLNTxbCRXie","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.190.145/tcp/14736/p2p/16Uiu2HAmA9U4VRZr5iRY7NDJof4vkiUQvKTAo5vDf1riMboMHYDo","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"Discv5"}]'
2026-03-05 04:34:55.258 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:33725/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:55.260 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.240.175/tcp/42915/p2p/16Uiu2HAm2T6KVAw9HgjW5j1Q6rZnXjVpW5DHwJWVFejKB3EDcg1e","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"Discv5"}]'
2026-03-05 04:34:55.260 DEBUG [src.libs.common] Sleeping for 20 seconds
2026-03-05 04:35:15.262 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '7546', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-05 04:35:15.274 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '7546', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'loss', '50.0%']
2026-03-05 04:35:15.285 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '7546', '-n', 'tc', '-s', 'qdisc', 'show', 'dev', 'eth0']
2026-03-05 04:35:15.294 DEBUG [src.steps.network_conditions] tc -s qdisc show dev eth0:
qdisc netem 8002: root refcnt 5 limit 1000 loss 50%
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
2026-03-05 04:35:15.294 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:33725/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:15.297 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[]'
2026-03-05 04:35:15.297 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:16985/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 04:35:15.306 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:35:15.308 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:16985/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 04:35:16.354 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:35:16.359 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:16985/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 04:35:16.378 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:35:16.379 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:16985/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 04:35:16.390 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:35:16.393 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:16985/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 04:35:16.407 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:35:16.410 DEBUG [src.libs.common] Sleeping for 30.0 seconds
2026-03-05 04:35:46.410 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:33725/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:46.413 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772685315297534234,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772685315308710998,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772685316359318739,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772685316379849257,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772685316393455879,"ephemeral":false,"proof":""}]'
2026-03-05 04:35:46.415 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '7546', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-05 04:35:46.426 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '7546', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-05 04:35:46.437 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '7546', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'loss', '50.0%', '75.0%']
2026-03-05 04:35:46.446 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:33725/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:46.448 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[]'
2026-03-05 04:35:46.449 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:16985/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 04:35:50.530 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:35:50.533 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:16985/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 04:36:10.778 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-05 04:36:10.779 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-05 04:36:10.779 DEBUG [src.node.waku_node] Stopping container with id db104bb4c5e8
2026-03-05 04:36:11.402 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:36:11.403 DEBUG [src.node.waku_node] Stopping container with id c420507e4d57
2026-03-05 04:36:11.958 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:36:11.959 DEBUG [src.node.waku_node] Stopping container with id 75b794054056
2026-03-05 04:36:12.214 ERROR [src.node.docker_mananger] Max retries reached for container db104bb4c5e8. Exiting log stream.
2026-03-05 04:36:12.502 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:36:12.505 DEBUG [src.node.waku_node] Stopping container with id b3c08e9c52cb
2026-03-05 04:36:12.771 ERROR [src.node.docker_mananger] Max retries reached for container c420507e4d57. Exiting log stream.
2026-03-05 04:36:13.059 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:36:13.062 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-05 04:36:13.127 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:36:13.192 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:36:13.252 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:36:13.308 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:36:13.309 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-05 04:36:13.310 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-05 04:36:13.311 DEBUG [src.libs.common] Attaching file ./log/docker/node3_2026-03-05_04-34-50__0ccf0f26-0cbc-4a58-a87e-dcfe61b61175__wakuorg_nwaku:latest.log
2026-03-05 04:36:13.312 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-05_04-34-50__0ccf0f26-0cbc-4a58-a87e-dcfe61b61175__wakuorg_nwaku:latest.log
2026-03-05 04:36:13.314 DEBUG [src.libs.common] Attaching file ./log/docker/node4_2026-03-05_04-34-50__0ccf0f26-0cbc-4a58-a87e-dcfe61b61175__wakuorg_nwaku:latest.log
2026-03-05 04:36:13.316 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-05_04-34-50__0ccf0f26-0cbc-4a58-a87e-dcfe61b61175__wakuorg_nwaku:latest.log
2026-03-05 04:36:13.320 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-05 04:36:13.320 DEBUG [tests.conftest] Running test: test_relay_packet_loss_correlated_vs_uncorrelated with id: 2026-03-05_04-36-13__97ca8228-441d-4e86-9a8b-9ce44a32dce8
2026-03-05 04:36:13.321 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-05 04:36:13.321 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-05 04:36:13.328 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:36:13.328 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-05_04-36-13__97ca8228-441d-4e86-9a8b-9ce44a32dce8__wakuorg_nwaku:latest.log
2026-03-05 04:36:13.334 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:36:13.334 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-05_04-36-13__97ca8228-441d-4e86-9a8b-9ce44a32dce8__wakuorg_nwaku:latest.log
2026-03-05 04:36:13.340 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:36:13.340 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-05_04-36-13__97ca8228-441d-4e86-9a8b-9ce44a32dce8__wakuorg_nwaku:latest.log
2026-03-05 04:36:13.346 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:36:13.346 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-05_04-36-13__97ca8228-441d-4e86-9a8b-9ce44a32dce8__wakuorg_nwaku:latest.log
2026-03-05 04:36:13.346 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:36:13.346 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:36:13.347 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:36:13.348 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.31.200
2026-03-05 04:36:13.348 DEBUG [src.node.docker_mananger] Generated ports ['2716', '2717', '2718', '2719', '2720']
2026-03-05 04:36:13.348 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:36:13.348 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:36:13.348 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:36:13.348 DEBUG [src.node.docker_mananger] docker run -i -t -p 2716:2716 -p 2717:2717 -p 2718:2718 -p 2719:2719 -p 2720:2720 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=2718 --rest-port=2716 --tcp-port=2717 --discv5-udp-port=2719 --rest-address=0.0.0.0 --nat=extip:172.18.31.200 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=db7ff29d252bdadc20b4079f188cd6f9feb3bca213b0deca62e3faabcc72ddcb --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=2720 --metrics-logging=true --relay=true
2026-03-05 04:36:13.456 ERROR [src.node.docker_mananger] Max retries reached for container 75b794054056. Exiting log stream.
2026-03-05 04:36:13.558 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.31.200 waku 714a7f5b37f3038b132bf8127c63d9d5d4444be10c9b1d74acca51db8ab89cb7
2026-03-05 04:36:13.591 DEBUG [src.node.docker_mananger] Container started with ID 714a7f5b37f3. Setting up logs at ./log/docker/node1_2026-03-05_04-36-13__97ca8228-441d-4e86-9a8b-9ce44a32dce8__wakuorg_nwaku:latest.log
2026-03-05 04:36:13.592 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 2716
2026-03-05 04:36:13.592 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:36:13.930 ERROR [src.node.docker_mananger] Max retries reached for container b3c08e9c52cb. Exiting log stream.
2026-03-05 04:36:14.593 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2716/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:14.596 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:36:14.596 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:36:14.596 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2716/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:14.599 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.31.200/tcp/2717/p2p/16Uiu2HAm6SR9gMSj9umrXZbtm2yMomwU75totY51P1P1RSkXCFZh","/ip4/172.18.31.200/tcp/2718/ws/p2p/16Uiu2HAm6SR9gMSj9umrXZbtm2yMomwU75totY51P1P1RSkXCFZh"],"enrUri":"enr:-L24QKNGHxY0pmhswcYxTiESsKdhDUojy5oBip3KIsKV2vn3dOepbv8By0EHMwj-sSCfsLbVTCglfJnM0QmZimGPiLICgmlkgnY0gmlwhKwSH8iKbXVsdGlhZGRyc5YACASsEh_IBgqdAAoErBIfyAYKnt0DgnJzhQADAQAAiXNlY3AyNTZrMaECo6Fegb8RscTmVNnVdoptUjfxMVhM89AoZVS3zgf1LRiDdGNwggqdg3VkcIIKn4V3YWt1MgE"}'
2026-03-05 04:36:14.599 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:36:14.599 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:36:14.599 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:36:14.600 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:36:14.601 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.236.234
2026-03-05 04:36:14.601 DEBUG [src.node.docker_mananger] Generated ports ['54404', '54405', '54406', '54407', '54408']
2026-03-05 04:36:14.601 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:36:14.601 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:36:14.601 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:36:14.601 DEBUG [src.node.docker_mananger] docker run -i -t -p 54404:54404 -p 54405:54405 -p 54406:54406 -p 54407:54407 -p 54408:54408 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=54406 --rest-port=54404 --tcp-port=54405 --discv5-udp-port=54407 --rest-address=0.0.0.0 --nat=extip:172.18.236.234 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=a8fcd9e5c5deb44a5c4d52feab31dbdfe2c4a86e5cdea219b5f42274a304ea3b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=54408 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QKNGHxY0pmhswcYxTiESsKdhDUojy5oBip3KIsKV2vn3dOepbv8By0EHMwj-sSCfsLbVTCglfJnM0QmZimGPiLICgmlkgnY0gmlwhKwSH8iKbXVsdGlhZGRyc5YACASsEh_IBgqdAAoErBIfyAYKnt0DgnJzhQADAQAAiXNlY3AyNTZrMaECo6Fegb8RscTmVNnVdoptUjfxMVhM89AoZVS3zgf1LRiDdGNwggqdg3VkcIIKn4V3YWt1MgE
2026-03-05 04:36:14.795 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.236.234 waku 2fb6d1830b02a210995a834ebdc3f7bedd5123299c1df745dc9ebbefb1ae18f0
2026-03-05 04:36:14.832 DEBUG [src.node.docker_mananger] Container started with ID 2fb6d1830b02. Setting up logs at ./log/docker/node2_2026-03-05_04-36-13__97ca8228-441d-4e86-9a8b-9ce44a32dce8__wakuorg_nwaku:latest.log
2026-03-05 04:36:14.832 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 54404
2026-03-05 04:36:14.832 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:36:15.832 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54404/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:15.847 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:36:15.847 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:36:15.849 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54404/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:15.855 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.236.234/tcp/54405/p2p/16Uiu2HAm51FUBDRvutWRraFyUzFUqxu19Tj4LFruDPykQfETo6Np","/ip4/172.18.236.234/tcp/54406/ws/p2p/16Uiu2HAm51FUBDRvutWRraFyUzFUqxu19Tj4LFruDPykQfETo6Np"],"enrUri":"enr:-L24QBX6OKpQlxc7l9ySsmZj1TVxAN0mrTAsIZJHZvxY72vEOC0R3wwzpztRNgMfcxqy9amQAQEHvdLSgqMaSTwSg3ECgmlkgnY0gmlwhKwS7OqKbXVsdGlhZGRyc5YACASsEuzqBtSFAAoErBLs6gbUht0DgnJzhQADAQAAiXNlY3AyNTZrMaECjlM3MLXudM30tRkf2hNF24mi6ut4JIT0BMkJ8bWYGJWDdGNwgtSFg3VkcILUh4V3YWt1MgE"}'
2026-03-05 04:36:15.856 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:36:15.856 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:36:15.856 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:36:15.860 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:36:15.860 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.185.126
2026-03-05 04:36:15.860 DEBUG [src.node.docker_mananger] Generated ports ['42915', '42916', '42917', '42918', '42919']
2026-03-05 04:36:15.860 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:36:15.861 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:36:15.861 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:36:15.861 DEBUG [src.node.docker_mananger] docker run -i -t -p 42915:42915 -p 42916:42916 -p 42917:42917 -p 42918:42918 -p 42919:42919 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=42917 --rest-port=42915 --tcp-port=42916 --discv5-udp-port=42918 --rest-address=0.0.0.0 --nat=extip:172.18.185.126 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=3fdb067c2ef0629f6ac3bcdd5bb5cfdec0edd1bea2b8e0ac7e01fec91dc6beba --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=42919 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QBX6OKpQlxc7l9ySsmZj1TVxAN0mrTAsIZJHZvxY72vEOC0R3wwzpztRNgMfcxqy9amQAQEHvdLSgqMaSTwSg3ECgmlkgnY0gmlwhKwS7OqKbXVsdGlhZGRyc5YACASsEuzqBtSFAAoErBLs6gbUht0DgnJzhQADAQAAiXNlY3AyNTZrMaECjlM3MLXudM30tRkf2hNF24mi6ut4JIT0BMkJ8bWYGJWDdGNwgtSFg3VkcILUh4V3YWt1MgE
2026-03-05 04:36:16.054 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.185.126 waku a8c5954fd6ae904c984115e166102bc0fe80427d05bf2f9e84e4e63d37c2b0ea
2026-03-05 04:36:16.087 DEBUG [src.node.docker_mananger] Container started with ID a8c5954fd6ae. Setting up logs at ./log/docker/node3_2026-03-05_04-36-13__97ca8228-441d-4e86-9a8b-9ce44a32dce8__wakuorg_nwaku:latest.log
2026-03-05 04:36:16.087 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 42915
2026-03-05 04:36:16.087 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:36:17.090 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42915/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:17.109 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:36:17.110 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:36:17.110 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42915/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:17.119 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.185.126/tcp/42916/p2p/16Uiu2HAmHUoPdZgudkU23BZn7XbRpb2wmbGwu2Pup5scza85Pnbp","/ip4/172.18.185.126/tcp/42917/ws/p2p/16Uiu2HAmHUoPdZgudkU23BZn7XbRpb2wmbGwu2Pup5scza85Pnbp"],"enrUri":"enr:-L24QBafVhUXGVCdJ1qjUP_fR88-qjyaD07I1loFvddVeJW4LkLFBIWmWSTuU3S-3FIhFbMpbnyof9nfje3c6hY20wsCgmlkgnY0gmlwhKwSuX6KbXVsdGlhZGRyc5YACASsErl-BqekAAoErBK5fganpd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDR648BKGBOmcW0kCi0uMYxGiUZCRlFiGW0DTIjHYr5geDdGNwgqekg3VkcIKnpoV3YWt1MgE"}'
2026-03-05 04:36:17.119 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:36:17.119 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:36:17.119 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:36:17.121 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:36:17.121 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.183.244
2026-03-05 04:36:17.121 DEBUG [src.node.docker_mananger] Generated ports ['35826', '35827', '35828', '35829', '35830']
2026-03-05 04:36:17.121 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:36:17.121 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:36:17.122 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:36:17.122 DEBUG [src.node.docker_mananger] docker run -i -t -p 35826:35826 -p 35827:35827 -p 35828:35828 -p 35829:35829 -p 35830:35830 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=35828 --rest-port=35826 --tcp-port=35827 --discv5-udp-port=35829 --rest-address=0.0.0.0 --nat=extip:172.18.183.244 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=76d92feebfeb7d5645a3f0c491f5c4ee6ffa83efb22bd17b7a9e2a6eb20cecf4 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=35830 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QBafVhUXGVCdJ1qjUP_fR88-qjyaD07I1loFvddVeJW4LkLFBIWmWSTuU3S-3FIhFbMpbnyof9nfje3c6hY20wsCgmlkgnY0gmlwhKwSuX6KbXVsdGlhZGRyc5YACASsErl-BqekAAoErBK5fganpd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDR648BKGBOmcW0kCi0uMYxGiUZCRlFiGW0DTIjHYr5geDdGNwgqekg3VkcIKnpoV3YWt1MgE
2026-03-05 04:36:17.322 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.183.244 waku 8ca3a5b8d635da04575d2fdfe67934855b2cec02747136fb628a086903e42a6d
2026-03-05 04:36:17.357 DEBUG [src.node.docker_mananger] Container started with ID 8ca3a5b8d635. Setting up logs at ./log/docker/node4_2026-03-05_04-36-13__97ca8228-441d-4e86-9a8b-9ce44a32dce8__wakuorg_nwaku:latest.log
2026-03-05 04:36:17.357 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 35826
2026-03-05 04:36:17.357 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:36:18.358 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35826/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:18.375 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:36:18.377 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:36:18.379 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35826/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:18.383 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.183.244/tcp/35827/p2p/16Uiu2HAmC69az9De6JHLXy8FHiWMZXFfrQzf97VZEYp7aGbMKuCG","/ip4/172.18.183.244/tcp/35828/ws/p2p/16Uiu2HAmC69az9De6JHLXy8FHiWMZXFfrQzf97VZEYp7aGbMKuCG"],"enrUri":"enr:-L24QMzaK5WBI2w7cXJbzSICPFNQCO8WFPUdp_mX0sFRQxwJNPR0LAv6q2SVkWooXjvfprcHko5_Ccdf-Pn65_ipAbYCgmlkgnY0gmlwhKwSt_SKbXVsdGlhZGRyc5YACASsErf0BovzAAoErBK39AaL9N0DgnJzhQADAQAAiXNlY3AyNTZrMaEC95ZG0bsnQzLvL7ehReOUsuXMrFEqOFsvatwHIMWKMW2DdGNwgovzg3VkcIKL9YV3YWt1MgE"}'
2026-03-05 04:36:18.383 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:36:18.384 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:2716/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-05 04:36:18.389 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:36:18.389 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54404/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-05 04:36:18.397 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:36:18.398 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:42915/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-05 04:36:18.406 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:36:18.407 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35826/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-05 04:36:18.414 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:36:18.415 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2716/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:18.419 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.236.234/tcp/41258/p2p/16Uiu2HAm51FUBDRvutWRraFyUzFUqxu19Tj4LFruDPykQfETo6Np","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"UnknownOrigin"}]'
2026-03-05 04:36:18.419 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54404/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:18.421 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.185.126/tcp/56998/p2p/16Uiu2HAmHUoPdZgudkU23BZn7XbRpb2wmbGwu2Pup5scza85Pnbp","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.31.200/tcp/2717/p2p/16Uiu2HAm6SR9gMSj9umrXZbtm2yMomwU75totY51P1P1RSkXCFZh","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"Discv5"}]'
2026-03-05 04:36:18.422 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42915/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:18.424 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.236.234/tcp/54405/p2p/16Uiu2HAm51FUBDRvutWRraFyUzFUqxu19Tj4LFruDPykQfETo6Np","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"Discv5"},{"multiaddr":"/ip4/172.18.183.244/tcp/39098/p2p/16Uiu2HAmC69az9De6JHLXy8FHiWMZXFfrQzf97VZEYp7aGbMKuCG","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"UnknownOrigin"}]'
2026-03-05 04:36:18.424 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35826/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:18.427 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.185.126/tcp/42916/p2p/16Uiu2HAmHUoPdZgudkU23BZn7XbRpb2wmbGwu2Pup5scza85Pnbp","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"Discv5"}]'
2026-03-05 04:36:18.427 DEBUG [src.libs.common] Sleeping for 20 seconds
2026-03-05 04:36:38.429 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '9408', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-05 04:36:38.440 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '9408', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'loss', '50.0%']
2026-03-05 04:36:38.451 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '9408', '-n', 'tc', '-s', 'qdisc', 'show', 'dev', 'eth0']
2026-03-05 04:36:38.460 DEBUG [src.steps.network_conditions] tc -s qdisc show dev eth0:
qdisc netem 8004: root refcnt 5 limit 1000 loss 50%
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
2026-03-05 04:36:38.460 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35826/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:38.463 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[]'
2026-03-05 04:36:38.463 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:2716/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 04:36:38.474 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:36:38.477 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:2716/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 04:36:42.978 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:36:42.979 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:2716/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 04:36:42.991 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:36:42.992 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:2716/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 04:36:44.450 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:36:44.451 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:2716/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 04:36:45.506 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:36:45.509 DEBUG [src.libs.common] Sleeping for 30.0 seconds
2026-03-05 04:37:15.510 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35826/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:37:15.513 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772685398463367138,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772685398477148688,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772685402979092949,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772685402992449793,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772685404451279190,"ephemeral":false,"proof":""}]'
2026-03-05 04:37:15.515 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '9408', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-05 04:37:15.526 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '9408', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-05 04:37:15.536 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '9408', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'loss', '50.0%', '75.0%']
2026-03-05 04:37:15.545 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35826/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:37:15.548 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[]'
2026-03-05 04:37:15.548 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:2716/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 04:37:15.560 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:37:15.563 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:2716/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 04:37:16.613 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:37:16.615 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:2716/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 04:37:16.626 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:37:16.629 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:2716/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 04:37:31.130 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:37:31.131 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:2716/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 04:37:35.866 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:37:35.867 DEBUG [src.libs.common] Sleeping for 30.0 seconds
2026-03-05 04:38:05.867 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35826/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:38:05.870 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772685435548873139,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772685435563461929,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772685436615166943,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772685436629252066,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772685451131136929,"ephemeral":false,"proof":""}]'
2026-03-05 04:38:05.872 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '9408', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-05 04:38:05.882 DEBUG [tests.e2e.test_network_conditions] uncorrelated=5 correlated=5
2026-03-05 04:38:05.884 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-05 04:38:05.885 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-05 04:38:05.885 DEBUG [src.node.waku_node] Stopping container with id 714a7f5b37f3
2026-03-05 04:38:06.453 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:38:06.453 DEBUG [src.node.waku_node] Stopping container with id 2fb6d1830b02
2026-03-05 04:38:07.008 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:38:07.009 DEBUG [src.node.waku_node] Stopping container with id a8c5954fd6ae
2026-03-05 04:38:07.267 ERROR [src.node.docker_mananger] Max retries reached for container 714a7f5b37f3. Exiting log stream.
2026-03-05 04:38:07.554 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:38:07.555 DEBUG [src.node.waku_node] Stopping container with id 8ca3a5b8d635
2026-03-05 04:38:07.822 ERROR [src.node.docker_mananger] Max retries reached for container 2fb6d1830b02. Exiting log stream.
2026-03-05 04:38:08.607 ERROR [src.node.docker_mananger] Max retries reached for container a8c5954fd6ae. Exiting log stream.
2026-03-05 04:38:18.115 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:38:18.116 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-05 04:38:18.201 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:38:18.284 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:38:18.443 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:38:18.523 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
Reference in New Issue View Git Blame Copy Permalink