logos-messaging/logos-messaging-interop-tests
1
0
Fork 0
mirror of https://github.com/logos-messaging/logos-messaging-interop-tests.git synced 2026-05-05 18:09:25 +00:00
Code Issues Packages Projects Releases Wiki Activity
logos-messaging-interop-tests/nim/1132/data/attachments/ede72fa11a9d9def.txt

333 lines
66 KiB
Plaintext
Raw Blame History

2026-03-30 04:58:05.831 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-30 04:58:05.831 DEBUG [tests.conftest] Running test: test_relay_packet_loss_correlated_vs_uncorrelated with id: 2026-03-30_04-58-05__b771dfd4-f114-456f-9844-8bfff7444316
2026-03-30 04:58:05.832 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-30 04:58:05.832 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-30 04:58:05.839 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-30 04:58:05.839 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-30_04-58-05__b771dfd4-f114-456f-9844-8bfff7444316__wakuorg_nwaku:latest.log
2026-03-30 04:58:05.845 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-30 04:58:05.845 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-30_04-58-05__b771dfd4-f114-456f-9844-8bfff7444316__wakuorg_nwaku:latest.log
2026-03-30 04:58:05.852 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-30 04:58:05.852 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-30_04-58-05__b771dfd4-f114-456f-9844-8bfff7444316__wakuorg_nwaku:latest.log
2026-03-30 04:58:05.859 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-30 04:58:05.859 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-30_04-58-05__b771dfd4-f114-456f-9844-8bfff7444316__wakuorg_nwaku:latest.log
2026-03-30 04:58:05.859 DEBUG [src.node.waku_node] Starting Node...
2026-03-30 04:58:05.859 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-30 04:58:05.861 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-30 04:58:05.861 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.203.39
2026-03-30 04:58:05.861 DEBUG [src.node.docker_mananger] Generated ports ['43626', '43627', '43628', '43629', '43630']
2026-03-30 04:58:05.861 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-30 04:58:05.861 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-30 04:58:05.861 DEBUG [src.node.waku_node] Using volumes []
2026-03-30 04:58:05.861 DEBUG [src.node.docker_mananger] docker run -i -t -p 43626:43626 -p 43627:43627 -p 43628:43628 -p 43629:43629 -p 43630:43630 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=43628 --rest-port=43626 --tcp-port=43627 --discv5-udp-port=43629 --rest-address=0.0.0.0 --nat=extip:172.18.203.39 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=c5ebb17cf9bc05eb9cfaf3e2eef256c4bf50ecc9bb2b8dfe413a4ae133ae8ec4 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=43630 --metrics-logging=true --relay=true
2026-03-30 04:58:06.038 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.203.39 waku e46693e01730aa0437c0db0edfe65a993fb4a01b9b39b75bfff2b752e2cbd559
2026-03-30 04:58:06.074 DEBUG [src.node.docker_mananger] Container started with ID e46693e01730. Setting up logs at ./log/docker/node1_2026-03-30_04-58-05__b771dfd4-f114-456f-9844-8bfff7444316__wakuorg_nwaku:latest.log
2026-03-30 04:58:06.074 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 43626
2026-03-30 04:58:06.074 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-30 04:58:06.164 ERROR [src.node.docker_mananger] Max retries reached for container 8e4f8cbaaee9. Exiting log stream.
2026-03-30 04:58:06.627 ERROR [src.node.docker_mananger] Max retries reached for container 9ba4809a1de7. Exiting log stream.
2026-03-30 04:58:07.075 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43626/health" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:58:07.078 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-30 04:58:07.078 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-30 04:58:07.078 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43626/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:58:07.081 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.203.39/tcp/43627/p2p/16Uiu2HAkyLiR6khbJrGeePMt3HZkvdSGLn5EFidU79jBPxMu4LGx","/ip4/172.18.203.39/tcp/43628/ws/p2p/16Uiu2HAkyLiR6khbJrGeePMt3HZkvdSGLn5EFidU79jBPxMu4LGx"],"enrUri":"enr:-L24QJ9fsytSq1_wKZzfMuVgnrr6Vv2Fm8taHYh-A2eiVvhjJGM5uV3R-xFhg8dXuLnFkgSMqAm2QUpYkICfeSwUfBMCgmlkgnY0gmlwhKwSyyeKbXVsdGlhZGRyc5YACASsEssnBqprAAoErBLLJwaqbN0DgnJzhQADAQAAiXNlY3AyNTZrMaECOimZMbMdx2CsZrOVaQY8K-JLlkPNWOpLsV_4EHu18EGDdGNwgqprg3VkcIKqbYV3YWt1MgE"}'
2026-03-30 04:58:07.081 INFO [src.node.waku_node] REST service is ready !!
2026-03-30 04:58:07.081 DEBUG [src.node.waku_node] Starting Node...
2026-03-30 04:58:07.081 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-30 04:58:07.083 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-30 04:58:07.083 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.86.210
2026-03-30 04:58:07.083 DEBUG [src.node.docker_mananger] Generated ports ['12798', '12799', '12800', '12801', '12802']
2026-03-30 04:58:07.084 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-30 04:58:07.084 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-30 04:58:07.084 DEBUG [src.node.waku_node] Using volumes []
2026-03-30 04:58:07.084 DEBUG [src.node.docker_mananger] docker run -i -t -p 12798:12798 -p 12799:12799 -p 12800:12800 -p 12801:12801 -p 12802:12802 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=12800 --rest-port=12798 --tcp-port=12799 --discv5-udp-port=12801 --rest-address=0.0.0.0 --nat=extip:172.18.86.210 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ea7bfa90a8a593db7f5ad72186b81afedf31ee616cdccadb13bde8b38ebe1add --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=12802 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QJ9fsytSq1_wKZzfMuVgnrr6Vv2Fm8taHYh-A2eiVvhjJGM5uV3R-xFhg8dXuLnFkgSMqAm2QUpYkICfeSwUfBMCgmlkgnY0gmlwhKwSyyeKbXVsdGlhZGRyc5YACASsEssnBqprAAoErBLLJwaqbN0DgnJzhQADAQAAiXNlY3AyNTZrMaECOimZMbMdx2CsZrOVaQY8K-JLlkPNWOpLsV_4EHu18EGDdGNwgqprg3VkcIKqbYV3YWt1MgE
2026-03-30 04:58:07.265 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.86.210 waku f0198b03310147e2fc321b9582de68ffc78933bd1fb231a2f0216ec242172f19
2026-03-30 04:58:07.297 DEBUG [src.node.docker_mananger] Container started with ID f0198b033101. Setting up logs at ./log/docker/node2_2026-03-30_04-58-05__b771dfd4-f114-456f-9844-8bfff7444316__wakuorg_nwaku:latest.log
2026-03-30 04:58:07.297 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 12798
2026-03-30 04:58:07.298 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-30 04:58:08.298 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12798/health" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:58:08.322 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-30 04:58:08.324 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-30 04:58:08.325 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12798/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:58:08.332 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.86.210/tcp/12799/p2p/16Uiu2HAm5oPytYmZahxbXERYXASbuw3R7cxe1AEGTYJjsQaLMmRo","/ip4/172.18.86.210/tcp/12800/ws/p2p/16Uiu2HAm5oPytYmZahxbXERYXASbuw3R7cxe1AEGTYJjsQaLMmRo"],"enrUri":"enr:-L24QJLkt10mdhR2ujBeleCLtieqJvo31rrskrKrYlf4iStnRg5H27nihhzXbKBAlQuUHfLej-Dg8REmuI30NyYhAdsCgmlkgnY0gmlwhKwSVtKKbXVsdGlhZGRyc5YACASsElbSBjH_AAoErBJW0gYyAN0DgnJzhQADAQAAiXNlY3AyNTZrMaECmiWOw_0RFUBGglWMIIbFDnz1govD8E8A0-8qSoD3EX6DdGNwgjH_g3VkcIIyAYV3YWt1MgE"}'
2026-03-30 04:58:08.333 INFO [src.node.waku_node] REST service is ready !!
2026-03-30 04:58:08.333 DEBUG [src.node.waku_node] Starting Node...
2026-03-30 04:58:08.333 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-30 04:58:08.335 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-30 04:58:08.335 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.10.161
2026-03-30 04:58:08.336 DEBUG [src.node.docker_mananger] Generated ports ['32047', '32048', '32049', '32050', '32051']
2026-03-30 04:58:08.336 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-30 04:58:08.336 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-30 04:58:08.336 DEBUG [src.node.waku_node] Using volumes []
2026-03-30 04:58:08.336 DEBUG [src.node.docker_mananger] docker run -i -t -p 32047:32047 -p 32048:32048 -p 32049:32049 -p 32050:32050 -p 32051:32051 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=32049 --rest-port=32047 --tcp-port=32048 --discv5-udp-port=32050 --rest-address=0.0.0.0 --nat=extip:172.18.10.161 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ca5de5438df1da006ee3effe731caab6f6db6eec5bbd660ed1169fe39fade5dd --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=32051 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QJLkt10mdhR2ujBeleCLtieqJvo31rrskrKrYlf4iStnRg5H27nihhzXbKBAlQuUHfLej-Dg8REmuI30NyYhAdsCgmlkgnY0gmlwhKwSVtKKbXVsdGlhZGRyc5YACASsElbSBjH_AAoErBJW0gYyAN0DgnJzhQADAQAAiXNlY3AyNTZrMaECmiWOw_0RFUBGglWMIIbFDnz1govD8E8A0-8qSoD3EX6DdGNwgjH_g3VkcIIyAYV3YWt1MgE
2026-03-30 04:58:08.523 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.10.161 waku 9909ea9398f69e4671e2a115dbbaab81550544d1a0a9d44bfe12ccca5df631d4
2026-03-30 04:58:08.562 DEBUG [src.node.docker_mananger] Container started with ID 9909ea9398f6. Setting up logs at ./log/docker/node3_2026-03-30_04-58-05__b771dfd4-f114-456f-9844-8bfff7444316__wakuorg_nwaku:latest.log
2026-03-30 04:58:08.563 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 32047
2026-03-30 04:58:08.563 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-30 04:58:09.564 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32047/health" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:58:09.576 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-30 04:58:09.577 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-30 04:58:09.579 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32047/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:58:09.584 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.10.161/tcp/32048/p2p/16Uiu2HAmJ1Qa6Sc6uQbDy6mZPWRTfUH5mmEKvNxU9C9UKoSmk79t","/ip4/172.18.10.161/tcp/32049/ws/p2p/16Uiu2HAmJ1Qa6Sc6uQbDy6mZPWRTfUH5mmEKvNxU9C9UKoSmk79t"],"enrUri":"enr:-L24QMRiYD7Vw4ZzMxLbUnPN9Yyx6sEAbPC0ISF0SmIdj5ufXp8Lg1YqRscCZMj0HiJYD1nbeJYZe1MxoZ81f5EoJe0CgmlkgnY0gmlwhKwSCqGKbXVsdGlhZGRyc5YACASsEgqhBn0wAAoErBIKoQZ9Md0DgnJzhQADAQAAiXNlY3AyNTZrMaEDT4Vv9KvYCvl_okWJj5EfNysvtan_K82LJ8025NaVFHODdGNwgn0wg3VkcIJ9MoV3YWt1MgE"}'
2026-03-30 04:58:09.584 INFO [src.node.waku_node] REST service is ready !!
2026-03-30 04:58:09.585 DEBUG [src.node.waku_node] Starting Node...
2026-03-30 04:58:09.585 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-30 04:58:09.587 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-30 04:58:09.587 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.106.41
2026-03-30 04:58:09.587 DEBUG [src.node.docker_mananger] Generated ports ['53105', '53106', '53107', '53108', '53109']
2026-03-30 04:58:09.587 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-30 04:58:09.587 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-30 04:58:09.587 DEBUG [src.node.waku_node] Using volumes []
2026-03-30 04:58:09.587 DEBUG [src.node.docker_mananger] docker run -i -t -p 53105:53105 -p 53106:53106 -p 53107:53107 -p 53108:53108 -p 53109:53109 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=53107 --rest-port=53105 --tcp-port=53106 --discv5-udp-port=53108 --rest-address=0.0.0.0 --nat=extip:172.18.106.41 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=9dd355deffbf3e16bbd9ff35411ee7de4ceb4066ac02b5e5ebbb0dba1f75eab1 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=53109 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QMRiYD7Vw4ZzMxLbUnPN9Yyx6sEAbPC0ISF0SmIdj5ufXp8Lg1YqRscCZMj0HiJYD1nbeJYZe1MxoZ81f5EoJe0CgmlkgnY0gmlwhKwSCqGKbXVsdGlhZGRyc5YACASsEgqhBn0wAAoErBIKoQZ9Md0DgnJzhQADAQAAiXNlY3AyNTZrMaEDT4Vv9KvYCvl_okWJj5EfNysvtan_K82LJ8025NaVFHODdGNwgn0wg3VkcIJ9MoV3YWt1MgE
2026-03-30 04:58:09.768 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.106.41 waku ea79221d4238284bf82a5eb34f250b981fb9c5f28d2e469a4750b1da00bafb04
2026-03-30 04:58:09.808 DEBUG [src.node.docker_mananger] Container started with ID ea79221d4238. Setting up logs at ./log/docker/node4_2026-03-30_04-58-05__b771dfd4-f114-456f-9844-8bfff7444316__wakuorg_nwaku:latest.log
2026-03-30 04:58:09.808 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 53105
2026-03-30 04:58:09.809 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-30 04:58:10.810 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53105/health" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:58:10.825 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-30 04:58:10.825 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-30 04:58:10.826 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53105/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:58:10.834 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.106.41/tcp/53106/p2p/16Uiu2HAm2wykUkMz8WagJ6ekTFv3eBi7Z2LwoCq3NyZcyU3tMzqg","/ip4/172.18.106.41/tcp/53107/ws/p2p/16Uiu2HAm2wykUkMz8WagJ6ekTFv3eBi7Z2LwoCq3NyZcyU3tMzqg"],"enrUri":"enr:-L24QJ7LRGBdPA1lWS3VuCe3UDp-r5m5Q9BIIkWiAiQ35RljRC0Eb4nxrDUm1E_zjoMTOKfTxTCCqSueAU1HDlwLnmkCgmlkgnY0gmlwhKwSaimKbXVsdGlhZGRyc5YACASsEmopBs9yAAoErBJqKQbPc90DgnJzhQADAQAAiXNlY3AyNTZrMaECb8VTa58OIgIyjJ37hpJTWyEeYw4rW65E1kOGjkxECFuDdGNwgs9yg3VkcILPdIV3YWt1MgE"}'
2026-03-30 04:58:10.835 INFO [src.node.waku_node] REST service is ready !!
2026-03-30 04:58:10.836 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43626/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-30 04:58:10.840 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 04:58:10.841 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12798/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-30 04:58:10.849 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 04:58:10.849 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32047/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-30 04:58:10.859 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 04:58:10.860 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53105/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-30 04:58:10.865 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 04:58:10.866 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43626/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:58:10.871 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.86.210/tcp/46070/p2p/16Uiu2HAm5oPytYmZahxbXERYXASbuw3R7cxe1AEGTYJjsQaLMmRo","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"UnknownOrigin"}]'
2026-03-30 04:58:10.871 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12798/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:58:10.874 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.10.161/tcp/46258/p2p/16Uiu2HAmJ1Qa6Sc6uQbDy6mZPWRTfUH5mmEKvNxU9C9UKoSmk79t","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.203.39/tcp/43627/p2p/16Uiu2HAkyLiR6khbJrGeePMt3HZkvdSGLn5EFidU79jBPxMu4LGx","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"Discv5"}]'
2026-03-30 04:58:10.875 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32047/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:58:10.877 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.106.41/tcp/48456/p2p/16Uiu2HAm2wykUkMz8WagJ6ekTFv3eBi7Z2LwoCq3NyZcyU3tMzqg","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.86.210/tcp/12799/p2p/16Uiu2HAm5oPytYmZahxbXERYXASbuw3R7cxe1AEGTYJjsQaLMmRo","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"Discv5"}]'
2026-03-30 04:58:10.877 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53105/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:58:10.880 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.10.161/tcp/32048/p2p/16Uiu2HAmJ1Qa6Sc6uQbDy6mZPWRTfUH5mmEKvNxU9C9UKoSmk79t","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"Discv5"}]'
2026-03-30 04:58:10.880 DEBUG [src.libs.common] Sleeping for 20 seconds
2026-03-30 04:58:30.882 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '8173', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-30 04:58:30.893 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '8173', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'loss', '50.0%']
2026-03-30 04:58:30.903 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '8173', '-n', 'tc', '-s', 'qdisc', 'show', 'dev', 'eth0']
2026-03-30 04:58:30.912 DEBUG [src.steps.network_conditions] tc -s qdisc show dev eth0:
qdisc netem 8002: root refcnt 5 limit 1000 loss 50%
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
2026-03-30 04:58:30.912 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53105/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:58:30.914 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[]'
2026-03-30 04:58:30.915 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43626/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-30 04:58:31.954 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 04:58:31.955 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43626/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-30 04:58:31.966 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 04:58:31.967 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43626/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-30 04:58:35.086 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 04:58:35.086 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43626/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-30 04:58:36.326 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 04:58:36.326 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43626/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-30 04:58:37.774 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 04:58:37.774 DEBUG [src.libs.common] Sleeping for 30.0 seconds
2026-03-30 04:59:07.774 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53105/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:59:07.777 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774846710915101776,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774846711955113995,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774846711967069624,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774846715086665519,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774846716326599901,"ephemeral":false,"proof":""}]'
2026-03-30 04:59:07.779 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '8173', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-30 04:59:07.790 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '8173', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-30 04:59:07.800 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '8173', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'loss', '50.0%', '75.0%']
2026-03-30 04:59:07.809 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53105/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:59:07.811 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[]'
2026-03-30 04:59:07.811 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43626/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-30 04:59:07.818 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 04:59:07.819 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43626/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-30 04:59:07.836 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 04:59:07.849 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43626/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-30 04:59:07.856 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 04:59:07.857 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43626/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-30 04:59:28.062 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-30 04:59:28.063 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-30 04:59:28.063 DEBUG [src.node.waku_node] Stopping container with id e46693e01730
2026-03-30 04:59:28.547 DEBUG [src.node.waku_node] Container stopped.
2026-03-30 04:59:28.547 DEBUG [src.node.waku_node] Stopping container with id f0198b033101
2026-03-30 04:59:28.994 DEBUG [src.node.waku_node] Container stopped.
2026-03-30 04:59:28.996 DEBUG [src.node.waku_node] Stopping container with id 9909ea9398f6
2026-03-30 04:59:29.361 ERROR [src.node.docker_mananger] Max retries reached for container e46693e01730. Exiting log stream.
2026-03-30 04:59:29.807 ERROR [src.node.docker_mananger] Max retries reached for container f0198b033101. Exiting log stream.
2026-03-30 04:59:39.449 DEBUG [src.node.waku_node] Container stopped.
2026-03-30 04:59:39.449 DEBUG [src.node.waku_node] Stopping container with id ea79221d4238
2026-03-30 04:59:40.263 ERROR [src.node.docker_mananger] Max retries reached for container 9909ea9398f6. Exiting log stream.
2026-03-30 04:59:49.873 DEBUG [src.node.waku_node] Container stopped.
2026-03-30 04:59:49.875 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-30 04:59:49.939 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-30 04:59:50.003 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-30 04:59:50.065 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-30 04:59:50.125 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-30 04:59:50.126 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-30 04:59:50.126 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-30 04:59:50.127 DEBUG [src.libs.common] Attaching file ./log/docker/node3_2026-03-30_04-58-05__b771dfd4-f114-456f-9844-8bfff7444316__wakuorg_nwaku:latest.log
2026-03-30 04:59:50.128 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-30_04-58-05__b771dfd4-f114-456f-9844-8bfff7444316__wakuorg_nwaku:latest.log
2026-03-30 04:59:50.129 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-30_04-58-05__b771dfd4-f114-456f-9844-8bfff7444316__wakuorg_nwaku:latest.log
2026-03-30 04:59:50.130 DEBUG [src.libs.common] Attaching file ./log/docker/node4_2026-03-30_04-58-05__b771dfd4-f114-456f-9844-8bfff7444316__wakuorg_nwaku:latest.log
2026-03-30 04:59:50.134 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-30 04:59:50.134 DEBUG [tests.conftest] Running test: test_relay_packet_loss_correlated_vs_uncorrelated with id: 2026-03-30_04-59-50__ad8205a7-b1be-4b29-907a-87159cf826ae
2026-03-30 04:59:50.135 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-30 04:59:50.135 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-30 04:59:50.142 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-30 04:59:50.142 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-30_04-59-50__ad8205a7-b1be-4b29-907a-87159cf826ae__wakuorg_nwaku:latest.log
2026-03-30 04:59:50.148 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-30 04:59:50.148 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-30_04-59-50__ad8205a7-b1be-4b29-907a-87159cf826ae__wakuorg_nwaku:latest.log
2026-03-30 04:59:50.154 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-30 04:59:50.154 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-30_04-59-50__ad8205a7-b1be-4b29-907a-87159cf826ae__wakuorg_nwaku:latest.log
2026-03-30 04:59:50.160 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-30 04:59:50.160 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-30_04-59-50__ad8205a7-b1be-4b29-907a-87159cf826ae__wakuorg_nwaku:latest.log
2026-03-30 04:59:50.160 DEBUG [src.node.waku_node] Starting Node...
2026-03-30 04:59:50.161 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-30 04:59:50.162 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-30 04:59:50.162 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.110.190
2026-03-30 04:59:50.162 DEBUG [src.node.docker_mananger] Generated ports ['32024', '32025', '32026', '32027', '32028']
2026-03-30 04:59:50.162 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-30 04:59:50.163 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-30 04:59:50.163 DEBUG [src.node.waku_node] Using volumes []
2026-03-30 04:59:50.163 DEBUG [src.node.docker_mananger] docker run -i -t -p 32024:32024 -p 32025:32025 -p 32026:32026 -p 32027:32027 -p 32028:32028 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=32026 --rest-port=32024 --tcp-port=32025 --discv5-udp-port=32027 --rest-address=0.0.0.0 --nat=extip:172.18.110.190 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=8a73bac8d42cd5d79145bcbf72ecdcf746ccfadaa3b718bdcb9f6d39fca66901 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=32028 --metrics-logging=true --relay=true
2026-03-30 04:59:50.345 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.110.190 waku e79ffc82e8828dd6e38a9ecc978c88b31414c9ed701e3861e9e0b5fc8898d418
2026-03-30 04:59:50.380 DEBUG [src.node.docker_mananger] Container started with ID e79ffc82e882. Setting up logs at ./log/docker/node1_2026-03-30_04-59-50__ad8205a7-b1be-4b29-907a-87159cf826ae__wakuorg_nwaku:latest.log
2026-03-30 04:59:50.381 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 32024
2026-03-30 04:59:50.381 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-30 04:59:50.813 ERROR [src.node.docker_mananger] Max retries reached for container ea79221d4238. Exiting log stream.
2026-03-30 04:59:51.382 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32024/health" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:59:51.385 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-30 04:59:51.385 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-30 04:59:51.386 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32024/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:59:51.388 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.110.190/tcp/32025/p2p/16Uiu2HAmB82tsTu84jQfTufZCqK8VmuKrqeTXcVQpV8yDuNUAh47","/ip4/172.18.110.190/tcp/32026/ws/p2p/16Uiu2HAmB82tsTu84jQfTufZCqK8VmuKrqeTXcVQpV8yDuNUAh47"],"enrUri":"enr:-L24QP2UhTmlO8xtaGiW8nmmVke9ngYUsTmiXNJNGWGThmhPWSpdxwxtHNul5pQEjOXB8Ynxz3LUBi_fjH8FR2Y7wrUCgmlkgnY0gmlwhKwSbr6KbXVsdGlhZGRyc5YACASsEm6-Bn0ZAAoErBJuvgZ9Gt0DgnJzhQADAQAAiXNlY3AyNTZrMaEC6TYvYJmVXJdwNVL_10CS-_mtU7VSutaSdqrMxb0cyYyDdGNwgn0Zg3VkcIJ9G4V3YWt1MgE"}'
2026-03-30 04:59:51.388 INFO [src.node.waku_node] REST service is ready !!
2026-03-30 04:59:51.388 DEBUG [src.node.waku_node] Starting Node...
2026-03-30 04:59:51.389 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-30 04:59:51.390 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-30 04:59:51.390 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.181.66
2026-03-30 04:59:51.390 DEBUG [src.node.docker_mananger] Generated ports ['10851', '10852', '10853', '10854', '10855']
2026-03-30 04:59:51.390 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-30 04:59:51.390 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-30 04:59:51.391 DEBUG [src.node.waku_node] Using volumes []
2026-03-30 04:59:51.391 DEBUG [src.node.docker_mananger] docker run -i -t -p 10851:10851 -p 10852:10852 -p 10853:10853 -p 10854:10854 -p 10855:10855 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=10853 --rest-port=10851 --tcp-port=10852 --discv5-udp-port=10854 --rest-address=0.0.0.0 --nat=extip:172.18.181.66 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=bed6d8af91aa7dd8a0b03bde24cb9eab656f74ae9067dcdc9ad8e2516c3b09be --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=10855 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QP2UhTmlO8xtaGiW8nmmVke9ngYUsTmiXNJNGWGThmhPWSpdxwxtHNul5pQEjOXB8Ynxz3LUBi_fjH8FR2Y7wrUCgmlkgnY0gmlwhKwSbr6KbXVsdGlhZGRyc5YACASsEm6-Bn0ZAAoErBJuvgZ9Gt0DgnJzhQADAQAAiXNlY3AyNTZrMaEC6TYvYJmVXJdwNVL_10CS-_mtU7VSutaSdqrMxb0cyYyDdGNwgn0Zg3VkcIJ9G4V3YWt1MgE
2026-03-30 04:59:51.576 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.181.66 waku 2656aa72f40b9824c25125ea31a2f356eea2ea52bebf3a359b647d02d948d310
2026-03-30 04:59:51.610 DEBUG [src.node.docker_mananger] Container started with ID 2656aa72f40b. Setting up logs at ./log/docker/node2_2026-03-30_04-59-50__ad8205a7-b1be-4b29-907a-87159cf826ae__wakuorg_nwaku:latest.log
2026-03-30 04:59:51.611 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 10851
2026-03-30 04:59:51.611 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-30 04:59:52.613 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10851/health" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:59:52.629 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-30 04:59:52.632 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-30 04:59:52.632 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10851/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:59:52.639 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.181.66/tcp/10852/p2p/16Uiu2HAmB3txAXKNEi7oH8wJkVLHUZKG79WwiyZgrv63dyoXDEtc","/ip4/172.18.181.66/tcp/10853/ws/p2p/16Uiu2HAmB3txAXKNEi7oH8wJkVLHUZKG79WwiyZgrv63dyoXDEtc"],"enrUri":"enr:-L24QKlp1McziT_lIkblojhmlpwOgRziLRxfAcl5HQEoEc_NBHOAh3gCyC64ulAHpFyGkjxjKEE17JHP9TZRITYvgLECgmlkgnY0gmlwhKwStUKKbXVsdGlhZGRyc5YACASsErVCBipkAAoErBK1QgYqZd0DgnJzhQADAQAAiXNlY3AyNTZrMaEC6CbhY0cSwqkgQbsPlFREYKLWpE1yx0h6nGviRcQ74wWDdGNwgipkg3VkcIIqZoV3YWt1MgE"}'
2026-03-30 04:59:52.640 INFO [src.node.waku_node] REST service is ready !!
2026-03-30 04:59:52.640 DEBUG [src.node.waku_node] Starting Node...
2026-03-30 04:59:52.640 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-30 04:59:52.644 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-30 04:59:52.644 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.55.67
2026-03-30 04:59:52.646 DEBUG [src.node.docker_mananger] Generated ports ['43526', '43527', '43528', '43529', '43530']
2026-03-30 04:59:52.646 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-30 04:59:52.646 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-30 04:59:52.647 DEBUG [src.node.waku_node] Using volumes []
2026-03-30 04:59:52.647 DEBUG [src.node.docker_mananger] docker run -i -t -p 43526:43526 -p 43527:43527 -p 43528:43528 -p 43529:43529 -p 43530:43530 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=43528 --rest-port=43526 --tcp-port=43527 --discv5-udp-port=43529 --rest-address=0.0.0.0 --nat=extip:172.18.55.67 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=9f860210e8df2bae63babda1a93e5ed4c2f3fdc507de01cfbe2d61fdf26e6fee --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=43530 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QKlp1McziT_lIkblojhmlpwOgRziLRxfAcl5HQEoEc_NBHOAh3gCyC64ulAHpFyGkjxjKEE17JHP9TZRITYvgLECgmlkgnY0gmlwhKwStUKKbXVsdGlhZGRyc5YACASsErVCBipkAAoErBK1QgYqZd0DgnJzhQADAQAAiXNlY3AyNTZrMaEC6CbhY0cSwqkgQbsPlFREYKLWpE1yx0h6nGviRcQ74wWDdGNwgipkg3VkcIIqZoV3YWt1MgE
2026-03-30 04:59:52.836 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.55.67 waku 24066f3cbbb59b4cd068a90e06dada9a7381775ab488b9e9f9cd46460013d120
2026-03-30 04:59:52.874 DEBUG [src.node.docker_mananger] Container started with ID 24066f3cbbb5. Setting up logs at ./log/docker/node3_2026-03-30_04-59-50__ad8205a7-b1be-4b29-907a-87159cf826ae__wakuorg_nwaku:latest.log
2026-03-30 04:59:52.874 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 43526
2026-03-30 04:59:52.874 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-30 04:59:53.876 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43526/health" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:59:53.882 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-30 04:59:53.888 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-30 04:59:53.889 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43526/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:59:53.891 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.55.67/tcp/43527/p2p/16Uiu2HAm52D2B4qwdhnztt2QgJTgjP9gk9tpyPwLKgbSSfjR68XC","/ip4/172.18.55.67/tcp/43528/ws/p2p/16Uiu2HAm52D2B4qwdhnztt2QgJTgjP9gk9tpyPwLKgbSSfjR68XC"],"enrUri":"enr:-L24QBtpYLa8HiJJTifLTRe74cVYNiaO5-o60tI-hA1xFMEbJ_Z2St-Q8rypWzgCaEHQjPEOAF4P5TOZMohZJCrKznECgmlkgnY0gmlwhKwSN0OKbXVsdGlhZGRyc5YACASsEjdDBqoHAAoErBI3QwaqCN0DgnJzhQADAQAAiXNlY3AyNTZrMaECjpIHL7nbuddyCnyPtCZ5VelvrgHCQS6GQDSUUkJByFuDdGNwgqoHg3VkcIKqCYV3YWt1MgE"}'
2026-03-30 04:59:53.891 INFO [src.node.waku_node] REST service is ready !!
2026-03-30 04:59:53.892 DEBUG [src.node.waku_node] Starting Node...
2026-03-30 04:59:53.892 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-30 04:59:53.895 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-30 04:59:53.895 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.171.1
2026-03-30 04:59:53.896 DEBUG [src.node.docker_mananger] Generated ports ['18881', '18882', '18883', '18884', '18885']
2026-03-30 04:59:53.896 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-30 04:59:53.896 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-30 04:59:53.896 DEBUG [src.node.waku_node] Using volumes []
2026-03-30 04:59:53.896 DEBUG [src.node.docker_mananger] docker run -i -t -p 18881:18881 -p 18882:18882 -p 18883:18883 -p 18884:18884 -p 18885:18885 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=18883 --rest-port=18881 --tcp-port=18882 --discv5-udp-port=18884 --rest-address=0.0.0.0 --nat=extip:172.18.171.1 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=cf8596f816ca08f72013e29f7d31bedec48b74ec48ce2b3fb6aec7d859eddbfe --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=18885 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QBtpYLa8HiJJTifLTRe74cVYNiaO5-o60tI-hA1xFMEbJ_Z2St-Q8rypWzgCaEHQjPEOAF4P5TOZMohZJCrKznECgmlkgnY0gmlwhKwSN0OKbXVsdGlhZGRyc5YACASsEjdDBqoHAAoErBI3QwaqCN0DgnJzhQADAQAAiXNlY3AyNTZrMaECjpIHL7nbuddyCnyPtCZ5VelvrgHCQS6GQDSUUkJByFuDdGNwgqoHg3VkcIKqCYV3YWt1MgE
2026-03-30 04:59:54.084 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.171.1 waku 9a16935fe84a8fb7288cf2c59bb2810e740019320e8b27f327ed61b538b811d9
2026-03-30 04:59:54.116 DEBUG [src.node.docker_mananger] Container started with ID 9a16935fe84a. Setting up logs at ./log/docker/node4_2026-03-30_04-59-50__ad8205a7-b1be-4b29-907a-87159cf826ae__wakuorg_nwaku:latest.log
2026-03-30 04:59:54.117 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 18881
2026-03-30 04:59:54.117 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-30 04:59:55.118 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18881/health" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:59:55.134 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-30 04:59:55.135 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-30 04:59:55.135 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18881/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:59:55.145 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.171.1/tcp/18882/p2p/16Uiu2HAm5VAeTRYh7uMijEszoB6VDHCWpJNb7qHa3FqGKPk6tW3j","/ip4/172.18.171.1/tcp/18883/ws/p2p/16Uiu2HAm5VAeTRYh7uMijEszoB6VDHCWpJNb7qHa3FqGKPk6tW3j"],"enrUri":"enr:-L24QK1oSF4arOvzVbKUl5rB4F1998DGuhuo_-KJaprVvUJZS2MkMfu9VGUMuTGFhz6AXICwdNRJ9KcLMAr8a3WXzzQCgmlkgnY0gmlwhKwSqwGKbXVsdGlhZGRyc5YACASsEqsBBknCAAoErBKrAQZJw90DgnJzhQADAQAAiXNlY3AyNTZrMaEClXoGbkV9eJo8nv7i131l9moK-VLMMQZkZ4nWzOujpFqDdGNwgknCg3VkcIJJxIV3YWt1MgE"}'
2026-03-30 04:59:55.145 INFO [src.node.waku_node] REST service is ready !!
2026-03-30 04:59:55.146 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32024/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-30 04:59:55.150 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 04:59:55.151 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:10851/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-30 04:59:55.158 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 04:59:55.159 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43526/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-30 04:59:55.166 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 04:59:55.167 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:18881/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-30 04:59:55.175 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 04:59:55.176 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32024/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:59:55.180 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.181.66/tcp/43826/p2p/16Uiu2HAmB3txAXKNEi7oH8wJkVLHUZKG79WwiyZgrv63dyoXDEtc","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"UnknownOrigin"}]'
2026-03-30 04:59:55.181 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10851/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:59:55.184 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.110.190/tcp/32025/p2p/16Uiu2HAmB82tsTu84jQfTufZCqK8VmuKrqeTXcVQpV8yDuNUAh47","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"Discv5"},{"multiaddr":"/ip4/172.18.55.67/tcp/47314/p2p/16Uiu2HAm52D2B4qwdhnztt2QgJTgjP9gk9tpyPwLKgbSSfjR68XC","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"UnknownOrigin"}]'
2026-03-30 04:59:55.184 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43526/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:59:55.187 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.171.1/tcp/38834/p2p/16Uiu2HAm5VAeTRYh7uMijEszoB6VDHCWpJNb7qHa3FqGKPk6tW3j","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.181.66/tcp/10852/p2p/16Uiu2HAmB3txAXKNEi7oH8wJkVLHUZKG79WwiyZgrv63dyoXDEtc","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"Discv5"}]'
2026-03-30 04:59:55.187 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18881/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-30 04:59:55.189 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.55.67/tcp/43527/p2p/16Uiu2HAm52D2B4qwdhnztt2QgJTgjP9gk9tpyPwLKgbSSfjR68XC","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"Discv5"}]'
2026-03-30 04:59:55.189 DEBUG [src.libs.common] Sleeping for 20 seconds
2026-03-30 05:00:15.191 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '10033', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-30 05:00:15.202 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '10033', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'loss', '50.0%']
2026-03-30 05:00:15.212 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '10033', '-n', 'tc', '-s', 'qdisc', 'show', 'dev', 'eth0']
2026-03-30 05:00:15.221 DEBUG [src.steps.network_conditions] tc -s qdisc show dev eth0:
qdisc netem 8004: root refcnt 5 limit 1000 loss 50%
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
2026-03-30 05:00:15.221 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18881/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-30 05:00:15.224 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[]'
2026-03-30 05:00:15.224 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32024/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-30 05:00:18.326 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 05:00:18.330 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32024/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-30 05:00:18.345 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 05:00:18.346 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32024/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-30 05:00:18.573 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 05:00:18.574 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32024/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-30 05:00:20.014 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 05:00:20.014 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32024/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-30 05:00:20.230 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 05:00:20.230 DEBUG [src.libs.common] Sleeping for 30.0 seconds
2026-03-30 05:00:50.230 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18881/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-30 05:00:50.234 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774846815224507564,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774846818330480508,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774846818346192481,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774846818574420579,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774846820014734282,"ephemeral":false,"proof":""}]'
2026-03-30 05:00:50.235 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '10033', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-30 05:00:50.246 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '10033', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-30 05:00:50.255 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '10033', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'loss', '50.0%', '75.0%']
2026-03-30 05:00:50.264 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18881/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-30 05:00:50.266 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[]'
2026-03-30 05:00:50.266 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32024/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-30 05:00:50.275 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 05:00:50.277 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32024/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-30 05:00:50.510 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 05:00:50.510 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32024/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-30 05:00:50.519 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 05:00:50.523 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32024/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-30 05:00:51.542 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 05:00:51.545 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32024/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-30 05:00:51.561 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-30 05:00:51.561 DEBUG [src.libs.common] Sleeping for 30.0 seconds
2026-03-30 05:01:21.562 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18881/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-30 05:01:21.565 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774846850266902157,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774846850277109342,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774846850510472487,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774846850523545986,"ephemeral":false,"proof":""},{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1774846851545309042,"ephemeral":false,"proof":""}]'
2026-03-30 05:01:21.567 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '10033', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-03-30 05:01:21.576 DEBUG [tests.e2e.test_network_conditions] uncorrelated=5 correlated=5
2026-03-30 05:01:21.578 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-30 05:01:21.578 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-30 05:01:21.579 DEBUG [src.node.waku_node] Stopping container with id e79ffc82e882
2026-03-30 05:01:22.063 DEBUG [src.node.waku_node] Container stopped.
2026-03-30 05:01:22.063 DEBUG [src.node.waku_node] Stopping container with id 2656aa72f40b
2026-03-30 05:01:22.542 DEBUG [src.node.waku_node] Container stopped.
2026-03-30 05:01:22.542 DEBUG [src.node.waku_node] Stopping container with id 24066f3cbbb5
2026-03-30 05:01:22.877 ERROR [src.node.docker_mananger] Max retries reached for container e79ffc82e882. Exiting log stream.
2026-03-30 05:01:22.984 DEBUG [src.node.waku_node] Container stopped.
2026-03-30 05:01:22.986 DEBUG [src.node.waku_node] Stopping container with id 9a16935fe84a
2026-03-30 05:01:23.356 ERROR [src.node.docker_mananger] Max retries reached for container 2656aa72f40b. Exiting log stream.
2026-03-30 05:01:23.433 DEBUG [src.node.waku_node] Container stopped.
2026-03-30 05:01:23.435 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-30 05:01:23.506 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-30 05:01:23.578 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-30 05:01:23.647 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-30 05:01:23.715 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
Reference in New Issue View Git Blame Copy Permalink