2026-02-25 20:22:16 +00:00

79 lines
14 KiB
Plaintext

2026-02-25 20:02:38.805 DEBUG [tests.conftest] Running fixture setup: test_id
2026-02-25 20:02:38.805 DEBUG [tests.conftest] Running test: test_relay_different_latency_between_two_nodes[200] with id: 2026-02-25_20-02-38__7dc32446-044f-4e35-8bd4-492ee47610e4
2026-02-25 20:02:38.805 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-02-25 20:02:38.806 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-02-25 20:02:38.811 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 20:02:38.811 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-02-25_20-02-38__7dc32446-044f-4e35-8bd4-492ee47610e4__wakuorg_nwaku:latest.log
2026-02-25 20:02:38.816 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 20:02:38.816 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-02-25_20-02-38__7dc32446-044f-4e35-8bd4-492ee47610e4__wakuorg_nwaku:latest.log
2026-02-25 20:02:38.817 INFO [tests.e2e.test_network_conditions] Starting node1 and node2 with relay enabled
2026-02-25 20:02:38.817 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 20:02:38.817 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 20:02:38.818 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 20:02:38.818 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.208.107
2026-02-25 20:02:38.818 DEBUG [src.node.docker_mananger] Generated ports ['40253', '40254', '40255', '40256', '40257']
2026-02-25 20:02:38.818 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 20:02:38.818 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 20:02:38.819 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 20:02:38.819 DEBUG [src.node.docker_mananger] docker run -i -t -p 40253:40253 -p 40254:40254 -p 40255:40255 -p 40256:40256 -p 40257:40257 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=40255 --rest-port=40253 --tcp-port=40254 --discv5-udp-port=40256 --rest-address=0.0.0.0 --nat=extip:172.18.208.107 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=a9e4f69b83eb7b65eed2b5d0ee5daebdb7bdf7417f172e47eaacecf7caabeee0 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=40257 --metrics-logging=true --relay=true
2026-02-25 20:02:38.960 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.208.107 waku 7b40c832ba33f778d5c16ca743b0f3fc8640fe842b1734cfd0f17fb13d2f1126
2026-02-25 20:02:38.982 DEBUG [src.node.docker_mananger] Container started with ID 7b40c832ba33. Setting up logs at ./log/docker/node1_2026-02-25_20-02-38__7dc32446-044f-4e35-8bd4-492ee47610e4__wakuorg_nwaku:latest.log
2026-02-25 20:02:38.983 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 40253
2026-02-25 20:02:38.983 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 20:02:39.147 ERROR [src.node.docker_mananger] Max retries reached for container b03b654a5ae5. Exiting log stream.
2026-02-25 20:02:39.606 ERROR [src.node.docker_mananger] Max retries reached for container 3070e66a91e4. Exiting log stream.
2026-02-25 20:02:39.985 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40253/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:02:39.987 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 20:02:39.987 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 20:02:39.987 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40253/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:02:39.990 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.208.107/tcp/40254/p2p/16Uiu2HAmDvNNwNa2Sgkmag1CBBvtqs6ZVy3YxWxerKUeSouMw3BD","/ip4/172.18.208.107/tcp/40255/ws/p2p/16Uiu2HAmDvNNwNa2Sgkmag1CBBvtqs6ZVy3YxWxerKUeSouMw3BD"],"enrUri":"enr:-L24QOvsbucVmEsibJlgXF_JmfJY0gld-KGVp-9pDVgLWH2xC0xFdV-IbjHYKz4c2IqMHDwJFoB1aeZrkFnRmuthoSECgmlkgnY0gmlwhKwS0GuKbXVsdGlhZGRyc5YACASsEtBrBp0-AAoErBLQawadP90DgnJzhQADAQAAiXNlY3AyNTZrMaEDEsxOgmCSYxlZzdX78Ryh2MOBuZLVfQvT6-RI0EIzk8iDdGNwgp0-g3VkcIKdQIV3YWt1MgE"}'
2026-02-25 20:02:39.990 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 20:02:39.990 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 20:02:39.990 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 20:02:39.991 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 20:02:39.991 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.192.111
2026-02-25 20:02:39.991 DEBUG [src.node.docker_mananger] Generated ports ['62761', '62762', '62763', '62764', '62765']
2026-02-25 20:02:39.992 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 20:02:39.992 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 20:02:39.992 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 20:02:39.992 DEBUG [src.node.docker_mananger] docker run -i -t -p 62761:62761 -p 62762:62762 -p 62763:62763 -p 62764:62764 -p 62765:62765 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=62763 --rest-port=62761 --tcp-port=62762 --discv5-udp-port=62764 --rest-address=0.0.0.0 --nat=extip:172.18.192.111 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=cfebb8afba421f451dfdfbaba914dbedb2a82cecccb7ffd7af3677d6dcdef23d --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=62765 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QOvsbucVmEsibJlgXF_JmfJY0gld-KGVp-9pDVgLWH2xC0xFdV-IbjHYKz4c2IqMHDwJFoB1aeZrkFnRmuthoSECgmlkgnY0gmlwhKwS0GuKbXVsdGlhZGRyc5YACASsEtBrBp0-AAoErBLQawadP90DgnJzhQADAQAAiXNlY3AyNTZrMaEDEsxOgmCSYxlZzdX78Ryh2MOBuZLVfQvT6-RI0EIzk8iDdGNwgp0-g3VkcIKdQIV3YWt1MgE
2026-02-25 20:02:40.141 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.192.111 waku cc176e31b56b8607210a0d4ffbf50b35139c38a2b4adf3aa0c40ba73ab6cfec4
2026-02-25 20:02:40.165 DEBUG [src.node.docker_mananger] Container started with ID cc176e31b56b. Setting up logs at ./log/docker/node2_2026-02-25_20-02-38__7dc32446-044f-4e35-8bd4-492ee47610e4__wakuorg_nwaku:latest.log
2026-02-25 20:02:40.166 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 62761
2026-02-25 20:02:40.166 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 20:02:41.166 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62761/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:02:41.195 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 20:02:41.198 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 20:02:41.199 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62761/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:02:41.204 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.192.111/tcp/62762/p2p/16Uiu2HAkv3kf3x3DMc5P3rUNVapaXEBHmFJAiNJ7TKoUXUfRQpJj","/ip4/172.18.192.111/tcp/62763/ws/p2p/16Uiu2HAkv3kf3x3DMc5P3rUNVapaXEBHmFJAiNJ7TKoUXUfRQpJj"],"enrUri":"enr:-L24QLwzsoKVZX4AgfsmH4T0lJ47lpcTWk5Z94sk5NOAl-y6FmEVFBFDd5F2jOeI5-Hpw3Jo2nF1azxVBapzHe6NeBgCgmlkgnY0gmlwhKwSwG-KbXVsdGlhZGRyc5YACASsEsBvBvUqAAoErBLAbwb1K90DgnJzhQADAQAAiXNlY3AyNTZrMaECCT4ygJFii1rAcmTRhARdyQJTJR62Jo4xxg7g1dLWWTiDdGNwgvUqg3VkcIL1LIV3YWt1MgE"}'
2026-02-25 20:02:41.204 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 20:02:41.204 INFO [tests.e2e.test_network_conditions] Subscribing both nodes to relay topic
2026-02-25 20:02:41.205 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:40253/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-25 20:02:41.209 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:02:41.209 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62761/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-25 20:02:41.213 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:02:41.214 INFO [tests.e2e.test_network_conditions] Waiting for autoconnection
2026-02-25 20:02:41.215 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40253/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:02:41.217 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.192.111/tcp/53186/p2p/16Uiu2HAkv3kf3x3DMc5P3rUNVapaXEBHmFJAiNJ7TKoUXUfRQpJj","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"UnknownOrigin"}]'
2026-02-25 20:02:41.218 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62761/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:02:41.220 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.208.107/tcp/40254/p2p/16Uiu2HAmDvNNwNa2Sgkmag1CBBvtqs6ZVy3YxWxerKUeSouMw3BD","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"Discv5"}]'
2026-02-25 20:02:41.220 DEBUG [src.libs.common] Sleeping for 10 seconds
2026-02-25 20:02:51.220 INFO [tests.e2e.test_network_conditions] Applying 200ms latency to node2
2026-02-25 20:02:51.222 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '4025', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-02-25 20:02:51.313 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '4025', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-02-25 20:02:51.322 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '4025', '-n', 'tc', 'qdisc', 'add', 'dev', 'eth0', 'root', 'netem', 'delay', '200ms']
2026-02-25 20:02:51.331 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:40253/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 20:02:51.335 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:02:51.336 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62761/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:02:51.740 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772049771331538713,"ephemeral":false,"proof":""}]'
2026-02-25 20:02:51.741 INFO [src.steps.network_conditions] TC exec: ['sudo', '-n', 'nsenter', '-t', '4025', '-n', 'tc', 'qdisc', 'del', 'dev', 'eth0', 'root']
2026-02-25 20:02:51.750 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-02-25 20:02:51.751 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-02-25 20:02:51.751 DEBUG [src.node.waku_node] Stopping container with id 7b40c832ba33
2026-02-25 20:02:52.201 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 20:02:52.201 DEBUG [src.node.waku_node] Stopping container with id cc176e31b56b
2026-02-25 20:02:52.666 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 20:02:52.669 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-02-25 20:02:52.677 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 20:02:52.685 DEBUG [src.node.docker_mananger] No errors found in the waku logs.