78 lines
14 KiB
Plaintext

2026-03-29 05:01:23.741 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-29 05:01:23.741 DEBUG [tests.conftest] Running test: test_store_sync_range_with_jitter_catches_old_messages with id: 2026-03-29_05-01-23__4f35fbf3-df43-42dc-955e-22fbdccf4fd3
2026-03-29 05:01:23.741 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-29 05:01:23.749 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-29 05:01:23.749 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-29_05-01-23__4f35fbf3-df43-42dc-955e-22fbdccf4fd3__wakuorg_nwaku:latest.log
2026-03-29 05:01:23.755 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-29 05:01:23.755 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-29_05-01-23__4f35fbf3-df43-42dc-955e-22fbdccf4fd3__wakuorg_nwaku:latest.log
2026-03-29 05:01:23.761 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-29 05:01:23.761 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-29_05-01-23__4f35fbf3-df43-42dc-955e-22fbdccf4fd3__wakuorg_nwaku:latest.log
2026-03-29 05:01:23.761 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-29 05:01:23.762 DEBUG [src.node.waku_node] Starting Node...
2026-03-29 05:01:23.762 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-29 05:01:23.764 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-29 05:01:23.764 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.236.139
2026-03-29 05:01:23.764 DEBUG [src.node.docker_mananger] Generated ports ['16119', '16120', '16121', '16122', '16123']
2026-03-29 05:01:23.764 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-29 05:01:23.764 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-29 05:01:23.764 DEBUG [src.node.waku_node] Using volumes []
2026-03-29 05:01:23.765 DEBUG [src.node.docker_mananger] docker run -i -t -p 16119:16119 -p 16120:16120 -p 16121:16121 -p 16122:16122 -p 16123:16123 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=16121 --rest-port=16119 --tcp-port=16120 --discv5-udp-port=16122 --rest-address=0.0.0.0 --nat=extip:172.18.236.139 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=42bd22a7bc3395a3f3ddfb6b83aba4f2ba04cbaa1ebd27e6ed82d7dbfca10b2f --store-sync=true --store=true --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=16123 --metrics-logging=true --relay=true --dns-discovery=false
2026-03-29 05:01:23.820 ERROR [src.node.docker_mananger] Max retries reached for container 773e711fcce9. Exiting log stream.
2026-03-29 05:01:23.960 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.236.139 waku 06ceb651cf77bb97a617fe6fa4d1e0a3f0f5d0912237c30216bb8e68d6fcc1a1
2026-03-29 05:01:23.994 DEBUG [src.node.docker_mananger] Container started with ID 06ceb651cf77. Setting up logs at ./log/docker/node1_2026-03-29_05-01-23__4f35fbf3-df43-42dc-955e-22fbdccf4fd3__wakuorg_nwaku:latest.log
2026-03-29 05:01:23.995 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 16119
2026-03-29 05:01:23.996 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-29 05:01:24.272 ERROR [src.node.docker_mananger] Max retries reached for container 411a91c99edb. Exiting log stream.
2026-03-29 05:01:24.997 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:16119/health" -H "Content-Type: application/json" -d 'None'
2026-03-29 05:01:25.000 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-29 05:01:25.001 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-29 05:01:25.001 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:16119/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-29 05:01:25.003 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.236.139/tcp/16120/p2p/16Uiu2HAmGr2NChbVRyyZuRzvoYCLXhazZQfr6c1fnnRQbeNmjeDd","/ip4/172.18.236.139/tcp/16121/ws/p2p/16Uiu2HAmGr2NChbVRyyZuRzvoYCLXhazZQfr6c1fnnRQbeNmjeDd"],"enrUri":"enr:-L24QJ5HLolgaL188fsb92IZJz8wkPv7zCuQUkEsjUa5fCY1dqpnKZBmr7bjUNK6biX6CwAmbDoRk0tdRjPKA-pitPUCgmlkgnY0gmlwhKwS7IuKbXVsdGlhZGRyc5YACASsEuyLBj74AAoErBLsiwY--d0DgnJzhQADAQAAiXNlY3AyNTZrMaEDPkJqci1i-9kCMy9JBxH4hQNzJmWrFvRnZuozSCgcp8CDdGNwgj74g3VkcII--oV3YWt1MhM"}'
2026-03-29 05:01:25.003 INFO [src.node.waku_node] REST service is ready !!
2026-03-29 05:01:25.004 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:16119/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-29 05:01:25.019 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-29 05:01:25.020 DEBUG [src.steps.store] Relaying message
2026-03-29 05:01:25.020 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:16119/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-29 05:01:25.024 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-29 05:01:25.024 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-29 05:01:25.225 DEBUG [src.steps.store] Relaying message
2026-03-29 05:01:25.225 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:16119/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-29 05:01:25.229 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-29 05:01:25.230 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-29 05:01:25.430 DEBUG [src.steps.store] Relaying message
2026-03-29 05:01:25.430 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:16119/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-29 05:01:25.435 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-29 05:01:25.435 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-29 05:01:50.636 DEBUG [src.node.waku_node] Starting Node...
2026-03-29 05:01:50.636 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-29 05:01:50.638 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-29 05:01:50.638 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.100.206
2026-03-29 05:01:50.638 DEBUG [src.node.docker_mananger] Generated ports ['9296', '9297', '9298', '9299', '9300']
2026-03-29 05:01:50.638 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-29 05:01:50.639 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-29 05:01:50.639 DEBUG [src.node.waku_node] Using volumes []
2026-03-29 05:01:50.639 DEBUG [src.node.docker_mananger] docker run -i -t -p 9296:9296 -p 9297:9297 -p 9298:9298 -p 9299:9299 -p 9300:9300 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=9298 --rest-port=9296 --tcp-port=9297 --discv5-udp-port=9299 --rest-address=0.0.0.0 --nat=extip:172.18.100.206 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=9bdeaecaaccf23bb2eacd523ae44b3bbe0d00dddfa9c7efbd0abf07fcc64efed --store-sync=true --store=true --store-sync-range=20 --store-sync-interval=5 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=9300 --metrics-logging=true --store-sync-relay-jitter=25 --relay=false --dns-discovery=false --discv5-bootstrap-node=enr:-L24QJ5HLolgaL188fsb92IZJz8wkPv7zCuQUkEsjUa5fCY1dqpnKZBmr7bjUNK6biX6CwAmbDoRk0tdRjPKA-pitPUCgmlkgnY0gmlwhKwS7IuKbXVsdGlhZGRyc5YACASsEuyLBj74AAoErBLsiwY--d0DgnJzhQADAQAAiXNlY3AyNTZrMaEDPkJqci1i-9kCMy9JBxH4hQNzJmWrFvRnZuozSCgcp8CDdGNwgj74g3VkcII--oV3YWt1MhM
2026-03-29 05:01:50.834 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.100.206 waku f04a5d05873426df68db6848cc246065ba0679fccb8bfd8ed0470f1782d7c5db
2026-03-29 05:01:50.874 DEBUG [src.node.docker_mananger] Container started with ID f04a5d058734. Setting up logs at ./log/docker/node2_2026-03-29_05-01-23__4f35fbf3-df43-42dc-955e-22fbdccf4fd3__wakuorg_nwaku:latest.log
2026-03-29 05:01:50.874 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 9296
2026-03-29 05:01:50.875 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-29 05:01:51.876 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9296/health" -H "Content-Type: application/json" -d 'None'
2026-03-29 05:01:51.879 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-29 05:01:51.880 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-29 05:01:51.880 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9296/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-29 05:01:51.882 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.100.206/tcp/9297/p2p/16Uiu2HAmGDKyk8tcHPLQF4sjYKSthEQ1qRJSMSAeQW87ki2syUub","/ip4/172.18.100.206/tcp/9298/ws/p2p/16Uiu2HAmGDKyk8tcHPLQF4sjYKSthEQ1qRJSMSAeQW87ki2syUub"],"enrUri":"enr:-L24QLwI5hMro0T6u2_hDRlfJX908eSNG25w-_zzIPZuK0cPKNHirOs83vDrVkzGAkv2bRM5T33QG-hnyVldwWQ317ECgmlkgnY0gmlwhKwSZM6KbXVsdGlhZGRyc5YACASsEmTOBiRRAAoErBJkzgYkUt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDNNvXOUUrCUX8eXoRHyt5tqGxAiJyEsuCZyDeRaA0ZfaDdGNwgiRRg3VkcIIkU4V3YWt1MhI"}'
2026-03-29 05:01:51.882 INFO [src.node.waku_node] REST service is ready !!
2026-03-29 05:01:51.883 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:9296/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.236.139/tcp/16120/p2p/16Uiu2HAmGr2NChbVRyyZuRzvoYCLXhazZQfr6c1fnnRQbeNmjeDd"]'
2026-03-29 05:01:51.917 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-29 05:02:01.920 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9296/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&cursor=&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-29 05:02:01.923 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x085b0d8c09e63f938615e3fbb1dc6f169dec00ce9eb618c488a34e2190a9b65a"},{"messageHash":"0x16cd4ae0c6d7dfaa078c1e2a3c9bed77248986071bb30d1256fd698e3279e051"},{"messageHash":"0x607cfec0edfb0972f680936def88068fe388a3ff6f88f401177090bc9faa5160"}]}'
2026-03-29 05:02:01.925 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-29 05:02:01.926 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-29 05:02:01.926 DEBUG [src.node.waku_node] Stopping container with id 06ceb651cf77
2026-03-29 05:02:02.375 DEBUG [src.node.waku_node] Container stopped.
2026-03-29 05:02:02.376 DEBUG [src.node.waku_node] Stopping container with id f04a5d058734
2026-03-29 05:02:02.872 DEBUG [src.node.waku_node] Container stopped.
2026-03-29 05:02:02.874 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-29 05:02:02.887 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-29 05:02:02.895 DEBUG [src.node.docker_mananger] No errors found in the waku logs.