209 lines
35 KiB
Plaintext

2026-01-02 04:33:55.481 DEBUG [tests.conftest] Running fixture setup: test_id
2026-01-02 04:33:55.481 DEBUG [tests.conftest] Running test: test_node_without_sync_or_relay_stays_empty with id: 2026-01-02_04-33-55__96ad9571-e50d-4297-80e5-3ca6a54f96ff
2026-01-02 04:33:55.481 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-01-02 04:33:55.488 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-01-02 04:33:55.488 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-01-02_04-33-55__96ad9571-e50d-4297-80e5-3ca6a54f96ff__wakuorg_nwaku:latest.log
2026-01-02 04:33:55.493 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-01-02 04:33:55.494 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-01-02_04-33-55__96ad9571-e50d-4297-80e5-3ca6a54f96ff__wakuorg_nwaku:latest.log
2026-01-02 04:33:55.499 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-01-02 04:33:55.499 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-01-02_04-33-55__96ad9571-e50d-4297-80e5-3ca6a54f96ff__wakuorg_nwaku:latest.log
2026-01-02 04:33:55.499 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-01-02 04:33:55.500 DEBUG [src.node.waku_node] Starting Node...
2026-01-02 04:33:55.500 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-01-02 04:33:55.502 DEBUG [src.node.docker_mananger] Network waku already exists
2026-01-02 04:33:55.502 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.175.212
2026-01-02 04:33:55.502 DEBUG [src.node.docker_mananger] Generated ports ['43337', '43338', '43339', '43340', '43341']
2026-01-02 04:33:55.502 DEBUG [src.node.waku_node] RLN credentials were not set
2026-01-02 04:33:55.502 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-01-02 04:33:55.502 DEBUG [src.node.waku_node] Using volumes []
2026-01-02 04:33:55.502 DEBUG [src.node.docker_mananger] docker run -i -t -p 43337:43337 -p 43338:43338 -p 43339:43339 -p 43340:43340 -p 43341:43341 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=43339 --rest-port=43337 --tcp-port=43338 --discv5-udp-port=43340 --rest-address=0.0.0.0 --nat=extip:172.18.175.212 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=9af785699aca4b6b8b85c3ce27e7a32cbc232ad81a0d1f5f6197c6dbee365db8 --store-sync=true --store=true --store-sync-range=300 --store-sync-interval=6 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=43341 --metrics-logging=true --store-sync-relay-jitter=0 --relay=true --dns-discovery=false
2026-01-02 04:33:55.687 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.175.212 waku dcc9938e7425e4884d8bc852725448e0ece4076a586f507efef25595bd1d58c2
2026-01-02 04:33:55.719 DEBUG [src.node.docker_mananger] Container started with ID dcc9938e7425. Setting up logs at ./log/docker/node1_2026-01-02_04-33-55__96ad9571-e50d-4297-80e5-3ca6a54f96ff__wakuorg_nwaku:latest.log
2026-01-02 04:33:55.720 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 43337
2026-01-02 04:33:55.721 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-01-02 04:33:55.731 ERROR [src.node.docker_mananger] Max retries reached for container 2cb490fe5dc8. Exiting log stream.
2026-01-02 04:33:56.277 ERROR [src.node.docker_mananger] Max retries reached for container 74ad0200c179. Exiting log stream.
2026-01-02 04:33:56.722 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43337/health" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:33:56.726 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-01-02 04:33:56.726 INFO [src.node.waku_node] Node protocols are initialized !!
2026-01-02 04:33:56.726 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43337/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:33:56.728 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.175.212/tcp/43338/p2p/16Uiu2HAmDbz1kRHxefsrQcrm4rcYaczwVWwh8BQHKWUH9dzoufip","/ip4/172.18.175.212/tcp/43339/ws/p2p/16Uiu2HAmDbz1kRHxefsrQcrm4rcYaczwVWwh8BQHKWUH9dzoufip"],"enrUri":"enr:-L24QN1PJ3lRmWhfxdASJOg7a4Krtk1QoasYB6P1ejact3_bNjZmw3UbR_ZMheFiElIrKIaSy4uimfsohBtRCd4RCjoCgmlkgnY0gmlwhKwSr9SKbXVsdGlhZGRyc5YACASsEq_UBqlKAAoErBKv1AapS90DgnJzhQADAQAAiXNlY3AyNTZrMaEDDhaQRXhmAD3gvqx7dyb9VRuxW3x1FF1bxS88ksHpPXGDdGNwgqlKg3VkcIKpTIV3YWt1MhM"}'
2026-01-02 04:33:56.729 INFO [src.node.waku_node] REST service is ready !!
2026-01-02 04:33:56.729 DEBUG [src.steps.store] Relaying message
2026-01-02 04:33:56.729 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43337/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:33:56.745 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:33:56.746 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:33:56.956 DEBUG [src.steps.store] Relaying message
2026-01-02 04:33:56.957 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43337/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:33:56.961 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:33:56.961 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:33:57.172 DEBUG [src.steps.store] Relaying message
2026-01-02 04:33:57.172 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43337/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:33:57.176 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:33:57.176 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:33:57.387 DEBUG [src.steps.store] Relaying message
2026-01-02 04:33:57.387 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43337/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:33:57.391 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:33:57.391 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:33:57.602 DEBUG [src.steps.store] Relaying message
2026-01-02 04:33:57.602 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43337/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:33:57.606 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:33:57.607 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:33:57.817 DEBUG [src.steps.store] Relaying message
2026-01-02 04:33:57.818 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43337/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:33:57.822 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:33:57.822 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:33:58.033 DEBUG [src.steps.store] Relaying message
2026-01-02 04:33:58.033 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43337/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:33:58.037 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:33:58.037 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:33:58.248 DEBUG [src.steps.store] Relaying message
2026-01-02 04:33:58.248 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43337/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:33:58.252 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:33:58.252 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:33:58.462 DEBUG [src.steps.store] Relaying message
2026-01-02 04:33:58.463 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43337/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:33:58.466 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:33:58.467 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:33:58.677 DEBUG [src.steps.store] Relaying message
2026-01-02 04:33:58.678 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43337/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:33:58.681 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:33:58.682 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:33:58.892 DEBUG [src.steps.store] Relaying message
2026-01-02 04:33:58.893 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43337/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:33:58.896 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:33:58.896 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:33:59.107 DEBUG [src.steps.store] Relaying message
2026-01-02 04:33:59.107 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43337/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:33:59.111 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:33:59.111 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:33:59.321 DEBUG [src.steps.store] Relaying message
2026-01-02 04:33:59.322 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43337/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:33:59.325 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:33:59.325 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:33:59.536 DEBUG [src.steps.store] Relaying message
2026-01-02 04:33:59.536 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43337/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:33:59.540 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:33:59.540 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:33:59.751 DEBUG [src.steps.store] Relaying message
2026-01-02 04:33:59.751 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43337/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:33:59.755 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:33:59.755 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:33:59.966 DEBUG [src.steps.store] Relaying message
2026-01-02 04:33:59.966 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43337/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:33:59.969 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:33:59.970 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:34:00.180 DEBUG [src.steps.store] Relaying message
2026-01-02 04:34:00.181 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43337/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:34:00.185 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:34:00.185 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:34:00.395 DEBUG [src.steps.store] Relaying message
2026-01-02 04:34:00.396 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43337/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:34:00.399 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:34:00.400 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:34:00.610 DEBUG [src.steps.store] Relaying message
2026-01-02 04:34:00.611 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43337/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:34:00.615 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:34:00.615 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:34:00.826 DEBUG [src.steps.store] Relaying message
2026-01-02 04:34:00.826 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43337/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:34:00.829 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:34:00.830 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:34:01.040 DEBUG [src.steps.store] Relaying message
2026-01-02 04:34:01.041 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43337/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:34:01.044 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:34:01.045 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:34:01.255 DEBUG [src.steps.store] Relaying message
2026-01-02 04:34:01.255 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43337/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:34:01.259 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:34:01.260 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:34:01.470 DEBUG [src.steps.store] Relaying message
2026-01-02 04:34:01.470 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43337/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:34:01.474 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:34:01.474 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:34:01.685 DEBUG [src.steps.store] Relaying message
2026-01-02 04:34:01.685 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43337/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:34:01.689 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:34:01.689 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:34:01.900 DEBUG [src.steps.store] Relaying message
2026-01-02 04:34:01.900 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43337/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:34:01.904 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:34:01.904 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:34:02.115 DEBUG [src.steps.store] Relaying message
2026-01-02 04:34:02.115 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43337/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:34:02.119 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:34:02.119 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:34:02.330 DEBUG [src.steps.store] Relaying message
2026-01-02 04:34:02.330 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43337/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:34:02.334 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:34:02.334 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:34:02.545 DEBUG [src.steps.store] Relaying message
2026-01-02 04:34:02.545 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43337/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:34:02.549 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:34:02.549 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:34:02.760 DEBUG [src.steps.store] Relaying message
2026-01-02 04:34:02.760 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43337/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:34:02.764 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:34:02.764 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:34:02.975 DEBUG [src.steps.store] Relaying message
2026-01-02 04:34:02.975 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43337/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:34:02.979 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:34:02.979 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-02 04:34:03.189 DEBUG [src.node.waku_node] Starting Node...
2026-01-02 04:34:03.189 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-01-02 04:34:03.191 DEBUG [src.node.docker_mananger] Network waku already exists
2026-01-02 04:34:03.191 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.87.77
2026-01-02 04:34:03.191 DEBUG [src.node.docker_mananger] Generated ports ['2970', '2971', '2972', '2973', '2974']
2026-01-02 04:34:03.191 DEBUG [src.node.waku_node] RLN credentials were not set
2026-01-02 04:34:03.192 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-01-02 04:34:03.192 DEBUG [src.node.waku_node] Using volumes []
2026-01-02 04:34:03.192 DEBUG [src.node.docker_mananger] docker run -i -t -p 2970:2970 -p 2971:2971 -p 2972:2972 -p 2973:2973 -p 2974:2974 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=2972 --rest-port=2970 --tcp-port=2971 --discv5-udp-port=2973 --rest-address=0.0.0.0 --nat=extip:172.18.87.77 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=fabf7dd1dc55ca3d4bb4a6de85df028adb56cd334b2c37df62929ef509cc4af9 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=2974 --metrics-logging=true --relay=false --dns-discovery=false --discv5-bootstrap-node=enr:-L24QN1PJ3lRmWhfxdASJOg7a4Krtk1QoasYB6P1ejact3_bNjZmw3UbR_ZMheFiElIrKIaSy4uimfsohBtRCd4RCjoCgmlkgnY0gmlwhKwSr9SKbXVsdGlhZGRyc5YACASsEq_UBqlKAAoErBKv1AapS90DgnJzhQADAQAAiXNlY3AyNTZrMaEDDhaQRXhmAD3gvqx7dyb9VRuxW3x1FF1bxS88ksHpPXGDdGNwgqlKg3VkcIKpTIV3YWt1MhM
2026-01-02 04:34:03.398 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.87.77 waku 0ada6da20e61f206e440ad70c7538f01da0be3700d875e7c26642dd2e88271a4
2026-01-02 04:34:03.429 DEBUG [src.node.docker_mananger] Container started with ID 0ada6da20e61. Setting up logs at ./log/docker/node2_2026-01-02_04-33-55__96ad9571-e50d-4297-80e5-3ca6a54f96ff__wakuorg_nwaku:latest.log
2026-01-02 04:34:03.429 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 2970
2026-01-02 04:34:03.429 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-01-02 04:34:04.430 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2970/health" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:34:04.433 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-01-02 04:34:04.434 INFO [src.node.waku_node] Node protocols are initialized !!
2026-01-02 04:34:04.434 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2970/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:34:04.436 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.87.77/tcp/2971/p2p/16Uiu2HAmCv4cEXipRv2tMW7ow8Xdq1bLSuuUn9M33aCUes3W6y68","/ip4/172.18.87.77/tcp/2972/ws/p2p/16Uiu2HAmCv4cEXipRv2tMW7ow8Xdq1bLSuuUn9M33aCUes3W6y68"],"enrUri":"enr:-L24QPL06cVfnNJnrIJsHH8b4JqsBtBgKrYrp21-muzJAGiGKNAIvnN96UqSxuR0JvXaywUp4F3DthMsejfNLb0GWZMCgmlkgnY0gmlwhKwSV02KbXVsdGlhZGRyc5YACASsEldNBgubAAoErBJXTQYLnN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDA9yGurKg_YDUrgDfKkMTrpLhseQ3e4bmVUUqCXvqs-GDdGNwggubg3VkcIILnYV3YWt1MgA"}'
2026-01-02 04:34:04.436 INFO [src.node.waku_node] REST service is ready !!
2026-01-02 04:34:04.437 DEBUG [src.node.waku_node] Starting Node...
2026-01-02 04:34:04.437 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-01-02 04:34:04.438 DEBUG [src.node.docker_mananger] Network waku already exists
2026-01-02 04:34:04.438 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.224.160
2026-01-02 04:34:04.439 DEBUG [src.node.docker_mananger] Generated ports ['35663', '35664', '35665', '35666', '35667']
2026-01-02 04:34:04.439 DEBUG [src.node.waku_node] RLN credentials were not set
2026-01-02 04:34:04.439 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-01-02 04:34:04.439 DEBUG [src.node.waku_node] Using volumes []
2026-01-02 04:34:04.439 DEBUG [src.node.docker_mananger] docker run -i -t -p 35663:35663 -p 35664:35664 -p 35665:35665 -p 35666:35666 -p 35667:35667 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=35665 --rest-port=35663 --tcp-port=35664 --discv5-udp-port=35666 --rest-address=0.0.0.0 --nat=extip:172.18.224.160 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=41b5e1890a9ab6ca55a5bf13ee8c15690dad7b060b946ae85e5fea1a1fb29cfc --store-sync=true --store=true --store-sync-range=300 --store-sync-interval=6 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=35667 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false --discv5-bootstrap-node=enr:-L24QN1PJ3lRmWhfxdASJOg7a4Krtk1QoasYB6P1ejact3_bNjZmw3UbR_ZMheFiElIrKIaSy4uimfsohBtRCd4RCjoCgmlkgnY0gmlwhKwSr9SKbXVsdGlhZGRyc5YACASsEq_UBqlKAAoErBKv1AapS90DgnJzhQADAQAAiXNlY3AyNTZrMaEDDhaQRXhmAD3gvqx7dyb9VRuxW3x1FF1bxS88ksHpPXGDdGNwgqlKg3VkcIKpTIV3YWt1MhM
2026-01-02 04:34:04.625 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.224.160 waku 390da66d4fa757fc52bb9b4af9697f9881611dc9e16f725ae8cd4bb6540712c1
2026-01-02 04:34:04.658 DEBUG [src.node.docker_mananger] Container started with ID 390da66d4fa7. Setting up logs at ./log/docker/node3_2026-01-02_04-33-55__96ad9571-e50d-4297-80e5-3ca6a54f96ff__wakuorg_nwaku:latest.log
2026-01-02 04:34:04.658 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 35663
2026-01-02 04:34:04.658 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-01-02 04:34:05.659 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35663/health" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:34:05.663 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-01-02 04:34:05.663 INFO [src.node.waku_node] Node protocols are initialized !!
2026-01-02 04:34:05.663 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35663/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:34:05.665 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.224.160/tcp/35664/p2p/16Uiu2HAm9beWY7doweF8dPRqZoKrFcBUc1RJXsWyfV9NV7ZWm86S","/ip4/172.18.224.160/tcp/35665/ws/p2p/16Uiu2HAm9beWY7doweF8dPRqZoKrFcBUc1RJXsWyfV9NV7ZWm86S"],"enrUri":"enr:-L24QAVF8hfGk03zh3trLP2855y1tRCvHlc4vtYRoIFSVs6XGqtY7PpDz2soqjmIuYTv-rMvo00vaGlrRIy69XZ33qwCgmlkgnY0gmlwhKwS4KCKbXVsdGlhZGRyc5YACASsEuCgBotQAAoErBLgoAaLUd0DgnJzhQADAQAAiXNlY3AyNTZrMaEC0pHDU9_qcuiDL1ujD12KB0xBdIyTN0dtCM2TeNTNO2eDdGNwgotQg3VkcIKLUoV3YWt1MhI"}'
2026-01-02 04:34:05.665 INFO [src.node.waku_node] REST service is ready !!
2026-01-02 04:34:05.666 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35663/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.175.212/tcp/43338/p2p/16Uiu2HAmDbz1kRHxefsrQcrm4rcYaczwVWwh8BQHKWUH9dzoufip"]'
2026-01-02 04:34:05.695 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:34:23.696 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35663/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&cursor=&pageSize=200&ascending=true&peer_id=" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:34:23.700 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0xfe158f8c5df5bf1e3234f0c18d8eca17a0b3d7f446860bf2bee02a8379ff812f"},{"messageHash":"0x54d2581b0b81cbbc1c53b59b5ebac4899dea1753ba14c6335b51a00ffc7e5d7b"},{"messageHash":"0xe7195296ab095a2b106a6c21ce2eee467f0cedab5e0e1985c0bb8df24458c8c1"},{"messageHash":"0xe63aae071da02e67c32722f0973f085b8b7a00ec3d78881d271b0243315eeb2f"},{"messageHash":"0xa71987de99ebdc7eb77dce2f95d0286a35cef75e6ffb25eeb945135ac329f7ab"},{"messageHash":"0x3f2e3a78999112fa1c6e57867207ec17be35c501871131b2adf7e4a1c2d9653f"},{"messageHash":"0xc5849ea8487ec798b8b9b7ee16ba9f8bdad74a85a0656a86e095e47f7b2efea5"},{"messageHash":"0xecd72f02b7fda0d6c7c127eecb9b43bb30e6555fa0a8aaa60e902926636ca284"},{"messageHash":"0x9cbb3d266707d5c4aab0fc816b435f5b7d3d2ef415363e921a56f74714269ad5"},{"messageHash":"0xd6ce92ecf5e938b5ed1c6940c5c5cf29a507228a8e128043368025d225f1f513"},{"messageHash":"0x427c38edefab60e8134a3670a1363ca52ee48d140f71b7de5d82b53c5684568f"},{"messageHash":"0x93be0a0892887c92107ceb7628419a3796ec761b63b58edf20b967941dac362a"},{"messageHash":"0x5b806a19af31c275fe5d2960bd05fc3a1a350c382c39f7e770230eb6761a4782"},{"messageHash":"0xa68b585fe5a4a53331e99ebe6b3b52260db6a7e2635a925e76dfab609f21011a"},{"messageHash":"0xd4c462641fb60099f73dc39a20debad386801cf3e71213fc633579a7be5e7371"},{"messageHash":"0xabce4a9adfb63ad3f75106f44180b73554f7f59587e5af7c8084b267b95a29a4"},{"messageHash":"0xd58a2b5749d1d42786f69e687b674cc244625a31d80f304d6e905a447336b101"},{"messageHash":"0x012d1d8f98dc408bc6498463b4036e9765ef3593368bbed50337fda8534605f1"},{"messageHash":"0x24d41484054fd80dde1976403750e9945f02be6faac070e2fa9fb95788891359"},{"messageHash":"0xfb73e60aaba082adc524f2d18a38fdeaf014000cb78a5be8db57a4bc280f20d2"},{"messageHash":"0x5826bb02a83f98bedb9c4d96b25609928694fb3ab3f6c61608181651951a67ad"},{"messageHash":"0xdee811b2fba9998d8ca3b8ab105ff2988af257d34c7c3b2ae12f3f58a5b4ea8a"},{"messageHash":"0x5a4aa84d61fe0e550701a19701cc4ff3f00f6445b5bec9684e6e778cbbe32e17"},{"messageHash":"0x96c9c92358933a6e869c9e8d1f242f47ba0084cf90238a6d99efe8f426e09dc5"},{"messageHash":"0xb61a866586d91176f8a5eebd9cb20891756a5876b80d58129c53ab96267fe0ef"},{"messageHash":"0x4abbe9648ece7bb60c8da2d4470be522633a7d31926975b713a79de33881f78d"},{"messageHash":"0x093cc978d14f1fabae0c53f6c2b554551e46d506542a348665f6e9c929f1a70a"},{"messageHash":"0x51a07b422702251fb924acc616ed2767eb069fd4e7e35583e4803705209a05ef"},{"messageHash":"0x01fc7d8546cb70607782a9ed8de9d07ba9a62b60f55e11cd06aeab7479859f8c"},{"messageHash":"0x2b4115bf9af76c0c9293a6e26b86b7d3e6b14e297ee7b5c58e24d51002828032"}]}'
2026-01-02 04:34:23.700 DEBUG [tests.store_sync.test_store_sync] Node3 store has 30 messages expected 30
2026-01-02 04:34:23.701 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-01-02 04:34:23.703 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-01-02 04:34:23.703 DEBUG [src.node.waku_node] Stopping container with id dcc9938e7425
2026-01-02 04:34:24.246 DEBUG [src.node.waku_node] Container stopped.
2026-01-02 04:34:24.246 DEBUG [src.node.waku_node] Stopping container with id 0ada6da20e61
2026-01-02 04:34:24.794 DEBUG [src.node.waku_node] Container stopped.
2026-01-02 04:34:24.795 DEBUG [src.node.waku_node] Stopping container with id 390da66d4fa7
2026-01-02 04:34:25.058 ERROR [src.node.docker_mananger] Max retries reached for container dcc9938e7425. Exiting log stream.
2026-01-02 04:34:25.612 ERROR [src.node.docker_mananger] Max retries reached for container 0ada6da20e61. Exiting log stream.
2026-01-02 04:34:35.384 DEBUG [src.node.waku_node] Container stopped.
2026-01-02 04:34:35.385 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-01-02 04:34:35.403 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-01-02 04:34:35.406 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-01-02 04:34:35.417 DEBUG [src.node.docker_mananger] No errors found in the waku logs.