209 lines
35 KiB
Plaintext

2025-12-11 04:17:31.040 DEBUG [tests.conftest] Running fixture setup: test_id
2025-12-11 04:17:31.041 DEBUG [tests.conftest] Running test: test_node_without_sync_or_relay_stays_empty with id: 2025-12-11_04-17-31__3176ae6c-b7a0-43a9-8b41-047051aa17bd
2025-12-11 04:17:31.041 DEBUG [src.steps.common] Running fixture setup: common_setup
2025-12-11 04:17:31.050 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-11 04:17:31.051 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2025-12-11_04-17-31__3176ae6c-b7a0-43a9-8b41-047051aa17bd__wakuorg_nwaku:latest.log
2025-12-11 04:17:31.060 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-11 04:17:31.061 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2025-12-11_04-17-31__3176ae6c-b7a0-43a9-8b41-047051aa17bd__wakuorg_nwaku:latest.log
2025-12-11 04:17:31.068 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-11 04:17:31.068 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2025-12-11_04-17-31__3176ae6c-b7a0-43a9-8b41-047051aa17bd__wakuorg_nwaku:latest.log
2025-12-11 04:17:31.069 DEBUG [src.steps.store] Running fixture setup: store_setup
2025-12-11 04:17:31.070 DEBUG [src.node.waku_node] Starting Node...
2025-12-11 04:17:31.072 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-11 04:17:31.075 DEBUG [src.node.docker_mananger] Network waku already exists
2025-12-11 04:17:31.075 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.202.252
2025-12-11 04:17:31.076 DEBUG [src.node.docker_mananger] Generated ports ['45224', '45225', '45226', '45227', '45228']
2025-12-11 04:17:31.077 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-11 04:17:31.077 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-11 04:17:31.077 DEBUG [src.node.waku_node] Using volumes []
2025-12-11 04:17:31.078 DEBUG [src.node.docker_mananger] docker run -i -t -p 45224:45224 -p 45225:45225 -p 45226:45226 -p 45227:45227 -p 45228:45228 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=45226 --rest-port=45224 --tcp-port=45225 --discv5-udp-port=45227 --rest-address=0.0.0.0 --nat=extip:172.18.202.252 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=f5ae01129fddecccea91aa79a23d4ef15f6ffe5bb36678e9bd6c87e503096a1a --store-sync=true --store=true --store-sync-range=300 --store-sync-interval=6 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=45228 --metrics-logging=true --store-sync-relay-jitter=0 --relay=true --dns-discovery=false
2025-12-11 04:17:31.258 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.202.252 waku 516a630e8394ff6356891635d917d9d58242e3d5db7f49e222975416b69e4d39
2025-12-11 04:17:31.281 ERROR [src.node.docker_mananger] Max retries reached for container 7be41912416e. Exiting log stream.
2025-12-11 04:17:31.295 DEBUG [src.node.docker_mananger] Container started with ID 516a630e8394. Setting up logs at ./log/docker/node1_2025-12-11_04-17-31__3176ae6c-b7a0-43a9-8b41-047051aa17bd__wakuorg_nwaku:latest.log
2025-12-11 04:17:31.296 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 45224
2025-12-11 04:17:31.296 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-11 04:17:31.892 ERROR [src.node.docker_mananger] Max retries reached for container 6d735cd1d852. Exiting log stream.
2025-12-11 04:17:32.297 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45224/health" -H "Content-Type: application/json" -d 'None'
2025-12-11 04:17:32.300 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2025-12-11 04:17:32.300 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-11 04:17:32.300 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45224/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-11 04:17:32.303 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.202.252/tcp/45225/p2p/16Uiu2HAm2Ds5PRzyRTAjVE5Smq5TnojnKj2dYQJVqhbJER5Sgn7q","/ip4/172.18.202.252/tcp/45226/ws/p2p/16Uiu2HAm2Ds5PRzyRTAjVE5Smq5TnojnKj2dYQJVqhbJER5Sgn7q"],"enrUri":"enr:-L24QEVdES_mY6rc_l45qMdZImIwsTjHMSOSAo-QpFeGGoKIMGgvUw7HsUPKni28Eu5RKOVAJ3hmezpIrDRArgJ149MCgmlkgnY0gmlwhKwSyvyKbXVsdGlhZGRyc5YACASsEsr8BrCpAAoErBLK_Aawqt0DgnJzhQADAQAAiXNlY3AyNTZrMaECZPtitL530V0t_warCmygmsqg2Cg0ZM06IkWYbN9XDYiDdGNwgrCpg3VkcIKwq4V3YWt1MhM"}'
2025-12-11 04:17:32.303 INFO [src.node.waku_node] REST service is ready !!
2025-12-11 04:17:32.304 DEBUG [src.steps.store] Relaying message
2025-12-11 04:17:32.304 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:17:32.316 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:32.316 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-11 04:17:32.527 DEBUG [src.steps.store] Relaying message
2025-12-11 04:17:32.527 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:17:32.531 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:32.531 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-11 04:17:32.741 DEBUG [src.steps.store] Relaying message
2025-12-11 04:17:32.742 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:17:32.745 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:32.746 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-11 04:17:32.956 DEBUG [src.steps.store] Relaying message
2025-12-11 04:17:32.956 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:17:32.960 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:32.960 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-11 04:17:33.171 DEBUG [src.steps.store] Relaying message
2025-12-11 04:17:33.171 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:17:33.175 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:33.175 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-11 04:17:33.386 DEBUG [src.steps.store] Relaying message
2025-12-11 04:17:33.386 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:17:33.390 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:33.391 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-11 04:17:33.601 DEBUG [src.steps.store] Relaying message
2025-12-11 04:17:33.601 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:17:33.605 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:33.605 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-11 04:17:33.816 DEBUG [src.steps.store] Relaying message
2025-12-11 04:17:33.816 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:17:33.820 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:33.820 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-11 04:17:34.031 DEBUG [src.steps.store] Relaying message
2025-12-11 04:17:34.031 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:17:34.034 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:34.035 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-11 04:17:34.245 DEBUG [src.steps.store] Relaying message
2025-12-11 04:17:34.246 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:17:34.250 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:34.250 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-11 04:17:34.461 DEBUG [src.steps.store] Relaying message
2025-12-11 04:17:34.461 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:17:34.465 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:34.465 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-11 04:17:34.676 DEBUG [src.steps.store] Relaying message
2025-12-11 04:17:34.676 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:17:34.679 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:34.679 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-11 04:17:34.890 DEBUG [src.steps.store] Relaying message
2025-12-11 04:17:34.890 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:17:34.894 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:34.894 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-11 04:17:35.105 DEBUG [src.steps.store] Relaying message
2025-12-11 04:17:35.105 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:17:35.108 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:35.109 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-11 04:17:35.319 DEBUG [src.steps.store] Relaying message
2025-12-11 04:17:35.319 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:17:35.323 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:35.324 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-11 04:17:35.534 DEBUG [src.steps.store] Relaying message
2025-12-11 04:17:35.535 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:17:35.538 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:35.538 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-11 04:17:35.749 DEBUG [src.steps.store] Relaying message
2025-12-11 04:17:35.749 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:17:35.753 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:35.753 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-11 04:17:35.964 DEBUG [src.steps.store] Relaying message
2025-12-11 04:17:35.964 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:17:35.968 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:35.968 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-11 04:17:36.178 DEBUG [src.steps.store] Relaying message
2025-12-11 04:17:36.179 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:17:36.182 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:36.182 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-11 04:17:36.393 DEBUG [src.steps.store] Relaying message
2025-12-11 04:17:36.393 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:17:36.397 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:36.398 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-11 04:17:36.608 DEBUG [src.steps.store] Relaying message
2025-12-11 04:17:36.608 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:17:36.612 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:36.612 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-11 04:17:36.823 DEBUG [src.steps.store] Relaying message
2025-12-11 04:17:36.823 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:17:36.826 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:36.827 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-11 04:17:37.037 DEBUG [src.steps.store] Relaying message
2025-12-11 04:17:37.038 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:17:37.041 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:37.041 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-11 04:17:37.252 DEBUG [src.steps.store] Relaying message
2025-12-11 04:17:37.252 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:17:37.256 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:37.256 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-11 04:17:37.467 DEBUG [src.steps.store] Relaying message
2025-12-11 04:17:37.467 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:17:37.471 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:37.471 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-11 04:17:37.681 DEBUG [src.steps.store] Relaying message
2025-12-11 04:17:37.682 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:17:37.685 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:37.686 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-11 04:17:37.896 DEBUG [src.steps.store] Relaying message
2025-12-11 04:17:37.896 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:17:37.900 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:37.900 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-11 04:17:38.111 DEBUG [src.steps.store] Relaying message
2025-12-11 04:17:38.111 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:17:38.116 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:38.116 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-11 04:17:38.327 DEBUG [src.steps.store] Relaying message
2025-12-11 04:17:38.327 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:17:38.331 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:38.331 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-11 04:17:38.542 DEBUG [src.steps.store] Relaying message
2025-12-11 04:17:38.542 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:17:38.546 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:38.547 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-11 04:17:38.757 DEBUG [src.node.waku_node] Starting Node...
2025-12-11 04:17:38.758 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-11 04:17:38.759 DEBUG [src.node.docker_mananger] Network waku already exists
2025-12-11 04:17:38.759 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.246.120
2025-12-11 04:17:38.760 DEBUG [src.node.docker_mananger] Generated ports ['16917', '16918', '16919', '16920', '16921']
2025-12-11 04:17:38.760 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-11 04:17:38.760 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-11 04:17:38.760 DEBUG [src.node.waku_node] Using volumes []
2025-12-11 04:17:38.760 DEBUG [src.node.docker_mananger] docker run -i -t -p 16917:16917 -p 16918:16918 -p 16919:16919 -p 16920:16920 -p 16921:16921 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=16919 --rest-port=16917 --tcp-port=16918 --discv5-udp-port=16920 --rest-address=0.0.0.0 --nat=extip:172.18.246.120 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=dc8ddf4b276815dcda358c5a8ce6f351dce066ec7eadd41b041c2ad651bf1dd5 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=16921 --metrics-logging=true --relay=false --dns-discovery=false --discv5-bootstrap-node=enr:-L24QEVdES_mY6rc_l45qMdZImIwsTjHMSOSAo-QpFeGGoKIMGgvUw7HsUPKni28Eu5RKOVAJ3hmezpIrDRArgJ149MCgmlkgnY0gmlwhKwSyvyKbXVsdGlhZGRyc5YACASsEsr8BrCpAAoErBLK_Aawqt0DgnJzhQADAQAAiXNlY3AyNTZrMaECZPtitL530V0t_warCmygmsqg2Cg0ZM06IkWYbN9XDYiDdGNwgrCpg3VkcIKwq4V3YWt1MhM
2025-12-11 04:17:38.944 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.246.120 waku dea34df0b82be0ea92594f345d7f92a3f46c36489c6233e001f9b2945a2ff4dd
2025-12-11 04:17:38.980 DEBUG [src.node.docker_mananger] Container started with ID dea34df0b82b. Setting up logs at ./log/docker/node2_2025-12-11_04-17-31__3176ae6c-b7a0-43a9-8b41-047051aa17bd__wakuorg_nwaku:latest.log
2025-12-11 04:17:38.980 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 16917
2025-12-11 04:17:38.981 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-11 04:17:39.981 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:16917/health" -H "Content-Type: application/json" -d 'None'
2025-12-11 04:17:39.985 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2025-12-11 04:17:39.985 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-11 04:17:39.986 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:16917/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-11 04:17:39.988 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.246.120/tcp/16918/p2p/16Uiu2HAmHo7RL1e7voDNJQfZmpyr8AKjceMJim45Bb9wfejqvsJj","/ip4/172.18.246.120/tcp/16919/ws/p2p/16Uiu2HAmHo7RL1e7voDNJQfZmpyr8AKjceMJim45Bb9wfejqvsJj"],"enrUri":"enr:-L24QM3m5kqrZNoEYEDhth2x320svObV-0lMfn72cgcPKx4RaTJUGIJSoKkro3cwaxEWgYQlwbE4mLIJFlW9BsgnlwICgmlkgnY0gmlwhKwS9niKbXVsdGlhZGRyc5YACASsEvZ4BkIWAAoErBL2eAZCF90DgnJzhQADAQAAiXNlY3AyNTZrMaEDTF8TI7qs5MX5Vruc3oeApi_aPHuZLoTAJ87VwgoFMtSDdGNwgkIWg3VkcIJCGIV3YWt1MgA"}'
2025-12-11 04:17:39.988 INFO [src.node.waku_node] REST service is ready !!
2025-12-11 04:17:39.988 DEBUG [src.node.waku_node] Starting Node...
2025-12-11 04:17:39.988 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-11 04:17:39.990 DEBUG [src.node.docker_mananger] Network waku already exists
2025-12-11 04:17:39.990 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.89.184
2025-12-11 04:17:39.990 DEBUG [src.node.docker_mananger] Generated ports ['60249', '60250', '60251', '60252', '60253']
2025-12-11 04:17:39.990 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-11 04:17:39.990 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-11 04:17:39.990 DEBUG [src.node.waku_node] Using volumes []
2025-12-11 04:17:39.990 DEBUG [src.node.docker_mananger] docker run -i -t -p 60249:60249 -p 60250:60250 -p 60251:60251 -p 60252:60252 -p 60253:60253 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=60251 --rest-port=60249 --tcp-port=60250 --discv5-udp-port=60252 --rest-address=0.0.0.0 --nat=extip:172.18.89.184 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=33ced460334c0fb78fbe5cdecd7a48fab6ee9da8ecff9dadcecb44ca94d59a18 --store-sync=true --store=true --store-sync-range=300 --store-sync-interval=6 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=60253 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false --discv5-bootstrap-node=enr:-L24QEVdES_mY6rc_l45qMdZImIwsTjHMSOSAo-QpFeGGoKIMGgvUw7HsUPKni28Eu5RKOVAJ3hmezpIrDRArgJ149MCgmlkgnY0gmlwhKwSyvyKbXVsdGlhZGRyc5YACASsEsr8BrCpAAoErBLK_Aawqt0DgnJzhQADAQAAiXNlY3AyNTZrMaECZPtitL530V0t_warCmygmsqg2Cg0ZM06IkWYbN9XDYiDdGNwgrCpg3VkcIKwq4V3YWt1MhM
2025-12-11 04:17:40.175 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.89.184 waku b77a5455f03a36159478ab931d06c5129498f9fd5024825b4818091fc1be07ab
2025-12-11 04:17:40.207 DEBUG [src.node.docker_mananger] Container started with ID b77a5455f03a. Setting up logs at ./log/docker/node3_2025-12-11_04-17-31__3176ae6c-b7a0-43a9-8b41-047051aa17bd__wakuorg_nwaku:latest.log
2025-12-11 04:17:40.208 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 60249
2025-12-11 04:17:40.208 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-11 04:17:41.208 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60249/health" -H "Content-Type: application/json" -d 'None'
2025-12-11 04:17:41.212 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2025-12-11 04:17:41.212 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-11 04:17:41.213 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60249/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-11 04:17:41.215 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.89.184/tcp/60250/p2p/16Uiu2HAmHffKvwyZk4YHgHsyrmLL7Nqt6ieYv5dynLcPEUoditxw","/ip4/172.18.89.184/tcp/60251/ws/p2p/16Uiu2HAmHffKvwyZk4YHgHsyrmLL7Nqt6ieYv5dynLcPEUoditxw"],"enrUri":"enr:-L24QNi0JCfRAgV3beMpPeXKRIY_t1pothI3uyJbmR_bN1NNErCv4DZYg6aPOPbWFZKWyBJWjMoTagae2Z3O3WbBpqACgmlkgnY0gmlwhKwSWbiKbXVsdGlhZGRyc5YACASsElm4ButaAAoErBJZuAbrW90DgnJzhQADAQAAiXNlY3AyNTZrMaEDSnaBbbVZK7XMFAvGSljJxgZAK7U_2VMyZPCzaKo1nYCDdGNwgutag3VkcILrXIV3YWt1MhI"}'
2025-12-11 04:17:41.215 INFO [src.node.waku_node] REST service is ready !!
2025-12-11 04:17:41.216 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:60249/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.202.252/tcp/45225/p2p/16Uiu2HAm2Ds5PRzyRTAjVE5Smq5TnojnKj2dYQJVqhbJER5Sgn7q"]'
2025-12-11 04:17:41.251 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:17:59.252 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60249/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&cursor=&pageSize=200&ascending=true&peer_id=" -H "Content-Type: application/json" -d 'None'
2025-12-11 04:17:59.256 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x2d398a520b47032ed9a85cdc957ce655613d4403cb08d4029615bed169595653"},{"messageHash":"0x27cf2f2aa41b3fefab38f005b064949495602761704a6b89988ae50195d0c64d"},{"messageHash":"0x83c6dfe12c840e6e04c4eb22ac116c8b14f1a378e1ea175d15d42d280cbb5b7b"},{"messageHash":"0x69db10259530c3c3f0ee73e5a58ee5d3f6e74305ca8aa83cabdc79149050584d"},{"messageHash":"0x89bc95292f9a5e5328bdc1afb62cf7cc526e35d30ec83bd99aeb506146374c3e"},{"messageHash":"0x359e7001241f380c975cf37e1a3f49f0b6687a888e40d457a4f753bc9f387538"},{"messageHash":"0xdc96b6823c98dd99a72e2550f247a42d4afcc7583d5c376e49ac6e4e8cf97b8b"},{"messageHash":"0x3c2ffc8ddced76aecdfa7eed809c489d6b0cc7c7d37823cbf84a170d236380d9"},{"messageHash":"0x20316e50c2c5cb082ab8fbc62c6489642a4d6e9327b6b445fdb64b5b41fa85ad"},{"messageHash":"0x0030793ee189d66e3b4a3a7ee49fbd028a23382f73dcea1bc1f7541e0bdfa2cc"},{"messageHash":"0x39c91f2237da40ce26b57db8f8ccee8388d02b85a5f6427291f658cd9977b400"},{"messageHash":"0xb699531862cdffe60c9ddcad5f181a048f1e7db632de3f3581a3d3b1c0ebe3a5"},{"messageHash":"0xa5ae6d5cdea783ae84cccefd4be4990d826bfe58033cc093832cb9af483a310b"},{"messageHash":"0xe95242d243935475713cf514a39a07fb2a5b6d7a57217094798aa3b6a2a79b00"},{"messageHash":"0xb7ae989753b999b82611872c5890084e6d5792d76d2dfde9d2ed89adf81bc127"},{"messageHash":"0x4030d87c295164b85b139cb83193be59a342823328b3b31b813552c375f6a56f"},{"messageHash":"0x2542558abc29432c0bb241988b12398e59dbffddc96887ef0458a6ea65a1eddf"},{"messageHash":"0x95b3f05a271b028f8f5d558265f2c40dd3698b6e030051d71d0d6328c5ff3112"},{"messageHash":"0x7858d85ecae7ccc590c22b77bab23d2eb2e4376656fa949fbedd43226aa4f170"},{"messageHash":"0x558f0e051c6224d724e4b0d2d983b0a816914d94c21fcbcec58696308d6367fb"},{"messageHash":"0x48ffa65811090c4a52b50beb20abed7d62d3d7cb636bb1698308d9b34e29b396"},{"messageHash":"0x10951cfb2b4ef087c05401ba82ca727c2caaa7bf3ea95177583b0c11f0683d0e"},{"messageHash":"0x5afa996dde4721c737d42ee51dbf3f99d00a71233edef0777a87c66ba4aea5eb"},{"messageHash":"0x914399a44a991fcd627e2af4fbb038f6718e55fd68d84fba7e2369cf67d6146a"},{"messageHash":"0x4bb5e914ddf40a0fd83e51428c852c74a527d9b98cc5dc7f3d286bf3b199b494"},{"messageHash":"0x1e858fedc0a378ca0ed3a22125f0b0a46297871ac93e4ff7c1e67b0f18f58b5d"},{"messageHash":"0xfd12b1e349b5baf4f4ae798d61102db3a34d707492926bbec286b8770981e3c1"},{"messageHash":"0x61a5c2d1dca4e73ff322f5acf88e18b4b396c241da4e105a1ab806eec1b53228"},{"messageHash":"0xc8a2791e2f1fd65baac24269ab97d5d5e630d0612da5c71f459dfbbb6cb46b61"},{"messageHash":"0xea9ee783d7010ce60b32d2ecb37adf6fa36d8816e098d7690af8014fc0910950"}]}'
2025-12-11 04:17:59.256 DEBUG [tests.store_sync.test_store_sync] Node3 store has 30 messages expected 30
2025-12-11 04:17:59.258 DEBUG [tests.conftest] Running fixture teardown: test_setup
2025-12-11 04:17:59.259 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2025-12-11 04:17:59.259 DEBUG [src.node.waku_node] Stopping container with id 516a630e8394
2025-12-11 04:17:59.881 DEBUG [src.node.waku_node] Container stopped.
2025-12-11 04:17:59.881 DEBUG [src.node.waku_node] Stopping container with id dea34df0b82b
2025-12-11 04:18:00.475 DEBUG [src.node.waku_node] Container stopped.
2025-12-11 04:18:00.476 DEBUG [src.node.waku_node] Stopping container with id b77a5455f03a
2025-12-11 04:18:00.693 ERROR [src.node.docker_mananger] Max retries reached for container 516a630e8394. Exiting log stream.
2025-12-11 04:18:01.285 ERROR [src.node.docker_mananger] Max retries reached for container dea34df0b82b. Exiting log stream.
2025-12-11 04:18:11.033 DEBUG [src.node.waku_node] Container stopped.
2025-12-11 04:18:11.036 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2025-12-11 04:18:11.052 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2025-12-11 04:18:11.054 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2025-12-11 04:18:11.068 DEBUG [src.node.docker_mananger] No errors found in the waku logs.