338 lines
50 KiB
Plaintext

2026-03-20 04:39:13.085 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-20 04:39:13.085 DEBUG [tests.conftest] Running test: test_three_store_sync_exchange with id: 2026-03-20_04-39-13__02fa4ccf-2b73-4d45-8230-60a6f99ac60b
2026-03-20 04:39:13.086 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-20 04:39:13.093 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-20 04:39:13.093 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-20_04-39-13__02fa4ccf-2b73-4d45-8230-60a6f99ac60b__wakuorg_nwaku:latest.log
2026-03-20 04:39:13.099 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-20 04:39:13.099 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-20_04-39-13__02fa4ccf-2b73-4d45-8230-60a6f99ac60b__wakuorg_nwaku:latest.log
2026-03-20 04:39:13.105 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-20 04:39:13.105 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-20_04-39-13__02fa4ccf-2b73-4d45-8230-60a6f99ac60b__wakuorg_nwaku:latest.log
2026-03-20 04:39:13.106 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-20 04:39:13.106 DEBUG [src.node.waku_node] Starting Node...
2026-03-20 04:39:13.107 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-20 04:39:13.108 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-20 04:39:13.108 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.234.66
2026-03-20 04:39:13.108 DEBUG [src.node.docker_mananger] Generated ports ['30307', '30308', '30309', '30310', '30311']
2026-03-20 04:39:13.108 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-20 04:39:13.109 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-20 04:39:13.109 DEBUG [src.node.waku_node] Using volumes []
2026-03-20 04:39:13.109 DEBUG [src.node.docker_mananger] docker run -i -t -p 30307:30307 -p 30308:30308 -p 30309:30309 -p 30310:30310 -p 30311:30311 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=30309 --rest-port=30307 --tcp-port=30308 --discv5-udp-port=30310 --rest-address=0.0.0.0 --nat=extip:172.18.234.66 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ee26d38a950de8c35c95c1bd9a3d14732377b5197483c95abe7dd186bafaef5c --store-sync=true --store=true --store-sync-range=600 --store-sync-interval=6 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=30311 --metrics-logging=true --store-sync-relay-jitter=0 --relay=true --dns-discovery=false
2026-03-20 04:39:13.305 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.234.66 waku 57c2f5acf9f8799608b7fad646878b205a1f723e3c5b1587d25001453f349478
2026-03-20 04:39:13.318 ERROR [src.node.docker_mananger] Max retries reached for container 6427310adff6. Exiting log stream.
2026-03-20 04:39:13.343 DEBUG [src.node.docker_mananger] Container started with ID 57c2f5acf9f8. Setting up logs at ./log/docker/node1_2026-03-20_04-39-13__02fa4ccf-2b73-4d45-8230-60a6f99ac60b__wakuorg_nwaku:latest.log
2026-03-20 04:39:13.344 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 30307
2026-03-20 04:39:13.344 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-20 04:39:13.885 ERROR [src.node.docker_mananger] Max retries reached for container fdd414684079. Exiting log stream.
2026-03-20 04:39:14.344 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30307/health" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:39:14.347 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-20 04:39:14.348 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-20 04:39:14.348 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30307/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:39:14.350 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.234.66/tcp/30308/p2p/16Uiu2HAm5iftHdX2xrKwjDComJomwfAZG9WyTCkYNK9EvNWXJnMZ","/ip4/172.18.234.66/tcp/30309/ws/p2p/16Uiu2HAm5iftHdX2xrKwjDComJomwfAZG9WyTCkYNK9EvNWXJnMZ"],"enrUri":"enr:-L24QPwC8Tp3Fz96hQouq2kuLiedH9NYkSwOn0dAPkh__BrWDP12LgXY_iwAh0MKMRZnj20n6qrpWJWlGqisVo-0X9ACgmlkgnY0gmlwhKwS6kKKbXVsdGlhZGRyc5YACASsEupCBnZkAAoErBLqQgZ2Zd0DgnJzhQADAQAAiXNlY3AyNTZrMaECmO-iu-Bb315R5L50DKRrdfQPMrmtHc_9LO17-5zVGGSDdGNwgnZkg3VkcIJ2ZoV3YWt1MhM"}'
2026-03-20 04:39:14.350 INFO [src.node.waku_node] REST service is ready !!
2026-03-20 04:39:14.351 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:14.351 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30307/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:14.367 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:14.368 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:14.578 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:14.579 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30307/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:14.583 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:14.583 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:14.794 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:14.794 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30307/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:14.798 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:14.798 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:15.009 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:15.009 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30307/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:15.013 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:15.014 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:15.224 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:15.225 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30307/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:15.229 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:15.229 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:15.439 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:15.440 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30307/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:15.444 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:15.444 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:15.655 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:15.655 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30307/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:15.659 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:15.660 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:15.870 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:15.871 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30307/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:15.874 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:15.875 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:16.085 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:16.086 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30307/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:16.090 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:16.090 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:16.301 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:16.301 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30307/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:16.305 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:16.305 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:16.516 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:16.516 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30307/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:16.521 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:16.521 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:16.732 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:16.732 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30307/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:16.736 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:16.736 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:16.947 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:16.947 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30307/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:16.952 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:16.952 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:17.163 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:17.163 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30307/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:17.167 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:17.168 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:17.378 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:17.379 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30307/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:17.383 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:17.384 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:17.594 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:17.595 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30307/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:17.599 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:17.599 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:17.810 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:17.810 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30307/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:17.815 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:17.815 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:18.026 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:18.026 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30307/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:18.030 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:18.030 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:18.241 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:18.241 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30307/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:18.245 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:18.245 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:18.456 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:18.456 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30307/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:18.460 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:18.461 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:18.671 DEBUG [src.node.waku_node] Starting Node...
2026-03-20 04:39:18.671 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-20 04:39:18.673 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-20 04:39:18.673 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.60.31
2026-03-20 04:39:18.673 DEBUG [src.node.docker_mananger] Generated ports ['20506', '20507', '20508', '20509', '20510']
2026-03-20 04:39:18.674 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-20 04:39:18.674 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-20 04:39:18.674 DEBUG [src.node.waku_node] Using volumes []
2026-03-20 04:39:18.674 DEBUG [src.node.docker_mananger] docker run -i -t -p 20506:20506 -p 20507:20507 -p 20508:20508 -p 20509:20509 -p 20510:20510 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=20508 --rest-port=20506 --tcp-port=20507 --discv5-udp-port=20509 --rest-address=0.0.0.0 --nat=extip:172.18.60.31 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=d4c0e720aa9e94db839cc9aa3abeacbaffea12e9bef0ca07b6a5ce6be335ecef --store-sync=true --store=true --store-sync-range=600 --store-sync-interval=6 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=20510 --metrics-logging=true --store-sync-relay-jitter=0 --relay=true --dns-discovery=false
2026-03-20 04:39:18.871 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.60.31 waku 3cf18fbcb9b4ffc914726027f8bc366e59023dea21f8706bab52c429c6687553
2026-03-20 04:39:18.906 DEBUG [src.node.docker_mananger] Container started with ID 3cf18fbcb9b4. Setting up logs at ./log/docker/node2_2026-03-20_04-39-13__02fa4ccf-2b73-4d45-8230-60a6f99ac60b__wakuorg_nwaku:latest.log
2026-03-20 04:39:18.906 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 20506
2026-03-20 04:39:18.906 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-20 04:39:19.907 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20506/health" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:39:19.910 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-20 04:39:19.910 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-20 04:39:19.910 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20506/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:39:19.912 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.60.31/tcp/20507/p2p/16Uiu2HAm7ktbBfRF2GgFfyyC33kvnxjffTF4yDc7ma3DXHym8HXB","/ip4/172.18.60.31/tcp/20508/ws/p2p/16Uiu2HAm7ktbBfRF2GgFfyyC33kvnxjffTF4yDc7ma3DXHym8HXB"],"enrUri":"enr:-L24QEss6W8ELVVYnfycaHFx6pudwbvXkQhZ7CSH2lm_nEpaHEBxwCpP6JKX-KkOhFD7aN-l1FkYnuM2iU2bDjxOMU8CgmlkgnY0gmlwhKwSPB-KbXVsdGlhZGRyc5YACASsEjwfBlAbAAoErBI8HwZQHN0DgnJzhQADAQAAiXNlY3AyNTZrMaECtziJcNjKwYVL2D0CsgghnjtLiMBTfnRRMjYqYCsqTO6DdGNwglAbg3VkcIJQHYV3YWt1MhM"}'
2026-03-20 04:39:19.913 INFO [src.node.waku_node] REST service is ready !!
2026-03-20 04:39:19.913 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:19.913 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20506/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:19.933 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:19.933 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:20.144 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:20.144 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20506/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:20.148 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:20.148 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:20.359 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:20.359 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20506/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:20.363 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:20.363 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:20.574 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:20.574 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20506/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:20.578 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:20.578 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:20.789 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:20.789 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20506/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:20.793 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:20.793 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:21.004 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:21.004 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20506/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:21.008 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:21.008 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:21.219 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:21.219 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20506/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:21.224 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:21.224 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:21.435 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:21.435 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20506/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:21.439 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:21.439 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:21.650 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:21.650 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20506/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:21.654 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:21.654 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:21.864 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:21.865 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20506/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:21.868 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:21.869 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:22.079 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:22.080 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20506/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:22.084 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:22.084 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:22.295 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:22.295 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20506/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:22.299 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:22.299 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:22.510 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:22.510 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20506/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:22.514 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:22.514 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:22.725 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:22.726 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20506/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:22.729 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:22.730 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:22.940 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:22.941 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20506/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:22.944 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:22.945 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:23.155 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:23.156 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20506/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:23.160 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:23.160 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:23.371 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:23.371 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20506/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:23.375 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:23.375 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:23.586 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:23.586 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20506/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:23.590 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:23.590 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:23.801 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:23.801 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20506/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:23.805 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:23.805 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:24.016 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:24.016 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20506/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:24.020 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:24.020 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:24.231 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20506/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.234.66/tcp/30308/p2p/16Uiu2HAm5iftHdX2xrKwjDComJomwfAZG9WyTCkYNK9EvNWXJnMZ"]'
2026-03-20 04:39:24.263 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:24.265 DEBUG [src.node.waku_node] Starting Node...
2026-03-20 04:39:24.265 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-20 04:39:24.269 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-20 04:39:24.269 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.153.91
2026-03-20 04:39:24.271 DEBUG [src.node.docker_mananger] Generated ports ['48254', '48255', '48256', '48257', '48258']
2026-03-20 04:39:24.271 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-20 04:39:24.271 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-20 04:39:24.271 DEBUG [src.node.waku_node] Using volumes []
2026-03-20 04:39:24.271 DEBUG [src.node.docker_mananger] docker run -i -t -p 48254:48254 -p 48255:48255 -p 48256:48256 -p 48257:48257 -p 48258:48258 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=48256 --rest-port=48254 --tcp-port=48255 --discv5-udp-port=48257 --rest-address=0.0.0.0 --nat=extip:172.18.153.91 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ca9cbfc42edc745af71dac1904cb441a1c3c669d2aca44d78be5e1af178fcc2f --store-sync=true --store=true --store-sync-range=600 --store-sync-interval=6 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=48258 --metrics-logging=true --store-sync-relay-jitter=0 --relay=true --dns-discovery=false
2026-03-20 04:39:24.473 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.153.91 waku 1a9a636b37a19a0aa11e6f55acfe417e41bc107cbc77784306f967c3abfaa1d8
2026-03-20 04:39:24.506 DEBUG [src.node.docker_mananger] Container started with ID 1a9a636b37a1. Setting up logs at ./log/docker/node3_2026-03-20_04-39-13__02fa4ccf-2b73-4d45-8230-60a6f99ac60b__wakuorg_nwaku:latest.log
2026-03-20 04:39:24.507 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 48254
2026-03-20 04:39:24.507 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-20 04:39:25.507 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48254/health" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:39:25.510 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-20 04:39:25.511 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-20 04:39:25.511 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48254/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:39:25.513 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.153.91/tcp/48255/p2p/16Uiu2HAmMUsfmbnQyKTE6x3KjWpM2CSidsVruBnmrUE87JCpnNPt","/ip4/172.18.153.91/tcp/48256/ws/p2p/16Uiu2HAmMUsfmbnQyKTE6x3KjWpM2CSidsVruBnmrUE87JCpnNPt"],"enrUri":"enr:-L24QJ0IINAzoszN5BcsO9h2TjvmAr-pr4yixdHyMh7zXqxoMykgdn5ZpKl0WcN3WeVKuYwL8lDA3fHZri3fNE2aSqkCgmlkgnY0gmlwhKwSmVuKbXVsdGlhZGRyc5YACASsEplbBrx_AAoErBKZWwa8gN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDgyHR0E9_i5fGk3dM8eYqd8EN5IUXJrvSMfY2LQwtnDuDdGNwgrx_g3VkcIK8gYV3YWt1MhM"}'
2026-03-20 04:39:25.513 INFO [src.node.waku_node] REST service is ready !!
2026-03-20 04:39:25.514 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:25.514 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48254/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:25.533 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:25.533 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:25.744 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:25.744 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48254/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:25.748 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:25.749 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:25.959 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:25.960 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48254/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:25.963 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:25.963 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:26.174 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:26.174 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48254/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:26.178 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:26.179 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:26.389 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:26.390 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48254/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:26.394 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:26.394 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:26.605 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:26.605 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48254/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:26.609 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:26.609 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:26.820 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:26.820 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48254/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:26.824 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:26.824 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:27.035 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:27.035 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48254/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:27.039 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:27.039 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:27.250 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:27.250 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48254/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:27.254 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:27.254 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:27.465 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:27.465 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48254/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:27.469 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:27.470 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:27.680 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:27.680 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48254/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:27.684 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:27.685 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:27.895 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:27.896 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48254/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:27.899 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:27.900 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:28.110 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:28.111 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48254/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:28.115 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:28.115 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:28.326 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:28.326 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48254/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:28.330 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:28.330 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:28.541 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:28.541 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48254/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:28.546 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:28.546 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:28.757 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:28.757 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48254/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:28.761 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:28.761 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:28.972 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:28.972 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48254/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:28.976 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:28.976 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:29.187 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:29.187 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48254/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:29.191 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:29.192 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:29.402 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:29.403 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48254/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:29.407 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:29.407 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:29.618 DEBUG [src.steps.store] Relaying message
2026-03-20 04:39:29.618 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48254/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:39:29.622 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:29.622 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-20 04:39:29.833 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48254/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.234.66/tcp/30308/p2p/16Uiu2HAm5iftHdX2xrKwjDComJomwfAZG9WyTCkYNK9EvNWXJnMZ"]'
2026-03-20 04:39:29.859 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:29.860 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48254/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.60.31/tcp/20507/p2p/16Uiu2HAm7ktbBfRF2GgFfyyC33kvnxjffTF4yDc7ma3DXHym8HXB"]'
2026-03-20 04:39:29.884 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:39:47.886 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30307/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&cursor=&pageSize=200&ascending=true&peer_id=" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:39:47.891 INFO [src.node.api_clients.base_client] Log line was discarded because it's longer than max_log_line_length=5000
2026-03-20 04:39:47.891 DEBUG [tests.store_sync.test_store_sync] Node-A store has 60 messages
2026-03-20 04:39:47.892 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20506/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&cursor=&pageSize=200&ascending=true&peer_id=" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:39:47.896 INFO [src.node.api_clients.base_client] Log line was discarded because it's longer than max_log_line_length=5000
2026-03-20 04:39:47.896 DEBUG [tests.store_sync.test_store_sync] Node-B store has 60 messages
2026-03-20 04:39:47.897 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48254/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&cursor=&pageSize=200&ascending=true&peer_id=" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:39:47.901 INFO [src.node.api_clients.base_client] Log line was discarded because it's longer than max_log_line_length=5000
2026-03-20 04:39:47.901 DEBUG [tests.store_sync.test_store_sync] Node-C store has 60 messages
2026-03-20 04:39:47.903 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-20 04:39:47.904 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-20 04:39:47.904 DEBUG [src.node.waku_node] Stopping container with id 57c2f5acf9f8
2026-03-20 04:39:48.466 DEBUG [src.node.waku_node] Container stopped.
2026-03-20 04:39:48.467 DEBUG [src.node.waku_node] Stopping container with id 3cf18fbcb9b4
2026-03-20 04:39:49.021 DEBUG [src.node.waku_node] Container stopped.
2026-03-20 04:39:49.022 DEBUG [src.node.waku_node] Stopping container with id 1a9a636b37a1
2026-03-20 04:39:49.387 ERROR [src.node.docker_mananger] Max retries reached for container 57c2f5acf9f8. Exiting log stream.
2026-03-20 04:39:49.593 DEBUG [src.node.waku_node] Container stopped.
2026-03-20 04:39:49.595 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-20 04:39:49.653 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-20 04:39:49.698 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-20 04:39:49.725 DEBUG [src.node.docker_mananger] No errors found in the waku logs.