338 lines
50 KiB
Plaintext

2026-03-27 04:51:38.090 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-27 04:51:38.091 DEBUG [tests.conftest] Running test: test_three_store_sync_exchange with id: 2026-03-27_04-51-38__5b2a9baf-d4ce-4a2b-a322-8a3b2b48b71e
2026-03-27 04:51:38.091 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-27 04:51:38.096 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-27 04:51:38.096 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-27_04-51-38__5b2a9baf-d4ce-4a2b-a322-8a3b2b48b71e__wakuorg_nwaku:latest.log
2026-03-27 04:51:38.101 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-27 04:51:38.101 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-27_04-51-38__5b2a9baf-d4ce-4a2b-a322-8a3b2b48b71e__wakuorg_nwaku:latest.log
2026-03-27 04:51:38.106 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-27 04:51:38.106 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-27_04-51-38__5b2a9baf-d4ce-4a2b-a322-8a3b2b48b71e__wakuorg_nwaku:latest.log
2026-03-27 04:51:38.106 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-27 04:51:38.107 DEBUG [src.node.waku_node] Starting Node...
2026-03-27 04:51:38.107 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-27 04:51:38.108 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-27 04:51:38.108 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.76.33
2026-03-27 04:51:38.108 DEBUG [src.node.docker_mananger] Generated ports ['53022', '53023', '53024', '53025', '53026']
2026-03-27 04:51:38.108 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-27 04:51:38.109 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-27 04:51:38.109 DEBUG [src.node.waku_node] Using volumes []
2026-03-27 04:51:38.109 DEBUG [src.node.docker_mananger] docker run -i -t -p 53022:53022 -p 53023:53023 -p 53024:53024 -p 53025:53025 -p 53026:53026 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=53024 --rest-port=53022 --tcp-port=53023 --discv5-udp-port=53025 --rest-address=0.0.0.0 --nat=extip:172.18.76.33 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=846efbe14a3de30cfe1afdeeb4bee367fe0bf7950e7bda8c1dbefa7b4b0fb39e --store-sync=true --store=true --store-sync-range=600 --store-sync-interval=6 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=53026 --metrics-logging=true --store-sync-relay-jitter=0 --relay=true --dns-discovery=false
2026-03-27 04:51:38.256 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.76.33 waku 7828c34a833aa7adffc13fb1ca00d02817d444ee577d71ee88526bf02ec2b6e9
2026-03-27 04:51:38.282 DEBUG [src.node.docker_mananger] Container started with ID 7828c34a833a. Setting up logs at ./log/docker/node1_2026-03-27_04-51-38__5b2a9baf-d4ce-4a2b-a322-8a3b2b48b71e__wakuorg_nwaku:latest.log
2026-03-27 04:51:38.283 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 53022
2026-03-27 04:51:38.283 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-27 04:51:38.498 ERROR [src.node.docker_mananger] Max retries reached for container 27be12e403b2. Exiting log stream.
2026-03-27 04:51:38.897 ERROR [src.node.docker_mananger] Max retries reached for container a50015de4cb6. Exiting log stream.
2026-03-27 04:51:39.284 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53022/health" -H "Content-Type: application/json" -d 'None'
2026-03-27 04:51:39.287 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-27 04:51:39.287 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-27 04:51:39.288 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53022/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-27 04:51:39.290 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.76.33/tcp/53023/p2p/16Uiu2HAmMfdRJ9qnUaXgxcQNBAepirkBoK2NWaDqoE3sgQFmFYEe","/ip4/172.18.76.33/tcp/53024/ws/p2p/16Uiu2HAmMfdRJ9qnUaXgxcQNBAepirkBoK2NWaDqoE3sgQFmFYEe"],"enrUri":"enr:-L24QL9Yk-XYKlLSy_P46cgKg-5e1hdCfnG0Q8CSSCRF1x9gCfHK79rBxtC4HscNtUkOIm9H2YALLNAICHBgFJJJRCQCgmlkgnY0gmlwhKwSTCGKbXVsdGlhZGRyc5YACASsEkwhBs8fAAoErBJMIQbPIN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDheMYsuy75LOoP4hq5_Tf6-9dy0YHJ31CCthIBYwGiWODdGNwgs8fg3VkcILPIYV3YWt1MhM"}'
2026-03-27 04:51:39.290 INFO [src.node.waku_node] REST service is ready !!
2026-03-27 04:51:39.290 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:39.291 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53022/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:39.307 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:39.307 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:39.518 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:39.518 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53022/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:39.522 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:39.522 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:39.733 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:39.733 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53022/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:39.738 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:39.738 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:39.949 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:39.949 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53022/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:39.953 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:39.954 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:40.164 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:40.164 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53022/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:40.168 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:40.168 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:40.379 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:40.380 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53022/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:40.384 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:40.384 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:40.595 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:40.595 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53022/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:40.599 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:40.599 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:40.810 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:40.811 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53022/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:40.815 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:40.815 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:41.026 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:41.026 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53022/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:41.030 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:41.031 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:41.241 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:41.241 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53022/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:41.245 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:41.246 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:41.457 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:41.457 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53022/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:41.461 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:41.461 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:41.672 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:41.672 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53022/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:41.676 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:41.677 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:41.887 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:41.887 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53022/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:41.891 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:41.892 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:42.102 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:42.103 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53022/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:42.106 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:42.107 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:42.318 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:42.318 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53022/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:42.322 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:42.322 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:42.533 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:42.533 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53022/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:42.537 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:42.537 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:42.748 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:42.749 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53022/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:42.753 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:42.753 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:42.964 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:42.964 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53022/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:42.968 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:42.968 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:43.179 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:43.179 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53022/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:43.183 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:43.184 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:43.394 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:43.394 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53022/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:43.398 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:43.398 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:43.609 DEBUG [src.node.waku_node] Starting Node...
2026-03-27 04:51:43.609 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-27 04:51:43.611 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-27 04:51:43.611 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.90.226
2026-03-27 04:51:43.611 DEBUG [src.node.docker_mananger] Generated ports ['22816', '22817', '22818', '22819', '22820']
2026-03-27 04:51:43.611 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-27 04:51:43.611 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-27 04:51:43.611 DEBUG [src.node.waku_node] Using volumes []
2026-03-27 04:51:43.611 DEBUG [src.node.docker_mananger] docker run -i -t -p 22816:22816 -p 22817:22817 -p 22818:22818 -p 22819:22819 -p 22820:22820 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=22818 --rest-port=22816 --tcp-port=22817 --discv5-udp-port=22819 --rest-address=0.0.0.0 --nat=extip:172.18.90.226 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=39171f2b7ffef07eaeb5de2f6d1c6ebcfea62f5dc0cf83f3baea520edb1ba067 --store-sync=true --store=true --store-sync-range=600 --store-sync-interval=6 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=22820 --metrics-logging=true --store-sync-relay-jitter=0 --relay=true --dns-discovery=false
2026-03-27 04:51:43.762 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.90.226 waku 2cd5ad040a1b9a809a0299306cf1471335c33032d335474332f9b90c20cd253b
2026-03-27 04:51:43.788 DEBUG [src.node.docker_mananger] Container started with ID 2cd5ad040a1b. Setting up logs at ./log/docker/node2_2026-03-27_04-51-38__5b2a9baf-d4ce-4a2b-a322-8a3b2b48b71e__wakuorg_nwaku:latest.log
2026-03-27 04:51:43.789 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 22816
2026-03-27 04:51:43.789 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-27 04:51:44.789 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:22816/health" -H "Content-Type: application/json" -d 'None'
2026-03-27 04:51:44.792 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-27 04:51:44.792 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-27 04:51:44.793 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:22816/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-27 04:51:44.795 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.90.226/tcp/22817/p2p/16Uiu2HAmJ5rp1xFoudhNVbJ34SkCjgzRqW6CWunawcE27r9C9f46","/ip4/172.18.90.226/tcp/22818/ws/p2p/16Uiu2HAmJ5rp1xFoudhNVbJ34SkCjgzRqW6CWunawcE27r9C9f46"],"enrUri":"enr:-L24QChySRYjsJXkFVKbBHA-Uc1Vjs5Q1NU6I5ni8E3qUdL0MP_fcCeSW5Nd3Np-1jnMdd8y5KD_EsjJUd0Iw7nI1s8CgmlkgnY0gmlwhKwSWuKKbXVsdGlhZGRyc5YACASsElriBlkhAAoErBJa4gZZIt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDUKluJp-m92GL2pffllNFSOHp18EGW5mlsr-pSMOLkjuDdGNwglkhg3VkcIJZI4V3YWt1MhM"}'
2026-03-27 04:51:44.795 INFO [src.node.waku_node] REST service is ready !!
2026-03-27 04:51:44.796 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:44.796 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22816/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:44.813 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:44.813 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:45.024 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:45.025 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22816/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:45.029 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:45.029 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:45.239 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:45.240 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22816/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:45.244 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:45.244 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:45.455 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:45.455 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22816/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:45.459 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:45.459 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:45.670 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:45.670 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22816/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:45.674 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:45.674 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:45.885 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:45.885 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22816/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:45.889 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:45.890 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:46.100 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:46.100 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22816/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:46.104 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:46.105 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:46.315 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:46.316 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22816/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:46.319 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:46.320 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:46.531 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:46.531 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22816/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:46.535 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:46.535 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:46.747 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:46.747 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22816/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:46.751 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:46.751 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:46.962 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:46.962 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22816/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:46.966 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:46.966 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:47.177 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:47.177 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22816/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:47.181 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:47.182 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:47.393 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:47.393 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22816/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:47.397 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:47.397 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:47.608 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:47.608 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22816/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:47.612 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:47.612 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:47.823 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:47.823 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22816/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:47.827 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:47.827 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:48.038 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:48.038 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22816/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:48.042 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:48.043 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:48.253 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:48.254 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22816/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:48.258 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:48.258 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:48.468 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:48.469 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22816/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:48.473 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:48.473 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:48.684 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:48.685 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22816/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:48.689 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:48.689 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:48.900 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:48.900 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22816/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:48.904 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:48.905 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:49.115 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22816/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.76.33/tcp/53023/p2p/16Uiu2HAmMfdRJ9qnUaXgxcQNBAepirkBoK2NWaDqoE3sgQFmFYEe"]'
2026-03-27 04:51:49.138 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:49.139 DEBUG [src.node.waku_node] Starting Node...
2026-03-27 04:51:49.140 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-27 04:51:49.143 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-27 04:51:49.144 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.59.41
2026-03-27 04:51:49.144 DEBUG [src.node.docker_mananger] Generated ports ['26302', '26303', '26304', '26305', '26306']
2026-03-27 04:51:49.144 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-27 04:51:49.144 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-27 04:51:49.144 DEBUG [src.node.waku_node] Using volumes []
2026-03-27 04:51:49.144 DEBUG [src.node.docker_mananger] docker run -i -t -p 26302:26302 -p 26303:26303 -p 26304:26304 -p 26305:26305 -p 26306:26306 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=26304 --rest-port=26302 --tcp-port=26303 --discv5-udp-port=26305 --rest-address=0.0.0.0 --nat=extip:172.18.59.41 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=826ae24eefdc1dfb2eef8e2fb5dc67f7cd719d49e251e441b8d89517fbd0837d --store-sync=true --store=true --store-sync-range=600 --store-sync-interval=6 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=26306 --metrics-logging=true --store-sync-relay-jitter=0 --relay=true --dns-discovery=false
2026-03-27 04:51:49.305 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.59.41 waku 3d190d6d0dcd0e1a0286ce3aa58a6cdcc7886b52f5987e43dbb27c6894ce5043
2026-03-27 04:51:49.330 DEBUG [src.node.docker_mananger] Container started with ID 3d190d6d0dcd. Setting up logs at ./log/docker/node3_2026-03-27_04-51-38__5b2a9baf-d4ce-4a2b-a322-8a3b2b48b71e__wakuorg_nwaku:latest.log
2026-03-27 04:51:49.331 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 26302
2026-03-27 04:51:49.331 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-27 04:51:50.331 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26302/health" -H "Content-Type: application/json" -d 'None'
2026-03-27 04:51:50.334 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-27 04:51:50.335 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-27 04:51:50.335 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26302/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-27 04:51:50.337 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.59.41/tcp/26303/p2p/16Uiu2HAm1EutcCoPPfUMTuFogXU5wDdhrapc3e7G7XkuimLoMxWU","/ip4/172.18.59.41/tcp/26304/ws/p2p/16Uiu2HAm1EutcCoPPfUMTuFogXU5wDdhrapc3e7G7XkuimLoMxWU"],"enrUri":"enr:-L24QApGhwa8gQwSUPBlX_yVoWLr5ljSixOKirV5e6FSnERtO2bCQ4VDdFypAxOJfHPxpSE7pQe1VDfLGBPEM5ZbY_ECgmlkgnY0gmlwhKwSOymKbXVsdGlhZGRyc5YACASsEjspBma_AAoErBI7KQZmwN0DgnJzhQADAQAAiXNlY3AyNTZrMaECVmR2Hy1-tjPqr-w3WNJBGYfy02CDgwJTLyXsaZomo8mDdGNwgma_g3VkcIJmwYV3YWt1MhM"}'
2026-03-27 04:51:50.337 INFO [src.node.waku_node] REST service is ready !!
2026-03-27 04:51:50.337 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:50.338 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26302/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:50.354 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:50.354 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:50.565 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:50.566 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26302/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:50.569 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:50.570 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:50.780 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:50.781 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26302/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:50.785 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:50.785 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:50.995 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:50.996 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26302/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:51.000 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:51.000 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:51.211 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:51.211 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26302/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:51.215 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:51.215 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:51.426 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:51.426 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26302/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:51.430 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:51.430 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:51.641 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:51.641 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26302/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:51.645 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:51.646 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:51.856 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:51.856 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26302/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:51.860 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:51.860 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:52.071 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:52.071 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26302/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:52.076 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:52.076 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:52.286 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:52.287 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26302/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:52.291 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:52.291 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:52.502 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:52.502 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26302/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:52.506 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:52.506 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:52.717 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:52.717 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26302/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:52.721 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:52.721 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:52.932 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:52.932 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26302/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:52.936 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:52.936 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:53.147 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:53.147 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26302/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:53.151 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:53.151 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:53.362 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:53.362 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26302/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:53.366 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:53.367 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:53.577 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:53.577 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26302/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:53.581 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:53.581 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:53.792 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:53.792 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26302/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:53.796 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:53.796 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:54.007 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:54.007 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26302/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:54.011 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:54.011 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:54.222 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:54.222 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26302/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:54.226 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:54.227 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:54.437 DEBUG [src.steps.store] Relaying message
2026-03-27 04:51:54.437 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26302/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-27 04:51:54.441 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:54.441 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-27 04:51:54.652 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26302/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.76.33/tcp/53023/p2p/16Uiu2HAmMfdRJ9qnUaXgxcQNBAepirkBoK2NWaDqoE3sgQFmFYEe"]'
2026-03-27 04:51:54.679 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:51:54.680 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26302/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.90.226/tcp/22817/p2p/16Uiu2HAmJ5rp1xFoudhNVbJ34SkCjgzRqW6CWunawcE27r9C9f46"]'
2026-03-27 04:51:54.706 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:52:12.706 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53022/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&cursor=&pageSize=200&ascending=true&peer_id=" -H "Content-Type: application/json" -d 'None'
2026-03-27 04:52:12.712 INFO [src.node.api_clients.base_client] Log line was discarded because it's longer than max_log_line_length=5000
2026-03-27 04:52:12.712 DEBUG [tests.store_sync.test_store_sync] Node-A store has 60 messages
2026-03-27 04:52:12.712 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:22816/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&cursor=&pageSize=200&ascending=true&peer_id=" -H "Content-Type: application/json" -d 'None'
2026-03-27 04:52:12.717 INFO [src.node.api_clients.base_client] Log line was discarded because it's longer than max_log_line_length=5000
2026-03-27 04:52:12.717 DEBUG [tests.store_sync.test_store_sync] Node-B store has 60 messages
2026-03-27 04:52:12.717 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26302/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&cursor=&pageSize=200&ascending=true&peer_id=" -H "Content-Type: application/json" -d 'None'
2026-03-27 04:52:12.722 INFO [src.node.api_clients.base_client] Log line was discarded because it's longer than max_log_line_length=5000
2026-03-27 04:52:12.722 DEBUG [tests.store_sync.test_store_sync] Node-C store has 60 messages
2026-03-27 04:52:12.723 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-27 04:52:12.724 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-27 04:52:12.725 DEBUG [src.node.waku_node] Stopping container with id 7828c34a833a
2026-03-27 04:52:13.118 DEBUG [src.node.waku_node] Container stopped.
2026-03-27 04:52:13.121 DEBUG [src.node.waku_node] Stopping container with id 2cd5ad040a1b
2026-03-27 04:52:13.511 DEBUG [src.node.waku_node] Container stopped.
2026-03-27 04:52:13.512 DEBUG [src.node.waku_node] Stopping container with id 3d190d6d0dcd
2026-03-27 04:52:13.916 DEBUG [src.node.waku_node] Container stopped.
2026-03-27 04:52:13.917 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-27 04:52:13.944 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-27 04:52:13.967 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-27 04:52:13.988 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-27 04:52:13.992 ERROR [src.node.docker_mananger] Max retries reached for container 7828c34a833a. Exiting log stream.