2026-03-05 15:25:13 +00:00

132 lines
23 KiB
Plaintext

2026-03-05 15:10:52.251 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-05 15:10:52.252 DEBUG [tests.conftest] Running test: test_store_sync_indirect_node with id: 2026-03-05_15-10-52__463ed0c5-86d8-4a8e-8bcd-9f84da443176
2026-03-05 15:10:52.252 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-05 15:10:52.259 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-beta
2026-03-05 15:10:52.259 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-05_15-10-52__463ed0c5-86d8-4a8e-8bcd-9f84da443176__harbor.status.im_wakuorg_nwaku:v0.38.0-beta.log
2026-03-05 15:10:52.265 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-beta
2026-03-05 15:10:52.265 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-05_15-10-52__463ed0c5-86d8-4a8e-8bcd-9f84da443176__harbor.status.im_wakuorg_nwaku:v0.38.0-beta.log
2026-03-05 15:10:52.271 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-beta
2026-03-05 15:10:52.271 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-05_15-10-52__463ed0c5-86d8-4a8e-8bcd-9f84da443176__harbor.status.im_wakuorg_nwaku:v0.38.0-beta.log
2026-03-05 15:10:52.272 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-05 15:10:52.272 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 15:10:52.273 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 15:10:52.274 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 15:10:52.274 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.186.2
2026-03-05 15:10:52.274 DEBUG [src.node.docker_mananger] Generated ports ['62728', '62729', '62730', '62731', '62732']
2026-03-05 15:10:52.275 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 15:10:52.275 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 15:10:52.275 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 15:10:52.275 DEBUG [src.node.docker_mananger] docker run -i -t -p 62728:62728 -p 62729:62729 -p 62730:62730 -p 62731:62731 -p 62732:62732 harbor.status.im/wakuorg/nwaku:v0.38.0-beta --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=62730 --rest-port=62728 --tcp-port=62729 --discv5-udp-port=62731 --rest-address=0.0.0.0 --nat=extip:172.18.186.2 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=3de2d08db0be03fbcf6a7dfc3ca533adc847f7fade426ad71d1eef0aee5b37ac --store-sync=true --store=true --store-sync-range=45 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=62732 --metrics-logging=true --store-sync-relay-jitter=0 --relay=true
2026-03-05 15:10:52.473 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.186.2 waku 1e0c2708d0becf9cdba69f58be31594701977303804c11bb8da805db9ee02234
2026-03-05 15:10:52.499 ERROR [src.node.docker_mananger] Max retries reached for container 51a926c4a98f. Exiting log stream.
2026-03-05 15:10:52.510 DEBUG [src.node.docker_mananger] Container started with ID 1e0c2708d0be. Setting up logs at ./log/docker/node1_2026-03-05_15-10-52__463ed0c5-86d8-4a8e-8bcd-9f84da443176__harbor.status.im_wakuorg_nwaku:v0.38.0-beta.log
2026-03-05 15:10:52.510 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-beta. REST: 62728
2026-03-05 15:10:52.511 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 15:10:53.046 ERROR [src.node.docker_mananger] Max retries reached for container 8d236c435226. Exiting log stream.
2026-03-05 15:10:53.512 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62728/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 15:10:53.515 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 15:10:53.515 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 15:10:53.515 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62728/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 15:10:53.517 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.186.2/tcp/62729/p2p/16Uiu2HAm4A6WaZssUnTYSwc6jPRCex7XGD7Q69Nrxr5XoSRwEBGD","/ip4/172.18.186.2/tcp/62730/ws/p2p/16Uiu2HAm4A6WaZssUnTYSwc6jPRCex7XGD7Q69Nrxr5XoSRwEBGD"],"enrUri":"enr:-L24QD_FsY1GI7sQ0l6LYn5ThU4up7WhGXubGrnn44ySggzRJKiHR_hQlclaFLWrXQITK9hx29ugyeB7p0oiCWl6pN0CgmlkgnY0gmlwhKwSugKKbXVsdGlhZGRyc5YACASsEroCBvUJAAoErBK6Agb1Ct0DgnJzhQADAQAAiXNlY3AyNTZrMaECgbugXvSNunA_kZvLhfCQk-Yd1yALPWAD1wdZJ6OTlIKDdGNwgvUJg3VkcIL1C4V3YWt1MhM"}'
2026-03-05 15:10:53.517 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 15:10:53.518 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62728/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-05 15:10:53.535 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 15:10:53.536 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 15:10:53.536 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 15:10:53.537 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 15:10:53.537 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.165.183
2026-03-05 15:10:53.537 DEBUG [src.node.docker_mananger] Generated ports ['32580', '32581', '32582', '32583', '32584']
2026-03-05 15:10:53.538 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 15:10:53.538 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 15:10:53.538 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 15:10:53.538 DEBUG [src.node.docker_mananger] docker run -i -t -p 32580:32580 -p 32581:32581 -p 32582:32582 -p 32583:32583 -p 32584:32584 harbor.status.im/wakuorg/nwaku:v0.38.0-beta --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=32582 --rest-port=32580 --tcp-port=32581 --discv5-udp-port=32583 --rest-address=0.0.0.0 --nat=extip:172.18.165.183 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=f1e56c77e46d6a81eeffb6fec7c4ecec0cee0c2c60c2a8ee4a37b9d062e56eff --store-sync=true --store=true --store-sync-range=45 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=32584 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --discv5-bootstrap-node=enr:-L24QD_FsY1GI7sQ0l6LYn5ThU4up7WhGXubGrnn44ySggzRJKiHR_hQlclaFLWrXQITK9hx29ugyeB7p0oiCWl6pN0CgmlkgnY0gmlwhKwSugKKbXVsdGlhZGRyc5YACASsEroCBvUJAAoErBK6Agb1Ct0DgnJzhQADAQAAiXNlY3AyNTZrMaECgbugXvSNunA_kZvLhfCQk-Yd1yALPWAD1wdZJ6OTlIKDdGNwgvUJg3VkcIL1C4V3YWt1MhM
2026-03-05 15:10:53.738 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.165.183 waku c24a7bb5c8bebb46ce83d003366339ba580c135f342d533fcd7a68d6874a867b
2026-03-05 15:10:53.771 DEBUG [src.node.docker_mananger] Container started with ID c24a7bb5c8be. Setting up logs at ./log/docker/node2_2026-03-05_15-10-52__463ed0c5-86d8-4a8e-8bcd-9f84da443176__harbor.status.im_wakuorg_nwaku:v0.38.0-beta.log
2026-03-05 15:10:53.772 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-beta. REST: 32580
2026-03-05 15:10:53.772 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 15:10:54.773 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32580/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 15:10:54.776 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 15:10:54.776 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 15:10:54.776 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32580/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 15:10:54.779 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.165.183/tcp/32581/p2p/16Uiu2HAm8LjpivzJfmFidr5Y5LfXJ3Vi62T2qmprdoUwAGtWWiwx","/ip4/172.18.165.183/tcp/32582/ws/p2p/16Uiu2HAm8LjpivzJfmFidr5Y5LfXJ3Vi62T2qmprdoUwAGtWWiwx"],"enrUri":"enr:-L24QNIcDej_O1zhqMa08SLJeZj8-LLrBiT5Ywvlzcc-Uz8QT1Zn9_mMVLmNGMgmWbrhY5XB_tNY5E0xr1XyzJJesR8CgmlkgnY0gmlwhKwSpbeKbXVsdGlhZGRyc5YACASsEqW3Bn9FAAoErBKltwZ_Rt0DgnJzhQADAQAAiXNlY3AyNTZrMaECv-RfOz6DxA4yTKJCfveEQkeb2Pr6_XEA2uWctrIYX6-DdGNwgn9Fg3VkcIJ_R4V3YWt1MhI"}'
2026-03-05 15:10:54.779 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 15:10:54.779 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 15:10:54.779 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 15:10:54.781 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 15:10:54.781 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.176.61
2026-03-05 15:10:54.781 DEBUG [src.node.docker_mananger] Generated ports ['10285', '10286', '10287', '10288', '10289']
2026-03-05 15:10:54.781 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 15:10:54.782 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 15:10:54.782 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 15:10:54.782 DEBUG [src.node.docker_mananger] docker run -i -t -p 10285:10285 -p 10286:10286 -p 10287:10287 -p 10288:10288 -p 10289:10289 harbor.status.im/wakuorg/nwaku:v0.38.0-beta --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=10287 --rest-port=10285 --tcp-port=10286 --discv5-udp-port=10288 --rest-address=0.0.0.0 --nat=extip:172.18.176.61 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=b33f25bc4a4a4a12bd11d45e8a76269eba0eadd4c64a616fe99d2eb8ec470afd --store-sync=true --store=true --store-sync-range=45 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=10289 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false --discv5-bootstrap-node=enr:-L24QNIcDej_O1zhqMa08SLJeZj8-LLrBiT5Ywvlzcc-Uz8QT1Zn9_mMVLmNGMgmWbrhY5XB_tNY5E0xr1XyzJJesR8CgmlkgnY0gmlwhKwSpbeKbXVsdGlhZGRyc5YACASsEqW3Bn9FAAoErBKltwZ_Rt0DgnJzhQADAQAAiXNlY3AyNTZrMaECv-RfOz6DxA4yTKJCfveEQkeb2Pr6_XEA2uWctrIYX6-DdGNwgn9Fg3VkcIJ_R4V3YWt1MhI
2026-03-05 15:10:54.971 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.176.61 waku c2a3dd116be6c54646531b082e05af81d72e0a78e6cd85e8cddb97d7b8aabca9
2026-03-05 15:10:55.005 DEBUG [src.node.docker_mananger] Container started with ID c2a3dd116be6. Setting up logs at ./log/docker/node3_2026-03-05_15-10-52__463ed0c5-86d8-4a8e-8bcd-9f84da443176__harbor.status.im_wakuorg_nwaku:v0.38.0-beta.log
2026-03-05 15:10:55.006 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-beta. REST: 10285
2026-03-05 15:10:55.006 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 15:10:56.007 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10285/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 15:10:56.010 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 15:10:56.011 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 15:10:56.011 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10285/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 15:10:56.013 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.176.61/tcp/10286/p2p/16Uiu2HAm3VHTk1XhD1Z78DM7gXjVyGRFs5Me1v9XRLznNoYmMRX3","/ip4/172.18.176.61/tcp/10287/ws/p2p/16Uiu2HAm3VHTk1XhD1Z78DM7gXjVyGRFs5Me1v9XRLznNoYmMRX3"],"enrUri":"enr:-L24QKql6su8oSgq8a0yVmRr1xpQgeYW2w-lGSpvbXxD7eyIWCapjk514zwTnPOmr9hF888ZrcTmY6BtT7Aahn0Bot4CgmlkgnY0gmlwhKwSsD2KbXVsdGlhZGRyc5YACASsErA9BiguAAoErBKwPQYoL90DgnJzhQADAQAAiXNlY3AyNTZrMaECd8pbeZCpw4oP16XEzUNxwF6B_of7BZ5JAypXgWR2aW6DdGNwgigug3VkcIIoMIV3YWt1MhI"}'
2026-03-05 15:10:56.013 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 15:10:56.014 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32580/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.186.2/tcp/62729/p2p/16Uiu2HAm4A6WaZssUnTYSwc6jPRCex7XGD7Q69Nrxr5XoSRwEBGD"]'
2026-03-05 15:10:56.046 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 15:10:56.046 DEBUG [src.steps.store] Relaying message
2026-03-05 15:10:56.050 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62728/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 15:10:56.060 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 15:10:56.061 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-05 15:10:56.262 DEBUG [src.steps.store] Relaying message
2026-03-05 15:10:56.263 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62728/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 15:10:56.266 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 15:10:56.267 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-05 15:10:56.467 DEBUG [src.steps.store] Relaying message
2026-03-05 15:10:56.467 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62728/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 15:10:56.471 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 15:10:56.471 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-05 15:10:56.672 DEBUG [src.steps.store] Relaying message
2026-03-05 15:10:56.672 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62728/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 15:10:56.677 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 15:10:56.677 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-05 15:10:56.878 DEBUG [src.steps.store] Relaying message
2026-03-05 15:10:56.878 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62728/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 15:10:56.882 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 15:10:56.882 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-05 15:10:57.083 DEBUG [src.steps.store] Relaying message
2026-03-05 15:10:57.083 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62728/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 15:10:57.088 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 15:10:57.088 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-05 15:10:57.288 DEBUG [src.steps.store] Relaying message
2026-03-05 15:10:57.289 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62728/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 15:10:57.293 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 15:10:57.293 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-05 15:10:57.494 DEBUG [src.steps.store] Relaying message
2026-03-05 15:10:57.494 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62728/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 15:10:57.498 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 15:10:57.498 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-05 15:10:57.699 DEBUG [src.steps.store] Relaying message
2026-03-05 15:10:57.699 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62728/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 15:10:57.703 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 15:10:57.703 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-05 15:10:57.904 DEBUG [src.steps.store] Relaying message
2026-03-05 15:10:57.904 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62728/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 15:10:57.908 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 15:10:57.908 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-05 15:10:58.109 DEBUG [src.libs.common] Sleeping for 65 seconds
2026-03-05 15:12:03.109 DEBUG [src.steps.store] Checking that peer harbor.status.im/wakuorg/nwaku:v0.38.0-beta can find the stored messages
2026-03-05 15:12:03.110 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10285/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-05 15:12:03.113 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x839e369a8d54188ebf5796a2286dc92c3ab8c69a1a8fccdb167a29d97591eb4d"},{"messageHash":"0x3118fbbec8ccc6a767de3436b1ecf5f24d51ea1ee7153cc0f31f23d1053a1f69"},{"messageHash":"0x2d75d25baae581e8d844cab9decc5bc0653b935b40391f08d3560cfeac86713e"},{"messageHash":"0x0d620dc945e3d8bc8507c92638fbe6ce60d839dbb690552f83b07431d1b150f0"},{"messageHash":"0x4edcc64993a22b749873062d3e8e1d26aae08124e5a220d527368144d8a8d20c"},{"messageHash":"0xe31218be362c3244018e7ffd79163f7c151bcb1453e1728d557099a555cef0c1"},{"messageHash":"0xeea53f5fda243ee2943698b3739eba61d6c85817fe9e38958c657a35549b2c03"},{"messageHash":"0xd6381dca6597f471f385d15a303a1f5d1265551da3fa792667f39c49a5c48919"},{"messageHash":"0xb7b874e00733fb730934361b1eb64a9ce0becdde039e9f23fab18a9b26f0bea7"},{"messageHash":"0x3616baebd3c149c6d6ca783fb41a973863839339242db7aa00281e7ba4d7e19a"}]}'
2026-03-05 15:12:03.113 DEBUG [src.steps.store] messages length is 10
2026-03-05 15:12:03.116 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-05 15:12:03.117 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-05 15:12:03.117 DEBUG [src.node.waku_node] Stopping container with id 1e0c2708d0be
2026-03-05 15:12:03.662 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 15:12:03.662 DEBUG [src.node.waku_node] Stopping container with id c24a7bb5c8be
2026-03-05 15:12:04.193 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 15:12:04.193 DEBUG [src.node.waku_node] Stopping container with id c2a3dd116be6
2026-03-05 15:12:04.475 ERROR [src.node.docker_mananger] Max retries reached for container 1e0c2708d0be. Exiting log stream.
2026-03-05 15:12:04.770 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 15:12:04.772 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-05 15:12:04.821 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 15:12:04.855 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 15:12:04.886 DEBUG [src.node.docker_mananger] No errors found in the waku logs.