225 lines
42 KiB
Plaintext

2026-03-02 04:40:35.073 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-02 04:40:35.073 DEBUG [tests.conftest] Running test: test_check_sync_when_all_3_nodes_publish with id: 2026-03-02_04-40-35__624c6bb1-520c-43d1-9bdb-b8f94d20f19e
2026-03-02 04:40:35.073 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-02 04:40:35.081 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-02 04:40:35.081 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-02_04-40-35__624c6bb1-520c-43d1-9bdb-b8f94d20f19e__wakuorg_nwaku:latest.log
2026-03-02 04:40:35.087 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-02 04:40:35.087 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-02_04-40-35__624c6bb1-520c-43d1-9bdb-b8f94d20f19e__wakuorg_nwaku:latest.log
2026-03-02 04:40:35.094 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-02 04:40:35.094 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-02_04-40-35__624c6bb1-520c-43d1-9bdb-b8f94d20f19e__wakuorg_nwaku:latest.log
2026-03-02 04:40:35.095 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-02 04:40:35.095 DEBUG [src.node.waku_node] Starting Node...
2026-03-02 04:40:35.096 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-02 04:40:35.097 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-02 04:40:35.097 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.216.255
2026-03-02 04:40:35.097 DEBUG [src.node.docker_mananger] Generated ports ['39429', '39430', '39431', '39432', '39433']
2026-03-02 04:40:35.098 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-02 04:40:35.098 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-02 04:40:35.098 DEBUG [src.node.waku_node] Using volumes []
2026-03-02 04:40:35.098 DEBUG [src.node.docker_mananger] docker run -i -t -p 39429:39429 -p 39430:39430 -p 39431:39431 -p 39432:39432 -p 39433:39433 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=39431 --rest-port=39429 --tcp-port=39430 --discv5-udp-port=39432 --rest-address=0.0.0.0 --nat=extip:172.18.216.255 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=7a09a1dfabf0aba71f6674a0bc3f5eb1baecf1e741f2ceccb1c2c0c67acb33e7 --store-sync=true --store=true --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=39433 --metrics-logging=true --relay=true
2026-03-02 04:40:35.292 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.216.255 waku 33eba070ac386790ece0c583c377e2482e1d7200a07e586399236fbc1a47fa8a
2026-03-02 04:40:35.294 ERROR [src.node.docker_mananger] Max retries reached for container 042f5cd456d3. Exiting log stream.
2026-03-02 04:40:35.331 DEBUG [src.node.docker_mananger] Container started with ID 33eba070ac38. Setting up logs at ./log/docker/node1_2026-03-02_04-40-35__624c6bb1-520c-43d1-9bdb-b8f94d20f19e__wakuorg_nwaku:latest.log
2026-03-02 04:40:35.332 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 39429
2026-03-02 04:40:35.333 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-02 04:40:35.866 ERROR [src.node.docker_mananger] Max retries reached for container 99654762050a. Exiting log stream.
2026-03-02 04:40:36.333 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:39429/health" -H "Content-Type: application/json" -d 'None'
2026-03-02 04:40:36.336 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-02 04:40:36.336 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-02 04:40:36.336 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:39429/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-02 04:40:36.339 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.216.255/tcp/39430/p2p/16Uiu2HAm9Xquk6ngSMR1dyrXERMdeswyFNoQFY9jUTUfUQWC2d19","/ip4/172.18.216.255/tcp/39431/ws/p2p/16Uiu2HAm9Xquk6ngSMR1dyrXERMdeswyFNoQFY9jUTUfUQWC2d19"],"enrUri":"enr:-L24QI_GTWqiK7Jt8ReDnEkgP0i7UMHoWjfHv3oEN6BkBaz6SYUfSVa4Gnb3-gxhpRtuR4LEFVwjCSF9q4waPsVaBUYCgmlkgnY0gmlwhKwS2P-KbXVsdGlhZGRyc5YACASsEtj_BpoGAAoErBLY_waaB90DgnJzhQADAQAAiXNlY3AyNTZrMaEC0ZhUdSwggfpAE-m3Kk7TZoNISsbbD4xShTmggJDWxVCDdGNwgpoGg3VkcIKaCIV3YWt1MhM"}'
2026-03-02 04:40:36.339 INFO [src.node.waku_node] REST service is ready !!
2026-03-02 04:40:36.339 DEBUG [src.node.waku_node] Starting Node...
2026-03-02 04:40:36.339 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-02 04:40:36.341 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-02 04:40:36.341 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.254.182
2026-03-02 04:40:36.341 DEBUG [src.node.docker_mananger] Generated ports ['32796', '32797', '32798', '32799', '32800']
2026-03-02 04:40:36.341 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-02 04:40:36.341 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-02 04:40:36.342 DEBUG [src.node.waku_node] Using volumes []
2026-03-02 04:40:36.342 DEBUG [src.node.docker_mananger] docker run -i -t -p 32796:32796 -p 32797:32797 -p 32798:32798 -p 32799:32799 -p 32800:32800 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=32798 --rest-port=32796 --tcp-port=32797 --discv5-udp-port=32799 --rest-address=0.0.0.0 --nat=extip:172.18.254.182 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=7fc32cc863fad1e0db43bca486fd1280a7c7a2047cc7dad2bae8b56fa6ffdd0a --store-sync=true --store=true --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=32800 --metrics-logging=true --relay=true --storenode=/ip4/172.18.216.255/tcp/39430/p2p/16Uiu2HAm9Xquk6ngSMR1dyrXERMdeswyFNoQFY9jUTUfUQWC2d19 --discv5-bootstrap-node=enr:-L24QI_GTWqiK7Jt8ReDnEkgP0i7UMHoWjfHv3oEN6BkBaz6SYUfSVa4Gnb3-gxhpRtuR4LEFVwjCSF9q4waPsVaBUYCgmlkgnY0gmlwhKwS2P-KbXVsdGlhZGRyc5YACASsEtj_BpoGAAoErBLY_waaB90DgnJzhQADAQAAiXNlY3AyNTZrMaEC0ZhUdSwggfpAE-m3Kk7TZoNISsbbD4xShTmggJDWxVCDdGNwgpoGg3VkcIKaCIV3YWt1MhM
2026-03-02 04:40:36.547 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.254.182 waku 00ca4e480c837c844587e6abbb5d1188ec548a9768331f1aea0379891707d1cb
2026-03-02 04:40:36.584 DEBUG [src.node.docker_mananger] Container started with ID 00ca4e480c83. Setting up logs at ./log/docker/node2_2026-03-02_04-40-35__624c6bb1-520c-43d1-9bdb-b8f94d20f19e__wakuorg_nwaku:latest.log
2026-03-02 04:40:36.585 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 32796
2026-03-02 04:40:36.586 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-02 04:40:37.586 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32796/health" -H "Content-Type: application/json" -d 'None'
2026-03-02 04:40:37.589 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-02 04:40:37.589 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-02 04:40:37.590 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32796/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-02 04:40:37.592 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.254.182/tcp/32797/p2p/16Uiu2HAmD21RUTqfTasw5tQpdjgg6M3ZLPGuCP1Ehg1pSWk4sBHm","/ip4/172.18.254.182/tcp/32798/ws/p2p/16Uiu2HAmD21RUTqfTasw5tQpdjgg6M3ZLPGuCP1Ehg1pSWk4sBHm"],"enrUri":"enr:-L24QORPfQ9IXgsEJEC_gmygbinM4B0osSGthfQNXelSA1SuOSehiB05OClXpP4ZjGgb8Mryco3svpshD8eU92IWQYoCgmlkgnY0gmlwhKwS_raKbXVsdGlhZGRyc5YACASsEv62BoAdAAoErBL-tgaAHt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDBWJoxd9mqJGDnuBRr4AiJcZX6y8WTmMF6PS71cW7AtSDdGNwgoAdg3VkcIKAH4V3YWt1MhM"}'
2026-03-02 04:40:37.592 INFO [src.node.waku_node] REST service is ready !!
2026-03-02 04:40:37.592 DEBUG [src.node.waku_node] Starting Node...
2026-03-02 04:40:37.592 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-02 04:40:37.594 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-02 04:40:37.594 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.100.70
2026-03-02 04:40:37.595 DEBUG [src.node.docker_mananger] Generated ports ['13604', '13605', '13606', '13607', '13608']
2026-03-02 04:40:37.595 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-02 04:40:37.595 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-02 04:40:37.595 DEBUG [src.node.waku_node] Using volumes []
2026-03-02 04:40:37.595 DEBUG [src.node.docker_mananger] docker run -i -t -p 13604:13604 -p 13605:13605 -p 13606:13606 -p 13607:13607 -p 13608:13608 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=13606 --rest-port=13604 --tcp-port=13605 --discv5-udp-port=13607 --rest-address=0.0.0.0 --nat=extip:172.18.100.70 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=8d434adc826a87d1aa7b3db8594a6e46aefc6e69db14fe5e63aa9a8f942daaaa --store-sync=true --store=false --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=13608 --metrics-logging=true --relay=true --storenode=/ip4/172.18.254.182/tcp/32797/p2p/16Uiu2HAmD21RUTqfTasw5tQpdjgg6M3ZLPGuCP1Ehg1pSWk4sBHm --discv5-bootstrap-node=enr:-L24QORPfQ9IXgsEJEC_gmygbinM4B0osSGthfQNXelSA1SuOSehiB05OClXpP4ZjGgb8Mryco3svpshD8eU92IWQYoCgmlkgnY0gmlwhKwS_raKbXVsdGlhZGRyc5YACASsEv62BoAdAAoErBL-tgaAHt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDBWJoxd9mqJGDnuBRr4AiJcZX6y8WTmMF6PS71cW7AtSDdGNwgoAdg3VkcIKAH4V3YWt1MhM
2026-03-02 04:40:37.791 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.100.70 waku ca58b46c73de4ac16fde8066b9d7f307c5f5e7e5c8289f359f9f0d68504a6608
2026-03-02 04:40:37.825 DEBUG [src.node.docker_mananger] Container started with ID ca58b46c73de. Setting up logs at ./log/docker/node3_2026-03-02_04-40-35__624c6bb1-520c-43d1-9bdb-b8f94d20f19e__wakuorg_nwaku:latest.log
2026-03-02 04:40:37.826 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 13604
2026-03-02 04:40:37.826 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-02 04:40:38.827 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13604/health" -H "Content-Type: application/json" -d 'None'
2026-03-02 04:40:38.830 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-02 04:40:38.830 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-02 04:40:38.830 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13604/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-02 04:40:38.833 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.100.70/tcp/13605/p2p/16Uiu2HAmNiePSRZUCqq1FhaoLNqNjywm1L2ViZ83GBSDMLnBZKnJ","/ip4/172.18.100.70/tcp/13606/ws/p2p/16Uiu2HAmNiePSRZUCqq1FhaoLNqNjywm1L2ViZ83GBSDMLnBZKnJ"],"enrUri":"enr:-L24QHIOv-a1mV73Ful47RlvuCybJIvlbBguWhWNABNVqKnGWE4kkKDcg9ks6K72FxdHfbdCfO5WukaT3aa2LTWDmW4CgmlkgnY0gmlwhKwSZEaKbXVsdGlhZGRyc5YACASsEmRGBjUlAAoErBJkRgY1Jt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDlYSezcp50Il1rdtEBDLWO7t-0Lk-nOE4m3Id065KykuDdGNwgjUlg3VkcII1J4V3YWt1MgE"}'
2026-03-02 04:40:38.833 INFO [src.node.waku_node] REST service is ready !!
2026-03-02 04:40:38.833 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32796/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.216.255/tcp/39430/p2p/16Uiu2HAm9Xquk6ngSMR1dyrXERMdeswyFNoQFY9jUTUfUQWC2d19"]'
2026-03-02 04:40:38.836 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:38.836 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13604/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.254.182/tcp/32797/p2p/16Uiu2HAmD21RUTqfTasw5tQpdjgg6M3ZLPGuCP1Ehg1pSWk4sBHm"]'
2026-03-02 04:40:38.872 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:38.873 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39429/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-02 04:40:38.884 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:38.886 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32796/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-02 04:40:38.891 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:38.892 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13604/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-02 04:40:38.894 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:38.895 DEBUG [src.steps.store] Relaying message
2026-03-02 04:40:38.895 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39429/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:40:38.901 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:38.902 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-02 04:40:38.914 DEBUG [src.steps.store] Relaying message
2026-03-02 04:40:38.914 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39429/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:40:38.919 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:38.920 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-02 04:40:38.932 DEBUG [src.steps.store] Relaying message
2026-03-02 04:40:38.932 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39429/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:40:38.938 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:38.938 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-02 04:40:38.949 DEBUG [src.steps.store] Relaying message
2026-03-02 04:40:38.949 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39429/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:40:38.955 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:38.955 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-02 04:40:38.966 DEBUG [src.steps.store] Relaying message
2026-03-02 04:40:38.966 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39429/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:40:38.971 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:38.972 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-02 04:40:38.983 DEBUG [src.steps.store] Relaying message
2026-03-02 04:40:38.983 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39429/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:40:38.988 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:38.988 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-02 04:40:38.999 DEBUG [src.steps.store] Relaying message
2026-03-02 04:40:38.999 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39429/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:40:39.004 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:39.004 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-02 04:40:39.016 DEBUG [src.steps.store] Relaying message
2026-03-02 04:40:39.016 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39429/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:40:39.021 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:39.021 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-02 04:40:39.032 DEBUG [src.steps.store] Relaying message
2026-03-02 04:40:39.032 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39429/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:40:39.037 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:39.037 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-02 04:40:39.048 DEBUG [src.steps.store] Relaying message
2026-03-02 04:40:39.048 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39429/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:40:39.053 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:39.054 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-02 04:40:39.065 DEBUG [src.steps.store] Relaying message
2026-03-02 04:40:39.065 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32796/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:40:39.073 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:39.074 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-02 04:40:39.084 DEBUG [src.steps.store] Relaying message
2026-03-02 04:40:39.085 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32796/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:40:39.092 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:39.093 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-02 04:40:39.104 DEBUG [src.steps.store] Relaying message
2026-03-02 04:40:39.105 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32796/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:40:39.111 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:39.112 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-02 04:40:39.123 DEBUG [src.steps.store] Relaying message
2026-03-02 04:40:39.123 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32796/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:40:39.130 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:39.131 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-02 04:40:39.142 DEBUG [src.steps.store] Relaying message
2026-03-02 04:40:39.142 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32796/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:40:39.148 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:39.150 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-02 04:40:39.160 DEBUG [src.steps.store] Relaying message
2026-03-02 04:40:39.161 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32796/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:40:39.168 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:39.169 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-02 04:40:39.180 DEBUG [src.steps.store] Relaying message
2026-03-02 04:40:39.180 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32796/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:40:39.186 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:39.187 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-02 04:40:39.198 DEBUG [src.steps.store] Relaying message
2026-03-02 04:40:39.198 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32796/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:40:39.204 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:39.206 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-02 04:40:39.217 DEBUG [src.steps.store] Relaying message
2026-03-02 04:40:39.217 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32796/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:40:39.223 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:39.224 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-02 04:40:39.234 DEBUG [src.steps.store] Relaying message
2026-03-02 04:40:39.235 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32796/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:40:39.242 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:39.243 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-02 04:40:39.253 DEBUG [src.steps.store] Relaying message
2026-03-02 04:40:39.253 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13604/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:40:39.258 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:39.258 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-02 04:40:39.268 DEBUG [src.steps.store] Relaying message
2026-03-02 04:40:39.269 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13604/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:40:39.273 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:39.274 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-02 04:40:39.284 DEBUG [src.steps.store] Relaying message
2026-03-02 04:40:39.284 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13604/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:40:39.290 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:39.290 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-02 04:40:39.301 DEBUG [src.steps.store] Relaying message
2026-03-02 04:40:39.301 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13604/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:40:39.305 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:39.306 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-02 04:40:39.317 DEBUG [src.steps.store] Relaying message
2026-03-02 04:40:39.317 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13604/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:40:39.321 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:39.321 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-02 04:40:39.333 DEBUG [src.steps.store] Relaying message
2026-03-02 04:40:39.333 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13604/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:40:39.338 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:39.340 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-02 04:40:39.351 DEBUG [src.steps.store] Relaying message
2026-03-02 04:40:39.352 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13604/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:40:39.356 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:39.357 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-02 04:40:39.368 DEBUG [src.steps.store] Relaying message
2026-03-02 04:40:39.368 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13604/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:40:39.372 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:39.376 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-02 04:40:39.386 DEBUG [src.steps.store] Relaying message
2026-03-02 04:40:39.387 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13604/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:40:39.391 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:39.391 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-02 04:40:39.402 DEBUG [src.steps.store] Relaying message
2026-03-02 04:40:39.402 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13604/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:40:39.407 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:40:39.407 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-02 04:40:39.418 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-02 04:40:39.418 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:39429/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-02 04:40:39.422 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0xca82eed52c4b35ddb0dd8c7dbd2f7a46045669e37e09a89a33aa34e7c606a269"},{"messageHash":"0xd873c53c4b315f7ba8065098694e36aeaa192f74f82c32c554425701fb83e8e1"},{"messageHash":"0x5e2c9a014b79f6e6b748f86fdb0a76d76f1bc3d3f56193eb8a1494308d914772"},{"messageHash":"0x09c8cd86bb2c61c143788ac72001b0e512adf19eea9fc9eb2ba1f74d79bd33e0"},{"messageHash":"0x02a749acc2b2fac4fbc3d1012e7a58b6eb829f7cbbf756b9df49f122efd9a5d8"},{"messageHash":"0x0d2f6da4b524ee68cd261ca3796c5bbce2979e73940ffe4f8aa44ab45db72ac7"},{"messageHash":"0xb5dd5cd0afd19b87c25d328648eb546f4dc5112e5b78b4d0d2a302ddad0e8690"},{"messageHash":"0xe7baf62933078417e3917935b30ca98c1add7e6bb9fb805ecd3f76656199cb0f"},{"messageHash":"0x12c717745691d149a076509d3040d29ac1c3dbf9e51c1325d442b130a87fa78a"},{"messageHash":"0xedc1460ccae5b5a79563e79e86dda760b4ff2bca54a6b0209259fe79c42ad473"},{"messageHash":"0xbf29da98c9de711d3d167a85f17e7cdc3cefd34409c2da92661bfbcf3191e573"},{"messageHash":"0x5d8a960dbf2471f54c334747a60035e85a4fff1a327c296d709346b60638b90f"},{"messageHash":"0x1e9ae55f09d7f568144769ceaa594259d3f705bd5017bcf173fb9134f2e0b98e"},{"messageHash":"0xdd02acec0397d04354cdbc8cc08644161f59441356d2fbe6cdbe10ae22646c8a"},{"messageHash":"0x98f10bf4c26e652dac5c545172102d7a7d0c76f41ccb7e227cacd2dc8e288507"},{"messageHash":"0x4323760580eab48be364b3fb9e753e02dd0c116ae8b32330524b48d3df99d1ea"},{"messageHash":"0xe987bd38d231c577fa621acc473d379ffe778d2cc9c810e2b7c88a50d0b1c0cb"},{"messageHash":"0x2b00f114b408e127c2d1208f8da03b97c62d28d27d7ad7a2d17b1a88a24b9186"},{"messageHash":"0x9677a02897febea8fe05d6c6591ea7551ac547b09721c4af66d752fbdbd47230"},{"messageHash":"0x8fd8734181a6a8a7ef68e3f228b794d0ce2a7458d3933d4c88e1e4e40b775fa4"},{"messageHash":"0x0f9b09d6bc1c2a0a7f8b798339af539bf19fe8e1ed640ee53711371210286bde"},{"messageHash":"0x35262913601a2bfbf75e2d37e1cc3da6757352b8778b1c92bd5f7c22d5da325d"},{"messageHash":"0xb61e75b3d332e13e924c9a8f641dde50c8692c45fb606ab22a020a3225040dbc"},{"messageHash":"0x1327321bf98025f767d9952b18b71e9017324d793ca8943940451e63b8253627"},{"messageHash":"0x23f48246f6e1eb977f4db42d20a77df2782e0d3bc7acca3acc56059547f56913"},{"messageHash":"0xe53412aa5d5f53ce187e9a83d80f9ff9f5d0067b169a3e3456e49b4457c1d377"},{"messageHash":"0xb1d990cdb121f8616ed4947ea8b7c927ab185ca77173ef209b2c4244d5da6885"},{"messageHash":"0x1e8f4727f9585f83fd09bf430fec21584013df58605a04ddb5d7de70d056ff3d"},{"messageHash":"0x8c5a4e8866582cc33a5eb0a30d31ca3a1cc06314475b417177b671d7c8ff81f4"},{"messageHash":"0x91fbe21b1a72bacf71293caccb67ed5cf562af316f1f245eff55e79fe540a1af"}]}'
2026-03-02 04:40:39.422 DEBUG [src.steps.store] messages length is 30
2026-03-02 04:40:39.425 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-02 04:40:39.426 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32796/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-02 04:40:39.429 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0xca82eed52c4b35ddb0dd8c7dbd2f7a46045669e37e09a89a33aa34e7c606a269"},{"messageHash":"0xd873c53c4b315f7ba8065098694e36aeaa192f74f82c32c554425701fb83e8e1"},{"messageHash":"0x5e2c9a014b79f6e6b748f86fdb0a76d76f1bc3d3f56193eb8a1494308d914772"},{"messageHash":"0x09c8cd86bb2c61c143788ac72001b0e512adf19eea9fc9eb2ba1f74d79bd33e0"},{"messageHash":"0x02a749acc2b2fac4fbc3d1012e7a58b6eb829f7cbbf756b9df49f122efd9a5d8"},{"messageHash":"0x0d2f6da4b524ee68cd261ca3796c5bbce2979e73940ffe4f8aa44ab45db72ac7"},{"messageHash":"0xb5dd5cd0afd19b87c25d328648eb546f4dc5112e5b78b4d0d2a302ddad0e8690"},{"messageHash":"0xe7baf62933078417e3917935b30ca98c1add7e6bb9fb805ecd3f76656199cb0f"},{"messageHash":"0x12c717745691d149a076509d3040d29ac1c3dbf9e51c1325d442b130a87fa78a"},{"messageHash":"0xedc1460ccae5b5a79563e79e86dda760b4ff2bca54a6b0209259fe79c42ad473"},{"messageHash":"0xbf29da98c9de711d3d167a85f17e7cdc3cefd34409c2da92661bfbcf3191e573"},{"messageHash":"0x5d8a960dbf2471f54c334747a60035e85a4fff1a327c296d709346b60638b90f"},{"messageHash":"0x1e9ae55f09d7f568144769ceaa594259d3f705bd5017bcf173fb9134f2e0b98e"},{"messageHash":"0xdd02acec0397d04354cdbc8cc08644161f59441356d2fbe6cdbe10ae22646c8a"},{"messageHash":"0x98f10bf4c26e652dac5c545172102d7a7d0c76f41ccb7e227cacd2dc8e288507"},{"messageHash":"0x4323760580eab48be364b3fb9e753e02dd0c116ae8b32330524b48d3df99d1ea"},{"messageHash":"0xe987bd38d231c577fa621acc473d379ffe778d2cc9c810e2b7c88a50d0b1c0cb"},{"messageHash":"0x2b00f114b408e127c2d1208f8da03b97c62d28d27d7ad7a2d17b1a88a24b9186"},{"messageHash":"0x9677a02897febea8fe05d6c6591ea7551ac547b09721c4af66d752fbdbd47230"},{"messageHash":"0x8fd8734181a6a8a7ef68e3f228b794d0ce2a7458d3933d4c88e1e4e40b775fa4"},{"messageHash":"0x0f9b09d6bc1c2a0a7f8b798339af539bf19fe8e1ed640ee53711371210286bde"},{"messageHash":"0x35262913601a2bfbf75e2d37e1cc3da6757352b8778b1c92bd5f7c22d5da325d"},{"messageHash":"0xb61e75b3d332e13e924c9a8f641dde50c8692c45fb606ab22a020a3225040dbc"},{"messageHash":"0x1327321bf98025f767d9952b18b71e9017324d793ca8943940451e63b8253627"},{"messageHash":"0x23f48246f6e1eb977f4db42d20a77df2782e0d3bc7acca3acc56059547f56913"},{"messageHash":"0xe53412aa5d5f53ce187e9a83d80f9ff9f5d0067b169a3e3456e49b4457c1d377"},{"messageHash":"0xb1d990cdb121f8616ed4947ea8b7c927ab185ca77173ef209b2c4244d5da6885"},{"messageHash":"0x1e8f4727f9585f83fd09bf430fec21584013df58605a04ddb5d7de70d056ff3d"},{"messageHash":"0x8c5a4e8866582cc33a5eb0a30d31ca3a1cc06314475b417177b671d7c8ff81f4"},{"messageHash":"0x91fbe21b1a72bacf71293caccb67ed5cf562af316f1f245eff55e79fe540a1af"}]}'
2026-03-02 04:40:39.429 DEBUG [src.steps.store] messages length is 30
2026-03-02 04:40:39.432 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-02 04:40:39.433 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13604/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-02 04:40:39.442 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"21f0870e5dd9b565554d","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0xca82eed52c4b35ddb0dd8c7dbd2f7a46045669e37e09a89a33aa34e7c606a269"},{"messageHash":"0xd873c53c4b315f7ba8065098694e36aeaa192f74f82c32c554425701fb83e8e1"},{"messageHash":"0x5e2c9a014b79f6e6b748f86fdb0a76d76f1bc3d3f56193eb8a1494308d914772"},{"messageHash":"0x09c8cd86bb2c61c143788ac72001b0e512adf19eea9fc9eb2ba1f74d79bd33e0"},{"messageHash":"0x02a749acc2b2fac4fbc3d1012e7a58b6eb829f7cbbf756b9df49f122efd9a5d8"},{"messageHash":"0x0d2f6da4b524ee68cd261ca3796c5bbce2979e73940ffe4f8aa44ab45db72ac7"},{"messageHash":"0xb5dd5cd0afd19b87c25d328648eb546f4dc5112e5b78b4d0d2a302ddad0e8690"},{"messageHash":"0xe7baf62933078417e3917935b30ca98c1add7e6bb9fb805ecd3f76656199cb0f"},{"messageHash":"0x12c717745691d149a076509d3040d29ac1c3dbf9e51c1325d442b130a87fa78a"},{"messageHash":"0xedc1460ccae5b5a79563e79e86dda760b4ff2bca54a6b0209259fe79c42ad473"},{"messageHash":"0xbf29da98c9de711d3d167a85f17e7cdc3cefd34409c2da92661bfbcf3191e573"},{"messageHash":"0x5d8a960dbf2471f54c334747a60035e85a4fff1a327c296d709346b60638b90f"},{"messageHash":"0x1e9ae55f09d7f568144769ceaa594259d3f705bd5017bcf173fb9134f2e0b98e"},{"messageHash":"0xdd02acec0397d04354cdbc8cc08644161f59441356d2fbe6cdbe10ae22646c8a"},{"messageHash":"0x98f10bf4c26e652dac5c545172102d7a7d0c76f41ccb7e227cacd2dc8e288507"},{"messageHash":"0x4323760580eab48be364b3fb9e753e02dd0c116ae8b32330524b48d3df99d1ea"},{"messageHash":"0xe987bd38d231c577fa621acc473d379ffe778d2cc9c810e2b7c88a50d0b1c0cb"},{"messageHash":"0x2b00f114b408e127c2d1208f8da03b97c62d28d27d7ad7a2d17b1a88a24b9186"},{"messageHash":"0x9677a02897febea8fe05d6c6591ea7551ac547b09721c4af66d752fbdbd47230"},{"messageHash":"0x8fd8734181a6a8a7ef68e3f228b794d0ce2a7458d3933d4c88e1e4e40b775fa4"},{"messageHash":"0x0f9b09d6bc1c2a0a7f8b798339af539bf19fe8e1ed640ee53711371210286bde"},{"messageHash":"0x35262913601a2bfbf75e2d37e1cc3da6757352b8778b1c92bd5f7c22d5da325d"},{"messageHash":"0xb61e75b3d332e13e924c9a8f641dde50c8692c45fb606ab22a020a3225040dbc"},{"messageHash":"0x1327321bf98025f767d9952b18b71e9017324d793ca8943940451e63b8253627"},{"messageHash":"0x23f48246f6e1eb977f4db42d20a77df2782e0d3bc7acca3acc56059547f56913"},{"messageHash":"0xe53412aa5d5f53ce187e9a83d80f9ff9f5d0067b169a3e3456e49b4457c1d377"},{"messageHash":"0xb1d990cdb121f8616ed4947ea8b7c927ab185ca77173ef209b2c4244d5da6885"},{"messageHash":"0x1e8f4727f9585f83fd09bf430fec21584013df58605a04ddb5d7de70d056ff3d"},{"messageHash":"0x8c5a4e8866582cc33a5eb0a30d31ca3a1cc06314475b417177b671d7c8ff81f4"},{"messageHash":"0x91fbe21b1a72bacf71293caccb67ed5cf562af316f1f245eff55e79fe540a1af"}]}'
2026-03-02 04:40:39.442 DEBUG [src.steps.store] messages length is 30
2026-03-02 04:40:39.447 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-02 04:40:39.449 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-02 04:40:39.449 DEBUG [src.node.waku_node] Stopping container with id 33eba070ac38
2026-03-02 04:40:40.042 DEBUG [src.node.waku_node] Container stopped.
2026-03-02 04:40:40.044 DEBUG [src.node.waku_node] Stopping container with id 00ca4e480c83
2026-03-02 04:40:40.624 DEBUG [src.node.waku_node] Container stopped.
2026-03-02 04:40:40.624 DEBUG [src.node.waku_node] Stopping container with id ca58b46c73de
2026-03-02 04:40:40.856 ERROR [src.node.docker_mananger] Max retries reached for container 33eba070ac38. Exiting log stream.
2026-03-02 04:40:41.194 DEBUG [src.node.waku_node] Container stopped.
2026-03-02 04:40:41.198 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-02 04:40:41.210 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-02 04:40:41.227 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-02 04:40:41.237 DEBUG [src.node.docker_mananger] No errors found in the waku logs.