145 lines
26 KiB
Plaintext

2026-03-21 04:37:13.467 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-21 04:37:13.467 DEBUG [tests.conftest] Running test: test_sync_nodes_have_store_true with id: 2026-03-21_04-37-13__13539497-8214-40f4-b22b-bfa337d2b436
2026-03-21 04:37:13.467 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-21 04:37:13.474 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-21 04:37:13.474 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-21_04-37-13__13539497-8214-40f4-b22b-bfa337d2b436__wakuorg_nwaku:latest.log
2026-03-21 04:37:13.481 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-21 04:37:13.481 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-21_04-37-13__13539497-8214-40f4-b22b-bfa337d2b436__wakuorg_nwaku:latest.log
2026-03-21 04:37:13.487 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-21 04:37:13.488 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-21_04-37-13__13539497-8214-40f4-b22b-bfa337d2b436__wakuorg_nwaku:latest.log
2026-03-21 04:37:13.488 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-21 04:37:13.489 DEBUG [src.node.waku_node] Starting Node...
2026-03-21 04:37:13.489 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-21 04:37:13.490 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-21 04:37:13.490 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.52.161
2026-03-21 04:37:13.491 DEBUG [src.node.docker_mananger] Generated ports ['32289', '32290', '32291', '32292', '32293']
2026-03-21 04:37:13.491 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-21 04:37:13.491 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-21 04:37:13.491 DEBUG [src.node.waku_node] Using volumes []
2026-03-21 04:37:13.491 DEBUG [src.node.docker_mananger] docker run -i -t -p 32289:32289 -p 32290:32290 -p 32291:32291 -p 32292:32292 -p 32293:32293 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=32291 --rest-port=32289 --tcp-port=32290 --discv5-udp-port=32292 --rest-address=0.0.0.0 --nat=extip:172.18.52.161 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=2f65edc9db900e0bbeeee6711b4ddcde77ab5c1afaba0dfdefb3eee31aeb0ddd --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=32293 --metrics-logging=true --store=true --relay=true
2026-03-21 04:37:13.682 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.52.161 waku a40e49aead54d24b9377b3f2ef9a80616fc0e9cc10d3fd27a99f1055e9a73d99
2026-03-21 04:37:13.717 DEBUG [src.node.docker_mananger] Container started with ID a40e49aead54. Setting up logs at ./log/docker/node1_2026-03-21_04-37-13__13539497-8214-40f4-b22b-bfa337d2b436__wakuorg_nwaku:latest.log
2026-03-21 04:37:13.719 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 32289
2026-03-21 04:37:13.719 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-21 04:37:13.742 ERROR [src.node.docker_mananger] Max retries reached for container 19e488f82105. Exiting log stream.
2026-03-21 04:37:14.264 ERROR [src.node.docker_mananger] Max retries reached for container 6ec18aec805c. Exiting log stream.
2026-03-21 04:37:14.720 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32289/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:37:14.723 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-21 04:37:14.723 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-21 04:37:14.723 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32289/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:37:14.726 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.52.161/tcp/32290/p2p/16Uiu2HAmU2CJ5FLZt6HQSuXgZFfdRXSLaotpr8JCGcBZ17BkqzTv","/ip4/172.18.52.161/tcp/32291/ws/p2p/16Uiu2HAmU2CJ5FLZt6HQSuXgZFfdRXSLaotpr8JCGcBZ17BkqzTv"],"enrUri":"enr:-L24QJ2V7v8JQP19Frh-dKrSnYwpqUNArrOEk5YlmwyTsxx1GKMm6VTI58U98o709Ja_9bKWON0eMorMWCvyb7LqUYYCgmlkgnY0gmlwhKwSNKGKbXVsdGlhZGRyc5YACASsEjShBn4iAAoErBI0oQZ-I90DgnJzhQADAQAAiXNlY3AyNTZrMaED5E4BsvN1Ro9ZcPE2liSdAFm3SpIfA_beGKykz2l8Ig2DdGNwgn4ig3VkcIJ-JIV3YWt1MgM"}'
2026-03-21 04:37:14.726 INFO [src.node.waku_node] REST service is ready !!
2026-03-21 04:37:14.726 DEBUG [src.node.waku_node] Starting Node...
2026-03-21 04:37:14.727 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-21 04:37:14.728 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-21 04:37:14.728 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.13.211
2026-03-21 04:37:14.728 DEBUG [src.node.docker_mananger] Generated ports ['39875', '39876', '39877', '39878', '39879']
2026-03-21 04:37:14.729 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-21 04:37:14.729 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-21 04:37:14.729 DEBUG [src.node.waku_node] Using volumes []
2026-03-21 04:37:14.729 DEBUG [src.node.docker_mananger] docker run -i -t -p 39875:39875 -p 39876:39876 -p 39877:39877 -p 39878:39878 -p 39879:39879 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=39877 --rest-port=39875 --tcp-port=39876 --discv5-udp-port=39878 --rest-address=0.0.0.0 --nat=extip:172.18.13.211 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=57bfee48bc04aeeb18225d5a34bc3625665eaddba673f0c6abab5b2f725e7ee6 --store-sync=true --store=true --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=39879 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QJ2V7v8JQP19Frh-dKrSnYwpqUNArrOEk5YlmwyTsxx1GKMm6VTI58U98o709Ja_9bKWON0eMorMWCvyb7LqUYYCgmlkgnY0gmlwhKwSNKGKbXVsdGlhZGRyc5YACASsEjShBn4iAAoErBI0oQZ-I90DgnJzhQADAQAAiXNlY3AyNTZrMaED5E4BsvN1Ro9ZcPE2liSdAFm3SpIfA_beGKykz2l8Ig2DdGNwgn4ig3VkcIJ-JIV3YWt1MgM
2026-03-21 04:37:14.947 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.13.211 waku f3d29751ec4a2f01cbba2ec00721b39cfce87c735359d804b7b6a3c28040e29d
2026-03-21 04:37:14.984 DEBUG [src.node.docker_mananger] Container started with ID f3d29751ec4a. Setting up logs at ./log/docker/node2_2026-03-21_04-37-13__13539497-8214-40f4-b22b-bfa337d2b436__wakuorg_nwaku:latest.log
2026-03-21 04:37:14.984 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 39875
2026-03-21 04:37:14.985 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-21 04:37:15.985 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:39875/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:37:15.988 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-21 04:37:15.988 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-21 04:37:15.989 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:39875/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:37:15.991 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.13.211/tcp/39876/p2p/16Uiu2HAmHpj4QN6uFA6b87zKUpYn81UxW67RJwdWuBMxZMC6MX56","/ip4/172.18.13.211/tcp/39877/ws/p2p/16Uiu2HAmHpj4QN6uFA6b87zKUpYn81UxW67RJwdWuBMxZMC6MX56"],"enrUri":"enr:-L24QJjaCAKBaIzePTGaLktESNwTtLgvBcYawk33Ef6wBMPYDWdSXqaFvOv4R37jlx2UsG4mJ0VR_UXrlfvSOOTzmfACgmlkgnY0gmlwhKwSDdOKbXVsdGlhZGRyc5YACASsEg3TBpvEAAoErBIN0wabxd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDTMjz9gxf53nNqvj8Ezo9rnHtSHjQ6a7jCfUN-UimCXWDdGNwgpvEg3VkcIKbxoV3YWt1MhM"}'
2026-03-21 04:37:15.992 INFO [src.node.waku_node] REST service is ready !!
2026-03-21 04:37:15.992 DEBUG [src.node.waku_node] Starting Node...
2026-03-21 04:37:15.992 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-21 04:37:15.994 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-21 04:37:15.994 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.61.59
2026-03-21 04:37:15.994 DEBUG [src.node.docker_mananger] Generated ports ['18412', '18413', '18414', '18415', '18416']
2026-03-21 04:37:15.994 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-21 04:37:15.995 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-21 04:37:15.995 DEBUG [src.node.waku_node] Using volumes []
2026-03-21 04:37:15.995 DEBUG [src.node.docker_mananger] docker run -i -t -p 18412:18412 -p 18413:18413 -p 18414:18414 -p 18415:18415 -p 18416:18416 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=18414 --rest-port=18412 --tcp-port=18413 --discv5-udp-port=18415 --rest-address=0.0.0.0 --nat=extip:172.18.61.59 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=b6fdc5d30def71b684f6af80d2abb3eb26c7e9f007bed47f5c5b1eeeaedfbaaa --store-sync=true --store=true --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=18416 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QJjaCAKBaIzePTGaLktESNwTtLgvBcYawk33Ef6wBMPYDWdSXqaFvOv4R37jlx2UsG4mJ0VR_UXrlfvSOOTzmfACgmlkgnY0gmlwhKwSDdOKbXVsdGlhZGRyc5YACASsEg3TBpvEAAoErBIN0wabxd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDTMjz9gxf53nNqvj8Ezo9rnHtSHjQ6a7jCfUN-UimCXWDdGNwgpvEg3VkcIKbxoV3YWt1MhM
2026-03-21 04:37:16.232 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.61.59 waku 2998b358a9261023905c86b8e32a74f807d6607ddf737d0aded86ce2976ec79a
2026-03-21 04:37:16.267 DEBUG [src.node.docker_mananger] Container started with ID 2998b358a926. Setting up logs at ./log/docker/node3_2026-03-21_04-37-13__13539497-8214-40f4-b22b-bfa337d2b436__wakuorg_nwaku:latest.log
2026-03-21 04:37:16.268 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 18412
2026-03-21 04:37:16.268 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-21 04:37:17.270 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18412/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:37:17.273 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-21 04:37:17.273 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-21 04:37:17.273 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18412/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:37:17.276 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.61.59/tcp/18413/p2p/16Uiu2HAm1mFVR1dzvWEZxQ6BoQUBJhJ5UxDKTpcufGF84aVWpeMa","/ip4/172.18.61.59/tcp/18414/ws/p2p/16Uiu2HAm1mFVR1dzvWEZxQ6BoQUBJhJ5UxDKTpcufGF84aVWpeMa"],"enrUri":"enr:-L24QJFWJohKA0sCNv1qj1JgnHCZ5RqfUvMJ26M0I1D62ZoaX-M5ZUscZnle-YUctVrKyUFsL6eMgezrQnBtrDbuIMICgmlkgnY0gmlwhKwSPTuKbXVsdGlhZGRyc5YACASsEj07BkftAAoErBI9OwZH7t0DgnJzhQADAQAAiXNlY3AyNTZrMaECXioMMF-uuvZcHdA7VNlkWwHe6yaFcZZbL599B5AEvUWDdGNwgkftg3VkcIJH74V3YWt1MhM"}'
2026-03-21 04:37:17.276 INFO [src.node.waku_node] REST service is ready !!
2026-03-21 04:37:17.276 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39875/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.52.161/tcp/32290/p2p/16Uiu2HAmU2CJ5FLZt6HQSuXgZFfdRXSLaotpr8JCGcBZ17BkqzTv"]'
2026-03-21 04:37:17.279 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:37:17.279 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:18412/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.13.211/tcp/39876/p2p/16Uiu2HAmHpj4QN6uFA6b87zKUpYn81UxW67RJwdWuBMxZMC6MX56"]'
2026-03-21 04:37:17.325 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:37:17.326 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32289/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-21 04:37:17.332 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:37:17.336 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39875/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-21 04:37:17.341 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:37:17.341 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:18412/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-21 04:37:17.345 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:37:17.345 DEBUG [src.steps.store] Relaying message
2026-03-21 04:37:17.346 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32289/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:37:17.352 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:37:17.354 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:37:17.555 DEBUG [src.steps.store] Relaying message
2026-03-21 04:37:17.555 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32289/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:37:17.561 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:37:17.562 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:37:17.763 DEBUG [src.steps.store] Relaying message
2026-03-21 04:37:17.763 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32289/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:37:17.770 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:37:17.770 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:37:17.971 DEBUG [src.steps.store] Relaying message
2026-03-21 04:37:17.971 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32289/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:37:17.977 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:37:17.978 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:37:18.179 DEBUG [src.steps.store] Relaying message
2026-03-21 04:37:18.179 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32289/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:37:18.185 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:37:18.185 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:37:18.389 DEBUG [src.steps.store] Relaying message
2026-03-21 04:37:18.389 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32289/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:37:18.395 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:37:18.396 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:37:18.598 DEBUG [src.steps.store] Relaying message
2026-03-21 04:37:18.598 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32289/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:37:18.604 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:37:18.604 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:37:18.805 DEBUG [src.steps.store] Relaying message
2026-03-21 04:37:18.806 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32289/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:37:18.815 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:37:18.815 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:37:19.016 DEBUG [src.steps.store] Relaying message
2026-03-21 04:37:19.016 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32289/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:37:19.023 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:37:19.025 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:37:19.227 DEBUG [src.steps.store] Relaying message
2026-03-21 04:37:19.227 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32289/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:37:19.234 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:37:19.235 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:37:19.436 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-21 04:37:19.437 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32289/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:37:19.440 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0xcac6ef5d4dc4b6f093e00037d070389c337913bb8ce9d976686b72d77ec66149"},{"messageHash":"0xf8a96491a3226579c7039ebf393a9063cd57c54074e76b68a7f43a18d171fe8d"},{"messageHash":"0x17442a06ab6d11c98601cf655e2fdc01e3be0f2fc3170fd4da319b003ac91632"},{"messageHash":"0xb00e385066f025877fe3eb74ac86521b6877c3ca7107d4f3552e6727f330b052"},{"messageHash":"0xf20fe2da8f4426188591ce41bc45070efe58c9b17d4f3c865e09268a2355a845"},{"messageHash":"0x557c7aacd3d702ea492d7f6741d5e4527a35aa7baecae46c05759ce6db8fc404"},{"messageHash":"0x60b9fcc0e8ee9acdd5c35d927e5f8a9ccf514a7f3aa6a52cbda21b408cc702aa"},{"messageHash":"0x9f5ae92c2e09112f5ae1116f8bbde6b41184d817b6ed3a3f398c79b8fcaf19cc"},{"messageHash":"0xd125835ff5b8e3373d1ac8bf084075f7263bcaccbbae1443d4201b275f9885ba"},{"messageHash":"0x339473c43e26f656d515639f04ac14d1d98e90ca460674636af3d5d4ead2c910"}]}'
2026-03-21 04:37:19.440 DEBUG [src.steps.store] messages length is 10
2026-03-21 04:37:19.442 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-21 04:37:19.442 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:39875/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:37:19.445 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0xcac6ef5d4dc4b6f093e00037d070389c337913bb8ce9d976686b72d77ec66149"},{"messageHash":"0xf8a96491a3226579c7039ebf393a9063cd57c54074e76b68a7f43a18d171fe8d"},{"messageHash":"0x17442a06ab6d11c98601cf655e2fdc01e3be0f2fc3170fd4da319b003ac91632"},{"messageHash":"0xb00e385066f025877fe3eb74ac86521b6877c3ca7107d4f3552e6727f330b052"},{"messageHash":"0xf20fe2da8f4426188591ce41bc45070efe58c9b17d4f3c865e09268a2355a845"},{"messageHash":"0x557c7aacd3d702ea492d7f6741d5e4527a35aa7baecae46c05759ce6db8fc404"},{"messageHash":"0x60b9fcc0e8ee9acdd5c35d927e5f8a9ccf514a7f3aa6a52cbda21b408cc702aa"},{"messageHash":"0x9f5ae92c2e09112f5ae1116f8bbde6b41184d817b6ed3a3f398c79b8fcaf19cc"},{"messageHash":"0xd125835ff5b8e3373d1ac8bf084075f7263bcaccbbae1443d4201b275f9885ba"},{"messageHash":"0x339473c43e26f656d515639f04ac14d1d98e90ca460674636af3d5d4ead2c910"}]}'
2026-03-21 04:37:19.445 DEBUG [src.steps.store] messages length is 10
2026-03-21 04:37:19.447 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-21 04:37:19.447 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18412/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:37:19.450 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0xcac6ef5d4dc4b6f093e00037d070389c337913bb8ce9d976686b72d77ec66149"},{"messageHash":"0xf8a96491a3226579c7039ebf393a9063cd57c54074e76b68a7f43a18d171fe8d"},{"messageHash":"0x17442a06ab6d11c98601cf655e2fdc01e3be0f2fc3170fd4da319b003ac91632"},{"messageHash":"0xb00e385066f025877fe3eb74ac86521b6877c3ca7107d4f3552e6727f330b052"},{"messageHash":"0xf20fe2da8f4426188591ce41bc45070efe58c9b17d4f3c865e09268a2355a845"},{"messageHash":"0x557c7aacd3d702ea492d7f6741d5e4527a35aa7baecae46c05759ce6db8fc404"},{"messageHash":"0x60b9fcc0e8ee9acdd5c35d927e5f8a9ccf514a7f3aa6a52cbda21b408cc702aa"},{"messageHash":"0x9f5ae92c2e09112f5ae1116f8bbde6b41184d817b6ed3a3f398c79b8fcaf19cc"},{"messageHash":"0xd125835ff5b8e3373d1ac8bf084075f7263bcaccbbae1443d4201b275f9885ba"},{"messageHash":"0x339473c43e26f656d515639f04ac14d1d98e90ca460674636af3d5d4ead2c910"}]}'
2026-03-21 04:37:19.450 DEBUG [src.steps.store] messages length is 10
2026-03-21 04:37:19.453 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-21 04:37:19.454 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-21 04:37:19.454 DEBUG [src.node.waku_node] Stopping container with id a40e49aead54
2026-03-21 04:37:20.040 DEBUG [src.node.waku_node] Container stopped.
2026-03-21 04:37:20.040 DEBUG [src.node.waku_node] Stopping container with id f3d29751ec4a
2026-03-21 04:37:20.616 DEBUG [src.node.waku_node] Container stopped.
2026-03-21 04:37:20.616 DEBUG [src.node.waku_node] Stopping container with id 2998b358a926
2026-03-21 04:37:20.857 ERROR [src.node.docker_mananger] Max retries reached for container a40e49aead54. Exiting log stream.
2026-03-21 04:37:21.181 DEBUG [src.node.waku_node] Container stopped.
2026-03-21 04:37:21.182 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-21 04:37:21.195 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-21 04:37:21.207 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-21 04:37:21.218 DEBUG [src.node.docker_mananger] No errors found in the waku logs.