145 lines
26 KiB
Plaintext

2026-03-08 04:38:36.745 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-08 04:38:36.745 DEBUG [tests.conftest] Running test: test_sync_nodes_have_store_true with id: 2026-03-08_04-38-36__57858c0d-95d3-42e8-89e9-3cf5747fd8ac
2026-03-08 04:38:36.746 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-08 04:38:36.755 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-08 04:38:36.755 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-08_04-38-36__57858c0d-95d3-42e8-89e9-3cf5747fd8ac__wakuorg_nwaku:latest.log
2026-03-08 04:38:36.762 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-08 04:38:36.762 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-08_04-38-36__57858c0d-95d3-42e8-89e9-3cf5747fd8ac__wakuorg_nwaku:latest.log
2026-03-08 04:38:36.768 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-08 04:38:36.768 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-08_04-38-36__57858c0d-95d3-42e8-89e9-3cf5747fd8ac__wakuorg_nwaku:latest.log
2026-03-08 04:38:36.768 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-08 04:38:36.769 DEBUG [src.node.waku_node] Starting Node...
2026-03-08 04:38:36.769 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-08 04:38:36.771 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-08 04:38:36.771 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.189.63
2026-03-08 04:38:36.771 DEBUG [src.node.docker_mananger] Generated ports ['18533', '18534', '18535', '18536', '18537']
2026-03-08 04:38:36.771 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-08 04:38:36.771 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-08 04:38:36.771 DEBUG [src.node.waku_node] Using volumes []
2026-03-08 04:38:36.771 DEBUG [src.node.docker_mananger] docker run -i -t -p 18533:18533 -p 18534:18534 -p 18535:18535 -p 18536:18536 -p 18537:18537 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=18535 --rest-port=18533 --tcp-port=18534 --discv5-udp-port=18536 --rest-address=0.0.0.0 --nat=extip:172.18.189.63 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ab6e935de7dcfef9ecac2c6cd875a57f40fc16e57ae1f6a786c4c3dd4a3d9b7b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=18537 --metrics-logging=true --store=true --relay=true
2026-03-08 04:38:36.951 ERROR [src.node.docker_mananger] Max retries reached for container 967467146fd3. Exiting log stream.
2026-03-08 04:38:36.968 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.189.63 waku 6cfc45aae69724767a60c520ae05035d0be7be4a02fc138351b51c16e9fac064
2026-03-08 04:38:37.001 DEBUG [src.node.docker_mananger] Container started with ID 6cfc45aae697. Setting up logs at ./log/docker/node1_2026-03-08_04-38-36__57858c0d-95d3-42e8-89e9-3cf5747fd8ac__wakuorg_nwaku:latest.log
2026-03-08 04:38:37.002 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 18533
2026-03-08 04:38:37.002 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-08 04:38:37.543 ERROR [src.node.docker_mananger] Max retries reached for container ba880e797f21. Exiting log stream.
2026-03-08 04:38:38.003 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18533/health" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:38:38.006 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-08 04:38:38.006 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-08 04:38:38.006 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18533/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:38:38.008 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.189.63/tcp/18534/p2p/16Uiu2HAm7hCCSUV51GK4vQJgAS1xPPc9TN7xJmjXneq5KSL25Lz7","/ip4/172.18.189.63/tcp/18535/ws/p2p/16Uiu2HAm7hCCSUV51GK4vQJgAS1xPPc9TN7xJmjXneq5KSL25Lz7"],"enrUri":"enr:-L24QNXh0jE45yi5F3zj3MHuROYDaQJ48L7Bbqcz5rVuLfJ5Jjz4PRHEh_PVZaeKQrfwycM12Ur5LyuhXj4G6CboMr0CgmlkgnY0gmlwhKwSvT-KbXVsdGlhZGRyc5YACASsEr0_BkhmAAoErBK9PwZIZ90DgnJzhQADAQAAiXNlY3AyNTZrMaECtkYfdo0PnmAt_3_rqBL6Jxxw94ofQkJSj3DsFs_HEGyDdGNwgkhmg3VkcIJIaIV3YWt1MgM"}'
2026-03-08 04:38:38.009 INFO [src.node.waku_node] REST service is ready !!
2026-03-08 04:38:38.009 DEBUG [src.node.waku_node] Starting Node...
2026-03-08 04:38:38.009 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-08 04:38:38.010 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-08 04:38:38.010 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.45.189
2026-03-08 04:38:38.011 DEBUG [src.node.docker_mananger] Generated ports ['34787', '34788', '34789', '34790', '34791']
2026-03-08 04:38:38.011 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-08 04:38:38.011 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-08 04:38:38.011 DEBUG [src.node.waku_node] Using volumes []
2026-03-08 04:38:38.011 DEBUG [src.node.docker_mananger] docker run -i -t -p 34787:34787 -p 34788:34788 -p 34789:34789 -p 34790:34790 -p 34791:34791 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=34789 --rest-port=34787 --tcp-port=34788 --discv5-udp-port=34790 --rest-address=0.0.0.0 --nat=extip:172.18.45.189 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=aceaff31bd09ff1fa1bc76dcf275ef32ae4b0abb4cefcdb77f78f9bf1f0dfd90 --store-sync=true --store=true --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=34791 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QNXh0jE45yi5F3zj3MHuROYDaQJ48L7Bbqcz5rVuLfJ5Jjz4PRHEh_PVZaeKQrfwycM12Ur5LyuhXj4G6CboMr0CgmlkgnY0gmlwhKwSvT-KbXVsdGlhZGRyc5YACASsEr0_BkhmAAoErBK9PwZIZ90DgnJzhQADAQAAiXNlY3AyNTZrMaECtkYfdo0PnmAt_3_rqBL6Jxxw94ofQkJSj3DsFs_HEGyDdGNwgkhmg3VkcIJIaIV3YWt1MgM
2026-03-08 04:38:38.206 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.45.189 waku 0d39c92fc10717418bbacb8bcbd6fc9c2d789e0059050aebd5824d085df31637
2026-03-08 04:38:38.240 DEBUG [src.node.docker_mananger] Container started with ID 0d39c92fc107. Setting up logs at ./log/docker/node2_2026-03-08_04-38-36__57858c0d-95d3-42e8-89e9-3cf5747fd8ac__wakuorg_nwaku:latest.log
2026-03-08 04:38:38.241 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 34787
2026-03-08 04:38:38.241 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-08 04:38:39.241 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34787/health" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:38:39.244 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-08 04:38:39.244 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-08 04:38:39.244 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34787/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:38:39.247 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.45.189/tcp/34788/p2p/16Uiu2HAmKed7m4Kq5dWf5xjpN3iPUg4FNrwZz5HHvF7eQpBhPERK","/ip4/172.18.45.189/tcp/34789/ws/p2p/16Uiu2HAmKed7m4Kq5dWf5xjpN3iPUg4FNrwZz5HHvF7eQpBhPERK"],"enrUri":"enr:-L24QIqNUtQESCePT7ojDDbAGp0LZ-1bycbJH4qtFP9g-P0DDnq_n5XC996BgI_uOudeQV29WTjxpujcWczIYhIIQb0CgmlkgnY0gmlwhKwSLb2KbXVsdGlhZGRyc5YACASsEi29BofkAAoErBItvQaH5d0DgnJzhQADAQAAiXNlY3AyNTZrMaEDZ-nMycKlNAKq3D-lqYoqajjqUvHQbitzh8PCoHAKisaDdGNwgofkg3VkcIKH5oV3YWt1MhM"}'
2026-03-08 04:38:39.247 INFO [src.node.waku_node] REST service is ready !!
2026-03-08 04:38:39.247 DEBUG [src.node.waku_node] Starting Node...
2026-03-08 04:38:39.247 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-08 04:38:39.249 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-08 04:38:39.249 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.68.73
2026-03-08 04:38:39.249 DEBUG [src.node.docker_mananger] Generated ports ['26863', '26864', '26865', '26866', '26867']
2026-03-08 04:38:39.250 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-08 04:38:39.250 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-08 04:38:39.250 DEBUG [src.node.waku_node] Using volumes []
2026-03-08 04:38:39.250 DEBUG [src.node.docker_mananger] docker run -i -t -p 26863:26863 -p 26864:26864 -p 26865:26865 -p 26866:26866 -p 26867:26867 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=26865 --rest-port=26863 --tcp-port=26864 --discv5-udp-port=26866 --rest-address=0.0.0.0 --nat=extip:172.18.68.73 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=f98737f8ec6cca9ea2e2cfc9b25a6dec385dbdafa3fca304488b1dcc4f9f43ff --store-sync=true --store=true --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=26867 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QIqNUtQESCePT7ojDDbAGp0LZ-1bycbJH4qtFP9g-P0DDnq_n5XC996BgI_uOudeQV29WTjxpujcWczIYhIIQb0CgmlkgnY0gmlwhKwSLb2KbXVsdGlhZGRyc5YACASsEi29BofkAAoErBItvQaH5d0DgnJzhQADAQAAiXNlY3AyNTZrMaEDZ-nMycKlNAKq3D-lqYoqajjqUvHQbitzh8PCoHAKisaDdGNwgofkg3VkcIKH5oV3YWt1MhM
2026-03-08 04:38:39.492 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.68.73 waku 6c35737284f28c6c1563083973e3ab76472750a5a313fd429420ba042124949f
2026-03-08 04:38:39.526 DEBUG [src.node.docker_mananger] Container started with ID 6c35737284f2. Setting up logs at ./log/docker/node3_2026-03-08_04-38-36__57858c0d-95d3-42e8-89e9-3cf5747fd8ac__wakuorg_nwaku:latest.log
2026-03-08 04:38:39.526 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 26863
2026-03-08 04:38:39.526 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-08 04:38:40.528 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26863/health" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:38:40.531 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-08 04:38:40.531 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-08 04:38:40.531 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26863/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:38:40.534 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.68.73/tcp/26864/p2p/16Uiu2HAm86F2Gzd8aUTZ1M5vV2qBTezNyQ4JwPWP2FBzoKWA851G","/ip4/172.18.68.73/tcp/26865/ws/p2p/16Uiu2HAm86F2Gzd8aUTZ1M5vV2qBTezNyQ4JwPWP2FBzoKWA851G"],"enrUri":"enr:-L24QOfwy2Z170NzhabLHVc_KeeCxbgjx73fN2QK8K-4A3TPG7CVfTAOwNKHazvxz7fhrVJnOzxIOHpe87NR7VtRU9YCgmlkgnY0gmlwhKwSREmKbXVsdGlhZGRyc5YACASsEkRJBmjwAAoErBJESQZo8d0DgnJzhQADAQAAiXNlY3AyNTZrMaECvC2s7LQdmKo6l1tEDy2Frb9voprh1pCe_QLoCii4ROeDdGNwgmjwg3VkcIJo8oV3YWt1MhM"}'
2026-03-08 04:38:40.534 INFO [src.node.waku_node] REST service is ready !!
2026-03-08 04:38:40.534 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34787/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.189.63/tcp/18534/p2p/16Uiu2HAm7hCCSUV51GK4vQJgAS1xPPc9TN7xJmjXneq5KSL25Lz7"]'
2026-03-08 04:38:40.537 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:38:40.538 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26863/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.45.189/tcp/34788/p2p/16Uiu2HAmKed7m4Kq5dWf5xjpN3iPUg4FNrwZz5HHvF7eQpBhPERK"]'
2026-03-08 04:38:40.575 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:38:40.576 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:18533/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-08 04:38:40.581 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:38:40.581 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34787/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-08 04:38:40.584 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:38:40.584 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26863/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-08 04:38:40.586 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:38:40.586 DEBUG [src.steps.store] Relaying message
2026-03-08 04:38:40.587 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:18533/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-08 04:38:40.592 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:38:40.592 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-08 04:38:40.793 DEBUG [src.steps.store] Relaying message
2026-03-08 04:38:40.793 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:18533/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-08 04:38:40.799 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:38:40.801 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-08 04:38:41.001 DEBUG [src.steps.store] Relaying message
2026-03-08 04:38:41.002 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:18533/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-08 04:38:41.008 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:38:41.008 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-08 04:38:41.208 DEBUG [src.steps.store] Relaying message
2026-03-08 04:38:41.209 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:18533/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-08 04:38:41.214 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:38:41.215 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-08 04:38:41.417 DEBUG [src.steps.store] Relaying message
2026-03-08 04:38:41.417 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:18533/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-08 04:38:41.423 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:38:41.423 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-08 04:38:41.624 DEBUG [src.steps.store] Relaying message
2026-03-08 04:38:41.624 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:18533/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-08 04:38:41.630 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:38:41.630 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-08 04:38:41.832 DEBUG [src.steps.store] Relaying message
2026-03-08 04:38:41.832 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:18533/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-08 04:38:41.838 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:38:41.839 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-08 04:38:42.040 DEBUG [src.steps.store] Relaying message
2026-03-08 04:38:42.040 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:18533/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-08 04:38:42.046 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:38:42.046 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-08 04:38:42.248 DEBUG [src.steps.store] Relaying message
2026-03-08 04:38:42.248 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:18533/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-08 04:38:42.253 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:38:42.254 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-08 04:38:42.455 DEBUG [src.steps.store] Relaying message
2026-03-08 04:38:42.456 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:18533/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-08 04:38:42.461 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:38:42.462 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-08 04:38:42.662 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-08 04:38:42.663 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18533/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:38:42.666 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x75437e360a7a9e598d3854df0306aee2a2430914f542c7a78e11c1e9c21179d9"},{"messageHash":"0xcfecfe1cf26ff5a8bf4a95638aef1b56d1b23e67a5bc744fc4002c946a8ef1ef"},{"messageHash":"0x5da1063fbf83cc2c0e3a0fa401245cf19f614b3205cfcc317be05b35b4db611f"},{"messageHash":"0xdc4233db0ad6d643e49c95b23235feaa5972a879fbb2125cad999c85b2f396f7"},{"messageHash":"0x7908ad7b07d5c7cd81f3a4dcc949184f847eff458e93f157b1f5ee1747a128cf"},{"messageHash":"0xe43f373dbe742076dcd0c05869f922a9880a5f57973a825df96ef5329855e8ac"},{"messageHash":"0x811d1278a600f7a2a7c75226f3c95276991a23f32feeb1da385f530f1f510748"},{"messageHash":"0xe8297d03221fb83dc1d5fd6de8db4e2988a792a821e78f0f94de0c103b9b6dad"},{"messageHash":"0x68dd20a02a4101b64e092f9d2401e11d36334f81a12fc25484d5e6f4a2b16bec"},{"messageHash":"0x76808048867f7d41d5291d9a4800729a6536aacf62782d4c24ff090038e7d88f"}]}'
2026-03-08 04:38:42.667 DEBUG [src.steps.store] messages length is 10
2026-03-08 04:38:42.668 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-08 04:38:42.668 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34787/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:38:42.671 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x75437e360a7a9e598d3854df0306aee2a2430914f542c7a78e11c1e9c21179d9"},{"messageHash":"0xcfecfe1cf26ff5a8bf4a95638aef1b56d1b23e67a5bc744fc4002c946a8ef1ef"},{"messageHash":"0x5da1063fbf83cc2c0e3a0fa401245cf19f614b3205cfcc317be05b35b4db611f"},{"messageHash":"0xdc4233db0ad6d643e49c95b23235feaa5972a879fbb2125cad999c85b2f396f7"},{"messageHash":"0x7908ad7b07d5c7cd81f3a4dcc949184f847eff458e93f157b1f5ee1747a128cf"},{"messageHash":"0xe43f373dbe742076dcd0c05869f922a9880a5f57973a825df96ef5329855e8ac"},{"messageHash":"0x811d1278a600f7a2a7c75226f3c95276991a23f32feeb1da385f530f1f510748"},{"messageHash":"0xe8297d03221fb83dc1d5fd6de8db4e2988a792a821e78f0f94de0c103b9b6dad"},{"messageHash":"0x68dd20a02a4101b64e092f9d2401e11d36334f81a12fc25484d5e6f4a2b16bec"},{"messageHash":"0x76808048867f7d41d5291d9a4800729a6536aacf62782d4c24ff090038e7d88f"}]}'
2026-03-08 04:38:42.671 DEBUG [src.steps.store] messages length is 10
2026-03-08 04:38:42.673 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-08 04:38:42.673 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26863/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:38:42.677 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x75437e360a7a9e598d3854df0306aee2a2430914f542c7a78e11c1e9c21179d9"},{"messageHash":"0xcfecfe1cf26ff5a8bf4a95638aef1b56d1b23e67a5bc744fc4002c946a8ef1ef"},{"messageHash":"0x5da1063fbf83cc2c0e3a0fa401245cf19f614b3205cfcc317be05b35b4db611f"},{"messageHash":"0xdc4233db0ad6d643e49c95b23235feaa5972a879fbb2125cad999c85b2f396f7"},{"messageHash":"0x7908ad7b07d5c7cd81f3a4dcc949184f847eff458e93f157b1f5ee1747a128cf"},{"messageHash":"0xe43f373dbe742076dcd0c05869f922a9880a5f57973a825df96ef5329855e8ac"},{"messageHash":"0x811d1278a600f7a2a7c75226f3c95276991a23f32feeb1da385f530f1f510748"},{"messageHash":"0xe8297d03221fb83dc1d5fd6de8db4e2988a792a821e78f0f94de0c103b9b6dad"},{"messageHash":"0x68dd20a02a4101b64e092f9d2401e11d36334f81a12fc25484d5e6f4a2b16bec"},{"messageHash":"0x76808048867f7d41d5291d9a4800729a6536aacf62782d4c24ff090038e7d88f"}]}'
2026-03-08 04:38:42.677 DEBUG [src.steps.store] messages length is 10
2026-03-08 04:38:42.679 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-08 04:38:42.680 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-08 04:38:42.680 DEBUG [src.node.waku_node] Stopping container with id 6cfc45aae697
2026-03-08 04:38:43.278 DEBUG [src.node.waku_node] Container stopped.
2026-03-08 04:38:43.278 DEBUG [src.node.waku_node] Stopping container with id 0d39c92fc107
2026-03-08 04:38:43.849 DEBUG [src.node.waku_node] Container stopped.
2026-03-08 04:38:43.849 DEBUG [src.node.waku_node] Stopping container with id 6c35737284f2
2026-03-08 04:38:44.093 ERROR [src.node.docker_mananger] Max retries reached for container 6cfc45aae697. Exiting log stream.
2026-03-08 04:38:44.432 DEBUG [src.node.waku_node] Container stopped.
2026-03-08 04:38:44.435 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-08 04:38:44.443 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-08 04:38:44.455 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-08 04:38:44.463 DEBUG [src.node.docker_mananger] No errors found in the waku logs.