183 lines
34 KiB
Plaintext

2025-12-11 04:14:50.800 DEBUG [tests.conftest] Running fixture setup: test_id
2025-12-11 04:14:50.801 DEBUG [tests.conftest] Running test: test_check_sync_when_2_nodes_publish with id: 2025-12-11_04-14-50__b8a6303e-1284-439c-9286-9d3500bdd1dc
2025-12-11 04:14:50.801 DEBUG [src.steps.common] Running fixture setup: common_setup
2025-12-11 04:14:50.810 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-11 04:14:50.811 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2025-12-11_04-14-50__b8a6303e-1284-439c-9286-9d3500bdd1dc__wakuorg_nwaku:latest.log
2025-12-11 04:14:50.820 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-11 04:14:50.821 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2025-12-11_04-14-50__b8a6303e-1284-439c-9286-9d3500bdd1dc__wakuorg_nwaku:latest.log
2025-12-11 04:14:50.828 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-11 04:14:50.828 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2025-12-11_04-14-50__b8a6303e-1284-439c-9286-9d3500bdd1dc__wakuorg_nwaku:latest.log
2025-12-11 04:14:50.829 DEBUG [src.steps.store] Running fixture setup: store_setup
2025-12-11 04:14:50.830 DEBUG [src.node.waku_node] Starting Node...
2025-12-11 04:14:50.831 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-11 04:14:50.834 DEBUG [src.node.docker_mananger] Network waku already exists
2025-12-11 04:14:50.834 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.107.219
2025-12-11 04:14:50.834 DEBUG [src.node.docker_mananger] Generated ports ['33872', '33873', '33874', '33875', '33876']
2025-12-11 04:14:50.834 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-11 04:14:50.835 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-11 04:14:50.835 DEBUG [src.node.waku_node] Using volumes []
2025-12-11 04:14:50.835 DEBUG [src.node.docker_mananger] docker run -i -t -p 33872:33872 -p 33873:33873 -p 33874:33874 -p 33875:33875 -p 33876:33876 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=33874 --rest-port=33872 --tcp-port=33873 --discv5-udp-port=33875 --rest-address=0.0.0.0 --nat=extip:172.18.107.219 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=919a11d083fa2aae1d3eff6dbefd899fbe9b624091cc2c68067c6cab3f0c0acd --store-sync=true --store=true --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=33876 --metrics-logging=true --relay=true
2025-12-11 04:14:51.014 ERROR [src.node.docker_mananger] Max retries reached for container bbbb268075bf. Exiting log stream.
2025-12-11 04:14:51.015 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.107.219 waku 159f5b747b29e685c5fec88973cc3d79a4620bdded199f9614b2b3d6af796ebe
2025-12-11 04:14:51.047 DEBUG [src.node.docker_mananger] Container started with ID 159f5b747b29. Setting up logs at ./log/docker/node1_2025-12-11_04-14-50__b8a6303e-1284-439c-9286-9d3500bdd1dc__wakuorg_nwaku:latest.log
2025-12-11 04:14:51.048 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 33872
2025-12-11 04:14:51.049 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-11 04:14:51.652 ERROR [src.node.docker_mananger] Max retries reached for container 11c50f29702f. Exiting log stream.
2025-12-11 04:14:52.050 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:33872/health" -H "Content-Type: application/json" -d 'None'
2025-12-11 04:14:52.054 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2025-12-11 04:14:52.054 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-11 04:14:52.054 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:33872/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-11 04:14:52.056 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.107.219/tcp/33873/p2p/16Uiu2HAmTi4A8iHjnXABXgMBfkhxkmdAD4FVs3QsxHbYt7548tHP","/ip4/172.18.107.219/tcp/33874/ws/p2p/16Uiu2HAmTi4A8iHjnXABXgMBfkhxkmdAD4FVs3QsxHbYt7548tHP"],"enrUri":"enr:-L24QON-PYosracYiixai8vMd9XTjX9He3KtFDLgWW_tGvOANwV5BZDJQvQk5bnKtqvONBtwlyf7OKVmsZovOrxP0TUCgmlkgnY0gmlwhKwSa9uKbXVsdGlhZGRyc5YACASsEmvbBoRRAAoErBJr2waEUt0DgnJzhQADAQAAiXNlY3AyNTZrMaED36haBb0LcMP3tkfyvW97ypdfK9kPHjhZ-N1sITZGvqqDdGNwgoRRg3VkcIKEU4V3YWt1MhM"}'
2025-12-11 04:14:52.056 INFO [src.node.waku_node] REST service is ready !!
2025-12-11 04:14:52.056 DEBUG [src.node.waku_node] Starting Node...
2025-12-11 04:14:52.056 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-11 04:14:52.058 DEBUG [src.node.docker_mananger] Network waku already exists
2025-12-11 04:14:52.058 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.85.26
2025-12-11 04:14:52.058 DEBUG [src.node.docker_mananger] Generated ports ['39007', '39008', '39009', '39010', '39011']
2025-12-11 04:14:52.058 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-11 04:14:52.058 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-11 04:14:52.058 DEBUG [src.node.waku_node] Using volumes []
2025-12-11 04:14:52.059 DEBUG [src.node.docker_mananger] docker run -i -t -p 39007:39007 -p 39008:39008 -p 39009:39009 -p 39010:39010 -p 39011:39011 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=39009 --rest-port=39007 --tcp-port=39008 --discv5-udp-port=39010 --rest-address=0.0.0.0 --nat=extip:172.18.85.26 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=6ab2c8c1990d8d8f43a6eeb4d53cbabe30a6caa39e26f5502a3bb68953cbec8b --store-sync=true --store=true --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=39011 --metrics-logging=true --relay=true --storenode=/ip4/172.18.107.219/tcp/33873/p2p/16Uiu2HAmTi4A8iHjnXABXgMBfkhxkmdAD4FVs3QsxHbYt7548tHP --discv5-bootstrap-node=enr:-L24QON-PYosracYiixai8vMd9XTjX9He3KtFDLgWW_tGvOANwV5BZDJQvQk5bnKtqvONBtwlyf7OKVmsZovOrxP0TUCgmlkgnY0gmlwhKwSa9uKbXVsdGlhZGRyc5YACASsEmvbBoRRAAoErBJr2waEUt0DgnJzhQADAQAAiXNlY3AyNTZrMaED36haBb0LcMP3tkfyvW97ypdfK9kPHjhZ-N1sITZGvqqDdGNwgoRRg3VkcIKEU4V3YWt1MhM
2025-12-11 04:14:52.253 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.85.26 waku 43088f1743eb69011a9120e8325346371b2cce54cd41b3fae16cc0d809a83b7a
2025-12-11 04:14:52.283 DEBUG [src.node.docker_mananger] Container started with ID 43088f1743eb. Setting up logs at ./log/docker/node2_2025-12-11_04-14-50__b8a6303e-1284-439c-9286-9d3500bdd1dc__wakuorg_nwaku:latest.log
2025-12-11 04:14:52.283 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 39007
2025-12-11 04:14:52.284 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-11 04:14:53.284 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:39007/health" -H "Content-Type: application/json" -d 'None'
2025-12-11 04:14:53.288 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"READY"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"READY"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2025-12-11 04:14:53.288 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-11 04:14:53.289 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:39007/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-11 04:14:53.291 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.85.26/tcp/39008/p2p/16Uiu2HAkvGK2LzQo5LYsjCYsRp6CxSqHhj1GmihRbAbVu3EY9SgS","/ip4/172.18.85.26/tcp/39009/ws/p2p/16Uiu2HAkvGK2LzQo5LYsjCYsRp6CxSqHhj1GmihRbAbVu3EY9SgS"],"enrUri":"enr:-L24QEQF5D1eljsSuTzz-iDp5MHNvUcO8G1C4jpTNeS9Se7zW1QcX-sdjRMeX6LbstMW6WB_fys5OHAgzyl_-lDBqIQCgmlkgnY0gmlwhKwSVRqKbXVsdGlhZGRyc5YACASsElUaBphgAAoErBJVGgaYYd0DgnJzhQADAQAAiXNlY3AyNTZrMaECDHXDvhICcElQz_oASp_cfiHlbWpom10ufkKFQb_UY0ODdGNwgphgg3VkcIKYYoV3YWt1MhM"}'
2025-12-11 04:14:53.291 INFO [src.node.waku_node] REST service is ready !!
2025-12-11 04:14:53.292 DEBUG [src.node.waku_node] Starting Node...
2025-12-11 04:14:53.292 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-11 04:14:53.293 DEBUG [src.node.docker_mananger] Network waku already exists
2025-12-11 04:14:53.293 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.151.187
2025-12-11 04:14:53.294 DEBUG [src.node.docker_mananger] Generated ports ['18158', '18159', '18160', '18161', '18162']
2025-12-11 04:14:53.294 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-11 04:14:53.294 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-11 04:14:53.294 DEBUG [src.node.waku_node] Using volumes []
2025-12-11 04:14:53.294 DEBUG [src.node.docker_mananger] docker run -i -t -p 18158:18158 -p 18159:18159 -p 18160:18160 -p 18161:18161 -p 18162:18162 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=18160 --rest-port=18158 --tcp-port=18159 --discv5-udp-port=18161 --rest-address=0.0.0.0 --nat=extip:172.18.151.187 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=c73f261b1159f324d1603ee77b1a6fcf0ac9ad4abebb0beaea0329f519fbfe6a --store-sync=true --store=false --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=18162 --metrics-logging=true --relay=false --storenode=/ip4/172.18.85.26/tcp/39008/p2p/16Uiu2HAkvGK2LzQo5LYsjCYsRp6CxSqHhj1GmihRbAbVu3EY9SgS --discv5-bootstrap-node=enr:-L24QEQF5D1eljsSuTzz-iDp5MHNvUcO8G1C4jpTNeS9Se7zW1QcX-sdjRMeX6LbstMW6WB_fys5OHAgzyl_-lDBqIQCgmlkgnY0gmlwhKwSVRqKbXVsdGlhZGRyc5YACASsElUaBphgAAoErBJVGgaYYd0DgnJzhQADAQAAiXNlY3AyNTZrMaECDHXDvhICcElQz_oASp_cfiHlbWpom10ufkKFQb_UY0ODdGNwgphgg3VkcIKYYoV3YWt1MhM
2025-12-11 04:14:53.479 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.151.187 waku f5b752f9cc0d953b5a5fef755810aa791a9716f18ac76aa1e443e3d5dcd9e231
2025-12-11 04:14:53.510 DEBUG [src.node.docker_mananger] Container started with ID f5b752f9cc0d. Setting up logs at ./log/docker/node3_2025-12-11_04-14-50__b8a6303e-1284-439c-9286-9d3500bdd1dc__wakuorg_nwaku:latest.log
2025-12-11 04:14:53.510 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 18158
2025-12-11 04:14:53.510 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-11 04:14:54.511 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18158/health" -H "Content-Type: application/json" -d 'None'
2025-12-11 04:14:54.514 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"READY"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2025-12-11 04:14:54.514 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-11 04:14:54.515 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18158/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-11 04:14:54.517 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.151.187/tcp/18159/p2p/16Uiu2HAm9UUChfHaE4iwtJ6xB8hSacMDMpHUGLtuXdELGPfhxNcp","/ip4/172.18.151.187/tcp/18160/ws/p2p/16Uiu2HAm9UUChfHaE4iwtJ6xB8hSacMDMpHUGLtuXdELGPfhxNcp"],"enrUri":"enr:-L24QNXlEJmwj4gaP8NTbq4ycom7WtroyYFBB8gMxDIGtzmhefqmwpFkl3sHJlArt8ZXYudMoqho815JixAsALPnDtkCgmlkgnY0gmlwhKwSl7uKbXVsdGlhZGRyc5YACASsEpe7BkbvAAoErBKXuwZG8N0DgnJzhQADAQAAiXNlY3AyNTZrMaEC0LsK58ytIJwUVnjqQhCPdXN4P5m4c9HmEbsQ1cu6ZumDdGNwgkbvg3VkcIJG8YV3YWt1MgA"}'
2025-12-11 04:14:54.517 INFO [src.node.waku_node] REST service is ready !!
2025-12-11 04:14:54.517 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39007/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.107.219/tcp/33873/p2p/16Uiu2HAmTi4A8iHjnXABXgMBfkhxkmdAD4FVs3QsxHbYt7548tHP"]'
2025-12-11 04:14:54.520 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:14:54.520 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:18158/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.85.26/tcp/39008/p2p/16Uiu2HAkvGK2LzQo5LYsjCYsRp6CxSqHhj1GmihRbAbVu3EY9SgS"]'
2025-12-11 04:14:54.547 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:14:54.550 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33872/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2025-12-11 04:14:54.555 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:14:54.556 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39007/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2025-12-11 04:14:54.558 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:14:54.559 DEBUG [src.steps.store] Relaying message
2025-12-11 04:14:54.559 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33872/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:14:54.570 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:14:54.570 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2025-12-11 04:14:54.581 DEBUG [src.steps.store] Relaying message
2025-12-11 04:14:54.581 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33872/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:14:54.586 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:14:54.586 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2025-12-11 04:14:54.596 DEBUG [src.steps.store] Relaying message
2025-12-11 04:14:54.597 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33872/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:14:54.601 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:14:54.602 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2025-12-11 04:14:54.612 DEBUG [src.steps.store] Relaying message
2025-12-11 04:14:54.612 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33872/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:14:54.617 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:14:54.618 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2025-12-11 04:14:54.629 DEBUG [src.steps.store] Relaying message
2025-12-11 04:14:54.629 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33872/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:14:54.634 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:14:54.634 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2025-12-11 04:14:54.645 DEBUG [src.steps.store] Relaying message
2025-12-11 04:14:54.645 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33872/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:14:54.651 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:14:54.651 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2025-12-11 04:14:54.661 DEBUG [src.steps.store] Relaying message
2025-12-11 04:14:54.661 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33872/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:14:54.667 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:14:54.667 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2025-12-11 04:14:54.678 DEBUG [src.steps.store] Relaying message
2025-12-11 04:14:54.678 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33872/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:14:54.685 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:14:54.686 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2025-12-11 04:14:54.696 DEBUG [src.steps.store] Relaying message
2025-12-11 04:14:54.696 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33872/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:14:54.700 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:14:54.701 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2025-12-11 04:14:54.711 DEBUG [src.steps.store] Relaying message
2025-12-11 04:14:54.712 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33872/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:14:54.716 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:14:54.716 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2025-12-11 04:14:54.727 DEBUG [src.steps.store] Relaying message
2025-12-11 04:14:54.727 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39007/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:14:54.732 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:14:54.733 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2025-12-11 04:14:54.743 DEBUG [src.steps.store] Relaying message
2025-12-11 04:14:54.743 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39007/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:14:54.747 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:14:54.748 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2025-12-11 04:14:54.759 DEBUG [src.steps.store] Relaying message
2025-12-11 04:14:54.759 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39007/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:14:54.764 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:14:54.764 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2025-12-11 04:14:54.775 DEBUG [src.steps.store] Relaying message
2025-12-11 04:14:54.775 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39007/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:14:54.780 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:14:54.780 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2025-12-11 04:14:54.790 DEBUG [src.steps.store] Relaying message
2025-12-11 04:14:54.790 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39007/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:14:54.796 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:14:54.796 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2025-12-11 04:14:54.807 DEBUG [src.steps.store] Relaying message
2025-12-11 04:14:54.808 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39007/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:14:54.812 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:14:54.812 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2025-12-11 04:14:54.823 DEBUG [src.steps.store] Relaying message
2025-12-11 04:14:54.823 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39007/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:14:54.827 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:14:54.827 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2025-12-11 04:14:54.838 DEBUG [src.steps.store] Relaying message
2025-12-11 04:14:54.838 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39007/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:14:54.843 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:14:54.843 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2025-12-11 04:14:54.854 DEBUG [src.steps.store] Relaying message
2025-12-11 04:14:54.854 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39007/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:14:54.859 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:14:54.859 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2025-12-11 04:14:54.870 DEBUG [src.steps.store] Relaying message
2025-12-11 04:14:54.870 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39007/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:14:54.875 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:14:54.876 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2025-12-11 04:14:54.887 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2025-12-11 04:14:54.887 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:33872/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2025-12-11 04:14:54.890 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x6c42895e933fb73c919b7fa1041e85f8c91bd11c034b6d9d12114471ab69e943"},{"messageHash":"0xa27113ba157933e7ca44cc31f71c0f8269f1a1ffece81f324129ea964de06f24"},{"messageHash":"0x0bff76a191bd6f6f7c28bd94a60f91d411a8da848c0be7cbbf40daa860a50157"},{"messageHash":"0xafb9cb850d0acc2ed6b23415d4942ce3a6e41869ebf601c8615c03d71aa19b36"},{"messageHash":"0x2a12bcc311cf9a09cf7cd2ac6e65990e0effe7da0dcc1ae01fa51951b4318b41"},{"messageHash":"0xc3a8f59e0289cb942b37d618605a0ef54eeb6f7259e5bb1352ccd944e77b07d1"},{"messageHash":"0x635c37c8afb54419b57c31fa288444c6f6e29df1079d027eb1ce0e7d1b12a685"},{"messageHash":"0x4a0f1028c6a889ec62a34f9c2412fe46ffe676027852b6e776069e9db11748d5"},{"messageHash":"0x650c54bbc3a99bcd8c7eacc4bb9e4331a6e21b4541116ea8f4462791d9d9218e"},{"messageHash":"0xd82b1216c867f86a8faa74759f86e4a0d9e8a8fd9a4903069465f33e24633379"},{"messageHash":"0x44096dd7eac15075efb7167742c588c7aae33b21a21a526c3f3e3343b4be06e1"},{"messageHash":"0x96d57115d3b5dc3ee8301afe54f1379a818da6d00a7bf30e9cfe3dd6d3dddc0b"},{"messageHash":"0x5697bc473216d71b1f39bd2cf03fc0e582b515ff74f512efb3c724db012b4ff3"},{"messageHash":"0x70249507a5598c56a729e574aaa7717f10e80a9d12732421a202864eb1f7b0c6"},{"messageHash":"0x797782c1680221bfc9b2ac6d5e0149dc00f22bad8e15bef8f7c939a51546c897"},{"messageHash":"0x4b78de0d87fd21d3ed68262f89b0934f86d811f092669153cd3e2e069f615127"},{"messageHash":"0x4d2ea16365d5a464e1cdf1640d9427ea26eb8f5d2e9278101be345242411f2e0"},{"messageHash":"0x6cf7b1a101c47ebf70d33e6ddb68c1b6f3c2bc9cbfe2e342cfbbc36f97178ca9"},{"messageHash":"0xeab11d1db83116374de61fec2018ffb57dc7982d8baf17f3328ea3b6a768e0bb"},{"messageHash":"0x555f0d75995212a17c37b3d296b3bd31164d162726120f24f0aac6be34692d93"}]}'
2025-12-11 04:14:54.890 DEBUG [src.steps.store] messages length is 20
2025-12-11 04:14:54.893 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2025-12-11 04:14:54.893 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:39007/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2025-12-11 04:14:54.896 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x6c42895e933fb73c919b7fa1041e85f8c91bd11c034b6d9d12114471ab69e943"},{"messageHash":"0xa27113ba157933e7ca44cc31f71c0f8269f1a1ffece81f324129ea964de06f24"},{"messageHash":"0x0bff76a191bd6f6f7c28bd94a60f91d411a8da848c0be7cbbf40daa860a50157"},{"messageHash":"0xafb9cb850d0acc2ed6b23415d4942ce3a6e41869ebf601c8615c03d71aa19b36"},{"messageHash":"0x2a12bcc311cf9a09cf7cd2ac6e65990e0effe7da0dcc1ae01fa51951b4318b41"},{"messageHash":"0xc3a8f59e0289cb942b37d618605a0ef54eeb6f7259e5bb1352ccd944e77b07d1"},{"messageHash":"0x635c37c8afb54419b57c31fa288444c6f6e29df1079d027eb1ce0e7d1b12a685"},{"messageHash":"0x4a0f1028c6a889ec62a34f9c2412fe46ffe676027852b6e776069e9db11748d5"},{"messageHash":"0x650c54bbc3a99bcd8c7eacc4bb9e4331a6e21b4541116ea8f4462791d9d9218e"},{"messageHash":"0xd82b1216c867f86a8faa74759f86e4a0d9e8a8fd9a4903069465f33e24633379"},{"messageHash":"0x44096dd7eac15075efb7167742c588c7aae33b21a21a526c3f3e3343b4be06e1"},{"messageHash":"0x96d57115d3b5dc3ee8301afe54f1379a818da6d00a7bf30e9cfe3dd6d3dddc0b"},{"messageHash":"0x5697bc473216d71b1f39bd2cf03fc0e582b515ff74f512efb3c724db012b4ff3"},{"messageHash":"0x70249507a5598c56a729e574aaa7717f10e80a9d12732421a202864eb1f7b0c6"},{"messageHash":"0x797782c1680221bfc9b2ac6d5e0149dc00f22bad8e15bef8f7c939a51546c897"},{"messageHash":"0x4b78de0d87fd21d3ed68262f89b0934f86d811f092669153cd3e2e069f615127"},{"messageHash":"0x4d2ea16365d5a464e1cdf1640d9427ea26eb8f5d2e9278101be345242411f2e0"},{"messageHash":"0x6cf7b1a101c47ebf70d33e6ddb68c1b6f3c2bc9cbfe2e342cfbbc36f97178ca9"},{"messageHash":"0xeab11d1db83116374de61fec2018ffb57dc7982d8baf17f3328ea3b6a768e0bb"},{"messageHash":"0x555f0d75995212a17c37b3d296b3bd31164d162726120f24f0aac6be34692d93"}]}'
2025-12-11 04:14:54.897 DEBUG [src.steps.store] messages length is 20
2025-12-11 04:14:54.899 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2025-12-11 04:14:54.899 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18158/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2025-12-11 04:14:54.907 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"dc794bb32a535c4ffc8c","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x6c42895e933fb73c919b7fa1041e85f8c91bd11c034b6d9d12114471ab69e943"},{"messageHash":"0xa27113ba157933e7ca44cc31f71c0f8269f1a1ffece81f324129ea964de06f24"},{"messageHash":"0x0bff76a191bd6f6f7c28bd94a60f91d411a8da848c0be7cbbf40daa860a50157"},{"messageHash":"0xafb9cb850d0acc2ed6b23415d4942ce3a6e41869ebf601c8615c03d71aa19b36"},{"messageHash":"0x2a12bcc311cf9a09cf7cd2ac6e65990e0effe7da0dcc1ae01fa51951b4318b41"},{"messageHash":"0xc3a8f59e0289cb942b37d618605a0ef54eeb6f7259e5bb1352ccd944e77b07d1"},{"messageHash":"0x635c37c8afb54419b57c31fa288444c6f6e29df1079d027eb1ce0e7d1b12a685"},{"messageHash":"0x4a0f1028c6a889ec62a34f9c2412fe46ffe676027852b6e776069e9db11748d5"},{"messageHash":"0x650c54bbc3a99bcd8c7eacc4bb9e4331a6e21b4541116ea8f4462791d9d9218e"},{"messageHash":"0xd82b1216c867f86a8faa74759f86e4a0d9e8a8fd9a4903069465f33e24633379"},{"messageHash":"0x44096dd7eac15075efb7167742c588c7aae33b21a21a526c3f3e3343b4be06e1"},{"messageHash":"0x96d57115d3b5dc3ee8301afe54f1379a818da6d00a7bf30e9cfe3dd6d3dddc0b"},{"messageHash":"0x5697bc473216d71b1f39bd2cf03fc0e582b515ff74f512efb3c724db012b4ff3"},{"messageHash":"0x70249507a5598c56a729e574aaa7717f10e80a9d12732421a202864eb1f7b0c6"},{"messageHash":"0x797782c1680221bfc9b2ac6d5e0149dc00f22bad8e15bef8f7c939a51546c897"},{"messageHash":"0x4b78de0d87fd21d3ed68262f89b0934f86d811f092669153cd3e2e069f615127"},{"messageHash":"0x4d2ea16365d5a464e1cdf1640d9427ea26eb8f5d2e9278101be345242411f2e0"},{"messageHash":"0x6cf7b1a101c47ebf70d33e6ddb68c1b6f3c2bc9cbfe2e342cfbbc36f97178ca9"},{"messageHash":"0xeab11d1db83116374de61fec2018ffb57dc7982d8baf17f3328ea3b6a768e0bb"},{"messageHash":"0x555f0d75995212a17c37b3d296b3bd31164d162726120f24f0aac6be34692d93"}]}'
2025-12-11 04:14:54.907 DEBUG [src.steps.store] messages length is 20
2025-12-11 04:14:54.910 DEBUG [tests.conftest] Running fixture teardown: test_setup
2025-12-11 04:14:54.911 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2025-12-11 04:14:54.911 DEBUG [src.node.waku_node] Stopping container with id 159f5b747b29
2025-12-11 04:14:55.432 DEBUG [src.node.waku_node] Container stopped.
2025-12-11 04:14:55.432 DEBUG [src.node.waku_node] Stopping container with id 43088f1743eb
2025-12-11 04:14:55.949 DEBUG [src.node.waku_node] Container stopped.
2025-12-11 04:14:55.949 DEBUG [src.node.waku_node] Stopping container with id f5b752f9cc0d
2025-12-11 04:14:56.245 ERROR [src.node.docker_mananger] Max retries reached for container 159f5b747b29. Exiting log stream.
2025-12-11 04:14:56.480 DEBUG [src.node.waku_node] Container stopped.
2025-12-11 04:14:56.481 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2025-12-11 04:14:56.490 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2025-12-11 04:14:56.503 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2025-12-11 04:14:56.508 DEBUG [src.node.docker_mananger] No errors found in the waku logs.