141 lines
26 KiB
Plaintext

2026-03-13 04:38:27.701 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-13 04:38:27.702 DEBUG [tests.conftest] Running test: test_sync_nodes_are_not_relay_and_have_storenode_set with id: 2026-03-13_04-38-27__5a483c51-9aa5-4e52-8993-9f6822c86fb5
2026-03-13 04:38:27.702 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-13 04:38:27.710 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-13 04:38:27.710 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-13_04-38-27__5a483c51-9aa5-4e52-8993-9f6822c86fb5__wakuorg_nwaku:latest.log
2026-03-13 04:38:27.717 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-13 04:38:27.717 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-13_04-38-27__5a483c51-9aa5-4e52-8993-9f6822c86fb5__wakuorg_nwaku:latest.log
2026-03-13 04:38:27.723 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-13 04:38:27.724 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-13_04-38-27__5a483c51-9aa5-4e52-8993-9f6822c86fb5__wakuorg_nwaku:latest.log
2026-03-13 04:38:27.724 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-13 04:38:27.725 DEBUG [src.node.waku_node] Starting Node...
2026-03-13 04:38:27.725 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-13 04:38:27.727 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-13 04:38:27.727 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.135.73
2026-03-13 04:38:27.727 DEBUG [src.node.docker_mananger] Generated ports ['17206', '17207', '17208', '17209', '17210']
2026-03-13 04:38:27.727 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-13 04:38:27.727 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-13 04:38:27.727 DEBUG [src.node.waku_node] Using volumes []
2026-03-13 04:38:27.727 DEBUG [src.node.docker_mananger] docker run -i -t -p 17206:17206 -p 17207:17207 -p 17208:17208 -p 17209:17209 -p 17210:17210 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=17208 --rest-port=17206 --tcp-port=17207 --discv5-udp-port=17209 --rest-address=0.0.0.0 --nat=extip:172.18.135.73 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=571fcdddf9accdaa818a0d0d6127165b19ae6e883cbf021373a5402327cb3328 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=17210 --metrics-logging=true --store=true --relay=true
2026-03-13 04:38:27.900 ERROR [src.node.docker_mananger] Max retries reached for container 0c6ffd0b59b0. Exiting log stream.
2026-03-13 04:38:27.939 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.135.73 waku 270d459cc52401de74e8182985379500cb765377ff6f264e13a5ef1f029103bd
2026-03-13 04:38:27.976 DEBUG [src.node.docker_mananger] Container started with ID 270d459cc524. Setting up logs at ./log/docker/node1_2026-03-13_04-38-27__5a483c51-9aa5-4e52-8993-9f6822c86fb5__wakuorg_nwaku:latest.log
2026-03-13 04:38:27.977 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 17206
2026-03-13 04:38:27.979 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-13 04:38:28.471 ERROR [src.node.docker_mananger] Max retries reached for container f40ba27df78f. Exiting log stream.
2026-03-13 04:38:28.979 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17206/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:28.982 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-13 04:38:28.982 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-13 04:38:28.983 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17206/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:28.985 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.135.73/tcp/17207/p2p/16Uiu2HAm2WhFZg9MHsx385wxK5mrhVbqBS1NuTMxZTDoZwckYBVJ","/ip4/172.18.135.73/tcp/17208/ws/p2p/16Uiu2HAm2WhFZg9MHsx385wxK5mrhVbqBS1NuTMxZTDoZwckYBVJ"],"enrUri":"enr:-L24QG6epm5_UKMjDntXXPPxFOXk6tiPNKhKi0tVmtRNvGQSSa6Ei2ogY04kl2uNX0PF1c43XoebmroJSBYvWJUNoFQCgmlkgnY0gmlwhKwSh0mKbXVsdGlhZGRyc5YACASsEodJBkM3AAoErBKHSQZDON0DgnJzhQADAQAAiXNlY3AyNTZrMaECaUsmkwLxqlfiiVysGLcI0XslbOMtb7ihNHpsJWnYWrmDdGNwgkM3g3VkcIJDOYV3YWt1MgM"}'
2026-03-13 04:38:28.985 INFO [src.node.waku_node] REST service is ready !!
2026-03-13 04:38:28.985 DEBUG [src.node.waku_node] Starting Node...
2026-03-13 04:38:28.986 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-13 04:38:28.987 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-13 04:38:28.987 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.193.186
2026-03-13 04:38:28.987 DEBUG [src.node.docker_mananger] Generated ports ['26514', '26515', '26516', '26517', '26518']
2026-03-13 04:38:28.988 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-13 04:38:28.988 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-13 04:38:28.988 DEBUG [src.node.waku_node] Using volumes []
2026-03-13 04:38:28.988 DEBUG [src.node.docker_mananger] docker run -i -t -p 26514:26514 -p 26515:26515 -p 26516:26516 -p 26517:26517 -p 26518:26518 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=26516 --rest-port=26514 --tcp-port=26515 --discv5-udp-port=26517 --rest-address=0.0.0.0 --nat=extip:172.18.193.186 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=bfbacb14b3aab4c48a7aedf33f2dd0430bebf530ce7bf53b111fe0cbc98a0c4b --store-sync=true --store=false --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=26518 --metrics-logging=true --relay=false --storenode=/ip4/172.18.135.73/tcp/17207/p2p/16Uiu2HAm2WhFZg9MHsx385wxK5mrhVbqBS1NuTMxZTDoZwckYBVJ --discv5-bootstrap-node=enr:-L24QG6epm5_UKMjDntXXPPxFOXk6tiPNKhKi0tVmtRNvGQSSa6Ei2ogY04kl2uNX0PF1c43XoebmroJSBYvWJUNoFQCgmlkgnY0gmlwhKwSh0mKbXVsdGlhZGRyc5YACASsEodJBkM3AAoErBKHSQZDON0DgnJzhQADAQAAiXNlY3AyNTZrMaECaUsmkwLxqlfiiVysGLcI0XslbOMtb7ihNHpsJWnYWrmDdGNwgkM3g3VkcIJDOYV3YWt1MgM
2026-03-13 04:38:29.198 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.193.186 waku 6d8360f3d10e61736f84d19d9832817dadd48d13f78064e816e05882d528f01f
2026-03-13 04:38:29.239 DEBUG [src.node.docker_mananger] Container started with ID 6d8360f3d10e. Setting up logs at ./log/docker/node2_2026-03-13_04-38-27__5a483c51-9aa5-4e52-8993-9f6822c86fb5__wakuorg_nwaku:latest.log
2026-03-13 04:38:29.239 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 26514
2026-03-13 04:38:29.239 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-13 04:38:30.240 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26514/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:30.243 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-13 04:38:30.243 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-13 04:38:30.244 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26514/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:30.246 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.193.186/tcp/26515/p2p/16Uiu2HAm9DdBevvFYQWs4LtAJYCDBN7iDyLnoe5ZgbwDG95vSdUk","/ip4/172.18.193.186/tcp/26516/ws/p2p/16Uiu2HAm9DdBevvFYQWs4LtAJYCDBN7iDyLnoe5ZgbwDG95vSdUk"],"enrUri":"enr:-L24QMkzugSeIUXxKvOLUNII-ds9SyDFdPOS9sKr7KA_YgAiEHX7n1ZHho1Sie_pjmpEiXOJ1EOACfkDHnsuw2g0IBsCgmlkgnY0gmlwhKwSwbqKbXVsdGlhZGRyc5YACASsEsG6BmeTAAoErBLBugZnlN0DgnJzhQADAQAAiXNlY3AyNTZrMaECzO18g5sMBMea0equyDfnwh9vP9L6kAp7nfVwQkk-D5GDdGNwgmeTg3VkcIJnlYV3YWt1MgA"}'
2026-03-13 04:38:30.246 INFO [src.node.waku_node] REST service is ready !!
2026-03-13 04:38:30.246 DEBUG [src.node.waku_node] Starting Node...
2026-03-13 04:38:30.247 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-13 04:38:30.248 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-13 04:38:30.248 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.222.127
2026-03-13 04:38:30.248 DEBUG [src.node.docker_mananger] Generated ports ['61787', '61788', '61789', '61790', '61791']
2026-03-13 04:38:30.249 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-13 04:38:30.249 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-13 04:38:30.249 DEBUG [src.node.waku_node] Using volumes []
2026-03-13 04:38:30.249 DEBUG [src.node.docker_mananger] docker run -i -t -p 61787:61787 -p 61788:61788 -p 61789:61789 -p 61790:61790 -p 61791:61791 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=61789 --rest-port=61787 --tcp-port=61788 --discv5-udp-port=61790 --rest-address=0.0.0.0 --nat=extip:172.18.222.127 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=e55b037ac82fabbecc12ce02ecfbbeac9e9824a70f4a13dcfbe4dcf64c7f61e1 --store-sync=true --store=false --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=61791 --metrics-logging=true --relay=false --storenode=/ip4/172.18.135.73/tcp/17207/p2p/16Uiu2HAm2WhFZg9MHsx385wxK5mrhVbqBS1NuTMxZTDoZwckYBVJ --discv5-bootstrap-node=enr:-L24QMkzugSeIUXxKvOLUNII-ds9SyDFdPOS9sKr7KA_YgAiEHX7n1ZHho1Sie_pjmpEiXOJ1EOACfkDHnsuw2g0IBsCgmlkgnY0gmlwhKwSwbqKbXVsdGlhZGRyc5YACASsEsG6BmeTAAoErBLBugZnlN0DgnJzhQADAQAAiXNlY3AyNTZrMaECzO18g5sMBMea0equyDfnwh9vP9L6kAp7nfVwQkk-D5GDdGNwgmeTg3VkcIJnlYV3YWt1MgA
2026-03-13 04:38:30.450 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.222.127 waku 175c46d96e1c2dfade52775d7c0f3ace5ad39f0a7d82337e8e7a2f29fe0bf9f3
2026-03-13 04:38:30.487 DEBUG [src.node.docker_mananger] Container started with ID 175c46d96e1c. Setting up logs at ./log/docker/node3_2026-03-13_04-38-27__5a483c51-9aa5-4e52-8993-9f6822c86fb5__wakuorg_nwaku:latest.log
2026-03-13 04:38:30.487 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 61787
2026-03-13 04:38:30.487 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-13 04:38:31.488 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61787/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:31.491 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-13 04:38:31.491 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-13 04:38:31.491 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61787/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:31.493 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.222.127/tcp/61788/p2p/16Uiu2HAmS2ZRCy423oftPTYqMkWFLw4emnHdvNhnNNbWc1KVPVoQ","/ip4/172.18.222.127/tcp/61789/ws/p2p/16Uiu2HAmS2ZRCy423oftPTYqMkWFLw4emnHdvNhnNNbWc1KVPVoQ"],"enrUri":"enr:-L24QF-Fb8_42niCpiU3lsfwuamfUcHzXKHitXN2MIlFzd1Wbm8EpjePXHykSjjzQpXBIr-wonwGkmbilHB4c4IZT_8CgmlkgnY0gmlwhKwS3n-KbXVsdGlhZGRyc5YACASsEt5_BvFcAAoErBLefwbxXd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDxq6EQR46jbHJ_lZhDRb2hlNz_yP2k8NYtDcaTSUQuWODdGNwgvFcg3VkcILxXoV3YWt1MgA"}'
2026-03-13 04:38:31.493 INFO [src.node.waku_node] REST service is ready !!
2026-03-13 04:38:31.494 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26514/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.135.73/tcp/17207/p2p/16Uiu2HAm2WhFZg9MHsx385wxK5mrhVbqBS1NuTMxZTDoZwckYBVJ"]'
2026-03-13 04:38:31.532 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:31.533 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61787/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.193.186/tcp/26515/p2p/16Uiu2HAm9DdBevvFYQWs4LtAJYCDBN7iDyLnoe5ZgbwDG95vSdUk"]'
2026-03-13 04:38:31.578 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:31.578 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17206/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-13 04:38:31.585 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:31.585 DEBUG [src.steps.store] Relaying message
2026-03-13 04:38:31.585 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17206/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:38:31.590 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:31.590 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-13 04:38:31.790 DEBUG [src.steps.store] Relaying message
2026-03-13 04:38:31.791 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17206/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:38:31.799 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:31.799 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-13 04:38:31.999 DEBUG [src.steps.store] Relaying message
2026-03-13 04:38:32.000 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17206/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:38:32.004 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:32.004 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-13 04:38:32.205 DEBUG [src.steps.store] Relaying message
2026-03-13 04:38:32.205 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17206/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:38:32.210 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:32.210 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-13 04:38:32.411 DEBUG [src.steps.store] Relaying message
2026-03-13 04:38:32.411 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17206/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:38:32.415 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:32.416 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-13 04:38:32.616 DEBUG [src.steps.store] Relaying message
2026-03-13 04:38:32.617 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17206/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:38:32.621 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:32.621 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-13 04:38:32.822 DEBUG [src.steps.store] Relaying message
2026-03-13 04:38:32.822 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17206/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:38:32.827 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:32.827 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-13 04:38:33.028 DEBUG [src.steps.store] Relaying message
2026-03-13 04:38:33.028 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17206/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:38:33.032 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:33.032 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-13 04:38:33.233 DEBUG [src.steps.store] Relaying message
2026-03-13 04:38:33.233 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17206/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:38:33.237 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:33.238 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-13 04:38:33.438 DEBUG [src.steps.store] Relaying message
2026-03-13 04:38:33.439 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17206/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:38:33.443 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:33.443 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-13 04:38:33.644 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-13 04:38:33.644 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17206/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:33.648 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0xb74b6e679b6739d28cf276888bd0bafad83a075e71e39dfc1317208bbe566dac"},{"messageHash":"0xf61f3db0d832ba468e28fd74c8d312fa6ba797563706ce4dd62583c38df70805"},{"messageHash":"0x97869306e99155397cd692527f5f3165af44b65fe9d5caa73de4e11bdcf54ad1"},{"messageHash":"0x60029dc70c1b6d6ec9cedb054d1e110ec40d912b9a5732bde93d56c7c66282bf"},{"messageHash":"0x4a1469ab19564d3845f6cd111dd4b6f8d8f6362ac616d7ae502235ae00aa279a"},{"messageHash":"0x890973dc3fb428eb954c0d3f396fca3857bbfcddc9fed0ce60431905b252de64"},{"messageHash":"0x1c1d5852c1399abfe1acad378894b53795470f7d1e2ab60fdc674263dac1043f"},{"messageHash":"0x7dd50ee5cfb03504dd38d3d2b862964d3b5d019cb0515fcb53ad18933b70759f"},{"messageHash":"0xdb34970e886bf80f4fdeed33480f5892017a90426d8645e29903acd85a13beba"},{"messageHash":"0x50ac5afa0c49546d6bdbc70c54050adfe693d232a2a306b40065ebaa78152024"}]}'
2026-03-13 04:38:33.648 DEBUG [src.steps.store] messages length is 10
2026-03-13 04:38:33.649 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-13 04:38:33.649 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26514/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:33.658 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"dfaf5140434731430465","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0xb74b6e679b6739d28cf276888bd0bafad83a075e71e39dfc1317208bbe566dac"},{"messageHash":"0xf61f3db0d832ba468e28fd74c8d312fa6ba797563706ce4dd62583c38df70805"},{"messageHash":"0x97869306e99155397cd692527f5f3165af44b65fe9d5caa73de4e11bdcf54ad1"},{"messageHash":"0x60029dc70c1b6d6ec9cedb054d1e110ec40d912b9a5732bde93d56c7c66282bf"},{"messageHash":"0x4a1469ab19564d3845f6cd111dd4b6f8d8f6362ac616d7ae502235ae00aa279a"},{"messageHash":"0x890973dc3fb428eb954c0d3f396fca3857bbfcddc9fed0ce60431905b252de64"},{"messageHash":"0x1c1d5852c1399abfe1acad378894b53795470f7d1e2ab60fdc674263dac1043f"},{"messageHash":"0x7dd50ee5cfb03504dd38d3d2b862964d3b5d019cb0515fcb53ad18933b70759f"},{"messageHash":"0xdb34970e886bf80f4fdeed33480f5892017a90426d8645e29903acd85a13beba"},{"messageHash":"0x50ac5afa0c49546d6bdbc70c54050adfe693d232a2a306b40065ebaa78152024"}]}'
2026-03-13 04:38:33.658 DEBUG [src.steps.store] messages length is 10
2026-03-13 04:38:33.660 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-13 04:38:33.660 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61787/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:33.692 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"7e1c0632552bd866871f","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0xb74b6e679b6739d28cf276888bd0bafad83a075e71e39dfc1317208bbe566dac"},{"messageHash":"0xf61f3db0d832ba468e28fd74c8d312fa6ba797563706ce4dd62583c38df70805"},{"messageHash":"0x97869306e99155397cd692527f5f3165af44b65fe9d5caa73de4e11bdcf54ad1"},{"messageHash":"0x60029dc70c1b6d6ec9cedb054d1e110ec40d912b9a5732bde93d56c7c66282bf"},{"messageHash":"0x4a1469ab19564d3845f6cd111dd4b6f8d8f6362ac616d7ae502235ae00aa279a"},{"messageHash":"0x890973dc3fb428eb954c0d3f396fca3857bbfcddc9fed0ce60431905b252de64"},{"messageHash":"0x1c1d5852c1399abfe1acad378894b53795470f7d1e2ab60fdc674263dac1043f"},{"messageHash":"0x7dd50ee5cfb03504dd38d3d2b862964d3b5d019cb0515fcb53ad18933b70759f"},{"messageHash":"0xdb34970e886bf80f4fdeed33480f5892017a90426d8645e29903acd85a13beba"},{"messageHash":"0x50ac5afa0c49546d6bdbc70c54050adfe693d232a2a306b40065ebaa78152024"}]}'
2026-03-13 04:38:33.693 DEBUG [src.steps.store] messages length is 10
2026-03-13 04:38:33.704 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-13 04:38:33.707 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-13 04:38:33.708 DEBUG [src.node.waku_node] Stopping container with id 270d459cc524
2026-03-13 04:38:34.304 DEBUG [src.node.waku_node] Container stopped.
2026-03-13 04:38:34.304 DEBUG [src.node.waku_node] Stopping container with id 6d8360f3d10e
2026-03-13 04:38:34.857 DEBUG [src.node.waku_node] Container stopped.
2026-03-13 04:38:34.859 DEBUG [src.node.waku_node] Stopping container with id 175c46d96e1c
2026-03-13 04:38:35.119 ERROR [src.node.docker_mananger] Max retries reached for container 270d459cc524. Exiting log stream.
2026-03-13 04:38:35.447 DEBUG [src.node.waku_node] Container stopped.
2026-03-13 04:38:35.450 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-13 04:38:35.459 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-13 04:38:35.465 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-13 04:38:35.471 DEBUG [src.node.docker_mananger] No errors found in the waku logs.