141 lines
26 KiB
Plaintext

2026-03-01 04:42:59.133 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-01 04:42:59.133 DEBUG [tests.conftest] Running test: test_sync_nodes_are_not_relay_and_have_storenode_set with id: 2026-03-01_04-42-59__71189a0d-c5cb-458c-9466-8249600794bf
2026-03-01 04:42:59.133 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-01 04:42:59.140 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-01 04:42:59.140 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-01_04-42-59__71189a0d-c5cb-458c-9466-8249600794bf__wakuorg_nwaku:latest.log
2026-03-01 04:42:59.148 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-01 04:42:59.148 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-01_04-42-59__71189a0d-c5cb-458c-9466-8249600794bf__wakuorg_nwaku:latest.log
2026-03-01 04:42:59.154 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-01 04:42:59.154 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-01_04-42-59__71189a0d-c5cb-458c-9466-8249600794bf__wakuorg_nwaku:latest.log
2026-03-01 04:42:59.154 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-01 04:42:59.155 DEBUG [src.node.waku_node] Starting Node...
2026-03-01 04:42:59.155 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-01 04:42:59.156 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-01 04:42:59.156 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.33.192
2026-03-01 04:42:59.157 DEBUG [src.node.docker_mananger] Generated ports ['13356', '13357', '13358', '13359', '13360']
2026-03-01 04:42:59.157 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-01 04:42:59.157 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-01 04:42:59.157 DEBUG [src.node.waku_node] Using volumes []
2026-03-01 04:42:59.157 DEBUG [src.node.docker_mananger] docker run -i -t -p 13356:13356 -p 13357:13357 -p 13358:13358 -p 13359:13359 -p 13360:13360 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=13358 --rest-port=13356 --tcp-port=13357 --discv5-udp-port=13359 --rest-address=0.0.0.0 --nat=extip:172.18.33.192 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=a60917e51b98bfe95e8f6e028f9844fb82c9a37ac9fdfcda95c7e54beabc58fb --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=13360 --metrics-logging=true --store=true --relay=true
2026-03-01 04:42:59.346 ERROR [src.node.docker_mananger] Max retries reached for container 90a48816440c. Exiting log stream.
2026-03-01 04:42:59.353 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.33.192 waku b82b61b29674904aef857b173d8195f32809f11a44b6176452c2ba47cdeb0779
2026-03-01 04:42:59.393 DEBUG [src.node.docker_mananger] Container started with ID b82b61b29674. Setting up logs at ./log/docker/node1_2026-03-01_04-42-59__71189a0d-c5cb-458c-9466-8249600794bf__wakuorg_nwaku:latest.log
2026-03-01 04:42:59.394 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 13356
2026-03-01 04:42:59.395 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-01 04:42:59.920 ERROR [src.node.docker_mananger] Max retries reached for container ca66736f93e1. Exiting log stream.
2026-03-01 04:43:00.395 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13356/health" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:43:00.398 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-01 04:43:00.399 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-01 04:43:00.399 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13356/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:43:00.401 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.33.192/tcp/13357/p2p/16Uiu2HAkw5R1a7NwbC2MYXRAKPNW8QGV7KUtXdpGjXxqnpMQNdwW","/ip4/172.18.33.192/tcp/13358/ws/p2p/16Uiu2HAkw5R1a7NwbC2MYXRAKPNW8QGV7KUtXdpGjXxqnpMQNdwW"],"enrUri":"enr:-L24QIxtyqtT82oX0UI_mmVlOxrrmulCbZRR9L8tz8y83j3ie3qXvEuZz68sV4yn0qVAWThYsx5JVEQtEtNdG5H2a_0CgmlkgnY0gmlwhKwSIcCKbXVsdGlhZGRyc5YACASsEiHABjQtAAoErBIhwAY0Lt0DgnJzhQADAQAAiXNlY3AyNTZrMaECGIbU761eXrKZ1UShPInLQFQXEy5wUjbfBZKtpyGQo-GDdGNwgjQtg3VkcII0L4V3YWt1MgM"}'
2026-03-01 04:43:00.401 INFO [src.node.waku_node] REST service is ready !!
2026-03-01 04:43:00.402 DEBUG [src.node.waku_node] Starting Node...
2026-03-01 04:43:00.402 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-01 04:43:00.403 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-01 04:43:00.403 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.148.50
2026-03-01 04:43:00.403 DEBUG [src.node.docker_mananger] Generated ports ['5588', '5589', '5590', '5591', '5592']
2026-03-01 04:43:00.404 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-01 04:43:00.404 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-01 04:43:00.404 DEBUG [src.node.waku_node] Using volumes []
2026-03-01 04:43:00.404 DEBUG [src.node.docker_mananger] docker run -i -t -p 5588:5588 -p 5589:5589 -p 5590:5590 -p 5591:5591 -p 5592:5592 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=5590 --rest-port=5588 --tcp-port=5589 --discv5-udp-port=5591 --rest-address=0.0.0.0 --nat=extip:172.18.148.50 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=fb5bff91b6c61e2776dbbf33ab010a4bf08cee7f7fb3dea55f4fbcd9c2f3caff --store-sync=true --store=false --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=5592 --metrics-logging=true --relay=false --storenode=/ip4/172.18.33.192/tcp/13357/p2p/16Uiu2HAkw5R1a7NwbC2MYXRAKPNW8QGV7KUtXdpGjXxqnpMQNdwW --discv5-bootstrap-node=enr:-L24QIxtyqtT82oX0UI_mmVlOxrrmulCbZRR9L8tz8y83j3ie3qXvEuZz68sV4yn0qVAWThYsx5JVEQtEtNdG5H2a_0CgmlkgnY0gmlwhKwSIcCKbXVsdGlhZGRyc5YACASsEiHABjQtAAoErBIhwAY0Lt0DgnJzhQADAQAAiXNlY3AyNTZrMaECGIbU761eXrKZ1UShPInLQFQXEy5wUjbfBZKtpyGQo-GDdGNwgjQtg3VkcII0L4V3YWt1MgM
2026-03-01 04:43:00.604 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.148.50 waku f4f12bb0e1f6a08fbc862f7f908e87a27214242397e21f43ca51b13975c06d21
2026-03-01 04:43:00.638 DEBUG [src.node.docker_mananger] Container started with ID f4f12bb0e1f6. Setting up logs at ./log/docker/node2_2026-03-01_04-42-59__71189a0d-c5cb-458c-9466-8249600794bf__wakuorg_nwaku:latest.log
2026-03-01 04:43:00.639 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 5588
2026-03-01 04:43:00.639 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-01 04:43:01.639 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:5588/health" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:43:01.642 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-01 04:43:01.643 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-01 04:43:01.643 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:5588/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:43:01.646 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.148.50/tcp/5589/p2p/16Uiu2HAm51dvPyPnZ8dkTxRAb6YMcbvGvAGfXqMF4ncXGWxBC3Ff","/ip4/172.18.148.50/tcp/5590/ws/p2p/16Uiu2HAm51dvPyPnZ8dkTxRAb6YMcbvGvAGfXqMF4ncXGWxBC3Ff"],"enrUri":"enr:-L24QA0pElrjPXjO_smEmOXm2_6Ez2KZzXflt3-07gEld92-NcV2RYIlK2jvH2j14TA_GKIcZNC92CCHxufmSI0u7HYCgmlkgnY0gmlwhKwSlDKKbXVsdGlhZGRyc5YACASsEpQyBhXVAAoErBKUMgYV1t0DgnJzhQADAQAAiXNlY3AyNTZrMaECjmyaKzK479EB0Z7rAnsa9ha0kHT5QC9x3orFhiu_sBKDdGNwghXVg3VkcIIV14V3YWt1MgA"}'
2026-03-01 04:43:01.646 INFO [src.node.waku_node] REST service is ready !!
2026-03-01 04:43:01.646 DEBUG [src.node.waku_node] Starting Node...
2026-03-01 04:43:01.646 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-01 04:43:01.648 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-01 04:43:01.648 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.156.223
2026-03-01 04:43:01.648 DEBUG [src.node.docker_mananger] Generated ports ['45687', '45688', '45689', '45690', '45691']
2026-03-01 04:43:01.648 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-01 04:43:01.648 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-01 04:43:01.648 DEBUG [src.node.waku_node] Using volumes []
2026-03-01 04:43:01.648 DEBUG [src.node.docker_mananger] docker run -i -t -p 45687:45687 -p 45688:45688 -p 45689:45689 -p 45690:45690 -p 45691:45691 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=45689 --rest-port=45687 --tcp-port=45688 --discv5-udp-port=45690 --rest-address=0.0.0.0 --nat=extip:172.18.156.223 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=dd2d66a5ebe1cd3e6feff31f34fbb27b678a5f89fb8f4628b9c6452c1ef8615d --store-sync=true --store=false --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=45691 --metrics-logging=true --relay=false --storenode=/ip4/172.18.33.192/tcp/13357/p2p/16Uiu2HAkw5R1a7NwbC2MYXRAKPNW8QGV7KUtXdpGjXxqnpMQNdwW --discv5-bootstrap-node=enr:-L24QA0pElrjPXjO_smEmOXm2_6Ez2KZzXflt3-07gEld92-NcV2RYIlK2jvH2j14TA_GKIcZNC92CCHxufmSI0u7HYCgmlkgnY0gmlwhKwSlDKKbXVsdGlhZGRyc5YACASsEpQyBhXVAAoErBKUMgYV1t0DgnJzhQADAQAAiXNlY3AyNTZrMaECjmyaKzK479EB0Z7rAnsa9ha0kHT5QC9x3orFhiu_sBKDdGNwghXVg3VkcIIV14V3YWt1MgA
2026-03-01 04:43:01.862 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.156.223 waku 2882c70f4aad23095f956cdca77e4925066aea46f54625e5f54df76f0f01cf96
2026-03-01 04:43:01.894 DEBUG [src.node.docker_mananger] Container started with ID 2882c70f4aad. Setting up logs at ./log/docker/node3_2026-03-01_04-42-59__71189a0d-c5cb-458c-9466-8249600794bf__wakuorg_nwaku:latest.log
2026-03-01 04:43:01.894 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 45687
2026-03-01 04:43:01.895 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-01 04:43:02.895 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45687/health" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:43:02.898 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-01 04:43:02.898 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-01 04:43:02.898 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45687/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:43:02.901 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.156.223/tcp/45688/p2p/16Uiu2HAm9cpG23ap3KwHVMFrabG9aqGprm6MeuaYkdiDT1HGwDbw","/ip4/172.18.156.223/tcp/45689/ws/p2p/16Uiu2HAm9cpG23ap3KwHVMFrabG9aqGprm6MeuaYkdiDT1HGwDbw"],"enrUri":"enr:-L24QNlubQKKLqnhM1wnvvQ2aXdqYOr-rg0pI-u5BXBiomC6f__EgqsFGabkdV5gHDMmNHHKdOXr2hIr5en4LdsvtqICgmlkgnY0gmlwhKwSnN-KbXVsdGlhZGRyc5YACASsEpzfBrJ4AAoErBKc3wayed0DgnJzhQADAQAAiXNlY3AyNTZrMaEC0t5eKK2Wie7pUURri-fxt0qfs7cPGgUL3yY8CAxKJvqDdGNwgrJ4g3VkcIKyeoV3YWt1MgA"}'
2026-03-01 04:43:02.901 INFO [src.node.waku_node] REST service is ready !!
2026-03-01 04:43:02.901 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:5588/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.33.192/tcp/13357/p2p/16Uiu2HAkw5R1a7NwbC2MYXRAKPNW8QGV7KUtXdpGjXxqnpMQNdwW"]'
2026-03-01 04:43:02.935 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:43:02.936 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45687/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.148.50/tcp/5589/p2p/16Uiu2HAm51dvPyPnZ8dkTxRAb6YMcbvGvAGfXqMF4ncXGWxBC3Ff"]'
2026-03-01 04:43:02.980 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:43:02.983 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13356/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-01 04:43:02.989 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:43:02.991 DEBUG [src.steps.store] Relaying message
2026-03-01 04:43:02.992 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13356/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-01 04:43:02.999 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:43:02.999 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-01 04:43:03.200 DEBUG [src.steps.store] Relaying message
2026-03-01 04:43:03.200 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13356/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-01 04:43:03.204 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:43:03.205 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-01 04:43:03.405 DEBUG [src.steps.store] Relaying message
2026-03-01 04:43:03.406 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13356/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-01 04:43:03.410 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:43:03.410 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-01 04:43:03.611 DEBUG [src.steps.store] Relaying message
2026-03-01 04:43:03.611 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13356/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-01 04:43:03.615 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:43:03.615 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-01 04:43:03.816 DEBUG [src.steps.store] Relaying message
2026-03-01 04:43:03.816 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13356/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-01 04:43:03.820 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:43:03.821 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-01 04:43:04.021 DEBUG [src.steps.store] Relaying message
2026-03-01 04:43:04.022 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13356/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-01 04:43:04.026 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:43:04.026 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-01 04:43:04.227 DEBUG [src.steps.store] Relaying message
2026-03-01 04:43:04.227 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13356/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-01 04:43:04.231 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:43:04.231 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-01 04:43:04.432 DEBUG [src.steps.store] Relaying message
2026-03-01 04:43:04.432 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13356/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-01 04:43:04.438 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:43:04.439 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-01 04:43:04.639 DEBUG [src.steps.store] Relaying message
2026-03-01 04:43:04.640 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13356/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-01 04:43:04.644 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:43:04.644 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-01 04:43:04.845 DEBUG [src.steps.store] Relaying message
2026-03-01 04:43:04.845 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13356/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-01 04:43:04.849 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:43:04.850 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-01 04:43:05.050 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-01 04:43:05.051 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13356/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:43:05.054 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x7347a847c338e92ed231f02f2aec4f803586bee5aa9c0155970e9c7eb6058a91"},{"messageHash":"0xccb7d4324c25cfee3212e811f1167f1c4cff83365b393fc1f84503256a34e42e"},{"messageHash":"0xfbcd792255a7125929136a3c95bfa62c1e3396533acedc74042ad46b99cd19f9"},{"messageHash":"0x600f5fd9a8aecd5982e9b657ff8f53d316378c6dae019fd819a4a98a48406621"},{"messageHash":"0x64bfafba08e99e768a2f0838bf67ab15fd22be40ad47342031595afc4672aee7"},{"messageHash":"0x6a97e077e778e333b3ea28b7d12da1af96d50e2c7224c3848f75b75ad46da664"},{"messageHash":"0x502d57554a7c65837e336a3d3032c17d8db9078e14009ad3900fed1cc7daf833"},{"messageHash":"0xfb558681aaf93e5e2020a232cd9436621211c9d6dab77a52b613ed8f17b4b7b5"},{"messageHash":"0x7315bb0d9ce5f7bf1cc4b1e172dd3b8a853fc8c4596381e0dc7275e7f87ccced"},{"messageHash":"0xf4cdf3d96031a85043d00fb8ad0c47739ad5120e4724f999931f45b505501b1c"}]}'
2026-03-01 04:43:05.055 DEBUG [src.steps.store] messages length is 10
2026-03-01 04:43:05.056 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-01 04:43:05.056 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:5588/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:43:05.065 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"0e97043dff563bd7b33b","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x7347a847c338e92ed231f02f2aec4f803586bee5aa9c0155970e9c7eb6058a91"},{"messageHash":"0xccb7d4324c25cfee3212e811f1167f1c4cff83365b393fc1f84503256a34e42e"},{"messageHash":"0xfbcd792255a7125929136a3c95bfa62c1e3396533acedc74042ad46b99cd19f9"},{"messageHash":"0x600f5fd9a8aecd5982e9b657ff8f53d316378c6dae019fd819a4a98a48406621"},{"messageHash":"0x64bfafba08e99e768a2f0838bf67ab15fd22be40ad47342031595afc4672aee7"},{"messageHash":"0x6a97e077e778e333b3ea28b7d12da1af96d50e2c7224c3848f75b75ad46da664"},{"messageHash":"0x502d57554a7c65837e336a3d3032c17d8db9078e14009ad3900fed1cc7daf833"},{"messageHash":"0xfb558681aaf93e5e2020a232cd9436621211c9d6dab77a52b613ed8f17b4b7b5"},{"messageHash":"0x7315bb0d9ce5f7bf1cc4b1e172dd3b8a853fc8c4596381e0dc7275e7f87ccced"},{"messageHash":"0xf4cdf3d96031a85043d00fb8ad0c47739ad5120e4724f999931f45b505501b1c"}]}'
2026-03-01 04:43:05.066 DEBUG [src.steps.store] messages length is 10
2026-03-01 04:43:05.067 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-01 04:43:05.068 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45687/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:43:05.099 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"fa848d2effe08f4f7d28","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x7347a847c338e92ed231f02f2aec4f803586bee5aa9c0155970e9c7eb6058a91"},{"messageHash":"0xccb7d4324c25cfee3212e811f1167f1c4cff83365b393fc1f84503256a34e42e"},{"messageHash":"0xfbcd792255a7125929136a3c95bfa62c1e3396533acedc74042ad46b99cd19f9"},{"messageHash":"0x600f5fd9a8aecd5982e9b657ff8f53d316378c6dae019fd819a4a98a48406621"},{"messageHash":"0x64bfafba08e99e768a2f0838bf67ab15fd22be40ad47342031595afc4672aee7"},{"messageHash":"0x6a97e077e778e333b3ea28b7d12da1af96d50e2c7224c3848f75b75ad46da664"},{"messageHash":"0x502d57554a7c65837e336a3d3032c17d8db9078e14009ad3900fed1cc7daf833"},{"messageHash":"0xfb558681aaf93e5e2020a232cd9436621211c9d6dab77a52b613ed8f17b4b7b5"},{"messageHash":"0x7315bb0d9ce5f7bf1cc4b1e172dd3b8a853fc8c4596381e0dc7275e7f87ccced"},{"messageHash":"0xf4cdf3d96031a85043d00fb8ad0c47739ad5120e4724f999931f45b505501b1c"}]}'
2026-03-01 04:43:05.101 DEBUG [src.steps.store] messages length is 10
2026-03-01 04:43:05.108 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-01 04:43:05.110 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-01 04:43:05.110 DEBUG [src.node.waku_node] Stopping container with id b82b61b29674
2026-03-01 04:43:05.672 DEBUG [src.node.waku_node] Container stopped.
2026-03-01 04:43:05.672 DEBUG [src.node.waku_node] Stopping container with id f4f12bb0e1f6
2026-03-01 04:43:06.223 DEBUG [src.node.waku_node] Container stopped.
2026-03-01 04:43:06.226 DEBUG [src.node.waku_node] Stopping container with id 2882c70f4aad
2026-03-01 04:43:06.486 ERROR [src.node.docker_mananger] Max retries reached for container b82b61b29674. Exiting log stream.
2026-03-01 04:43:06.795 DEBUG [src.node.waku_node] Container stopped.
2026-03-01 04:43:06.796 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-01 04:43:06.808 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-01 04:43:06.815 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-01 04:43:06.823 DEBUG [src.node.docker_mananger] No errors found in the waku logs.