145 lines
26 KiB
Plaintext

2026-03-18 04:46:53.384 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-18 04:46:53.385 DEBUG [tests.conftest] Running test: test_sync_nodes_have_store_true with id: 2026-03-18_04-46-53__fe129e9a-bd44-4088-af5f-609754c35509
2026-03-18 04:46:53.385 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-18 04:46:53.393 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-18 04:46:53.393 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-18_04-46-53__fe129e9a-bd44-4088-af5f-609754c35509__wakuorg_nwaku:latest.log
2026-03-18 04:46:53.400 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-18 04:46:53.400 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-18_04-46-53__fe129e9a-bd44-4088-af5f-609754c35509__wakuorg_nwaku:latest.log
2026-03-18 04:46:53.407 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-18 04:46:53.407 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-18_04-46-53__fe129e9a-bd44-4088-af5f-609754c35509__wakuorg_nwaku:latest.log
2026-03-18 04:46:53.407 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-18 04:46:53.408 DEBUG [src.node.waku_node] Starting Node...
2026-03-18 04:46:53.408 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-18 04:46:53.410 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-18 04:46:53.410 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.88.15
2026-03-18 04:46:53.410 DEBUG [src.node.docker_mananger] Generated ports ['44207', '44208', '44209', '44210', '44211']
2026-03-18 04:46:53.411 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-18 04:46:53.411 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-18 04:46:53.411 DEBUG [src.node.waku_node] Using volumes []
2026-03-18 04:46:53.411 DEBUG [src.node.docker_mananger] docker run -i -t -p 44207:44207 -p 44208:44208 -p 44209:44209 -p 44210:44210 -p 44211:44211 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=44209 --rest-port=44207 --tcp-port=44208 --discv5-udp-port=44210 --rest-address=0.0.0.0 --nat=extip:172.18.88.15 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=c5d35eed5060f71211224cff30c8eabab484f3060c89fd8d70d6da9e4caeba6b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=44211 --metrics-logging=true --store=true --relay=true
2026-03-18 04:46:53.613 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.88.15 waku 28f684b536aec80a54c76b83e161be2d6aa8a827aeaab2f6474c5eaaa1e2b89b
2026-03-18 04:46:53.622 ERROR [src.node.docker_mananger] Max retries reached for container e307fb64e0c0. Exiting log stream.
2026-03-18 04:46:53.649 DEBUG [src.node.docker_mananger] Container started with ID 28f684b536ae. Setting up logs at ./log/docker/node1_2026-03-18_04-46-53__fe129e9a-bd44-4088-af5f-609754c35509__wakuorg_nwaku:latest.log
2026-03-18 04:46:53.650 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 44207
2026-03-18 04:46:53.651 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-18 04:46:54.173 ERROR [src.node.docker_mananger] Max retries reached for container 78c6215919c8. Exiting log stream.
2026-03-18 04:46:54.652 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44207/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:46:54.655 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-18 04:46:54.655 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-18 04:46:54.655 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44207/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:46:54.658 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.88.15/tcp/44208/p2p/16Uiu2HAmRcrE8Vfsb8VJ3cq1u9hDf5mz1SY1e2my9vjmXCN4JxQR","/ip4/172.18.88.15/tcp/44209/ws/p2p/16Uiu2HAmRcrE8Vfsb8VJ3cq1u9hDf5mz1SY1e2my9vjmXCN4JxQR"],"enrUri":"enr:-L24QNUxVYHjEgKt41bLSf9jToSgfoFn_zo1UinhZPB7DNrKWZ5DdeiHzjcGb8gE75ZBPaS29C63EOI6yU303WGA5RsCgmlkgnY0gmlwhKwSWA-KbXVsdGlhZGRyc5YACASsElgPBqywAAoErBJYDwassd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDwJuVTZawv9aW78bKO_G-LhTtJ9na2ML6sVgnNVXoJcKDdGNwgqywg3VkcIKssoV3YWt1MgM"}'
2026-03-18 04:46:54.658 INFO [src.node.waku_node] REST service is ready !!
2026-03-18 04:46:54.658 DEBUG [src.node.waku_node] Starting Node...
2026-03-18 04:46:54.658 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-18 04:46:54.660 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-18 04:46:54.660 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.109.210
2026-03-18 04:46:54.660 DEBUG [src.node.docker_mananger] Generated ports ['28485', '28486', '28487', '28488', '28489']
2026-03-18 04:46:54.660 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-18 04:46:54.660 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-18 04:46:54.660 DEBUG [src.node.waku_node] Using volumes []
2026-03-18 04:46:54.660 DEBUG [src.node.docker_mananger] docker run -i -t -p 28485:28485 -p 28486:28486 -p 28487:28487 -p 28488:28488 -p 28489:28489 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=28487 --rest-port=28485 --tcp-port=28486 --discv5-udp-port=28488 --rest-address=0.0.0.0 --nat=extip:172.18.109.210 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=a62cd46899f8508b2ef6acfbd5c021b45a8af5dbc77729af150cdd56ef3bf4fc --store-sync=true --store=true --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=28489 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QNUxVYHjEgKt41bLSf9jToSgfoFn_zo1UinhZPB7DNrKWZ5DdeiHzjcGb8gE75ZBPaS29C63EOI6yU303WGA5RsCgmlkgnY0gmlwhKwSWA-KbXVsdGlhZGRyc5YACASsElgPBqywAAoErBJYDwassd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDwJuVTZawv9aW78bKO_G-LhTtJ9na2ML6sVgnNVXoJcKDdGNwgqywg3VkcIKssoV3YWt1MgM
2026-03-18 04:46:54.872 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.109.210 waku d34c9a97a78c8e34310fe03d4b76c45fc0c178bd17f121aa0a9969c0e6e237f7
2026-03-18 04:46:54.909 DEBUG [src.node.docker_mananger] Container started with ID d34c9a97a78c. Setting up logs at ./log/docker/node2_2026-03-18_04-46-53__fe129e9a-bd44-4088-af5f-609754c35509__wakuorg_nwaku:latest.log
2026-03-18 04:46:54.910 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 28485
2026-03-18 04:46:54.910 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-18 04:46:55.910 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:28485/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:46:55.913 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-18 04:46:55.913 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-18 04:46:55.913 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:28485/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:46:55.916 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.109.210/tcp/28486/p2p/16Uiu2HAmUkTZgtNwEZVZna61ybTbibj2Pcb9C2JA5qWwbFRUDVBB","/ip4/172.18.109.210/tcp/28487/ws/p2p/16Uiu2HAmUkTZgtNwEZVZna61ybTbibj2Pcb9C2JA5qWwbFRUDVBB"],"enrUri":"enr:-L24QK93r9PUxseONvesjQRiEAX8pcDtdHjoAp1i-xSigelia2ANjTDqJenpA0xVSkEWfztaNWbW4Dg39zcoh9xruisCgmlkgnY0gmlwhKwSbdKKbXVsdGlhZGRyc5YACASsEm3SBm9GAAoErBJt0gZvR90DgnJzhQADAQAAiXNlY3AyNTZrMaED7yGqYxJGgYF1K3S77FZ19PMwgaaMYJ2LrdzY0mkBSE6DdGNwgm9Gg3VkcIJvSIV3YWt1MhM"}'
2026-03-18 04:46:55.916 INFO [src.node.waku_node] REST service is ready !!
2026-03-18 04:46:55.916 DEBUG [src.node.waku_node] Starting Node...
2026-03-18 04:46:55.916 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-18 04:46:55.918 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-18 04:46:55.918 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.169.162
2026-03-18 04:46:55.918 DEBUG [src.node.docker_mananger] Generated ports ['41446', '41447', '41448', '41449', '41450']
2026-03-18 04:46:55.918 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-18 04:46:55.919 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-18 04:46:55.919 DEBUG [src.node.waku_node] Using volumes []
2026-03-18 04:46:55.919 DEBUG [src.node.docker_mananger] docker run -i -t -p 41446:41446 -p 41447:41447 -p 41448:41448 -p 41449:41449 -p 41450:41450 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=41448 --rest-port=41446 --tcp-port=41447 --discv5-udp-port=41449 --rest-address=0.0.0.0 --nat=extip:172.18.169.162 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=dc6b503ffc6fd9f4df71ac337c974c9ef7cfdbce5cb8138dbccbae9ae2ca1af2 --store-sync=true --store=true --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=41450 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QK93r9PUxseONvesjQRiEAX8pcDtdHjoAp1i-xSigelia2ANjTDqJenpA0xVSkEWfztaNWbW4Dg39zcoh9xruisCgmlkgnY0gmlwhKwSbdKKbXVsdGlhZGRyc5YACASsEm3SBm9GAAoErBJt0gZvR90DgnJzhQADAQAAiXNlY3AyNTZrMaED7yGqYxJGgYF1K3S77FZ19PMwgaaMYJ2LrdzY0mkBSE6DdGNwgm9Gg3VkcIJvSIV3YWt1MhM
2026-03-18 04:46:56.165 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.169.162 waku 6c9cf2730676ecb4d9541252f82fbd78cb807f37275010ce110b211328c22ec7
2026-03-18 04:46:56.202 DEBUG [src.node.docker_mananger] Container started with ID 6c9cf2730676. Setting up logs at ./log/docker/node3_2026-03-18_04-46-53__fe129e9a-bd44-4088-af5f-609754c35509__wakuorg_nwaku:latest.log
2026-03-18 04:46:56.203 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 41446
2026-03-18 04:46:56.203 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-18 04:46:57.203 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:41446/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:46:57.206 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-18 04:46:57.207 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-18 04:46:57.207 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:41446/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:46:57.209 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.169.162/tcp/41447/p2p/16Uiu2HAmP1EfFxnZFTCmBR6fdttdv8vKxxGj1ieDFFQSiDsaBD9H","/ip4/172.18.169.162/tcp/41448/ws/p2p/16Uiu2HAmP1EfFxnZFTCmBR6fdttdv8vKxxGj1ieDFFQSiDsaBD9H"],"enrUri":"enr:-L24QHBFyq33kpDkfXC7czlC2FrDiWnrC2_lVRVNAVY5Ae4CeQowVXEzeHbgiMSigOn6PxV7pvy-AblvfWomVNDDAVgCgmlkgnY0gmlwhKwSqaKKbXVsdGlhZGRyc5YACASsEqmiBqHnAAoErBKpogah6N0DgnJzhQADAQAAiXNlY3AyNTZrMaEDmcSqZJUkyM5hHx4aT2PmK7Ee-uczsD6BPvL1WEZnPfCDdGNwgqHng3VkcIKh6YV3YWt1MhM"}'
2026-03-18 04:46:57.209 INFO [src.node.waku_node] REST service is ready !!
2026-03-18 04:46:57.210 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:28485/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.88.15/tcp/44208/p2p/16Uiu2HAmRcrE8Vfsb8VJ3cq1u9hDf5mz1SY1e2my9vjmXCN4JxQR"]'
2026-03-18 04:46:57.213 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:46:57.213 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:41446/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.109.210/tcp/28486/p2p/16Uiu2HAmUkTZgtNwEZVZna61ybTbibj2Pcb9C2JA5qWwbFRUDVBB"]'
2026-03-18 04:46:57.259 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:46:57.261 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44207/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-18 04:46:57.266 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:46:57.266 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:28485/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-18 04:46:57.271 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:46:57.271 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:41446/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-18 04:46:57.274 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:46:57.274 DEBUG [src.steps.store] Relaying message
2026-03-18 04:46:57.274 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44207/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 04:46:57.282 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:46:57.282 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-18 04:46:57.483 DEBUG [src.steps.store] Relaying message
2026-03-18 04:46:57.483 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44207/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 04:46:57.490 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:46:57.493 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-18 04:46:57.694 DEBUG [src.steps.store] Relaying message
2026-03-18 04:46:57.695 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44207/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 04:46:57.701 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:46:57.701 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-18 04:46:57.902 DEBUG [src.steps.store] Relaying message
2026-03-18 04:46:57.902 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44207/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 04:46:57.909 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:46:57.909 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-18 04:46:58.110 DEBUG [src.steps.store] Relaying message
2026-03-18 04:46:58.110 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44207/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 04:46:58.116 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:46:58.117 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-18 04:46:58.318 DEBUG [src.steps.store] Relaying message
2026-03-18 04:46:58.319 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44207/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 04:46:58.325 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:46:58.325 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-18 04:46:58.526 DEBUG [src.steps.store] Relaying message
2026-03-18 04:46:58.526 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44207/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 04:46:58.533 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:46:58.533 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-18 04:46:58.736 DEBUG [src.steps.store] Relaying message
2026-03-18 04:46:58.736 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44207/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 04:46:58.742 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:46:58.743 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-18 04:46:58.944 DEBUG [src.steps.store] Relaying message
2026-03-18 04:46:58.944 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44207/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 04:46:58.952 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:46:58.952 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-18 04:46:59.154 DEBUG [src.steps.store] Relaying message
2026-03-18 04:46:59.154 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44207/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 04:46:59.161 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:46:59.161 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-18 04:46:59.362 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-18 04:46:59.362 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44207/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:46:59.365 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x86a35b97d746eb2e4984972a3cff114a3ec86ae9495c2bb6bf2fc3abfd52e0ac"},{"messageHash":"0x76e592089ba3b0a5b34fe1c82c1b191e7c97cfe98c3a5fc4e2f22fc7bb94f0ba"},{"messageHash":"0x9a1ce0509ddd8fb8353fb1f3a7cae27d725ef18d9539b38755c0945648e99c26"},{"messageHash":"0xdf872139ed5e7b99c6efd144080a6f617b9efc667f7c106aeb9328f71123d65b"},{"messageHash":"0x60f36fa061cdd5d6a5d9132448f8bff1033cd8a29d96f9729ac95a875d305a9f"},{"messageHash":"0x3ad700271cd32e4551f856566059d020e06362dbffbfe2ef5d9f0a7f50bc8ade"},{"messageHash":"0x1a492f7345441a4dc869efd6fe3ce7181d21bc645fa1ffabdf83ed621978ea45"},{"messageHash":"0xc6741bb029c4e8a757b994a9e5613a82db1228aa07db8b8d135d6b2069e3bd84"},{"messageHash":"0x6123a0ea93c6853b35cc8f846b696fd56c00a4e0e7de3ce494b1771fd00a8a01"},{"messageHash":"0x9fd4a8c6c77f0fab9da05d089f576baa2441f0766f3d5526551c904e93688816"}]}'
2026-03-18 04:46:59.366 DEBUG [src.steps.store] messages length is 10
2026-03-18 04:46:59.367 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-18 04:46:59.367 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:28485/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:46:59.370 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x86a35b97d746eb2e4984972a3cff114a3ec86ae9495c2bb6bf2fc3abfd52e0ac"},{"messageHash":"0x76e592089ba3b0a5b34fe1c82c1b191e7c97cfe98c3a5fc4e2f22fc7bb94f0ba"},{"messageHash":"0x9a1ce0509ddd8fb8353fb1f3a7cae27d725ef18d9539b38755c0945648e99c26"},{"messageHash":"0xdf872139ed5e7b99c6efd144080a6f617b9efc667f7c106aeb9328f71123d65b"},{"messageHash":"0x60f36fa061cdd5d6a5d9132448f8bff1033cd8a29d96f9729ac95a875d305a9f"},{"messageHash":"0x3ad700271cd32e4551f856566059d020e06362dbffbfe2ef5d9f0a7f50bc8ade"},{"messageHash":"0x1a492f7345441a4dc869efd6fe3ce7181d21bc645fa1ffabdf83ed621978ea45"},{"messageHash":"0xc6741bb029c4e8a757b994a9e5613a82db1228aa07db8b8d135d6b2069e3bd84"},{"messageHash":"0x6123a0ea93c6853b35cc8f846b696fd56c00a4e0e7de3ce494b1771fd00a8a01"},{"messageHash":"0x9fd4a8c6c77f0fab9da05d089f576baa2441f0766f3d5526551c904e93688816"}]}'
2026-03-18 04:46:59.370 DEBUG [src.steps.store] messages length is 10
2026-03-18 04:46:59.372 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-18 04:46:59.372 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:41446/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:46:59.375 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x86a35b97d746eb2e4984972a3cff114a3ec86ae9495c2bb6bf2fc3abfd52e0ac"},{"messageHash":"0x76e592089ba3b0a5b34fe1c82c1b191e7c97cfe98c3a5fc4e2f22fc7bb94f0ba"},{"messageHash":"0x9a1ce0509ddd8fb8353fb1f3a7cae27d725ef18d9539b38755c0945648e99c26"},{"messageHash":"0xdf872139ed5e7b99c6efd144080a6f617b9efc667f7c106aeb9328f71123d65b"},{"messageHash":"0x60f36fa061cdd5d6a5d9132448f8bff1033cd8a29d96f9729ac95a875d305a9f"},{"messageHash":"0x3ad700271cd32e4551f856566059d020e06362dbffbfe2ef5d9f0a7f50bc8ade"},{"messageHash":"0x1a492f7345441a4dc869efd6fe3ce7181d21bc645fa1ffabdf83ed621978ea45"},{"messageHash":"0xc6741bb029c4e8a757b994a9e5613a82db1228aa07db8b8d135d6b2069e3bd84"},{"messageHash":"0x6123a0ea93c6853b35cc8f846b696fd56c00a4e0e7de3ce494b1771fd00a8a01"},{"messageHash":"0x9fd4a8c6c77f0fab9da05d089f576baa2441f0766f3d5526551c904e93688816"}]}'
2026-03-18 04:46:59.375 DEBUG [src.steps.store] messages length is 10
2026-03-18 04:46:59.377 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-18 04:46:59.379 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-18 04:46:59.379 DEBUG [src.node.waku_node] Stopping container with id 28f684b536ae
2026-03-18 04:46:59.994 DEBUG [src.node.waku_node] Container stopped.
2026-03-18 04:46:59.994 DEBUG [src.node.waku_node] Stopping container with id d34c9a97a78c
2026-03-18 04:47:00.607 DEBUG [src.node.waku_node] Container stopped.
2026-03-18 04:47:00.608 DEBUG [src.node.waku_node] Stopping container with id 6c9cf2730676
2026-03-18 04:47:00.813 ERROR [src.node.docker_mananger] Max retries reached for container 28f684b536ae. Exiting log stream.
2026-03-18 04:47:01.204 DEBUG [src.node.waku_node] Container stopped.
2026-03-18 04:47:01.207 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-18 04:47:01.215 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-18 04:47:01.238 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-18 04:47:01.245 DEBUG [src.node.docker_mananger] No errors found in the waku logs.