141 lines
26 KiB
Plaintext

2026-03-08 04:38:44.470 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-08 04:38:44.470 DEBUG [tests.conftest] Running test: test_sync_nodes_are_not_relay_and_have_storenode_set with id: 2026-03-08_04-38-44__ac4d1675-d316-4772-b634-dd5545d92c2a
2026-03-08 04:38:44.470 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-08 04:38:44.478 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-08 04:38:44.478 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-08_04-38-44__ac4d1675-d316-4772-b634-dd5545d92c2a__wakuorg_nwaku:latest.log
2026-03-08 04:38:44.485 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-08 04:38:44.485 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-08_04-38-44__ac4d1675-d316-4772-b634-dd5545d92c2a__wakuorg_nwaku:latest.log
2026-03-08 04:38:44.491 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-08 04:38:44.491 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-08_04-38-44__ac4d1675-d316-4772-b634-dd5545d92c2a__wakuorg_nwaku:latest.log
2026-03-08 04:38:44.491 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-08 04:38:44.492 DEBUG [src.node.waku_node] Starting Node...
2026-03-08 04:38:44.492 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-08 04:38:44.494 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-08 04:38:44.494 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.220.241
2026-03-08 04:38:44.494 DEBUG [src.node.docker_mananger] Generated ports ['37355', '37356', '37357', '37358', '37359']
2026-03-08 04:38:44.494 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-08 04:38:44.494 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-08 04:38:44.494 DEBUG [src.node.waku_node] Using volumes []
2026-03-08 04:38:44.494 DEBUG [src.node.docker_mananger] docker run -i -t -p 37355:37355 -p 37356:37356 -p 37357:37357 -p 37358:37358 -p 37359:37359 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=37357 --rest-port=37355 --tcp-port=37356 --discv5-udp-port=37358 --rest-address=0.0.0.0 --nat=extip:172.18.220.241 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=f4e476a77b3cd2fcdf63fa4dfdedc60a026adcbd13a6fc7dfdb60e0c2989e0ce --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=37359 --metrics-logging=true --store=true --relay=true
2026-03-08 04:38:44.668 ERROR [src.node.docker_mananger] Max retries reached for container 0d39c92fc107. Exiting log stream.
2026-03-08 04:38:44.693 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.220.241 waku 18f25c36f9e2afd982a8c0435258e9e3362fc92ea15f1c5ea99e15c7892c2f9b
2026-03-08 04:38:44.729 DEBUG [src.node.docker_mananger] Container started with ID 18f25c36f9e2. Setting up logs at ./log/docker/node1_2026-03-08_04-38-44__ac4d1675-d316-4772-b634-dd5545d92c2a__wakuorg_nwaku:latest.log
2026-03-08 04:38:44.730 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 37355
2026-03-08 04:38:44.730 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-08 04:38:45.254 ERROR [src.node.docker_mananger] Max retries reached for container 6c35737284f2. Exiting log stream.
2026-03-08 04:38:45.730 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37355/health" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:38:45.733 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-08 04:38:45.733 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-08 04:38:45.733 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37355/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:38:45.736 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.220.241/tcp/37356/p2p/16Uiu2HAmP15yzKWWFev3Rzo4LiuY6VE5UGzHSENGys8RLTHdPyum","/ip4/172.18.220.241/tcp/37357/ws/p2p/16Uiu2HAmP15yzKWWFev3Rzo4LiuY6VE5UGzHSENGys8RLTHdPyum"],"enrUri":"enr:-L24QMkTJBEjblXigk-22MHqRYS17kz_E4vE_-P5dJF2ceMpMXs1KTEdbUBstT4pN3izKdXknwG0u5LpM-sgDzK7nW8CgmlkgnY0gmlwhKwS3PGKbXVsdGlhZGRyc5YACASsEtzxBpHsAAoErBLc8QaR7d0DgnJzhQADAQAAiXNlY3AyNTZrMaEDmbraupvbpbo8Wjg-B0lG-GcTV8M-kje79AFXjPxTq4SDdGNwgpHsg3VkcIKR7oV3YWt1MgM"}'
2026-03-08 04:38:45.736 INFO [src.node.waku_node] REST service is ready !!
2026-03-08 04:38:45.736 DEBUG [src.node.waku_node] Starting Node...
2026-03-08 04:38:45.737 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-08 04:38:45.738 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-08 04:38:45.738 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.217.92
2026-03-08 04:38:45.738 DEBUG [src.node.docker_mananger] Generated ports ['59745', '59746', '59747', '59748', '59749']
2026-03-08 04:38:45.738 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-08 04:38:45.738 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-08 04:38:45.739 DEBUG [src.node.waku_node] Using volumes []
2026-03-08 04:38:45.739 DEBUG [src.node.docker_mananger] docker run -i -t -p 59745:59745 -p 59746:59746 -p 59747:59747 -p 59748:59748 -p 59749:59749 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=59747 --rest-port=59745 --tcp-port=59746 --discv5-udp-port=59748 --rest-address=0.0.0.0 --nat=extip:172.18.217.92 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=3cbe67b160d4ccdfe42bd29f63debc31aeeebbfae9bcc72ef6edef82fb059c93 --store-sync=true --store=false --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=59749 --metrics-logging=true --relay=false --storenode=/ip4/172.18.220.241/tcp/37356/p2p/16Uiu2HAmP15yzKWWFev3Rzo4LiuY6VE5UGzHSENGys8RLTHdPyum --discv5-bootstrap-node=enr:-L24QMkTJBEjblXigk-22MHqRYS17kz_E4vE_-P5dJF2ceMpMXs1KTEdbUBstT4pN3izKdXknwG0u5LpM-sgDzK7nW8CgmlkgnY0gmlwhKwS3PGKbXVsdGlhZGRyc5YACASsEtzxBpHsAAoErBLc8QaR7d0DgnJzhQADAQAAiXNlY3AyNTZrMaEDmbraupvbpbo8Wjg-B0lG-GcTV8M-kje79AFXjPxTq4SDdGNwgpHsg3VkcIKR7oV3YWt1MgM
2026-03-08 04:38:45.935 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.217.92 waku f3a8e1221709ff01d9720838d6f66904919574302dfe0932f6f5d8dcdc46ca2c
2026-03-08 04:38:45.973 DEBUG [src.node.docker_mananger] Container started with ID f3a8e1221709. Setting up logs at ./log/docker/node2_2026-03-08_04-38-44__ac4d1675-d316-4772-b634-dd5545d92c2a__wakuorg_nwaku:latest.log
2026-03-08 04:38:45.974 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 59745
2026-03-08 04:38:45.974 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-08 04:38:46.975 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:59745/health" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:38:46.978 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-08 04:38:46.978 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-08 04:38:46.978 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:59745/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:38:46.980 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.217.92/tcp/59746/p2p/16Uiu2HAm9Z7RRoYXk716fBNt8eWxyrmxTfLvzKmx7y6nsm62yGpA","/ip4/172.18.217.92/tcp/59747/ws/p2p/16Uiu2HAm9Z7RRoYXk716fBNt8eWxyrmxTfLvzKmx7y6nsm62yGpA"],"enrUri":"enr:-L24QNPltTRHlEjle1kwM23RLtaQ6MiJnX04zfJfWYJuncLBTvCoKNHH89lgV2WTYen0Kw34lXgWfIlTS07aOv0Xxx8CgmlkgnY0gmlwhKwS2VyKbXVsdGlhZGRyc5YACASsEtlcBuliAAoErBLZXAbpY90DgnJzhQADAQAAiXNlY3AyNTZrMaEC0etzMWjMp2batS6iDfaRS5HIwbk-FXPaeOjcPiKZkLuDdGNwgulig3VkcILpZIV3YWt1MgA"}'
2026-03-08 04:38:46.981 INFO [src.node.waku_node] REST service is ready !!
2026-03-08 04:38:46.981 DEBUG [src.node.waku_node] Starting Node...
2026-03-08 04:38:46.981 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-08 04:38:46.982 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-08 04:38:46.983 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.2.133
2026-03-08 04:38:46.983 DEBUG [src.node.docker_mananger] Generated ports ['5806', '5807', '5808', '5809', '5810']
2026-03-08 04:38:46.983 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-08 04:38:46.983 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-08 04:38:46.983 DEBUG [src.node.waku_node] Using volumes []
2026-03-08 04:38:46.983 DEBUG [src.node.docker_mananger] docker run -i -t -p 5806:5806 -p 5807:5807 -p 5808:5808 -p 5809:5809 -p 5810:5810 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=5808 --rest-port=5806 --tcp-port=5807 --discv5-udp-port=5809 --rest-address=0.0.0.0 --nat=extip:172.18.2.133 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=fab8bc50aa4c6451e8b0c2f03a95ed172ddc2acbfa5136f6cee3faec87af9129 --store-sync=true --store=false --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=5810 --metrics-logging=true --relay=false --storenode=/ip4/172.18.220.241/tcp/37356/p2p/16Uiu2HAmP15yzKWWFev3Rzo4LiuY6VE5UGzHSENGys8RLTHdPyum --discv5-bootstrap-node=enr:-L24QNPltTRHlEjle1kwM23RLtaQ6MiJnX04zfJfWYJuncLBTvCoKNHH89lgV2WTYen0Kw34lXgWfIlTS07aOv0Xxx8CgmlkgnY0gmlwhKwS2VyKbXVsdGlhZGRyc5YACASsEtlcBuliAAoErBLZXAbpY90DgnJzhQADAQAAiXNlY3AyNTZrMaEC0etzMWjMp2batS6iDfaRS5HIwbk-FXPaeOjcPiKZkLuDdGNwgulig3VkcILpZIV3YWt1MgA
2026-03-08 04:38:47.198 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.2.133 waku bc6670d9e0d199df96e0b0d8b96315f56976271b3f4142ededc977626b075303
2026-03-08 04:38:47.233 DEBUG [src.node.docker_mananger] Container started with ID bc6670d9e0d1. Setting up logs at ./log/docker/node3_2026-03-08_04-38-44__ac4d1675-d316-4772-b634-dd5545d92c2a__wakuorg_nwaku:latest.log
2026-03-08 04:38:47.233 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 5806
2026-03-08 04:38:47.233 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-08 04:38:48.234 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:5806/health" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:38:48.237 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-08 04:38:48.237 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-08 04:38:48.237 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:5806/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:38:48.239 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.2.133/tcp/5807/p2p/16Uiu2HAm9SLL8Hb3UmEavix6PiFVatbkoeSobfj4f1uVUQrdtYyQ","/ip4/172.18.2.133/tcp/5808/ws/p2p/16Uiu2HAm9SLL8Hb3UmEavix6PiFVatbkoeSobfj4f1uVUQrdtYyQ"],"enrUri":"enr:-L24QGFgOYmWk0yxt6roaTu9g-4sl8uWt18dIlwteXBEad4dOuz_qMtclaLAdmlDgXcpJ7Ojy9nUoat73pwESvcU3-QCgmlkgnY0gmlwhKwSAoWKbXVsdGlhZGRyc5YACASsEgKFBhavAAoErBIChQYWsN0DgnJzhQADAQAAiXNlY3AyNTZrMaEC0C7652_DztvXAQkFOxoUWXLrMGG7qvJgbLge-fEUwzuDdGNwghavg3VkcIIWsYV3YWt1MgA"}'
2026-03-08 04:38:48.240 INFO [src.node.waku_node] REST service is ready !!
2026-03-08 04:38:48.240 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59745/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.220.241/tcp/37356/p2p/16Uiu2HAmP15yzKWWFev3Rzo4LiuY6VE5UGzHSENGys8RLTHdPyum"]'
2026-03-08 04:38:48.270 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:38:48.272 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:5806/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.217.92/tcp/59746/p2p/16Uiu2HAm9Z7RRoYXk716fBNt8eWxyrmxTfLvzKmx7y6nsm62yGpA"]'
2026-03-08 04:38:48.317 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:38:48.318 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37355/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-08 04:38:48.323 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:38:48.323 DEBUG [src.steps.store] Relaying message
2026-03-08 04:38:48.323 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37355/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-08 04:38:48.327 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:38:48.327 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-08 04:38:48.528 DEBUG [src.steps.store] Relaying message
2026-03-08 04:38:48.528 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37355/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-08 04:38:48.532 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:38:48.532 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-08 04:38:48.733 DEBUG [src.steps.store] Relaying message
2026-03-08 04:38:48.733 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37355/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-08 04:38:48.737 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:38:48.738 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-08 04:38:48.938 DEBUG [src.steps.store] Relaying message
2026-03-08 04:38:48.938 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37355/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-08 04:38:48.943 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:38:48.943 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-08 04:38:49.143 DEBUG [src.steps.store] Relaying message
2026-03-08 04:38:49.144 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37355/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-08 04:38:49.148 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:38:49.148 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-08 04:38:49.349 DEBUG [src.steps.store] Relaying message
2026-03-08 04:38:49.349 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37355/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-08 04:38:49.353 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:38:49.353 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-08 04:38:49.554 DEBUG [src.steps.store] Relaying message
2026-03-08 04:38:49.554 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37355/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-08 04:38:49.558 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:38:49.558 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-08 04:38:49.759 DEBUG [src.steps.store] Relaying message
2026-03-08 04:38:49.759 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37355/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-08 04:38:49.763 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:38:49.763 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-08 04:38:49.964 DEBUG [src.steps.store] Relaying message
2026-03-08 04:38:49.964 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37355/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-08 04:38:49.968 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:38:49.969 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-08 04:38:50.169 DEBUG [src.steps.store] Relaying message
2026-03-08 04:38:50.170 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37355/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-08 04:38:50.174 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:38:50.174 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-08 04:38:50.375 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-08 04:38:50.375 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37355/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:38:50.378 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x85e87e223a2fd7e32ce37a8f6659f15294b4cb5a8bfd64be60f568bfb82a9ec4"},{"messageHash":"0x7be85fd5209e48fb38f15fd3b33f3ae35f1f77fcadb745845e0c7124d311819a"},{"messageHash":"0xaddf32bd8a506305e2e247c3c19a8d1ac273b851d4921b1ee81d06e6bbcd0b85"},{"messageHash":"0xdb76117cb2f4c6832c54d0f0dfbaa41e4e1d1b484d5d0766f600b1b9d440d298"},{"messageHash":"0x8e7b6eb5cd4a1a458ad77c4fe36dadc9e839a78852ffde62b12225e15c9888d2"},{"messageHash":"0x8852f6defe146aaa57c3536f0977e32ac72c983c415c82c6dda96f2c3a427fe0"},{"messageHash":"0x0732fa4baeae29d7b425a00744a6e06602e594758c6bd46128a0cc2baa7f6afa"},{"messageHash":"0xd0b4689b5a7fe8a5f8e5686557b056f0ee0410826fcabeee047ee79f91f30438"},{"messageHash":"0x77a6880445e768ac58201d14fa52b96ad5a08e46e7b14e0e14aa9aa2ea7a2394"},{"messageHash":"0xbcf9986f7fac114dff04d72e2c12cc1f2a16935c886abdbfd1e2a83299fd8235"}]}'
2026-03-08 04:38:50.379 DEBUG [src.steps.store] messages length is 10
2026-03-08 04:38:50.380 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-08 04:38:50.380 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:59745/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:38:50.389 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"c6d87f8d4e4a8a09c18c","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x85e87e223a2fd7e32ce37a8f6659f15294b4cb5a8bfd64be60f568bfb82a9ec4"},{"messageHash":"0x7be85fd5209e48fb38f15fd3b33f3ae35f1f77fcadb745845e0c7124d311819a"},{"messageHash":"0xaddf32bd8a506305e2e247c3c19a8d1ac273b851d4921b1ee81d06e6bbcd0b85"},{"messageHash":"0xdb76117cb2f4c6832c54d0f0dfbaa41e4e1d1b484d5d0766f600b1b9d440d298"},{"messageHash":"0x8e7b6eb5cd4a1a458ad77c4fe36dadc9e839a78852ffde62b12225e15c9888d2"},{"messageHash":"0x8852f6defe146aaa57c3536f0977e32ac72c983c415c82c6dda96f2c3a427fe0"},{"messageHash":"0x0732fa4baeae29d7b425a00744a6e06602e594758c6bd46128a0cc2baa7f6afa"},{"messageHash":"0xd0b4689b5a7fe8a5f8e5686557b056f0ee0410826fcabeee047ee79f91f30438"},{"messageHash":"0x77a6880445e768ac58201d14fa52b96ad5a08e46e7b14e0e14aa9aa2ea7a2394"},{"messageHash":"0xbcf9986f7fac114dff04d72e2c12cc1f2a16935c886abdbfd1e2a83299fd8235"}]}'
2026-03-08 04:38:50.389 DEBUG [src.steps.store] messages length is 10
2026-03-08 04:38:50.390 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-08 04:38:50.390 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:5806/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:38:50.419 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"a5e580a7b3a528a0a7ae","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x85e87e223a2fd7e32ce37a8f6659f15294b4cb5a8bfd64be60f568bfb82a9ec4"},{"messageHash":"0x7be85fd5209e48fb38f15fd3b33f3ae35f1f77fcadb745845e0c7124d311819a"},{"messageHash":"0xaddf32bd8a506305e2e247c3c19a8d1ac273b851d4921b1ee81d06e6bbcd0b85"},{"messageHash":"0xdb76117cb2f4c6832c54d0f0dfbaa41e4e1d1b484d5d0766f600b1b9d440d298"},{"messageHash":"0x8e7b6eb5cd4a1a458ad77c4fe36dadc9e839a78852ffde62b12225e15c9888d2"},{"messageHash":"0x8852f6defe146aaa57c3536f0977e32ac72c983c415c82c6dda96f2c3a427fe0"},{"messageHash":"0x0732fa4baeae29d7b425a00744a6e06602e594758c6bd46128a0cc2baa7f6afa"},{"messageHash":"0xd0b4689b5a7fe8a5f8e5686557b056f0ee0410826fcabeee047ee79f91f30438"},{"messageHash":"0x77a6880445e768ac58201d14fa52b96ad5a08e46e7b14e0e14aa9aa2ea7a2394"},{"messageHash":"0xbcf9986f7fac114dff04d72e2c12cc1f2a16935c886abdbfd1e2a83299fd8235"}]}'
2026-03-08 04:38:50.420 DEBUG [src.steps.store] messages length is 10
2026-03-08 04:38:50.428 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-08 04:38:50.431 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-08 04:38:50.431 DEBUG [src.node.waku_node] Stopping container with id 18f25c36f9e2
2026-03-08 04:38:50.996 DEBUG [src.node.waku_node] Container stopped.
2026-03-08 04:38:50.997 DEBUG [src.node.waku_node] Stopping container with id f3a8e1221709
2026-03-08 04:38:51.587 DEBUG [src.node.waku_node] Container stopped.
2026-03-08 04:38:51.587 DEBUG [src.node.waku_node] Stopping container with id bc6670d9e0d1
2026-03-08 04:38:51.811 ERROR [src.node.docker_mananger] Max retries reached for container 18f25c36f9e2. Exiting log stream.
2026-03-08 04:38:52.160 DEBUG [src.node.waku_node] Container stopped.
2026-03-08 04:38:52.162 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-08 04:38:52.175 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-08 04:38:52.182 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-08 04:38:52.189 DEBUG [src.node.docker_mananger] No errors found in the waku logs.