132 lines
23 KiB
Plaintext

2026-03-03 04:39:26.819 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-03 04:39:26.819 DEBUG [tests.conftest] Running test: test_store_sync_indirect_node with id: 2026-03-03_04-39-26__cc911255-077a-4e7c-bf8f-6bea37d5368e
2026-03-03 04:39:26.820 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-03 04:39:26.827 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:39:26.827 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-03_04-39-26__cc911255-077a-4e7c-bf8f-6bea37d5368e__wakuorg_nwaku:latest.log
2026-03-03 04:39:26.834 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:39:26.835 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-03_04-39-26__cc911255-077a-4e7c-bf8f-6bea37d5368e__wakuorg_nwaku:latest.log
2026-03-03 04:39:26.841 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:39:26.841 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-03_04-39-26__cc911255-077a-4e7c-bf8f-6bea37d5368e__wakuorg_nwaku:latest.log
2026-03-03 04:39:26.841 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-03 04:39:26.842 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:39:26.842 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:39:26.844 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-03 04:39:26.844 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.130.166
2026-03-03 04:39:26.845 DEBUG [src.node.docker_mananger] Generated ports ['37986', '37987', '37988', '37989', '37990']
2026-03-03 04:39:26.845 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:39:26.845 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:39:26.845 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:39:26.845 DEBUG [src.node.docker_mananger] docker run -i -t -p 37986:37986 -p 37987:37987 -p 37988:37988 -p 37989:37989 -p 37990:37990 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=37988 --rest-port=37986 --tcp-port=37987 --discv5-udp-port=37989 --rest-address=0.0.0.0 --nat=extip:172.18.130.166 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=efd860edf44c1a2fd9b8ede32eed968bf74c21327cf2d34ab8eb60558d3cffa0 --store-sync=true --store=true --store-sync-range=45 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=37990 --metrics-logging=true --store-sync-relay-jitter=0 --relay=true
2026-03-03 04:39:27.033 ERROR [src.node.docker_mananger] Max retries reached for container c70417133169. Exiting log stream.
2026-03-03 04:39:27.039 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.130.166 waku 30d72df61f70ddd947a7c650ee3e4d82609b3e2876660b9a18d8cf7423333a47
2026-03-03 04:39:27.074 DEBUG [src.node.docker_mananger] Container started with ID 30d72df61f70. Setting up logs at ./log/docker/node1_2026-03-03_04-39-26__cc911255-077a-4e7c-bf8f-6bea37d5368e__wakuorg_nwaku:latest.log
2026-03-03 04:39:27.074 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 37986
2026-03-03 04:39:27.075 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:39:27.619 ERROR [src.node.docker_mananger] Max retries reached for container ddc2cb092c90. Exiting log stream.
2026-03-03 04:39:28.075 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37986/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:39:28.078 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:39:28.078 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:39:28.079 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37986/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:39:28.081 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.130.166/tcp/37987/p2p/16Uiu2HAm2BvWgUQ6UAtc5dLBU6ccy7gPm2PZWfMvPUc94kDrup45","/ip4/172.18.130.166/tcp/37988/ws/p2p/16Uiu2HAm2BvWgUQ6UAtc5dLBU6ccy7gPm2PZWfMvPUc94kDrup45"],"enrUri":"enr:-L24QKFe5thzUUT8LW4casC03K2UjmMCecvxXZtJpHVJRGSVXIHoTwQUBDZwgWlpfcRSFsMuTvEUxCHTDNYqMMqxw0kCgmlkgnY0gmlwhKwSgqaKbXVsdGlhZGRyc5YACASsEoKmBpRjAAoErBKCpgaUZN0DgnJzhQADAQAAiXNlY3AyNTZrMaECZHwb8h-hhZXmXBC_0aEkfyIBRCXbynS3fQt_rsDtjD6DdGNwgpRjg3VkcIKUZYV3YWt1MhM"}'
2026-03-03 04:39:28.081 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:39:28.081 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37986/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-03 04:39:28.100 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:28.100 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:39:28.100 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:39:28.101 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-03 04:39:28.102 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.129.137
2026-03-03 04:39:28.102 DEBUG [src.node.docker_mananger] Generated ports ['29855', '29856', '29857', '29858', '29859']
2026-03-03 04:39:28.102 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:39:28.102 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:39:28.102 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:39:28.102 DEBUG [src.node.docker_mananger] docker run -i -t -p 29855:29855 -p 29856:29856 -p 29857:29857 -p 29858:29858 -p 29859:29859 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=29857 --rest-port=29855 --tcp-port=29856 --discv5-udp-port=29858 --rest-address=0.0.0.0 --nat=extip:172.18.129.137 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=fe6cb8a1dad28ecafaeb3aadad3ccde9a03f17befc5bfdc7b1ed4996b1c05dca --store-sync=true --store=true --store-sync-range=45 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=29859 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --discv5-bootstrap-node=enr:-L24QKFe5thzUUT8LW4casC03K2UjmMCecvxXZtJpHVJRGSVXIHoTwQUBDZwgWlpfcRSFsMuTvEUxCHTDNYqMMqxw0kCgmlkgnY0gmlwhKwSgqaKbXVsdGlhZGRyc5YACASsEoKmBpRjAAoErBKCpgaUZN0DgnJzhQADAQAAiXNlY3AyNTZrMaECZHwb8h-hhZXmXBC_0aEkfyIBRCXbynS3fQt_rsDtjD6DdGNwgpRjg3VkcIKUZYV3YWt1MhM
2026-03-03 04:39:28.302 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.129.137 waku ceed02749fd2ee8898de75cee4ce5ef912ccf51df845b0c072e092e6929716ff
2026-03-03 04:39:28.335 DEBUG [src.node.docker_mananger] Container started with ID ceed02749fd2. Setting up logs at ./log/docker/node2_2026-03-03_04-39-26__cc911255-077a-4e7c-bf8f-6bea37d5368e__wakuorg_nwaku:latest.log
2026-03-03 04:39:28.335 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 29855
2026-03-03 04:39:28.336 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:39:29.336 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:29855/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:39:29.339 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:39:29.339 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:39:29.339 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:29855/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:39:29.342 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.129.137/tcp/29856/p2p/16Uiu2HAm1QLCLXbQHQ6hZHrXQbKfqfYWNqrvzzgGMxcTCxR9oV1J","/ip4/172.18.129.137/tcp/29857/ws/p2p/16Uiu2HAm1QLCLXbQHQ6hZHrXQbKfqfYWNqrvzzgGMxcTCxR9oV1J"],"enrUri":"enr:-L24QJR5beqEYlCF-idInvBHCrFEDhpDFkpnoDhbX9QR9fHEQ5V9b1b2ohQvtT1ernN4-YUPB7u1y3acaKGIJ8XIX2YCgmlkgnY0gmlwhKwSgYmKbXVsdGlhZGRyc5YACASsEoGJBnSgAAoErBKBiQZ0od0DgnJzhQADAQAAiXNlY3AyNTZrMaECWM4r1RpyXBWYb2DbhYDWJ0Hxb8lbPQfmVbwoRdYF0fGDdGNwgnSgg3VkcIJ0ooV3YWt1MhI"}'
2026-03-03 04:39:29.342 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:39:29.342 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:39:29.342 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:39:29.344 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-03 04:39:29.344 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.113.18
2026-03-03 04:39:29.344 DEBUG [src.node.docker_mananger] Generated ports ['62993', '62994', '62995', '62996', '62997']
2026-03-03 04:39:29.344 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:39:29.344 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:39:29.344 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:39:29.344 DEBUG [src.node.docker_mananger] docker run -i -t -p 62993:62993 -p 62994:62994 -p 62995:62995 -p 62996:62996 -p 62997:62997 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=62995 --rest-port=62993 --tcp-port=62994 --discv5-udp-port=62996 --rest-address=0.0.0.0 --nat=extip:172.18.113.18 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=c6efe02e30df22cea0bcd7f825adeb08f7dd99d6d3dbcad8b27a3a7eb2c8d136 --store-sync=true --store=true --store-sync-range=45 --store-sync-interval=10 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=62997 --metrics-logging=true --store-sync-relay-jitter=0 --relay=false --dns-discovery=false --discv5-bootstrap-node=enr:-L24QJR5beqEYlCF-idInvBHCrFEDhpDFkpnoDhbX9QR9fHEQ5V9b1b2ohQvtT1ernN4-YUPB7u1y3acaKGIJ8XIX2YCgmlkgnY0gmlwhKwSgYmKbXVsdGlhZGRyc5YACASsEoGJBnSgAAoErBKBiQZ0od0DgnJzhQADAQAAiXNlY3AyNTZrMaECWM4r1RpyXBWYb2DbhYDWJ0Hxb8lbPQfmVbwoRdYF0fGDdGNwgnSgg3VkcIJ0ooV3YWt1MhI
2026-03-03 04:39:29.543 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.113.18 waku 21cd7400ab61059e20ae6d3a0f4fc84c3a20ca4fcb643da03d30cb74f71de91f
2026-03-03 04:39:29.581 DEBUG [src.node.docker_mananger] Container started with ID 21cd7400ab61. Setting up logs at ./log/docker/node3_2026-03-03_04-39-26__cc911255-077a-4e7c-bf8f-6bea37d5368e__wakuorg_nwaku:latest.log
2026-03-03 04:39:29.581 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 62993
2026-03-03 04:39:29.582 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:39:30.582 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62993/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:39:30.585 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:39:30.585 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:39:30.586 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62993/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:39:30.588 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.113.18/tcp/62994/p2p/16Uiu2HAmBjWGxV6zuMir3EAWGdNznCBwXG7keqbjqA5akJSUqZVe","/ip4/172.18.113.18/tcp/62995/ws/p2p/16Uiu2HAmBjWGxV6zuMir3EAWGdNznCBwXG7keqbjqA5akJSUqZVe"],"enrUri":"enr:-L24QAZ0BjLootr50XW4BWGSXTiQWT9hV5lWV1cZgoe1GRQkSEznR4RkYm9eHRXKTv3lmckDSX_MOBNRMKWnbI63ZFkCgmlkgnY0gmlwhKwScRKKbXVsdGlhZGRyc5YACASsEnESBvYSAAoErBJxEgb2E90DgnJzhQADAQAAiXNlY3AyNTZrMaEC8kx5E8QMwjCEOw7XaLYT-XvuM3A9rc3qRxW5bLmgio2DdGNwgvYSg3VkcIL2FIV3YWt1MhI"}'
2026-03-03 04:39:30.588 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:39:30.588 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:29855/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.130.166/tcp/37987/p2p/16Uiu2HAm2BvWgUQ6UAtc5dLBU6ccy7gPm2PZWfMvPUc94kDrup45"]'
2026-03-03 04:39:30.627 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:30.628 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:30.629 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37986/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:30.640 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:30.641 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-03 04:39:30.843 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:30.843 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37986/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:30.847 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:30.848 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-03 04:39:31.048 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:31.049 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37986/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:31.053 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:31.053 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-03 04:39:31.254 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:31.254 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37986/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:31.258 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:31.259 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-03 04:39:31.459 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:31.460 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37986/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:31.464 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:31.464 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-03 04:39:31.665 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:31.665 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37986/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:31.669 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:31.669 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-03 04:39:31.870 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:31.870 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37986/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:31.875 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:31.875 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-03 04:39:32.076 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:32.076 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37986/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:32.080 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:32.080 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-03 04:39:32.281 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:32.281 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37986/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:32.285 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:32.286 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-03 04:39:32.486 DEBUG [src.steps.store] Relaying message
2026-03-03 04:39:32.487 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37986/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:39:32.491 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:39:32.491 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-03 04:39:32.691 DEBUG [src.libs.common] Sleeping for 65 seconds
2026-03-03 04:40:37.692 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-03 04:40:37.693 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62993/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:37.696 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x2461bfb55b725692e5ed38129a48d088c3bbf38c3dee0e2ac3a72b2a69e016b2"},{"messageHash":"0xf01f832dac516be0ecec564cdeef04cbd3b06cd7ce76f2908f4509fea1ae1f8a"},{"messageHash":"0xdb13768a3b4844a3ce134e5e3f854c87e1fab2f6e78a0b2780db01012a1522da"},{"messageHash":"0x177726c5b028af66cd82bec9fad607679d96a70e9ebdf4e6b7633701e31764a7"},{"messageHash":"0x018a102a3ec17742917cb328c1fede0a1d0fee97fe5a950766c1beaf6048c348"},{"messageHash":"0x5c992024c8e1e65a9de30f90f3fe0bf786d793b2b8db7fcff758698f5200f8a6"},{"messageHash":"0x61e1bad61048143b6240f3f6d2002ab2486af10146170f273570bafe70105949"},{"messageHash":"0xb57d5451490eeecdf4a672fcbb5889e624f38f65712ba8b54a2d9b51b4585bf6"},{"messageHash":"0xe4a60b7a7542c92e83e46bab77953ca0aaed8fb80702119f113d885fe435671d"},{"messageHash":"0x6c631222fa9bafcb9706b770e3184a8546738fdb19f35a7faf5ad4b0491c03bf"}]}'
2026-03-03 04:40:37.696 DEBUG [src.steps.store] messages length is 10
2026-03-03 04:40:37.699 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-03 04:40:37.700 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-03 04:40:37.700 DEBUG [src.node.waku_node] Stopping container with id 30d72df61f70
2026-03-03 04:40:38.311 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:40:38.313 DEBUG [src.node.waku_node] Stopping container with id ceed02749fd2
2026-03-03 04:40:38.918 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:40:38.919 DEBUG [src.node.waku_node] Stopping container with id 21cd7400ab61
2026-03-03 04:40:39.128 ERROR [src.node.docker_mananger] Max retries reached for container 30d72df61f70. Exiting log stream.
2026-03-03 04:40:39.489 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:40:39.493 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-03 04:40:39.531 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-03 04:40:39.600 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-03 04:40:39.630 DEBUG [src.node.docker_mananger] No errors found in the waku logs.