85 lines
15 KiB
Plaintext

2026-03-10 04:34:11.363 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-10 04:34:11.364 DEBUG [tests.conftest] Running test: test_passing_cursor_of_non_existing_message_from_the_store with id: 2026-03-10_04-34-11__c3338908-972b-4f5d-ad94-70fb3afba398
2026-03-10 04:34:11.364 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-10 04:34:11.364 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-10 04:34:11.365 DEBUG [src.steps.store] Running fixture setup: node_setup
2026-03-10 04:34:11.372 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-10 04:34:11.372 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/publishing_node1_2026-03-10_04-34-11__c3338908-972b-4f5d-ad94-70fb3afba398__wakuorg_nwaku:latest.log
2026-03-10 04:34:11.372 DEBUG [src.node.waku_node] Starting Node...
2026-03-10 04:34:11.372 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-10 04:34:11.374 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-10 04:34:11.374 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.165.138
2026-03-10 04:34:11.374 DEBUG [src.node.docker_mananger] Generated ports ['52185', '52186', '52187', '52188', '52189']
2026-03-10 04:34:11.374 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-10 04:34:11.374 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-10 04:34:11.374 DEBUG [src.node.waku_node] Using volumes []
2026-03-10 04:34:11.375 DEBUG [src.node.docker_mananger] docker run -i -t -p 52185:52185 -p 52186:52186 -p 52187:52187 -p 52188:52188 -p 52189:52189 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=52187 --rest-port=52185 --tcp-port=52186 --discv5-udp-port=52188 --rest-address=0.0.0.0 --nat=extip:172.18.165.138 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=c4ac2cf5ff17bfc0a760a27aa7e7e978afe1b72acd6754efc5fe3f4d0eb7e39e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=52189 --metrics-logging=true --store=true --relay=true
2026-03-10 04:34:11.564 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.165.138 waku 5ac295fdc21e58df4baa85ca1836a619fe7e40fb110683c552eb1af7d3732437
2026-03-10 04:34:11.587 ERROR [src.node.docker_mananger] Max retries reached for container 6ea9be47fdfd. Exiting log stream.
2026-03-10 04:34:11.599 DEBUG [src.node.docker_mananger] Container started with ID 5ac295fdc21e. Setting up logs at ./log/docker/publishing_node1_2026-03-10_04-34-11__c3338908-972b-4f5d-ad94-70fb3afba398__wakuorg_nwaku:latest.log
2026-03-10 04:34:11.599 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 52185
2026-03-10 04:34:11.599 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-10 04:34:12.151 ERROR [src.node.docker_mananger] Max retries reached for container 8d769e3eece0. Exiting log stream.
2026-03-10 04:34:12.601 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:52185/health" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:34:12.604 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-10 04:34:12.604 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-10 04:34:12.605 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:52185/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:34:12.608 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.165.138/tcp/52186/p2p/16Uiu2HAm8T5NrWvWbxrduE2F9LRieu5txgC6AfSVNSa7A3ui8MYn","/ip4/172.18.165.138/tcp/52187/ws/p2p/16Uiu2HAm8T5NrWvWbxrduE2F9LRieu5txgC6AfSVNSa7A3ui8MYn"],"enrUri":"enr:-L24QO16jxKjOG04W6kzptHGYwj6e1xDBuvDOGpvxIV-jqqzCgQQYqxATQRxvku-pot6avpABCeltl-23vFSDP6xHZsCgmlkgnY0gmlwhKwSpYqKbXVsdGlhZGRyc5YACASsEqWKBsvaAAoErBKligbL290DgnJzhQADAQAAiXNlY3AyNTZrMaECwYP3c4h0_7hwVPu1P4aRcMYfhqlGTxL0eAxkRO1g-CuDdGNwgsvag3VkcILL3IV3YWt1MgM"}'
2026-03-10 04:34:12.608 INFO [src.node.waku_node] REST service is ready !!
2026-03-10 04:34:12.616 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-10 04:34:12.616 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/store_node1_2026-03-10_04-34-11__c3338908-972b-4f5d-ad94-70fb3afba398__wakuorg_nwaku:latest.log
2026-03-10 04:34:12.616 DEBUG [src.node.waku_node] Starting Node...
2026-03-10 04:34:12.616 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-10 04:34:12.618 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-10 04:34:12.618 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.106.31
2026-03-10 04:34:12.618 DEBUG [src.node.docker_mananger] Generated ports ['52125', '52126', '52127', '52128', '52129']
2026-03-10 04:34:12.619 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-10 04:34:12.619 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-10 04:34:12.619 DEBUG [src.node.waku_node] Using volumes []
2026-03-10 04:34:12.619 DEBUG [src.node.docker_mananger] docker run -i -t -p 52125:52125 -p 52126:52126 -p 52127:52127 -p 52128:52128 -p 52129:52129 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=52127 --rest-port=52125 --tcp-port=52126 --discv5-udp-port=52128 --rest-address=0.0.0.0 --nat=extip:172.18.106.31 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=6ccb5edefd6ae97b5bbf2afe91e0fa8d1988a42fd3c18f75211cacae3ab6a113 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=52129 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QO16jxKjOG04W6kzptHGYwj6e1xDBuvDOGpvxIV-jqqzCgQQYqxATQRxvku-pot6avpABCeltl-23vFSDP6xHZsCgmlkgnY0gmlwhKwSpYqKbXVsdGlhZGRyc5YACASsEqWKBsvaAAoErBKligbL290DgnJzhQADAQAAiXNlY3AyNTZrMaECwYP3c4h0_7hwVPu1P4aRcMYfhqlGTxL0eAxkRO1g-CuDdGNwgsvag3VkcILL3IV3YWt1MgM --storenode=/ip4/172.18.165.138/tcp/52186/p2p/16Uiu2HAm8T5NrWvWbxrduE2F9LRieu5txgC6AfSVNSa7A3ui8MYn --store=true --relay=true
2026-03-10 04:34:12.840 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.106.31 waku 0ecaa34ee3dca852af5470f06db2993c4411eb6a7f9d0977f2db8edf9041110a
2026-03-10 04:34:12.876 DEBUG [src.node.docker_mananger] Container started with ID 0ecaa34ee3dc. Setting up logs at ./log/docker/store_node1_2026-03-10_04-34-11__c3338908-972b-4f5d-ad94-70fb3afba398__wakuorg_nwaku:latest.log
2026-03-10 04:34:12.877 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 52125
2026-03-10 04:34:12.878 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-10 04:34:13.878 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:52125/health" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:34:13.882 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-10 04:34:13.882 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-10 04:34:13.882 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:52125/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:34:13.885 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.106.31/tcp/52126/p2p/16Uiu2HAm3PR59kSsbdset1HGmRXqLs1kLjD4kFkExH375x6pnhhi","/ip4/172.18.106.31/tcp/52127/ws/p2p/16Uiu2HAm3PR59kSsbdset1HGmRXqLs1kLjD4kFkExH375x6pnhhi"],"enrUri":"enr:-L24QAoYH4gJOzp-GjKDTfgCgQjOfRT7DqXqWYAnjUDLJN81Zk2VazNHvFOynixvIqczy7Ge-TgYSQN-uPjisNl3JZ4CgmlkgnY0gmlwhKwSah-KbXVsdGlhZGRyc5YACASsEmofBsueAAoErBJqHwbLn90DgnJzhQADAQAAiXNlY3AyNTZrMaECdkl6SjkQ3jjh5tecPC_LDeymoOrILc8oLakctCxRBbGDdGNwgsueg3VkcILLoIV3YWt1MgM"}'
2026-03-10 04:34:13.885 INFO [src.node.waku_node] REST service is ready !!
2026-03-10 04:34:13.885 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:52125/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.165.138/tcp/52186/p2p/16Uiu2HAm8T5NrWvWbxrduE2F9LRieu5txgC6AfSVNSa7A3ui8MYn"]'
2026-03-10 04:34:13.888 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:34:13.889 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:52185/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-10 04:34:13.891 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:34:13.891 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:52125/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-10 04:34:13.894 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:34:13.895 DEBUG [src.steps.store] Relaying message
2026-03-10 04:34:13.895 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:52185/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "TWVzc2FnZV8w", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:34:13.900 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:34:13.902 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-10 04:34:14.102 DEBUG [src.steps.store] Relaying message
2026-03-10 04:34:14.103 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:52185/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "TWVzc2FnZV8x", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:34:14.108 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:34:14.109 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-10 04:34:14.309 DEBUG [src.steps.store] Relaying message
2026-03-10 04:34:14.310 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:52185/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "TWVzc2FnZV8y", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:34:14.315 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:34:14.315 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-10 04:34:14.516 DEBUG [src.steps.store] Relaying message
2026-03-10 04:34:14.516 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:52185/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "TWVzc2FnZV8z", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:34:14.523 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:34:14.524 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-10 04:34:14.725 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:52185/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&cursor=0x4f8865d1d82b3ad54b3b9dd7422bba01afab115c63ccc655701dcfb5d4e15387&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:34:14.728 ERROR [src.node.api_clients.base_client] HTTP error occurred: 500 Server Error: Internal Server Error for url: http://127.0.0.1:52185/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&cursor=0x4f8865d1d82b3ad54b3b9dd7422bba01afab115c63ccc655701dcfb5d4e15387&pageSize=100&ascending=true. Response content: b'error in handleSelfStoreRequest: BAD_RESPONSE: archive error: DRIVER_ERROR: cursor not found'
2026-03-10 04:34:14.729 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:52125/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&cursor=0x4f8865d1d82b3ad54b3b9dd7422bba01afab115c63ccc655701dcfb5d4e15387&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:34:14.732 ERROR [src.node.api_clients.base_client] HTTP error occurred: 500 Server Error: Internal Server Error for url: http://127.0.0.1:52125/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&cursor=0x4f8865d1d82b3ad54b3b9dd7422bba01afab115c63ccc655701dcfb5d4e15387&pageSize=100&ascending=true. Response content: b'error in handleSelfStoreRequest: BAD_RESPONSE: archive error: DRIVER_ERROR: cursor not found'
2026-03-10 04:34:14.734 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-10 04:34:14.736 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-10 04:34:14.736 DEBUG [src.node.waku_node] Stopping container with id 5ac295fdc21e
2026-03-10 04:34:15.277 DEBUG [src.node.waku_node] Container stopped.
2026-03-10 04:34:15.277 DEBUG [src.node.waku_node] Stopping container with id 0ecaa34ee3dc
2026-03-10 04:34:15.828 DEBUG [src.node.waku_node] Container stopped.
2026-03-10 04:34:15.831 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-10 04:34:15.842 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-10 04:34:15.850 DEBUG [src.node.docker_mananger] No errors found in the waku logs.