85 lines
15 KiB
Plaintext

2026-03-09 04:37:08.777 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-09 04:37:08.777 DEBUG [tests.conftest] Running test: test_passing_cursor_of_non_existing_message_from_the_store with id: 2026-03-09_04-37-08__795a852d-c085-47e0-baa4-1084edad91a6
2026-03-09 04:37:08.778 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-09 04:37:08.778 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-09 04:37:08.778 DEBUG [src.steps.store] Running fixture setup: node_setup
2026-03-09 04:37:08.785 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-09 04:37:08.785 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/publishing_node1_2026-03-09_04-37-08__795a852d-c085-47e0-baa4-1084edad91a6__wakuorg_nwaku:latest.log
2026-03-09 04:37:08.786 DEBUG [src.node.waku_node] Starting Node...
2026-03-09 04:37:08.786 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-09 04:37:08.787 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-09 04:37:08.788 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.244.229
2026-03-09 04:37:08.788 DEBUG [src.node.docker_mananger] Generated ports ['7634', '7635', '7636', '7637', '7638']
2026-03-09 04:37:08.788 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-09 04:37:08.788 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-09 04:37:08.788 DEBUG [src.node.waku_node] Using volumes []
2026-03-09 04:37:08.788 DEBUG [src.node.docker_mananger] docker run -i -t -p 7634:7634 -p 7635:7635 -p 7636:7636 -p 7637:7637 -p 7638:7638 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=7636 --rest-port=7634 --tcp-port=7635 --discv5-udp-port=7637 --rest-address=0.0.0.0 --nat=extip:172.18.244.229 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=add4a68d3e5caea22b9b71dccbde5dff30f594db5ca54bf5ff4219ea5aa2fbe7 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=7638 --metrics-logging=true --store=true --relay=true
2026-03-09 04:37:08.985 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.244.229 waku 45f23618a7d52692c2ea393d7a69f25ca8630adf5d819336e61bb71fff87e8a8
2026-03-09 04:37:09.028 DEBUG [src.node.docker_mananger] Container started with ID 45f23618a7d5. Setting up logs at ./log/docker/publishing_node1_2026-03-09_04-37-08__795a852d-c085-47e0-baa4-1084edad91a6__wakuorg_nwaku:latest.log
2026-03-09 04:37:09.028 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 7634
2026-03-09 04:37:09.029 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-09 04:37:09.044 ERROR [src.node.docker_mananger] Max retries reached for container 49dc7a02ae57. Exiting log stream.
2026-03-09 04:37:09.554 ERROR [src.node.docker_mananger] Max retries reached for container 90247a324c9b. Exiting log stream.
2026-03-09 04:37:10.029 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:7634/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:37:10.032 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-09 04:37:10.033 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-09 04:37:10.033 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:7634/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:37:10.035 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.244.229/tcp/7635/p2p/16Uiu2HAm9DT9TnNgM1BJmxCUPhkuF8mKob9hwRFo6SeWtR24B7zH","/ip4/172.18.244.229/tcp/7636/ws/p2p/16Uiu2HAm9DT9TnNgM1BJmxCUPhkuF8mKob9hwRFo6SeWtR24B7zH"],"enrUri":"enr:-L24QCDHtx750Z0Si31amW6PtMQWOQhH1i5kIOH5dMzjfhmFB3UqB6v8GFR9yA6fM_ENb7Bg3S1T08LCrugRYy1UGW4CgmlkgnY0gmlwhKwS9OWKbXVsdGlhZGRyc5YACASsEvTlBh3TAAoErBL05QYd1N0DgnJzhQADAQAAiXNlY3AyNTZrMaECzOIi-OfB6EravC2XA0RwCkOwnEzvFIT5fCTP-NmyNrKDdGNwgh3Tg3VkcIId1YV3YWt1MgM"}'
2026-03-09 04:37:10.036 INFO [src.node.waku_node] REST service is ready !!
2026-03-09 04:37:10.043 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-09 04:37:10.043 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/store_node1_2026-03-09_04-37-08__795a852d-c085-47e0-baa4-1084edad91a6__wakuorg_nwaku:latest.log
2026-03-09 04:37:10.043 DEBUG [src.node.waku_node] Starting Node...
2026-03-09 04:37:10.043 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-09 04:37:10.045 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-09 04:37:10.045 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.183.75
2026-03-09 04:37:10.045 DEBUG [src.node.docker_mananger] Generated ports ['19627', '19628', '19629', '19630', '19631']
2026-03-09 04:37:10.045 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-09 04:37:10.046 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-09 04:37:10.046 DEBUG [src.node.waku_node] Using volumes []
2026-03-09 04:37:10.046 DEBUG [src.node.docker_mananger] docker run -i -t -p 19627:19627 -p 19628:19628 -p 19629:19629 -p 19630:19630 -p 19631:19631 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=19629 --rest-port=19627 --tcp-port=19628 --discv5-udp-port=19630 --rest-address=0.0.0.0 --nat=extip:172.18.183.75 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=8fdda6b2ed20d6c0a22daee5d2a4bae058af8a4906d6f85bd4e55f57fecf4041 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=19631 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QCDHtx750Z0Si31amW6PtMQWOQhH1i5kIOH5dMzjfhmFB3UqB6v8GFR9yA6fM_ENb7Bg3S1T08LCrugRYy1UGW4CgmlkgnY0gmlwhKwS9OWKbXVsdGlhZGRyc5YACASsEvTlBh3TAAoErBL05QYd1N0DgnJzhQADAQAAiXNlY3AyNTZrMaECzOIi-OfB6EravC2XA0RwCkOwnEzvFIT5fCTP-NmyNrKDdGNwgh3Tg3VkcIId1YV3YWt1MgM --storenode=/ip4/172.18.244.229/tcp/7635/p2p/16Uiu2HAm9DT9TnNgM1BJmxCUPhkuF8mKob9hwRFo6SeWtR24B7zH --store=true --relay=true
2026-03-09 04:37:10.244 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.183.75 waku b91216c517d6bd22d7b51959535a9d532e549f9afcff96322a51fa3f423a2bcb
2026-03-09 04:37:10.280 DEBUG [src.node.docker_mananger] Container started with ID b91216c517d6. Setting up logs at ./log/docker/store_node1_2026-03-09_04-37-08__795a852d-c085-47e0-baa4-1084edad91a6__wakuorg_nwaku:latest.log
2026-03-09 04:37:10.281 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 19627
2026-03-09 04:37:10.282 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-09 04:37:11.282 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19627/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:37:11.285 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-09 04:37:11.285 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-09 04:37:11.286 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19627/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:37:11.288 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.183.75/tcp/19628/p2p/16Uiu2HAmTcARixizQ4kNmAoJ77dracpzFVbbLiKMHDuJFbpCvsmj","/ip4/172.18.183.75/tcp/19629/ws/p2p/16Uiu2HAmTcARixizQ4kNmAoJ77dracpzFVbbLiKMHDuJFbpCvsmj"],"enrUri":"enr:-L24QOGgWKCIBz7PuVydQ7PzL3g1PM-5OYB_IHuUUKkM9ip2BL9C5KymeRkuLuDAauwgUZy7IKGBLSuGwD0wgXdgItUCgmlkgnY0gmlwhKwSt0uKbXVsdGlhZGRyc5YACASsErdLBkysAAoErBK3SwZMrd0DgnJzhQADAQAAiXNlY3AyNTZrMaED3iX0d8Csi2lxSYPaRlMcHnDOGX1JDSRH78QWcyKg_gKDdGNwgkysg3VkcIJMroV3YWt1MgM"}'
2026-03-09 04:37:11.288 INFO [src.node.waku_node] REST service is ready !!
2026-03-09 04:37:11.288 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:19627/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.244.229/tcp/7635/p2p/16Uiu2HAm9DT9TnNgM1BJmxCUPhkuF8mKob9hwRFo6SeWtR24B7zH"]'
2026-03-09 04:37:11.291 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-09 04:37:11.292 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:7634/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-09 04:37:11.294 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-09 04:37:11.295 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:19627/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-09 04:37:11.297 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-09 04:37:11.298 DEBUG [src.steps.store] Relaying message
2026-03-09 04:37:11.298 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:7634/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "TWVzc2FnZV8w", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-09 04:37:11.304 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-09 04:37:11.304 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-09 04:37:11.505 DEBUG [src.steps.store] Relaying message
2026-03-09 04:37:11.505 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:7634/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "TWVzc2FnZV8x", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-09 04:37:11.511 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-09 04:37:11.511 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-09 04:37:11.712 DEBUG [src.steps.store] Relaying message
2026-03-09 04:37:11.712 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:7634/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "TWVzc2FnZV8y", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-09 04:37:11.718 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-09 04:37:11.718 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-09 04:37:11.919 DEBUG [src.steps.store] Relaying message
2026-03-09 04:37:11.919 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:7634/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "TWVzc2FnZV8z", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-09 04:37:11.925 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-09 04:37:11.926 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-09 04:37:12.127 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:7634/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&cursor=0x5318901bc09fe186acccdeb9275427b6ccfddff53df343b076f749ee8e4efaea&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:37:12.130 ERROR [src.node.api_clients.base_client] HTTP error occurred: 500 Server Error: Internal Server Error for url: http://127.0.0.1:7634/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&cursor=0x5318901bc09fe186acccdeb9275427b6ccfddff53df343b076f749ee8e4efaea&pageSize=100&ascending=true. Response content: b'error in handleSelfStoreRequest: BAD_RESPONSE: archive error: DRIVER_ERROR: cursor not found'
2026-03-09 04:37:12.131 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19627/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&cursor=0x5318901bc09fe186acccdeb9275427b6ccfddff53df343b076f749ee8e4efaea&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:37:12.134 ERROR [src.node.api_clients.base_client] HTTP error occurred: 500 Server Error: Internal Server Error for url: http://127.0.0.1:19627/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&cursor=0x5318901bc09fe186acccdeb9275427b6ccfddff53df343b076f749ee8e4efaea&pageSize=100&ascending=true. Response content: b'error in handleSelfStoreRequest: BAD_RESPONSE: archive error: DRIVER_ERROR: cursor not found'
2026-03-09 04:37:12.136 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-09 04:37:12.137 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-09 04:37:12.137 DEBUG [src.node.waku_node] Stopping container with id 45f23618a7d5
2026-03-09 04:37:12.750 DEBUG [src.node.waku_node] Container stopped.
2026-03-09 04:37:12.750 DEBUG [src.node.waku_node] Stopping container with id b91216c517d6
2026-03-09 04:37:13.309 DEBUG [src.node.waku_node] Container stopped.
2026-03-09 04:37:13.312 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-09 04:37:13.324 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-09 04:37:13.330 DEBUG [src.node.docker_mananger] No errors found in the waku logs.