nim-codex/codex
Ben Bierens 9c8a59d150
Blockstore maintenance (#347)
* setting up

* Implements timer utility

* applies async and cancellation to timer loop

* Sets up mocktimer and mockblockstore to set up first maintenance module test

* wip: first test that calls blockChecker

* wip: adding user type to timer callback

* Chronicles doesn't like type-arguments? Disables logging in timer module for now

* Implementing block check test for blockMaintainer module

* Sets up additional tests for blockmaintainer

* Removes generic from timer module. Implements numberOfBlocks per interval in blockMaintainer.

* Implements blockMaintainer

* Sets up tests for blockChecker

* Some comments by Mark

* Cleanup repostore tests

* Setting up the use of std/times for block TTL tracking

* repostore adds expiration timestamp

* Defaults the repostore clock to the system clock

* Applies updates to repostore interface.

* Implements retrieving of block expiration information from repostore

* Sets up tests for maintenance module behavior

* Implements block maintenance module

* Wires maintenance module into codex. Sets up integration tests for block expiration

* Sets up test for missing behavior: removing timestamp metadata on block delete

* Implements removing of expiration metadata in repoStore

* Fixes integration tests for block expiration

* Adds block expiration tests to integration test run

* Handled some comments by Dmitriy

* Review comment by Dmitriy: Removes seq[cid] from runBlockCheck

* Review comment by Dmitriy: Moves key formatting methods to keyutils.

* Review comment by Dmitriy: Encodes durations using chronos

* Fixes conversion of TTL type in conf.

* Review comments by Dmitriy

* Adds unit tests for keyUtils.

* Adds test coverage for exception in maintenance module
2023-03-08 16:04:54 +01:00
..
blockexchange Repo limits (#319) 2022-12-02 18:00:55 -06:00
contracts [marketplace] Load sales state from chain (#306) 2023-03-08 14:34:26 +01:00
erasure Repo limits (#319) 2022-12-02 18:00:55 -06:00
manifest Repo limits (#319) 2022-12-02 18:00:55 -06:00
purchasing [marketplace] Load sales state from chain (#306) 2023-03-08 14:34:26 +01:00
rest Docker build (#354) 2023-03-08 12:45:55 +01:00
sales [marketplace] Load sales state from chain (#306) 2023-03-08 14:34:26 +01:00
storageproofs [marketplace] Load sales state from chain (#306) 2023-03-08 14:34:26 +01:00
stores Blockstore maintenance (#347) 2023-03-08 16:04:54 +01:00
streams Block download (#304) 2022-11-15 09:46:21 -06:00
utils Blockstore maintenance (#347) 2023-03-08 16:04:54 +01:00
blockexchange.nim Change every dagger to codex (#102) 2022-05-19 13:56:03 -06:00
blocktype.nim Repo limits (#319) 2022-12-02 18:00:55 -06:00
chunker.nim Block download (#304) 2022-11-15 09:46:21 -06:00
clock.nim Blockstore maintenance (#347) 2023-03-08 16:04:54 +01:00
codex.nim Blockstore maintenance (#347) 2023-03-08 16:04:54 +01:00
conf.nim Blockstore maintenance (#347) 2023-03-08 16:04:54 +01:00
contracts.nim [marketplace] support latest contracts changes (#327) 2023-01-19 16:58:04 +11:00
discovery.nim track latest nim-libp2p's master branch (#248) 2022-11-02 11:40:28 -06:00
erasure.nim Change every dagger to codex (#102) 2022-05-19 13:56:03 -06:00
errors.nim Change every dagger to codex (#102) 2022-05-19 13:56:03 -06:00
formats.nim Remove protobuf serialization (#289) 2022-10-27 07:41:34 -06:00
manifest.nim Change every dagger to codex (#102) 2022-05-19 13:56:03 -06:00
market.nim [marketplace] Load sales state from chain (#306) 2023-03-08 14:34:26 +01:00
namespaces.nim Repo limits (#319) 2022-12-02 18:00:55 -06:00
node.nim [marketplace] Load sales state from chain (#306) 2023-03-08 14:34:26 +01:00
proving.nim [marketplace] Load sales state from chain (#306) 2023-03-08 14:34:26 +01:00
purchasing.nim Load purchase state from chain (#283) 2022-11-08 08:10:17 +01:00
rng.nim track latest nim-libp2p's master branch (#248) 2022-11-02 11:40:28 -06:00
sales.nim [marketplace] Load sales state from chain (#306) 2023-03-08 14:34:26 +01:00
storageproofs.nim Upload authenticators (#108) 2022-05-25 20:29:31 -06:00
stores.nim Blockstore maintenance (#347) 2023-03-08 16:04:54 +01:00
streams.nim adding AsyncStreamWrapper (#110) 2022-06-14 09:19:35 -06:00
systemclock.nim Blockstore maintenance (#347) 2023-03-08 16:04:54 +01:00
utils.nim Download files without padding (#218) 2022-08-24 15:15:59 +03:00