Commit Graph

75 Commits

Author SHA1 Message Date
Jordan Hrycaj c5bbf83114
Expose function for listing existing column families (#48)
* Expose function for listing existing column families

* Free CF list after use

* Update, fix error case

* Rename listRocksDbCFs -> listColumnFamilies

* Need to free each item separately

* Handle default option objects, close after use
2024-06-13 15:43:33 +00:00
web3-developer e36f454cd4
Add helper script to cleanup build artifacts. (#47) 2024-06-13 15:47:14 +08:00
web3-developer a84cf5b896
Build windows DLLs from vendor directory (#45)
* Add vcpkg as a submodule.

* Set vendor submodules to RocksDb version v9.1.0

* Update readme.
2024-06-12 21:16:06 +08:00
Jacek Sieka 138dadac9c
expose more options (#46) 2024-06-12 11:51:03 +02:00
Jacek Sieka e34c8e825c
use `MAKE` variable when available, which can set `-j` 2024-06-04 17:14:24 +02:00
Jacek Sieka 2879227085
expose additional configuration options (#43)
* caches
* table options
* spelling fixes
2024-06-04 12:06:14 +02:00
Jordan Hrycaj eb594e33b2
Add explicit seek position method to iterator (#42) 2024-04-16 16:54:55 +00:00
web3-developer f37d7d486c
Don't set default compression as it forces us to require the compression library when linking or at runtime. Let RocksBb pick the best default. (#41) 2024-03-30 00:26:12 +08:00
web3-developer 90027f1875
Support for static linking RocksDb. (#40)
* Added rocksdb as a submodule in vendor directory.

* Add support for static linking using nimble.

* Add script to build static library dependencies.

* Disable warnings as error in deps build.

* Set recommended compression options in build and in library.

* Move static linking into wrapper code.

* Conditionally set linker using when defined(macosx).

* Add support for linking windows static libraries.

* Build rocksdb static libs using vcpkg.

* Remove lib prefix from library names for windows.

* Static linking is not supported on windows. Update documentation and CI.
2024-03-27 14:18:21 +08:00
web3-developer fc2ba4a836
Update open procs to support adding the default column family if it is missing from the columnFamilies list. (#39) 2024-03-07 09:02:24 +08:00
web3-developer 5f6282e8d4
Rocksdb rewrite integration (#38)
* Column families support (#34)

* Update library to support column families. If not specified, uses the 'default' column family.

* Added tests for column family changes.

* Update library version and readme.

* Updated the librocksdb c library to the latest stable version.

* Started rewrite of library.

* Commit library rewrite progress.

* Completed initial rewrite and refactored tests.

* Completed implementation of backup engine.

* Added tests for new types.

* Completed tests for existing features.

* Remove features not supported by older versions of RocksDB to fix CI (temporary fix).

* Remove flush before backup support from BackupEngine to fix CI.

* Transactions support (#36)

* Update library to support column families. If not specified, uses the 'default' column family.

* Added tests for column family changes.

* Update library version and readme.

* Updated the librocksdb c library to the latest stable version.

* Started rewrite of library.

* Commit library rewrite progress.

* Completed initial rewrite and refactored tests.

* Completed implementation of backup engine.

* Added tests for new types.

* Completed tests for existing features.

* Remove features not supported by older versions of RocksDB to fix CI (temporary fix).

* Remove flush before backup support from BackupEngine to fix CI.

* Implemented RocksDB iterator.

* Implemented pairs iterator.

* Completed implementation of WriteBatch with tests.

* Fix example code.

* Completed implementation of TransactionDb.

* Support setting default column family.

* Remove unneeded usage of var for ref type parameters.

* Completed transactiondb tests.

* Improve and refactor rocksdb test.

* Added support for ingesting sst files using the SstFileWriter. (#37)

* Create ColFamilyReadOnly and ColFamilyReadWrite types for using a specific column family.

* Use inline pragma for small procs and add lock to RocksDbRef type close to prevent double free.

* Added documentation for the public API.

* Initial implementation of sst filewriter.

* Added tests for sstfilewriter.

* Documentation minor improvements.
2024-03-05 11:12:37 +08:00
andri lim 5e2b026f84
Fix broken CI (#35)
* Remove appveyor and travis scripts

* Fix broken CI

* Fix set pointer field to nil with typed nil

* Add liblz4 in CI deps of linux i386
2024-02-13 20:59:41 +07:00
Adam Spitz 724b72fe10
Made del return a bool, and added clear. (#33)
* Made del return a bool, and added clear.

What I've done here feels very awkward. Maybe I'm missing something,
but it looks to me like RocksDB doesn't support these operations in
any natural way.

These changes were made in order to get our implementation of
KvStoreRef for RocksDB working again after these changes to the
KvStoreRef interface:

8f0ae55353

I don't really recommend merging this; I think I'd prefer to just stop
trying to use this common KvStoreRef interface.

Still, if we do want to keep the common interface, I think this commit
will work well enough.

* Updated the tests to expect del to return a bool too.

* Leave the new `clear` operation unimplemented.
2023-01-17 11:37:10 -05:00
Jordan Hrycaj b7f0728225
Allow access to some details of the DB driver (#31)
why:
  Playing with SST direct import
2022-08-11 09:13:10 +01:00
Ștefan Talpalaru fb3f2c30b0
Windows static lib: link required system libs (#30) 2022-03-22 18:46:47 +01:00
Ștefan Talpalaru c381daf84f
allow statically linking librocksdb (#29) 2022-03-22 10:02:39 +01:00
Ștefan Talpalaru c565aa88b9
CI: use GitHub Actions (#28)
* CI: use GitHub Actions
2022-01-11 02:39:31 +01:00
Ștefan Talpalaru eddfa91bdd
version 0.3.1 2021-11-20 01:29:06 +01:00
Ștefan Talpalaru 6f55b371e2
Nim-1.6 fix (#27) 2021-11-20 01:19:21 +01:00
Ștefan Talpalaru 6aab1e0dd6
Merge pull request #25 from xyb/removeuglycast
remove ugly cast
2020-07-20 14:45:25 +02:00
Xie Yanbo 1717743ce7 remove ugly cast 2020-07-20 18:44:28 +08:00
andri lim 11d80282c1
Merge pull request #24 from xyb/csizet
fix csize_t issue for nim 1.2.x
2020-07-20 12:34:41 +07:00
Xie Yanbo 3a54ced19d fix csize_t issue for nim 1.2.x 2020-07-20 00:30:09 +08:00
Jacek Sieka e528ee949a
get with callback (#22)
* get with callback

avoids seq copy sometimes

* comment on defect exception safety
2020-04-23 20:55:21 +02:00
Jacek Sieka 8da2f11951
nim 1.2, port to results (#21) 2020-04-18 00:18:04 +02:00
Ștefan Talpalaru 08fec021c0
CI: update script path 2019-08-24 05:01:23 +02:00
kdeme 5b1307cb1f
Merge pull request #20 from status-im/max-open-files
Allow setting max open files in RocksDbInstance init
2019-07-16 21:12:30 +02:00
kdeme a48aaf2215
Allow setting max open files in RocksDbInstance init 2019-07-16 15:51:52 +02:00
Jacek Sieka 60faf6af17
std_shims -> stew 2019-07-07 12:11:27 +02:00
Ștefan Talpalaru 234c7d2756
Merge branch 'buildnim' 2019-06-18 18:31:15 +02:00
Ștefan Talpalaru 9d309f07d5
add .appveyor.yml; use build_nim.sh and build_rocksdb.sh 2019-06-18 17:27:18 +02:00
andri lim 22ab21a5ef add readonly option 2019-04-01 11:29:19 +03:00
Ștefan Talpalaru 2e858e6b9a
assert() -> doAssert() 2019-03-14 00:12:27 +01:00
Ștefan Talpalaru dce00a6ff8 don't allow failures on OSX 2019-01-20 11:45:52 +02:00
Ștefan Talpalaru 65493e8bac enable OSX for Travis 2019-01-20 11:45:52 +02:00
Ștefan Talpalaru d6018fac5c fix Travis tests on macOS 2019-01-20 11:45:52 +02:00
Ștefan Talpalaru 0860aee591 tests refactoring
- added "--threads:on"
- fixed the Nim API tests and moved them to unittest
- added copyright header
- combined the 2 test file into tests/all.nim and set that as the
  Nimble test target
- had Travis run that
- new "tempfile" dependency to create proper tempfiles + deleting them
  at the end
- copied the error string to RocksDBResult
2019-01-20 11:45:52 +02:00
Bruno Škvorc f8d6165bd5 License update to respect original repo (#16) 2019-01-03 14:04:11 +01:00
Bruno Škvorc d9c51b8051
Update README.md 2019-01-02 14:57:34 +01:00
Ștefan Talpalaru 3c0ab43e1e use dynamic linking instead of dlopen on all Linux distros
- also document the need for "librocksdb-dev" on Debian
2018-12-26 23:52:42 +02:00
Jacek Sieka d8cfc392bc
fix license files 2018-11-14 12:57:17 -06:00
Yuriy Glukhov e2433f0651 Use native linking on Arch linux. 2018-10-02 21:17:42 +03:00
Yuriy Glukhov 1edab645d9 Distinguish empty values from non existent 2018-09-07 16:30:36 +03:00
Jacek Sieka 68ac74e64f
readme: update license 2018-09-05 12:48:31 -06:00
Jacek Sieka 6e8871f4c7
readme: fix license, badges 2018-09-04 23:02:57 -06:00
Jacek Sieka c1e11e7f75
remove example from README - linked code is more recent 2018-08-16 13:13:34 -06:00
Yuriy Glukhov c84ff3309c
Merge pull request #9 from status-im/rocksdb-wrapper-fixes
Rocksdb wrapper fixes
2018-08-16 18:19:29 +03:00
Jacek Sieka e48a45bd44
reuse read and write options
* fixes segfault in del
* fixes initResource freeing options before they get used
* fixes failing test cases
* avoids reallocating options on every access
* deallocates fields in reverse creation order
2018-08-16 09:13:13 -06:00
Jacek Sieka e05b1a411d
remove partial ABI version again, turns out travis has 4.x installed! 2018-08-15 20:45:20 -06:00
Jacek Sieka 9a10f01a27
add more version info to linked library - this is better but still wrong 2018-08-15 20:33:38 -06:00