2018-05-27 19:13:55 +00:00
# Nimbus: an Ethereum 2.0 Sharding Client for Resource-Restricted Devices
2018-02-06 19:20:06 +00:00
2018-12-27 14:32:35 +00:00
[![Windows build status (Appveyor) ](https://img.shields.io/appveyor/ci/nimbus/nimbus/master.svg?label=Windows "Windows build status (Appveyor )")](https://ci.appveyor.com/project/nimbus/nimbus)
2018-04-06 14:52:10 +00:00
[![Build Status (Travis) ](https://img.shields.io/travis/status-im/nimbus/master.svg?label=Linux%20/%20macOS "Linux/macOS build status (Travis )")](https://travis-ci.org/status-im/nimbus)
2018-09-05 03:03:10 +00:00
[![License: Apache ](https://img.shields.io/badge/License-Apache%202.0-blue.svg )](https://opensource.org/licenses/Apache-2.0)
2018-04-06 14:52:10 +00:00
[![License: MIT ](https://img.shields.io/badge/License-MIT-blue.svg )](https://opensource.org/licenses/MIT)
![Stability: experimental ](https://img.shields.io/badge/stability-experimental-orange.svg )
2018-02-07 16:50:28 +00:00
2018-03-17 08:39:13 +00:00
Join the Status community chats:
2018-08-31 22:23:51 +00:00
[![Gitter: #status-im/nimbus ](https://img.shields.io/badge/gitter-status--im%2Fnimbus-orange.svg )](https://gitter.im/status-im/nimbus)
2018-03-17 08:39:13 +00:00
[![Riot: #nimbus ](https://img.shields.io/badge/riot-%23nimbus%3Astatus.im-orange.svg )](https://chat.status.im/#/room/#nimbus:status.im)
2018-09-05 03:01:33 +00:00
[![Riot: #dev-status ](https://img.shields.io/badge/riot-%23dev--status%3Astatus.im-orange.svg )](https://chat.status.im/#/room/#dev-status:status.im)
2018-03-17 08:39:13 +00:00
2018-05-17 04:51:17 +00:00
## Rationale
2019-01-23 12:59:26 +00:00
2018-11-22 13:00:24 +00:00
[Nimbus: an Ethereum 2.0 Sharding Client ](https://our.status.im/nimbus-for-newbies/ ). The code in this repository is currently focusing on Ethereum 1.0 feature parity, while all 2.0 research and development is happening in parallel in [nim-beacon-chain ](https://github.com/status-im/nim-beacon-chain ). The two repositories are expected to merge in Q1 2019.
2018-04-06 14:52:10 +00:00
2018-12-27 14:32:35 +00:00
## Development Updates
To keep up to date with changes and development progress, follow the [Nimbus blog ](https://our.status.im/tag/nimbus/ ).
2018-06-19 19:19:07 +00:00
## Building & Testing
2019-03-29 23:54:36 +00:00
_We currently do not guarantee that Nimbus will work on Windows._
2018-06-24 14:34:32 +00:00
### Prerequisites
2019-03-14 20:33:06 +00:00
#### Rocksdb
2018-12-24 16:03:27 +00:00
2019-03-14 20:33:06 +00:00
A recent version of Facebook's [RocksDB ](https://github.com/facebook/rocksdb/ ) is needed - it can usually be installed using a package manager of your choice:
```bash
# MacOS
brew install rocksdb
# Fedora
dnf install rocksdb-devel
2019-03-14 20:54:27 +00:00
# Debian and Ubuntu
sudo apt-get install librocksdb-dev
2019-03-25 14:32:29 +00:00
# Arch (AUR)
pakku -S rocksdb
2019-03-14 20:33:06 +00:00
```
On Windows, you can [download pre-compiled DLLs ](#windows ).
2019-03-29 23:54:36 +00:00
You can also build and install it by following [their instructions ](https://github.com/facebook/rocksdb/blob/master/INSTALL.md ).
2019-03-14 20:33:06 +00:00
#### Developer tools
GNU make, Bash and the usual POSIX utilities
2018-06-19 19:19:07 +00:00
2018-09-24 22:25:17 +00:00
#### Obtaining the prerequisites through the Nix package manager
2018-06-24 14:34:32 +00:00
2019-03-14 20:33:06 +00:00
*Experimental*
2018-06-24 14:34:32 +00:00
Users of the [Nix package manager ](https://nixos.org/nix/download.html ) can install all prerequisites simply by running:
``` bash
2019-03-11 22:03:29 +00:00
nix-shell default.nix
2018-06-24 14:34:32 +00:00
```
2018-12-24 16:03:27 +00:00
### Build & Develop
2018-06-24 14:34:32 +00:00
2018-12-24 16:03:27 +00:00
#### POSIX-compatible OS
2018-06-19 19:19:07 +00:00
2018-12-24 16:03:27 +00:00
To build Nimbus (in "build/nimbus"), just execute:
2018-09-24 22:25:17 +00:00
2018-08-31 22:23:51 +00:00
```bash
2018-12-24 16:03:27 +00:00
make
2018-08-31 22:23:51 +00:00
```
2018-07-20 20:02:52 +00:00
2018-12-24 16:03:27 +00:00
Running `./build/nimbus --help` will provide you with a list of
the available command-line options. To start syncing with mainnet, just execute `./build/nimbus`
2018-09-24 22:25:17 +00:00
without any parameters.
2018-07-20 20:02:52 +00:00
2018-09-24 22:25:17 +00:00
To execute all tests:
2018-08-31 22:23:51 +00:00
```bash
2018-12-24 16:03:27 +00:00
make test
```
To pull the latest changes in all the Git repositories involved:
```bash
2019-02-12 15:06:00 +00:00
git pull
2018-12-24 16:03:27 +00:00
make update
```
To run a command that might use binaries from the Status Nim fork:
```bash
2019-03-14 20:33:06 +00:00
./env.sh bash
which nim
2018-08-31 22:23:51 +00:00
```
2018-07-20 20:02:52 +00:00
2018-09-24 22:25:17 +00:00
Our Wiki provides additional helpful information for [debugging individual test cases][1]
and for [pairing Nimbus with a locally running copy of Geth][2].
2018-12-24 16:03:27 +00:00
#### Windows
2018-07-20 20:02:52 +00:00
2019-03-29 23:54:36 +00:00
_Experimental support!_
2018-12-24 16:03:27 +00:00
Install Mingw-w64 for your architecture using the "[MinGW-W64 Online
Installer](https://sourceforge.net/projects/mingw-w64/files/)" (first link
under the directory listing). Run it and select your architecture in the setup
menu ("i686" on 32-bit, "x86\_64" on 64-bit), set the threads to "win32" and
the exceptions to "dwarf" on 32-bit and "seh" on 64-bit. Change the
installation directory to "C:\mingw-w64" and add it to your system PATH in "My
Computer"/"This PC" -> Properties -> Advanced system settings -> Environment
Variables -> Path -> Edit -> New -> C:\mingw-w64\mingw64\bin (it's "C:\mingw-w64\mingw32\bin" on 32-bit)
2018-12-27 14:32:35 +00:00
2018-12-24 16:03:27 +00:00
Install [Git for Windows ](https://gitforwindows.org/ ) and use a "Git Bash" shell to clone and build Nimbus.
If you don't want to compile RocksDB and SQLite separately, you can fetch pre-compiled DLLs with:
2018-12-27 14:32:35 +00:00
```bash
2018-12-24 16:03:27 +00:00
mingw32-make fetch-dlls
2018-12-27 14:32:35 +00:00
```
2018-12-24 16:03:27 +00:00
This will place the right DLLs for your architecture in the "build/" directory.
You can now follow those instructions in the previous section by replacing `make` with `mingw32-make` (regardless of your 32-bit or 64-bit architecture).
2018-12-27 14:32:35 +00:00
2019-01-06 22:06:26 +00:00
### Development tips
- you can switch the DB backend with a Nim compiler define:
`-d:nimbus_db_backend=...` where the (case-insensitive) value is one of
2019-01-23 12:59:26 +00:00
"rocksdb" (the default), "sqlite", "lmdb"
- the Premix debugging tools are [documented separately ](premix/readme.md )
2019-01-06 22:06:26 +00:00
2019-03-29 17:08:39 +00:00
- you can control the Makefile's verbosity with the V variable (defaults to 0):
2019-02-16 21:23:17 +00:00
```bash
2019-03-29 17:08:39 +00:00
make V=1 # verbose
make V=2 test # even more verbose
2019-02-16 21:23:17 +00:00
```
2019-03-11 19:45:46 +00:00
- same for the [Chronicles log level ](https://github.com/status-im/nim-chronicles#chronicles_log_level ):
```bash
make LOG_LEVEL=DEBUG nimbus # this is the default
make LOG_LEVEL=TRACE nimbus # log everything
```
2019-03-12 11:09:33 +00:00
- pass arbitrary parameters to the Nim compiler:
```bash
2019-03-17 00:54:30 +00:00
make NIMFLAGS="-d:release"
2019-03-12 11:09:33 +00:00
```
2019-02-21 22:46:28 +00:00
- if you want to use SSH keys with GitHub:
```bash
make github-ssh
```
2019-02-12 15:06:00 +00:00
#### Git submodule workflow
Working on a dependency:
```bash
cd vendor/nim-chronicles
git checkout -b mybranch
# make some changes
git status
git commit -a
git push origin mybranch
# create a GitHub PR and wait for it to be approved and merged
git checkout master
git pull
git branch -d mybranch
# realise that the merge was done without "--no-ff"
git branch -D mybranch
# update the submodule's commit in the superproject
cd ../..
git status
git add vendor/nim-chronicles
git commit
```
It's important that you only update the submodule commit after it's available upstream.
You might want to do this on a new branch of the superproject, so you can make
a GitHub PR for it and see the CI test results.
Don't update all Git submodules at once, just because you found the relevant
Git command or `make` target. You risk updating submodules to other people's
latest commits when they are not ready to be used in the superproject.
Adding the submodule "https://github.com/status-im/foo" to "vendor/foo":
```bash
./add_submodule.sh status-im/foo
```
Removing the submodule "vendor/bar":
```bash
git submodule deinit -f -- vendor/bar
git rm -f vendor/bar
```
Checking out older commits, either to bisect something or to reproduce an older build:
```bash
git checkout < commit hash here >
2019-03-12 14:48:39 +00:00
make clean
make -j8 update
2019-02-12 15:06:00 +00:00
```
2019-02-15 02:11:20 +00:00
Running a dependency's test suite using `nim` instead of `nimble` (which cannot be
convinced not to run a dependency check, thus clashing with our jury-rigged
"vendor/.nimble/pkgs"):
```bash
cd vendor/nim-blscurve
../../nimble.sh test
```
2018-12-24 16:03:27 +00:00
### Troubleshooting
Report any errors you encounter, please, if not [already documented ](https://github.com/status-im/nimbus/issues )!
* Turn it off and on again:
2019-03-29 15:18:33 +00:00
2018-12-24 16:03:27 +00:00
```bash
2019-03-12 14:48:39 +00:00
make clean
make update
2018-12-24 16:03:27 +00:00
```
2018-04-06 14:52:10 +00:00
## License
2018-12-27 14:32:35 +00:00
Licensed and distributed under either of
* MIT license: [LICENSE-MIT ](LICENSE-MIT ) or http://opensource.org/licenses/MIT
or
2019-01-02 13:50:44 +00:00
* Apache License, Version 2.0, ([LICENSE-APACHEv2](LICENSE-APACHEv2) or http://www.apache.org/licenses/LICENSE-2.0)
2018-04-06 14:52:10 +00:00
2019-01-23 12:59:26 +00:00
at your option. These files may not be copied, modified, or distributed except according to those terms.
2018-12-24 16:03:27 +00:00
[1]: https://github.com/status-im/nimbus/wiki/Understanding-and-debugging-Nimbus-EVM-JSON-tests
[2]: https://github.com/status-im/nimbus/wiki/Debugging-state-reconstruction