1701 Commits

Author SHA1 Message Date
Ștefan Talpalaru
3a6a9f8135 generate Grafana dashboards for remote testnet nodes 2020-06-03 12:44:16 +03:00
Jacek Sieka
07393c8de6
Ssz cache (#1084)
* wip: cache

* cache lists and arrays of complex objects (5x block processing speed
on ncli_db)

trivial baseline cache that stores tree in flat memory structure

* support array of uint64

* work around type issues

* more type compiler bug workarounds

* cache balances, more type fixes

* index type

* ncli_db: add validation flag, better ux

* int64 fixes

* test fix

* "oops"

```
647.913,        0.000,      647.913,      647.913,            1,
Initialize DB
0.540,        0.402,        0.340,        9.451,          619,
Load block from database
40.268,        0.000,       40.268,       40.268,            1,
Load state from database
0.498,        0.150,        0.343,        0.930,          596,
Apply block
3.548,       11.005,        0.729,       54.022,           23,
Apply epoch block
```

* support all basic types

* cleanups

* a few more cleanups
2020-06-03 07:57:17 +02:00
tersec
b7bb62d48b
use shuffled validator cache in more places; cleanups (#1095) 2020-06-03 07:42:08 +02:00
39aac348b3
fix use of legacy get.status.im domain
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-06-02 22:32:07 +02:00
Jacek Sieka
1d9a58f1e8
a few more cleanups 2020-06-02 22:10:45 +02:00
kdeme
06f025b228 Add timeout to switch.connect 2020-06-02 23:06:11 +03:00
Jacek Sieka
7e881a4c09
cleanups 2020-06-02 17:17:07 +02:00
Jacek Sieka
872d7ff493
support all basic types 2020-06-02 11:44:51 +02:00
Jacek Sieka
00acf4f7b2
"oops"
```
647.913,        0.000,      647.913,      647.913,            1,
Initialize DB
0.540,        0.402,        0.340,        9.451,          619,
Load block from database
40.268,        0.000,       40.268,       40.268,            1,
Load state from database
0.498,        0.150,        0.343,        0.930,          596,
Apply block
3.548,       11.005,        0.729,       54.022,           23,
Apply epoch block
```
2020-06-01 22:37:26 +02:00
Dustin Brody
1a6b83a15f cleanups 2020-06-01 19:45:21 +00:00
Jacek Sieka
1fd2cfef62 ncli_db: add validation flag, better ux 2020-06-01 17:53:41 +00:00
Jacek Sieka
bcf90860b6
test fix 2020-06-01 18:01:46 +02:00
Jacek Sieka
405f460f9b
int64 fixes 2020-06-01 17:35:42 +02:00
Jacek Sieka
e692aa426f
ncli_db: add validation flag, better ux 2020-06-01 16:48:24 +02:00
Zahary Karadjov
ef90a45509
Bump testutils 2020-06-01 16:58:28 +03:00
Jacek Sieka
2316ac15c3
index type 2020-06-01 14:52:52 +02:00
Jacek Sieka
fec01829c4
cache balances, more type fixes 2020-06-01 14:52:52 +02:00
Jacek Sieka
be92842944
more type compiler bug workarounds 2020-06-01 14:52:52 +02:00
Jacek Sieka
a0b8b818f3
work around type issues 2020-06-01 14:52:52 +02:00
Jacek Sieka
4fc9a84c57
support array of uint64 2020-06-01 14:52:52 +02:00
Jacek Sieka
f1dcee2749
wip: cache
* cache lists and arrays of complex objects (5x block processing speed
on ncli_db)

trivial baseline cache that stores tree in flat memory structure
2020-06-01 14:52:50 +02:00
tersec
a327e8581b
switch state transition caching to match EpochRef (#1089)
* switch state transition caching usage to shuffled active validator indices to match EpochRef

* refactor the EpochRef -> StateCache transformation; elide pointless mapIt

* limit state passed between get_beacon_committee(...) and compute_committee(...)

* tweaks
2020-06-01 09:44:50 +02:00
Zahary Karadjov
0bcdabfcdf Detect another invalid SSZ input found through fuzzing
The first offset of an SSZ object should always have a fixed constant
value. Otherwise, some unused bytes may appear between the fixed portion
and the dynamic portion.

Please note that this fix shutds down the minimal forward compatibility
currently supported by the SSZ format (and thus, the expected behavior
must be clarified in the SSZ spec).
2020-05-30 14:47:35 +03:00
Zahary Karadjov
8d1fb2f3a6 Bump nim-eth to fix 'make witti' 2020-05-29 21:13:58 +03:00
Ștefan Talpalaru
a90b0dd197
Merge pull request #1077 from status-im/timeout
Eth2Node.stop(): trace msg on timeout
2020-05-29 16:30:13 +02:00
Zed
edfd3eb9ae Run tests 2020-05-29 16:38:55 +03:00
Zed
c570abf602 Check iv length for decryption 2020-05-29 16:38:55 +03:00
Zed
fd5478d550 Add more tests 2020-05-29 16:38:55 +03:00
Zed
80ce960afa Minor improvements 2020-05-29 16:38:55 +03:00
Zed
49c083d5b7 Catch all exceptions 2020-05-29 16:38:55 +03:00
Zed
14ad100b45 Address comments 2020-05-29 16:38:55 +03:00
Zed
8496e20a78 Implement EIP 2335 compliant keystore
Closes #1024
2020-05-29 16:38:55 +03:00
Kim De Mey
e33c8d9067
Bump nim-eth and accompanying discv5 cleanup (#1081) 2020-05-29 12:03:29 +02:00
tersec
b5f45db5e9
keep cache of per-epoch items in block pool (#1068)
* plumbing between block pool and state transition functions around active validator indices and committees

* have shared epochrefs followed by blockref tree while allowing for skipped slots

* factor out the epoch info extraction; document how the EpochRef follows forks
2020-05-29 08:10:20 +02:00
Ștefan Talpalaru
4b731b266d
bump vendor/nimbus-build-system 2020-05-29 00:18:47 +02:00
Jacek Sieka
061be037d1 ncli_db: database tool
includes a benchmark tool for now
2020-05-28 17:43:02 +00:00
Zahary Karadjov
0493737d7a Remove ssz.loadFile 2020-05-28 19:15:16 +03:00
Zahary Karadjov
1fd87a2255 Remove SszReader.maxObjectSize 2020-05-28 19:15:16 +03:00
Zahary Karadjov
d4fa2c8913 Avoid an unnecessary copy in readSszValue 2020-05-28 19:15:16 +03:00
Jacek Sieka
693bc15919 avoid some RVO bugs 2020-05-28 19:15:16 +03:00
Jacek Sieka
f53b55cbe0 SSZ cleanup
* be stricter about SSZ length prefix
* compute zeroHash list at compile time
* remove SSZ schema stuff
* move SSZ navigation to ncli
* cleanup a few leftover openArray uses
2020-05-28 19:15:16 +03:00
Mamy André-Ratsimbazafy
49c33f0890 Use v0.12 ready BLS curve 2020-05-28 15:09:56 +00:00
Viktor Kirilov
cefd525ab3 more work on the BN/VC split
- fixed comments from the last review
- getting more data VIA RPC, moved some code back into the BN only
- attestation duties being requested as well
2020-05-28 13:01:42 +03:00
Jacek Sieka
18eca263b1
avoid stack allocations in some tests (#1079) 2020-05-28 10:28:14 +02:00
Eugene Kabanov
21131e629b
Sync freeze fixes. (#1072)
* Add ability to reset state of sync manager.
Fix bug when sync got stuck on `zero-point` reset.
Fix bug when sync got stuck when some of the workers waiting for failing one.

* Remove debugging comments and imports.

* Remove not used pendingLock.
2020-05-28 07:02:28 +02:00
Dmitriy Ryajov
e238e8186c
bumping libp2p to latest master (#1075) 2020-05-28 06:38:07 +02:00
Ștefan Talpalaru
489565b5ab
Makefile: small testnet targets refactoring (#1078) 2020-05-28 06:28:10 +02:00
Ștefan Talpalaru
273a912ae0
Eth2Node.stop(): trace msg on timeout 2020-05-28 03:14:01 +02:00
Ștefan Talpalaru
c0daeb8432
Merge pull request #1076 from status-im/testnetmetrics
connect_to_testnet.nims: enable metrics [skip ci]
2020-05-27 22:42:57 +02:00
Ștefan Talpalaru
b0a7cb17eb
connect_to_testnet.nims: enable metrics [skip ci]
you still need to pass NIMFLAGS="-d:insecure" to Make
2020-05-27 22:35:40 +02:00