Eugene Kabanov
293d990d43
Fix PeerPool issue with peers overflow maxPeers setting. ( #1285 )
2020-07-07 11:49:08 +02:00
Zahary Karadjov
441ae9b58c
Introduce a RuntimePreset object for the overridable testnet preset values
2020-07-03 22:29:23 +03:00
tersec
a92276d510
adopt Result[void, string] in place of some bool return signatures ( #1275 )
...
* adopt Result[void, string] in place of some bool return signatures
* string -> cstring to reduce memory allocations; ensure all err() strings are constants, with contextual information from higher-level callers
* logScope usage fixes
* homogenize err() reporting convention
* invalid signature in deposit isn't an error
2020-07-03 17:03:14 +00:00
tersec
c64737e7f2
implement aggregated attestation receiving/validating ( #1272 )
...
* implement aggregated attestation receiving/validating
* document the conditions without explicit implementations in isValidAggregatedAttestation()
2020-07-02 16:15:27 +00:00
Zahary Karadjov
98761afc64
Run beacon_node --network=altona without initial Eth1 syncing
2020-07-02 18:52:48 +03:00
Zahary Karadjov
e342b96d2e
Embed the Altona metadata in the NBC executable
2020-07-02 18:14:11 +03:00
cheatfate
76c12d493e
Add check for late attestation sent messages in logtrace tool.
2020-07-02 10:36:04 +03:00
Zahary Karadjov
26b7202af3
Fix #1266
2020-07-01 22:01:50 +03:00
Jacek Sieka
f3e92762e3
add tests for unviable blocks ( #1271 )
...
* add tests for unviable blocks
also enable finalization tests in all test configs - they're plenty fast
now
also fix newClone for non-rvo cases. sigh.
* fixes
2020-07-01 19:00:14 +02:00
Jacek Sieka
66c230ffd1
check that parent of added block is sufficiently recent ( #1269 )
...
Otherwise, we might introduce a fork into the DAG that is no longer
viable, creating trouble for both sync and fork choice
2020-07-01 17:21:21 +02:00
Jacek Sieka
ef2f037571
bump libp2p ( #1267 )
2020-07-01 13:41:40 +02:00
Zahary Karadjov
c19321e578
Fix the 'maxDelay' FieldError problem during the initial deposit making when joining a testnet
2020-07-01 12:13:56 +03:00
tersec
fe20c36ba5
switch several beacon_node procs to funcs ( #1262 )
...
* switch several beacon_node procs to funcs
2020-06-30 13:53:57 +00:00
Jacek Sieka
e898525b16
More version in --version and less version in --help ( #1260 )
...
Long version and copyright banners is probably not what the user is
after when typing `--help`
2020-06-30 14:23:52 +02:00
tersec
d09e9f1aaf
remove non-snappy support from inspector; switch some procs to funcs ( #1261 )
...
* remove non-snappy support from inspector; switch some procs to funcs
* use mapIt instead of explicit for loop
2020-06-30 11:17:49 +02:00
tersec
b4db2ad693
remove v0.11.3 support; add block_sim to CI ( #1253 )
...
* remove v0.11.3 support; add block_sim to CI
* rm stray PERSISTENT_COMMITTEE_PERIOD
* remove TopicFilter.InteropAttestations
* bump two comment-spec-refs to v0.12.1
2020-06-29 18:08:58 +00:00
Zahary Karadjov
302cef5e90
Attach all local validators before starting the networking
2020-06-29 18:07:41 +03:00
Mamy Ratsimbazafy
510e8110ff
typo
2020-06-29 15:00:16 +02:00
Jacek Sieka
61fc535f8c
print networking info on startup
2020-06-29 14:01:18 +02:00
Jacek Sieka
047f354e9b
Don't wait for genesis to start network ( #1249 )
2020-06-29 07:34:48 +02:00
Zahary Karadjov
8140b4458c
Working local sim with WAIT_GENESIS=yes
2020-06-29 02:18:48 +03:00
Zahary Karadjov
9cd8a6c730
Working local sim (without waiting genesis)
2020-06-29 02:18:48 +03:00
Zahary Karadjov
96ac81c89f
Better UX; Don't delete testnet data folders
2020-06-29 02:18:48 +03:00
Zahary Karadjov
b9e653f7fd
Working genesis detection for Altona
2020-06-29 02:18:48 +03:00
Zahary Karadjov
31e31bb30c
Switch to monitoring of Blocks; More accurate genesis detection and faster Eth1 syncing
2020-06-29 02:18:48 +03:00
Jacek Sieka
816779733e
use the eth2 message id for gossip (in logging too) ( #1246 )
...
* use the eth2 message id for gossip (in logging too)
* bump
* add spec link
2020-06-28 22:06:50 +02:00
Jacek Sieka
ea57852359
count attestations from blocks while syncing ( #1244 )
...
* count attestations from blocks while syncing
* check for resolved old attestations
2020-06-28 19:32:11 +02:00
Jacek Sieka
eeccaaf16d
stop gossipping non-snappy ( #1240 )
...
* stop gossipping non-snappy
Also simplify subscription and actually handle decoding errors
* log weird states too
2020-06-27 12:16:43 +02:00
Mamy Ratsimbazafy
fc3a18039d
typos
2020-06-26 15:51:20 +02:00
Mamy Ratsimbazafy
9b05581695
typo
2020-06-26 14:36:21 +02:00
Zahary Karadjov
322a12fed7
Fix the Eth1 deposit contract monitoring on Witti
2020-06-26 02:33:39 +03:00
zah
578ea2013a
implement spev v0.12.1 in initialize_beacon_state_from_eth1 ( #1236 )
2020-06-25 16:24:55 +02:00
tersec
fe15d473c9
effectively revert withEpochState ( #1235 )
2020-06-25 14:14:41 +02:00
Jacek Sieka
1301600341
Trusted blocks ( #1227 )
...
* cleanups
* fix ncli state root check flag
* add block dump to ncli_db
* limit ncli_db benchmark length
* tone down finalization logs
* introduce trusted blocks
We only store blocks whose signature we've verified in the database - as
such, there's no need to check it again, and most importantly, no need
to deserialize the signature when loading from database.
50x startup time improvement, 200x block load time improvement.
* fix rewinding when deposits have invalid signature
* speed up ancestor iteration by avoiding copy
* avoid deserializing signatures for trusted data
* load blocks lazily when rewinding (less memory used)
* chronicles workarounds
* document trustedbeaconblock
2020-06-25 12:23:10 +02:00
Mamy Ratsimbazafy
902093f57c
Revert "Dual headed fork choice [Reloaded] ( #1223 )" ( #1234 )
...
This reverts commit 6836d41ebd
.
2020-06-25 11:36:03 +02:00
Zahary Karadjov
62e4efe34b
Re-wire the sending of deposits by the 'deposits create' command
2020-06-24 23:06:05 +03:00
Zahary Karadjov
384e512031
Implement EIP-2386 wallets; Progress towards a CLI for interactive wallet creation
...
For more information:
4494da0966/EIPS/eip-2386.md (specification)
2020-06-24 23:06:05 +03:00
Mamy Ratsimbazafy
6836d41ebd
Dual headed fork choice [Reloaded] ( #1223 )
...
* Dual headed fork choice
* fix finalizedEpoch not moving
* reduce fork choice verbosity
* Add failing tests due to pruning
* Properly handle duplicate blocks in sync
* test_block_pool also add a test for duplicate blocks
* comments addressing review
2020-06-24 20:24:36 +02:00
Zahary Karadjov
f20f077827
Introduce some short-cuts in the Eth1 monitoring for faster syncing
2020-06-24 19:22:52 +03:00
Ștefan Talpalaru
bdd56b626f
Merge pull request #1206 from status-im/readme
...
Update readme and manual
2020-06-24 01:04:25 +02:00
tersec
1b3c19dc21
default to v0.12.1 beacon chain spec, keeping witti working ( #1222 )
...
* default to v0.12.1 beacon chain spec, keeping witti working
* a couple of fixes that help for the Onyx testnet
2020-06-23 19:40:44 +00:00
tersec
807b920c19
state_transition implements the spec fairly directly ( #1220 )
2020-06-23 13:54:24 +00:00
tersec
a683656238
send and validate with v0.12.1 attestations ( #1213 )
...
* send and validate with v0.12.1 attestations
* use EpochRef instead of empty cache in attestation validation
2020-06-23 10:38:59 +00:00
Eugene Kabanov
f60235b3e9
Attestation validator now populates list of missing blocks. ( #1211 )
2020-06-23 11:29:08 +02:00
Jacek Sieka
1d709c09f4
secp: requiresInit ( #1210 )
...
* secp: requiresInit
* bump
2020-06-22 21:40:19 +02:00
Zahary Karadjov
a2e28bef27
Further removal of enum support; Bump modules
2020-06-22 20:14:14 +03:00
Zahary Karadjov
7211a99086
Smooth out the differences between Ganache and Infura; Working local sim and Altona target
2020-06-22 17:30:04 +03:00
Zahary Karadjov
14274587cf
More user-friendly logging during mainchain monitoring
2020-06-22 17:30:04 +03:00
Zahary Karadjov
1def383ad1
Reword the Tmux setup to handle all simulation scenarios in more visible way
2020-06-22 17:30:04 +03:00
Zahary Karadjov
e9d68e2f7b
Add simulation mode that bootstraps from an Eth1 ganache instance
2020-06-22 17:30:04 +03:00
Dustin Brody
62a7e7fede
fix is_valid_indexed_attestation() to check for too-high attestation indices
2020-06-22 14:15:51 +00:00
Eugene Kabanov
47eaaa7696
Fix connection workers race. ( #1204 )
2020-06-21 18:49:48 +02:00
Jacek Sieka
a661ecbae1
bump libp2p ( #1209 )
2020-06-21 18:45:28 +02:00
Jacek Sieka
7e0e4dc327
don't crash on unknown disconnection reason, fix disconnection reason enum ( #1208 )
2020-06-20 09:24:33 +02:00
tersec
7b4e129316
re-add minimal constant checking; organize presets by spec version ( #1203 )
...
* re-add minimal preset constant checking; organize presets to better support multiple spec versions
* bump spec ref
* increase Azure timeout to 90 minutes to accomodate Nim compiler building
2020-06-20 09:12:45 +02:00
李婷婷
fd35b61ecb
fix typo
2020-06-19 23:00:18 +08:00
Dustin Brody
4ecbc655ea
switch 11 beaconstate.nim spec refs from v0.11.x to v0.12.1
2020-06-19 11:54:37 +00:00
Viktor Kirilov
72dfe7f578
- updated the validator shell script after the keystore changes
...
- better logging & retrying requests on the VC side if the BN fails for some reason
- VC now fetches the attestation duties 1 epoch in advance - in the future it will tell the BN to subscribe to the appropriate attestation topics in advance based on that info
- a bunch of other code cleanup & fixes such as better naming for consoles when using multitail, etc.
reviewed in PR #1184 - proper review of the API & VC are pending
2020-06-19 12:21:22 +03:00
tersec
dc1a565b3f
support v0.12.1 attestation topics in beacon node/inspector subscribing ( #1187 )
...
* support v0.12.1 attestation topics in beacon node and inspector subscribing
* bump is_valid_merkle_branch() spec ref
2020-06-18 15:10:25 +02:00
Eugene Kabanov
4436c85ff7
Forward sync refactoring. ( #1191 )
...
* Forward sync refactoring.
Rename Quarantine.pending to Quarantine.orphans.
Removing "old" fields.
* Fix test's FetchRecord.
* Fix `checkResponse` to not allow duplicates in response.
2020-06-18 12:03:36 +02:00
Dustin Brody
db870fead4
update 20 beacon chain protocol spec refs
2020-06-18 08:39:28 +00:00
Jacek Sieka
e813111b3b
peers rpc call
...
simple way to display nbc peer table
2020-06-18 07:29:20 +00:00
tersec
ee9f4a2e3f
remove skipMerkleValidation and skipBlockParentRootValidation ( #1197 )
2020-06-18 07:56:47 +02:00
Dustin Brody
ffca27b45f
update 24 v0.11.x spec refs to v0.12.1
2020-06-17 12:11:03 +00:00
Jacek Sieka
8fbbd59885
metric names ( #1188 )
...
* fix metric names to not clash with native libp2p metrics
* run testnet node with rpc enabled by default
2020-06-17 13:04:24 +02:00
Dustin Brody
5b6ade043c
remove unused import
2020-06-17 09:25:54 +00:00
Dustin Brody
ec85a8bdbf
update a dozen unchanged spec refs to v0.12.1
2020-06-17 09:25:54 +00:00
Jacek Sieka
49e9167b28
clean up dump feature
...
* don't write blocks that get added to database
* don't write states
* write to folders
* add state dumping feature to `ncli_db` to get any known state from the
database
2020-06-16 13:44:37 +00:00
kdeme
a25bc025d1
Start discovery after starting libp2p switch
2020-06-16 13:33:46 +00:00
Jacek Sieka
5c25d23ef1
eth2hash -> eth2digest
...
hash in nim is the insecure hash-map helper - might as well use `digest`
consistently to mark the difference
2020-06-16 13:30:21 +00:00
Jacek Sieka
60176b8cc1
Revert "Dual headed fork choice ( #1163 )" ( #1181 )
...
This reverts commit 090f06614a
.
2020-06-16 09:46:00 +02:00
Jacek Sieka
89e4819ce9
collect signature production and verificaiton in one place ( #1179 )
...
* collect signature production and verificaiton in one place
Signatures are made over data and domain - here we collect all such
activities in one place.
Also:
* security: fix cast-before-range-check
* log block/attestation verification consistently
* run block verification based on `getProposer` in its own history
* clean up some unused stuff
* import
* missing raises
2020-06-16 07:45:04 +02:00
Ștefan Talpalaru
9335533503
bump submodules
2020-06-16 04:27:20 +00:00
Mamy Ratsimbazafy
090f06614a
Dual headed fork choice ( #1163 )
...
* Dual headed fork choice
* fix finalizedEpoch not moving
* reduce fork choice verbosity
2020-06-16 00:40:16 +02:00
Eugene Kabanov
96f26c447c
Replace zero-point rewind with rewind to latest finalized epoch's first slot. ( #1176 )
...
* Replace zero-point rewind with rewind to latest finalized epoch's first slot.
* Fix tests.
* Add missing penalty for MissingParent
Fix comments.
2020-06-15 21:41:26 +02:00
Dustin Brody
8a2c796e83
switch 12 unchanged spec references from 0.11.x to 0.12.1; line-wrap and remove pointless-to-counterproductive "return"
2020-06-15 10:10:31 +00:00
Eugene Kabanov
50c5d47250
Add maximum number of workers (peers used) by SyncManager (default: 10) ( #1172 )
...
Refactor and simplification of `sync` procedure.
Fix aggressive looping on excessive recurring failures.
2020-06-14 11:45:53 +02:00
Jacek Sieka
360ebd705f
db: compress with snappy
...
* 3gb vs 12gb for 4000 epochs of witti
* 3-4x sync blocks/sec performance improvement on my FDE SSD drive
* generate less quirky code for primitive types
2020-06-14 11:33:00 +03:00
Dustin Brody
1d1e90adf4
Update 36 spec refs from 0.11.x to 0.12.1
2020-06-12 19:41:03 +00:00
Jacek Sieka
78b767f645
avoid genericAssign for beacon node types ( #1166 )
...
* avoid genericAssign for beacon node types
ok, I got fed up of this function messing up cpu measurements - it's so
ridiculously slow, it's sad.
before, while syncing:
```
40,65% beacon_node_shared_witti_0 [.]
genericAssignAux__U5DxFPRpHCCZDKWQzM9adaw
9,02% libc-2.31.so [.] __memmove_avx_unaligned_erms
7,07% beacon_node_shared_witti_0 [.] BIG_384_58_monty
5,19% beacon_node_shared_witti_0 [.] BIG_384_58_mul
2,72% beacon_node_shared_witti_0 [.] memcpy@plt
1,18% [kernel] [k] rb_next
1,17% beacon_node_shared_witti_0 [.] genericReset
1,06% [kernel] [k] map_private_extent_buffer
```
after:
```
24,88% beacon_node_shared_witti_0 [.] BIG_384_58_monty
20,29% beacon_node_shared_witti_0 [.] BIG_384_58_mul
3,15% beacon_node_shared_witti_0 [.] BIG_384_58_norm
2,93% beacon_node_shared_witti_0 [.] BIG_384_58_add
2,55% beacon_node_shared_witti_0 [.] BIG_384_58_sqr
1,64% beacon_node_shared_witti_0 [.] BIG_384_58_mod
1,63% beacon_node_shared_witti_0 [.]
sha256Transform__BJNBQtWr9bJwzqbyfKXd38Q
1,48% beacon_node_shared_witti_0 [.] FP_BLS381_add
1,39% beacon_node_shared_witti_0 [.] BIG_384_58_sub
1,33% beacon_node_shared_witti_0 [.] BIG_384_58_dnorm
1,14% beacon_node_shared_witti_0 [.] FP2_BLS381_mul
1,05% beacon_node_shared_witti_0 [.] BIG_384_58_cmove
1,05% beacon_node_shared_witti_0 [.]
get_shuffled_seq__4uncAHNsSG3Pndo5H11U9aQ
```
* better field iteration
2020-06-12 21:10:22 +02:00
Jacek Sieka
42832cefa8
Small fixes ( #1165 )
...
* random fixes
* create dump dir on startup
* don't crash on failure to write dump
* fix a few `uint64` instances being used when indexing arrays - this
should be a compile error but isn't due to compiler bugs
* fix standalone test_block_pool compilation
* add signed block processing in ncli
* reuse cache entry instead of allocating a new one
* allow for small clock disparities when validating blocks
2020-06-12 18:43:20 +02:00
tersec
c8f24ae3b8
Remove three skipMerkleValidation usages ( #1164 )
...
* remove three skipMerkleValidation usages
* remove a couple obsolete comments/TODOs
2020-06-12 18:03:46 +02:00
Kim De Mey
68a8b7d969
Filter discovery nodes on forkId ( #1162 )
2020-06-12 16:14:18 +02:00
Zahary Karadjov
9363169098
Cosmetic improvement for the statusbar
2020-06-11 17:40:08 +03:00
Zahary Karadjov
cf6a869e9e
Address some TODO items; Handle start-up before genesis more properly
2020-06-11 17:40:08 +03:00
Zahary Karadjov
c773e10c1a
Attempt to reduce the risk of dropped network connections during the loading of KeyStores
2020-06-11 17:40:08 +03:00
Zahary Karadjov
25821331c4
More greppable code for the onPeerConnected operation
2020-06-11 17:40:08 +03:00
Zahary Karadjov
811ba9aacd
Fix SSZ issues on 32-bit platforms
2020-06-11 17:40:08 +03:00
Zahary Karadjov
fdaf419e41
Address review comments
2020-06-11 17:40:08 +03:00
Zahary Karadjov
6e88a07b51
Fix the validator client build
2020-06-11 17:40:08 +03:00
Zahary Karadjov
2acda1c115
Provide a default value for secretsDir (similar to validatorsDir)
2020-06-11 17:40:08 +03:00
Zahary Karadjov
a75c632f7a
Fixed launch_local_testnet; Renamed validator_keygen to keystore_directories
2020-06-11 17:40:08 +03:00
Zahary Karadjov
a8113cf2bc
Restore the local sim to a working state
2020-06-11 17:40:08 +03:00
Zahary Karadjov
17343442ea
Implement more of the KeyStore spec and integrate it in the beacon node
2020-06-11 17:40:08 +03:00
Eugene Kabanov
1fc9413c48
Fix #1153 . ( #1160 )
...
Add ability for SyncQueue to recover from unexpected MissingParent.
2020-06-11 16:20:53 +02:00
Jacek Sieka
016cc22173
show peer info on connect ( #1155 )
2020-06-11 07:14:26 +02:00
Viktor Kirilov
e7febc2e2b
can finalize successfully with external VCs! + some other cleanup
2020-06-10 13:50:50 +03:00
Viktor Kirilov
06873abde3
fixed build
2020-06-10 13:50:50 +03:00
Viktor Kirilov
3bae40ae91
- extracted the commands to run a VC into a separate run_validator.sh script
...
- each BN gets half of its previous validators as inProcess and the other half goes to the respective VC for that BN - using separate data dirs where the keys are copied
- also removed a few command line options which are no longer necessary
- block proposals originating from a VC are propagated from one BN to the rest properly
- other cleanup & moving code back to since it is no longer used elsewhere
2020-06-10 13:50:50 +03:00
Mamy Ratsimbazafy
ce897fe83f
[Split fork choice PR] Derisk-ed attestation checks changes ( #1154 )
...
* Derisked attestation pool improvements
* tune down frequent logs
* VoteTracker logging
2020-06-10 08:58:12 +02:00
Dustin Brody
a9f73ac8fb
poke
2020-06-09 18:39:05 +00:00
Dustin Brody
8f7541959a
allow compile-time switching between v0.11.3 and v0.12.1
2020-06-09 18:39:05 +00:00
Dustin Brody
36f15a3688
complete re-implmentation of reasonable asymptotic-complexity algorithms from 0.11.3
2020-06-09 18:39:05 +00:00
Dustin Brody
35f67cec60
remove the scaffolding get_empty_per_epoch_cache() calls and the pointless construction and return/discarding of zero-filled arrays
2020-06-09 18:39:05 +00:00
Dustin Brody
5582ecc1f4
remove some debugging code
2020-06-09 18:39:05 +00:00
Dustin Brody
cc13153fc6
initial 0.12.1 beacon chain spec
2020-06-09 18:39:05 +00:00
Jacek Sieka
1e71388093
Include finalization, head and time (in that order) in standard bar ( #1142 )
...
These are the 3 most important things in the life of a beacon-node -
finalization checkpoint for security, head + time for seeing that we're
synced and working.
The order given is the expected increasing order that things should be
moving in - finalization lags head, and head lags clock - the structure
helps the user remember, but also see the pattern where time is getting
out of sync with head.
A validator would also want to know when the next action is going to be
(ie next attestation / block production) but that's for another day.
2020-06-08 18:04:11 +02:00
Eugene Kabanov
040e38529a
Fix #1140 . ( #1143 )
...
SeenTable is now able to hold peers with different timeout values.
2020-06-08 18:02:50 +02:00
tersec
a50415a719
temporary workaround for witti attestation dropping ( #1131 )
2020-06-08 09:22:31 +02:00
Eugene Kabanov
3ce98d5bca
Add checks for penalties which are not applied immediately. ( #1139 )
...
Change default maxHeadAge value to 1 epoch.
Set zero-point at the SyncQueue's initialization.
Remove annoying logs in runDiscoveryLoop.
2020-06-07 17:36:24 +02:00
Jacek Sieka
ea8f96d284
ncli_db: allow saving states by root ( #1136 )
...
also dump state+block when validation fails
2020-06-06 13:26:19 +02:00
Jacek Sieka
bb698a7e16
lots of peers ( #1130 )
2020-06-05 22:25:01 +02:00
Zahary Karadjov
4f1c4687e4
Fix the inspector build
2020-06-05 20:06:24 +03:00
Zahary Karadjov
0c78fc39e7
Use the latest LibP2P
2020-06-05 19:34:12 +03:00
Zahary Karadjov
32bc4d9096
Use {.push raises.} in spec/datatypes
...
This was an attempt to trigger a previously reported crash, but
everything turned out to be fine.
2020-06-05 19:33:30 +03:00
Dustin Brody
74dc2fffa6
3x blocksim speedup by using EpochRef in attestation pool addResolved(...)
2020-06-05 13:02:35 +00:00
Jacek Sieka
68b5638da4
allow non-power-of-2 limits in hashlist
...
fixes "make eth2_network_simulation"
a bit sad: no test coverage except against our own tests
2020-06-05 14:51:22 +03:00
Dustin Brody
3cb7896bab
12x speedup on state sim with 100k validators sans BLS by caching get_beacon_proposer_index(...)
2020-06-04 17:07:51 +00:00
Jacek Sieka
bcbfa736c9
format ErrorMsg messages reasonably ( #1109 )
2020-06-04 08:19:25 +02:00
Jacek Sieka
56ffb696be
reorder ssz ( #1099 )
...
* reorder ssz
* split into hash_trees and ssz_serialization, roughly, for hashing and
IO
* move bitseqs into ssz (from stew)
* clean up imports
* docs, imports
2020-06-03 15:52:02 +02:00
cheatfate
405e9db199
Fix problem of good peers is also logged as timed out.
2020-06-03 13:48:01 +03:00
cheatfate
12e28a1fa9
Add proper concurrent connections.
...
Add SeenTable to avoid continuous attempts to dead peers.
Refactor onSecond.
Block backward sync while forward sync is working.
SyncManager now checks responses according corresponding requests + tests.
SyncManager now watching for not progressing local_head_slot and resets SyncQueue.
2020-06-03 12:53:57 +03:00
Jacek Sieka
07393c8de6
Ssz cache ( #1084 )
...
* wip: cache
* cache lists and arrays of complex objects (5x block processing speed
on ncli_db)
trivial baseline cache that stores tree in flat memory structure
* support array of uint64
* work around type issues
* more type compiler bug workarounds
* cache balances, more type fixes
* index type
* ncli_db: add validation flag, better ux
* int64 fixes
* test fix
* "oops"
```
647.913, 0.000, 647.913, 647.913, 1,
Initialize DB
0.540, 0.402, 0.340, 9.451, 619,
Load block from database
40.268, 0.000, 40.268, 40.268, 1,
Load state from database
0.498, 0.150, 0.343, 0.930, 596,
Apply block
3.548, 11.005, 0.729, 54.022, 23,
Apply epoch block
```
* support all basic types
* cleanups
* a few more cleanups
2020-06-03 07:57:17 +02:00
tersec
b7bb62d48b
use shuffled validator cache in more places; cleanups ( #1095 )
2020-06-03 07:42:08 +02:00
Jacek Sieka
1d9a58f1e8
a few more cleanups
2020-06-02 22:10:45 +02:00
kdeme
06f025b228
Add timeout to switch.connect
2020-06-02 23:06:11 +03:00
Jacek Sieka
7e881a4c09
cleanups
2020-06-02 17:17:07 +02:00
Jacek Sieka
872d7ff493
support all basic types
2020-06-02 11:44:51 +02:00
Jacek Sieka
00acf4f7b2
"oops"
...
```
647.913, 0.000, 647.913, 647.913, 1,
Initialize DB
0.540, 0.402, 0.340, 9.451, 619,
Load block from database
40.268, 0.000, 40.268, 40.268, 1,
Load state from database
0.498, 0.150, 0.343, 0.930, 596,
Apply block
3.548, 11.005, 0.729, 54.022, 23,
Apply epoch block
```
2020-06-01 22:37:26 +02:00
Dustin Brody
1a6b83a15f
cleanups
2020-06-01 19:45:21 +00:00
Jacek Sieka
405f460f9b
int64 fixes
2020-06-01 17:35:42 +02:00
Zahary Karadjov
ef90a45509
Bump testutils
2020-06-01 16:58:28 +03:00
Jacek Sieka
2316ac15c3
index type
2020-06-01 14:52:52 +02:00
Jacek Sieka
fec01829c4
cache balances, more type fixes
2020-06-01 14:52:52 +02:00
Jacek Sieka
be92842944
more type compiler bug workarounds
2020-06-01 14:52:52 +02:00
Jacek Sieka
a0b8b818f3
work around type issues
2020-06-01 14:52:52 +02:00
Jacek Sieka
4fc9a84c57
support array of uint64
2020-06-01 14:52:52 +02:00
Jacek Sieka
f1dcee2749
wip: cache
...
* cache lists and arrays of complex objects (5x block processing speed
on ncli_db)
trivial baseline cache that stores tree in flat memory structure
2020-06-01 14:52:50 +02:00
tersec
a327e8581b
switch state transition caching to match EpochRef ( #1089 )
...
* switch state transition caching usage to shuffled active validator indices to match EpochRef
* refactor the EpochRef -> StateCache transformation; elide pointless mapIt
* limit state passed between get_beacon_committee(...) and compute_committee(...)
* tweaks
2020-06-01 09:44:50 +02:00
Zahary Karadjov
0bcdabfcdf
Detect another invalid SSZ input found through fuzzing
...
The first offset of an SSZ object should always have a fixed constant
value. Otherwise, some unused bytes may appear between the fixed portion
and the dynamic portion.
Please note that this fix shutds down the minimal forward compatibility
currently supported by the SSZ format (and thus, the expected behavior
must be clarified in the SSZ spec).
2020-05-30 14:47:35 +03:00
Ștefan Talpalaru
a90b0dd197
Merge pull request #1077 from status-im/timeout
...
Eth2Node.stop(): trace msg on timeout
2020-05-29 16:30:13 +02:00
Zed
c570abf602
Check iv length for decryption
2020-05-29 16:38:55 +03:00
Zed
80ce960afa
Minor improvements
2020-05-29 16:38:55 +03:00
Zed
49c083d5b7
Catch all exceptions
2020-05-29 16:38:55 +03:00
Zed
14ad100b45
Address comments
2020-05-29 16:38:55 +03:00
Zed
8496e20a78
Implement EIP 2335 compliant keystore
...
Closes #1024
2020-05-29 16:38:55 +03:00
Kim De Mey
e33c8d9067
Bump nim-eth and accompanying discv5 cleanup ( #1081 )
2020-05-29 12:03:29 +02:00
tersec
b5f45db5e9
keep cache of per-epoch items in block pool ( #1068 )
...
* plumbing between block pool and state transition functions around active validator indices and committees
* have shared epochrefs followed by blockref tree while allowing for skipped slots
* factor out the epoch info extraction; document how the EpochRef follows forks
2020-05-29 08:10:20 +02:00
Jacek Sieka
061be037d1
ncli_db: database tool
...
includes a benchmark tool for now
2020-05-28 17:43:02 +00:00
Zahary Karadjov
0493737d7a
Remove ssz.loadFile
2020-05-28 19:15:16 +03:00