9b520d3949
address comment
2019-03-26 17:35:09 +02:00
808c5edfc0
Add more fork choice logs
2019-03-26 17:35:09 +02:00
e7b36c4389
add beacon clock and rework timing
...
* have regular slot tick, decide on work to do lazily
* use beacon clock instance that will eventually sync time
* skip work when falling behind
* add one more state cache for justified state (since that's used in
fork choice)
* remove old sync cruft
* single timer per slot, serializing block production and attestation
2019-03-26 13:21:48 +02:00
e4c10a31c9
Use latest state from the DB in sync. Fixed off by one in block roots ( #203 )
2019-03-25 14:52:23 -06:00
70cb84ef93
Fix the build with the latest nim-eth
2019-03-25 19:57:05 +02:00
1b0e67c88c
ssz: update to 0.5.1:ish ( #202 )
...
* ssz: update to 0.5.1:ish
* slightly fewer seq allocations
* still a lot of potential for optimization
* fixes #174
* ssz: avoid reallocating leaves (logN merkle impl)
2019-03-25 10:46:31 -06:00
6b1527ccd5
Almost final 0.5.1 spec updates ( #201 )
...
* update processExits to 0.5.1
* mark process_deposit, get_empty_block as 0.5.1; update get_genesis_beacon_state to 0.5.1; implement processDeposits
* hotfix via https://github.com/ethereum/eth2.0-specs/pull/821
2019-03-24 12:21:23 -06:00
9f55b4646c
More 0.5.1 spec updates ( #195 )
...
* rm gone-in-0.5.0 Proposal, verifyBlockSignature, and slot check which moved to spec function processBlockHeader
* mark get_attestation_participants and get_epoch_committee_count as 0.5.1; finish updating processAttestations to 0.5.1; add kludgy workaround for bug relating to get_winning_roots_etc using crosslink_data_root as index when we have that as ZERO_HASH for all leading to it confusing attesters on different shards; rm BeaconState.latest_attestations, which splits into previous_epoch_attestations and current_epoch_attestations
* Fix CI due to removed latest_attestations field
2019-03-22 18:33:12 +00:00
0a027e410a
Address review concerns and make some steps towards json logging
2019-03-22 17:04:17 +02:00
06301458bf
Don't add the 'node' log property when connecting to the testnet
2019-03-22 17:04:17 +02:00
ca49ae9b5a
Report connected peers before fork choice
2019-03-22 12:33:10 +01:00
894816fa0c
Fixed crash caused by findAncestorBySlot ( #196 )
...
closes #193
2019-03-22 11:57:19 +01:00
94c3b005fa
https://github.com/ethereum/eth2.0-specs/pull/816 hotfix ( #194 )
2019-03-21 16:02:50 +00:00
1bb2859aca
implement bulk of 0.5.0 state transition function ( #192 )
2019-03-21 15:31:36 +00:00
ee89ef1c79
cleanups ( #189 )
...
* add simple bitfield type (fixes #19 )
* fix bit endianess to match spec
* consolidate attestation and block logging
* cruft cleanup
* run optimizer on tests, speeds up build
2019-03-20 14:01:48 -06:00
13c7f7fcec
begin refactoring 0.5.0 epoch transition ( #185 )
...
* begin refactoring 0.5.0 epoch transition at justification and finalization
* update processTransfers to 0.5.0 spec
* update get_crosslink_committees_at_slot to 0.5.0 except for noted workaround for pre-0.5.0 spec bug related to epoch boundary conditions, to be flipped in more coordinated way with other epoch processing changes
* mark ejection processing as 0.5.0
* 0.5.0 epoch update finalization
* rm BEACON_CHAIN_SHARD_NUMBER to complete updating miscellaneous constants to 0.5.0
* mark verify_slashable_attestation as 0.5.0
* update process_attester_slashing to 0.5.0
* update process_slashings(...) to 0.5.0 and mark process_exit_queue as 0.5.0
* refactor epoch processing by implementing 0.5.0's update_registry_and_shuffling_data(...)
2019-03-19 20:19:46 -06:00
6d4284877d
Tentative fix for self-connection discovery issues
2019-03-20 03:18:59 +02:00
6ec8ffe0ff
Much better error reporting on snapshot deserialization problems
2019-03-20 02:05:10 +02:00
b454501595
handle missing validators dir during key import
2019-03-19 23:04:22 +02:00
42ca6afae2
Helpful scripts for resetting the testnets
2019-03-19 21:50:22 +02:00
6a35d3584d
Automate the creation of the network metadata files
...
With these changes, running a simulation is very close to running
an actual testnet. Some checks have been added in the client to
make sure you are not connecting to an incompatible network (e.g.
a network running with a different number of shards).
2019-03-19 20:27:54 +02:00
8bab6fd51f
Add TODO for local bind ip
2019-03-19 11:19:27 -06:00
d7f972a47e
allow setting advertised external ip
...
* detect it in start.sh
2019-03-19 10:50:09 +02:00
2bc632c29b
AttestationData.justified epoch -> AttestationData.source_epoch and AttestationData.latest_crosslink -> AttestationData.previous_crosslink; implement verify_merkle_branch and update process_deposit to use it; rm BeaconState.batched_block_roots; Transfer.{from, to} -> Transfer.{sender, recipient}; update Fork data type and code to use bytes4; implement int_to_bytes8 (close to metaprogramming time); adjust signed_root and all callers to use 0.5.0 calling signature; processDepositRoot -> processEth1Data ( #182 )
2019-03-18 15:42:42 +00:00
6bb38095c9
Command-line and data storage handling for testnets
2019-03-18 12:45:29 +02:00
798197879b
Revert "AttestationData.justified epoch -> AttestationData.source_epoch and AttestationData.latest_crosslink -> AttestationData.previous_crosslink; implement verify_merkle_branch and update process_deposit to use it; rm BeaconState.batched_block_roots; Transfer.{from, to} -> Transfer.{sender, recipient}; update Fork data type and code to use bytes4; implement int_to_bytes8 (close to metaprogramming time); adjust signed_root and all callers to use 0.5.0 calling signature; processDepositRoot -> processEth1Data"
...
This reverts commit 18f1d000a1
2019-03-17 15:24:50 -07:00
18f1d000a1
AttestationData.justified epoch -> AttestationData.source_epoch and AttestationData.latest_crosslink -> AttestationData.previous_crosslink; implement verify_merkle_branch and update process_deposit to use it; rm BeaconState.batched_block_roots; Transfer.{from, to} -> Transfer.{sender, recipient}; update Fork data type and code to use bytes4; implement int_to_bytes8 (close to metaprogramming time); adjust signed_root and all callers to use 0.5.0 calling signature; processDepositRoot -> processEth1Data
2019-03-17 15:17:40 -07:00
f36c2d86dc
begin 0.5.0 spec update ( #179 )
...
* begin 0.5.0 spec update: parent_root -> previous_block_root, BeaconState.justified_epoch -> BeaconState.current_justified_epoch, DOMAIN_PROPOSAL -> DOMAIN_BEACON_BLOCK, temporarily rename BeaconBlockHeader to BeaconBlockHeaderRLP to allow for gradual re-merging without disrupting RLP; mark a few unchanged functions and data types, implement get_temporary_block_header/get_empty_block/should_update_validator_registry/processBlockHeader/cacheState; update a few others
* a dozen or so more trivial mostly comment changes, finding more unchanged parts of 0.5.0
* several more trivial changes; goal is to reduce noise around the upcoming substantial changes (epoch processing, etc)
2019-03-16 13:52:37 -06:00
1cb8ae9004
state processing fixes ( #177 )
...
* remove some redundant state updates
* when attesting late, use correct state / head
* don't send out obsolete attestations
* don't propose obsolete blocks
* remove some more resundant state updates :)
* simplify block logging (experimental)
* document fork choice division
* fix some Slot / Epoch conversion warnings
2019-03-14 07:33:56 -06:00
9ff1eb4ac8
Merge branch 'master' of github.com:status-im/nim-beacon-chain
2019-03-14 00:05:12 +01:00
de295619be
assert() -> doAssert()
2019-03-14 00:04:43 +01:00
b0f4034060
implement fork choice ( #175 )
...
* keep track of a finalized block
* keep track of all justified blocks
* use naive spec version of LMD ghost
* cache slot number and a few more things in BlockRef
* keep track of the latest vote of each validator
* depend less on the state of node.state (it's a cache, effectively)
2019-03-13 16:59:20 -06:00
562eafe124
Finish the Spec/Epoch types refactoring
2019-03-13 23:23:01 +02:00
1479bae22f
implement distinct Epoch type and continue 0.4.0 spec update ( #173 )
...
* implement distinct Epoch type
* update two more spec 0.4.0 markers, leaving just deposit processing
2019-03-12 19:46:44 -06:00
50a0948bc0
Mostly convert to using distinct Slot type ( #172 )
2019-03-12 16:21:32 -06:00
6dea18c140
Squashed commit of the following:
...
commit bed6909f33241f62ed8d
2019-03-12 16:03:14 +01:00
5d186ef93c
Fix the build of serialized_sized
2019-03-12 15:38:58 +02:00
0206496663
Fix a build error
2019-03-12 15:14:30 +02:00
903cb8a8b5
A LibP2P-based networking stack;
...
To enable it, comment out the 'withLibp2p' line in nim.cfg
The history was squashed in order to remove an accidentally
commited binary file.
Other changes:
* SSZ was adapted to use the common serialization framework
* gossibsup.subscribe is not using async handlers at the moment
and this allowed me to simplify it
2019-03-12 13:36:55 +02:00
434ba5727f
finish all but 3 items for 0.4.0 spec update ( #167 )
2019-03-12 10:59:43 +01:00
b587455e7b
Use BlockPool for slot->blocks mapping ( #166 )
2019-03-11 09:38:36 -06:00
13de015038
more 0.4.0 spec updates: renamings, continue Proposal updates, and note several more functions which were verified not to have changed in 0.4.0 ( #163 )
2019-03-11 09:33:24 -06:00
89aa3ec53f
fix keccak256 digest comments
2019-03-09 12:34:08 -08:00
aec31b1126
Updates for finalizing chain! ( #162 )
...
* set epoch_boundary_root - chain finalizes!
* fix slotStart to offset GENESIS_SLOT
* work around bug that will be fixed by
https://github.com/ethereum/eth2.0-specs/pull/732
* compile with debug info (there was a GC-related crash in C land)
2019-03-09 04:23:14 +00:00
0b47acae37
some comment changes noting further 0.4.0-spec-update progress, but no meaningful semantic changes ( #161 )
2019-03-08 18:23:42 +00:00
1afdcda62d
spec version 0.4.0 update: shard_block_root -> crosslink_data_root; switch from validator.slashed_epoch -> validator.slashed approach; a couple assert -> doAssert; note fix for underflow-prone spec changes in checkAttestation; GENESIS_SLOT change from 2^63 to 2^32; refactor Proposer and ProposalSlashing structure; add signed_root; remove duplicate slashValidator ( #159 )
...
* spec version 0.4.0 update: shard_block_root -> crosslink_data_root; switch from validator.slashed_epoch -> validator.slashed approach; a couple assert -> doAssert; note fix for underflow-prone spec changes in checkAttestation; GENESIS_SLOT change from 2^63 to 2^32; refactor Proposer and ProposalSlashing structure; add signed_root; remove duplicate slashValidator
* re-apply shard_block_root -> crosslink_data_root
* remove incorrect humaneSlotNum
* add (run-time only, alas) sanity check on signed_root
2019-03-08 17:44:31 +00:00
6bcefc0e42
verify blocks before storing in block pool / database ( #158 )
...
* fix state db lookup typo
* fix randao reveal slot when proposing blocks
* only store blocks that can be applied to a state
* store state at every epoch boundary (yes, needs pruning!)
* split out state advancement function when there's no block
* default state sim to 0.9 attestation ratio
2019-03-08 10:40:17 -06:00
72749f4d04
processEpoch 5x faster, total 2x faster, with 16k validators ( #157 )
...
* processEpoch 5x faster, total 2x faster, with 16k validators
* don't recompute active_validator_indices as much
* remove duplicate process_ejections function
2019-03-07 16:53:44 +00:00
4d55cf8eea
beacon node sim: various improvements ( fixes #111 ) ( #156 )
...
* allow running more or fewer validators
* use deterministic key generation for tests to avoid exhausting system
RNG
* update README with simulator docs
* write the data of each validator to separate file, instead of a big
chainstart.json (makes it easier to run different validator counts)
2019-03-07 13:59:28 +00:00
5d0de00168
transform a few quadratic algorithms from processEpoch into linear or otherwise subquadratic algorithms ( #155 )
2019-03-06 08:21:13 -06:00
b8402e9809
speed up epoch processing by caching shuffling results ( #153 )
...
* speed up epoch processing by caching shuffling results
2019-03-05 19:10:36 +00:00
38f48753b2
Comments on #117 addressed ( #154 )
2019-03-05 07:55:09 -06:00
21e4debda0
Merge pull request #117 from status-im/sync2
...
Initial full sync impl
2019-03-04 21:05:24 +02:00
9ea0bf4326
Comments addressed
2019-03-04 13:50:26 +02:00
81d5becc7b
Switch hash functions, prevent underflow & verify that shuffling works ( #149 )
...
* prevent balance underflow, per spec implementation note
* verify that permutation shuffing works: add YAML dependency to be used for ingesting test cases; switch from blake2 to keccak256 to match EF test cases; remove inefficient naive-spec-version of shuffling algorithm now that protolambda's can be tested directly
2019-03-01 17:50:01 -06:00
4c31f50889
Comments addressed
2019-03-01 22:09:20 +02:00
bed6510da3
Initial full sync impl
2019-03-01 19:39:38 +02:00
68a39a21be
Mysterious fix for the mysterious build issue
2019-03-01 18:51:37 +02:00
794f6aed89
fix https://github.com/status-im/nim-beacon-chain/issues/145 ( #147 )
2019-03-01 14:39:17 +00:00
ddb3a9cd94
Revert "Add some missing RLP serialization routines ( #144 )" ( #146 )
...
This reverts commit 859aa327cb
2019-03-01 07:34:37 -06:00
859aa327cb
Add some missing RLP serialization routines ( #144 )
...
* Add some missing RLP serialization routines
2019-02-28 15:50:21 -06:00
1cfea240ed
Complete scan through v0.3.0 spec ( #141 )
...
* Complete scan through v0.3.0 spec; remaining known discreptancy is in bls_verify_multiple
* switch remaining slot-misuses of get_active_validator_indices to epochs
* spec workaround
* finish first 0.3.0 pass by getting slow, naive version of bls_verify_multiple running
2019-02-28 15:24:43 -06:00
125231d321
add initial block pool ( #139 )
...
* implement in-memory block graph
* store tail block in database
* resolve unknown parents by syncing them from peers
* introduce concept of resolved blocks and attestations - those that
follow minimal protocol rules
* update state head lazily
* log more stuff
* shortHash -> shortLog
* start 9/10 beacon nodes by default, last can be started manually
* see also #134
* fix start.sh epoch length
2019-02-28 15:21:29 -06:00
20f99db058
remove unused epoch template ( #142 )
2019-02-28 08:17:57 -06:00
5b60c3b45f
Enable discovery service regardless bootnodes are provided
2019-02-28 09:48:33 +02:00
34e6149f89
fix crosslink epoch refs to begin with GENESIS_EPOCH; more minor epoch processing tweaks/unstubbed-code ( #137 )
...
* fix crosslink epoch refs to begin with GENESIS_EPOCH; more minor epoch processing tweaks/unstubbed-code
* remove obsolete TODO and use humanEpochNum
2019-02-27 13:58:07 +00:00
0305432a87
implement and call process_slashings and process_exit_queue from processEpoch; update a few more epoch processing details to be consistent with 0.3.0; add rest of final upates per epoch ( #136 )
2019-02-26 10:54:08 +01:00
60e6a9fedc
assert relationship between constants necessary to avoid underflow
2019-02-25 14:58:04 +00:00
eda43b5b1c
adjust copyright comment form
2019-02-25 14:58:04 +00:00
6dab867848
cleanup
2019-02-25 14:58:04 +00:00
8baab40ea6
much faster shuffling based on observations from https://github.com/protolambda/eth2-shuffle enough that it's not easy to get exact speedup numbers
2019-02-25 14:58:04 +00:00
f77016af68
switch sense of bls_verify check
2019-02-25 14:58:04 +00:00
de2cad0e12
switch from legacy pre-spec sum_effective_balances(...) to get_total_balance(...)
2019-02-25 14:58:04 +00:00
a42601e29e
initial epoch processing update switching from slot-oriented to epoch-oriented, using newer helper functions
2019-02-25 14:58:04 +00:00
fb3bbfccaa
small 0.3.0 adjustments; comment updates/clarifications; add Transfer processing
2019-02-25 14:58:04 +00:00
a62d25ab98
Merge pull request #131 from status-im/state-replay
...
initial state replay implementation
2019-02-22 18:04:48 +02:00
2d52d5cbfe
convert some asserts to doAsserts to keep them in release mode builds; rename get_initial_beacon_state to get_genesis_beacon_state to track spec; switch target spec version to 0.3.0; switch references to penalize_validator to slash_validator/slashValidator to track spec; make some function returns safer by omitting 'return' ( #132 )
...
* convert some asserts to doAsserts to keep them in release mode builds; rename get_initial_beacon_state to get_genesis_beacon_state to track spec; switch target spec version to 0.3.0; switch references to penalize_validator to slash_validator/slashValidator to track spec; make some function returns safer by omitting 'return'
* 2x shuffling speedup by hoisting pivot calculations per https://github.com/protolambda/eth2-shuffle
2019-02-22 10:56:45 +01:00
4c2d212781
updates
...
* comment on last finalized state
* use explicitly named proc's instead of type tricks
2019-02-21 15:38:26 -06:00
1d9c91d230
cleanups
...
* add ancestor getter to db layer, and use
* remove head block call
* add trivial beacon chain db test
2019-02-21 11:20:50 -06:00
2d307e2257
initial state replay implementation
...
* fix initial attestation pool on reordered attestations
* simplify db layer api
* load head block from database on startup, then load state
* significantly changes database format
* move subscriptions to separate proc's
* implement block replay from historical state
* avoid rescheduling epoch actions on block receipt (why?)
* make sure genesis block is created and used
* relax initial state sim parameters a bit
2019-02-20 22:42:17 -06:00
1d13007627
More spec v0.3.0 notations and updates ( #129 )
...
* tighten get_active_index_root epoch assertion bound
* implement merkle_root
* rm process_penalties_and_exits; add slash_validator
* rm rm'd and unused constant
2019-02-20 14:35:27 -06:00
132f1147a2
spec 0.3.0 updates: EPOCH_LENGTH -> SLOTS_PER_EPOCH, SlotNumber -> Slot, EpochNumber -> Epoch ( #127 )
...
* spec 0.3.0 updates: EPOCH_LENGTH -> SLOTS_PER_EPOCH, SlotNumber -> Slot, EpochNumber -> Epoch
2019-02-19 19:33:58 -06:00
4670d6c98a
naive attestation pool, in preparation of fork choice integration ( #125 )
...
* move attestation pool to separate file
* combine attestations lazily when needed
* advance state when there's a gap while attesting
* compile beacon node with optimizations - it's tooo slow right now
* log when unable to keep up
2019-02-20 00:35:02 +01:00
1269e001ad
get most 0.3.0 spec renamings ( #126 )
...
* get most 0.3.0 spec renamings
2019-02-19 17:07:56 -06:00
c64cd2f275
a few simple SlotNumber cleanups
2019-02-18 22:43:33 +02:00
8e48bac58b
[WIP] Fix some issues after introducing "humaneEpochNumber" ( #118 )
...
* Fix some issues after introducing "humaneEpochNumber" + use slot_duration to 4
* Address humane comments
* Fix comment
2019-02-18 16:58:34 +01:00
0e9cc20cfe
beacon node simplifications ( #116 )
...
* remove previous randao scheme code
* fix some epoch logging
* move genesis time selection to state generation
2019-02-15 17:33:32 +01:00
d3f97c1d5c
Merge pull request #115 from status-im/nus
...
complete switching to v0.2.0 RANDAO scheme, with verification enabled
2019-02-15 10:57:14 +00:00
6bef36d418
remove more old RANDAO vestiges
2019-02-14 14:03:45 -08:00
8fbf87aa8c
complete switching to v0.2.0 RANDAO scheme, with verification enabled
2019-02-14 13:41:04 -08:00
a71424d768
add more config options and log compile parameters ( #114 )
...
default sim runs with smaller chain now
2019-02-14 13:32:33 -06:00
c2a52d7fc5
Allow faster slots ( #112 )
...
* Allow compile time configurable slot time
2019-02-14 13:15:10 +01:00
55ac8d337b
some v0.2.0 updates and fixes a bug that should enable simulation to continue longer ( #110 )
...
* some v0.2.0 updates and fixes a bug that should enable simulation to continue longer
2019-02-14 04:16:50 +01:00
31a4c7255f
more v0.2.0 spec updates ( #107 )
...
* switch to v0.2.0 shuffling scheme
* fix some >80 char lines; add get_total_balance helper function (used in epoch processing, etc); note intended removal of repeat_hash and users thereof; add some int_to_bytes and bytes_to_int helpers; more underflow comments; add Gwei type; adjust generate_seed to include additional entropy source; note egregious inefficiencies
* minor code cleanup
* move some general helper functions to helpers.nim and clarify little-endian comments
2019-02-13 11:26:32 +01:00
b60fa131f1
Fix simulation regression due to custody_bitfield ( #108 )
2019-02-12 23:50:02 +01:00
899c8e5df9
Bitfield debugging asserts ( #106 )
...
* debugging asserts
* Ensure initialization of custody_bitfield for mock Attestations
2019-02-12 18:07:44 +01:00
56a48cc60f
Fixed epoch actions ( #105 )
...
* Fixed epoch actions
* debugging asserts
* Revert "debugging asserts"
This reverts commit 9a11f5a7d8
2019-02-12 16:56:58 +01:00
433e2f78c2
Merge pull request #104 from status-im/oug
...
Spec updates for 0.2.0
2019-02-11 15:48:00 +00:00
f1cbc4a9dc
adjust indentation
2019-02-11 16:32:22 +01:00
f7feb9a6c9
Delay validators and add more log in crosslink asserts ( #103 )
2019-02-11 16:29:21 +01:00
b03ac3427f
split out get_previous_epoch into helper function
2019-02-11 16:10:46 +01:00
d44999abc5
latest_crosslink_root -> latest_crosslink; adjust checkAttestation; add SHUFFLE_ROUND_COUNT and FORK_CHOICE_BALANCE_INCREMENT constants; some additional casts because a few places where ValidatorIndex was used are now uint64; remove some old commented-out lines of code from shardcommittee transition
2019-02-11 15:32:27 +01:00
4747477160
more checking that various functions match v0.1; some variable/etc renaming; fix is_double_vote to check epoch, not slot equivalence; finish verify_slashable_attestation; adjust is_surround_vote logic ( #100 )
2019-02-08 00:07:15 +01:00
c567bc410f
Use human-readable names for the slot numbers
2019-02-07 22:14:08 +01:00
f1f1beb703
Fixed block proposal signature domain
2019-02-07 21:55:44 +01:00
1e574cf75a
Hacky (?) fix #97 assert fails
2019-02-07 21:22:46 +01:00
072c1607fd
implement new RANDAO reveals ( #92 )
...
* implement new RANDAO reveals
2019-02-07 21:13:10 +01:00
f2545318db
get_crosslink_committees_at_slot updates ( #95 )
2019-02-07 20:27:13 +01:00
2794181889
Spec updates ( #94 )
...
* s/slot_included/inclusion_slot/; s/participation_bitfield/aggregation_bitfield/; rearrange some type definitions to match spec order
* a couple more Eth1Data-related spec syncs
2019-02-07 17:55:48 +01:00
31abd31d8a
Fix an int conversion issue
2019-02-07 17:53:02 +01:00
dfcd22519b
Fix for getting the current epoch number
2019-02-07 16:40:00 +01:00
bc44744acd
rm unused work_pool module ( #90 )
...
* rm unused work_pool module
* preserve comment from Danny about signature aggregation
2019-02-07 16:28:59 +01:00
ed8f7ab475
schedule epoch actions for all 64 slots in an epoch
2019-02-07 13:18:00 +01:00
976e1e1f10
spec: remove unused code, fix state_sim speed
2019-02-07 13:03:02 +01:00
20e7ca48b5
Fix `validator not in registry` and `$` bugs.
2019-02-07 12:51:21 +02:00
2d71b998c7
Spec update to v0.1 ( #88 )
...
* update based on https://github.com/ethereum/eth2.0-specs/pull/483
* more spec updates
2019-02-07 11:43:21 +01:00
788b093284
Merge pull request #87 from status-im/vdy
...
Spec updates
2019-02-06 22:52:36 +00:00
74cb86ec21
more spec changes
2019-02-06 21:37:21 +01:00
224f22d377
Fix regression from #80 on validator_keygen ( #86 )
2019-02-06 20:58:18 +01:00
337aa83f1a
spec: fix off-by-one, allows state_sim to continue
2019-02-06 20:53:05 +01:00
2f96c4bade
spec: remove ShardCommittee remnants, add CrosslinkCommittee helper
2019-02-06 20:37:25 +01:00
11da02c34f
Asyncdispatch2 rebranding to chronos ( #84 )
...
* Asyncdispatch2 rebranding to chronos
* nim-eth and nim-chronos part of nimble packages
* fix package name
2019-02-06 18:56:04 +01:00
7cf13c22f0
fix up some non-spec things that interfere with state_sim with attestations
2019-02-06 13:31:41 +01:00
7f1bddb267
Use nim-eth ( #82 )
2019-02-05 20:21:18 +01:00
d1af069c55
Spec update ( #83 )
...
* rm GWEI_PER_ETH
* update EJECTION_BALANCE; rm MAX_CASPER_VOTES/replace with MAX_INDICES_PER_SLASHABLE_VOTE; modify GENESIS_SLOT
* update various constants from slots to epochs; MAX_CASPER_SLASHINGS -> MAX_ATTESTER_SLASHINGS
* AttesterSlashing field renamings; SlashableVote -> SlashableAttestation; add DOMAIN_RANDAO
* rm aggregate_signature_poc_[01]_indices
* centralize some bitfield functions
2019-02-05 19:40:27 +01:00
20e02d5615
enable "--threads:on" for tests ( #75 )
...
* enable "--threads:on" for tests
* disable Chronicles colours on Windows
* delete forLoopMacros-related config
2019-02-05 18:48:34 +01:00
e5d152c6d6
Update BLS to the latest scheme. ( #80 )
...
* Attempt to switch to nim-blscurve.
* "Fix" BLS test for new tests
* Missing domain param in validator keygen
2019-02-05 17:13:29 +01:00
bbd94185a4
State storage predicate moved to beacon_node, split persistBlock to persistBlock and persistState
2019-02-04 21:44:37 +01:00
1606bc6f92
Cosmetics
2019-02-04 21:44:37 +01:00
917c48d9a5
More persistance
2019-02-04 21:44:37 +01:00
dda24619e8
several mechanical renamings
2019-01-30 19:30:34 +02:00
68ca7850f4
rm min_empty_validator_index, ZERO_BALANCE_VALIDATOR_TTL, Validator.latest_status_change_slot; switch Fork.fork_slot to Fork.epoch; begin removing Validator.randao_layers; now that https://github.com/ethereum/eth2.0-specs/issues/352 is fixed, test out for more slots; get process_deposit consistent with current spec
2019-01-30 00:41:07 -08:00
8dadbd3257
fix spurious assertion per https://github.com/ethereum/eth2.0-specs/issues/515
2019-01-28 20:49:20 -08:00
5d0e1c026d
remove Validator.{custody_commitment,latest_custody_reseed_slot,penultimate_custody_reseed_slot}
2019-01-28 20:34:44 -08:00
ad3de5fde9
Uint24 -> ValidatorIndex; Fork.pre_fork_version -> Fork.previous_version; Fork.post_fork_version -> Fork.current_version
2019-01-28 20:15:00 -08:00
4574178836
epochs replace slots as main first-class entity; several mechanical renamings (ForkData -> Fork; .fork_data -> .fork; remove stub custody types/code; some type aliasing to keep slots and epochs more enforceably separate; fix test_state_transition.nim assumption that GENESIS_SLOT == 0
2019-01-28 19:22:22 -08:00
b46183047f
remove BeaconState.shard_committees_at_slots in favor of crosslink committees; validator_registry_latest_change_slot -> validator_registry_update_slot mechanical renaming
2019-01-28 23:43:55 +02:00
f85088651c
Revert "remove BeaconState.shard_committees_at_slots in favor of crosslink committees; validator_registry_latest_change_slot -> validator_registry_update_slot mechanical renaming"
...
This reverts commit 2222a8e222
2019-01-26 11:17:22 -08:00
2222a8e222
remove BeaconState.shard_committees_at_slots in favor of crosslink committees; validator_registry_latest_change_slot -> validator_registry_update_slot mechanical renaming
2019-01-26 11:15:33 -08:00
7071021dc5
Typo fix
2019-01-25 23:13:41 +01:00
e0a257406e
clean up and add some logging ( #70 )
2019-01-25 11:35:22 -06:00
a0712e691a
Replace the usage of cligen with confutils ( #68 )
2019-01-23 12:45:15 -06:00
53952dd0c9
Merge pull request #66 from status-im/wcc
...
Spec update
2019-01-23 18:34:00 +00:00
3877ef263c
remove return to gain better error messages
2019-01-23 09:53:51 -08:00
63f7302a41
Update beacon_chain/spec/beaconstate.nim
...
Co-Authored-By: tersec <tersec@users.noreply.github.com>
2019-01-23 17:51:59 +00:00
a11dcdfe64
switch from get_shuffling_prev to get_shuffling; remove some also-removed-in-spec calls and temporarily/ugly-bridge a still-useful reference to shard committees until they're completely removed
2019-01-22 17:50:51 -08:00
21b8bd7f71
new shuffling routine and adjust tests for it
2019-01-22 14:36:31 -08:00
d728f113ac
move existing shuffling routine out of way and keep existing references to it
2019-01-22 11:17:34 -08:00
523a990adc
ssz: switch to little-endian
...
https://github.com/ethereum/eth2.0-specs/pull/139
2019-01-22 11:56:01 -06:00
a9c026b957
More logging close to the code that fails often
2019-01-21 21:43:08 +02:00
eed9ea8f0a
Spec updates ( #64 )
...
* s/CrosslinkRecord/Crosslink/
* {MIN,MAX}_DEPOSIT to {MIN,MAX}_DEPOSIT_AMOUNT; rm SHARD_PERSISTENT_COMMITTEE_CHANGE_PERIOD; per https://github.com/ethereum/eth2.0-specs/issues/378 and 35adc9c61a
2019-01-21 19:26:58 +01:00
476052b314
deposit root to Eth1Data transition
2019-01-18 12:47:30 +02:00
c788d72857
s/POW_RECEIPT_ROOT_VOTING_PERIOD/ETH1_DATA_VOTING_PERIOD/; rm COLLECTIVE_PENALTY_CALCULATION_PERIOD, ACTIVE_PENDING_EXIT, EXITED_WITH_PENALTY
2019-01-18 12:47:30 +02:00
1fe5ba07b8
update initiate_validator_exit and exit_validator helper functions to current spec; remove spec-removed EXITED_WITHOUT_PENALTY
2019-01-18 12:47:30 +02:00
9dcf37aad6
adjust get_shuffling and get_active_validator_indices to use slot, per spec
2019-01-18 12:47:30 +02:00
f30b4f822e
ValidatorRecord -> Validator
2019-01-18 12:47:30 +02:00
38c2cc72fa
poc -> custody mechanical name changes
2019-01-18 12:47:30 +02:00
d753332c54
Fix the build of the validator_keygen
2019-01-17 14:38:27 +02:00
43ae45fe7e
Add --logLevel command-line flag; Fix running the start.sh script from the beacon-chain repo
2019-01-17 14:38:27 +02:00
7e4d264887
Back the db by rocksdb backend
2019-01-17 14:38:16 +02:00
ce72c1b4bc
re-disable assertion creationg failures in research/state_sim; hadn't been set up to run before, either
2019-01-17 00:14:55 -08:00
6f103a7bcd
switch to new penalty calculation infrastructure
2019-01-16 06:50:54 -08:00
7e3aa4dda2
initial process_penalties_and_exits
2019-01-16 05:39:34 -08:00
44edf400d2
rm PENDING_ACTIVATION
2019-01-16 05:24:58 -08:00
2ff973e46f
add some helper functions from new spec; fix some comments; more plumbing; start removing some of the status-code refs in favor of the new status bitfield
2019-01-16 04:57:49 -08:00
bc65693eae
stop routing through update_validator_status
2019-01-16 04:20:44 -08:00
5823091501
some more fields, plumbing, comment fixes
2019-01-16 03:39:16 -08:00
cb1096c581
add some helper functions, change epoch processing, add some new constants
2019-01-16 03:07:41 -08:00
d101c117fd
stage a few more working changes from the bunch
2019-01-16 02:42:40 -08:00
1bf876f5c1
mechanical renamings
2019-01-16 02:21:06 -08:00
7608fd76a3
Make the code compile in Nim 0.19.0
2019-01-12 13:57:50 +02:00
c3d6961eed
Remove rebase hash leftovers
2019-01-12 13:57:50 +02:00
0a080e4f27
Remove the vote count closure, unlike the spec we use a count table
2019-01-12 13:57:50 +02:00
423f632606
Fork choice compiles (but untested)
2019-01-12 13:57:50 +02:00
f0e3de6b19
Depart from spec "attestation_targets"
2019-01-12 13:57:50 +02:00
4a6e694268
Add BeaconChainDB
2019-01-12 13:57:50 +02:00
8a68bbb26c
Integrate fork choice helpers into skeleton
2019-01-12 13:57:50 +02:00
e3d8bc9695
Sync with latest specs
...
get_parent - https://github.com/ethereum/eth2.0-specs/pull/250
AttestationData - ac600d39https://github.com/ethereum/eth2.0-specs/issues/285 and 5b35b6c2
2019-01-12 13:57:50 +02:00
4c3cae5519
Move fork choice research out of beacon chain
2019-01-12 13:57:50 +02:00
12c6e2f46b
Implement spec helpers for lmd ghost
2019-01-12 13:57:50 +02:00
a586087472
Stable network simulation
2019-01-09 10:45:33 +02:00
1c30214e9a
Reach block 64 in the network simulation
...
* Slightly better logging
* Handling of incoming blocks and missing blocks
2019-01-07 14:59:52 +02:00
8f9a5441f1
More reliable network simulation
...
You'll need the latest versions of nim-eth-p2p, nim-serialization
and nim-json-serialization.
Before starting the simulation script, make sure to delete any previous
json files from the simulation folder:
```
rm tests/simulation/*.json
tests/simulation/start.sh
```
This should survive the creation of few blocks before diying with a
block validation error.
2019-01-05 14:35:47 +02:00
a0aa230c45
spec updates
...
* skip validation in a few more cases
* more renames
* add attestations to state sim
2018-12-28 02:32:41 +02:00
12a819c110
spec updates ( #48 )
...
* spec updates
* balances move out to separate seq
* bunch of placeholders for proof-of-custody / phase1
* fix inclusion distance adjustment
* modify state in-place in `updateState` (tests spent over 80% time
copying state! now it's down to 25-50)
* document several conditions and conversations
* some renames here and there to follow spec
2018-12-27 14:14:37 -06:00
68644517da
initial rough commit of a work/attestation pool ( #46 )
...
* initial rough commit of a work/attestation pool
* add kludgy participation_bitfield handling, some error handling, and document future improvments from spec update #47
* rename addAttestation to add for Nim consistency
2018-12-26 13:17:30 +01:00
eb369cee4e
spec updates
...
* first attestation created!
* add hash_tree_root_final that returns an Eth2Digest
* hits the first real blocking spec bug :(
2018-12-24 10:08:11 +01:00
04314589ff
spec updates ( #45 )
...
* spec updates
* random small updates
* ssz no longer sorts by field, fix enum serialization
* rewire block processing a little to avoid a few state copies
* add a state simulation tool that writes out jsons
2018-12-21 16:37:46 -06:00
abb199d6dc
Chain creation and network simulation start script
2018-12-19 15:39:00 +02:00
0b0c66ebd9
spec updates
...
* spec-following renames
* more documentation
* simplify casper slashing
* fix block creation flow / logic
2018-12-19 14:48:25 +02:00
400ac83aa0
BLSVerify > bls_verify
2018-12-17 13:36:17 -06:00
142aa8ca8e
ssz: finish implementation ( #42 )
...
* ssz: finish implementation
* add object support, simplify implementation
* fix extra round of hashing in tree_hash_root
* ssz: cleanups
* work around Nim range bug for Uint24, cleanups
2018-12-17 19:03:53 +01:00
5dc06f4496
switch some proc to func, add some infrastructure, update based on spec name changes ( #40 )
...
* switch some proc to func, add some infrastructure, update based on spec name changes
* typo
2018-12-15 10:32:36 -06:00
aa5129b90e
simplify randao layers tests
2018-12-15 01:17:59 +02:00
b1114a94de
fix double incrementing of proposer.randao_layers
2018-12-15 01:17:59 +02:00
35ac0c4ddc
spec updates ( #39 )
...
* some minor renames
* fix some leftover block slot references (replaced by state slot)
* fix some more uint underflows
* update epoch calculations (reward et al)
* now works past 100 epochs at least with empty blocks (very slow)
2018-12-14 10:12:39 -06:00
44bb13ae46
spec updates ( #37 )
...
* use repeat_hash from spec in randao
* add some logging to state processing
* export crypto string converters in spec insulation layer
* enable block signature verification
* ssz: add support for arrays, remove custom data type code
* correctly handle previous and new block
* add trivial block processing tests
* prefer iterative repeat_hash
* state transition mostly done
* handle most specials and slashings
2018-12-13 10:00:55 -06:00
a7ee8a71bb
Sign block proposal and attestation
2018-12-13 12:58:05 +02:00
34f7254c61
fix build
2018-12-12 16:10:46 -08:00
4b1197bc17
fix one compile error
2018-12-12 13:44:18 -08:00
d48f056be9
Merge pull request #33 from status-im/gossip_sub
...
Faux implementation of GossipSub based on RLPx
2018-12-12 21:36:43 +00:00
5776393539
Fixed compilation error with newer nim
2018-12-12 12:36:20 +01:00
5b35b6c2dc
hash -> root
...
ethereum/eth2.0-specs#285
2018-12-11 15:53:18 -06:00
7ea51d5b0b
spec updates ( #34 )
...
* spec updates
* make several constants uint64 to help minimize casting
* document data type woes - will have to revisit these
* change comment style on fields and constants to make room for better
comments
* add BLSVerify and BLSAddPbkeys facades to insulate spec code from
milagro
* fix proof of possession type
* drop explicitly ordered container fields from ssz - there's an issue
open to sort this out before committing it to the spec
2018-12-11 11:55:45 -06:00
c71f89e211
Faux implementation of GossipSub based on RLPx
2018-12-10 14:06:54 +02:00
10ed2bd5b9
Comments addressed, cosmetics
2018-12-09 11:17:54 +02:00
61f81fb0c4
Some bits of randao
2018-12-09 11:17:54 +02:00
e8ec26debb
spec updates
...
* bunch of renames
* bunch of new constants
* more long variable names!
2018-12-05 20:07:04 -06:00
eba4f18f71
Merge remote-tracking branch 'origin/master' into epoch-state-2
2018-12-05 11:58:01 -06:00
f12b679880
addLocalValidators impl
2018-12-05 18:58:28 +02:00
94756cc5a2
add is_power_of_2 implementation
2018-12-05 07:19:57 -06:00
4b41010610
add more epoch processing
...
* document several parts
* almost complete epoch state processing
2018-12-04 12:45:30 -06:00
ac600d398b
spec updates
...
* lots of renames
* add some epoch processing
2018-12-03 15:41:24 -06:00
0141c84fe5
data type updates from spec ( #25 )
...
* data type updates from spec
2018-12-03 11:46:22 -06:00
6669e698b5
spec updates
...
* more work on block processing
* fix some unsigned issues
* fix ssz issue when last chunk is not full
* work around empty const seq compiler bug
* XXX -> TODO
2018-11-29 16:16:07 -06:00
a661e5afd8
call out inefficiencies and quirks for future consideration
2018-11-29 12:18:12 -06:00
4d6b068697
beacon state updates
...
* add `on_startup` genesis state constructor
* update state transition to use ssz
* update validator adder
2018-11-28 23:38:44 -06:00
e4d1bebf4d
Get the code to compiling state
2018-11-29 03:17:57 +02:00
32ebcb007a
Add more flesh to the skeleton :)
2018-11-28 22:55:31 +02:00
4920c0a357
work-in-progress beacon node skeleton (not compiling at the moment)
2018-11-28 22:55:04 +02:00
53f819689e
fix import
2018-11-28 14:01:30 -06:00
b01c51b3e2
move spec stuff to spec directory
...
helps maintain sanity in the face of spec changes
2018-11-28 13:49:03 -06:00
e63b452181
assorted fixes; some of algorithms aren't 100% updated yet, but want to get data structures in place
2018-11-27 20:23:27 -08:00
548b6922ba
introduce Eth2Hash, Eth2Digest and friends ( #22 , fixes #3 )
...
* introduce Eth2Hash, Eth2Digest and friends
2018-11-27 17:10:09 -06:00
2137b084b2
work-around a generics compilation issue
2018-11-26 18:41:03 +02:00
da22f2065f
docs & comments
...
* link to resources for shuffling
* describe get_beacon_proposer
* hints for solving init issue
2018-11-26 09:44:49 -06:00
d1839dad9a
more small fixes
...
* move consts to top
* move some functions to validator.nim
* add some validator functoin smoke tests
2018-11-23 16:44:43 -06:00
3ce94623e3
spec updates
2018-11-23 13:42:47 -06:00
9989f2fe56
"Stub" hashSSZ function for BeaconBlock ( #18 )
...
* FIx hash_ssz in the generic case
* Add a stub hash function for BeaconBlocks
2018-11-22 11:17:05 +01:00
0fe8c6762c
update data structures ( #17 )
2018-11-20 18:52:14 -06:00
7e243d57cd
ssz: documentation updates, fix fromBytesSSZ type constraint
2018-11-20 11:35:11 -06:00
6df3ec952b
hash_ssz: simplify per latest spec update
...
* update per https://github.com/ethereum/eth2.0-specs/pull/140
* join with ssz to form a single ssz module (like spec)
2018-11-20 10:43:09 -06:00
7e630bf8bf
Fixed compilation errors. Reenabled test
2018-11-19 19:09:39 +02:00
eff23ba182
Merge pull request #14 from status-im/HelperSpecUpdates
...
update some helper functions to current spec, along with a couple of data types that needed tweaking/fixing
2018-11-16 22:57:54 +00:00
949b24702c
hash_ssz: updates ( #13 )
...
* rename from tree_ssz
* add special cases for some types based on beacon chain code
* add smoke test
* avoids some trivial allocations, but the big one remains - the
temporary
chunk buffer is still heap allocated
* update to handle zero-length buffer case same as latest spec
2018-11-16 11:04:21 -06:00
d0fd1b4eb7
update some helper functions to current spec, along with a couple of data types that needed tweaking/fixing
2018-11-15 16:54:36 -08:00
8493949456
update ShardAndCommittee and CrosslinkRecord
2018-11-15 10:20:27 -08:00
b2d93f75c1
update ValidatorRecord
2018-11-15 10:16:09 -08:00
150d0b6055
rm CrystallizedState, add ShardReassignmentRecord, add BeaconState
2018-11-15 10:01:54 -08:00
9ea109ba4c
rm ActiveState
2018-11-15 08:47:56 -08:00
6a95e2c664
add AttestationSignedData
2018-11-15 08:44:52 -08:00
0b45eb5b74
update AttestationRecord
2018-11-15 08:35:25 -08:00
572b856dfd
empty start at true
2018-11-13 19:19:10 +01:00
3935d33457
Merge branch 'bls-scheme2' of https://github.com/status-im/nim-beacon-chain into bls-scheme2
2018-11-13 19:16:03 +01:00
b8a17522c0
Fix agg_pubkey initialization
2018-11-13 19:15:57 +01:00
45fb4f83a2
Merge branch 'master' into bls-scheme2
2018-11-12 17:18:14 +01:00
6a3c7d6aa5
Update for bls scheme 2
2018-11-12 10:13:24 +01:00
dab75a76a2
comment out aggregated sig + make SSZ compile again
2018-11-12 09:46:16 +01:00
786337e930
tree_ssz: naive implementation of treeHash
...
as seen in https://github.com/ethereum/eth2.0-specs/pull/120
2018-11-11 19:21:47 -06:00
5bdcee6536
document spec links
2018-11-11 19:19:58 -06:00
f389c454d6
first part of spec updating; some constants, structure changes, data type changes from int to uint ( #9 )
...
* first part of spec updating; some constants, structure changes, data type changes from int to uint
* Update beacon_chain/datatypes.nim
Co-Authored-By: tersec <tersec@users.noreply.github.com>
2018-11-09 10:34:30 +01:00
577598cca7
ssz: fix buffer overflows, explicit error reporting ( #7 )
...
* ssz: fix buffer overflows, explicit error reporting
* ssz: harden against unaligned data
2018-10-08 12:56:34 +02:00
46e8affee0
Delete outdated per_block_processing.nim
2018-10-03 13:15:17 +02:00
f60d578fb3
Signature aggregation in block processing ( #5 )
...
* signature-aggreg-in-block-processing
* Message is a Blake2 hash not simple concat
* Address comments:
- Range change in parent_hashes computation
- Slot not beind module Cycles anymore
- justified_slot part of the hash
Not addressed: using parent.slot_number instead of block.slot_number
2018-10-02 18:09:11 +02:00
99a394e084
Config CI + use Milagro BLS signatures
2018-09-26 18:26:39 +02:00
ca4082b316
Update to latest spec
2018-09-24 17:44:48 +02:00
6ddab7e9c0
basic SimpleSerialize + tests
2018-09-20 17:45:02 +02:00
a42a0ad851
Fork choice compile and run 🔥
2018-09-12 15:41:49 +02:00
acf322ea7b
Fix tables initialization issues
2018-09-11 14:02:45 +02:00
3bc75711d5
Finish network simulator
2018-09-11 12:24:46 +02:00
03b1f1a4ba
Networksim additions + fix agents and normal_distribution types
2018-09-10 12:35:11 +02:00
32dbdc860b
Mention thread-safety
2018-09-06 18:16:11 +02:00
61af4c33c7
Add a normal distribution generator for latency simulations
2018-09-06 12:31:20 +02:00
e049d9e106
Finish fork choice rule base procs
2018-09-05 12:03:52 +02:00
3d76e238e7
Fix slot and proposer type, add initBlock proc
2018-09-04 18:09:28 +02:00
0561bf70b7
Switch to proper time datatypes
2018-09-04 17:27:53 +02:00
1cb28aecc8
Implement signature and block fork choide rule
2018-09-04 16:22:10 +02:00
1f1328d019
Make sense of Ghost node Python spec dynamic polymorphism
2018-09-04 14:48:32 +02:00
f7e876471e
initial impl of fork choice rules. Main types sorted out
2018-09-03 18:42:22 +02:00
e403e96144
indices_for_slot renaming - aligning to 01abccfdbb
2018-08-24 10:20:15 +02:00
14bb9b6efd
Revamp per block processing / state transition
2018-08-21 18:21:45 +02:00
0b560f7307
Update helpers get_indices_for_slot and get_block_hash following spec fixes, see https://github.com/ethereum/beacon_chain/pull/62
2018-08-21 14:45:35 +02:00
9f0fc6817b
Update helpers to latest sped, highlight spec bugs
2018-08-17 18:21:25 +02:00
f203859316
Use Ethereum Foundation naming convention (snake_case + MACRO_CASE)
2018-08-17 18:21:10 +02:00
f8b2e790e3
sync with latest spec, closes #2
2018-08-16 12:02:59 +02:00
d65d714c3b
Stub Partial crosslink records checks
2018-07-23 18:36:02 +02:00
585072ae15
Add getCutoffs helper (buggy)
2018-07-23 16:22:37 +02:00
4c6665832b
Add the pseudo renadom shuffle
2018-07-23 14:58:41 +02:00
2438aaada8
Update everything to latest spec change from July 21
2018-07-23 12:15:56 +02:00
65dbb086d1
Add the types used in the beacon chain
2018-07-20 20:18:56 +02:00
Mamy André-Ratsimbazafy
Jacek Sieka
Yuriy Glukhov
Zahary Karadjov
Jacek Sieka
Dustin Brody
Ștefan Talpalaru
Yuriy Glukhov
Mamy Ratsimbazafy
cheatfate
Bruno Škvorc
Danny Ryan