nimbus-eth2/tests
Jacek Sieka 4ed2e34a9e Revamp attestation pool
This is a revamp of the attestation pool that cleans up several aspects
of attestation processing as the network grows larger and block space
becomes more precious.

The aim is to better exploit the divide between attestation subnets and
aggregations by keeping the two kinds separate until it's time to either
produce a block or aggregate. This means we're no longer eagerly
combining single-vote attestations, but rather wait until the last
moment, and then try to add singles to all aggregates, including those
coming from the network.

Importantly, the branch improves on poor aggregate quality and poor
attestation packing in cases where block space is running out.

A basic greed scoring mechanism is used to select attestations for
blocks - attestations are added based on how much many new votes they
bring to the table.

* Collect single-vote attestations separately and store these until it's
time to make aggregates
* Create aggregates based on single-vote attestations
* Select _best_ aggregate rather than _first_ aggregate when on
aggregation duty
* Top up all aggregates with singles when it's time make the attestation
cut, thus improving the chances of grabbing the best aggregates out
there
* Improve aggregation test coverage
* Improve bitseq operations
* Simplify aggregate signature creation
* Make attestation cache temporary instead of storing it in attestation
pool - most of the time, blocks are not being produced, no need to keep
the data around
* Remove redundant aggregate storage that was used only for RPC
* Use tables to avoid some linear seeks when looking up attestation data
* Fix long cleanup on large slot jumps
* Avoid some pointers
* Speed up iterating all attestations for a slot (fixes #2490)
2021-04-13 20:24:02 +03:00
..
fork_choice Fork choice - almost free pruning - fix #1534 (#1535) 2020-08-26 17:23:34 +02:00
fuzzing Clarify that the deposit cretion tools are intended for testnets 2021-04-08 19:58:22 +03:00
helpers remove {.inline.} pragmas (#2033) 2020-11-20 11:00:22 +01:00
mocking Revamp attestation pool 2021-04-13 20:24:02 +03:00
official Reset cached indices when resetting cache on SSZ read (#2480) 2021-04-08 13:11:04 +03:00
simulation Remove `-d:insecure` compile option (#2468) 2021-04-01 14:44:11 +02:00
slashing_protection remove unused imports in slashing prtection (#2436) 2021-03-19 08:26:02 +00:00
spec_block_processing Move SSZ, deposit_contracts & eth1_monitor [reorg files 3/5] (#2371) 2021-03-03 07:23:05 +01:00
spec_epoch_processing openarray -> openArray 2020-11-03 23:23:10 +02:00
all_tests.nim Add discovery query with forkId and attnets filter (#2420) 2021-03-24 11:48:53 +01:00
all_tests.nim.cfg Rename binaries; Mimic the original repo layout in the distribution 2020-11-09 11:38:52 +02:00
test_attestation_pool.nim Revamp attestation pool 2021-04-13 20:24:02 +03:00
test_beacon_chain_db.nim Write state diffs to separate table (and experimentally, files instead of db) (#2460) 2021-04-06 21:56:45 +03:00
test_beacon_node.nim Rename binaries; Mimic the original repo layout in the distribution 2020-11-09 11:38:52 +02:00
test_beaconstate.nim Prefer converting int` to uint64 and switch foo.len.uint64 to .len64 (#1375) 2020-07-26 20:55:48 +02:00
test_bitseqs.nim Revamp attestation pool 2021-04-13 20:24:02 +03:00
test_block_pool.nim Revamp attestation pool 2021-04-13 20:24:02 +03:00
test_datatypes.nim Address review comments; Add a test 2020-07-12 21:01:31 +03:00
test_discovery.nim update some v1.1.0 alpha1 to alpha2 (#2457) 2021-03-29 19:17:48 +00:00
test_eth1_monitor.nim Move SSZ, deposit_contracts & eth1_monitor [reorg files 3/5] (#2371) 2021-03-03 07:23:05 +01:00
test_exit_pool.nim Consensus object pools [reorg 4/5] (#2374) 2021-03-04 10:13:44 +01:00
test_helpers.nim Generate markdown test reports 2020-03-13 14:38:59 +00:00
test_honest_validator.nim centralize p2p validation in a single file and address https://github.com/status-im/nimbus-eth2/pull/2377#issuecomment-791313118 (#2383) 2021-03-06 08:32:55 +01:00
test_interop.nim Move SSZ, deposit_contracts & eth1_monitor [reorg files 3/5] (#2371) 2021-03-03 07:23:05 +01:00
test_keystore.nim Fix #1855; Add support for wallet recovery passwords 2020-10-30 23:56:04 +02:00
test_peer_pool.nim Reorg (5/5) (#2377) 2021-03-05 14:12:00 +01:00
test_ssz.nim Reset cached indices when resetting cache on SSZ read (#2480) 2021-04-08 13:11:04 +03:00
test_ssz_merkleization.nim Move SSZ, deposit_contracts & eth1_monitor [reorg files 3/5] (#2371) 2021-03-03 07:23:05 +01:00
test_state_transition.nim address some TODOs (#2005) 2020-11-12 19:24:07 +00:00
test_statediff.nim immutable validator database factoring (#2297) 2021-03-15 14:11:51 +00:00
test_sync_manager.nim ncli_db pruneDatabase checkpointing; remove onSlotEnd lookaheadTime 2021-03-12 23:15:46 +02:00
test_sync_manager.nim.cfg Split Eth2Processor in prep for batching (#2396) 2021-03-11 11:10:57 +01:00
test_sync_protocol.nim Consolidate modules by areas [part 1] (#2365) 2021-03-02 11:27:45 +01:00
test_zero_signature.nim performance fixes (#2259) 2021-01-25 13:04:18 +01:00
testblockutil.nim Revamp attestation pool 2021-04-13 20:24:02 +03:00
teststateutil.nim immutable validator database factoring (#2297) 2021-03-15 14:11:51 +00:00
testutil.nim Write state diffs to separate table (and experimentally, files instead of db) (#2460) 2021-04-06 21:56:45 +03:00