nimbus-eth1/nimbus
Jordan Hrycaj d53eacb854
Prep for full sync after snap (#1253)
* Split fetch accounts into sub-modules

details:
  There will be separated modules for accounts snapshot, storage snapshot,
  and healing for either.

* Allow to rebase pivot before negotiated header

why:
  Peers seem to have not too many snapshots available. By setting back the
  pivot block header slightly, the chances might be higher to find more
  peers to serve this pivot. Experiment on mainnet showed that setting back
  too much (tested with 1024), the chances to find matching snapshot peers
  seem to decrease.

* Add accounts healing

* Update variable/field naming in `worker_desc` for readability

* Handle leaf nodes in accounts healing

why:
  There is no need to fetch accounts when they had been added by the
  healing process. On the flip side, these accounts must be checked for
  storage data and the batch queue updated, accordingly.

* Reorganising accounts hash ranges batch queue

why:
  The aim is to formally cover as many accounts as possible for different
  pivot state root environments. Formerly, this was tried by starting the
  accounts batch queue at a random value for each pivot (and wrapping
  around.)

  Now, each pivot environment starts with an interval set mutually
  disjunct from any interval set retrieved with other pivot state roots.

also:
  Stop fishing for more pivots in `worker` if 100% download is reached

* Reorganise/update accounts healing

why:
  Error handling was wrong and the (math. complexity of) whole process
  could be better managed.

details:
  Much of the algorithm is now documented at the top of the file
  `heal_accounts.nim`
2022-10-08 18:20:50 +01:00
..
accounts Initial implementation of the merge spec 2022-01-24 09:44:39 +02:00
db update EF test fixtures and fixes to pass all tests 2022-10-03 16:41:32 +07:00
docs.static Kludge for 'make docs' to produce pretty nim manuals 2022-01-22 08:26:57 +02:00
graphql add CORS support for HTTP local services(json-rpc, engine-api, graphql) 2022-07-19 16:12:36 +07:00
merge bump nim eth 2022-08-22 20:11:36 +07:00
p2p reduce imported but not used warning when evmc enabled 2022-10-03 16:41:33 +07:00
rpc Use rpcProxy in lc proxy (#1238) 2022-09-24 13:57:27 +02:00
sync Prep for full sync after snap (#1253) 2022-10-08 18:20:50 +01:00
transaction upgrade evmc to v10.0.0 2022-10-03 16:38:32 +07:00
utils Snap sync accounts healing (#1225) 2022-09-16 08:24:12 +01:00
vm2 reduce imported but not used warning when evmc enabled 2022-10-03 16:41:33 +07:00
block_types.nim reduce compiler warnings 2019-11-13 21:49:39 +07:00
chain_config.nim update EF test fixtures and fixes to pass all tests 2022-10-03 16:41:32 +07:00
conf_utils.nim modify hive simulators to run in CI 2022-04-21 12:01:18 +07:00
config.nim simple peer manager to handle static peers reconnection 2022-08-26 22:07:56 +07:00
constants.nim eth: adapt to smaller eth_types (#1210) 2022-09-03 20:15:35 +02:00
context.nim enhance net-key command line option to accept random, hex, and path 2022-07-30 08:46:11 +07:00
debug.nim reduce imported but not used warning when evmc enabled 2022-10-03 16:41:33 +07:00
errors.nim Redesign of BaseVMState descriptor (#923) 2022-01-18 16:19:32 +00:00
forks.nim upgrade evmc to v10.0.0 2022-10-03 16:38:32 +07:00
genesis.nim reduce imported but not used warning when evmc enabled 2022-10-03 16:41:33 +07:00
genesis_alloc.nim Added sepolia specs (#1148) 2022-07-01 21:16:26 +01:00
launcher.nim Premix-related changes 2019-01-28 12:38:23 +02:00
lightchain_shell.nim Some renames 2018-05-28 13:22:28 +03:00
makefile wire evmc to vm2 and drop legacy vm 2022-09-26 15:16:28 +07:00
nim.cfg NAT port mapping 2019-04-17 03:56:28 +02:00
nimbus.nim Isolating sync action modules (#1249) 2022-09-30 09:22:14 +01:00
peers.nim simple peer manager to handle static peers reconnection 2022-08-26 22:07:56 +07:00
sealer.nim move sealing engine gaslimit calculator to txpool 2022-08-29 16:54:59 +07:00
tracer.nim eth: adapt to smaller eth_types (#1210) 2022-09-03 20:15:35 +02:00
transaction.nim Cleanup some imports and fix some warnings in the process (#1096) 2022-05-22 22:44:15 +02:00
utils.nim initial beacon sync skeleton implementation 2022-09-17 09:08:55 +07:00
validation.nim first step into styleCheck fixes 2022-04-14 08:39:50 +07:00
version.nim dist: precompiled binaries and Docker images (#1015) 2022-03-27 13:21:15 +02:00
vm_compile_info.nim wire evmc to vm2 and drop legacy vm 2022-09-26 15:16:28 +07:00
vm_computation.nim wire evmc to vm2 and drop legacy vm 2022-09-26 15:16:28 +07:00
vm_gas_costs.nim upgrade evmc to v10.0.0 2022-10-03 16:38:32 +07:00
vm_internals.nim wire evmc to vm2 and drop legacy vm 2022-09-26 15:16:28 +07:00
vm_precompiles.nim wire evmc to vm2 and drop legacy vm 2022-09-26 15:16:28 +07:00
vm_state.nim wire evmc to vm2 and drop legacy vm 2022-09-26 15:16:28 +07:00
vm_state_transactions.nim wire evmc to vm2 and drop legacy vm 2022-09-26 15:16:28 +07:00
vm_types.nim wire evmc to vm2 and drop legacy vm 2022-09-26 15:16:28 +07:00