nimbus-eth1/tests/replay
Jordan Hrycaj e14fd4b96c
Prep for full sync after snap make 6 (#1291)
* Update log ticker, using time interval rather than ticker count

why:
  Counting and logging ticker occurrences is inherently imprecise. So
  time intervals are used.

* Use separate storage tables for snap sync data

* Left boundary proof update

why:
  Was not properly implemented, yet.

* Capture pivot in peer worker (aka buddy) tasks

why:
  The pivot environment is linked to the `buddy` descriptor. While
  there is a task switch, the pivot may change. So it is passed on as
  function argument `env` rather than retrieved from the buddy at
  the start of a sub-function.

* Split queues `fetchStorage` into `fetchStorageFull` and `fetchStoragePart`

* Remove obsolete account range returned from `GetAccountRange` message

why:
  Handler returned the wrong right value of the range. This range was
  for convenience, only.

* Prioritise storage slots if the queue becomes large

why:
  Currently, accounts processing is prioritised up until all accounts
  are downloaded. The new prioritisation has two thresholds for
  + start processing storage slots with a new worker
  + stop account processing and switch to storage processing

also:
  Provide api for `SnapTodoRanges` pair of range sets in `worker_desc.nim`

* Generalise left boundary proof for accounts or storage slots.

why:
  Detailed explanation how this works is documented with
  `snapdb_accounts.importAccounts()`.

  Instead of enforcing a left boundary proof (which is still the default),
  the importer functions return a list of `holes` (aka node paths) found in
  the argument ranges of leaf nodes. This in turn is used by the book
   keeping software for data download.

* Forgot to pass on variable in function wrapper

also:
  + Start healing not before 99% accounts covered (previously 95%)
  + Logging updated/prettified
2022-11-08 18:56:04 +00:00
..
goerli68161.txt.gz Redesign of BaseVMState descriptor (#923) 2022-01-18 16:19:32 +00:00
gunzip.nim Redesign of BaseVMState descriptor (#923) 2022-01-18 16:19:32 +00:00
mainspecs2k.txt.gz Exported blobs and some scripts to parallel project nimbus-eth1-blobs (#995) 2022-03-16 09:13:17 +00:00
pp.nim Snap accounts bulk import preparer (#1183) 2022-08-04 09:04:30 +01:00
pp_light.nim eth: adapt to smaller eth_types (#1210) 2022-09-03 20:15:35 +02:00
undump_accounts.nim Prep for full sync after snap make 4 (#1282) 2022-10-27 14:49:28 +01:00
undump_blocks.nim eth: adapt to smaller eth_types (#1210) 2022-09-03 20:15:35 +02:00
undump_storages.nim Prep for full sync after snap make 6 (#1291) 2022-11-08 18:56:04 +00:00