nimbus-eth1/nrpc
Jacek Sieka 747177df38
Stream blocks during import
When running the import, currently blocks are loaded in batches into a
large `seq` then passed to the importer as such.

In reality, blocks are still processed one by one, so the batching does
not offer any performance advantage. It does however require that the
client wastes memory, up to several GB, on the block sequence while
they're waiting to be processed.

This PR introduces a persister that accepts blocks one by one and at the
same time removes a number of redundant / unnecessary copies,
assignments and resets that were slowing down the import process in
general.
2024-12-12 16:55:25 +01:00
..
config.nim `external_sync` rename to `sync` (#2789) 2024-10-27 13:23:32 +00:00
nim.cfg External syncer (#2574) 2024-09-29 18:48:11 +02:00
nrpc.nim Stream blocks during import 2024-12-12 16:55:25 +01:00