nimbus-eth1/nrpc
Jacek Sieka 7bbb0f4421
Stream blocks during import (#2937)
When running the import, currently blocks are loaded in batches into a
`seq` then passed to the importer as such.

In reality, blocks are still processed one by one, so the batching does
not offer any performance advantage. It does however require that the
client wastes memory, up to several GB, on the block sequence while
they're waiting to be processed.

This PR introduces a persister that accepts these potentially large
blocks one by one and at the same time removes a number of redundant /
unnecessary copies, assignments and resets that were slowing down the
import process in general.
2024-12-18 13:21:20 +01:00
..
config.nim `external_sync` rename to `sync` (#2789) 2024-10-27 13:23:32 +00:00
nim.cfg External syncer (#2574) 2024-09-29 18:48:11 +02:00
nrpc.nim Stream blocks during import (#2937) 2024-12-18 13:21:20 +01:00