nimbus-eth1/fluffy/eth_data
Jacek Sieka 7bbb0f4421
Stream blocks during import (#2937)
When running the import, currently blocks are loaded in batches into a
`seq` then passed to the importer as such.

In reality, blocks are still processed one by one, so the batching does
not offer any performance advantage. It does however require that the
client wastes memory, up to several GB, on the block sequence while
they're waiting to be processed.

This PR introduces a persister that accepts these potentially large
blocks one by one and at the same time removes a number of redundant /
unnecessary copies, assignments and resets that were slowing down the
import process in general.
2024-12-18 13:21:20 +01:00
..
era1.nim Stream blocks during import (#2937) 2024-12-18 13:21:20 +01:00
history_data_json_store.nim simplify genesis generation code (#2786) 2024-10-26 16:26:38 +07:00
history_data_seeding.nim Remove old portal_debug API for seeding data into the network (#2726) 2024-10-10 16:42:57 +02:00
history_data_ssz_e2s.nim Fix eth/common & web3 related deprecation warnings for fluffy (#2698) 2024-10-04 23:21:26 +02:00
yaml_eth_types.nim Rework beacon block proofs to better structure (#2493) 2024-07-17 11:32:05 +02:00
yaml_utils.nim bump nimbus-build-system to use Nim v2.0.10 (#2684) 2024-10-06 12:15:54 +00:00