nimbus-eth1/fluffy/tools/portal_bridge
Jacek Sieka 7bbb0f4421
Stream blocks during import (#2937)
When running the import, currently blocks are loaded in batches into a
`seq` then passed to the importer as such.

In reality, blocks are still processed one by one, so the batching does
not offer any performance advantage. It does however require that the
client wastes memory, up to several GB, on the block sequence while
they're waiting to be processed.

This PR introduces a persister that accepts these potentially large
blocks one by one and at the same time removes a number of redundant /
unnecessary copies, assignments and resets that were slowing down the
import process in general.
2024-12-18 13:21:20 +01:00
..
state_bridge Fluffy: Cleanup state bridge preimages backend and add logging for transfer limit reached (#2896) 2024-12-02 16:09:43 +08:00
nim.cfg Fluffy State Bridge: Fetch portal client nodeId on startup and sort offers by distance from nodeId (#2570) 2024-08-19 20:49:07 +08:00
portal_bridge.nim Remove duplicate logging code from fluffy (#2488) 2024-07-15 11:41:17 +02:00
portal_bridge_beacon.nim Add validation on gossip of LC updates as per spec (#2528) 2024-07-26 18:56:32 +02:00
portal_bridge_common.nim Fluffy State Bridge: Support running without an EL for block ranges where we have the state diffs in the database (#2920) 2024-12-09 21:57:41 +08:00
portal_bridge_conf.nim Fluffy State Bridge: Support skipping gossip when content is found in the network (#2867) 2024-11-25 11:40:09 +08:00
portal_bridge_history.nim Stream blocks during import (#2937) 2024-12-18 13:21:20 +01:00
portal_bridge_state.nim Fluffy State Bridge: Support running without an EL for block ranges where we have the state diffs in the database (#2920) 2024-12-09 21:57:41 +08:00