nimbus-eth1/fluffy
Jacek Sieka 7bbb0f4421
Stream blocks during import (#2937)
When running the import, currently blocks are loaded in batches into a
`seq` then passed to the importer as such.

In reality, blocks are still processed one by one, so the batching does
not offer any performance advantage. It does however require that the
client wastes memory, up to several GB, on the block sequence while
they're waiting to be processed.

This PR introduces a persister that accepts these potentially large
blocks one by one and at the same time removes a number of redundant /
unnecessary copies, assignments and resets that were slowing down the
import process in general.
2024-12-18 13:21:20 +01:00
..
common Refactor/clean-up/prepping history network code (#2836) 2024-11-06 08:49:55 +01:00
database Stream blocks during import (#2937) 2024-12-18 13:21:20 +01:00
docs/the_fluffy_book Remove Portal beacon-lc-bridge (#2897) 2024-12-02 17:30:17 +01:00
eth_data Stream blocks during import (#2937) 2024-12-18 13:21:20 +01:00
grafana Update Grafana dashboard for Portal (#2727) 2024-10-10 20:11:04 +02:00
network Fluffy: Fix broken portal hive tests (#2917) 2024-12-06 23:53:15 +08:00
rpc Fluffy: Implement poke in state network (#2750) 2024-11-28 20:33:57 +08:00
scripts fluffy: revert iplimit/bitperhop debug flags (#2860) 2024-11-21 13:36:18 +01:00
tests Fluffy: Portal stream improvements and pending transfers prune fix (#2900) 2024-12-04 08:34:13 +08:00
tools Stream blocks during import (#2937) 2024-12-18 13:21:20 +01:00
README.md Dead link fixes and other small improvements to the fluffy book (#1859) 2023-10-25 13:23:17 +02:00
conf.nim Fluffy: Make the Kademlia concurrency factor configurable via a debug parameter (#2868) 2024-11-25 20:16:27 +08:00
fluffy.nim Fluffy: Make the Kademlia concurrency factor configurable via a debug parameter (#2868) 2024-11-25 20:16:27 +08:00
fluffy.nim.cfg Simplify aristo tree deletion functionality (#2563) 2024-08-14 12:09:30 +00:00
logging.nim Remove duplicate logging code from fluffy (#2488) 2024-07-15 11:41:17 +02:00
network_metadata.nim Remove MergeForkBlock alias and use MergeNetSplitBlock only (#2947) 2024-12-17 11:42:13 +00:00
nim.cfg Remove PREFER_BLST_SHA256 disable, allowing for BLST SHA256 in SSZ (#2686) 2024-10-03 14:25:30 +02:00
portal_node.nim fluffy/portal: Add missing imports (#2851) 2024-11-19 15:38:10 +01:00
version.nim Formatting fluffy with nph v0.5.1 + CI check (#2020) 2024-02-28 18:31:45 +01:00

README.md

Fluffy: The Nimbus Portal Network Client

Fluffy CI Stability: experimental License: Apache License: MIT

Discord: Nimbus Status: #nimbus-general

Introduction

Fluffy is the Nimbus client implementation of the Portal network specifications.

You can find all the information you need to run a Fluffy node in The Fluffy Book.

The quickstart page in particular will help you to get quickly connected to the Portal network.

Development Updates

Monthly development updates are shared here.

To keep up to date with changes and development progress, follow the Nimbus blog.

License

Licensed and distributed under either of

or

at your option. These files may not be copied, modified, or distributed except according to those terms.