status-im
/
nimbus-eth1
mirror of https://github.com/status-im/nimbus-eth1.git
2
0
Fork 0
Code Issues Projects Releases Wiki Activity
nimbus-eth1/tests
History
Jacek Sieka 7bbb0f4421
Stream blocks during import (#2937) 
When running the import, currently blocks are loaded in batches into a
`seq` then passed to the importer as such.

In reality, blocks are still processed one by one, so the batching does
not offer any performance advantage. It does however require that the
client wastes memory, up to several GB, on the block sequence while
they're waiting to be processed.

This PR introduces a persister that accepts these potentially large
blocks one by one and at the same time removes a number of redundant /
unnecessary copies, assignments and resets that were slowing down the
import process in general.
 		2024-12-18 13:21:20 +01:00
..
bootstrap config: fix new config based on input from jamie and zahary 2021-09-18 17:34:51 +07:00
customgenesis Remove totalTerminalDifficultyPassed (#2934) 2024-12-13 13:29:00 +07:00
db Added support for namespaces to RocksDb kvstore. (#2066) 2024-03-12 11:04:46 +08:00
engine_api Revert "Adopt latest changes to requests hash computation" (#2892) 2024-11-29 16:13:08 +07:00
fixtures Remove persist block test (#2935) 2024-12-13 14:31:20 +07:00
graphql Workaround for 0 gas price estimation (#2180) 2024-05-28 13:36:38 +07:00
invalid_keystore Fix keystore loader bug (#2774) 2024-10-24 04:07:06 +00:00
keystore implement more eth rpc and keystore management 2020-07-23 14:54:32 +07:00
replay Stream blocks during import (#2937) 2024-12-18 13:21:20 +01:00
test_aristo Remove `forkTx` and friends (#2951) 2024-12-18 11:56:46 +01:00
test_coredb Reduce getCanonicalHead usage, and delegate to ForkedChain (#2948) 2024-12-18 11:04:23 +07:00
test_forked_chain Fc module can update base also when on parent arc (#2911) 2024-12-05 13:01:57 +07:00
test_jwt_auth Enable JWT authentication for websockets (#1039) 2022-04-06 15:11:13 +01:00
test_txpool Offload signature checking to taskpools (#2927) 2024-12-13 11:53:41 +07:00
all_tests.nim Remove persist block test (#2935) 2024-12-13 14:31:20 +07:00
all_tests_macro.nim Cache code and invalid jump destination tables (fixes #2268) (#2404) 2024-06-21 09:44:10 +02:00
asynctest.nim Core db and aristo updates for destructor and tx logic (#1894) 2023-11-16 19:35:03 +00:00
macro_assembler.nim Offload signature checking to taskpools (#2927) 2024-12-13 11:53:41 +07:00
nim.cfg import: read from era files (#2254) 2024-05-31 09:13:56 +02:00
test_allowed_to_fail.nim ForkedChain implementation (#2405) 2024-06-26 07:27:48 +07:00
test_aristo.nim Remove `forkTx` and friends (#2951) 2024-12-18 11:56:46 +01:00
test_block_fixture.nim replace deprecated types (#2704) 2024-10-16 08:34:12 +07:00
test_blockchain_json.nim Reduce getCanonicalHead usage, and delegate to ForkedChain (#2948) 2024-12-18 11:04:23 +07:00
test_config.nim Bump nim-eth, nim-web3, nimbus-eth2 (#2344) 2024-06-14 14:31:08 +07:00
test_configuration.nim Move rlp block import into it's own subcommand (#2904) 2024-12-04 20:36:07 +07:00
test_coredb.nim Offload signature checking to taskpools (#2927) 2024-12-13 11:53:41 +07:00
test_coredb.nim.cfg Store keys together with node data (#2849) 2024-11-20 09:56:27 +01:00
test_difficulty.nim switch to Nim v2.0.12 (#2817) 2024-11-01 19:06:26 +00:00
test_engine_api.nim Wire ForkedChainRef properly to TxPool (#2933) 2024-12-13 13:21:20 +07:00
test_evm_support.nim Offload signature checking to taskpools (#2927) 2024-12-13 11:53:41 +07:00
test_filters.nim replace deprecated types (#2704) 2024-10-16 08:34:12 +07:00
test_forked_chain.nim Offload signature checking to taskpools (#2927) 2024-12-13 11:53:41 +07:00
test_forkid.nim Remove MergeForkBlock alias and use MergeNetSplitBlock only (#2947) 2024-12-17 11:42:13 +00:00
test_generalstate_json.nim Offload signature checking to taskpools (#2927) 2024-12-13 11:53:41 +07:00
test_genesis.nim Remove MergeForkBlock alias and use MergeNetSplitBlock only (#2947) 2024-12-17 11:42:13 +00:00
test_getproof_json.nim Remove trie_defs imports (#2872) 2024-11-25 16:37:57 +01:00
test_graphql.nim Wire ForkedChainRef to graphql and rpc_utils (#2936) 2024-12-13 14:34:32 +07:00
test_helpers.nim switch to Nim v2.0.12 (#2817) 2024-11-01 19:06:26 +00:00
test_jwt_auth.nim replace deprecated types (#2704) 2024-10-16 08:34:12 +07:00
test_ledger.nim Reduce getCanonicalHead usage, and delegate to ForkedChain (#2948) 2024-12-18 11:04:23 +07:00
test_multi_keys.nim Cleanup stateless and block witness code. (#2295) 2024-06-08 15:05:00 +07:00
test_op_arith.nim Fix styles and reduce compiler warnings (#2086) 2024-03-20 14:35:38 +07:00
test_op_bit.nim Fix styles and reduce compiler warnings (#2086) 2024-03-20 14:35:38 +07:00
test_op_custom.nim Fix styles and reduce compiler warnings (#2086) 2024-03-20 14:35:38 +07:00
test_op_env.nim post-merge nrpc fix (#2685) 2024-10-03 11:42:24 +00:00
test_op_memory.nim switch to Nim v2.0.12 (#2817) 2024-11-01 19:06:26 +00:00
test_op_misc.nim Fix styles and reduce compiler warnings (#2086) 2024-03-20 14:35:38 +07:00
test_precompiles.nim Offload signature checking to taskpools (#2927) 2024-12-13 11:53:41 +07:00
test_rpc.nim Reduce getCanonicalHead usage, and delegate to ForkedChain (#2948) 2024-12-18 11:04:23 +07:00
test_tools_build.nim Remove `hunter` (#2697) 2024-10-06 10:11:44 +00:00
test_tracer_json.nim Offload signature checking to taskpools (#2927) 2024-12-13 11:53:41 +07:00
test_transaction_json.nim Unify tx validation (#2777) 2024-10-26 09:19:48 +02:00
test_txpool.nim Bump nim-eth and nimbus-eth2 (#2741) 2024-10-16 13:51:38 +07:00
test_txpool2.nim Reduce getCanonicalHead usage, and delegate to ForkedChain (#2948) 2024-12-18 11:04:23 +07:00
tracerTestGen.nim Offload signature checking to taskpools (#2927) 2024-12-13 11:53:41 +07:00