76f15302a7
better timesharing in eth2 processor
...
* use `idleAsync` to more evenly divide cpu attention when syncing in
particular - this gives networking better latency
* more strict exception handling in eth2_processor
2021-01-18 22:27:34 +02:00
a0689e4237
auto-bump nim-libp2p ( #2239 )
...
Co-authored-by: = <sinkingsugar@users.noreply.github.com>
2021-01-15 21:15:58 +09:00
bb0a022968
auto-bump nim-libp2p ( #2238 )
...
Co-authored-by: = <sinkingsugar@users.noreply.github.com>
2021-01-15 15:50:14 +09:00
295e3c9c73
Topics validation and direct peers ( #2237 )
...
* pick the right libp2p branch
* add topics validation
2021-01-15 04:17:06 +00:00
ce64da1fcd
auto-bump nim-libp2p ( #2235 )
...
Co-authored-by: = <arnetheduck@users.noreply.github.com>
2021-01-15 01:39:09 +00:00
66d8f317cd
Use async queryRandom instead of inefficient randomNodes to discover nodes ( #2211 )
2021-01-14 08:58:13 +01:00
f5efcc8669
auto-bump nim-libp2p ( #2228 )
...
Co-authored-by: = <sinkingsugar@users.noreply.github.com>
2021-01-12 04:27:32 +01:00
be3fac8495
auto-bump nim-libp2p ( #2206 )
...
Co-authored-by: = <sinkingsugar@users.noreply.github.com>
2021-01-11 09:53:20 +01:00
93b434d0ac
bumps ( #2214 )
...
* bumps
several modules pinned to merged branches
* faststreams master broken, go back
2021-01-07 13:12:37 +01:00
e58a355a1c
CI release: ARM and ARM64 builds ( #2213 )
2021-01-07 10:19:29 +01:00
52ca12c79f
bump nat, avoid one more finalizer ( #2209 )
2020-12-31 15:58:31 +01:00
ed24f60f70
remove async from sub/unsub ( #2197 )
...
* remove await/async from sub/unsub
* fix unsubscribe wrong key (missed _snappy)
* use the right libp2p commit hash
* remove unused async
* fix inspector
* fix subnet calculation in RPC and insert broadcast attestations into node's pool
* unify codepaths to ensure only mostly-checked-to-be-valid attestations enter the pool, even from node's own broadcasts
* update attestation pool tests for new validateAttestation param
Co-authored-by: Dustin Brody <tersec@users.noreply.github.com>
2020-12-24 09:48:52 +01:00
0f8a3a5ae8
checkpoint database at end of each slot ( #2195 )
...
* checkpoint database at end of each slot
To avoid spending time on synchronizing with the file system while doing
processing, the manual checkpointing mode turns off fsync during
processing and instead checkpoints the database when the slot has ended.
From an sqlite perspecitve, in WAL mode this guaranees database
consistency but may lead to data loss which is fine - anything missing
from the beacon chain database can be recovered on the next startup.
* log sync status and delay in slot start message
* bump
2020-12-18 22:01:24 +01:00
452042b17b
msgid formatting, libp2p bump ( #2198 )
...
* msgid formatting, libp2p bump
* fix libp2p commit
2020-12-18 18:45:27 +00:00
ca2a09d424
bump secp
2020-12-16 19:41:12 +02:00
ff23ca27c2
bump vendor/nimbus-benchmarking
2020-12-16 14:11:11 +01:00
b0086c5d99
bump libp2p ( #2187 )
...
* bump libp2p
* also stew
2020-12-16 09:36:51 +01:00
4e191a06ac
use stew/leb128
...
* 3 varint parsers -> 1
* 1/3 memory usage / allocations when writing stuff to libp2p
2020-12-15 17:06:15 +02:00
e52c88386b
build warnings ( #2179 )
2020-12-14 16:45:31 +00:00
f49fcb9df3
Bump nim-eth for discovery v5 ip limits ( #2085 )
2020-12-11 14:35:08 +01:00
e59437c5e2
new Make target: "benchmarks" ( #2174 )
...
It runs some benchmarks, collects the output and generates HTML charts.
2020-12-11 12:12:43 +01:00
2b3b219c77
Bump blst: perf + 32-bit platforms support + pure C fallback + drop Miracl fallback tests ( #2152 )
...
* bump BLST
* Cached subgroup checks
* Bump BLST - BLST now has pure C fallback for all arch (Miracl unneeded)
* Drop testing Miracl fallback in Nimbus
* Charting uncharted waters: 32-bit should imply -mno-adx
2020-12-10 10:18:07 +01:00
c4d9d5f64e
bump nim-stew (no change)
2020-12-09 17:24:25 +01:00
0b33183341
bumps ( #2154 )
...
* avoid dangling cstring returns in Result, fixing some low-risk crash
potential
* bump libp2p for connection race fix and a few cleanups
2020-12-07 17:09:05 +01:00
4feb0a308e
Fix #2125 (ETH status bar display); Bump LibP2P
2020-12-02 00:03:59 +02:00
4eaf29875a
Less risk for Eth1-induced delays in block proposal
2020-12-01 15:38:50 +02:00
38f7558e50
Work around a strange codegen issue to fix local sim in CI; Bump LibP2P
2020-12-01 15:38:00 +02:00
7e4fd325b5
bump nim-libp2p
2020-11-29 14:47:19 +01:00
e1fb2d98fb
auto-bump nim-libp2p
2020-11-28 09:20:02 +00:00
d16e127daf
Peer stuff ( #2084 )
...
* Revert "Revert "Full "node" RPC calls implementation and fixes to peer lifetime states. (#2065 )" (#2082 )"
This reverts commit 7cc3dc8027
2020-11-26 20:23:45 +01:00
9b9aa93cd4
Seenttl by spec ( #2083 )
...
* add rpc call to get chronos futures at runtime
* add seenTTL gossip parameter
Co-authored-by: Jacek Sieka <jacek@status.im>
2020-11-26 13:08:22 +01:00
7cc3dc8027
Revert "Full "node" RPC calls implementation and fixes to peer lifetime states. ( #2065 )" ( #2082 )
...
This reverts commit d041287a4f
2020-11-26 09:05:23 +01:00
d041287a4f
Full "node" RPC calls implementation and fixes to peer lifetime states. ( #2065 )
...
* Initial commit.
* Fix log lines and compilation error.
* Add get_v1_node_peers() implementation.
* Fix peer's lifetime states.
* Use the most recent multiaddress.
* Fix assign NewPeerScore again.
Fix compilation error with last seen address.
Fix Peer upgraded log line place.
* syncing, health, peer_count, peer_id and fixes for identity.
* Fix compilation problems.
* Move object declaration to callsigs.
Fix identity addresses fields.
* Finish node RPC calls.
* Avoid leak of lifetime future.
* Bump chronos.
* Fix json generator problem.
2020-11-26 08:09:59 +01:00
7fdafa65ee
New bootstrap nodes for Mainnet
2020-11-25 21:27:40 +02:00
372c9b798c
Fix the corrupted database state on Pyrmont nodes; Add mainnet genesis ( #2056 )
...
* Handle some web3 timeouts better
* Add support for developer .env files
* Eth1 improvements; Mainnet genesis state
Notable changes:
* The deposits table have been removed from the database. The client
will no longer process all deposits on start-up.
* The network metadata now includes a "state snapshot" of the deposit
contract. This allows the client to skip syncing deposits made prior
to the snapshot (i.e. genesis). Suitable metadata added for Pyrmont
and Mainnet.
* The Eth1 monitor won't be started unless there are validators attached
to the node.
* The genesis detection code is now optional and disabled by default
* Bugfix: The client should not produce blocks that will fail validation
when it hasn't downloaded the latest deposits yet
* Bugfix: Work around the database corruption affecting Pyrmont nodes
* Remove metadata for Toledo and Medalla
2020-11-24 22:21:47 +01:00
f2722ed866
auto-bump nim-libp2p ( #2064 )
...
Co-authored-by: = <dryajov@users.noreply.github.com>
2020-11-24 12:38:18 +01:00
0856f0539a
auto-bump nim-libp2p ( #2036 )
...
Co-authored-by: = <dryajov@users.noreply.github.com>
2020-11-23 10:38:34 +01:00
d232f16b40
Add more eth1-related logging
2020-11-20 17:13:51 +02:00
e370e80aee
Add more Pyrmont bootstrap nodes
2020-11-18 14:40:45 +02:00
28369574b7
Bump `nim-chronos` to fix write() deadlocks. ( #2037 )
2020-11-18 11:39:15 +01:00
ebfacf597c
Review and fix some usages of Future.cancel; Bump Chronos
2020-11-18 00:27:21 +02:00
4479c0a9f1
fix some libp2p channel hangs ( #2032 )
...
* fix some libp2p channel hangs
* make sure no concurrent reads are issues by awaiting cancellations
* bumps with fixes
* merge bump
2020-11-17 16:07:05 +01:00
a6b188bfd4
misc fixes ( #2027 )
...
* log when database is loading (to avoid confusion)
* generate network keys later during startup
* fix quarantine not scheduling chain of parents for download and
increase size to one epoch
* log validator count, enr and peerid more clearly on startup
2020-11-16 20:15:43 +01:00
5b011b65ae
add rpc call to get chronos futures at runtime
2020-11-16 12:31:39 +02:00
eb76d650f6
Add genesis state for Pyrmont
2020-11-15 21:40:40 +02:00
d02d8f8d51
Drop UseDiscv51 flag and only support discovery v5.1
2020-11-14 19:12:30 +02:00
602f344525
remove v0.12.3 EF test vectors to save 2.7GB of space in CI instances ( #2017 )
2020-11-13 22:16:56 +01:00
ab8f8ccaba
clean up dependencies ( #2008 )
...
* clean up dependencies
* use non-prce-mode for metrics
* clean up obsolete snappy and gflags deps from manuals
* conditional pcre
2020-11-13 16:00:45 +01:00
80ca7a2d9f
Implement #1768
2020-11-12 22:29:43 +02:00
8ad45de65b
Add makefile targets for Pyrmont
2020-11-12 21:51:15 +02:00
08da65edea
Latest toledo metadata
2020-11-10 14:11:31 +02:00
52043a8fe7
Toledo genesis state
2020-11-10 00:56:46 +02:00
a010ef2061
update tests from v1.0.0-rc.0 to v1.0.0 ( #1976 )
2020-11-09 17:44:18 +00:00
2343934bc8
Add backwards compatibility target for signing_process
2020-11-09 14:40:06 +02:00
94e9ce3c1f
Add metadata for the toledo network
2020-11-09 11:38:52 +02:00
aaf20c1554
bump libp2p ( #1963 )
2020-11-06 13:18:16 +01:00
18639c3eff
Don't require requests that might fail on non-archive Geth nodes
2020-11-03 23:23:10 +02:00
ee663d9fc2
move libp2p back a few commits ( #1948 )
...
to see if it helps with connectivity issues
2020-11-03 17:04:16 +01:00
937decb0e9
Revert "Gossip11 post audit ( #1917 )" ( #1947 )
...
This reverts commit 63173ab2c1
2020-11-03 11:45:40 +01:00
446f8cc738
auto-bump nim-libp2p ( #1934 )
...
Co-authored-by: = <dryajov@users.noreply.github.com>
2020-11-01 23:04:05 +01:00
9e3ca74ee0
auto-bump nim-libp2p ( #1930 )
...
Co-authored-by: = <sinkingsugar@users.noreply.github.com>
2020-10-31 15:06:18 +09:00
63173ab2c1
Gossip11 post audit ( #1917 )
...
* bump libp2p gossip
* use gossip 1.1
* use proper libp2p commit hash
* switch to master libp2p, has audit fixes now
2020-10-30 14:26:35 +00:00
8d998a5a8b
auto-bump nim-libp2p ( #1914 )
...
Co-authored-by: = <dryajov@users.noreply.github.com>
2020-10-30 13:35:01 +01:00
2396417581
bump nim-libbacktrace ( #1799 )
...
so stack traces work with LTO
2020-10-27 13:09:03 +01:00
eee01a32d5
Regression fix of eth2_network_simulation on Windows. ( #1900 )
...
* Concentrate all sensitive writeFile/createPath calls in one place.
Fix eth2_network_simulation for Windows.
* Remove artifacts.
* fix import
Co-authored-by: Jacek Sieka <jacek@status.im>
2020-10-27 12:04:17 +01:00
677f099110
BLS signature v4 ( #1912 )
2020-10-27 09:37:04 +01:00
8102d5dc4d
Bump eth2-testnets for more discv5.1 bootstrap nodes on medalla ( #1911 )
...
And improve logging UX a bit by ignoring comments or newlines
2020-10-27 08:44:46 +01:00
756b62fdf5
Bump nim-eth to get UseDiscv51 flag ( #1895 )
...
* Bump nim-eth to get UseDiscv51 flag
* Switch medalla to discovery v5.1, other targets to v5.0
* Bump nim-eth for better discv5.1 logging
* Bump eth2-testnets for updated medalla bootnodes
2020-10-23 18:59:58 +02:00
decfd66a78
bump libp2p: seq[byte] message IDs and improve reject/ignore handling ( #1898 )
...
* bump libp2p: use seq[byte] message IDs and improve reject/ignore handling
* bump libp2p to pick up debug message details
2020-10-21 20:03:12 +00:00
a136c2e95a
bump libp2p; integrate pubsub.ValidationResult into extended validation ( #1893 )
2020-10-20 12:31:20 +00:00
dbc90e998a
Add Disc v5.1 bootstrap nodes for Zinken
...
Also prepares the Makefiles for supporting Medalla
through a separate binary
2020-10-18 12:44:52 +03:00
d98be078c3
Address #1690 Min password entropy
2020-10-16 19:34:26 +03:00
7ad59b1852
Bump nim-stew.
2020-10-15 20:18:33 +03:00
84fe294c00
Fix protection of data folder and security files using Windows ACL.
2020-10-15 20:18:33 +03:00
ce1fda1195
Store the deposits and the immutable validator data in Sqlite
2020-10-15 20:15:51 +03:00
e6320e5881
Address #1584 Don't keep all deposits in memory (persist them to disk)
2020-10-15 20:15:51 +03:00
8ce0fc3a89
Address #1687
...
This addresses the issues by detecting and rejecting keystores with
incorrect PBKDF2 and SCrypt params. It also bumps the version of
nim-json-serialization to include a bugfix for incorrect parsing
of json files featuring comments.
2020-10-15 20:15:51 +03:00
bcd9088114
Bump blscurve/blst (missed in #1775 ) ( #1870 )
2020-10-15 14:25:12 +02:00
1ae3fb90ba
Linux AMD64 binary distribution ( #1844 )
...
* Linux AMD64 binary distribution
The builds are reproducible, as long as our base Docker Hub image
remains available.
tl;dr: `make dist`
* use UTC dates
2020-10-15 12:19:41 +00:00
513ba72b9a
add v1.0.0-rc.0 support behind compile-time flag ( #1852 )
...
* add v1.0.0-rc.0 support behind compile-time flag
* keep runtime presets consistent
2020-10-13 17:21:25 +00:00
15c989f70d
bump eth2-testnets ( #1856 )
2020-10-12 12:40:01 +00:00
5bf2cd623a
Add a genesis state for zinken
2020-10-10 13:26:26 +03:00
00a8a68671
Address #1695
...
Better error messages when the beacon node is asked to listen on a
reserved port (0) or an already taken one.
2020-10-09 16:39:03 +03:00
d534570cf6
Use latest Zinken metadata (correct genesis time and bootstrap nodes)
2020-10-08 11:20:06 +03:00
b46c8410a6
Retire Spadina and prepare for the Zinken network
2020-10-07 18:12:21 +03:00
6b9090398e
[JSON-RPC] Prevent silent uint conversion ( #1819 )
...
* Prevent silent uint conversion
* bump json-rpc
2020-10-07 15:02:54 +02:00
078c626554
auto-bump nim-libp2p ( #1806 )
...
Co-authored-by: = <sinkingsugar@users.noreply.github.com>
2020-10-07 12:52:25 +02:00
e9b2253fac
bump nim-nat-traversal and nimbus-build-system ( #1824 )
...
* bump nim-nat-traversal and nimbus-build-system
The "clean-cross" target has been moved to the latter.
* Windows fix
2020-10-07 12:01:27 +02:00
aed291128a
Add support for starting from weak subjectivity checkpoints
...
Also removes the `genesis.ssz` file stored in the data folder.
The `medalla-fast-sync` target has been adapted to use the new features.
2020-10-07 09:32:03 +03:00
fec4b5014d
Address #1694
2020-10-06 15:46:22 +03:00
f484d06f6b
bump json-rpc ( #1813 )
...
gets rid of ugly inf logs
2020-10-06 10:50:15 +02:00
5555d39ea9
Bump nim-stew.
2020-10-05 22:19:50 +03:00
c5c788a9db
Secure network key file and data directory.
2020-10-05 22:19:50 +03:00
596600058a
bump nimcrypto ( #1802 )
2020-10-03 11:21:45 +02:00
b57693ec0d
Logging update ( #1795 )
...
* Fix discovery log message trigger
* Bump chronicles - include https://github.com/status-im/nim-chronicles/pull/89 for better NOTICE/WARNING color
2020-10-03 08:35:45 +02:00
7a5f389f64
auto-bump nim-libp2p ( #1738 )
...
Co-authored-by: = <sinkingsugar@users.noreply.github.com>
2020-10-03 08:21:38 +02:00
f5340998b9
Add a fuzzing test for the beacon node CLI parser
2020-10-02 12:42:32 +03:00
a455dc1bc0
Bump confutils to allow overriding CLI options https://github.com/status-im/nim-confutils/pull/22 ( #1781 )
2020-09-30 16:37:29 +02:00
98661914f1
Revert "bump nim-libbacktrace ( #1769 )" ( #1773 )
...
This reverts commit de1b3315e8
2020-09-28 22:37:18 +02:00
de1b3315e8
bump nim-libbacktrace ( #1769 )
...
* bump nim-libbacktrace
so it works with LTO
* macOS fix
2020-09-28 21:23:53 +02:00
Jacek Sieka
nbc-bump-bot[bot]
Giovanni Petrantoni
Kim De Mey
Ștefan Talpalaru
Mamy Ratsimbazafy
Zahary Karadjov
=
Eugene Kabanov
tersec