Ștefan Talpalaru
2f9dc31b2e
Merge pull request #1029 from status-im/makefiles
...
bump vendor/nimbus-build-system
2020-05-15 17:10:52 +02:00
tersec
74db0f3c8d
fix some XDeclaredButNotUsed hints ( #1027 )
2020-05-15 14:41:00 +02:00
Ștefan Talpalaru
c232fd0b3d
bump vendor/nimbus-build-system
2020-05-15 14:27:21 +02:00
Mamy Ratsimbazafy
1916e1d2da
Revive nbench ( #1022 )
...
* Fix nbench compilation with HashedBeaconState
* Add nbench to tooling
* use newClone - fix 265e01e404 (r425198575)
* Detail advance_slot and hashTreeRoot
* Report throughput
* Fallback for ARM
* windows does not support inline ASM
2020-05-15 00:54:10 +02:00
Ștefan Talpalaru
8b4065bc19
Jenkins: support running 2 parallel jobs on the same node ( #1025 )
...
* Jenkins: support running 2 parallel jobs on the same node
* try escaping $
2020-05-14 19:34:47 +02:00
Dustin Brody
2ddc507e5b
update datatypes v0.11.1 spec references to v0.11.2
2020-05-14 16:33:11 +00:00
Dustin Brody
d6c76f6b2f
re-enable all but the finalization tests for block pool in mainnet presets
2020-05-14 16:33:11 +00:00
Dustin Brody
2d691b2e14
bump spec ref versions
2020-05-14 16:41:46 +03:00
Dustin Brody
2db99545cd
allow inspector tool to log interop attestations
2020-05-14 16:41:46 +03:00
Dustin Brody
57519bebac
remove some unused imports, add tests for pubsub topics, and subscribe to interop attestations
2020-05-14 16:41:46 +03:00
Jacek Sieka
6c9e2d98a8
bump libp2p
2020-05-14 16:41:19 +03:00
Jacek Sieka
3c98f18d47
document snappy decompression assumptions
2020-05-14 16:41:19 +03:00
Jacek Sieka
a605c7244e
simplify libp2p snappy
...
* handle a few more exceptions gracefully (in libp2p also)
* unify libp2p varint parsing
* decompress directly into seq
* avoid seq slice
* stop oversized snappy processing earlier (lowers risk)
2020-05-14 16:41:19 +03:00
Mamy André-Ratsimbazafy
cdc866007d
workaround stack overflow in test_beacon_chain_db
2020-05-14 12:53:46 +00:00
Mamy André-Ratsimbazafy
e9ff9617df
Wrap all suite in a proc to avoid polluting globals
2020-05-14 12:53:46 +00:00
Viktor Kirilov
926d1c546e
updated news, also no longer allowing event handlers to raise anything other than a Defect in the Web3 API
2020-05-14 14:10:26 +03:00
Diederik Loerakker
be806e6801
API fixes - minimal changes to HTTP RPC for Eth2Stats support ( #1017 )
...
* add api for eth2stats
* fix chain head rpc
2020-05-14 11:18:08 +02:00
Zahary Karadjov
e537ed94d6
Bump some modules
2020-05-13 12:19:58 +03:00
Zahary Karadjov
75c1c6a95c
Enable Snappy by default (using LibP2P steams for now)
...
This refactors the newly added Snappy streaming back-ends trying to
make them more similar and to reduce the code duplication to a minimum.
2020-05-13 12:18:42 +03:00
Zahary Karadjov
f055fad08a
Make the Snappy FastStreams integration optional by duplicating it for LibP2P streams
2020-05-13 12:18:42 +03:00
Zahary Karadjov
3ecb197635
Memory-optimal hash_tree_root
...
The work on this was started last week while I was waiting
for a decision on the "Async Snappy" PR. It was prompted by
a failing test in the test suite, where the HashingStream
was inserting some incorrectly padded chunks that affected
the result of `hash_tree_root`. Instead of working around
the problem in the HashingStream, I've decided to implement
a planned optimisation that allows us to remove the hashing
stream altogether.
With the optimisation in place, `hash_tree_root` will now
use only stack memory and only the precise amount neccesary
to build the chunks-merging tree.
2020-05-13 12:18:42 +03:00
Zahary Karadjov
7e846a0bce
Implement sszSize
2020-05-13 12:18:42 +03:00
Zahary Karadjov
dbe0010504
Bump nim-snappy
2020-05-13 12:18:42 +03:00
Zahary Karadjov
15f0153441
Cosmetic improvements
2020-05-13 12:18:42 +03:00
Zahary Karadjov
e8a15aa0ce
Document the SSZ hashing stream
2020-05-13 12:18:42 +03:00
Zahary Karadjov
9538b60704
Integrate the async Snappy implementation
2020-05-13 12:18:42 +03:00
Zahary Karadjov
a739d7e8d6
Adapt SSZ to the latest FastStreams API
2020-05-13 12:18:42 +03:00
tersec
9ad05d44e4
reintroduce finalization verification to beacon node, because otherwise the consensus layer can get detached without noticing it ( #1013 )
2020-05-13 08:36:33 +00:00
Eugene Kabanov
da0b1a4993
Fix status handling. ( #1008 )
...
* Fix status handling.
Add log map of received blocks.
* Fix review comments.
Fix UnusedImport in sync_protocol.nim
2020-05-13 08:37:58 +02:00
Ștefan Talpalaru
010a00963f
Merge pull request #1011 from status-im/ene
...
remove potentially GC leak-inducing acyclicity tag
2020-05-12 23:29:45 +02:00
Dustin Brody
a58d45b737
remove potentially GC leak-inducing acyclicity tag
2020-05-12 20:20:24 +02:00
Ștefan Talpalaru
9c37c7ba26
work around Prometheus quirks [skip ci]
2020-05-12 18:36:43 +02:00
tersec
ba1d7e2ed4
switch state cache to use ref statedata objects to limit memory usage ( #1007 )
...
* switch state cache to use ref statedata objects to limit memory usage
* more directly initialize ref StateData
* use HashedBeaconState instead of StateData to try to fix memory leak
* switch cache to seq[ref HashedBeaconState]
* remove unused import
Co-authored-by: Ștefan Talpalaru <stefantalpalaru@yahoo.com>
2020-05-12 16:26:58 +00:00
Ștefan Talpalaru
d7b8de9c5e
Grafana dashboard: change time format [skip ci]
2020-05-11 22:08:25 +02:00
Jacek Sieka
0d1a602cf5
bump libp2p
2020-05-11 21:06:58 +02:00
Ștefan Talpalaru
2d78523423
fix Grafana dashboards ( #1006 )
...
* fix Grafana dashboards
and refactor a couple of scripts
* start.sh: allow running standalone script
2020-05-11 18:35:53 +00:00
Jacek Sieka
fb2e0ddbec
sync fixes ( #1005 )
...
* sync fixes
* fix Status message finalized info
* work around sync starting before initial status exchange
* don't fail block on deposit signature check failure (fixes #989 )
* print ForkDigest and Version nicely
* dump incoming blocks
* fix crash when libp2p peer connection is closed
* update chunk size to 16 to work around missing blocks when syncing
* bump libp2p
* bump libp2p
* better deposit skip message
2020-05-11 18:08:52 +00:00
Ștefan Talpalaru
a7a50824a1
more metrics ( #1004 )
2020-05-11 06:25:49 +00:00
tersec
c498103b2f
quick/minimal mitigation of beacon_node memory usage resulting from 2*Table.defaultInitialSize pointless BeaconState objects in block pool state cache ( #1002 )
2020-05-10 16:31:55 +00:00
Jacek Sieka
592d6f65c3
bump ( #1001 )
2020-05-09 16:47:14 +02:00
Eugene Kabanov
55dfcc6783
Inspector native version. ( #995 )
2020-05-09 14:18:58 +00:00
tersec
093d298b2b
Increase finalization and finalization checking robustness ( #990 )
...
* fix some warnings related to beacon_node splitting; reimplement finalization verification more robustly; improve attestation pool block selection logic
* re-add missing import
* whitelist allowed state transition flags and make rollback/restore naming more consistent
* restore usage of update flags passed into skipAndUpdateState(...) in addition to the potential verifyFinalization flag
* switch rest of rollback -> restore
2020-05-09 12:43:15 +00:00
Ștefan Talpalaru
bc759ceec3
Merge branch 'metrics' into devel
2020-05-09 13:54:29 +02:00
Ștefan Talpalaru
c572f61129
bump vendor/nim-metrics
2020-05-09 01:13:57 +02:00
Ștefan Talpalaru
aa00e5ea61
Merge branch 'reuseaddr' into devel
2020-05-08 23:17:25 +02:00
Ștefan Talpalaru
fc9d6bc1b3
enable SO_REUSEADDR in libp2p transports
2020-05-08 21:50:20 +02:00
tersec
f0d02f5f29
return nonzero exit code on state transition failure ( #996 )
2020-05-08 16:16:44 +02:00
Jacek Sieka
c1aff83b8b
decrease sync chunk size ( #988 )
...
While mainnet performance is being worked on, this helps with the flow.
2020-05-08 08:17:40 +02:00
Eugene Kabanov
3ffd0d7216
Fix gossip messages not delivered. ( #983 )
2020-05-06 15:42:59 +00:00
Mamy Ratsimbazafy
621c2e38a6
Separate validator duties from the Beacon Node ( #976 )
...
* Separate validator duties from the Beacon Node
* remove duplicate MaxEmptySlotCOunt
* imports
* have beacnde properly compile
2020-05-06 13:23:45 +00:00