Kim De Mey
4e08f774d5
Fix issue where invalid / not validated would get gossiped ( #1247 )
...
Also requires us to split header data propagation from block body
and receipts propagation as the now fixed bug would allow for more
data to be gossiped even when data does not get validated (which
requires the headers).
2022-09-29 08:42:54 +02:00
Kim De Mey
1bd4911e78
Remove ChaindId from BlockKey and update test vectors ( #1242 )
2022-09-28 09:09:38 +02:00
Kim De Mey
87f28458a5
StyleCheck fixes for Fluffy and lcproxy ( #1220 )
...
Also add the compiler options in the nim.cfg of Fluffy and
lcproxy (only visible with direct nimble usage).
2022-09-10 21:00:27 +02:00
Kim De Mey
4a396bdd25
Add eth_chainId rpc to Nimbus and Fluffy ( #1219 )
2022-09-10 15:05:32 +02:00
Kim De Mey
011f44abea
Split parsing and seeding functionality for history data ( #1218 )
2022-09-09 21:21:48 +02:00
Kim De Mey
621c6a31a7
Fix bug in inCurrentEpoch and improve accumulator related tests ( #1217 )
...
* Fix bug in inCurrentEpoch and improve accumulator related tests
- Fix negative wraparound / underflow in inCurrentEpoch
- Add tests in accumulator tests to verify the above
- Add header offer tests with accumulator that does and doesn't
contain historical epochs
- Additional clean-up of history tests
- enable canonicalVerify in the tests
2022-09-09 13:12:09 +02:00
Jacek Sieka
c2ed731fa5
eth: adapt to smaller eth_types ( #1210 )
2022-09-03 20:15:35 +02:00
Kim De Mey
5355f4e73a
A bit of consistency clean-up in accumulator code ( #1201 )
2022-08-24 22:12:56 +02:00
Kim De Mey
c0a6c9a75c
Remove the usage of AccumulatorDB in the accumulator tests ( #1200 )
2022-08-24 16:41:04 +02:00
Kim De Mey
55dcbe9e58
Make the default network for portalcli the history network ( #1195 )
2022-08-23 16:28:10 +02:00
KonradStaniec
88263e664b
Clean up ( #1197 )
2022-08-22 12:23:26 +02:00
KonradStaniec
5f2117d081
Refactor portal stream ( #1191 )
2022-08-17 09:32:06 +02:00
KonradStaniec
c5101c16e9
Bump nim eth ( #1188 )
...
* Bump nim eth
* Bump actions ubuntu
2022-08-16 09:17:57 +02:00
KonradStaniec
f0cd340163
Adhere to transport limits in seed methods ( #1186 )
...
* Add means to limit offered content to fit talkreq
* Add test for history network limits
* Change seed method api to return num of items offered
2022-08-09 14:32:41 +02:00
KonradStaniec
4f8d10f338
Bump nim-eth ( #1185 )
2022-08-06 10:11:36 +02:00
KonradStaniec
71f9e37482
Add getting block by number through accumulator ( #1182 )
2022-08-04 08:34:53 +02:00
Kim De Mey
50af402f59
Add verification of block data by use of accumulator ( #1178 )
2022-08-01 21:00:21 +02:00
KonradStaniec
a1253c67bd
Fix testnet tests ( #1176 )
...
* Testnet improvements
Increase timeout for reading
Add more logs
Offer endpoint can fail due to talkReq timeout, to avoid
test failure, retry it few times until success.
2022-07-29 14:24:07 +02:00
KonradStaniec
e3cabaff7f
Add bulk seeding to multiple peers ( #1170 )
...
* Add bulk seeding to multiple peers
2022-07-26 13:14:56 +02:00
KonradStaniec
aa945f1ed9
Additional seed endpoints ( #1164 )
...
* Additional seed endpoints
2022-07-20 12:46:42 +02:00
Kim De Mey
5abf05e455
Add validation for offered block bodies and receipts ( #1158 )
...
Also use a AsyncQueue now to handle offered data instead of the
network specific validation callbacks.
2022-07-11 16:29:16 +02:00
Kim De Mey
f29cbebb9d
Move block data test files to one location ( #1154 )
2022-07-05 16:14:52 +02:00
Kim De Mey
facd7342fb
Add network retries for fluffy block requests ( #1153 )
...
- Add retries when the network request failed on validation of
block header, body or receipts.
- Shuffle the first set of neighbours that the request is send to
in order to not always hit the same peer first for the same content
- Some general clean-up
2022-07-05 14:42:55 +02:00
Kim De Mey
fb12793482
Bump nim-eth and nim-bearssl and accompanying fixes ( #1150 )
2022-07-04 09:38:02 +02:00
Kim De Mey
33015ea4a3
Adjust to the newly specified SSZ types for Block Body and Receipts ( #1147 )
2022-07-01 21:51:51 +02:00
KonradStaniec
fdb048ed21
Add getLogs implementation ( #1143 )
...
* Add eth_getLogs json-rpc endpoint in Fluffy and Nimbus
2022-06-29 17:44:08 +02:00
Kim De Mey
cad74db423
Support for multiple content items over Portal stream ( #1090 )
...
Each content item send gets prefix with varint (max u32) allowing
to send multiple content items as requested by offer/accept flow.
2022-06-24 15:35:31 +02:00
Kim De Mey
d4d4e8c28f
Add accumulator buildProof, verifyProof and verifyHeader ( #1132 )
2022-06-23 21:00:59 +02:00
Kim De Mey
bf511b091e
Docs: Add separate section for seeding history data ( #1140 )
...
- Move section of eth_data_exporter out of default way to run
Fluffy
- Update section to explain full flow of seeding history data
into the network
2022-06-23 14:14:31 +02:00
Kim De Mey
589ba8367e
Adjust Grafana dashboard to represent the one used for the fleet ( #1139 )
...
This means adding the instance and container variables which can
be used to select the metrics of the specific fleet node.
2022-06-22 17:22:07 +02:00
KonradStaniec
196428dcf5
Use one ws connection to transfer data from source ( #1136 )
2022-06-22 08:50:58 +02:00
KonradStaniec
489b975189
Add seed db file format ( #1126 )
...
* Add seed db file format
2022-06-20 16:52:48 +02:00
Kim De Mey
de2051dcf8
Add Accumulator build helper calls and refactors ( #1127 )
...
- Move the accumulator definitions to a history accumulator file
- Add accumulator build helper calls + temporary database
- Add a header gossip content key encoding test
- Refactor & some cleanup
2022-06-16 08:50:29 +02:00
Kim De Mey
6325712aa6
Add accumulator content keys for history network ( #1123 )
2022-06-14 23:38:34 +02:00
Kim De Mey
49bdaa112e
Increase wait time for content propagation to avoid CI failures ( #1122 )
2022-06-14 14:23:07 +02:00
KonradStaniec
b23789d107
Add getting receipts from history network ( #1118 )
...
* Add getting receipts from history network
2022-06-10 12:24:53 +02:00
KonradStaniec
730013bde3
Change test data and propagation format ( #1115 )
...
* Change test data and propagation format
* Add tool to download data from local node
2022-06-08 15:14:01 +02:00
KonradStaniec
0776f35e0c
Use queries with custom xor function ( #1113 )
...
* Use queries with custom xor function
2022-06-03 13:44:42 +02:00
Kim De Mey
6d8b25a5f5
Update header accumulator test to start from Mainnet genesis ( #1111 )
2022-06-01 15:21:22 +02:00
Kim De Mey
7216160ad0
Update Ultralight bootstrap nodes for testnet ( #1110 )
2022-06-01 08:52:54 +02:00
KonradStaniec
5c78fe64e4
Fix utp connection leak on cancel ( #1107 )
...
* Fix utp connection leak on cancel
2022-05-31 14:28:02 +02:00
KonradStaniec
af10e8f179
Do not use vacuum when pruning ( #1103 )
...
* Do not use vacuum when pruning
2022-05-26 08:26:08 +02:00
Kim De Mey
f219c69840
Rework of Portal json-rpc debug API and related functionality ( #1102 )
...
- More consistent naming in calls used by the JSON-RPC debug API
- Use storeContent everywhere to make sure content is only stored
if in range
- Remove populateHistoryDb subcommand and replace by JSON-RPC call
storeContent
- Remove some whitespace and fix some indentations
2022-05-24 13:27:22 +02:00
Kim De Mey
553be51217
Change radius-config option to radius and allow also logRadius ( #1100 )
2022-05-23 23:23:24 +02:00
Kim De Mey
a69b16abff
Cleanup some imports and fix some warnings in the process ( #1096 )
2022-05-22 22:44:15 +02:00
Kim De Mey
6e05c7588e
Add Header Accumulator for the Header Gossip Network ( #1094 )
2022-05-18 22:49:35 +02:00
KonradStaniec
6a9d875fe7
Add pruning metrics ( #1093 )
2022-05-17 12:47:24 +02:00
Kim De Mey
56c3e31efc
Refactor and clean-up of Portal wire protocol test ( #1089 )
2022-05-16 13:17:42 +02:00
KonradStaniec
4e8c5f292e
Dynamic radius adjustments ( #1079 )
...
* Add config for node radius
* Adjust radius when deleting content
2022-05-12 18:04:37 +02:00
KonradStaniec
d3f231e3da
Add put method which preserves max size ( #1065 )
...
* Add put method which preserves max size
2022-05-09 17:18:57 +02:00