d667346834
Adjustments in eth_data_exporter related to accumulator generation ( #1261 )
...
- Add exportHeaders to write headers in e2s file per epoch
- Add verifyHeaders to verify decoding the above files
- Adjust exportAccumulatorData to use generated header epoch files
and write accumulator in SSZ (no hex)
- Add printAccumulatorData to print all root hashes
2022-10-14 08:57:17 +02:00
181243b6c4
Make portal_historyOffer spec compliant ( #1259 )
...
* Make portal_historyOffer spec compliant
2022-10-11 12:10:54 +02:00
0a2f1378e4
Make fluffy rpc portal call compatible with spec ( #1258 )
2022-10-10 15:15:57 +02:00
78f7de1344
Make accumulator finite at merge block ( #1256 )
...
- Let accumulator finish its last pre merge epoch (hash_tree_root
on incomplete epoch).
- Adjust code to use isPreMerge and remove isCurrentEpoch
- Split up tests to a set that runs with a mainnet merge block
number and a set that runs with a testing value.
2022-10-10 12:59:55 +02:00
4e08f774d5
Fix issue where invalid / not validated would get gossiped ( #1247 )
...
Also requires us to split header data propagation from block body
and receipts propagation as the now fixed bug would allow for more
data to be gossiped even when data does not get validated (which
requires the headers).
2022-09-29 08:42:54 +02:00
1bd4911e78
Remove ChaindId from BlockKey and update test vectors ( #1242 )
2022-09-28 09:09:38 +02:00
87f28458a5
StyleCheck fixes for Fluffy and lcproxy ( #1220 )
...
Also add the compiler options in the nim.cfg of Fluffy and
lcproxy (only visible with direct nimble usage).
2022-09-10 21:00:27 +02:00
4a396bdd25
Add eth_chainId rpc to Nimbus and Fluffy ( #1219 )
2022-09-10 15:05:32 +02:00
011f44abea
Split parsing and seeding functionality for history data ( #1218 )
2022-09-09 21:21:48 +02:00
621c6a31a7
Fix bug in inCurrentEpoch and improve accumulator related tests ( #1217 )
...
* Fix bug in inCurrentEpoch and improve accumulator related tests
- Fix negative wraparound / underflow in inCurrentEpoch
- Add tests in accumulator tests to verify the above
- Add header offer tests with accumulator that does and doesn't
contain historical epochs
- Additional clean-up of history tests
- enable canonicalVerify in the tests
2022-09-09 13:12:09 +02:00
c2ed731fa5
eth: adapt to smaller eth_types ( #1210 )
2022-09-03 20:15:35 +02:00
5355f4e73a
A bit of consistency clean-up in accumulator code ( #1201 )
2022-08-24 22:12:56 +02:00
c0a6c9a75c
Remove the usage of AccumulatorDB in the accumulator tests ( #1200 )
2022-08-24 16:41:04 +02:00
55dcbe9e58
Make the default network for portalcli the history network ( #1195 )
2022-08-23 16:28:10 +02:00
88263e664b
Clean up ( #1197 )
2022-08-22 12:23:26 +02:00
5f2117d081
Refactor portal stream ( #1191 )
2022-08-17 09:32:06 +02:00
c5101c16e9
Bump nim eth ( #1188 )
...
* Bump nim eth
* Bump actions ubuntu
2022-08-16 09:17:57 +02:00
f0cd340163
Adhere to transport limits in seed methods ( #1186 )
...
* Add means to limit offered content to fit talkreq
* Add test for history network limits
* Change seed method api to return num of items offered
2022-08-09 14:32:41 +02:00
4f8d10f338
Bump nim-eth ( #1185 )
2022-08-06 10:11:36 +02:00
71f9e37482
Add getting block by number through accumulator ( #1182 )
2022-08-04 08:34:53 +02:00
50af402f59
Add verification of block data by use of accumulator ( #1178 )
2022-08-01 21:00:21 +02:00
a1253c67bd
Fix testnet tests ( #1176 )
...
* Testnet improvements
Increase timeout for reading
Add more logs
Offer endpoint can fail due to talkReq timeout, to avoid
test failure, retry it few times until success.
2022-07-29 14:24:07 +02:00
e3cabaff7f
Add bulk seeding to multiple peers ( #1170 )
...
* Add bulk seeding to multiple peers
2022-07-26 13:14:56 +02:00
aa945f1ed9
Additional seed endpoints ( #1164 )
...
* Additional seed endpoints
2022-07-20 12:46:42 +02:00
5abf05e455
Add validation for offered block bodies and receipts ( #1158 )
...
Also use a AsyncQueue now to handle offered data instead of the
network specific validation callbacks.
2022-07-11 16:29:16 +02:00
f29cbebb9d
Move block data test files to one location ( #1154 )
2022-07-05 16:14:52 +02:00
facd7342fb
Add network retries for fluffy block requests ( #1153 )
...
- Add retries when the network request failed on validation of
block header, body or receipts.
- Shuffle the first set of neighbours that the request is send to
in order to not always hit the same peer first for the same content
- Some general clean-up
2022-07-05 14:42:55 +02:00
fb12793482
Bump nim-eth and nim-bearssl and accompanying fixes ( #1150 )
2022-07-04 09:38:02 +02:00
33015ea4a3
Adjust to the newly specified SSZ types for Block Body and Receipts ( #1147 )
2022-07-01 21:51:51 +02:00
fdb048ed21
Add getLogs implementation ( #1143 )
...
* Add eth_getLogs json-rpc endpoint in Fluffy and Nimbus
2022-06-29 17:44:08 +02:00
cad74db423
Support for multiple content items over Portal stream ( #1090 )
...
Each content item send gets prefix with varint (max u32) allowing
to send multiple content items as requested by offer/accept flow.
2022-06-24 15:35:31 +02:00
d4d4e8c28f
Add accumulator buildProof, verifyProof and verifyHeader ( #1132 )
2022-06-23 21:00:59 +02:00
bf511b091e
Docs: Add separate section for seeding history data ( #1140 )
...
- Move section of eth_data_exporter out of default way to run
Fluffy
- Update section to explain full flow of seeding history data
into the network
2022-06-23 14:14:31 +02:00
589ba8367e
Adjust Grafana dashboard to represent the one used for the fleet ( #1139 )
...
This means adding the instance and container variables which can
be used to select the metrics of the specific fleet node.
2022-06-22 17:22:07 +02:00
196428dcf5
Use one ws connection to transfer data from source ( #1136 )
2022-06-22 08:50:58 +02:00
489b975189
Add seed db file format ( #1126 )
...
* Add seed db file format
2022-06-20 16:52:48 +02:00
de2051dcf8
Add Accumulator build helper calls and refactors ( #1127 )
...
- Move the accumulator definitions to a history accumulator file
- Add accumulator build helper calls + temporary database
- Add a header gossip content key encoding test
- Refactor & some cleanup
2022-06-16 08:50:29 +02:00
6325712aa6
Add accumulator content keys for history network ( #1123 )
2022-06-14 23:38:34 +02:00
49bdaa112e
Increase wait time for content propagation to avoid CI failures ( #1122 )
2022-06-14 14:23:07 +02:00
b23789d107
Add getting receipts from history network ( #1118 )
...
* Add getting receipts from history network
2022-06-10 12:24:53 +02:00
730013bde3
Change test data and propagation format ( #1115 )
...
* Change test data and propagation format
* Add tool to download data from local node
2022-06-08 15:14:01 +02:00
0776f35e0c
Use queries with custom xor function ( #1113 )
...
* Use queries with custom xor function
2022-06-03 13:44:42 +02:00
6d8b25a5f5
Update header accumulator test to start from Mainnet genesis ( #1111 )
2022-06-01 15:21:22 +02:00
7216160ad0
Update Ultralight bootstrap nodes for testnet ( #1110 )
2022-06-01 08:52:54 +02:00
5c78fe64e4
Fix utp connection leak on cancel ( #1107 )
...
* Fix utp connection leak on cancel
2022-05-31 14:28:02 +02:00
af10e8f179
Do not use vacuum when pruning ( #1103 )
...
* Do not use vacuum when pruning
2022-05-26 08:26:08 +02:00
f219c69840
Rework of Portal json-rpc debug API and related functionality ( #1102 )
...
- More consistent naming in calls used by the JSON-RPC debug API
- Use storeContent everywhere to make sure content is only stored
if in range
- Remove populateHistoryDb subcommand and replace by JSON-RPC call
storeContent
- Remove some whitespace and fix some indentations
2022-05-24 13:27:22 +02:00
553be51217
Change radius-config option to radius and allow also logRadius ( #1100 )
2022-05-23 23:23:24 +02:00
a69b16abff
Cleanup some imports and fix some warnings in the process ( #1096 )
2022-05-22 22:44:15 +02:00
6e05c7588e
Add Header Accumulator for the Header Gossip Network ( #1094 )
2022-05-18 22:49:35 +02:00
Kim De Mey
KonradStaniec
Jacek Sieka