5355f4e73a
A bit of consistency clean-up in accumulator code ( #1201 )
2022-08-24 22:12:56 +02:00
c0a6c9a75c
Remove the usage of AccumulatorDB in the accumulator tests ( #1200 )
2022-08-24 16:41:04 +02:00
55dcbe9e58
Make the default network for portalcli the history network ( #1195 )
2022-08-23 16:28:10 +02:00
88263e664b
Clean up ( #1197 )
2022-08-22 12:23:26 +02:00
5f2117d081
Refactor portal stream ( #1191 )
2022-08-17 09:32:06 +02:00
c5101c16e9
Bump nim eth ( #1188 )
...
* Bump nim eth
* Bump actions ubuntu
2022-08-16 09:17:57 +02:00
f0cd340163
Adhere to transport limits in seed methods ( #1186 )
...
* Add means to limit offered content to fit talkreq
* Add test for history network limits
* Change seed method api to return num of items offered
2022-08-09 14:32:41 +02:00
4f8d10f338
Bump nim-eth ( #1185 )
2022-08-06 10:11:36 +02:00
71f9e37482
Add getting block by number through accumulator ( #1182 )
2022-08-04 08:34:53 +02:00
50af402f59
Add verification of block data by use of accumulator ( #1178 )
2022-08-01 21:00:21 +02:00
a1253c67bd
Fix testnet tests ( #1176 )
...
* Testnet improvements
Increase timeout for reading
Add more logs
Offer endpoint can fail due to talkReq timeout, to avoid
test failure, retry it few times until success.
2022-07-29 14:24:07 +02:00
e3cabaff7f
Add bulk seeding to multiple peers ( #1170 )
...
* Add bulk seeding to multiple peers
2022-07-26 13:14:56 +02:00
aa945f1ed9
Additional seed endpoints ( #1164 )
...
* Additional seed endpoints
2022-07-20 12:46:42 +02:00
5abf05e455
Add validation for offered block bodies and receipts ( #1158 )
...
Also use a AsyncQueue now to handle offered data instead of the
network specific validation callbacks.
2022-07-11 16:29:16 +02:00
f29cbebb9d
Move block data test files to one location ( #1154 )
2022-07-05 16:14:52 +02:00
facd7342fb
Add network retries for fluffy block requests ( #1153 )
...
- Add retries when the network request failed on validation of
block header, body or receipts.
- Shuffle the first set of neighbours that the request is send to
in order to not always hit the same peer first for the same content
- Some general clean-up
2022-07-05 14:42:55 +02:00
fb12793482
Bump nim-eth and nim-bearssl and accompanying fixes ( #1150 )
2022-07-04 09:38:02 +02:00
33015ea4a3
Adjust to the newly specified SSZ types for Block Body and Receipts ( #1147 )
2022-07-01 21:51:51 +02:00
fdb048ed21
Add getLogs implementation ( #1143 )
...
* Add eth_getLogs json-rpc endpoint in Fluffy and Nimbus
2022-06-29 17:44:08 +02:00
cad74db423
Support for multiple content items over Portal stream ( #1090 )
...
Each content item send gets prefix with varint (max u32) allowing
to send multiple content items as requested by offer/accept flow.
2022-06-24 15:35:31 +02:00
d4d4e8c28f
Add accumulator buildProof, verifyProof and verifyHeader ( #1132 )
2022-06-23 21:00:59 +02:00
bf511b091e
Docs: Add separate section for seeding history data ( #1140 )
...
- Move section of eth_data_exporter out of default way to run
Fluffy
- Update section to explain full flow of seeding history data
into the network
2022-06-23 14:14:31 +02:00
589ba8367e
Adjust Grafana dashboard to represent the one used for the fleet ( #1139 )
...
This means adding the instance and container variables which can
be used to select the metrics of the specific fleet node.
2022-06-22 17:22:07 +02:00
196428dcf5
Use one ws connection to transfer data from source ( #1136 )
2022-06-22 08:50:58 +02:00
489b975189
Add seed db file format ( #1126 )
...
* Add seed db file format
2022-06-20 16:52:48 +02:00
de2051dcf8
Add Accumulator build helper calls and refactors ( #1127 )
...
- Move the accumulator definitions to a history accumulator file
- Add accumulator build helper calls + temporary database
- Add a header gossip content key encoding test
- Refactor & some cleanup
2022-06-16 08:50:29 +02:00
6325712aa6
Add accumulator content keys for history network ( #1123 )
2022-06-14 23:38:34 +02:00
49bdaa112e
Increase wait time for content propagation to avoid CI failures ( #1122 )
2022-06-14 14:23:07 +02:00
b23789d107
Add getting receipts from history network ( #1118 )
...
* Add getting receipts from history network
2022-06-10 12:24:53 +02:00
730013bde3
Change test data and propagation format ( #1115 )
...
* Change test data and propagation format
* Add tool to download data from local node
2022-06-08 15:14:01 +02:00
0776f35e0c
Use queries with custom xor function ( #1113 )
...
* Use queries with custom xor function
2022-06-03 13:44:42 +02:00
6d8b25a5f5
Update header accumulator test to start from Mainnet genesis ( #1111 )
2022-06-01 15:21:22 +02:00
7216160ad0
Update Ultralight bootstrap nodes for testnet ( #1110 )
2022-06-01 08:52:54 +02:00
5c78fe64e4
Fix utp connection leak on cancel ( #1107 )
...
* Fix utp connection leak on cancel
2022-05-31 14:28:02 +02:00
af10e8f179
Do not use vacuum when pruning ( #1103 )
...
* Do not use vacuum when pruning
2022-05-26 08:26:08 +02:00
f219c69840
Rework of Portal json-rpc debug API and related functionality ( #1102 )
...
- More consistent naming in calls used by the JSON-RPC debug API
- Use storeContent everywhere to make sure content is only stored
if in range
- Remove populateHistoryDb subcommand and replace by JSON-RPC call
storeContent
- Remove some whitespace and fix some indentations
2022-05-24 13:27:22 +02:00
553be51217
Change radius-config option to radius and allow also logRadius ( #1100 )
2022-05-23 23:23:24 +02:00
a69b16abff
Cleanup some imports and fix some warnings in the process ( #1096 )
2022-05-22 22:44:15 +02:00
6e05c7588e
Add Header Accumulator for the Header Gossip Network ( #1094 )
2022-05-18 22:49:35 +02:00
6a9d875fe7
Add pruning metrics ( #1093 )
2022-05-17 12:47:24 +02:00
56c3e31efc
Refactor and clean-up of Portal wire protocol test ( #1089 )
2022-05-16 13:17:42 +02:00
4e8c5f292e
Dynamic radius adjustments ( #1079 )
...
* Add config for node radius
* Adjust radius when deleting content
2022-05-12 18:04:37 +02:00
d3f231e3da
Add put method which preserves max size ( #1065 )
...
* Add put method which preserves max size
2022-05-09 17:18:57 +02:00
69366e1880
Improve selecting of nodes in neighborhood gossip ( #1072 )
...
Allow also concurrent neighborhood gossip jobs when seeding data
into the network.
Update Grafana dashboard for two additional metrics regarding
lookups in neighborhood gossip.
2022-05-07 13:50:16 +02:00
7bd9afa465
Bump nim-eth for max discv5 packet size ( #1070 )
2022-05-03 09:18:33 +02:00
99eea47dff
Fix clean-up socket in FindContent on cancel ( #1067 )
2022-04-20 18:46:00 +02:00
991edc1711
Fix log for block body network fetching ( #1066 )
2022-04-15 16:10:05 +02:00
f37dde1177
Fix two possible index errors on Portal wire protocol ( #1061 )
2022-04-13 17:42:32 +02:00
3d818ad8ee
Update Fluffy README.md with metrics information
2022-04-13 16:11:01 +02:00
9626655557
Few more log improvements for Fluffy ( #1060 )
2022-04-13 11:17:07 +02:00
Kim De Mey
KonradStaniec