Commit Graph

224 Commits

Author SHA1 Message Date
Dmitriy Ryajov 6c92b3dc25
Poc 2 (#7)
* moving protobuf into bitswap

* adding block type

* reworking bitswap

* adding chunker

* adding license header

* use 1.2.6

* adding fixed size chunker

* add blockstore

* add iterator to chunker

* more bitswap changes

* rename ipfs to dagger

* rename to dagger

* blockstore inherits from BlockProvider

* wip - add core block handling logic

* smal changes

* use proper block store methods

* adding asynq heapqueue

* wip prepare for bitswap task runner

* adding `$`

* adding memory store and tests

* fixed chunking

* extracted desicion engine from bitswap

* added helper random funcs

* adding testing helpers

* only handle seqs

* add peer events

* cleanup pending blocks on blockstore event

* allow nil handlers

* move protobuf type helpers

* allow initializing block from Cid

* testing and fixes

* small fixes

* expose `<`

* spelling

* default value

* spelling

* pending blocks manager

* adding stores manager

* more tests a wip around bitswap

* small changes

* merge bitswap and engine for now

* for now run only the new poc's tests

* add a more complete ci setup

* use template in map

* remove p2pd

* remove go

* dont use asyncCheck

* few small changes

* adding ability to update items

* adding multiple task runners

* handle cancelation properly

* use Result instead of throwing

* wip bitswap tests

* moving things around

* split out engine again

* add request and handlers interface

* fix tests

* wip - engine tests

* remove unused imports

* fix tests

* cleanup block requesting logic

* add block request tests

* more block requests

* add support for max heap

* don't use result

* use max heap & send block presence in task handler

* add task handler tests

* rename store to localStore

* cleanup & logging

* cancel task on stop

* don't depend on local store for events

* dont use heap queue for wants

* add chronicles

* fix issue with peer wants

* add test for delayed block sends

* remove obsolete tests

* wip chunker

* run all tests

* add todo

* misc

* remove irrelevant files

* removing more files

* adding helpers for bitswap tests

* moved bitswap file

* misc

* make blocks timeout longer

* adjust block timeout

* speedup test

* compile with threads

* import missing crypto

* misc

* disable threads for now

* fix 32 bit platforms

* re-enable threads support in tests
2021-02-25 18:23:22 -06:00
Mark Spanbroek 8e76ecfa9f Fix: adapt to latest libp2p api
Fixes compilation error.
2021-02-08 14:39:27 +01:00
Mark Spanbroek b0a1166c3c Bitswap: retrieve() waits until IPFS object has been retrieved
Workaround that always waited for exactly 1 second has been removed.
2021-02-02 19:29:52 +01:00
Mark Spanbroek b54c3d9585 Implement Ipfs API 2021-02-02 19:29:52 +01:00
Mark Spanbroek a63000f602 Exchange objects between peers using bitswap 2021-02-02 19:29:52 +01:00
Mark Spanbroek 28d1ddf7e3 Repo: use Option to signal retrieval success or failure 2021-02-02 19:29:52 +01:00
Mark Spanbroek 520f3f3bc9 Add Bitswap protocol for libp2p 2021-02-02 19:29:52 +01:00
Mark Spanbroek e6d84b9c0d Add initializers for bitswap messages 2021-02-02 19:29:52 +01:00
Mark Spanbroek fa15c92158 Serialize bitswap messages using protobuf 2021-02-02 19:29:52 +01:00
Mark Spanbroek 216317d4f5 Cleanup protobuf for use with protobufserialization 2021-02-02 19:29:52 +01:00
Mark Spanbroek 8f4a7d796f Added protobuf definitions for bitswap
Source:
https://github.com/ipfs/go-bitswap/blob/master/message/pb/message.proto
2021-02-02 19:29:52 +01:00
Mark Spanbroek b3f5599925 Add absolutely minimal implementation of a DHT routing table 2021-02-02 19:29:52 +01:00
Mark Spanbroek 7b15a6ae83 Disable failing test for now 2021-02-02 19:29:52 +01:00
Mark Spanbroek dc06106ae1 Change MerkleDag to IpfsObject to better match IPFS API 2021-02-02 19:29:52 +01:00
Mark Spanbroek 5a36e26e7c Change type and proc names to better match IPFS API 2021-02-02 19:29:52 +01:00
Mark Spanbroek 05a7f47113 Rename dagger->ipfs
This is a storage engine based on IPFS, which is only a part of Dagger
2021-02-02 19:29:52 +01:00
Mark Spanbroek dd18f50ec6 Replace root hash by root content id 2021-02-02 19:29:52 +01:00
Mark Spanbroek 096fe0e40d Repo for storing and retrieving Merkle DAGs 2021-02-02 19:29:52 +01:00
Mark Spanbroek ecc4e50d28 Add root hash to Merkle DAG 2021-02-02 19:29:52 +01:00
Mark Spanbroek c795c698fe Compile all tests in one go 2021-02-02 19:29:52 +01:00
Mark Spanbroek 5f5153820f Add absolutely minimal implementation of chunking 2021-02-02 19:29:52 +01:00
Mark Spanbroek 2471423197 Added (failing) test for transferring file from one peer to another 2021-02-02 19:29:52 +01:00
Mark Spanbroek bd29797aba Project setup 2021-02-02 19:29:52 +01:00
Mark Spanbroek 29bb6828ee Initial commit 2021-01-13 09:10:17 +01:00