Full-featured BitTorrent client package and utilities
Go to file
Matt Joiner 20d9c63885
Update README.md
2020-11-09 09:20:05 +11:00
.circleci Don't fail on 386 tests in CI 2020-10-28 12:09:24 +11:00
bencode
cmd Fix error handling for bad torrent adds with safe file handling 2020-10-15 16:03:43 +11:00
common Got file storage working with segment index 2020-06-01 00:14:51 +10:00
fs Don't block trying to fill entire Reader.Read 2020-10-27 12:59:07 +11:00
internal Include a null byte in the middle of the Greeting test 2020-10-30 10:42:45 +11:00
iplist
logonce
metainfo Add comment to metainfo.MetaInfo.CreationDate 2020-05-13 14:33:26 +10:00
mmap_span Abstract out segments mapping and use it in mmap storage 2020-05-31 21:00:19 +10:00
mse mse/cmd/mse: Fail on missing subcommand 2020-11-04 16:34:31 +11:00
peer_protocol Performance improvements to PEX 2020-10-23 08:58:55 +11:00
segments Further progress on webseeding 2020-06-01 18:25:45 +10:00
storage Replace storage.IncompletePieceToWriter with io.Writer 2020-11-06 16:23:38 +11:00
test sqlite storage: Provide helpers and reasonable defaults 2020-10-30 12:20:54 +11:00
testdata
tracker Fix unused import 2020-10-01 11:50:42 +10:00
util/dirwatch
webseed webseed: Handle http response status codes 2020-10-15 12:42:27 +11:00
webtorrent Fix race in webtorrent.TrackerClient.Run 2020-06-01 11:11:41 +10:00
.gitignore Fix PkgGoDev reference in README 2020-11-06 08:44:02 +11:00
LICENSE
README.md Update README.md 2020-11-09 09:20:05 +11:00
TODO
bad_storage.go
bep40.go
bep40_test.go
callbacks.go Add the ReceiveEncryptedHandshakeSkeys callback 2020-11-05 13:28:45 +11:00
client.go Add the ReceiveEncryptedHandshakeSkeys callback 2020-11-05 13:28:45 +11:00
client_test.go Tidy up some storage close handling 2020-10-11 12:40:43 +11:00
closewrapper.go
config.go Limit half-open connections at the Client level 2020-09-30 16:56:27 +10:00
conn_stats.go Add doc comments related to #383 2020-03-16 16:30:39 +11:00
deferrwl.go
dht.go Support custom DHT servers 2020-02-20 17:46:29 +11:00
dialer.go Add support for non-IP-based networks 2020-02-20 16:47:37 +11:00
doc.go BEP27 isn't implemented 2020-05-24 17:47:16 +10:00
example_test.go
file.go Support disabling webtorrent 2020-06-01 18:24:46 +10:00
file_test.go Rewrite file.bytesLeft 2020-03-24 12:15:35 +11:00
global.go Update the peersAddedBySource expvar 2020-04-16 11:56:58 +10:00
go.mod Use bind-blob fix for crawshaw.io/sqlite 2020-10-12 17:13:05 +11:00
go.sum Performance improvements to PEX 2020-10-23 08:58:55 +11:00
handshake.go Add the ReceiveEncryptedHandshakeSkeys callback 2020-11-05 13:28:45 +11:00
handshake_test.go
ipport.go Add support for non-IP-based networks 2020-02-20 16:47:37 +11:00
issue97_test.go
issue211_test.go
listen.go
main_test.go Move envpprof imports around 2020-02-21 12:58:47 +11:00
misc.go connLessTrusted takes peer instead of PeerConn 2020-06-01 00:03:51 +10:00
misc_test.go
multiless.go
network_test.go
networks.go
peer-impl.go Fix conn status string for WebRTC connections 2020-09-29 16:21:54 +10:00
peer_info.go Tidy up the interface changes 2020-06-02 17:41:59 +10:00
peer_infos.go Rename Peer to PeerInfo, and unexport PeerInfos 2020-05-29 19:44:48 +10:00
peerconn.go Fix piece getting queued for hash multiple times 2020-11-06 08:39:56 +11:00
peerconn_test.go Expose peer.RemoteAddr 2020-07-15 16:16:14 +10:00
peerid.go Rename Peer to PeerInfo, and unexport PeerInfos 2020-05-29 19:44:48 +10:00
peerid_test.go
pex.go Fix initial pex message regression 2020-11-08 23:13:59 +11:00
pex_test.go Performance improvements to PEX 2020-10-23 08:58:55 +11:00
pexconn.go Performance improvements to PEX 2020-10-23 08:58:55 +11:00
pexconn_test.go Performance improvements to PEX 2020-10-23 08:58:55 +11:00
piece.go Fix piece getting queued for hash multiple times 2020-11-06 08:39:56 +11:00
piecestate.go
portfwd.go Update anacrolix/log 2020-04-16 17:20:58 +10:00
prioritized_peers.go Rename Peer to PeerInfo, and unexport PeerInfos 2020-05-29 19:44:48 +10:00
prioritized_peers_test.go Rename Peer to PeerInfo, and unexport PeerInfos 2020-05-29 19:44:48 +10:00
protocol.go
ratelimitreader.go
reader.go Update the readahead window on read failure 2020-11-03 10:41:47 +11:00
reader_test.go
request_strategy.go Move requestStrategyDefaults into its own file 2020-02-27 09:45:13 +11:00
request_strategy_defaults.go Readability 2020-04-19 11:30:48 +10:00
rlreader_test.go
socket.go Add support for non-IP-based networks 2020-02-20 16:47:37 +11:00
spec.go Add DisallowDataDownload/Upload to TorrentSpec and small log cleanup 2020-06-04 10:36:56 +10:00
struct_test.go Rename struct size test 2020-09-29 16:42:52 +10:00
t.go Rename Peer to PeerInfo, and unexport PeerInfos 2020-05-29 19:44:48 +10:00
testing.go Extract the transfer tests 2020-02-20 13:57:24 +11:00
torrent.go Replace storage.IncompletePieceToWriter with io.Writer 2020-11-06 16:23:38 +11:00
torrent_pending_pieces.go Use stable bit set for pending pieces PriorityBitmap 2020-02-27 18:33:44 +11:00
torrent_stats.go Add doc comments related to #383 2020-03-16 16:30:39 +11:00
torrent_test.go Tidy up the interface changes 2020-06-02 17:41:59 +10:00
tracker_scraper.go Set tracker announce timeout back to default 2020-10-01 11:45:47 +10:00
utp.go
utp_go.go
utp_libutp.go
utp_test.go
webrtc.go Big tidy up of webtorrent code 2020-04-07 14:30:27 +10:00
webseed-peer.go We might want to close webseed peers on response errors 2020-10-15 12:45:19 +11:00
worst_conns.go Further progress on webseeding 2020-06-01 18:25:45 +10:00
wstracker.go Fix crash when announcing unloaded torrent to websocket 2020-05-03 14:10:46 +10:00

README.md

torrent

Join the chat at https://gitter.im/anacrolix/torrent GoDoc CircleCI Astronomer Rating GitHub Release PkgGoDev

This repository implements BitTorrent-related packages and command-line utilities in Go. The emphasis is on use as a library from other projects. It's been used 24/7 in production by downstream services since late 2014. The implementation was specifically created to explore Go's concurrency capabilities, and to include the ability to stream data directly from the BitTorrent network. To this end it supports seeking, readaheads and other features exposing torrents and their files with the various Go idiomatic io package interfaces. This is also demonstrated through torrentfs.

There is support for protocol encryption, DHT, PEX, uTP, and various extensions. There are several data storage backends provided: blob, file, bolt, mmap, and sqlite, to name a few. You can write your own to store data for example on S3, or in a database.

Some noteworthy package dependencies that can be used for other purposes include:

Installation

Install the library package with go get github.com/anacrolix/torrent, or the provided cmds with go get github.com/anacrolix/torrent/cmd/....

Library examples

There are some small examples in the package documentation.

Downstream projects

There are several web-frontends and Android clients among the known public projects:

Help

Communication about the project is primarily through Gitter and the issue tracker.

Command packages

Here I'll describe what some of the packages in ./cmd do.

Note that the godo command which is invoked in the following examples builds and executes a Go import path, like go run. It's easier to use this convention than to spell out the install/invoke cycle for every single example.

torrent

Downloads torrents from the command-line. This first example does not use godo.

$ go get github.com/anacrolix/torrent/cmd/torrent
# Now 'torrent' should be in $GOPATH/bin, which should be in $PATH.
$ torrent download 'magnet:?xt=urn:btih:KRWPCX3SJUM4IMM4YF5RPHL6ANPYTQPU'
ubuntu-14.04.2-desktop-amd64.iso [===================================================================>]  99% downloading (1.0 GB/1.0 GB)
2015/04/01 02:08:20 main.go:137: downloaded ALL the torrents
$ md5sum ubuntu-14.04.2-desktop-amd64.iso
1b305d585b1918f297164add46784116  ubuntu-14.04.2-desktop-amd64.iso
$ echo such amaze
wow

torrentfs

torrentfs mounts a FUSE filesystem at -mountDir. The contents are the torrents described by the torrent files and magnet links at -metainfoDir. Data for read requests is fetched only as required from the torrent network, and stored at -downloadDir.

$ mkdir mnt torrents
$ godo github.com/anacrolix/torrent/cmd/torrentfs -mountDir=mnt -metainfoDir=torrents &
$ cd torrents
$ wget http://releases.ubuntu.com/14.04.2/ubuntu-14.04.2-desktop-amd64.iso.torrent
$ cd ..
$ ls mnt
ubuntu-14.04.2-desktop-amd64.iso
$ pv mnt/ubuntu-14.04.2-desktop-amd64.iso | md5sum
996MB 0:04:40 [3.55MB/s] [========================================>] 100%
1b305d585b1918f297164add46784116  -

torrent-magnet

Creates a magnet link from a torrent file. Note the extracted trackers, display name, and info hash.

$ godo github.com/anacrolix/torrent/cmd/torrent-magnet < ubuntu-14.04.2-desktop-amd64.iso.torrent
magnet:?xt=urn:btih:546cf15f724d19c4319cc17b179d7e035f89c1f4&dn=ubuntu-14.04.2-desktop-amd64.iso&tr=http%3A%2F%2Ftorrent.ubuntu.com%3A6969%2Fannounce&tr=http%3A%2F%2Fipv6.torrent.ubuntu.com%3A6969%2Fannounce