torrent

This repository implements BitTorrent-related packages and command-line utilities in Go. The emphasis is on use as a library from other projects. It's been used 24/7 in production by downstream services since late 2014. The implementation was specifically created to explore Go's concurrency capabilities, and to include the ability to stream data directly from the BitTorrent network. To this end it supports seeking, readaheads and other features exposing torrents and their files with the various Go idiomatic io package interfaces. This is also demonstrated through torrentfs.

There is support for protocol encryption, DHT, PEX, uTP, and various extensions. There are several data storage backends provided: blob, file, bolt, mmap, and sqlite, to name a few. You can write your own to store data for example on S3, or in a database.

Some noteworthy package dependencies that can be used for other purposes include:

Installation

Install the library package with go get github.com/anacrolix/torrent, or the provided cmds with go install github.com/anacrolix/torrent/cmd/...@latest.

Library examples

There are some small examples in the package documentation.

Mentions

@anacrolix is interviewed about this repo in Console 32.

Downstream projects

There are several web-frontends, sites, Android clients, storage backends and supporting services among the known public projects:

cove: Personal torrent browser with streaming, DHT search, video transcoding and casting.
confluence: torrent client as a HTTP service
Gopeed: Gopeed (full name Go Speed), a high-speed downloader developed by Golang + Flutter, supports (HTTP, BitTorrent, Magnet) protocol, and supports all platforms.
Erigon: an implementation of Ethereum (execution layer with embeddable consensus layer), on the efficiency frontier.
exatorrent: Elegant self-hostable torrent client
bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, content classifier and torrent search engine with web UI, GraphQL API and Servarr stack integration.
TorrServer: Torrent streaming server over http
distribyted: Distribyted is an alternative torrent client. It can expose torrent files as a standard FUSE, webDAV or HTTP endpoint and download them on demand, allowing random reads using a fixed amount of disk space.
Simple Torrent: self-hosted HTTP remote torrent client
autobrr: autobrr redefines download automation for torrents and Usenet, drawing inspiration from tools like trackarr, autodl-irssi, and flexget.
mabel: Fancy BitTorrent client for the terminal
webtor.io: free cloud BitTorrent-client
Android Torrent Client: Android torrent client
libtorrent: gomobile wrapper
Go-PeersToHTTP: Simple torrent proxy to http stream controlled over REST-like api
CortexFoundation/torrentfs: Independent HTTP service for file seeding and P2P file system of cortex full node
Torrent WebDAV Client: Automatic torrent download, streaming, WebDAV server and client.
goTorrent: torrenting server with a React web frontend
Go Peerflix: Start watching the movie while your torrent is still downloading!
hTorrent: HTTP to BitTorrent gateway with seeking support.
Remote-Torrent: Download Remotely and Retrieve Files Over HTTP
Trickl: torrent client for android
ANT-Downloader: ANT Downloader is a BitTorrent Client developed by golang, angular 7, and electron
Elementum (up to version 0.0.71)

Help

Communication about the project is primarily through Discussions and the issue tracker.

Command packages

Here I'll describe what some of the packages in ./cmd do. See installation to make them available.

`torrent`

`torrent download`

Downloads torrents from the command-line.

$ torrent download 'magnet:?xt=urn:btih:KRWPCX3SJUM4IMM4YF5RPHL6ANPYTQPU'
... lots of jibber jabber ...
downloading "ubuntu-14.04.2-desktop-amd64.iso": 1.0 GB/1.0 GB, 1989/1992 pieces completed (1 partial)
2015/04/01 02:08:20 main.go:137: downloaded ALL the torrents
$ md5sum ubuntu-14.04.2-desktop-amd64.iso
1b305d585b1918f297164add46784116  ubuntu-14.04.2-desktop-amd64.iso
$ echo such amaze
wow

`torrent metainfo magnet`

Creates a magnet link from a torrent file. Note the extracted trackers, display name, and info hash.

$ torrent metainfo testdata/debian-10.8.0-amd64-netinst.iso.torrent magnet
magnet:?xt=urn:btih:4090c3c2a394a49974dfbbf2ce7ad0db3cdeddd7&dn=debian-10.8.0-amd64-netinst.iso&tr=http%3A%2F%2Fbttracker.debian.org%3A6969%2Fannounce

See torrent metainfo --help for other metainfo related commands.

`torrentfs`

torrentfs mounts a FUSE filesystem at -mountDir. The contents are the torrents described by the torrent files and magnet links at -metainfoDir. Data for read requests is fetched only as required from the torrent network, and stored at -downloadDir.

$ mkdir mnt torrents
$ torrentfs -mountDir=mnt -metainfoDir=torrents &
$ cd torrents
$ wget http://releases.ubuntu.com/14.04.2/ubuntu-14.04.2-desktop-amd64.iso.torrent
$ cd ..
$ ls mnt
ubuntu-14.04.2-desktop-amd64.iso
$ pv mnt/ubuntu-14.04.2-desktop-amd64.iso | md5sum
996MB 0:04:40 [3.55MB/s] [========================================>] 100%
1b305d585b1918f297164add46784116  -

Name		Name	Last commit message	Last commit date
Latest commit History 3,674 Commits
.circleci		.circleci
.github		.github
analysis		analysis
bencode		bencode
cmd		cmd
common		common
dialer		dialer
fs		fs
internal		internal
iplist		iplist
logonce		logonce
merkle		merkle
metainfo		metainfo
mmap_span		mmap_span
mse		mse
peer_protocol		peer_protocol
request-strategy		request-strategy
segments		segments
smartban		smartban
storage		storage
test		test
testdata		testdata
tests		tests
tracker		tracker
typed-roaring		typed-roaring
types		types
util/dirwatch		util/dirwatch
version		version
webseed		webseed
webtorrent		webtorrent
.deepsource.toml		.deepsource.toml
.gitignore		.gitignore
.golangci.yml		.golangci.yml
Dockerfile		Dockerfile
LICENSE		LICENSE
NOTES.md		NOTES.md
README.md		README.md
SECURITY.md		SECURITY.md
TODO		TODO
bad_storage.go		bad_storage.go
bep40.go		bep40.go
bep40_test.go		bep40_test.go
callbacks.go		callbacks.go
client-nowasm_test.go		client-nowasm_test.go
client-stats.go		client-stats.go
client.go		client.go
client_test.go		client_test.go
config.go		config.go
conn_stats.go		conn_stats.go
deferrwl.go		deferrwl.go
dht.go		dht.go
dial-pool.go		dial-pool.go
dialer.go		dialer.go
doc.go		doc.go
example_test.go		example_test.go
file.go		file.go
file_test.go		file_test.go
global.go		global.go
go.mod		go.mod
go.sum		go.sum
handshake.go		handshake.go
handshake_test.go		handshake_test.go
ipport.go		ipport.go
issue211_test.go		issue211_test.go
issue97_test.go		issue97_test.go
listen.go		listen.go
logging.go		logging.go
ltep.go		ltep.go
ltep_test.go		ltep_test.go
main_test.go		main_test.go
misc.go		misc.go
misc_test.go		misc_test.go
netip-addrport.go		netip-addrport.go
network_test.go		network_test.go
networks.go		networks.go
ordered-bitmap.go		ordered-bitmap.go
otel.go		otel.go
peer-conn-msg-writer.go		peer-conn-msg-writer.go
peer-impl.go		peer-impl.go
peer.go		peer.go
peer_info.go		peer_info.go
peer_infos.go		peer_infos.go
peerconn.go		peerconn.go
peerconn_test.go		peerconn_test.go
peerid.go		peerid.go
peerid_test.go		peerid_test.go
pending-requests.go		pending-requests.go
pending-requests_test.go		pending-requests_test.go
pex.go		pex.go
pex_test.go		pex_test.go
pexconn.go		pexconn.go
pexconn_test.go		pexconn_test.go
piece.go		piece.go
piecestate.go		piecestate.go
portfwd.go		portfwd.go
prioritized-peers.go		prioritized-peers.go
prioritized-peers_test.go		prioritized-peers_test.go
protocol.go		protocol.go
ratelimitreader.go		ratelimitreader.go
reader.go		reader.go

License

anacrolix/torrent

Folders and files

Latest commit

History