SSD-friendly FS crawler for the Aquatic BitTorrent tracker, based on the librqbit API
Note
- requires PR#233, the yggverse or info-hash-api branch implementation
- compatible with any other
--infohashsource inhash1hash2...binary format - see also the βtracker as the web frontend for
preloadstorage - visit project Wiki for details
torrent client > aquatic_udp > infohash.bin < aquatic-crawler > * /preload/info-hash.torrent
torrent client <-----------------------| * /preload/info-hash/data
<-------------------------------------| * /preload/.info-hash/tmp
Tip
You may want to install some system dependencies
git clone https://github.com/YGGverse/aquatic-crawler.git && cd aquatic-crawlercargo build --releasesudo install target/release/aquatic-crawler /usr/local/bin/aquatic-crawler
Tip
- prepend
RUST_LOG=debugto debug, appendNO_COLOR=1to disable fmt - use
--preload-*arguments group to avoid preloading everything (by default) - make sure the current
nofilevalue corresponds to the expected count of torrent files (details)
aquatic-crawler --infohash /path/to/info-hash-ipv4.bin\
--infohash /path/to/info-hash-ipv6.bin\
--infohash /path/to/another-source.bin\
--tracker udp://host1:port\
--tracker udp://host2:port\
--preload /path/to/directory\
--preload-max-filesize=50000\
--preload-max-filecount=10\
--preload-regex="\.(png|gif|jpeg|jpg|webp|svg|log|nfo|txt)$"aquatic-crawler --help