Kitten is a distributed file system optimized for small files storage，inspired by Facebook‘s Haystack。
- High throughput & Low latency for millions of files
- Fault-tolerant, store replicates files on different racks
- Cost-effective
- Simple
Find more detail design in docs folder.
| Name | Issue | Description |
|---|---|---|
| Kitten's basic component | #1 | Implement basic component including StoreProxy, Directory(WIP), Cache |
| Introduce Etcd | #2 | |
| Expose easy APIs | #3 | Find an elegantly way to expose APIs. |
| Support S3 API | #4 | As S3 APIs are the de facto standards for OSS， support S3 style APIs. |
| Implement erasure code | #5 | Split data into two groups(hot/warm), use erasure code to store warm data. |
Inspired by:
bfs distributed file system(small file storage) writen in golang.
seaweedfs SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files!
Thanks again for JetBrains' Sponsorship!