distributed-storage

SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, local tiering, cloud tiering. Filer supports cross-cluster active-active replication, Kubernetes, POSIX, S3 API, encryption, Erasure Coding for warm storage, FUSE mount, Hadoop, WebDAV, mount cloud storage.

A feature complete and high performance multi-group Raft library in Go.

An industrial-grade C++ implementation of RAFT consensus algorithm based on brpc, widely used inside Baidu to build highly-available distributed systems.

ChubaoFS (abbrev. CBFS) is a cloud native distributed file system and object store.

Pravega - Streaming as a new software defined storage primitive

The LeoFS Storage System

Distributed "massively parallel" SQL query engine

MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System (Software-Defined Storage)

Distributed Storage System for QEMU

Raft Java implementation which is simple and easy to understand.

High-performance Distributed Storage

Awesome list of distributed systems resources

CORTX Community Object Storage is 100% open source object storage uniquely optimized for mass capacity storage devices.

Distributed object storage server from Douban Inc.

DAOS Storage Engine

zenoh unifies data in motion, data in-use, data at rest and computations. It carefully blends traditional pub/sub with geo-distributed storages, queries and computations, while retaining a level of time and space efficiency that is well beyond any of the mainstream stacks.

MySQL 学习笔记

A distributed key-value store. On Disk. Able to grow or shrink without service interruption.

Low-Level Versioned Store

A collection of Salt files for deploying, managing and automating Ceph.

😇 A Docker Compose bundle to run on servers with spare CPU, RAM, disk, and bandwidth to help the world. Includes Tor, ArchiveWarrior, BOINC, and more...

A decentralized (p2p) file storage system built atop Kademlia DHT that enforces data integrity, privacy, and availability through sharding, proofs of retrievability, redundancy, and encryption, with smart-contract powered incentive scheme

Kertish-dfs is a simple distributed storage platform, implements file storage on a single distributed computer cluster, and provides interfaces for file/folder handling. Kertish-dfs aims primarily for completely distributed operation without a single point of failure, scalable to the exabyte level.

The legacy distributed object storage server developed by PitchPoint Solutions can store billions of large and small files using minimal resources. Object data is stored in replicated volumes implemented like Facebooks Haystack Object Store. Object metadata which essentially maps an object name to a volume position is stored in an elasticsearch index. (Development by PitchPoint Solutions has been discontinued)

File-system fault injection framework for distributed storage systems

电子科技大学分布式存储与计算实验室2018新生学习资料整理

A distributed consistent graph storage

Distributed KV Storage System based on Raft and RocksDB, can be use to store small files, like images.

IOTA meets BitTorrent: An algorithm to persist any file onto the tangle of IOTA