distributed-file-system

SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.

FastDFS is an open source high performance distributed file system (DFS). It's major functions include: file storing, file syncing and file accessing, and design for high capacity and load balance. Wechat/Weixin public account (Chinese Language): fastdfs

go-fastdfs 是一个简单的分布式文件系统(私有云存储)，具有无中心、高性能，高可靠，免维护等优点，支持断点续传，分块上传，小文件合并，自动同步，自动修复。Go-fastdfs is a simple distributed file system (private cloud storage), with no center, high performance, high reliability, maintenance free and other advantages, support breakpoint continuation, block upload, small file merge, automatic synchronization, automatic repair.(similar fastdfs).

The LeoFS Storage System

MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System (Software-Defined Storage)

Raft Java implementation which is simple and easy to understand.

A distributed POSIX filesystem based on TiKV, with partition tolerance and strict consistency.

Kertish-dfs is a simple distributed storage platform, implements file storage on a single distributed computer cluster, and provides interfaces for file/folder handling. Kertish-dfs aims primarily for completely distributed operation without a single point of failure, scalable to the exabyte level.

The legacy distributed object storage server developed by PitchPoint Solutions can store billions of large and small files using minimal resources. Object data is stored in replicated volumes implemented like Facebooks Haystack Object Store. Object metadata which essentially maps an object name to a volume position is stored in an elasticsearch index. (Development by PitchPoint Solutions has been discontinued)

IPFS Core API implementation in .Net

InterPlanetary File System for Business (IPFSfB) is an enterprise blockchain storage network based on InterPlanetary File System.

Distributed filesystem in Rust

Distributed KV Storage System based on Raft and RocksDB, can be use to store small files, like images.

🚀 List of distributed system projects for inspiration and learning to build distributed services from real world examples

Simple version of Distributed File System on multiple threads

🏠超精简分布式对象存储

DAFT Allows File Transfers

Yet Another File System (yfs) based on Paxos algorithm.

A filesystem evolved from MogileFS

Monitoring GlusterFS Discovery storage with Zabbix 3.4

Puppet module for LizardFS (highly-available and scalable open source distributed file system)

A general performance test framework for Distributed File System

A file system backed by AntidoteDB.

This repository contains a simple Hadoop-like (MapReduce) distributed computing platform implemented in Java. It is extended from a course project at UIUC awarded the best Java version implementation and it's open-sourced for reference.

Implementation of 9P parser and message writer.

Experimental distributed filesystem for Linux

A python implementation of Google File System

The core library for blobfs and blobfs-win project, this tool can help you mount the Azure Blob storage as the local disk driver, no matter it is a Linux system or a Windows system.