Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

Open MPI main development repository

Kratos Multiphysics (A.K.A Kratos) is a framework for building parallel multi-disciplinary simulation software. Modularity, extensibility and HPC are the main objectives. Kratos has BSD license and is written in C++ with extensive Python interface.

OpenHPC Integration, Packaging, and Test Repo

distributed dataflows with functional list operations for data processing with C++14

Official git repository of Elmer FEM software

LibTomMath is a free open source portable number theoretic multiple-precision integer library written entirely in C.

Unified Communication X (mailing list - https://elist.ornl.gov/mailman/listinfo/ucx-group)

Python bindings for MPI

C++ library for solving large sparse linear systems with algebraic multigrid method

High-performance stateful serverless runtime based on WebAssembly

This is a set of simple programs that can be used to explore the features of a parallel platform.

Official MPICH Repository

一週間でなれる！スパコンプログラマ

Simplify HPC and Batch workloads on Azure

🔬 Assemble large genomes using short reads

A fast simulator and a library dedicated to the channel coding.

DMTCP: Distributed MultiThreaded CheckPointing

🚀 Fast prime counting function implementations

MPI wrappers for Julia

TomsFastMath is a fast public domain, open source, large integer arithmetic library written in portable ISO C.

RAxML Next Generation: faster, easier-to-use and more flexible

Modular, multilingual (C, C++, CUDA, Fortran, Python) utility for performance measurement and analysis

Kubernetes Operator for Allreduce-style Distributed Training

Information about many aspects of high-performance computing. Wiki content moved to ~/docs.

QUDA is a library for performing calculations in lattice QCD on GPUs.

DASH, the C++ Template Library for Distributed Data Structures with Support for Hierarchical Locality for HPC and Data-Driven Science

Intel(R) Machine Learning Scaling Library is a library providing an efficient implementation of communication patterns used in deep learning.

parallel finite element unstructured meshes

Ytk-mp4j is a fast, user-friendly, cross-platform, multi-process, multi-thread collective message passing java library which includes gather, scatter, allgather, reduce-scatter, broadcast, reduce, allreduce communications for distributed machine learning.