apache-arrow

Instant Kubernetes-Native Application Observability

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

Modern columnar data format for ML implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..

❄️ Coolest database around 🧊 Embeddable column database written in Go.

Manipulate JSON-like data with NumPy-like idioms.

Infrastructures™ for Machine Learning Training/Inference in Production.

A Rust DataFrame implementation, built on Apache Arrow

A SQLite vtable extension to read Parquet files

Official Julia implementation of Apache Arrow

Manipulate arrays of complex data structures as easily as Numpy.

Geospatial extensions for Polars

Fletcher: A framework to integrate FPGA accelerators with Apache Arrow

Transactional NoSQL database with Zero-Copy Semantics, Vector Search, replaceable backends, and a vast ecosystem of bindings for C, C++, Python, Java, GoLang

Rust-based WebAssembly bindings to read and write Apache Parquet data

Convert a CSV to a parquet file.

Pod5: a high performance file format for nanopore reads.

In-memory, columnar, arrow-based database.

Java read and write example for Apache Arrow

A simple dataframe library for Ruby