stream-processing

Here are 941 public repositories matching this topic...

google / mediapipe

Cross-platform, customizable ML solutions for live and streaming media.

android c-plus-plus calculator machine-learning framework computer-vision deep-learning inference pipeline-framework stream-processing video-processing perception mobile-development audio-processing graph-framework graph-based mediapipe

Updated Dec 22, 2023
C++

vectordotdev / vector

Star

A high-performance observability data pipeline.

rust parser events router pipeline metrics vector logs stream-processing forwarder observability

Updated Dec 28, 2023
Rust

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

mysql redis elasticsearch streaming kafka spark influxdb rabbitmq clickhouse hbase stream-processing opentsdb loki flink rocketmq

Updated Sep 15, 2023
Java

newTendermint / awesome-bigdata

Star

A curated list of awesome big data frameworks, ressources and other awesomeness.

data-science data awesome database data-stream bigdata series-database data-visualization data-warehouse stream-processing data-analytics awesome-list distributed-database visualize-data streaming-data

Updated Oct 4, 2023

redpanda-data / redpanda

Star

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

go kubernetes streaming microservices kafka cpp seastar storage-engine containers realtime stream-processing event-driven redpanda

Updated Dec 23, 2023
C++

madd86 / awesome-system-design

Star

A curated list of awesome System Design (A.K.A. Distributed Systems) resources.

distributed-systems microservices nosql interview stream-processing microservices-architecture relational-database message-broker hadoop-ecosystem

Updated Dec 12, 2023

benthosdev / benthos

Star

Fancy stream processing made operationally mundane

go golang kafka cqrs etl rabbitmq amqp logs message-bus event-sourcing nats stream-processing message-queue data-engineering streaming-data stream-processor data-ops

Updated Dec 27, 2023
Go

robinhood / faust

Star

Python Stream Processing

python distributed-systems kafka stream-processing asyncio kafka-streams

Updated Nov 23, 2023
Python

ThreeDotsLabs / watermill

Star

Building event-driven applications the easy way in Go.

go golang events reactive kafka cqrs sagas rabbitmq event-sourcing nats stream-processing event-driven watermill

Updated Dec 20, 2023
Go

confluentinc / ksql

Star

The database purpose-built for stream processing applications.

real-time sql kafka interactive stream-processing kafka-connect materialized-views ksqldb ksqldb-documentation ksqldb-tutorials streaming-queries event-streaming-database

Updated Dec 28, 2023
Java

hazelcast / hazelcast

Star

Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.

java caching distributed-systems real-time big-data hazelcast scalability distributed-computing distributed stream-processing in-memory low-latency hacktoberfest data-insights data-in-motion

Updated Dec 27, 2023
Java

risingwavelabs / risingwave

Star

The streaming database: redefining stream processing 🌊. PostgreSQL-compatible, highly performant, scalable, elastic, and reliable ☁️.

Updated Dec 28, 2023
Rust

MaterializeInc / materialize

Star

The data warehouse for operational workloads.

rust distributed-systems streaming sql database kafka postgresql data-warehouse stream-processing streaming-data materialized-view postgresql-dialect operational-data-warehouse

Updated Dec 28, 2023
Rust

fluent / fluent-bit

Star

Fast and Lightweight Logs and Metrics processor for Linux, BSD, OSX and Windows

c metrics logging logs prometheus data-collector stream-processing fluentd fluent-bit cloudnative sql-queries forwarder traces opentelemetry

Updated Dec 26, 2023
C

apache / hudi

Star

Upserts, Deletes And Incremental Processing on Big Data.

bigdata stream-processing data-integration datalake apachespark hudi apachehudi incremental-processing apacheflink

Updated Dec 28, 2023
Java

online-ml / river

Star

🌊 Online machine learning in Python

python data-science machine-learning streaming stream-processing online-learning streaming-data concept-drift real-time-processing incremental-learning online-machine-learning online-statistics

Updated Dec 27, 2023
Python

javascriptdata / danfojs

Star

Danfo.js is an open source, JavaScript library providing high performance, intuitive, and easy to use data structures for manipulating and processing structured data.