stream-processing

Here are 918 public repositories matching this topic...

google / mediapipe

Cross-platform, customizable ML solutions for live and streaming media.

android c-plus-plus calculator machine-learning framework computer-vision deep-learning inference pipeline-framework stream-processing video-processing perception mobile-development audio-processing graph-framework graph-based mediapipe

Updated Jun 17, 2023
C++

vectordotdev / vector

Star

A high-performance observability data pipeline.

rust parser events router pipeline metrics vector logs stream-processing forwarder vrl observability

Updated Jun 19, 2023
Rust

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

mysql redis elasticsearch streaming kafka spark influxdb rabbitmq clickhouse hbase stream-processing opentsdb loki flink rocketmq

Updated Jun 14, 2023
Java

newTendermint / awesome-bigdata

Star

A curated list of awesome big data frameworks, ressources and other awesomeness.

data-science data awesome database data-stream bigdata series-database data-visualization data-warehouse stream-processing data-analytics awesome-list distributed-database visualize-data streaming-data

Updated Jun 16, 2023

redpanda-data / redpanda

Star

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

go kubernetes streaming microservices kafka cpp seastar storage-engine containers realtime stream-processing event-driven redpanda

Updated Jun 19, 2023
C++

madd86 / awesome-system-design

Star

A curated list of awesome System Design (A.K.A. Distributed Systems) resources.

distributed-systems microservices nosql interview stream-processing microservices-architecture relational-database message-broker hadoop-ecosystem

Updated May 20, 2023

robinhood / faust

Star

Python Stream Processing

python distributed-systems kafka stream-processing asyncio kafka-streams

Updated Feb 23, 2023
Python

benthosdev / benthos

Star

Fancy stream processing made operationally mundane

go golang kafka cqrs etl rabbitmq amqp logs message-bus event-sourcing nats stream-processing message-queue data-engineering streaming-data stream-processor data-ops

Updated Jun 19, 2023
Go

ThreeDotsLabs / watermill

Star

Building event-driven applications the easy way in Go.

go golang events reactive kafka cqrs sagas rabbitmq event-sourcing nats stream-processing event-driven watermill

Updated Jun 10, 2023
Go

confluentinc / ksql

Star

The database purpose-built for stream processing applications.

real-time sql kafka interactive stream-processing kafka-connect materialized-views ksqldb ksqldb-documentation ksqldb-tutorials streaming-queries event-streaming-database

Updated Jun 19, 2023
Java

hazelcast / hazelcast

Star

Open-source distributed computation and storage platform. Real-time Stream Processing Unconference. Save Your Spot https://hazelcast.com/lp/unconference/

java caching distributed-systems big-data hazelcast scalability distributed-computing distributed stream-processing in-memory low-latency hacktoberfest

Updated Jun 19, 2023
Java

MaterializeInc / materialize

Star

Materialize is a fast, distributed SQL database built on streaming internals.

rust distributed-systems streaming sql database kafka postgresql stream-processing materialized-view postgresql-dialect

Updated Jun 19, 2023
Rust

fluent / fluent-bit

Star

Fast and Lightweight Logs and Metrics processor for Linux, BSD, OSX and Windows

c metrics logging logs prometheus data-collector stream-processing fluentd fluent-bit cloudnative sql-queries forwarder traces opentelemetry

Updated Jun 19, 2023
C

risingwavelabs / risingwave

Star

🚀SQL stream processing with Postgres-like experience. 🪄More than a modern alternative to Apache Flink.

rust postgres real-time sql database kafka serverless postgresql stream-processing pulsar dataflow distributed-database cloud-native postgresql-database flink

Updated Jun 19, 2023
Rust

apache / hudi

Star

Upserts, Deletes And Incremental Processing on Big Data.

bigdata stream-processing data-integration datalake apachespark hudi apachehudi incremental-processing apacheflink

Updated Jun 19, 2023
Java

online-ml / river

Star

🌊 Online machine learning in Python

python data-science machine-learning streaming stream-processing online-learning streaming-data concept-drift real-time-processing incremental-learning online-machine-learning online-statistics

Updated Jun 14, 2023
Python

javascriptdata / danfojs

Star

Danfo.js is an open source, JavaScript library providing high performance, intuitive, and easy to use data structures for manipulating and processing structured data.