-
Updated
Mar 8, 2022
#
data-stream
Here are 94 public repositories matching this topic...
A curated list of awesome big data frameworks, ressources and other awesomeness.
data-science
data
awesome
database
data-stream
bigdata
series-database
data-visualization
data-warehouse
stream-processing
data-analytics
awesome-list
distributed-database
visualize-data
streaming-data
Apache Kafka® running on Kubernetes
docker
kubernetes
kafka
openshift
messaging
data-stream
kafka-connect
kubernetes-operator
kafka-streams
kubernetes-controller
data-streaming
enmasse
data-streams
-
Updated
Mar 31, 2022 - Java
Probabilistic data structures for processing continuous, unbounded streams.
go
filter
data-stream
bloom-filter
count-min-sketch
probabilistic-programming
cuckoo-filter
scalable-bloom-filters
counting-bloom-filters
stable-bloom-filters
-
Updated
Mar 15, 2021 - Go
NIST Certified SCAP 1.2 toolkit
-
Updated
Mar 30, 2022 - XSLT
A lightweight stream processing library for Go
redis
kafka
pipeline
etl
websocket
data-stream
pipelines
streams
stream-processing
pulsar
windowing
aerospike
streaming-api
kafka-streams
throttling
data-pipeline
streaming-data
nats-streaming
stream-processor
apache-pulsar
-
Updated
Feb 11, 2022 - Go
An open-source framework for real-time anomaly detection using Python, ElasticSearch and Kibana
python
iot
elasticsearch
data-science
alerts
kibana
dashboard
timeseries
jupyter
sklearn
data-stream
datascience
dataset
machinelearning
anomaly
anomalydetection
anomalydiscovery
anomaly-detection
bokeh-dashboard
dsio
-
Updated
Mar 31, 2020 - Python
A stream processing API for Go (alpha)
-
Updated
Oct 17, 2021 - Go
Series and Panels for Real-time and Exploratory Analysis of Data Streams
-
Updated
Aug 14, 2021 - C#
Simple yet powerful live data computation framework
react
javascript
event-stream
stream
es6
promise
data-stream
transformations
reactive-programming
spark-streaming
streams2
-
Updated
Feb 11, 2022 - JavaScript
Data stream analytics: Implement online learning methods to address concept drift in data streams using the River library. Code for the paper entitled "PWPAE: An Ensemble Framework for Concept Drift Adaptation in IoT Data Streams" accepted in IEEE GlobeCom 2021.
iot
machine-learning
data-stream
lightgbm
adaptive-learning
ensemble-learning
drift
online-learning
streaming-data
real-time-analytics
concept-drift
change-detector
intrusion-detection-system
anomaly-detection
iot-data-analytics
drift-detection
cicids2017
-
Updated
Mar 24, 2022 - Jupyter Notebook
The Open Source Time-Series Data Historian
-
Updated
Mar 30, 2022 - TypeScript
xxxnell
commented
Jan 18, 2019
The Tornado 🌪️ framework, designed and implemented for adaptive online learning and data stream mining in Python.
data-stream
adaptive-learning
ddm
online-learning
adwin
concept-drift
incremental-learning
drift-detection
fhddm
mddm
eddm
hddm
-
Updated
Apr 24, 2021 - Python
Event Based Applications [DEPRECATED]
go
golang
library
event-stream
cep
data-stream
eda
event-driven
data-analysis
tideland
event-processing
-
Updated
Oct 11, 2017 - Go
Kafka-ML: connecting the data stream with ML/AI frameworks (now TensorFlow and PyTorch!)
docker
kubernetes
iot
machine-learning
kafka
deep-learning
tensorflow
data-stream
keras
pytorch
gpu-acceleration
keras-tensorflow
-
Updated
Mar 23, 2022 - Python
Learn how to use Kinesis Firehose, AWS Glue, S3, and Amazon Athena by streaming and analyzing reddit comments in realtime. 100-200 level tutorial.
real-time
reddit
sentiment-analysis
data-stream
tutorials
data-lake
kinesis-firehose
self-learning
sentiment-classification
amazon-athena
aws-glue
delivery-stream
-
Updated
Apr 20, 2021 - Python
A framework for data stream modeling and associated data mining tasks such as clustering and classification. - R Package
-
Updated
Dec 16, 2021 - R
unsupervised concept drift detection
-
Updated
Aug 25, 2021 - Python
RPJiOS: RPJ's RPi OS, a sensor data platform for the Raspberry Pi built with python2.7 and redis.
python
redis
raspberry-pi
rpi
sensor
data-stream
data-platform
sensors
data-processing
data-pipeline
garden-bots
-
Updated
Mar 11, 2022 - Python
f1ames
commented
Dec 13, 2021
A simple C# network library.
c-sharp
serialization
socket
csharp
communication
unity
network
protocol
data-stream
unity3d
unity-3d
greeter
il2cpp
remote-method-invocation
netstandard20
-
Updated
Mar 31, 2022 - C#
A library for performing Content-Defined Chunking (CDC) on data streams.
-
Updated
Feb 28, 2022 - Rust
a suite of benchmark applications for distributed data stream processing systems
big-data
apache-spark
storm
data-stream
bigdata
evaluation
stream-processing
spark-streaming
apache-storm
apache-flink
experiments
big-data-analytics
-
Updated
Mar 24, 2022 - Java
An online learning method used to address concept drift. Code for the paper entitled "A Lightweight Concept Drift Detection and Adaptation Framework for IoT Data Streams" published in IEEE Internet of Things Magazine.
iot
machine-learning
random-forest
svm
data-stream
xgboost
hyperparameter-optimization
lightgbm
drift
bayesian-optimization
particle-swarm-optimization
online-learning
real-time-analytics
concept-drift
change-detector
intrusion-detection-system
anomaly-detection
nsl-kdd
drift-detection
-
Updated
Sep 14, 2021 - Jupyter Notebook
In this project, we implemented a topic detection system on Twitter. This system reads tweets from a data stream and assigns them to one of the existing clusters or a new one. Each cluster acts as an agent, which makes the proposed approach a multi-agent system. There is also a coordinator, who monitors the whole system and coordinates the agent.
-
Updated
Apr 28, 2021 - Python
MIST: High-performance IoT Stream Processing
-
Updated
Mar 19, 2019 - Java
A Node.js and JavaScript synchronous data pipeline processing, data sharing and stream processing library. Actionable & Transformable Pipeline data processing.
nodejs
javascript
flow
data-stream
data-transformation
pipeline-framework
data-flow
synchronous
data-pipeline
streaming-data
data-processor
pipe-data
-
Updated
Aug 8, 2017 - JavaScript
HyperLogLog and other probabilistic data structures for mining in data streams
-
Updated
Dec 3, 2014 - Python
Verifies data streams from synchrophasor measurement devices
-
Updated
Mar 30, 2022 - C#
Improve this page
Add a description, image, and links to the data-stream topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the data-stream topic, visit your repo's landing page and select "manage topics."
We should add a Github action that runs
make generate
and succeeds if there is no diff. It should run on each push to a PR.We could do the same with proto files (generate them and make sure there's no diff).