#
airflow
Here are 469 public repositories matching this topic...
Argo Workflows: Get stuff done with Kubernetes.
-
Updated
Aug 9, 2020 - Go
Dolphin Scheduler is a distributed and easy-to-extend visual workflow scheduling platform, dedicated to solving the complex dependencies in data processing, making the scheduling system out of the box for data processing.(分布式易扩展的可视化工作流任务调度)
airflow
schedule
job-scheduler
oozie
task-scheduler
azkaban
distributed-schedule-system
workflow-scheduling-system
etl-dependency
workflow-platform
cronjob-schedule
job-schedule
task-schedule
workflow-schedule
data-schedule
-
Updated
Aug 9, 2020 - Java
PipelineAI Kubeflow Distribution
docker
kubernetes
redis
machine-learning
airflow
kafka
spark
cassandra
neural-network
tensorflow
gpu
scikit-learn
keras
pytorch
artificial-intelligence
kubeflow
tfx
pipelineai
-
Updated
Apr 24, 2020 - Jsonnet
Docker Apache Airflow
-
Updated
Jul 29, 2020 - Shell
Curated list of resources about Apache Airflow
-
Updated
Jul 27, 2020
DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.
workflow
airflow
spark
hive
hadoop
etl
kettle
hue
tableau
flink
zeppelin
griffin
azkaban
governance
davinci
visualis
supperset
linkis
scriptis
dataworks
-
Updated
Jul 31, 2020 - Java
A series of DAGs/Workflows to help maintain the operation of Airflow
-
Updated
Aug 7, 2020 - Python
An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
python
airflow
spark
apache-spark
scheduler
s3
data-engineering
data-lake
warehouse
redshift
data-migration
livy
etl-framework
apache-airflow
emr-cluster
etl-pipeline
etl-job
data-engineering-pipeline
airflow-dag
goodreads-data-pipeline
-
Updated
Mar 9, 2020 - Python
Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition
python
vagrant
data-science
data
machine-learning
airflow
kafka
spark
apache-spark
analytics
machine-learning-algorithms
python3
amazon-ec2
python-3
apache-kafka
amazon-web-services
predictive-analytics
agile-data
data-syndrome
agile-data-science
-
Updated
Jul 29, 2020 - Jupyter Notebook
Turbine: the bare metals that gets you Airflow
-
Updated
Jul 6, 2020 - Python
Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.
infrastructure
aws
postgres
data
airflow
cloudformation
cassandra
cluster
aws-s3
aws-sdk
data-warehouse
data-engineering
data-lake
aws-ec2
postgresql-database
data-modeling
cassandra-database
etl-pipeline
data-engineering-pipeline
airflow-operators
-
Updated
Mar 5, 2020 - Python
Kubernetes custom controller and CRDs to managing Airflow
kubernetes
airflow
workflow-engine
kubernetes-operator
kubernetes-controller
apache-airflow
crd
airflow-operator
-
Updated
Jun 25, 2020 - Go
A plugin for Apache Airflow that exposes rest end points for the Command Line Interfaces
-
Updated
Jul 15, 2020 - Python
Dynamically generate Apache Airflow DAGs from YAML configuration files
-
Updated
Aug 8, 2020 - Python
Example DAGs using hooks and operators from Airflow Plugins
airflow
mongodb
etl
google-analytics
imap
selenium
sftp
mailgun
salesforce
facebook-ads
dbt
hubspot
dag
marketo
singer
apache-airflow
marketo-sdk
airflow-plugins
-
Updated
Jul 24, 2018 - Python
A web frontend for scheduling Jupyter notebook reports
docker
kubernetes
airflow
jupyter
notebook
jupyter-notebook
nteract
luigi
celery
jupyterlab
dask
jupyter-notebooks
phosphorjs
apache-airflow
papermill
scheduling-notebooks
-
Updated
Feb 28, 2020 - Python
A process that runs in unison with Apache Airflow to control the Scheduler process to ensure High Availability
airflow
high-availability
scheduler-failover-controller
apache-airflow
airflow-scheduler
airflow-cluster
-
Updated
Dec 24, 2019 - Python
Airflow Unit Tests and Integration Tests
-
Updated
Jul 27, 2020 - Python
Airflow plugin to export dag and task based metrics to Prometheus.
-
Updated
May 7, 2020 - Python
docker
postgres
data-science
airflow
jupyter
docker-compose
jupyter-notebook
superset
apache
minio
apistar
-
Updated
Nov 27, 2018
python
docker
postgres
data-science
airflow
jupyter
docker-image
superset
cookiecutter
minio
apistar
-
Updated
Jun 14, 2020 - Jupyter Notebook
afctl helps to manage and deploy Apache Airflow projects faster and smoother.
-
Updated
Apr 5, 2020 - Python
Fast iterative local development and testing of Apache Airflow workflows
-
Updated
Dec 9, 2019 - Shell
Use Airflow to move data from multiple MySQL databases to BigQuery
-
Updated
Jul 21, 2020 - PLpgSQL
A Helm chart to install Apache Airflow on Kubernetes
-
Updated
Aug 6, 2020 - Shell
Improve this page
Add a description, image, and links to the airflow topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the airflow topic, visit your repo's landing page and select "manage topics."