Popular GitHub Repositories for Apache Airflow

The practical use-cases of how to make your Machine Learning Pipelines robust and reliable using Apache Airflow.

数据仓库环境下的ELT数据管道实现

MCP Server for Apache Airflow

基于Docker Compose的Apache Airflow + Spark ETL流程：OpenWeather数据导入PostgreSQL数据库

This project was driven by the need to provide our client Mela, a startup focusing on simplifying cryptocurrency investments, with a reliable and scalable platform for backtesting trading strategies. Additionally, leveraging advanced forecasting methods would enhance the platform's capability to predict future price trends with greater accuracy.

?? MLOps Mini-Projects & Use Cases ?? Explore hands-on MLOps projects! ? From ML and DL to Generative AI, see how I deploy and manage models using cutting-edge tools. ?? Regular updates as I experiment with new MLOps solutions! ??

RAG with Apache Airflow, LlamaIndex, and?Qdrant

Using MLOps and ETL pipeline, an end-to-end machine learning model developed to forecast the Consignment Product.

This is an end-to-end AWS Cloud ETL project. This data pipeline orchestration uses Apache Airflow on AWS EC2 as well as Snowpipe. It demonstrates how to build ETL data pipeline that would perform data transformation using Python on Apache Airflow as well as automatic ingestion into Snowflake data warehouse via Snowpipe. Also features Power BI.

This is an end-to-end AWS Cloud ETL project. This orchestration uses Apache Airflow on AWS EC2 as well as AWS Glue. It demonstrates how to build ETL pipeline that would perform data transform using Glue job/crawler as well as loading into a Redshift table. It also shows how to connect Amazon Athena to Glue Data Catalog, and Power BI to Redshift.

Cookbook for Dockerized MLOps