Popular GitHub Repositories for Dataops

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.

DataOps framework for Machine Learning projects.

DataOps Data Quality TestGen is part of DataKitchen's Open Source Data Observability. DataOps TestGen delivers simple, fast data quality test generation and execution by data profiling,  new dataset hygiene review, AI generation of data quality validation tests, ongoing testing of data refreshes, & continuous anomaly monitoring

Enterprise Scale AIFactory (esml) - on Azure

A curated list of awesome open source and commercial MLOps platforms ?

Python’s delightfully modular experiment tracker for MLOps

A comprehensive repository for generative AI research, platform engineering, updates, data and software engineering, system design and architecture, interview resources, notebooks, and much more!

Curated list of Awesome Training Data! (Data Labeling, Annotation, Discovery, Workflow etc)

My M.Sc. dissertation: Modern Data Platform using DataOps, Kubernetes, and Cloud-Native ecosystem to build a resilient Big Data platform based on Data Lakehouse architecture which is the base for Machine Learning (MLOps) and Artificial Intelligence (AIOps).

Overview of technologies and concepts for DataMLDevSecOps, with history

The modular open source data platform using kubernetes and cloud-native ecosystem which is the base for DataOps/MLOps(LLMOps)

Modern cloud-native federated data platform focused on data mesh paradigm while complying with state-of-the-art and conway's law.