Popular GitHub Repositories for Infrastructure

A portable accelerated data query and LLM-inference engine, written in Rust, for data-grounded AI apps and agents.

A Data Engineering & Machine Learning Knowledge Hub

Distribute and run AI workloads magically in Python, like PyTorch for ML infra.

Epsilla is a high performance Vector Database Management System

The Fuzzy Labs guide to the universe of open source MLOps

?? CodeBoxAPI is the simplest sandboxing infrastructure for your LLM Apps and Services.

Distributed DAG (Directed acyclic graph) framework for machine learning with UI

Turns devices into a scalable LLM platform

SDCN is an infrastructure that allows people to share and use Stable Diffusion computing power easily.

A curated list of research in System for Edge Intelligence and Computing(Edge MLSys), including Frameworks, Tools, Repository, etc. Paper notes are also provided.

Easiest way to build custom agents, in a no-code notion style editor, using simple macros.

Blockchain infrastructure for decentralized machine learning (decentralized-ml repo).

Gateway and load balancer to your LLM inference endpoints

The reliability layer between your code and LLM providers.

Terraform configuration for self-hosting Langfuse on Google Cloud.

Practice for Machine Learning in Production course

Airflow POC demo : 1) env set up 2) airflow DAG 3) Spark/ML pipeline | #DE

Inferex looks after serving, scaling, securing & monitoring your models, and liberating your ML team from the overhead of managing and maintaining infrastructure.

✭ MAGNETRON ™ ✭: This is a Google Colab/Jupyter Notebook for developing an OBJECT DETECTION proxia when working with ARTIFICIAL INTELLIGENCE 2.0 ™ (ARTIFICIAL INTELLIGENCE 2.0™ is part of MAGNETRON ™ TECHNOLOGY).

Deploy serverless LLM from Azure marketplace using bicep.