Popular GitHub Repositories for Orchestration

BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.

What are the principles we can use to build LLM-powered software that is actually good enough to put in the hands of production customers?

dstack is a lightweight, open-source alternative to Kubernetes & Slurm, simplifying AI container orchestration with multi-cloud & on-prem support. It natively supports NVIDIA, AMD, TPU, and Intel accelerators.

A reactive runtime for building durable AI agents

ML pipeline orchestration and model deployments on Kubernetes.

Simple and flexible ML workflow engine

? Autonomous agent framework for Elixir. Built for distributed, autonomous behavior and dynamic workflows.

ClearML Agent - ML-Ops made easy. ML-Ops scheduler & orchestration solution

Construct a modern data stack and orchestration the workflows to create high quality data for analytics and ML applications.

Kheish: A multi-role LLM agent for tasks like code auditing, file searching, and more—seamlessly leveraging RAG and extensible modules.

Lightweight Multi Agent AI Orchestrator Framework with AGI Capabilities.

a modular multimodal framework for ai applications

FuseML aims to provide an MLOps framework as the medium dynamically integrating together the AI/ML tools of your choice. It's an extensible tool built through collaboration, where Data Engineers and DevOps Engineers can come together and contribute with reusable integration code.

SAP Cloud SDK for AI is the official Software Development Kit (SDK) for SAP AI Core, SAP Generative AI Hub, and Orchestration Service.

NFVdeep: Deep Reinforcement Learning for Online Orchestration of Service Function Chains

ACP（Agent Control Plane）是一个分布式代理调度器，其设计目标是简洁、清晰和易于控制。它专为无需监控即可运行的外部循环代理而设计，这些代理执行异步工具调用，例如请求人工反馈以处理关键操作。完全支持MCP。

Oracle Bedrock

a self-hosted solution for running ai-generated code in secure sandboxes

a self-hosted solution for running ai-generated code in a sandbox

Integration patterns - Using AI in business processes