Popular GitHub Repositories for Orchestration

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.

dstack is a lightweight, open-source alternative to Kubernetes & Slurm, simplifying AI container orchestration with multi-cloud & on-prem support. It natively supports NVIDIA, AMD, TPU, and Intel accelerators.

A reactive runtime for building durable AI agents

Aqueduct is no longer being maintained. Aqueduct allows you to run LLM and ML workloads on any cloud infrastructure.

ML pipeline orchestration and model deployments on Kubernetes.

Simple and flexible ML workflow engine

? Autonomous agent framework for Elixir. Built for distributed, autonomous behavior and dynamic workflows.

ClearML Agent - ML-Ops made easy. ML-Ops scheduler & orchestration solution

Construct a modern data stack and orchestration the workflows to create high quality data for analytics and ML applications.

Kheish: A multi-role LLM agent for tasks like code auditing, file searching, and more—seamlessly leveraging RAG and extensible modules.

Lightweight Multi Agent AI Orchestrator Framework with AGI Capabilities.

a modular multimodal framework for ai applications

FuseML aims to provide an MLOps framework as the medium dynamically integrating together the AI/ML tools of your choice. It's an extensible tool built through collaboration, where Data Engineers and DevOps Engineers can come together and contribute with reusable integration code.

SAP Cloud SDK for AI is the official Software Development Kit (SDK) for SAP AI Core, SAP Generative AI Hub, and Orchestration Service.

NFVdeep: Deep Reinforcement Learning for Online Orchestration of Service Function Chains

Oracle Bedrock

a self-hosted solution for running ai-generated code in a sandbox

Integration patterns - Using AI in business processes

A toolkit for composing self-learning algorithmic trading agents