Popular GitHub Repositories for Runtime

A retargetable MLIR-based machine learning compiler and runtime toolkit.

an MLOps/LLMOps platform

Sandwood - A JVM based Java like Probabilistic Programming Language

LCAI-TIHU SW is a software stack of the AI inference processor based on RISC-V

Tensor-like types – with variadic shapes – that support both static and runtime type checking, and convenient parsing

Repository for the Llama Programming Language. Work In Progress

A toolset application for iOS/MacOS developer with Xcode. eg: Copilot, Copilot Chat, Xcode&runtime Manager, Cleaner ...

Run AI agents with a single YAML file

Tradeoff between runtime and RAM usage for large language model inference.

Your AI Catalyst: inference backend to maximize your model's inference performance

Realtime Interprocess Communication and Orchestration for Robotics & AI

Basic Everyday Extensions required for basic nlp Tasks and math related etc

Universal Runtime Code Executor for AI-Generated Code and API Execution Worker.