Popular GitHub Repositories for Opa Envoy

The Cloud-Native API Gateway and AI Gateway

Intelligent (edge and LLM) proxy for agents. Move faster by letting Arch handle the pesky heavy lifting in building agentic apps. Fast ?? task clarification, agent routing, seamless integration of prompts with tools for common tasks, and unified access and observability of LLMs.

Permit Policy Decision Point service. High-performance, policy-driven authorization for your apps and service.

LLM Semantic Router: Intelligent Mixture-of-Models (MoM) System with Advanced ML Security. An advanced semantic router that intelligently directs OpenAI API requests to the most suitable backend language model from a defined pool based on deep semantic understanding of request content.

轻量级 AI 推理网关——本地模型注册中心和参数转换器（Python SDK），可选 Envoy 代理处理器和 FastAPI 注册服务器部署方案。

Envoy based LLM model router

Demos for Java-based AI on Kubernetes from Development to Deployment

A web application showcasing AI techniques.

A unified security event schema for LLM, RAG, and Agent applications.

AI-powered infrastructure recommendations for DevOps. Analyzes Terraform, Ansible, and OPA Rego configurations to optimize your infrastructure-as-code. Part of the Kado ecosystem, it securely leverages AI to enhance DevOps workflows with intelligent insights.

A FinOps control plane for AI APIs - Drop-in API gateway that enforces hard budgets, rate limits, and custom policy checks before any request reaches AI providers. Stop surprise AI bills with multi-tenant budget controls, complete audit trails, and sub-20ms latency overhead

? Streamline your FastAPI apps with this Python SDK, enabling seamless integration with Vercel AI for real-time AI responses.

Exploring MCP security: prompt injections, leaks, auth bypasses, OPA policies, and quirky edge cases. A playground for safe, educational, and cutting-edge model security experiments.