Popular GitHub Repositories for Load Balancer

Stateful load balancer custom-tailored for llama.cpp ??

Gateway and load balancer to your LLM inference endpoints

Practical use of Azure API Management's AI Gateway to manage Azure OpenAI operations.

一个开源的、容器化的系统，利用陷阱、蜜罐和智能分析来阻止AI爬虫。

Yarp usage example

CloudApp - A Full Stack application with Next.js 14 Frontend (App shell and Micro frontends), Java and Python microservices, Kafka based Chat, Nginx load balancer and reverse proxy, OpenStreetMap, Local Ollama LLM AI and Jira integrations. MongoDB and Postgres database foundation.

The Text Classification using MLOps project delivers a production-ready MLOps pipeline with MLflow for experiment tracking, DVC for data versioning on Amazon S3, and CI/CD automation via GitHub Actions. It features AWS Auto Scaling Groups, Load Balancers, and Launch Templates for scalable and resilient deployments.

AI Movie Recommendation System supporting 1M users