Popular GitHub Repositories for Torchserve

Torchserve server using a YoloV5 model running on docker with GPU and static batch inference to perform production ready and real time inference.

A minimalistic and pluggable machine learning platform for Kubernetes.

TorchServe+Streamlit for easily serving your HuggingFace NER models

Deploy Swin Transformer using TorchServe

Slides and notebook for the workshop on serving bert models in production

Quick and easy tutorial to serve HuggingFace sentiment analysis model using torchserve

Deploy FastAI Trained PyTorch Model in TorchServe and Host in GCP's AI-Platform Prediciton.

TorchServe images with specific Python version working out-of-the-box.

This repo implements a minimalistic pytorch_lightning + neptune + torchserve flow for (computer vision) model training and deployment

ML Lifecycle project

? My source code for MSRA-USTC Joint Innovation Project 2021 Track AI System: Deploying deep learning model on Docker to prepare for large-scale inference.

Multi video offline streaming and Yolov8 object detection with Kafka, torch serve, AWS EC2

Template to serve, optimize and scale ? pipeline in production with Torchserve & Docker

Use torchserve, fastapi and nextjs to deploy a stable diffusion vision model with docker compose - The School of AI EMLO-V4 course assignment https://theschoolof.ai/#programs

Simple NER Pipeline Using KoCharELECTRA

Contains solutoins for assignments and learning notes from Extensive Machine Learning Operations course of The School of AI

This repo contains a deployment of a super-resolution network in pytorch-lightning.

Launch a Segment Anything inference endpoint with 1 Bash command.

Personal project aimed at developing a ML service which resembles a production environment system

Modern web interface for Stable Diffusion 3 text-to-image generation. Features real-time progress tracking, local storage, and a sleek dark mode UI. Built with Next.js 15, FastAPI, and TorchServe.