Popular GitHub Repositories for Torchserve

Torchserve server using a YoloV5 model running on docker with GPU and static batch inference to perform production ready and real time inference.

A minimalistic and pluggable machine learning platform for Kubernetes.

TorchServe+Streamlit for easily serving your HuggingFace NER models

Deploy Swin Transformer using TorchServe

Slides and notebook for the workshop on serving bert models in production

This repo contains a deployment of a super-resolution network in pytorch-lightning.

Quick and easy tutorial to serve HuggingFace sentiment analysis model using torchserve

Deploy FastAI Trained PyTorch Model in TorchServe and Host in GCP's AI-Platform Prediciton.

TorchServe images with specific Python version working out-of-the-box.

This repo implements a minimalistic pytorch_lightning + neptune + torchserve flow for (computer vision) model training and deployment

ML Lifecycle project

? My source code for MSRA-USTC Joint Innovation Project 2021 Track AI System: Deploying deep learning model on Docker to prepare for large-scale inference.

Template to serve, optimize and scale ? pipeline in production with Torchserve & Docker

Multi video offline streaming and Yolov8 object detection with Kafka, torch serve, AWS EC2

Use torchserve, fastapi and nextjs to deploy a stable diffusion vision model with docker compose - The School of AI EMLO-V4 course assignment https://theschoolof.ai/#programs

Simple NER Pipeline Using KoCharELECTRA

Contains solutoins for assignments and learning notes from Extensive Machine Learning Operations course of The School of AI

Launch a Segment Anything inference endpoint with 1 Bash command.

Personal project aimed at developing a ML service which resembles a production environment system

Modern web interface for Stable Diffusion 3 text-to-image generation. Features real-time progress tracking, local storage, and a sleek dark mode UI. Built with Next.js 15, FastAPI, and TorchServe.