Popular GitHub Repositories for Bentoml

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Model Deployment at Scale on Kubernetes ??

Pybind11 bindings for Whisper.cpp

A simple web application that lets you replace any part of an image with an image generated based on your description.

This repository contains instructions, template source code and examples on how to serve/deploy machine learning models using various frameworks and applications such as Docker, Flask, FastAPI, BentoML, Streamlit, MLflow and even code on how to deploy your machine learning model as an android app.

A bentoML-powered API to transcribe audio and make sense of it

A simple yet complete guide to MLOps tools and practices - from a conventional way to a modern approach of working with ML projects.

Serve Llama 3.3 70B (with AWQ quantization) using vLLM and deploy it on BentoCloud.

Generate novel text - novel finetuned from skt KoGPT2 base v2 - ???

API serving for your diffusers models

End to End MLOps

? ML Inference Pipeline for Legist

My practices in mlops tools ?. Feel free to explore the various scripts and files ??. I am just diving into the world of production-ready Machine Learning with streamlined workflows. ?

A pipeline built on ZenML for training digit MNIST dataset using Pytorch, experiment tracking using MLFlow and model deployment using BentoML

Testing the integration of MLFlow and BentoML

Serving and deploying LLMs with Bento Ecosystem.

This repository contains a machine learning project focused on building a recommender system. The project is structured to facilitate the development, training, evaluation, and deployment of the recommender model. Key components and configurations are managed using various tools and frameworks.

LifeCycle for ML

LLM Serving Libs Benchmark