inference-server-old

Open Source Computer Vision Library

《动手学深度学习》：面向中文读者、能运行、可讨论。中英文版被70多个国家的500多所大学用于教学。

A high-throughput and memory-efficient inference and serving engine for LLMs

Making large AI models cheaper, faster and more accessible

Port of OpenAI's Whisper model in C/C++

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

12 Weeks, 24 Lessons, AI for All!

CasaOS - A simple, easy-to-use, elegant open-source Personal Cloud system.

Image-to-Image Translation in PyTorch

High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios