volksdep

Making large AI models cheaper, faster and more accessible

Port of OpenAI's Whisper model in C/C++

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Build and share delightful machine learning apps, all in Python. ? Star to support our work!

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

ncnn is a high-performance neural network inference framework optimized for the mobile platform

SGLang is a fast serving framework for large language models and vision language models.

? The exhaustive Pattern Matching library for TypeScript, with smart type inference.

webhook is a lightweight incoming webhook server to run shell commands

Example ? Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using ? Amazon SageMaker.