peregrine

Making large AI models cheaper, faster and more accessible

Port of OpenAI's Whisper model in C/C++

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

Python sample codes and textbook for robotics algorithms.

? Python examples of popular machine learning algorithms with interactive Jupyter demos and math being explained

ncnn is a high-performance neural network inference framework optimized for the mobile platform

?? ?? ??? ?? ?? & ?? ?? ???? ?

SGLang is a fast serving framework for large language models and vision language models.

? The exhaustive Pattern Matching library for TypeScript, with smart type inference.