logistic-point-process

A high-throughput and memory-efficient inference and serving engine for LLMs

Making large AI models cheaper, faster and more accessible

Port of OpenAI's Whisper model in C/C++

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

ncnn is a high-performance neural network inference framework optimized for the mobile platform

Tool for producing high quality forecasts for time series data that has multiple seasonality with linear or non-linear growth.

State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enterprise-grade infrastructure.

Machine Learning Engineering Open Book

? The exhaustive Pattern Matching library for TypeScript, with smart type inference.

SGLang is a fast serving framework for large language models and vision language models.