RaBitQ

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!

Lossy PNG compressor — pngquant command based on libimagequant library

mlpack: a fast, header-only C++ machine learning library

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

Sparsity-aware deep learning inference runtime for CPUs

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks

? Accelerate inference and training of ? Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools