AIbase
Product LibraryTool Navigation

llm-compressor

Public

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

Creat2024-06-21T04:13:34
Update2025-03-27T04:04:52
1.2K
Stars
4
Stars Increase