llm-compressor
PublicTransformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM