awesome-compression

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Awesome Knowledge Distillation

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

Collection of AWESOME vision-language models for vision tasks

"Effective Whole-body Pose Estimation with Two-stages Distillation" (ICCV 2023, CV4Metaverse Workshop)

AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.

A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility

This is a collection of our NAS and Vision Transformer work.

A curated list for Efficient Large Language Models

PaddleSlim is an open-source library for deep model compression and architecture search.