Awesome-Efficient-LLM

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

A Collection of useful Methods in Java

Awesome Knowledge Distillation

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

Collection of AWESOME vision-language models for vision tasks

"Effective Whole-body Pose Estimation with Two-stages Distillation" (ICCV 2023, CV4Metaverse Workshop)

AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.

A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility

This is a collection of our NAS and Vision Transformer work.

PaddleSlim is an open-source library for deep model compression and architecture search.