neurips-micronet

Awesome Knowledge Distillation

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

Collection of AWESOME vision-language models for vision tasks

"Effective Whole-body Pose Estimation with Two-stages Distillation" (ICCV 2023, CV4Metaverse Workshop)

A modular RL library to fine-tune language models to human preferences

A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility

[ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment

This is a collection of our NAS and Vision Transformer work.

A curated list for Efficient Large Language Models

OpenMMLab Model Compression Toolbox and Benchmark.