MDFlow

A large scale study of Knowledge Distillation.

Efficient AI Backbones including GhostNet, TNT and MLP, developed by Huawei Noah's Ark Lab.

Awesome Knowledge Distillation

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

Collection of AWESOME vision-language models for vision tasks

"Effective Whole-body Pose Estimation with Two-stages Distillation" (ICCV 2023, CV4Metaverse Workshop)

A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility

[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

A curated list for Efficient Large Language Models

OpenMMLab Model Compression Toolbox and Benchmark.