Yolov5-distillation-train-inference

Efficient AI Backbones including GhostNet, TNT and MLP, developed by Huawei Noah's Ark Lab.

Awesome Knowledge Distillation

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

An Automatic Model Compression (AutoMC) framework for developing smaller and faster AI applications.

A curated list of neural network pruning resources.

A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (papers, repositories) that are missed by the repo.

A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility

A PyTorch-based knowledge distillation toolkit for natural language processing

PaddleSlim is an open-source library for deep model compression and architecture search.

The official repo for [NeurIPS'22] "ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation" and [TPAMI'23] "ViTPose++: Vision Transformer for Generic Body Pose Estimation"