Pretrained-Language-Model

Efficient AI Backbones including GhostNet, TNT and MLP, developed by Huawei Noah's Ark Lab.

Awesome Knowledge Distillation

An Automatic Model Compression (AutoMC) framework for developing smaller and faster AI applications.

Collection of AWESOME vision-language models for vision tasks

A curated list of neural network pruning resources.

"Effective Whole-body Pose Estimation with Two-stages Distillation" (ICCV 2023, CV4Metaverse Workshop)

A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (papers, repositories) that are missed by the repo.

A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility

This is a collection of our NAS and Vision Transformer work.

A curated list for Efficient Large Language Models