Popular GitHub Repositories for Distillation Model

Awesome Knowledge Distillation

irresponsible innovation. Try now at https://chat.dev/

An R package providing functions for interpreting and distilling machine learning models

Easily generate synthetic data for classification tasks using LLMs

Acesse: https://agents4good.github.io/MasterChef-AI/

Project code and experimental results for AI535 Deep Learning Final Project: Using Attention Transfer and Synthetic Data for Unsupervised Few-Sample Feature-Based Knowledge Distillation