Popular GitHub Repositories for Low Rank Approximation

Fine-tuning of diffusion models

LoRA (Low-Rank Adaptation) inspector for Stable Diffusion

[ICLR 2022] Code for paper "Exploring Extreme Parameter Compression for Pre-trained Language Models"(https://arxiv.org/abs/2205.10036)

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

My experiment of multilayer NMF, a deep neural network in which the first several layers take Semi-NMF as its pseudo-activation-function that finds the latent sturcture embedding in the original data unsupervisely.

[CVPR 2025] CASP: Compression of Large Multimodal Models Based on Attention Sparsity

This repository contains example notebooks and homeworks demonstrating various techniques in model optimization for Edge ML.