Popular GitHub Repositories for Low Rank

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.

ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference

Repository to track the progress in model compression and acceleration

This repository contains the code to train flan t5 with alpaca instructions and low rank adaptation.

[ICLR 2020, Oral] Harnessing Structures for Value-Based Planning and Reinforcement Learning

Demo code for CVPR2023 paper "Sparsifiner: Learning Sparse Instance-Dependent Attention for Efficient Vision Transformers"