Popular GitHub Repositories for 4bit Quantize

A simple custom QLoRA implementation for fine-tuning a language model (LLM) with basic tools such as PyTorch and Bitsandbytes, completely decoupled from Hugging Face.

Text Generation on Pre-Trained NousResearch’s Llama-2-7b-chat-hf using guanaco-llama2-1k dataset

Sample project with combination of Whisper and Deepseek R1 for extracting key points from office meeting videos