Popular GitHub Repositories for Qlora

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Finetune Llama 3.3, DeepSeek-R1 & Reasoning LLMs 2x faster with 70% less memory! ?

Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

AirLLM 70B inference with single 4GB GPU

Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调

? ????? about ????, ??????, and ?????? ??? for free by designing, training, and deploying a real-time financial advisor LLM system ~ ?????? ???? + ????? & ??????? ?????????

chatglm 6b finetuning and alpaca finetuning

Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.

?MindChat（漫谈）——心理大模型：漫谈人生路, 笑对风霜途

?孙思邈中文医疗大模型(Sunsimiao)：提供安全、可靠、普惠的中文医疗大模型

Firefly中文LLaMA-2大模型，支持增量预训练Baichuan2、Llama2、Llama、Falcon、Qwen、Baichuan、InternLM、Bloom等大模型

对llama3进行全参微调、lora微调以及qlora微调。

LongQLoRA: Extent Context Length of LLMs Efficiently

Small finetuned LLMs for a diverse set of useful tasks

Large language Model fintuning bloom , opt , gpt, gpt2 ,llama,llama-2,cpmant and so on

qwen models finetuning

使用qlora对中文大语言模型进行微调，包含ChatGLM、Chinese-LLaMA-Alpaca、BELLE

Fine-Tuning Falcon-7B, LLAMA 2 with QLoRA to create an advanced AI model with a profound understanding of the Indian legal context.

Use QLoRA to tune LLM in PyTorch-Lightning w/ Huggingface + MLflow

Finetune any model on HF in less than 30 seconds