Popular GitHub Repositories for Peft Fine Tuning Llm

Practical course about Large Language Models.

[SIGIR'24] The official implementation code of MOELoRA.

An Efficient LLM Fine-Tuning Factory Optimized for MoE PEFT

Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"

Official repository of my book "A Hands-On Guide to Fine-Tuning LLMs with PyTorch and Hugging Face"

CRE-LLM: A Domain-Specific Chinese Relation Extraction Framework with Fine-tuned Large Language Model

Official code implemtation of paper AntGPT: Can Large Language Models Help Long-term Action Anticipation from Videos?

memory-efficient fine-tuning; support 24G GPU memory fine-tuning 7B

AI Community Tutorial, including: LoRA/Qlora LLM fine-tuning, Training GPT-2 from scratch, Generative Model Architecture, Content safety and control implementation, Model distillation techniques, Dreambooth techniques, Transfer learning, etc for practice with real project!

High Quality Image Generation Model - Powered with NVIDIA A100

A Python library for efficient and flexible cycle-consistency training of transformer models via iteratie back-translation. Memory and compute efficient techniques such as PEFT adapter switching allow for 7.5x larger models to be trained on the same hardware.

EDoRA: Efficient Weight-Decomposed Low-Rank Adaptation via Singular Value Decomposition

Fine-tuning Llama3 8b to generate JSON formats for arithmetic questions and process the output to perform calculations.

PEFT is a wonderful tool that enables training a very large model in a low resource environment. Quantization and PEFT will enable widespread adoption of LLM.

本项目致力于分析大型语言模型 (LLM) 作为文本分类器在五个德国社交媒体数据集上的性能，涵盖13项任务。我们实验了零样本和少样本分类方法，以及使用各种大型语言模型的微调方法。

This repository contains a notebook for fine-tuning the meta-llama/Llama-3.2-3B-Instruct (or any other generative language models) model using Quantized LoRA (QLoRA) for sentiment classification on the Arabic HARD dataset.

FineTuning LLMs on conversational medical dataset.

Finetuning LLaMA 3.2-1B-Instruct model using qLoRA and LoRA quantization PEFT methods

Test results of Kanarya and Trendyol models with and without fine-tuning techniques on the Turkish tweet hate speech detection dataset.

Finetuning Large Language Models