llm-webui

Mastering Applied AI, One Concept at a Time

Auto Data is a library designed for quick and effortless creation of datasets tailored for fine-tuning Large Language Models (LLMs).

? Easy, open-source LLM finetuning with one-line commands, seamless cloud integration, and popular optimization frameworks. ?

On Memorization of Large Language Models in Logical Reasoning

Fine-tune Mistral 7B to generate fashion style suggestions

Official repository of my book "A Hands-On Guide to Fine-Tuning LLMs with PyTorch and Hugging Face"

[NeurIPS 2023] Make Your Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning

Medical Language Model fine-tuned using pretraining, instruction tuning, and Direct Preference Optimization (DPO). Progresses from general medical knowledge to specific instruction following, with experiments in preference alignment for improved medical text generation and understanding.

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

SEIKO is a novel reinforcement learning method to efficiently fine-tune diffusion models in an online setting. Our methods outperform all baselines (PPO, classifier-based guidance, direct reward backpropagation) for fine-tuning Stable Diffusion.