Popular GitHub Repositories for Instruction Tuning

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

The official GitHub page for the survey paper "A Survey of Large Language Models".

Aligning pretrained language models with instruction data generated by themselves.

Instruction Tuning with GPT-4

Code and models for NExT-GPT: Any-to-Any Multimodal Large Language Model

? Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

【EMNLP 2024?】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection

总结Prompt&LLM论文，开源数据&模型，AIGC应用

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tuning) together for easy use. We welcome open-source enthusiasts to initiate any meaningful PR on this repo and integrate as many LLM related technologies as possible. 我们打造了方便研究人员上手和使用大模型等微调平台，我们欢迎开源爱好者发起任何有意义的pr！

Synthetic data curation for post-training and structured data extraction

A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)

[SIGIR'2024] "GraphGPT: Graph Instruction Tuning for Large Language Models"

DISC-FinLLM，中文金融大语言模型（LLM），旨在为用户提供金融场景下专业、智能、全面的金融咨询服务。DISC-FinLLM, a Chinese financial large language model (LLM) designed to provide users with professional, intelligent, and comprehensive financial consulting services in financial scenarios.

Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]

Crosslingual Generalization through Multitask Finetuning

DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection and Instruction-Aware Models for Conversational AI

Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey

Papers and Datasets on Instruction Tuning and Following. ???