Expert Specialized Fine-Tuning

A professional fine-tuning tool for customizing large language models.

CommonProductProgrammingLarge Language ModelsFine-Tuning

Expert Specialized Fine-Tuning (ESFT) is an efficient fine-tuning method for large language models (LLMs) with a Mixture-of-Experts (MoE) architecture. It optimizes model performance by adjusting only the task-related parts, improving efficiency while reducing resource and storage usage.

Install dependencies and download necessary adapters for a quick start.
Use the eval.py script to evaluate model performance on different datasets.
Use the get_expert_scores.py script to calculate the score of each expert based on the evaluation dataset.
Use the generate_expert_config.py script to generate a configuration to convert a MoE model trained only on task-related tasks.

ESFT is suitable for researchers and developers who need to customize fine-tune large language models. It can help them improve model performance on specific tasks while reducing resource consumption.

Researchers use ESFT to fine-tune models to improve performance on natural language processing tasks.
Developers utilize ESFT to optimize models to adapt to specific industry language processing needs.
Educational institutions adopt ESFT to customize teaching assistant models
enhancing teaching interactivity.

1. Clone or download the ESFT project to your local machine.
2. Enter the esft directory and install the required dependencies.
3. Download necessary adapters to adapt to different large language models.
4. Use the eval.py script to evaluate model performance on a specific dataset.
5. Based on the evaluation results

Visit

Expert Specialized Fine-Tuning Visit Over Time

Monthly Visits

488643166

Bounce Rate

37.28%

Page per Visit

5.7

Visit Duration

00:06:37

Expert Specialized Fine-Tuning Visit Trend

Expert Specialized Fine-Tuning Visit Geography

Expert Specialized Fine-Tuning Traffic Sources

Expert Specialized Fine-Tuning Alternatives

AIKit — A one-stop solution for hosting, deploying, building, and fine-tuning open-source large language models.

Programming•Open-source•Large Language Models

150

URL Parser Online — An online URL parser that converts URLs into a format suitable for large language models.

Productivity•URL Parsing•Data Extraction

264

SELA — SELA enhances automated machine learning by combining Monte Carlo Tree Search and LLM-based agents.

Programming•Automated Machine Learning•Monte Carlo Tree Search

LongVU — Spatiotemporal Adaptation Compression Model for Long Video Language Understanding

Video•Video Understanding•Spatiotemporal Compression

BitNet — Inference framework for 1-bit large language models

Programming•Large Language Models•Inference Framework

132

ComfyGen — Adaptive workflow for text-to-image generation

Image•Text-to-image•Adaptive workflows

252

awesome-LLM-resources — A comprehensive collection of global large language model resources.

Productivity•Large Language Models•Resource Aggregation

VirtualWife — A virtual digital human project that supports live streaming on Bilibili.

chatting•Virtual Digital Human•Emotional Companionship

102

MM1.5 — Optimization and analysis of multimodal large language models

Productivity•Multimodal•Large Language Models

AutoDAN-Turbo — An automated framework for breaking the limitations of large language models

Programming•Automation•Jailbreaking

Mishi AI Community — A knowledge community in the field of AI and product management

ChineseSelection•Product Management•Knowledge Community

252

RD-Agent — An automated research and development tool that enhances R&D efficiency and quality.

Programming•Artificial Intelligence•Automation

120

NVLM 1.0 — A cutting-edge multimodal large language model that achieves state-of-the-art performance on visual-language tasks.

Productivity•Multimodal Learning•Large Language Models

108

OneGen — An efficient single-pass unified generation and retrieval framework suitable for large language models.

Programming•Natural Language Processing•Large Language Models

102

Open Source LLM Tools — A collection of open-source large language model tools.

Productivity•AI Tools•Open Source

PresentationGen — A SpringBoot Web application that utilizes large language models to generate PPT files.

Productivity•Automation•Presentation

Shire — An AI programming agent language that facilitates communication between large language models (LLMs) and integrated development environments (IDEs) for automated programming.

Programming•AI Programming•Automation

PromptChainer — A free and fast prompt chain generator

Productivity•Artificial Intelligence•Automation

150

LongCite — Generates fine-grained citations for large language models in long text question answering.

Programming•Long Text Question Answering•Citation Generation

LongLLaVA — Efficiently extending multimodal large language models to 1,000 images.

Image•Multimodal Learning•Image Processing

iText2KG — Incrementally build knowledge graphs using large language models.

Productivity•Knowledge Graph•Natural Language Processing

192

ChatMLX — A high-performance MacOS chat application based on large language models.

chatting•Chat•Large Language Models

EAGLE — Exploration of the design space for multimodal large language models

Programming•Multimodal Learning•Large Language Models

276

Best AI Websites & Tools