LLaMa2lang
Convenient script to fine-tune (chat) LLaMa2 for any language.
CommonProductProgrammingNatural Language ProcessingMachine Translation
LLaMa2lang is a convenient script for fine-tuning LLaMa2-7b into a chat model for a specific language. It uses the Huggingface Open Assistant dataset as the base data and uses the OPUS translation model to fully translate it into the target language. Then, the translated dataset is converted into the input format for the chat model using LLaMa2's prompt format. Finally, LLaMa2-chat is fine-tuned using QLoRA and PEFT. By using LLaMa2lang, you can create a LLaMa2 model suitable for chatting in any non-English language.
LLaMa2lang Visit Over Time
Monthly Visits
494758773
Bounce Rate
37.69%
Page per Visit
5.7
Visit Duration
00:06:29