Popular GitHub Repositories for Ia3

chatglm 6b finetuning and alpaca finetuning

qwen models finetuning

Experiments on optimizing of Large Language Models (LLMs) using Parameter Efficient Fine-Tuning (PEFT) with techniques like LORA and IA3 for faster inference and reduced memory usage.

Fine-tuned chemical language model for predicting molecular lipophilicity in drug design. Explores parameter-efficient fine-tuning strategies (LoRA, BitFit, IA3), layer freezing techniques, and influence-based data selection. Balances accuracy and computational efficiency for molecular property prediction tasks.