Popular GitHub Repositories for Prefix Tuning

SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batching, and more. Supports datasets from Huggingface, torchdata iterables, or simple lists of dictionaries.

Example code for prefix-tuning GPT/GPT-NeoX models and for inference with trained prefixes

Comparison of different adaptation methods on PEFT for fine-tuning downstream tasks or benchmarks.