awesome-red-teaming-llms

Adversary Emulation Framework

Data augmentation for NLP

? Open-Source Evaluation & Testing for AI & LLM systems

TextAttack ? is a Python framework for adversarial attacks, data augmentation, and model training in NLP https://textattack.readthedocs.io/en/master/

A Python toolbox to create adversarial examples that fool neural networks in PyTorch, TensorFlow, and JAX

A unified evaluation framework for large language models

PyTorch implementation of adversarial attacks [torchattacks]

Must-read Papers on Textual Adversarial Attack and Defense

Advbox is a toolbox to generate adversarial examples that fool neural networks in PaddlePaddle、PyTorch、Caffe2、MxNet、Keras、TensorFlow and Advbox can benchmark the robustness of machine learning models. Advbox give a command line tool to generate adversarial examples with Zero-Coding.

Secrets of RLHF in Large Language Models Part I: PPO