QROA

Adversary Emulation Framework

Data augmentation for NLP

TextAttack ? is a Python framework for adversarial attacks, data augmentation, and model training in NLP https://textattack.readthedocs.io/en/master/

A Python toolbox to create adversarial examples that fool neural networks in PyTorch, TensorFlow, and JAX

A unified evaluation framework for large language models

PyTorch implementation of adversarial attacks [torchattacks]

Must-read Papers on Textual Adversarial Attack and Defense

Advbox is a toolbox to generate adversarial examples that fool neural networks in PaddlePaddle、PyTorch、Caffe2、MxNet、Keras、TensorFlow and Advbox can benchmark the robustness of machine learning models. Advbox give a command line tool to generate adversarial examples with Zero-Coding.

A reading list for large models safety, security, and privacy (including Awesome LLM Security, Safety, etc.).

Secrets of RLHF in Large Language Models Part I: PPO