Popular GitHub Repositories for Red Teaming

所有系统提示都需透明公开

A security scanner for your LLM agentic workflows

Automated prompt-based testing and evaluation of Gen AI applications

AI Alignment: A Comprehensive Survey

Code scanner to check for issues in prompts and LLM calls

Official repository for the paper "ALERT: A Comprehensive Benchmark for Assessing Large Language Models’ Safety through Red Teaming"

Risks and targets for assessing LLMs & LLM vulnerabilities

A re-implementation of the "Red Teaming Language Models with Language Models" paper by Perez et al., 2022

Repository accompanying the paper https://arxiv.org/abs/2407.14937

Realign is a testing and simulation framework for AI applications.

AI Red Teaming Range

This repository serves as a central hub for discovering tools and services focused on automated prompt engineering. Whether you're looking to optimize your prompts for generative AI models or enhance the capabilities of your agents, you'll find a wide range of resources here.

Some experiments with activation steering in LLMs

CRAWNET is a graph-based domain discovery tool by CRYXNET that helps you gather information about domains and potential relationships with other actors.

Exposing Jailbreak Vulnerabilities in LLM Applications with?ARTKIT

A powerful local AI-agentic tool that generates and validates advanced exploit payloads using CrewAI framework.

这份概念验证 (PoC) 演示了利用隐藏在指令文件 (copilot-instructions.md) 中的 Unicode 字符，注入提示从而攻击 AI 代码助手（例如 Copilot）的漏洞。它强调了使用不可信指令模板的风险。仅供教育/研究用途。

Security Risk Identification and Red Teaming in Generative AI Systems

模拟具有自主行为的对抗性AI威胁，用于网络安全红队演练。