PurPaaS-LLM

? Open-Source Evaluation & Testing for AI & LLM systems

Secrets of RLHF in Large Language Models Part I: PPO

A curated list of useful resources that cover Offensive AI.

A list of backdoor learning resources

a prompt injection scanner for custom LLM applications

A security scanner for your LLM agentic workflows

PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to adversarial prompt attacks. ? Best Paper Awards @ NeurIPS ML Safety Workshop 2022

[NeurIPS '23 Spotlight] Thought Cloning: Learning to Think while Acting by Imitating Human Thinking

RuLES: a benchmark for evaluating rule-following in language models

Code accompanying the paper Pretraining Language Models with Human Preferences