Sign in
Home
Academy
Resources
Leaderboard
Privacy
Terms
Loading: Preparing console
RESOURCES
Get started
A collection of resources to get you started with mechanistic interpretability and AI red teaming.
Request access to the Discord community
Roadmaps
AI Red Teaming roadmap
roadmap.sh
Courses
ARENA — Chapter 1: Transformer Interpretability
Callum McDougall
Introduction to Red Teaming AI
Hack The Box
Learn Mechanistic Interpretability
Cat McGee
Wiki OffSec ML
offsecml.com
Blogs
How to become a mechanistic interpretability researcher
Neel Nanda — Head of Alignment, Google DeepMind
A Mathematical Framework for Transformer Circuits
Anthropic
Self-preservation or Instruction Ambiguity? Examining the Causes of Shutdown Resistance
Alignment Forum
An Extremely Opinionated Annotated List of My Favourite Mechanistic Interpretability Papers v2
Neel Nanda
Interpretability Dreams
Chris Olah
How to hack AI apps
Joseph Thacker
Papers
Open Problems in Mechanistic Interpretability
arXiv
A Primer on the Inner Workings of Transformer-based Language Models
arXiv
Bypassing the Safety Training of Open-Source LLMs with Priming Attacks
arXiv
Books
Red Teaming AI: Strategies & Techniques
Philip A. Dursey
YouTube
What is LLM Red Teaming? How Generative AI Safety Testing Works
Agentic AI Red Teaming: The Hottest Cyber Skill of 2026
GitHub
TransformerLens
Mechanistic interpretability of generative language models
L1B3RT4S
Jailbreaking prompts
CL4R1T4S
Leaked system prompts
Spiritual-Spell-Red-Teaming (ENI)
Jailbreaking prompts
VibeLearning — AI-sec
Eman Herawy
Tools
Promptfoo
Automated testing for AI risk in development
nnsight
Interpret and manipulate the internals of DLMs
Averta
AI red teaming and guardrails
Low-refusal models
Gemma-4-12B Obliterated
Abliterated
GLM-5.2
Ultra-low refusal rates
Qwen3.6-27B Obliterated
Abliterated
Platforms
Gandalf: Agent Breaker
Break the AI agent
Gray Swan Arena
Break AI. Win prizes. Get discovered.
