Interpretability

Explore Interpretability through related topics and the articles other pages reference most.

Explore articles

Reset filters
Browse subtopics: AI Safety

Articles that also belong to these categories. Counts cover all of Interpretability.

Showing 1-9 of 9 articles

Abliteration

Abliteration is the practice of removing refusal behavior from an open-weight large language model by editing its weights so that the model can no longer write a "refusal direction" into its residual stream.

AI SafetyLarge Language Models

Activation steering

Activation steering is a family of inference-time techniques in mechanistic interpretability and AI safety that modify a neural network's internal activations to influence its behavior, without retraining the…

AI SafetyLarge Language Models

Mechanistic interpretability

Mechanistic interpretability (often abbreviated as mech interp or MI) is the field that reverse-engineers the internal computations of neural networks, particularly transformers

AI Safety

Neuralese

Neuralese is an informal term for information that neural networks pass to one another, or that a single model carries from one step of its computation to the next

AI SafetyLarge Language Models

Nick Cammarata

Nick Cammarata is a machine learning researcher who works on mechanistic interpretability, the study of how the internal components of neural networks compute.

AI SafetyPeople

Persona vectors

Persona vectors are single linear directions in the activation space of a large language model that correspond to high level character traits such as evil, sycophancy, or a propensity to hallucinate.

AI SafetyLarge Language Models

Representation Engineering

Representation Engineering (often abbreviated RepE) is a top-down approach to artificial-intelligence transparency and control that reads and manipulates high-level concepts (such as honesty, harmlessness, and…

AI Safety