On the Biology of a Large Language Model
On the Biology of a Large Language Model is a mechanistic interpretability paper published by Anthropic on March 27, 2025, in the Transformer Circuits Thread.
Interpretability
Explore Interpretability through related topics and the articles other pages reference most.
Explore articles
Browse subtopics: AI Research
Articles that also belong to these categories. Counts cover all of Interpretability.
All articles (44)Machine Learning (12)Anthropic (8)Deep Learning (8)AI Safety (6)Neural Networks (6)AI Research (4)Large Language Models (4)Computer Vision (2)Developer Tools (2)Open Source AI (2)Transformer Models (2)AI Companies (1)AI Ethics (1)Algorithms (1)Generative AI (1)Mathematics (1)Model Evaluation (1)OpenAI (1)People (1)
Showing 1-4 of 4 articles
Scaling Monosemanticity
Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnet is the May 21
Towards Monosemanticity
Towards Monosemanticity is an October 2023 mechanistic interpretability paper from Anthropic that used a sparse autoencoder to decompose the internal activations of a small language model into thousands of…
Toy Models of Superposition
Toy Models of Superposition is a September 2022 mechanistic interpretability paper from Anthropic that shows how a neural network can represent more features than it has dimensions by packing them into…