Large Language Models

Explore language models, how they work, and the techniques used to build applications with them.

Explore articles

Reset filters
Browse subtopics: AI Safety

Articles that also belong to these categories. Counts cover all of Large Language Models.

Showing 1-21 of 21 articles

Activation steering

Activation steering is a family of inference-time techniques in mechanistic interpretability and AI safety that modify a neural network's internal activations to influence its behavior, without retraining the…

AI SafetyInterpretability

AdvBench

AdvBench (Adversarial Behavior Benchmark) is a red-teaming benchmark dataset for measuring how easily an aligned large language model can be pushed into producing harmful or objectionable content

AI BenchmarksAI Safety

Anthropic

Anthropic is an American artificial intelligence (AI) safety and research company founded in 2021 by Dario Amodei, Daniela Amodei, and other former OpenAI researchers, best known for the Claude family of large…

AI CompaniesAI Safety

Backdoor attacks on large language models

A backdoor attack on a large language model (LLM) is an adversarial training-time attack in which an attacker manipulates training data, fine-tuning data, preference labels, or model weights so that the…

AI Safety

Guardrails (AI)

AI guardrails are runtime safety mechanisms that monitor, validate, and constrain the inputs and outputs of AI systems, particularly large language models (LLMs), to block harmful, inaccurate, or off-policy…

AI Safety

HaluEval

HaluEval (Hallucination Evaluation) is a large-scale benchmark for measuring how well large language models (LLMs) can recognize hallucinated content, that is, text that conflicts with a source or cannot be…

AI BenchmarksAI Safety

HarmBench

HarmBench is a standardized evaluation framework for automated red teaming and robust refusal of large language models (LLMs).

AI BenchmarksAI Safety

Indirect prompt injection

Indirect prompt injection is a class of attack against large language model-integrated applications in which the malicious instructions that subvert the model are not supplied by the user, but are smuggled…

AI Safety

Many-shot jailbreaking

Many-shot jailbreaking is a technique for bypassing the safety training of a large language model by filling its context window with a long series of faux dialogue turns in which an AI assistant complies with…

AI SafetyAnthropic

Persona vectors

Persona vectors are single linear directions in the activation space of a large language model that correspond to high level character traits such as evil, sycophancy, or a propensity to hallucinate.

AI SafetyInterpretability

Prompt injection

Prompt injection is a class of security vulnerabilities in which an attacker crafts malicious input designed to override, subvert, or manipulate the instructions governing a large language model (LLM).

AI Safety

Refusal direction

The refusal direction is a finding from mechanistic interpretability research that the refusal behavior of safety fine-tuned chat language models is mediated by a single

AI SafetyInterpretability

System prompt

A system prompt is a special set of instructions, guidelines, persona definitions, and contextual information given to a large language model (LLM) before any user input

AI SafetyPrompt Engineering