Category

AI Safety

216 articlesRSS

Showing 61-120 of 216 articles

Data poisoning

Data poisoning is a class of adversarial attack in which a malicious actor deliberately corrupts the training data used to build machine learning models, with...

Machine Learning

Deceptive alignment

Deceptive alignment is a hypothesised AI failure mode in which a trained model internally pursues an objective different from the one specified by its training...

AI Alignment

DeepSeek market crash (Jan 2025)

The DeepSeek market crash of January 2025 was a sharp, single-day selloff in United States and global technology stocks on Monday, January 27, 2025, triggered...

AI Companies

Dictionary learning (for interpretability)

Dictionary learning, in the context of mechanistic interpretability, is the framework of decomposing the dense internal activations of a neural network into a...

Machine Learning

Disney & Universal v. Midjourney

Disney and Universal v. Midjourney is a copyright infringement lawsuit filed on June 11, 2025, in which The Walt Disney Company and Comcast's NBCUniversal...

AI Companies

Dustin Moskovitz

Dustin Aaron Moskovitz (born May 22, 1984) is an American internet entrepreneur and philanthropist who, through the foundation Good Ventures and the grantmaker...

People

Effective Altruism

Effective altruism (often abbreviated EA) is a philosophical and social movement that uses evidence and careful reasoning to identify the most effective ways...

AI Ethics

Eliciting latent knowledge

Eliciting latent knowledge (ELK) is an open problem in AI alignment formulated by Paul Christiano, Ajeya Cotra, and Mark Xu at the Alignment Research Center...

AI Alignment

Eliezer Yudkowsky

September 11, 1979, Chicago, Illinois, U.S. Nationality Self-taught (autodidact); did not attend high school or college Known for Founder and Research...

People

Elizabeth "Beth" Barnes

Elizabeth "Beth" Barnes is a British AI safety researcher and the founder and chief executive of METR (Model Evaluation and Threat Research), an independent...

People

Emergent abilities

Emergent abilities are capabilities of large language models (LLMs) that are absent in smaller models but appear once a model reaches sufficient scale. Jason...

Large Language ModelsMachine Learning

Emergent misalignment

Emergent misalignment is an AI safety finding, first reported in February 2025, in which fine-tuning a large language model on a single narrow bad behavior...

Machine Learning

Evan Hubinger

Evan Hubinger is an American AI safety researcher who leads the alignment stress-testing team at Anthropic, where he serves as a Member of Technical Staff and...

AnthropicPeople

Executive Order on AI

The Executive Order on AI most commonly refers to Executive Order 14110, titled "Safe, Secure, and Trustworthy Development and Use of Artificial Intelligence,"...

Artificial Intelligence

Existential risk from AI

Existential risk from artificial intelligence (also called AI x-risk) is the hypothesis that the development of sufficiently advanced artificial intelligence...

AI EthicsArtificial Intelligence

FAR.AI

FAR.AI is an artificial intelligence safety research and education non-profit based in Berkeley, California, that conducts technical research on robustness,...

Research Organizations

FActScore

FActScore (Factual precision in Atomicity Score) is an evaluation method and metric, introduced in 2023, for measuring the factual precision of long-form text...

AI Benchmarks

FORT Robotics

FORT Robotics is a Philadelphia-based technology company that builds safety and security infrastructure for autonomous machines, robots, and industrial...

CompaniesRobotics

FinanceBench

FinanceBench is an AI benchmark for open-book financial question answering, designed to test whether large language models can answer the kinds of questions a...

AI Benchmarks

Florida v. OpenAI

Florida v. OpenAI is a civil enforcement lawsuit filed on June 1, 2026, by the State of Florida, through Attorney General James Uthmeier, against OpenAI and...

AI Companies

Fraud Detection (AI)

Fraud detection is the application of statistical analysis, machine learning, and rules-based logic to identify illegitimate activity inside payment systems,...

AI Tools & ProductsFinance AI

Frontier Model Forum

The Frontier Model Forum is an industry body established on July 26, 2023, by Anthropic, Google, Microsoft, and OpenAI to advance safety research, identify...

AI AgentsAI Alignment

Frontier Safety Framework (Google DeepMind)

The Frontier Safety Framework (FSF) is Google DeepMind's risk-management framework for identifying and mitigating severe risks from advanced frontier AI...

Google DeepMind

Frontier Security Institute

The Frontier Security Institute (FSI) is a Washington, D.C. organization launched by the Center for AI Safety (CAIS) to connect frontier artificial...

AI Policy & RegulationResearch Organizations

Frontier models

Frontier models are the most advanced artificial intelligence models that represent the cutting edge of AI capabilities at any given time. These highly capable...

AI Policy & RegulationArtificial Intelligence

Future of Humanity Institute (FHI)

The Future of Humanity Institute (FHI) was a multidisciplinary research institute at the University of Oxford that studied existential risk, the long-term...

Research Organizations

Future of Life Institute

The Future of Life Institute (FLI) is a United States nonprofit research and outreach organization that works on existential and large-scale risks from...

Research Organizations

GPAI Code of Practice

The General-Purpose AI Code of Practice (abbreviated GPAI Code of Practice or CoP) is a voluntary compliance framework published by the European Commission...

AI Policy & Regulation

GTG-1002 (AI-orchestrated espionage campaign)

GTG-1002 is the internal tracking name that Anthropic gave to a cyber espionage operation it says it detected in September 2025 and disclosed in November 2025,...

Anthropic

Garcia v. Character Technologies

Garcia v. Character Technologies is a wrongful death and product liability lawsuit filed in late October 2024 in the United States District Court for the...

AI Policy & Regulation

Gated SAE

A Gated sparse autoencoder (Gated SAE) is a sparse-autoencoder architecture for mechanistic interpretability that splits the encoder into a gating path, which...

Machine Learning

Gemma Scope

Gemma Scope is an open, comprehensive suite of sparse autoencoders (SAEs) released by Google DeepMind in 2024 to support mechanistic interpretability research...

Machine Learning

Geoffrey Irving

Geoffrey Irving is a computer scientist and artificial intelligence safety researcher who, until 2026, served as chief scientist of the UK AI Security...

People

Gillian Hadfield

Gillian Kereldena Hadfield (born July 14, 1961) is a Canadian-American legal scholar and economist whose research sits at the intersection of law, economics,...

People

GiveWell

GiveWell is an American nonprofit charity evaluator, founded in 2007 by Holden Karnofsky and Elie Hassenfeld, that uses cost-effectiveness analysis to...

Research Organizations

Goodfire AI

Goodfire AI is a San Francisco-based artificial intelligence research lab and public benefit corporation focused on mechanistic interpretability, the science...

AI CompaniesInterpretability

Gradient hacking

Gradient hacking is a hypothesised failure mode of supervised and reinforcement-learning systems in which a sufficiently capable, deceptively aligned...

AI Alignment

Grok "MechaHitler" incident

The Grok "MechaHitler" incident was a content-moderation and AI-safety failure that occurred on July 8 to 9, 2025, when Grok, the chatbot built by xAI and...

AI Companies

Grok 3 Jailbreak

Grok 3 jailbreak is the umbrella term for a class of reported guardrail-bypass findings against Grok 3, the third-generation large language model that xAI...

Artificial IntelligenceLarge Language Models

Grok child safety controversy (2026)

The Grok child safety controversy was a multinational regulatory and legal crisis that began in late December 2025, when xAI's Grok chatbot and its image and...

AI Incidents & ControversiesAI Policy & Regulation

Grounding (artificial intelligence)

Grounding in artificial intelligence is the process of anchoring an AI system's outputs to verifiable, real-world information so that each claim can be traced...

Artificial IntelligenceLarge Language Models

Guardrails (AI)

AI guardrails are runtime safety mechanisms that monitor, validate, and constrain the inputs and outputs of AI systems, particularly large language models...

Large Language Models

Hallucination

Hallucination in artificial intelligence is the generation of output that is fluent, confident, and plausible but factually incorrect, fabricated, or not...

Machine LearningNatural Language Processing

HaluEval

HaluEval (Hallucination Evaluation) is a large-scale benchmark for measuring how well large language models (LLMs) can recognize hallucinated content, that is,...

AI BenchmarksLarge Language Models

HarmBench

HarmBench is a standardized evaluation framework for automated red teaming and robust refusal of large language models (LLMs). It was introduced in 2024 by...

AI BenchmarksLarge Language Models

Holden Karnofsky

Holden G. Karnofsky is an American philanthropist, nonprofit executive, and writer on artificial intelligence who co-founded the charity evaluator GiveWell...

People

How to Steal ChatGPT-4, GPT-4 and other Proprietary LLMs

See also: Guides and Security This article is a defensive and academic survey of how proprietary large language models (LLMs) such as GPT-4, ChatGPT, Claude,...

Humanity's Last Exam

Humanity's Last Exam Abbreviation Multi-modal AI benchmark testing frontier knowledge across 100+ academic subjects, designed to be the most challenging...

AI Benchmarks

Ian Hogarth

Ian Hogarth is a British technology entrepreneur, investor, and writer who serves as the founding chair of the UK AI Safety Institute, the government research...

People

Igor Babuschkin

Igor Babuschkin is a German artificial intelligence researcher and engineer who is a co-founder of xAI, the AI company that Elon Musk started in 2023. At xAI...

AI CompaniesPeople

Ilya Sutskever

Ilya Sutskever (born December 8, 1986) is a Russian-born, Israeli-Canadian computer scientist who is the co-founder and former Chief Scientist of OpenAI and...

Deep LearningOpenAI

Indirect prompt injection

Indirect prompt injection is a class of attack against large language model-integrated applications in which the malicious instructions that subvert the model...

Large Language Models

Inner alignment

Inner alignment is the AI-safety problem of ensuring that a learned model which is itself an optimizer (a mesa-optimizer) pursues the objective the training...

AI Alignment

Instrumental convergence

Instrumental convergence is a hypothesis in AI safety holding that a wide range of sufficiently capable agents, when pursuing almost any final goal, will...

AI Alignment

International AI Safety Report

The International AI Safety Report is the first independent, government-mandated scientific assessment of the capabilities, risks, and safety of...

AI Policy & Regulation

J. Zico Kolter

J. Zico Kolter (full name Jeremy Zico Kolter) is an American computer scientist who is a professor and head of the Machine Learning Department at Carnegie...

People

Jailbreak (artificial intelligence)

A jailbreak in artificial intelligence is a technique that bypasses the safety guardrails, content policies, and alignment constraints built into large...

Artificial IntelligenceLarge Language Models

JailbreakBench

JailbreakBench is an open-source robustness benchmark for evaluating jailbreak attacks and defenses against large language models (LLMs). It bundles four...

AI BenchmarksLarge Language Models

JumpReLU SAE

A JumpReLU sparse autoencoder (JumpReLU SAE) is a variant of the sparse autoencoder used in mechanistic interpretability whose encoder applies a learnable...

Machine Learning

Kate Crawford

Kate Crawford (born 1974) is an Australian scholar, author, and artist known as one of the leading critical voices on the politics of artificial intelligence....

People