Terminal-Bench
Terminal-Bench is an open benchmark for evaluating AI agents on complex, real-world tasks performed through command-line terminal interfaces.
Model Evaluation
Explore Model Evaluation through related topics and the articles other pages reference most.
Explore articles
Browse subtopics (41)
Articles that also belong to these categories. Counts cover all of Model Evaluation.
All articles (134)AI Benchmarks (56)Machine Learning (55)Statistics (15)AI Companies (14)Large Language Models (12)AI Safety (11)Natural Language Processing (9)AI Agents (6)AI Code Generation (6)Developer Tools (6)MLOps (5)AI Ethics (4)Deep Learning (4)Open Source AI (4)Reasoning Models (4)AI Policy & Regulation (3)Computer Vision (3)Data & Datasets (3)AI Infrastructure (2)AI Research (2)AI Tools & Products (2)Information Retrieval (2)Meta AI (2)Reinforcement Learning (2)Training & Optimization (2)2025 in artificial intelligence (1)AI Models (1)Anthropic (1)Artificial Intelligence (1)Data Centers (1)Education AI (1)Finance AI (1)Google DeepMind (1)Interpretability (1)NVIDIA (1)Neural Networks (1)Research Organizations (1)Software Development (1)Speech & Audio AI (1)Video Generation (1)World Models (1)
Showing 121-134 of 134 articles
Test Set
A test set is a collection of examples reserved from model fitting and model selection so that it can evaluate a fixed machine learning model or a fully specified learning procedure.
The Leaderboard Illusion
The Leaderboard Illusion is a 2025 research paper, led by Cohere and Cohere Labs with academic collaborators, that argues the most influential public ranking of large language models, Chatbot Arena
True negative
A true negative (TN) is a case that a binary classification model correctly predicts as belonging to the negative class: the true label is negative and the predicted label is also negative.
True positive
A true positive (TP) is a prediction that is correctly positive: the model predicts the positive class and the true label is also positive.
True positive rate (TPR)
The true positive rate (TPR) is the proportion of actual positive cases that a classifier correctly identifies as positive, computed as TPR = TP / (TP + FN), where TP is the number of true positives and FN the…
UK AI Security Institute
The UK AI Security Institute (AISI) is a research organization within the United Kingdom's Department for Science, Innovation and Technology (DSIT) that conducts pre-deployment evaluations of frontier AI…
Validation Set
A validation set (also called a development set or dev set) is a subset of labeled data that is held out from the training set and used to evaluate a model's performance during development
Vals AI
Vals AI is an independent, third-party AI model evaluation company based in San Francisco that builds and publishes domain-specific benchmarks measuring how well large language models perform on real…
WebArena
WebArena is a realistic, self-hosted web environment and benchmark designed for developing and evaluating autonomous AI agents that perform tasks on the web.
WebVoyager
WebVoyager is an end-to-end web agent and its companion benchmark, introduced by Hongliang He and seven coauthors in a paper accepted to ACL 2024 .
WildBench
WildBench is an automated evaluation framework for large language models (LLMs) introduced by the Allen Institute for AI (AI2) in 2024.
Word error rate
Word error rate (WER) is the standard metric for measuring the accuracy of an automatic speech recognition (ASR) system
chrF
chrF is a machine translation evaluation metric that scores a candidate translation by counting the character n-grams it shares with one or more reference translations, then combining character n-gram…