Thursday, July 23, 2026
- t-SNEv8t-distributed stochastic neighbor embedding (t-SNE) is a nonlinear dimensionality reduction technique used primarily for visualizing high-dimensional data in...
- Direct Preference Optimization (DPO)v8Direct Preference Optimization (DPO) is a method for aligning large language models with human preferences that replaces the multi-stage reinforcement learning...
- Curse of Dimensionalityv6See also: Machine learning, Feature engineering, Dimensionality reduction The curse of dimensionality is the set of problems that arise when data has a large...
- Expectation-Maximization (EM) Algorithmv8The Expectation-Maximization (EM) algorithm is an iterative method for finding maximum likelihood or maximum a posteriori (MAP) estimates of the parameters of...
- Estimator (tf.estimator)v5See also: TensorFlow, Keras, deep learning, machine learning tf.estimator is a high-level TensorFlow API that encapsulates the complete lifecycle of a machine...
- UMAP (Uniform Manifold Approximation and Projection)v5UMAP (Uniform Manifold Approximation and Projection) is a nonlinear dimensionality reduction technique that compresses high-dimensional data into a...
- Grad-CAMv5Grad-CAM (Gradient-weighted Class Activation Mapping) is a technique for producing visual explanations from convolutional neural network (CNN) models by using...
- Rejection samplingv5See also: Monte Carlo methods, Importance sampling, Markov chain Monte Carlo, Speculative decoding, Best-of-N sampling, Bayesian inference Rejection sampling,...
- Support Vector Machine (SVM)v6A support vector machine (SVM) is a supervised learning algorithm that classifies data by finding the optimal hyperplane that separates points into distinct...
- AdvBenchv6AdvBench (Adversarial Behavior Benchmark) is a red-teaming benchmark dataset for measuring how easily an aligned large language model can be pushed into...
- InfiniteBenchv7InfiniteBench (stylized as ∞Bench) is a long-context benchmark that tests whether large language models (LLMs) can genuinely process and reason over inputs...
- MACHIAVELLI (benchmark)v4MACHIAVELLI is a benchmark for evaluating the ethical behavior of AI agents in text-based interactive environments. Introduced in 2023 by Alexander Pan, Jun...
- EgoSchemav6EgoSchema is a diagnostic benchmark for evaluating very long-form video language understanding, introduced by Karttikeya Mangalam, Raiymbek Akshulakov, and...
- HarmBenchv5HarmBench is a standardized evaluation framework for automated red teaming and robust refusal of large language models (LLMs). It was introduced in 2024 by...
- RULER (benchmark)v6RULER: What's the Real Context Size of Your Long-Context Language Models? Abbreviation A synthetic benchmark for evaluating long-context large language...
- BBQ (Bias Benchmark for QA)v5BBQ (the Bias Benchmark for QA) is a hand-built evaluation dataset that measures whether a question answering (QA) language model relies on social stereotypes...
- JailbreakBenchv5JailbreakBench is an open-source robustness benchmark for evaluating jailbreak attacks and defenses against large language models (LLMs). It bundles four...
- LongBenchv8LongBench is a benchmark suite for evaluating the long-context understanding capabilities of large language models (LLMs). Developed by researchers at Tsinghua...
- Depthwise Separable CNNv4A depthwise separable convolution is a factorized form of convolution that decomposes a standard convolutional operation into two sequential steps: a depthwise...
- Earth Mover's Distancev7Earth Mover's Distance (EMD), also known as the Wasserstein-1 distance, Kantorovich-Rubinstein metric, or Mallows's distance, is a measure of dissimilarity...
- TPU Boardv5A TPU board (Tensor Processing Unit board) is a printed circuit board (PCB) that houses one or more Tensor Processing Unit chips along with associated memory,...
- SUPERBv4SUPERB, which stands for Speech processing Universal PERformance Benchmark, is a comprehensive evaluation framework designed to measure how well...
- ToxiGenv4ToxiGen is a large-scale, machine-generated dataset designed for adversarial and implicit hate speech detection. Created by Thomas Hartvigsen, Saadia Gabriel,...
- PR AUCv5See also: precision, recall, ROC curve, AUC, F1 score, confusion matrix, precision-recall curve PR AUC (Precision-Recall Area Under the Curve), also referred...
- Empirical Risk Minimizationv5Empirical risk minimization (ERM) is the foundational principle of statistical learning theory: because the true risk (the expected loss over the unknown data...
- Needle in a Haystack (NIAH)v7Needle in a Haystack (NIAH) is a long-context evaluation that measures whether a large language model can retrieve a single fact (the "needle") inserted at a...
- CRUXEvalv5CRUXEval (Code Reasoning, Understanding, and eXecution Evaluation) is a benchmark designed to measure how well large language models can reason about,...
- PIQAv7PIQA (Physical Interaction Question Answering) is a benchmark dataset of roughly 21,000 binary multiple-choice questions that evaluates the physical...
- IFEvalv6IFEval (Instruction-Following Evaluation) is a benchmark of 541 prompts that measures how reliably large language models obey explicit, machine-checkable...
- WritingBenchv5WritingBench is a comprehensive benchmark for evaluating the generative writing capabilities of large language models (LLMs) across diverse real-world writing...
- HaluEvalv4HaluEval (Hallucination Evaluation) is a large-scale benchmark for measuring how well large language models (LLMs) can recognize hallucinated content, that is,...
- LibriSpeechv5LibriSpeech is a freely available corpus of approximately 1,000 hours of 16 kHz read English speech that serves as the standard benchmark for training and...
- LAMBADAv5LAMBADA (LAnguage Modeling Broadened to Account for Discourse Aspects) is a benchmark dataset designed to evaluate the ability of computational language models...
- BIG-Bench Hardv7BIG-Bench Hard (BBH) is a suite of 23 challenging tasks drawn from the BIG-Bench benchmark, selected because they are "the [tasks] for which prior language...
- TruthfulQAv7TruthfulQA is a benchmark designed to measure whether large language models (LLMs) generate truthful answers to questions. Created by Stephanie Lin, Jacob...
- MMMU-Prov4MMMU-Pro is a rigorous benchmark for evaluating multimodal AI systems on college-level, expert questions that genuinely require seeing an image, built as a...
- CLIP Scorev7CLIP Score (also written CLIPScore or CLIP-S) is a reference-free automatic evaluation metric that measures how well a text caption matches an image, computed...
- MathVistav7MathVista is a benchmark for evaluating the mathematical reasoning capabilities of foundation models in visual contexts.[1] It was introduced by Pan Lu, Hritik...
- FLORES-200v5FLORES-200 is a multilingual evaluation benchmark for machine translation systems, covering 200 languages across a wide range of language families, scripts,...
- BoolQv4BoolQ (Boolean Questions) is a natural language processing benchmark dataset of 15,942 naturally occurring yes/no question answering examples, each pairing a...
- PubMedQAv6PubMedQA is a biomedical question answering dataset and benchmark that evaluates whether machine learning models can answer yes/no/maybe research questions...
- GAIA benchmarkv6GAIA (General AI Assistants) is a benchmark for evaluating general-purpose AI agents and assistants on real-world tasks that require reasoning, web browsing,...
- LegalBenchv7LegalBench is a collaboratively constructed benchmark for measuring legal reasoning in large language models (LLMs), consisting of 162 tasks that span six...
- ZebraLogicv6ZebraLogic is a benchmark for evaluating the logical reasoning capabilities of large language models (LLMs). Developed by researchers at the Allen Institute...
- Viggle AIv4Viggle AI is an artificial intelligence-powered character animation and video generation platform developed by WarpEngine Canada Inc. The platform enables...
- Photoroomv6Photoroom is an AI-powered photo editing platform headquartered in Paris, France, specializing in background removal, product photography, and generative image...
- TriviaQAv6TriviaQA is a large-scale reading comprehension and question answering dataset of over 650,000 question-answer-evidence triples, introduced in 2017 by Mandar...
- Basetenv8Baseten is an inference platform for deploying, serving, and scaling machine learning models in production. The company converts ML models into...
- MLPerfv8MLPerf is the AI industry's standard suite of benchmarks for measuring how fast machine learning systems train and run models, developed and maintained by...
- Berkeley Function Calling Leaderboardv5The Berkeley Function Calling Leaderboard (BFCL) is the standard benchmark for measuring how accurately large language models (LLMs) invoke functions, APIs,...
- CommonsenseQAv4CommonsenseQA is a multiple-choice question answering benchmark of 12,247 questions, introduced in 2019 by Alon Talmor, Jonathan Herzig, Nicholas Lourie, and...
- Frechet Inception Distancev5The Frechet Inception Distance (FID) is the standard metric for measuring the quality of images produced by generative models: it computes the Frechet distance...
- MedQAv4MedQA is a large-scale, open-domain medical question answering benchmark of multiple-choice questions taken from real medical licensing examinations,...
- AlpacaEvalv6AlpacaEval is an automatic evaluation framework for instruction-following large language models (LLMs) developed by Stanford University's Tatsu Lab, which...
- AgentBenchv6AgentBench is a multi-dimensional benchmark for evaluating large language models (LLMs) as autonomous agents across eight distinct interactive environments,...
- CodeContestsv4CodeContests is a competitive programming dataset created by Google DeepMind for training and evaluating machine learning models on algorithmic problem-solving...
- Kaiber AIv7Kaiber AI is a creative technology company that builds AI video generation tools for musicians, visual artists, and content creators. Founded in 2022 by Victor...
- Covariant (company)v8Private Industry October 2017 (as Embodied Intelligence) Founders Emeryville, California, United States Key people Covariant Brain, RFM-1 (Robotics...
- Alignment Research Centerv8Nonprofit research organization (501(c)(3)) Industry April 2021 Founder Berkeley, California, United States President Paul Christiano (Founder), Jacob...
- Qodov6Qodo (formerly CodiumAI or Codium) is an AI-powered code integrity platform that provides automated code review, test generation, and code quality tools for...
- Anyscalev10Private Industry 2019; Berkeley, California Founders San Francisco, California, United States CEO Ray (open-source distributed computing framework) ...
- Taskadev7Taskade is an AI-powered workspace platform for project management, task automation, and team collaboration.[3] Founded in 2017 by John Xie (CEO), Dionis Loire...
- Mem AIv6Mem AI is an AI-powered note-taking and knowledge management platform developed by Mem Technologies, Inc. (commonly referred to as Mem or Mem Labs). Founded in...
- tl;dvv3tl;dv (short for "too long; didn't view") is an artificial intelligence-powered meeting recording, transcription, and intelligence platform that works with...
- Granola (software)v7Granola is an artificial intelligence-powered meeting notepad application that combines a user's own typed notes with AI-generated content derived from a...
- Cogramv6Cogram is an artificial intelligence platform designed for the architecture, engineering, and construction (AEC) industry.[1] Founded in 2021 by Alexander von...
- Warp (terminal)v5Warp is an AI-powered terminal emulator and agentic development environment developed by Warp (formerly Warp Dev, Inc.). Written in Rust, Warp uses...
- Center for AI Safetyv8The Center for AI Safety (CAIS) is an American nonprofit research and advocacy organization based in San Francisco, California, founded in 2022 to reduce...
- Sourcegraph Codyv7Sourcegraph Cody is an enterprise AI coding assistant built by Sourcegraph that combines large language models with the company's code-search and code-graph...
- Civitaiv8Civitai (pronounced "siv-it-eye") is the largest community hub and marketplace for sharing open-source image generation models, hosting hundreds of thousands...
- Wordtunev6AI writing and reading assistant Developer October 27, 2020 Platform Proprietary (NLP models) Headquarters 10 million+ (2025) Website Wordtune is an...
- Pieces for Developersv7Pieces for Developers is an AI-powered developer productivity tool created by Mesh Intelligent Technologies, Inc. The software provides code snippet...
- Rytrv6Rytr is an artificial intelligence-powered writing assistant platform designed to help individuals and businesses generate short-form and medium-form written...
- Sudowritev6Sudowrite is an artificial intelligence-powered writing assistant designed specifically for fiction writers, novelists, screenwriters, and other creative...
- Continue (software)v8Continue is an open-source AI code assistant that integrates directly into code editors, letting developers connect any large language model (LLM) and...
- Exa AIv5Exa AI (formerly Metaphor) is an artificial intelligence company that builds a search engine designed specifically for AI applications. Unlike traditional...
- Colossyanv8Colossyan is a generative AI company that develops an AI-powered video creation platform focused on corporate training, workplace learning, and enterprise...
- Luma AIv8Luma AI (operating as Luma Labs, Inc.) is a generative AI company headquartered in Palo Alto, California, that builds text-to-video, 3D, and image models, best...
- Topaz Labsv5Topaz Labs is a software company headquartered in Dallas, Texas, that develops AI-powered tools for photo and video enhancement, best known for Gigapixel,...
- Tavilyv4See also: Retrieval-augmented generation, AI agent, and Information retrieval Tavily is a search engine and API platform built specifically for AI agents and...
- Machine Intelligence Research Institutev5501(c)(3) nonprofit Industry July 27, 2000 (as Singularity Institute for Artificial Intelligence) Founders Berkeley, California, United States Key...
- Le Chatv13Le Chat is the consumer AI assistant and conversational chatbot built by Mistral AI, the French artificial intelligence company headquartered in Paris, and is...
- Modal (platform)v7Modal is a serverless cloud computing platform that lets developers run compute-intensive artificial intelligence, machine learning, and data-processing...
- Playground AIv4Playground AI (now branded simply as Playground) is an AI image generation and graphic design platform founded by Suhail Doshi in 2022. The platform combines...
- Tome (AI)v8Tome was an artificial intelligence-powered presentation and storytelling platform that allowed users to generate full presentations, including text, images,...
- Krisp AIv5Krisp AI (formerly 2Hz) is an artificial intelligence company that develops real-time voice AI products, including noise cancellation, accent conversion, voice...
- Beautiful.aiv7Beautiful.ai is an AI-powered presentation software platform that uses intelligent design rules and generative AI to automate the creation of professional...
- Clipdropv5Clipdrop is an AI-powered image editing and creation platform developed by the French startup Init ML. Founded in 2020 by Cyril Diagne, Damien Henry, and...
- Invideo AIv9Invideo AI is an AI video generation platform that allows users to create professional-quality videos from simple text prompts. The platform automates the...
- Auto-GPTv9AutoGPT (also stylized Auto-GPT) is an open-source autonomous AI agent framework that uses large language models (LLMs), primarily OpenAI's GPT-4, to...
- You.comv8You.com is an artificial intelligence company that builds AI-powered web search infrastructure and enterprise research agents, founded in 2020 by Richard...
- CoreWeavev8CoreWeave, Inc. is an American artificial intelligence cloud computing company headquartered in Livingston, New Jersey, that rents large clusters of NVIDIA...
- Poe (platform)v9Poe (short for Platform for Open Exploration) is an AI chatbot aggregator platform developed and operated by Quora.[15] Poe provides access to multiple large...
- Robot locomotionv5Robot locomotion refers to the methods by which robots move through their environment, with a particular focus on legged robots that walk, run, climb, and...
- NVIDIA Isaac Simv6NVIDIA Isaac Sim is an open-source robotics simulation application built on NVIDIA Omniverse for developing, simulating, and testing AI-driven robots in...
- Krea AIv10Krea AI (legally Krea, krea.ai) is a San Francisco generative AI company, founded in 2022, that builds a browser-based creative suite for image generation,...
- ALOHA (robot system)v5ALOHA (A Low-cost Open-source Hardware System for Bimanual Teleoperation) is an open-source robotic platform for collecting bimanual manipulation...
- Robot manipulationv5See also: Robotics, Robot learning, Embodied AI, Computer vision Robot manipulation is the ability of a robotic system to physically interact with objects in...
- Robot safetyv4Robot safety is the discipline concerned with minimizing the risk of physical harm, property damage, and other hazards arising from the operation of robotic...
- QuillBotv7QuillBot is an artificial intelligence-powered writing platform, founded in 2017, whose AI paraphrasing tool is its flagship product alongside a grammar...
