Multimodal AI

Explore Multimodal AI through related topics and the articles other pages reference most.

Explore articles

Reset filters
Browse subtopics: Computer Vision

Articles that also belong to these categories. Counts cover all of Multimodal AI.

Showing 1-22 of 22 articles

CLIP Score

CLIP Score (also written CLIPScore or CLIP-S) is a reference-free automatic evaluation metric that measures how well a text caption matches an image, computed as the rescaled cosine similarity of the image and…

AI BenchmarksComputer Vision

Computer-use agent

A computer-use agent (CUA) is a category of AI agent in artificial intelligence that performs tasks by directly operating a general-purpose computer's graphical user interface (GUI) the way a human does, by…

AI AgentsArtificial Intelligence

DeepSeek-OCR

DeepSeek-OCR is an open-source optical character recognition (OCR) and document-understanding system released by DeepSeek on 20 October 2025 that pioneers a contexts optical compression paradigm: it encodes…

Chinese AIComputer Vision

Donut (Model)

Donut (Document understanding transformer) is an OCR-free visual document understanding model introduced by researchers at NAVER CLOVA in the paper "OCR-free Document Understanding Transformer," first posted…

AI ModelsComputer Vision

EgoSchema

EgoSchema is a diagnostic benchmark for evaluating very long-form video language understanding, introduced by Karttikeya Mangalam, Raiymbek Akshulakov, and Jitendra Malik at UC Berkeley.

AI BenchmarksComputer Vision

Elorian

Elorian (legal name Elorian AI, Inc.) is an artificial intelligence research and product lab in Palo Alto, California, that builds models meant to reason directly over images and video rather than first…

AI CompaniesComputer Vision

MMMU-Pro

MMMU-Pro is a rigorous benchmark for evaluating multimodal AI systems on college-level, expert questions that genuinely require seeing an image, built as a harder and more robust version of the original MMMU…

AI BenchmarksComputer Vision

SigLIP

SigLIP (Sigmoid Loss for Language-Image Pre-training) is a family of vision-language encoders developed by researchers at Google DeepMind that pre-trains image and text encoders by treating each image-text…

Computer VisionGoogle DeepMind

Video-MME

Video-MME (Video Multi-Modal Evaluation) is a benchmark for testing how well multimodal large language models (MLLMs) understand video, built from 900 manually selected videos totaling 254 hours and 2,700…

AI BenchmarksComputer Vision

ZeroBench

ZeroBench is a visual reasoning benchmark built to be effectively impossible for current frontier large multimodal models, which score 0.0% on its main questions.

AI BenchmarksComputer Vision