AI Glasses
AI glasses are eyeglasses that carry a camera, microphones, open-ear speakers and an AI assistant, and in most cases no display at all.
Multimodal AI
Explore Multimodal AI through related topics and the articles other pages reference most.
Most referenced in this topic
Ranked by links from other AI Wiki pages.
Explore articles
Browse subtopics (42)
Articles that also belong to these categories. Counts cover all of Multimodal AI.
All articles (118)AI Models (45)Large Language Models (41)Open Source AI (28)Chinese AI (27)Google DeepMind (21)Computer Vision (18)AI Benchmarks (15)Generative AI (12)Meta AI (12)Embodied AI (10)Mixture of Experts (8)AI Agents (7)Machine Learning (7)Robotics (7)Google (6)Image Generation (6)Video Generation (5)Artificial Intelligence (4)OpenAI (4)AI Companies (3)AI Tools & Products (3)Reasoning Models (3)Small Language Models (3)AI Code Generation (2)AI Hardware (2)AI Research (2)Data & Datasets (2)Deep Learning (2)NVIDIA (2)Natural Language Processing (2)World Models (2)Anthropic (1)Autonomous Vehicles (1)Computer Science (1)Conversational AI (1)Diffusion Models (1)Information Retrieval (1)Model Architecture (1)Reinforcement Learning (1)Sensors (1)Speech & Audio AI (1)Transformer Models (1)
Showing 1-60 of 118 articles
Agentic video understanding
Agentic video understanding is an approach to video analysis in which a reasoning model chooses which parts of a video to inspect for a particular question.
Baidu ERNIE
Baidu ERNIE (Enhanced Representation through Knowledge Integration) is the family of large language and multimodal foundation models built by the Chinese technology company Baidu, spanning the original 2019…
CLIP (Contrastive Language-Image Pre-training)
CLIP, short for Contrastive Language-Image Pre-training, is a family of neural networks developed by OpenAI researchers to learn a shared representation of images and natural-language descriptions.
CLIP Score
CLIP Score (also written CLIPScore or CLIP-S) is a reference-free automatic evaluation metric that measures how well a text caption matches an image, computed as the rescaled cosine similarity of the image and…
CM3leon
CM3leon (pronounced "chameleon") is a multimodal generative model from Meta AI, introduced in July 2023, that handles both text-to-image and image-to-text generation in a single architecture.
Chameleon (Meta AI)
Chameleon is a family of early-fusion, token-based mixed-modal foundation models from Meta AI's Fundamental AI Research (FAIR) group that represents both images and text as discrete tokens in a single unified…
Claude Sonnet 4.5
Claude Sonnet 4.5 is a multimodal large language model (LLM) developed by Anthropic and released on September 29, 2025, which Anthropic described at launch as "the best coding model in the world." It is a…
CogAgent
CogAgent is an open visual language model built to act as a graphical user interface (GUI) agent: given a screenshot and a natural-language goal, it predicts the next on-screen action, such as where to click…
CogVLM
CogVLM is an open vision language model developed by Zhipu AI and the Knowledge Engineering Group (KEG) at Tsinghua University.
Computer-use agent
A computer-use agent (CUA) is a category of AI agent in artificial intelligence that performs tasks by directly operating a general-purpose computer's graphical user interface (GUI) the way a human does, by…
DeepSeek Janus
DeepSeek Janus is a family of open-weight unified multimodal models from Chinese AI lab DeepSeek that perform both image understanding and text-to-image generation in a single autoregressive Transformer.
DeepSeek V4.1-Flash
DeepSeek V4.1-Flash is an open-weight multimodal mixture-of-experts model released by DeepSeek on September 10, 2026. It accepts text and images and generates text.
DeepSeek-OCR
DeepSeek-OCR is an open-source optical character recognition (OCR) and document-understanding system released by DeepSeek on 20 October 2025 that pioneers a contexts optical compression paradigm: it encodes…
DeepSeek-VL
DeepSeek-VL is the first open-source vision-language model series from DeepSeek, the Chinese AI company.
DeepSeek-VL2
DeepSeek-VL2 is an open-weights family of Mixture-of-Experts (MoE) vision-language models released by the Chinese AI laboratory DeepSeek on December 13, 2024.
DiffusionGemma
DiffusionGemma is an experimental open-weight large language model developed by Google DeepMind for multimodal text generation through discrete diffusion.
Document Question Answering Models
Document question answering models (DocQA, sometimes called DocVQA for document visual question answering) are machine learning systems that take a document image or PDF together with a natural language…
Donut (Model)
Donut (Document understanding transformer) is an OCR-free visual document understanding model introduced by researchers at NAVER CLOVA in the paper "OCR-free Document Understanding Transformer," first posted…
Doubao Seed 1.6
Doubao Seed 1.6 is a family of general-purpose foundation models developed by the ByteDance Seed research team and released through Volcano Engine on 11 June 2025 at the company's Force Original Power…
ERNIE 4.5
ERNIE 4.5 is a family of large language models released by the Chinese technology company Baidu, open-sourced on June 30, 2025 under the Apache 2.0 license .
ERNIE 5.0
ERNIE 5.0 is a natively omni-modal foundation model from Baidu, unveiled at the company's annual Baidu World 2025 conference in Beijing on 13 November 2025 as the flagship in the ERNIE line at launch.
ERQA
ERQA (Embodied Reasoning Question Answering) is a multimodal benchmark released by Google DeepMind in March 2025 to evaluate the embodied reasoning capabilities of vision-language models (VLMs) on robotics…
EgoSchema
EgoSchema is a diagnostic benchmark for evaluating very long-form video language understanding, introduced by Karttikeya Mangalam, Raiymbek Akshulakov, and Jitendra Malik at UC Berkeley.
Feature Extraction Models
Feature extraction models are machine learning systems that transform raw inputs such as text, images, or audio into dense numerical vectors known as embeddings or hidden-state representations.
Flamingo (visual language model)
Flamingo is a family of visual language models (VLMs) built by DeepMind and introduced in April 2022 that brought few-shot, in-context learning to multimodal inputs.
Fox (benchmark)
Fox is an evaluation suite for fine-grained, multi-page document understanding by large vision-language models.
GLM-5.3-Flash
GLM-5.3-Flash is an open-weight, natively multimodal mixture-of-experts large language model released by Z.ai on August 26, 2026.
GPT Image 1
GPT Image 1 (API identifier gpt-image-1) is a natively multimodal image generation model developed by OpenAI, integrated into ChatGPT on March 25, 2025, and released as a standalone API on April 23, 2025.
GPT-4V (Vision)
GPT-4V, also written GPT-4V(ision) and read as "GPT-4 with vision," is the image-understanding capability that OpenAI added to its GPT-4 large language model, letting a user supply one or more images alongside…
GPT-4o mini
GPT-4o mini is a small, low-cost multimodal large language model developed by OpenAI and released on July 18, 2024, as the company's most cost-efficient model at the time.
Gemini (app)
The Gemini app is Google's consumer AI assistant, a chat application available on the web at gemini.google.com and as native Android and iOS apps
Gemini 1.0
Gemini 1.0 is the first generation of Gemini, the family of natively multimodal AI models that Google DeepMind announced on 6 December 2023 .
Gemini 1.5 Flash
Gemini 1.5 Flash is a lightweight, low-latency multimodal large language model from Google DeepMind, released at Google I/O on May 14, 2024, as the fast and cost-efficient member of the Gemini 1.5 family.
Gemini 1.5 Pro
Gemini 1.5 Pro is a multimodal large language model developed by Google DeepMind and announced on February 15, 2024, as the flagship model of the Gemini 1.5 generation.
Gemini 2.0 Flash
Gemini 2.0 Flash is a fast, low-cost multimodal large language model built by Google DeepMind as the flagship workhorse of the Gemini 2.0 generation, designed for the agentic era with native tool use, a 1…
Gemini 2.0 Flash-Lite
Gemini 2.0 Flash-Lite is a large language model developed by Google DeepMind and released as the most cost-efficient member of the Gemini 2.0 model family.
Gemini 2.5 Flash
Gemini 2.5 Flash is a fast, cost-optimized multimodal large language model developed by Google DeepMind and the mid-tier member of the Gemini 2.5 family.
Gemini 3
Gemini 3 is the third major generation of the Gemini family of multimodal models from Google DeepMind, launched on November 18, 2025 with Gemini 3 Pro as the flagship and described by Google as "our most…
Gemini 3 Flash
Gemini 3 Flash is a multimodal large language model released by Google on December 17, 2025 as the fast, lower-cost sibling to Gemini 3 Pro in the Gemini 3 family.
Gemini 3 Pro
Gemini 3 Pro is the flagship preview model in Google DeepMind's Gemini 3 family of multimodal models, launched on November 18, 2025 as what Google called "our most intelligent model." It became the first…
Gemini 3.1 Pro
Gemini 3.1 Pro is a large language model developed by Google DeepMind and released on 19 February 2026 as a point-release upgrade to Gemini 3 Pro .
Gemini 3.5 Flash
Gemini 3.5 Flash is a fast frontier large language model developed by Google DeepMind, announced at Google I/O 2026 on May 19, 2026 and made generally available the same day .
Gemini 3.6 Flash
Gemini 3.6 Flash is a proprietary, multimodal large language model released by Google on July 21, 2026. It belongs to the Gemini 3 series and uses the stable API identifier gemini-3.6-flash.
Gemini 3.7 Flash
Gemini 3.7 Flash is a proprietary, multimodal large language model released by Google on August 13, 2026.
Gemini 3.8 Flash
Gemini 3.8 Flash is a multimodal model in Google's Gemini family. Google DeepMind released it on September 2, 2026 as a generally available model for software engineering, tool-using agents, and knowledge work.
Gemini Omni
Gemini Omni is a family of proprietary multimodal AI models from Google DeepMind for generating and editing media.
Gemini Robotics 2
Gemini Robotics 2 is a family of three robotics models announced by Google DeepMind on July 30, 2026: a vision-language-action (VLA) model of the same name, an embodied reasoning model called Gemini Robotics…
Gemini Ultra
Gemini Ultra (branded Ultra 1.0) was the largest and most capable model in the Gemini 1.0 family, the first generation of natively multimodal large language models from Google DeepMind.
Gemma 3
Gemma 3 is a family of open-weight large language models developed by Google DeepMind and released on March 12, 2025.
Generalist GEN-1
GEN-1 is an embodied robot foundation model and control system developed by Generalist AI.
Generalist GEN-1.5
Generalist GEN-1.5 is a proprietary robot foundation model announced by Generalist AI on August 19, 2026.
HY-World 2.0
HY-World 2.0 (also written HunyuanWorld 2.0 or Hunyuan World Model 2.0) is an open multimodal 3D world model from Tencent's Hunyuan team, with a technical report and first code release published on April 16
HuggingGPT
HuggingGPT is an agent system that uses a large language model as a controller to plan tasks and orchestrate specialist machine learning models hosted on Hugging Face.
Image-to-Text Models
Image-to-text models are machine learning systems that take an image as input and produce natural language text as output.
ImageBind
ImageBind is a multimodal model from Meta AI (its Fundamental AI Research lab) that learns a single joint embedding space across six different modalities: images and video, text, audio, depth, thermal…
InternVL
InternVL is a family of open-source multimodal large language models developed by the OpenGVLab research group at the Shanghai Artificial Intelligence Laboratory in collaboration with academic partners…
LINGO-2 (Wayve)
LINGO-2 is a closed-loop vision-language-action model for autonomous driving developed by the British self-driving company Wayve.
LLaVA (Large Language and Vision Assistant)
LLaVA (Large Language and Vision Assistant) is an open-source family of multimodal large language models that connects a frozen vision encoder to a pre-trained large language model through a single learned…
LayoutLM
LayoutLM is a family of pre-trained multimodal models developed by Microsoft Research for document AI, the task of automatically reading and understanding visually rich documents such as forms, invoices…