Citation and evidence

Gemini Omni

10 min full readUpdated 11 references

This article's verification

Report a problem with this article

Edit article
More

Cite this article

Gemini Omni is a family of proprietary multimodal AI models from Google DeepMind for generating and editing media. Google announced the family at Google I/O on May 19, 2026, and released its first member, Gemini Omni Flash, on the same day. The initial product focuses on AI video generation: it accepts combinations of text, images, video, and, on some product surfaces, audio references, then produces short video with synchronized audio. Google describes Omni as a meeting point between the reasoning capabilities of the Gemini family and its generative media work.[1][2]

Google DeepMind logo
Google DeepMind logo. Source: Wikimedia Commons, Public domain.

The released model's official name is Gemini Omni Flash. Its first Gemini Developer API identifier was gemini-omni-flash-preview. On August 27, 2026, Google released the generally available gemini-omni-1.1-flash (Gemini Omni 1.1 Flash), adding video extension, first-and-last-frame interpolation, and 360p to 4K output; the preview endpoint was deprecated on September 30, 2026 and is now listed as shut down.[2][3][5] "Gemini Omni" names the broader family. Google has discussed future Omni output modalities and a higher-capability Pro variant, but as of early November 2026 its developer documentation lists no Omni Pro endpoint, and Google has not announced a release date for one.[1][3][10]

Naming and release history

DateDevelopment
May 19, 2026Google announced Gemini Omni and began rolling out Gemini Omni Flash in the Gemini app and Google Flow for Google AI Plus, Pro, and Ultra subscribers. It also started a free rollout through YouTube Shorts and YouTube Create.[1][2]
June 30, 2026The Gemini Developer API added gemini-omni-flash-preview in public preview through the Interactions API.[5]
July 16, 2026Google began rolling Gemini Omni into Google Vids for Google AI Pro and Ultra subscribers and Google Workspace business customers.[9]
August 27, 2026The Gemini Developer API released gemini-omni-1.1-flash (Gemini Omni 1.1 Flash) as the generally available version, with video extension, first-and-last-frame interpolation, and resolution control; Google deprecated gemini-omni-flash-preview on September 30, 2026.[3][5]

Expanded article table

At launch, Google said Omni would eventually support outputs such as images and audio. The available Flash endpoint instead returns video, while some enterprise documentation lists text output alongside it. This distinction matters because "any input to any output" describes Google's planned family direction, not the complete output set of the June 2026 developer preview.[1][8]

"Introducing Gemini Omni", official video from Google for Developers, published May 19, 2026. Watch on YouTube.

Architecture and training

The Gemini Omni Flash model card identifies it as a transformer-based model with native support for text, vision, video, and audio inputs. Google says it trained the model on text, image, audio, and video data, with captions at several levels of detail for audio and video examples. Training videos went through semantic deduplication and filters for safety, compliance, and quality.[2]

Google trained the model on Tensor Processing Units using JAX and Pathways. It has not disclosed the parameter count, detailed network topology, training-compute budget, dataset size, or whether the production system routes requests among distinct media components. Google's launch description says Omni combines Gemini intelligence with generative media models, but the published model card does not describe a router or mixture-of-experts design.[1][2]

The model is proprietary and distributed through hosted Google products and APIs. Google has not released model weights or a technical paper that would allow independent inspection of its architecture or training corpus.

Inputs, outputs, and developer specifications

The Gemini Developer API and Google enterprise documentation expose different limits for the model; the enterprise page still documents the preview identifier, while the Developer API now serves the generally available gemini-omni-1.1-flash. These figures apply to their respective access surfaces rather than defining one universal configuration.[3][8]

PropertyGemini Developer APIGoogle Enterprise Agent Platform
Model IDgemini-omni-1.1-flash (the earlier gemini-omni-flash-preview is shut down)gemini-omni-flash-preview
Release stageGenerally available (since August 27, 2026)Preview (deprecation date November 6, 2026)
Maximum input context1,048,576 tokens131,072 tokens
Documented output limitVideo lasting 3-10 seconds57,920 output tokens
Video format360p, 720p (default), 1080p, or 4K at 24 frames per second (1080p and 4K by upscaling)720p; 16:9 or 9:16
Main supported tasksText-to-video, image-to-video (including first-and-last-frame interpolation), reference-to-video, video editing, and video extensionText-to-video, reference-to-video, sound generation, and video editing

Expanded article table

The Developer API model page lists text, image, and video input, with videos up to 10 seconds for editing. Its detailed guide says direct audio-reference upload is not yet supported through that API, even though the model card describes audio as an architectural input modality and consumer launch material demonstrated voice references. Modality support therefore depends on the product and API version.[1][2][3][4]

Omni Flash can generate a clip from a text description, animate one or more still images, or alter an uploaded or previously generated clip. Developers can specify landscape 16:9 or portrait 9:16 output. The Interactions API also supports stateful editing: a follow-up request supplies the prior interaction ID, and the model creates a new video while applying the requested change. Each editing turn produces a new clip rather than modifying the original file in place.[4]

Google positions the model as having world knowledge and an intuitive grasp of physical relationships. Demonstrations include changes to materials, objects, actions, camera angles, and visual styles, as well as prompts tied to scientific or historical subjects. These examples show intended behavior, not a guarantee that a generated scene is physically or factually correct. Gemini Omni also differs from Google's Veo line in emphasis: Omni is built around multimodal references and conversational revision, while Veo remains a dedicated video-generation family.[1][7][10]

Product access and pricing

Consumer access began in the Gemini app, Google Flow, YouTube Shorts, and YouTube Create. The model card also lists Google Flow Music as a distribution channel. Google Vids later added text and image conditioned generation plus conversational editing for eligible Google AI and Workspace customers.[1][2][9]

Developer access is available through Google AI Studio and the paid tier of the Gemini Developer API. Standard API pricing lists input at $1.50 per million tokens for text, image, video, or audio. Output costs $9.00 per million text tokens and $17.50 per million video tokens. Google calculates 720p video at 5,792 output tokens per second, which makes the listed effective video price about $0.10 per second. There is no free API tier for this model.[6]

Google's enterprise platform lists the preview in the global region with fixed-quota consumption. It does not support pay-as-you-go, batch inference, or provisioned throughput on that surface. As of its November 4, 2026 update, the enterprise documentation gives the preview a deprecation date of November 6, 2026.[8]

Evaluation

Google reports human preference tests across four main video tasks. For video editing, human raters compared outputs on 504 examples and Google reported leading overall preference and instruction-following results against other video models. Its text-to-video test used 1,003 prompts from Meta's MovieGenBench. An image-to-video evaluation used 355 VBench image and text pairs, where Google reported a leading tie among Omni Flash, Grok Imagine Video, and Kling. A reference-to-video study used 468 multimodal examples and measured overall preference and speech adherence.[7]

These results are vendor-reported. The public model page describes sample counts and evaluation methods, but it does not expose all prompts, individual ratings, or enough detail to reproduce the comparisons independently. The initial May model card also said fuller evaluation results would accompany API access, so the later model page should be read as an update to that launch document.[2][7]

A separate 35-case test by K-Dense examined one-shot scientific and educational clips through an early-access API. Thirty-four generations succeeded. Reviewers rated 16 clips at least 4 out of 5 for scientific accuracy, four as mixed, and 14 as containing serious errors. The test found strong visual quality and prompt adherence but recurring problems with scientific labels, equations, mechanisms, and physical dynamics. It was a small, non-peer-reviewed evaluation without iterative prompt refinement, so it is evidence of specific failure modes rather than a general model ranking.[11]

Safety and provenance

Google says Gemini Omni Flash underwent automated and human evaluations during and after training, specialist human red teaming, automated red teaming, and pre-release ethics and safety reviews. The model card describes pre-training work on synthetic captioning and post-training production filters. Inputs and generated outputs in the API are subject to content-safety filters and Google's prohibited-use policy.[2][4]

Generated Omni videos carry an imperceptible SynthID watermark. Google also says content created or edited through the Gemini app, Flow, or YouTube includes C2PA Content Credentials. The two mechanisms serve different purposes: SynthID embeds a detectable signal in the media, while Content Credentials attach provenance metadata.[7]

Speech alteration receives additional restrictions. The model card says the underlying model can change a person's speech, but Google has restricted that capability while it continues safety testing. The public Developer API guide lists voice editing as unsupported. Google's personal-avatar workflows also require product-specific enrollment and likeness controls.[2][4][9]

Limitations

Google's model card identifies incomplete consistency across edits, complex motion, and accurate text rendering as known weaknesses. The Developer API has further operational limits: it does not support reasoning across multiple video references, voice editing, uploaded audio references, YouTube videos as a media source, provisioned throughput, system instructions, temperature controls, top_p, stop sequences, or a separate negative-prompt field, and video extension (added with the August 2026 GA model, along with first-and-last-frame interpolation) can only append to the end of a clip. Google says English is fully supported, while other languages have not been evaluated and may vary in quality.[2][4]

Some geographic restrictions apply. Editing uploaded videos is unavailable through the Developer API in the European Economic Area, Switzerland, and the United Kingdom, although editing a video generated by the model is supported there. Uploading or editing images containing minors is also restricted in those regions, and images of certain recognizable people may be rejected more broadly.[4]

Preview status remains a limitation on the enterprise surface, where behavior, quotas, interfaces, and documented ceilings may change; on the Developer API the August 2026 GA release replaced the preview endpoint. The difference between the million-token Developer API context window and the smaller enterprise limit also means developers should verify the documentation for the exact surface they deploy on. Generated factual or educational media requires human review, especially where a visually plausible error could be mistaken for a correct explanation.[3][8][11]

Continue reading

More to read

Topics:AI ModelsGenerative AIGoogle DeepMindMultimodal AIVideo Generation

References

  1. ^1 ^2 ^3 ^4 ^5 ^6 ^7 ^8Google, "Introducing Gemini Omni," May 19, 2026. blog.google/...gemini-omni
  2. ^1 ^2 ^3 ^4 ^5 ^6 ^7 ^8 ^9 ^10 ^11Google DeepMind, "Gemini Omni Flash: Model Card," May 19, 2026. deepmind.google/...gemini-omni-flash
  3. ^1 ^2 ^3 ^4 ^5 ^6Google AI for Developers, "Gemini Omni Flash," latest update August 2026. ai.google.dev/...gemini-omni-flash
  4. ^1 ^2 ^3 ^4 ^5 ^6Google AI for Developers, "Generate and edit videos with Gemini Omni Flash," updated July 6, 2026. ai.google.dev/...omni
  5. ^1 ^2 ^3Google AI for Developers, "Gemini API release notes," June 30, 2026 entry. ai.google.dev/...changelog
  6. ^Google AI for Developers, "Gemini Developer API pricing," updated July 9, 2026. ai.google.dev/...pricing
  7. ^1 ^2 ^3 ^4Google DeepMind, "Gemini Omni." deepmind.google/...gemini-omni
  8. ^1 ^2 ^3 ^4Google Cloud, "Gemini Omni Flash Preview," last updated November 4, 2026. docs.cloud.google.com/...omni-flash-preview
  9. ^1 ^2 ^3Google, "Create, edit and star in videos with two Google Vids updates," July 16, 2026. blog.google/...gemini-omni-personal-avatars
  10. ^1 ^2TechCrunch, Rebecca Bellan, "Google's Gemini Omni turns images, audio, and text into video, and that's just the start," May 19, 2026. techcrunch.com/...o-video-and-thats-just-the-start
  11. ^1 ^2K-Dense, "Benchmarking Google's Omni Flash for Scientific Video," updated June 30, 2026. k-dense.ai/...g-google-omni-flash-scientific-video

Improve this article

Add missing citations, update stale details, or write a clearer explanation. Anyone can edit: changes go live when you publish, and every edit is checked by an editor.

5 revisions · v5 · 1,921 words · full history

Fact-checks are independent of edits: a reviewer re-verifies the article against its sources and stamps the date. How we verify

Research and drafting on this wiki are AI-assisted, under named human editorial standards. How AI is used here

Reviewer note: Independent fact-check of the full article against its cited sources (75 claims, 11 sources fetched); 7 material + 5 minor fixed

Cite this page: AI Wiki. "Gemini Omni." aiwiki.ai, updated 1 Nov 2026, fact-checked 5 Nov 2026. CC BY 4.0. https://aiwiki.ai/wiki/gemini_omni

Edit article