# HunyuanVideo

> Source: https://aiwiki.ai/wiki/hunyuan_video
> Updated: 2026-10-28
> Fact-checked: 2026-11-04
> Categories: Chinese AI, Generative AI, Open Source AI, Video Generation
> License: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/) - attribute to "AI Wiki (aiwiki.ai)"
> Cite as: AI Wiki. "HunyuanVideo." aiwiki.ai, 28 Oct 2026. https://aiwiki.ai/wiki/hunyuan_video
> From AI Wiki (https://aiwiki.ai), the free encyclopedia of artificial intelligence. Reuse freely with attribution.

**HunyuanVideo** is an open-source [video generation](https://aiwiki.ai/wiki/ai_video_generation) model developed by [Tencent](https://aiwiki.ai/wiki/tencent_ai) and released on December 3, 2024, with over 13 billion parameters, making it the largest open-source video generation model at the time of launch.[1] It generates high-quality videos from text prompts and, through subsequent releases, from images, audio, and reference videos as well, using a [Diffusion Transformer](https://aiwiki.ai/wiki/diffusion_model) (DiT) architecture with a novel "Dual-Stream to Single-Stream" design, a [Multimodal Large Language Model](https://aiwiki.ai/wiki/multimodal_model) (MLLM) text encoder, and a 3D Variational [Autoencoder](https://aiwiki.ai/wiki/autoencoder) (VAE) for spatiotemporal compression.[1] The accompanying technical report states that HunyuanVideo "demonstrates performance in video generation comparable to, or even surpassing, that of leading closed-source models."[1]

<figure class="w-56">
<img src="/images/wd-2026-10-28-tencent-logo-c2cdd6d1ecf7-tile.png" alt="Tencent logo" width="480" height="122" />
<figcaption>Tencent logo. Source: <a href="https://commons.wikimedia.org/wiki/File:Tencent_logo_2017.svg">Wikimedia Commons</a>, <a href="https://commons.wikimedia.org/wiki/File:Tencent_logo_2017.svg#Licensing">Public domain</a>.</figcaption>
</figure>

[Tencent](https://aiwiki.ai/wiki/tencent) released the model weights and inference code under the Tencent Hunyuan Community License Agreement.[11] In professional human evaluations conducted with 1,533 text prompts and 60 evaluators, HunyuanVideo outperformed several leading models including [Runway Gen-3 Alpha](https://aiwiki.ai/wiki/runway_gen_3) and Luma 1.6, particularly in motion quality.[1] A follow-up release, HunyuanVideo 1.5, arrived in November 2025 with a smaller 8.3 billion parameter model that runs on consumer-grade GPUs while delivering further gains in instruction following and motion clarity.[2] Together with sibling models such as HunyuanCustom, HunyuanVideo-Avatar, and HunyuanVideo-Foley, the HunyuanVideo family has grown into one of the most complete open-source video generation ecosystems available as of 2026.

## When was HunyuanVideo released, and how has it evolved?

HunyuanVideo was developed by the Tencent Hunyuan [Foundation Model](https://aiwiki.ai/wiki/foundation_models) Team. The accompanying research paper, titled "HunyuanVideo: A Systematic Framework For Large Video Generative Models," was published on [arXiv](https://aiwiki.ai/wiki/information_retrieval) (2412.03603) on December 3, 2024, the same day the inference code and model weights were made publicly available on [GitHub](https://aiwiki.ai/wiki/github_copilot) and [Hugging Face](https://aiwiki.ai/wiki/hugging_face).[1][3][5]

The project grew out of Tencent's broader [Hunyuan](https://aiwiki.ai/wiki/hunyuan) AI initiative, which includes large language models, image generation systems, and the [3D generation](https://aiwiki.ai/wiki/hunyuan_3d) line. HunyuanVideo was positioned as an answer to closed-source video generation tools such as [OpenAI](https://aiwiki.ai/wiki/openai)'s [Sora](https://aiwiki.ai/wiki/sora) and [Kuaishou](https://aiwiki.ai/wiki/kuaishou)'s [Kling](https://aiwiki.ai/wiki/kling), offering comparable quality in an open-weight package that researchers and developers could run locally. The release marked a strategic decision by Tencent to publish a frontier-scale video model rather than keep it as an internal product, mirroring the company's approach to its text and image foundation models.

Several milestones followed the initial release:

| Date | Release | Description |
|---|---|---|
| December 3, 2024 | HunyuanVideo (T2V) | Original 13B parameter text-to-video model, 720p output, 129 frames at 24 fps |
| December 17-18, 2024 | Diffusers integration and FP8 weights | HunyuanVideo integrated into Hugging Face Diffusers (December 17) and FP8 weights released to cut GPU memory (December 18) |
| March 6, 2025 | HunyuanVideo-I2V | 13B parameter image-to-video variant with token replace technique for reference image injection |
| May 9, 2025 | HunyuanCustom | Multimodal-driven framework for customized video generation supporting image, audio, video, and text conditions |
| May 28, 2025 | HunyuanVideo-Avatar | Audio-driven human animation model for generating speech-synchronized digital human videos |
| August 28, 2025 | HunyuanVideo-Foley | Text-Video-to-Audio (TV2A) model that automatically generates sound effects synchronized to existing video |
| September 29, 2025 | HunyuanVideo-Foley-XL | Smaller, memory-friendly XL model (the default is XXL) with offload inference for reduced VRAM use |
| November 21, 2025 | HunyuanVideo 1.5 | Lightweight 8.3B parameter model with SSTA attention, super-resolution to 1080p, and consumer GPU support |
| November 27, 2025 | Cache inference support | TeaCache, TaylorCache, and DeepCache integrations land for HunyuanVideo 1.5 |
| December 2025 | HunyuanVideo-1.5 I2V step-distilled | 8 or 12-step image-to-video distillation generating clips in roughly 75 seconds on an RTX 4090 |

The cadence of releases through 2025 transformed HunyuanVideo from a single text-to-video checkpoint into a layered ecosystem of foundation, conditional, and [audio models](https://aiwiki.ai/wiki/audio_models), all sharing the same underlying DiT architecture and VAE compression scheme.

## How does the HunyuanVideo architecture work?

HunyuanVideo is built on three main components: a [Diffusion Transformer](https://aiwiki.ai/wiki/diffusion_transformer) backbone, an MLLM-based text encoder, and a 3D causal VAE.[1] The system operates in a compressed latent space, where Gaussian noise is progressively denoised conditioned on text (or image) inputs, and the resulting latent representation is decoded back into pixel-space video. The same architectural blueprint also underpins the diffusion model variants in HunyuanVideo-I2V, HunyuanCustom, and HunyuanVideo-Avatar, which extend the base transformer with additional conditioning modules rather than replacing it.

### Dual-Stream to Single-Stream Diffusion Transformer

The core of HunyuanVideo is a [transformer](https://aiwiki.ai/wiki/attention)-based diffusion model that processes video and text tokens through a hybrid architecture. This design was referred to by the team as "Dual-Stream to Single-Stream."[1]

In the dual-stream phase, video tokens and text tokens pass through separate transformer blocks independently. Each [modality](https://aiwiki.ai/wiki/modality) learns its own modulation mechanisms (such as adaptive layer normalization) without interference from the other. This separation allows the model to develop strong representations for both visual content and language semantics before they interact.

In the single-stream phase, video and text tokens are concatenated into a single sequence and processed jointly through additional transformer blocks using full attention. This stage enables deep multimodal fusion, allowing the model to align generated visual content with the text description.

The architecture hyperparameters for the 13B foundation model are:

| Parameter | Value |
|---|---|
| Dual-stream blocks | 20 |
| Single-stream blocks | 40 |
| Hidden dimension | 3,072 |
| FFN dimension | 12,288 |
| Attention heads | 24 |
| Head dimension | 128 |
| Positional embedding channels (dt, dh, dw) | 16, 56, 56 |

The model uses Flow Matching as its training objective rather than the more traditional DDPM ([Denoising Diffusion Probabilistic Model](https://aiwiki.ai/wiki/ddpm)) approach.[1] In flow matching, the network learns to predict the velocity field that transports samples between a simple noise distribution and the target data distribution. This formulation has been shown to produce more stable training dynamics and higher-quality outputs compared to standard noise prediction.

### MLLM text encoder

Rather than relying on [CLIP](https://aiwiki.ai/wiki/computer_vision) or [T5](https://aiwiki.ai/wiki/t5) alone as text encoders, HunyuanVideo uses a pre-trained Multimodal Large Language Model (MLLM) with a decoder-only architecture.[1] The publicly released version uses llava-llama-3-8b-v1_1 (provided by Xtuner) as the text encoder, though Tencent has indicated that a proprietary HunyuanMLLM was used internally.[5]

The MLLM offers several advantages over traditional text encoders. Compared to CLIP, it provides superior image detail description and complex reasoning capabilities. Compared to T5, its visual instruction fine-tuning gives it better image-text alignment.[1]

However, the MLLM is based on causal (autoregressive) attention, while diffusion models tend to benefit from bidirectional text representations. To address this gap, HunyuanVideo introduces an extra bidirectional token refiner that post-processes the MLLM's output features, producing enhanced text embeddings that better guide the diffusion process.[1]

A secondary text encoder, OpenAI's clip-vit-large-patch14, is also used in the pipeline alongside the MLLM.[1] The CLIP encoder contributes a pooled global representation that supplements the token-level features extracted from the MLLM, giving the diffusion transformer both fine-grained semantic anchors and a coarse overall prompt summary.

In addition, a prompt rewrite model fine-tuned from Hunyuan-Large rewrites user prompts into more detailed descriptions before they are fed to the text encoder.[1] This approach improves generation quality by expanding sparse user inputs into rich, descriptive text. The rewrite module also handles multilingual input, standardizes prompts into a caption-like structure, and simplifies complex wording while keeping the user's intent.[1]

### 3D causal VAE

HunyuanVideo compresses pixel-space videos into a compact latent space using a 3D Variational Autoencoder (VAE) built with CausalConv3D layers.[1] The compression ratios are:

| Dimension | Compression ratio |
|---|---|
| Temporal (video length) | 4x |
| Spatial (height and width) | 8x |
| Channel | 16 latent channels |

The causal convolution design ensures temporal causality, meaning each frame's latent representation depends only on current and previous frames, never future ones. This property is important for maintaining coherent motion and enabling autoregressive-style generation patterns.

By compressing along all three dimensions simultaneously (rather than separately handling spatial and temporal compression), the 3D VAE can capture joint spatiotemporal patterns. This compression significantly reduces the number of tokens the diffusion transformer must process, making it possible to train on high-resolution video at the original frame rate.

The VAE handles both images (treated as single-frame videos) and multi-frame videos, allowing the same architecture to support unified image and video generation.[1] This shared codec is also why HunyuanVideo-I2V, HunyuanCustom, and HunyuanVideo-Avatar can interchange latents and reference images without retraining the VAE for each downstream task.

## How was HunyuanVideo trained?

### Data curation

HunyuanVideo was pre-trained on internet-scale images and videos, processed through a hierarchical data filtering pipeline.[1] Raw videos were split into single-shot clips with PySceneDetect, deduplicated using embeddings from an internal VideoCLIP model, and rebalanced around roughly 10,000 k-means concept centroids. Filters then removed clips with low aesthetic scores (assessed with Dover), visual blur (a dedicated clarity model), static or slow motion (optical-flow motion speed), excessive on-screen text (an internal OCR model, which also cropped subtitles), and watermarks, borders or logos (YOLOX-like detectors).[1] Progressively stricter thresholds produced a dataset for each training stage, with video resolution rising from 256x256x65 to 720x1280x129, and the final fine-tuning set was built through manual annotation.[1]

The later HunyuanVideo 1.5 report describes a revised pipeline: basic filtering of padding borders, stitching artifacts, grid layouts and static scenes; a visual quality operator scoring sharpness, detail retention, noise and artifacts, and dynamic range; and aesthetic filtering. Approximately 800 million video segments remained for HunyuanVideo 1.5 pre-training.[2] The dataset spans a deliberately broad mix of human action, natural scenery, animal behavior, sports, animation, and product footage so that the model can match a wide variety of prompts encountered downstream.

### Progressive training strategy

The model was trained using a progressive multi-stage approach that gradually increased resolution, video length, and frame rate:[1]

1. Text-to-image pre-training at 256px, then mix-scale training on 256px and 512px images, to establish semantic alignment.
2. Progressive video-image joint training initialized from the T2I weights, moving from low-resolution short videos to low-resolution long videos and then high-resolution long videos, with images mixed in at every stage.
3. High-performance fine-tuning on four curated subsets that were screened automatically and then reviewed manually.

HunyuanVideo 1.5 used a related schedule: 256p at 16 fps, progressing to 480p and 720p and then to 24 fps, with T2I, T2V and image-to-video (I2V) tasks mixed at a ratio of 1:6:3.[2]

This progressive approach allows the model to first learn basic visual concepts at low resolution before tackling the harder problem of high-resolution video with complex motion. The strategy also improves training efficiency, since early stages process far fewer tokens per sample.

The report describes a 5D parallel training strategy combining tensor parallelism, sequence parallelism, context parallelism (using Ring Attention for long sequences) and data parallelism with ZeroCache optimization, plus recomputation and activation offloading to manage memory.[1]

## What is HunyuanVideo 1.5, and how does it differ from 1.0?

HunyuanVideo 1.5 was released on November 21, 2025, as a lighter and more efficient successor to the original model.[2][4] The accompanying technical report (arXiv: 2511.18870) detailed a number of architectural improvements designed to make high-quality video generation accessible on consumer hardware while keeping pace with proprietary competitors.[2] Tencent describes the model as establishing "a new state-of-the-art among open-source video generation models."[2]

### Key changes from 1.0

The most significant change was the reduction in model size from 13 billion to 8.3 billion parameters.[2] Despite the smaller size, HunyuanVideo 1.5 achieved state-of-the-art visual quality and motion coherence through several architectural innovations.

The 3D causal VAE was also updated, with spatial compression increased to 16x (up from 8x in version 1.0) while maintaining 4x temporal compression.[2] The latent channel dimension was set to 32. The denser latent representation lets a smaller transformer span the same field of view, which is one of the main reasons HunyuanVideo 1.5 can run on a single 24 GB consumer GPU.

Other notable updates include:

- **Glyph-aware bilingual text encoding** that pairs a Qwen2.5-VL multimodal encoder with a separate Glyph-ByT5 encoder to improve the rendering of Chinese and English text in video.[2]
- **Adaptive flow matching shift schedules** tuned to the different token lengths of each progressive training stage.[2]
- **Optional super-resolution stage** that upscales base outputs to 1080p in latent space.
- **A step-distilled 480p image-to-video model** (December 5, 2025) that cuts sampling from 50 steps to 8 or 12, alongside CFG-distilled checkpoints and step-distilled super-resolution models.[4]

### Selective and Sliding Tile Attention (SSTA)

The headline architectural innovation of HunyuanVideo 1.5 is Selective and Sliding Tile Attention (SSTA), a mechanism designed to address the high computational cost of full attention over long video sequences.[2] SSTA operates through four steps:

1. **3D Block Partition:** The spatiotemporal token sequence is divided into 3D blocks.
2. **Selective Mask Generation:** Based on query-key similarity and key-key redundancy metrics, the system identifies and marks redundant tokens.
3. **STA Mask Generation:** A sliding tile attention mask is created to maintain local coherence.
4. **Block-Sparse Attention:** Only non-redundant token interactions are computed.

By dynamically pruning redundant spatiotemporal tokens, SSTA achieved an end-to-end speedup of 1.87x for 10-second 720p video synthesis compared to [FlashAttention](https://aiwiki.ai/wiki/flash_attention)-3, without a meaningful loss in output quality.[2] SSTA is implemented as a drop-in replacement for the dense attention path used in HunyuanVideo 1.0, so existing training and inference utilities require only minor modifications to take advantage of it.

### Video super-resolution

HunyuanVideo 1.5 includes a dedicated video super-resolution network that upscales outputs from the base resolution (480p to 720p) to 1080p.[2] This network follows the same 8.3B Diffusion Transformer architecture as the main model and operates in latent space. Low-resolution latents are injected using channel concatenation, and a separate latent upsample block spatially aligns low-resolution and high-resolution latents before the final VAE decoding step.

The super-resolution network was trained on 1 million high-quality video clips.[2] It not only increases resolution but also corrects distortions and refines details in the base output, effectively serving as a "polish" stage that can be skipped to save compute when 1080p is not required.

### Post-training

HunyuanVideo 1.5 introduced a three-phase post-training pipeline:[2]

1. **Continuing training:** Further pre-training on curated high-quality data.
2. **Supervised fine-tuning:** Training on human-selected high-quality video-prompt pairs.
3. **[RLHF](https://aiwiki.ai/wiki/rlhf) (Reinforcement Learning from Human Feedback):** Aligning model outputs with human preferences for visual quality, motion naturalness, and text faithfulness.

For image-to-video, Tencent applied online reinforcement learning with a fine-tuned VLM-based reward model; for text-to-video, it first ran Direct Preference Optimization on manually annotated video pairs and then the same online RL stage. Both were aimed mainly at correcting structural and motion artifacts.[2]

### What hardware does HunyuanVideo 1.5 need?

One of the goals of HunyuanVideo 1.5 was to run on consumer-grade GPUs. Peak memory usage was reported at 13.6 GB for 720p video with 121 frames, making it feasible to run on GPUs like the [NVIDIA](https://aiwiki.ai/wiki/nvidia) RTX 4090.[2] Community tools push requirements lower: the README lists Wan2GP as running HunyuanVideo 1.5 in as little as 6 GB of VRAM.[4] With the official 480p image-to-video step-distilled checkpoint, a single RTX 4090 can generate a video in about 75 seconds.[4]

## What can HunyuanVideo do?

### Text-to-video

The primary capability of HunyuanVideo is text-to-video generation. Given a text prompt, the model generates video clips at up to 720p resolution (1280x720 or 720x1280 depending on aspect ratio) with 129 frames at 24 fps, yielding roughly 5 seconds of video.[1] Multiple aspect ratios are supported, including 16:9, 9:16, 4:3, 3:4, and 1:1. HunyuanVideo 1.5 extends the maximum duration to 10 seconds and supports outputs from 480p directly up to 1080p when the super-resolution stage is enabled.[2]

The prompt rewrite system, powered by a fine-tuned Hunyuan-Large model, automatically expands brief user prompts into detailed descriptions.[1] This substantially improves generation quality for casual users who may not write highly detailed prompts. The pipeline accepts both English and Chinese natural language and routes through a normalized intermediate prompt format.

### Image-to-video

HunyuanVideo-I2V, released in March 2025, extends the framework to accept a reference image as input alongside text.[7] The model uses a token replace technique to inject reference image information into the generation process, preserving the visual style, color palette, and character identity of the source image throughout the generated video.[7]

The I2V release also includes LoRA training code for customizable special effects,[7] and launch coverage described lip synchronization with 10 speech styles and five preset dance routine templates.[17] A 480p step-distilled I2V variant released on December 5, 2025 generates clips in 8 or 12 steps and reduces end-to-end generation time by approximately 75 percent, so a single RTX 4090 can complete a clip in around 75 seconds.[4]

In practice, image-to-video has become one of the most common workflows for HunyuanVideo, because creators can first generate a still image with tools such as Flux or HunyuanImage and then use HunyuanVideo-I2V to animate it. The reference image is encoded by the same MLLM-CLIP pipeline as text and threaded into both streams of the diffusion transformer.

### Unified image and video generation

Because the 3D VAE treats images as single-frame videos, HunyuanVideo can generate both still images and videos from the same architecture.[1] This unified approach simplifies the pipeline and allows knowledge transfer between image and video generation tasks during training.

### Multimodal conditioning

With the release of HunyuanCustom in May 2025, the family extended beyond text and a single reference image to accept image, audio, video, and text conditions concurrently.[8] This enables workflows such as inserting a specific person, animating them speaking a recorded audio clip, and constraining the camera trajectory by referencing an existing video, all in a single inference. The same multimodal toolkit underlies many of the editing and dubbing pipelines built on top of HunyuanVideo through 2025 and 2026.

## How does HunyuanVideo perform on benchmarks?

Tencent conducted a professional human evaluation using 1,533 text prompts. Sixty professional evaluators assessed generated videos across three criteria: Text Alignment, Motion Quality, and Visual Quality.[1] To ensure fairness, inference was conducted only once per prompt with no cherry-picking of results.

| Model | Text Alignment | Motion Quality | Visual Quality | Overall |
|---|---|---|---|---|
| HunyuanVideo | 61.8% | 66.5% | 95.7% | 41.3% |
| CNTopA (API) | 62.6% | 61.7% | 95.6% | 37.7% |
| CNTopB (Web) | 60.1% | 62.9% | 97.7% | 37.5% |
| [Runway](https://aiwiki.ai/wiki/runway_ml) Gen-3 Alpha | 47.7% | 54.7% | 97.5% | 27.4% |
| Luma 1.6 | 57.6% | 44.2% | 94.1% | 24.8% |
| CNTopC (Web) | 48.4% | 47.2% | 96.3% | 24.6% |

HunyuanVideo achieved the highest overall score (41.3%) and the best motion quality score (66.5%) among all tested models.[1] "CNTopA", "CNTopB" and "CNTopC" refer to anonymized top-performing Chinese video generation models that were included in the comparison.

Tencent's HunyuanVideo 1.5 report gives its own rating results rather than third-party leaderboard scores. In its text-to-video ratings, the 720p model scored 61.57 on instruction following against 44.07 for Wan 2.2, 50.03 for Kling 2.1 Master, 53.19 for Seedance Pro and 73.77 for Veo 3, and led all five on structural stability (79.75), while trailing the four competitors on aesthetic quality (63.30 versus 65.98 to 68.22).[2]

## How does HunyuanVideo compare with other video models?

The following table compares HunyuanVideo with other notable video generation models released around the same period.

| Feature | HunyuanVideo (1.0) | HunyuanVideo 1.5 | [Sora](https://aiwiki.ai/wiki/sora) (OpenAI) | [Kling](https://aiwiki.ai/wiki/kling) (Kuaishou) | [CogVideoX](https://aiwiki.ai/wiki/zhipu_ai)-5B (Zhipu AI) | Wan 2.2 (Alibaba) |
|---|---|---|---|---|---|---|
| Release Date | December 2024 | November 2025 | December 2024 | June 2024 | August 2024 | July 2025 |
| Parameters | 13B | 8.3B | Undisclosed | Undisclosed | 5B | 27B MoE (14B active) |
| Open Source | Yes (Tencent Hunyuan Community License) | Yes (Tencent Hunyuan Community License) | No | No | Open weights (CogVideoX License) | Yes (Apache 2.0) |
| Architecture | Dual-Stream/Single-Stream DiT | Dual-stream DiT (54 blocks) with SSTA | Diffusion Transformer | Diffusion Transformer (DiT) | Expert Transformer (DiT) | Mixture-of-Experts DiT |
| Max Resolution | 720p (native) | 1080p (with super-resolution) | 1080p | 1080p | 720x480 | 720p |
| Max Duration | ~5 seconds (129 frames at 24 fps) | 5 to 10 seconds | Up to 20 seconds | Up to 2 minutes | Up to 6 seconds | About 5 seconds |
| Text Encoder | MLLM (decoder-only) + CLIP | Qwen2.5-VL MLLM + Glyph-ByT5 | Undisclosed | Undisclosed | T5 with Expert LayerNorm | Bilingual T5-style |
| Image-to-Video | Yes (separate I2V model) | Yes (unified) | Yes | Yes | Yes | Yes |
| Audio-driven Avatar | Yes (HunyuanVideo-Avatar) | Yes (HunyuanVideo-Avatar) | No (unconfirmed) | Partial | No | Yes (Wan2.2-S2V) |
| Consumer GPU Support | Limited (60GB+ VRAM) | Yes (8GB+ with GGUF quantization) | No (cloud only) | No (cloud only) | Yes (8-12GB VRAM) | Partial (24GB+ recommended) |

### HunyuanVideo versus Wan 2.x

Alibaba's Wan family has emerged as the most direct open-source competitor to HunyuanVideo since 2025. Wan 2.2, released in July 2025, uses a Mixture-of-Experts DiT with 27 billion total parameters and 14 billion active during inference, while HunyuanVideo 1.5 pursues efficiency at 8.3 billion. Independent comparisons published through late 2025 and early 2026 highlight a consistent pattern: HunyuanVideo 1.5 leads on instruction following accuracy, motion clarity, and physically grounded effects like fluids and cloth, whereas Wan 2.2 leads on photorealistic aesthetics, especially fine skin texture and hair on human subjects. HunyuanVideo also requires less VRAM (roughly 14 GB minimum versus 24 GB for Wan 2.2 with comparable settings) and generally renders shorter clips faster thanks to SSTA.

### HunyuanVideo versus Open-Sora and Mochi

Open-Sora 2.0, an 11B parameter model released in March 2025 by HPC AI Tech, was benchmarked directly against HunyuanVideo and reported as comparable to it.[16] On VBench, Open-Sora 2.0 narrowed the difference to OpenAI's Sora to under one percentage point and achieved scores broadly comparable to the original 13B HunyuanVideo.[16] Genmo's Mochi 1, another popular open-source contender, is praised for fluid motion but tends to lag HunyuanVideo on temporal coherence beyond five seconds and on text alignment. With the November 2025 release of HunyuanVideo 1.5, third-party leaderboards as of early 2026 generally place HunyuanVideo 1.5 ahead of both Open-Sora 2.0 and Mochi 1 on overall video quality at comparable parameter counts.

## Is HunyuanVideo open source?

HunyuanVideo is released under the Tencent Hunyuan Community License Agreement, dated December 3, 2024.[11] This is not a standard open-source license. Key terms include:

- **Usage rights:** Non-exclusive, non-transferable, royalty-free license to use, reproduce, distribute, and create derivative works.[11]
- **Commercial use:** Free for most commercial applications. However, a licensee whose products or services had more than 100 million monthly active users in the month before the release date must request a separate license, which Tencent may grant at its discretion.[11]
- **Distribution requirements:** Derivative works must include a copy of the license agreement and carry notices about modified files. Tencent encourages (but does not require) users to publish a blog post about their experience and mark products as "Powered by Tencent Hunyuan."[11]
- **Territorial restrictions:** The license does not apply in the European Union, United Kingdom, or South Korea.[11]
- **Governing law:** Hong Kong Special Administrative Region of the People's Republic of China.[11]

Tencent retains intellectual property rights over the original HunyuanVideo works, while users own their derivative works and modifications as long as they comply with the license terms. An Acceptable Use Policy attached to the license lists prohibited uses, including use outside the licensed territory, exploiting or harming minors, generating false information to harm others or influence elections, impersonating individuals without consent, and military use. The license also bars using the models or their outputs to improve any other AI model.[11]

## Community adoption and ecosystem

### ComfyUI integration

[ComfyUI](https://aiwiki.ai/wiki/comfyui), the popular node-based interface for diffusion model workflows, added official native support for HunyuanVideo in December 2024.[13] The integration allows users to build text-to-video and image-to-video workflows using ComfyUI's visual node editor.

Multiple integration pathways exist:

- **Official native nodes** in ComfyUI (no plugins required for basic usage).[13]
- **ComfyUI-HunyuanVideoWrapper** by community developer Kijai, which adds features such as context windowing, direct image embedding through IP2V, and support for the official HunyuanVideo-I2V model and its LoRAs.[12]
- **ComfyUI-GGUF** by community developer city96, enabling quantized model loading for low-VRAM setups.

For HunyuanVideo 1.5, the official README points to ComfyUI's native support and to a community-implemented ComfyUI plugin (comfyui_hunyuanvideo_1.5_plugin) with both simplified and complete node sets, along with built-in automatic model download support.[4] ComfyUI workflows have also become the de facto distribution format for community LoRAs, since users can drop a checkpoint file into a folder and immediately reuse a published workflow.

### LoRA fine-tuning

HunyuanVideo supports [LoRA](https://aiwiki.ai/wiki/fine_tuning) (Low-Rank Adaptation) fine-tuning, allowing users to customize the model for specific styles, characters, or effects without retraining the full model. The original repository did not ship LoRA training code, so early LoRA training relied on community tools; Tencent later released official LoRA training code with HunyuanVideo-I2V in March 2025 and with HunyuanVideo 1.5 on December 5, 2025.[7][4]

Two community-maintained training stacks dominate as of 2026:

- **Musubi Tuner** by kohya-ss, which supports HunyuanVideo, HunyuanVideo-I2V, Wan 2.1 and 2.2, FramePack, FLUX, [Qwen-Image](https://aiwiki.ai/wiki/qwen_image), and other modern architectures. It includes VRAM-saving features such as FP8 weights, block swapping, and cached latents and text-encoder outputs.[14]
- **diffusion-pipe**, which offers a Gradio interface and Docker images for easy deployment on RunPod or Vast.AI, and is popular for users who want to train without writing config files.

Additional tools include finetrainers, OneTrainer, and various community forks. For HunyuanVideo 1.5, Tencent's official training code supports distributed training, Fully Sharded Data Parallel (FSDP), context parallelism and gradient checkpointing, and Tencent recommends the Muon optimizer for continued training or LoRA fine-tuning.[4]

Practical recipes published on Civitai and YouTube converge on a common pattern: 10 to 50 short clips of three to five seconds at 720p, paired with dense captions in a sidecar text file, trained for around 4,000 steps. A character LoRA typically requires 20 to 30 reference clips covering varied angles, lighting, and expressions, and finishes in 6 to 12 hours on a single RTX 4090.

On platforms like Civitai, a growing library of community-created LoRA adapters is available for HunyuanVideo, covering character styles, animation effects, camera movements, fictional intellectual properties, and style transfers such as Studio Ghibli aesthetics or specific cinematographers' looks.

### Prompt engineering

Because HunyuanVideo's MLLM text encoder can handle long, detailed prompts, community guides recommend writing dense descriptions with explicit subject, action, environment, camera, and lighting clauses. For LoRA-conditioned generation, the LoRA trigger word should be written directly into the caption as a short phrase rather than a single token. Recommended sampler settings include 25 to 30 inference steps for smooth motion, a flow shift around 0.5 to 1.0 for dialogue-heavy scenes with little motion, and embedded guidance scales of 10 to 12 when strict prompt adherence is required. Multiple LoRAs can be chained by stacking nodes in ComfyUI, with strengths typically set between 0.5 and 1.2.

### Hugging Face Diffusers

HunyuanVideo is integrated into the Hugging Face Diffusers library, making it accessible through a standard Python API.[5] This integration simplifies model loading, inference, and pipeline customization for developers already familiar with the Diffusers ecosystem. Both the 13B 1.0 model and the 8.3B 1.5 model expose Diffusers pipelines, and the HunyuanCustom and HunyuanVideo-Avatar variants are gradually being integrated as well.

### Memory and speed optimization

The community has developed several approaches to reduce VRAM requirements and inference latency:

- **FP8 quantization** (E4M3 format) saves approximately 10 GB of GPU memory compared to full precision.
- **GGUF quantization** (Q8, Q6, Q4 variants) enables running on GPUs with 8 GB or less of VRAM.
- **Temporal tiling** in the VAE decoder processes video frames in chunks rather than all at once, eliminating memory spikes.
- **FastHunyuan** with NF4 quantization allows inference on a single RTX 4090 with roughly 20 GB of VRAM.
- **Cache inference** methods (DeepCache, TeaCache, TaylorCache) were added in November 2025 for HunyuanVideo 1.5, providing further speedups.[4] For the original HunyuanVideo, TeaCache reported a 2.1x speedup at a threshold of 0.15 without much visible quality loss.[15]
- **MagCache** offers a training-free caching scheme that estimates timestep-wise output drift and reports a 1.7x speedup for HunyuanVideo 1.5 at 20 inference steps.[4]
- **Step distillation** reduces the sampling schedule from 50 steps to 8 or 12 steps for the 480p image-to-video model.[4]

In combination, these techniques have brought HunyuanVideo from a model that initially required an 80 GB H100 to a system that can produce 5-second 720p clips on a hobbyist RTX 4090 in under two minutes, and on a high-end RTX 5090 in well under a minute as of early 2026.

## Extended models

Tencent has built several specialized models on top of the HunyuanVideo foundation. Together they form a layered ecosystem in which the same diffusion transformer backbone and 3D causal VAE are adapted to new conditioning modalities by adding lightweight injection modules.

### HunyuanVideo-I2V

HunyuanVideo-I2V is the dedicated image-to-video variant of the foundation model. It uses a token replace technique in which a portion of the input latent sequence is overwritten with tokens derived from the reference image, anchoring the first frames of the generated clip to the input.[7] The MLLM text encoder receives both the user prompt and a visual description of the reference image to align style and content. Minimum GPU memory is 60 GB at full precision for 720p output, with 80 GB recommended for best quality, although community FP8 and GGUF variants substantially lower these requirements.[7]

### HunyuanCustom

Released on May 9, 2025, HunyuanCustom extends the video generation framework with multi-modal conditioning.[8] It accepts image, audio, video, and text inputs simultaneously, with an emphasis on subject consistency across generated frames.[8] The model uses a text-image fusion module based on LLaVA and an image ID enhancement module that reinforces identity features across frames through temporal concatenation.[8]

For audio and video conditioning, HunyuanCustom introduces:

- **AudioNet**, which performs hierarchical alignment between audio features and the video latent stream via spatial cross-attention so that the generated video responds to the rhythm and emphasis of speech or music.[8]
- A **video-driven injection module** that integrates compressed conditional video through a patchify-based feature-alignment network, enabling object replacement workflows in which a person or product in an existing clip is replaced with a new identity.[8]

Tencent reports that HunyuanCustom outperforms VACE, Skyreels, Pika, Vidu, Keling, and Hailuo on subject consistency, text-video alignment, and overall video quality in head-to-head subject-driven generation tests.[8]

### HunyuanVideo-Avatar

Released on May 28, 2025, HunyuanVideo-Avatar is an audio-driven human animation model jointly developed by Tencent Hunyuan and Tencent Music.[9] Given a single character image and an audio clip, it generates video of the character speaking or singing with lip synchronization, emotional expression, and full-body motion.[9] Key components include:

- A **character image injection module** that replaces the conventional addition-based character conditioning scheme, eliminating the mismatch between training and inference.[9]
- An **Audio Emotion Module (AEM)** that extracts emotional cues from a reference image and transfers them to the generated video.[9]
- A **Face-Aware Audio Adapter (FAA)** that isolates the audio-driven character with a latent-level face mask and uses cross-attention for multi-character dialogue.[9]

The model supports photorealistic, cartoon, 3D-rendered, and anthropomorphic character styles, and has been deployed inside multiple Tencent Music applications for short-form video, virtual host, and avatar singing use cases.[9]

### HunyuanVideo-Foley

HunyuanVideo-Foley, released in August 2025 and updated with the XL variant on September 29, 2025, is an end-to-end Text-Video-to-Audio (TV2A) model that automatically generates sound effects synchronized to existing video.[10] It analyses the visual content of the input video, identifies actions and environments, and produces contextually appropriate Foley sound effects, ambience, and incidental music. The architecture is a hybrid diffusion transformer with multimodal (visual-audio) and unimodal (audio) blocks, paired with a self-developed 48 kHz audio VAE that can faithfully reconstruct sound effects, music, and vocals.[10]

Tencent reports best-in-class scores across audio quality, synchronization, and semantic alignment metrics in its internal evaluation.[10] In creator workflows, HunyuanVideo-Foley is commonly chained after HunyuanVideo or HunyuanVideo-Avatar to produce a fully voiced and dubbed clip from text plus a still image.

### HunyuanVideo 1.5 lineup

Beyond the base T2V checkpoint, the HunyuanVideo 1.5 release ships several model files:[4]

- **HunyuanVideo-1.5 T2V** (8.3B), the foundation text-to-video model.
- **HunyuanVideo-1.5 I2V** (8.3B), the image-to-video sibling.
- **CFG-distilled and sparse-attention variants** of the T2V and I2V checkpoints, plus a **480p I2V step-distilled** model for 8 or 12-step inference.
- **HunyuanVideo-1.5 Super-Resolution** (8.3B), released as 720p and 1080p step-distilled models that upscale base outputs.

This modular packaging mirrors the structure used by the broader Hunyuan foundation suite and gives community deployments fine control over the tradeoff between quality, speed, and resolution.

## What is HunyuanVideo used for?

HunyuanVideo and its derivatives are used across a wide range of practical applications:

- **Short-form video creation** for social platforms, where text-to-video and image-to-video pipelines convert script ideas or storyboard frames into 5 to 10 second clips.
- **E-commerce and product marketing**, where HunyuanCustom and HunyuanVideo-Avatar generate product demos and virtual hosts from a few reference images and audio recordings.
- **Advertising and creative pre-visualization** for previewing concepts before live action shoots.
- **Game and animation prototyping**, where Studio Ghibli-style and anime LoRAs help build mood reels and concept clips without keyframing.
- **Educational content** that combines HunyuanVideo for visuals with HunyuanVideo-Foley for ambient sound and a downstream TTS narrator.
- **Research**, since the open weights, training scripts, and detailed technical reports make HunyuanVideo a standard reference baseline for academic work on long-sequence diffusion, video latent codecs, and motion modeling.

The combination of open weights, a mature ComfyUI ecosystem, and consumer-grade hardware support has made HunyuanVideo a popular default in indie filmmaking and YouTube channels focused on AI-assisted content production.

## What are the limitations of HunyuanVideo?

Like all current video generation models, HunyuanVideo has several known limitations:

- **Duration constraints:** The base model generates approximately 5 seconds of video (129 frames). While HunyuanVideo 1.5 extends this to 10 seconds, it still falls short of the longer durations offered by some commercial models such as Kling, which can produce two-minute clips.
- **Physics simulation:** Generated videos may contain physically implausible motions, particularly for complex interactions between objects, fast camera moves combined with deformable objects, and contact-rich actions such as cooking or fine tool use.
- **Text rendering:** The original model sometimes struggles to render legible text within generated video frames. HunyuanVideo 1.5's glyph-aware encoding improves bilingual signage and short captions, but long passages of text remain unreliable.
- **Compute requirements:** The original 13B model requires 60 GB or more of GPU memory at full precision, limiting accessibility. HunyuanVideo 1.5 and community quantization efforts have partially addressed this, but high-end consumer GPUs are still needed for the best quality.
- **Territorial license restrictions:** The license excludes the EU, UK, and South Korea, limiting legal use in those regions and prompting some commercial platforms to gate access geographically.
- **Identity drift:** Long clips can suffer from gradual identity drift in characters. Subject-consistent generation models such as HunyuanCustom mitigate this but at the cost of more complex inference pipelines.
- **Audio integration:** The base T2V and I2V models do not generate audio. HunyuanVideo-Foley fills this gap but adds an additional model and step to the pipeline.

## See also

- [Step-Video](https://aiwiki.ai/wiki/step_video)

## References

1. Kong, W., Tian, Q., et al. "HunyuanVideo: A Systematic Framework For Large Video Generative Models." arXiv:2412.03603, December 2024. https://arxiv.org/abs/2412.03603
2. Tencent Hunyuan Foundation Model Team. "HunyuanVideo 1.5 Technical Report." arXiv:2511.18870, November 2025. https://arxiv.org/abs/2511.18870
3. Tencent-Hunyuan. "HunyuanVideo GitHub Repository." https://github.com/Tencent-Hunyuan/HunyuanVideo
4. Tencent-Hunyuan. "HunyuanVideo-1.5 GitHub Repository." https://github.com/Tencent-Hunyuan/HunyuanVideo-1.5
5. Tencent. "HunyuanVideo on Hugging Face." https://huggingface.co/tencent/HunyuanVideo
6. Tencent. "HunyuanVideo-1.5 on Hugging Face." https://huggingface.co/tencent/HunyuanVideo-1.5
7. Tencent-Hunyuan. "HunyuanVideo-I2V GitHub Repository." https://github.com/Tencent-Hunyuan/HunyuanVideo-I2V
8. Hu, T., et al. "HunyuanCustom: A Multimodal-Driven Architecture for Customized Video Generation." arXiv:2505.04512, May 2025. https://arxiv.org/abs/2505.04512
9. Tencent-Hunyuan. "HunyuanVideo-Avatar GitHub Repository." https://github.com/Tencent-Hunyuan/HunyuanVideo-Avatar
10. Tencent-Hunyuan. "HunyuanVideo-Foley GitHub Repository." https://github.com/Tencent-Hunyuan/HunyuanVideo-Foley
11. Tencent Hunyuan Community License Agreement. https://github.com/Tencent-Hunyuan/HunyuanVideo/blob/main/LICENSE.txt
12. Kijai. "ComfyUI-HunyuanVideoWrapper." https://github.com/kijai/ComfyUI-HunyuanVideoWrapper
13. ComfyUI Documentation. "Hunyuan Video Examples." https://docs.comfy.org/tutorials/video/hunyuan-video
14. kohya-ss. "Musubi Tuner." https://github.com/kohya-ss/musubi-tuner
15. ali-vilab. "TeaCache: Timestep Embedding Tells: It's Time to Cache for Video Diffusion Models." https://github.com/ali-vilab/TeaCache
16. HPC AI Tech. "Open-Sora 2.0: Training a Commercial-Level Video Generation Model in $200k." arXiv:2503.09642, March 2025. https://arxiv.org/abs/2503.09642
17. ComfyUI Wiki. "Tencent Hunyuan Launches Open-Source Video Generation Model" (HunyuanVideo-I2V launch), March 6, 2025. https://comfyui-wiki.com/en/news/2025-03-06-hunyuanvideo-i2v-launch

