Wan 2.1-VACE

Wan 2.1-VACE (also written Wan2.1-VACE) is an open-weights video creation and editing model released by Alibaba's Tongyi Lab on May 14, 2025 ^[1][4]. The name VACE stands for Video All-in-One Creation and Editing, and the model is positioned as the first open-source system to combine multiple video generation and editing tasks within a single unified framework ^[1][9]. It builds on the Wan 2.1 base video generation model, adding a multimodal conditioning interface that handles text, image, video, and mask inputs together ^[3].

The release ships in two parameter sizes, 1.3 billion and 14 billion, both available for free download on Hugging Face, GitHub, and Alibaba's ModelScope platform under the Apache 2.0 license ^[4][5]. The 1.3B variant targets consumer hardware and runs at 480P, while the 14B variant supports both 480P and 720P ^[4]. VACE supports reference-to-video generation, video-to-video editing, masked video-to-video editing, character animation, video inpainting, outpainting, pose transfer, depth control, and spatio-temporal extension, all from one model rather than a stack of single-task tools ^[3][6]. Its model card describes it simply as "an all-in-one model for video creation and editing" ^[4].

The accompanying research paper, VACE: All-in-One Video Creation and Editing, was first published to arXiv on March 10, 2025 and accepted to ICCV 2025 ^[3][17]. The model's release sat between the original Wan 2.1 launch in February 2025 and Alibaba's later open-weights Wan 2.2 upgrade in late July 2025, with the API-first Wan 2.5 preview arriving in September 2025, the Wan 2.6 series in December 2025, and Wan2.7-Video in April 2026 ^{[15][12][13][19]}.

Background

Alibaba's video model program runs out of the Tongyi Lab inside Alibaba Cloud, where it sits alongside the broader Tongyi family of foundation models. The team had been building toward open-source video generation for several years before VACE, with early Wanxiang text-to-image work feeding into the first Wan video releases. When Wan 2.1 launched on February 25, 2025, it topped the VBench leaderboard with an overall score of 84.7 percent ^[14][18] and accumulated more than 2.2 million downloads across Hugging Face and ModelScope within days ^[20]. It was the only open-source system in the VBench top five at the time, which is what drove the early attention ^[18].

That first Wan 2.1 release already covered text-to-video, image-to-video, and first-and-last-frame video generation in separate model checkpoints. The gap it left, and the gap VACE was designed to fill, was video editing. Most open-source video pipelines in early 2025 still required separate expert models for tasks like inpainting, outpainting, or pose-driven animation. Users had to chain these together with their own glue code, often losing temporal consistency between stages. VACE was the team's answer to that fragmentation.

The broader context here is the open-source video race that picked up speed across 2024 and 2025. Tencent's HunyuanVideo, Genmo's Mochi, and Lightricks' LTX-Video had all shown that open weights could approach the visual quality of closed systems, but none of them had bundled creation and editing into one model. VACE was Alibaba's attempt to leapfrog that fragmentation rather than chase a marginal quality improvement on text-to-video alone.

Architecture

VACE is built on top of the Wan 2.1 Diffusion Transformer (DiT) backbone, which uses Flow Matching as its generative framework ^[3]. The base architecture for the 14B variant has 40 layers, 40 attention heads, a hidden dimension of 5120, and a T5 text encoder for multilingual conditioning ^[4]. The 1.3B variant uses 30 layers, 12 heads, and a hidden dimension of 1536 ^[5]. Both share the Wan-VAE, a 3D causal variational autoencoder that can encode and decode 1080P video of arbitrary length while preserving temporal information ^[7][14].

The VACE-specific contribution sits on top of this backbone in two pieces.

Video Condition Unit

The Video Condition Unit, or VCU, is a unified input interface ^[3]. Rather than defining a separate input format for each task, the team treated text, reference images, source videos, masks, and control signals as different fields of a common multimodal record. A request to inpaint a region of a video and a request to generate a video from a single reference image both flatten into the same VCU representation, just with different fields populated.

This design lets a single trained model serve every supported task without architectural switching. It also makes task combinations possible at inference time. A user can supply a reference image, a source video, and a mask in the same call, and the model treats this as a combined reference-and-edit instruction rather than two separate operations.

Context Adapter

The second piece is the Context Adapter, a structure that injects task-specific concepts into the DiT backbone using formalized representations of temporal and spatial dimensions ^[3]. During training, the team froze the base Wan 2.1 weights and only trained the adapter layers. According to coverage of the technical report, this approach converged faster than full fine-tuning and reduced the risk of degrading the base model's generation quality while adding editing capabilities.

The paper's abstract states that "the unified model of VACE achieves performance on par with task-specific models across various subtasks," a result the authors back with a VACE-Benchmark of 480 evaluation samples spanning 12 tasks ^[3]. The authors of the VACE paper are Zeyinzi Jiang, Zhen Han, Chaojie Mao, Jingfeng Zhang, Yulin Pan, and Yu Liu, all from Alibaba's Tongyi Lab ^[3][17].

What can Wan 2.1-VACE do?

VACE consolidates a range of video generation and editing tasks behind one API ^[3][4]. The HuggingFace model card and the GitHub repository group these into three primary categories: Reference-to-Video (R2V), Video-to-Video (V2V), and Masked Video-to-Video (MV2V) ^[4][6]. In community marketing materials, these get rebranded as the "Anything" family of operations.

Scroll sideways for more →

The community-facing names for these operations include Move-Anything (motion transfer), Swap-Anything (subject replacement), Reference-Anything (R2V from arbitrary references), Expand-Anything (spatial and temporal outpainting), and Animate-Anything (driving a reference character with a control signal) ^[8]. These map to combinations of VCU fields rather than separate models.

A notable detail in the model card is that Wan 2.1 was the first video foundation model capable of rendering both Chinese and English text inside generated frames, a capability VACE inherits ^[4][20]. Earlier open-source video systems either could not produce legible in-frame text at all or were limited to Latin scripts.

What model sizes and weights are available?

VACE shipped in two parameter sizes at launch, with an earlier preview release of the smaller variant available from March 2025 ^[4][5].

Scroll sideways for more →

The 1.3B model is designed to fit on consumer GPUs. According to the model card, the underlying Wan 2.1 1.3B text-to-video model needs about 8.19 GB of VRAM and can generate a 5-second 480P clip in roughly 4 minutes on a single RTX 4090 without further optimization ^[7]. The 14B model is heavier and is the recommended choice for 720P output, where the 1.3B model becomes unstable ^[4]. At 480P the checkpoints target the standard 81x480x832 grid, and at 720P the 14B model runs at 81x720x1280 ^[4].

The LTX-Video variant is a separate community-contributed checkpoint that ports the VACE framework onto Lightricks' LTX-Video base, not an Alibaba release. It uses the RAIL-M license inherited from its base model rather than Apache 2.0.

Weights for both Alibaba checkpoints are mirrored across Hugging Face under the Wan-AI organization, on the official Wan-Video/Wan2.1 GitHub repository, and on ModelScope ^[4][7]. Quantized GGUF variants in FP8 and lower precisions appeared within weeks of the initial release through community packagers, including the Comfy-Org repackaged build for ComfyUI users and QuantStack's GGUF conversions.

Open-source ecosystem

The VACE codebase landed on GitHub under the ali-vilab/VACE repository on March 31, 2025, ahead of the Wan-branded model weights ^[6]. Native ComfyUI support arrived shortly after the May 14 weight release, with workflow templates contributed by community members including Datou, T8star-Aix, and Kijai ^[8]. Kijai in particular published the VACE node system that became the basis for most third-party workflows.

Integrations followed quickly across the rest of the open-source video stack.

Scroll sideways for more →

The permissive Apache 2.0 license on the official weights, the unified VCU interface, and the early ComfyUI port together made VACE the default open-source video editing model for many independent creators through mid-2025 ^[8]. Quantized FP16 and FP8 checkpoints under 30 GB enabled local use on a single 24 GB consumer card for the 14B model at 480P, which had previously required cloud compute for comparable quality.

The original Wan 2.1 base model had already cleared 2.2 million downloads in its first 48 hours, and the broader Wan 2.1 series passed 3.3 million downloads by the time VACE was announced, according to Alibaba Cloud's announcement of the release ^[2][20].

What is the difference between Wan 2.1-VACE and Wan 2.2?

Wan 2.2, released as open weights in late July 2025, is the successor generation to the Wan 2.1 base that VACE was built on ^[15]. Alibaba described the launch as "the industry's first open-source MoE large video generation models," referring to a Mixture-of-Experts design that splits denoising between a high-noise expert responsible for overall scene layout and a low-noise expert that refines details and textures ^[15]. The two A14B checkpoints carry 27 billion total parameters but activate only 14 billion per step, which the team says cuts computation by roughly half while raising quality ^[15].

Wan 2.2 shipped in three variants: Wan2.2-T2V-A14B for text-to-video, Wan2.2-I2V-A14B for image-to-video, and a compact Wan2.2-TI2V-5B that generates a 5-second 720P clip on a single consumer-grade GPU ^[15]. Alibaba trained the new generation on 65.6 percent more images and 83.2 percent more video than Wan 2.1, and released all three under Apache 2.0 on Hugging Face, GitHub, and ModelScope ^[15].

The core Tongyi team did not ship an all-in-one editing checkpoint for Wan 2.2 the way it did for Wan 2.1. Instead, the VACE framework carried forward through Alibaba's PAI group, which released Wan2.2-VACE-Fun-A14B as part of its VideoX-Fun project ^[16]. That checkpoint applies the VACE conditioning scheme to the Wan 2.2 MoE base, supporting reference images, masks, and control signals such as Canny edges, depth, pose, and MLSD, along with trajectory control and subject-driven generation, under the same Apache 2.0 license ^[16]. For users who wanted the unified edit-and-generate workflow on the newer base model, Wan2.2-VACE-Fun became the bridge between the original Wan 2.1-VACE and the MoE generation, keeping the VACE line openly downloadable even as the flagship models moved toward API-only distribution.

How does Wan 2.1-VACE compare to other video models?

VACE sits in a crowded field of mid-2025 video models. The comparison below covers what each system actually shipped at the time, drawn from public model cards and announcements.

Scroll sideways for more →

Against the closed commercial systems, VACE trades raw visual fidelity for openness and editing flexibility. Veo 3 and Sora 2 both ship native audio synthesis and reach higher resolutions, but neither exposes the model weights and neither offers VACE's combination of inpainting, outpainting, and reference-driven editing inside one prompt. Against the other open-weights releases of the period, the unified editing interface is the differentiating feature: HunyuanVideo at launch was text-to-video only, and Mochi 1 did not bundle editing.

The comparison shifts again with Wan 2.5, which Alibaba previewed on September 23, 2025 ^[12]. Wan 2.5 added native multimodal generation across text, image, video, and audio in a single architecture, and pushed output to 1080P with synchronized audio and lip-sync in clips up to 10 seconds ^[12]. Wan 2.5 closed the audio gap with Sora 2 and Veo 3 but launched as a preview through the Alibaba Cloud Model Studio API rather than as an immediate open-weights release. VACE remained the openly downloadable workhorse for users who needed weights they could run locally.

The Wan 2.6 series, unveiled on December 16, 2025, extended clip length to 15 seconds and introduced multi-shot storytelling and reference-to-video with both appearance and voice preservation ^[13]. Alibaba continued the line into 2026 with Wan2.7-Video, launched on April 7, 2026, which the company framed as a way to "elevate creators from executors to directors" through natural-language instruction editing that can change a video's characters, dialogue, appearance, scenes, and styles from a single prompt ^[19]. Wan 2.6 and Wan 2.7 both run through Model Studio and the Qwen App rather than as a direct weight release at launch, which left Wan 2.1-VACE and the community Wan2.2-VACE-Fun checkpoint as the openly downloadable editing anchors of the series while the later versions handled the proprietary-feature frontier ^[16][19].

How was Wan 2.1-VACE received?

The announcement on Alizila, Alibaba's English-language news site, framed VACE as the first open-source unified video editing model and emphasized the consolidation of tasks that had previously required separate experts ^[1]. Independent coverage from outlets like AIBase, Artificial Intelligence News, and DeepNewz echoed the unified-model framing and highlighted the dual 1.3B and 14B sizing as evidence of a deliberate consumer-grade and prosumer-grade split ^[9][10][11].

In the practitioner community, the reception was driven less by leaderboard numbers and more by the ComfyUI workflows that landed within days of release. The Wan2.1-VACE Native Support announcement on the ComfyUI blog described the model as significantly improving the efficiency and quality of video creation, with workflow examples for the Move-Anything, Swap-Anything, Reference-Anything, Expand-Anything, and Animate-Anything operations ^[8]. RunComfy and similar workflow distribution sites started shipping VACE templates almost immediately.

The ICCV 2025 acceptance of the underlying paper gave the work an academic anchor beyond the model release, and it was presented as a poster at the conference ^[17]. The paper's claim that a unified model can match task-specific models across multiple subtasks was the part most often cited in subsequent video-model papers through late 2025 ^[3].

A practical limitation noted in community discussion was the 81-frame budget at the supported resolutions, which translates to roughly 5 seconds of video at 16 fps ^[4]. Longer outputs required chaining generations with VACE's spatio-temporal extension capability, which works but is slower than a single forward pass. The arrival of Wan 2.5, Wan 2.6, and Wan 2.7 with their 10-second and 15-second clip lengths later addressed this directly, although those releases did not initially ship open weights ^[12][13][19].

A second limitation flagged in the model card itself is text-to-video stability at 720P on the 1.3B variant, which the card explicitly does not recommend ^[4]. Users running on consumer hardware were therefore funneled toward 480P unless they had GPU memory and patience for the 14B variant.

See also

• Wan 2.1
• Wan 2.2
• Wan 2.5
• Alibaba
• Tongyi
• HunyuanVideo
• Sora 2
• Veo 3
• Seedance
• ComfyUI

References

1. Alibaba Group. "Alibaba Unveils Wan2.1-VACE: Groundbreaking Open-Source AI Model for Video Creation and Editing." Alizila, May 15, 2025. https://www.alizila.com/alibaba-unveils-wan2-1-vace-groundbreaking-open-source-ai-model-for-video-creation-and-editing/ ↩
2. Alibaba Cloud. "Alibaba Introduces Open-Source Model for Video Creation and Editing." Alibaba Cloud Community, May 2025. https://www.alibabacloud.com/blog/alibaba-introduces-open-source-model-for-video-creation-and-editing_602226 ↩
3. Jiang, Zeyinzi; Han, Zhen; Mao, Chaojie; Zhang, Jingfeng; Pan, Yulin; Liu, Yu. "VACE: All-in-One Video Creation and Editing." arXiv preprint arXiv:2503.07598, March 10, 2025. https://arxiv.org/abs/2503.07598 ↩
4. Wan-AI. "Wan2.1-VACE-14B model card." Hugging Face, May 2025. https://huggingface.co/Wan-AI/Wan2.1-VACE-14B ↩
5. Wan-AI. "Wan2.1-VACE-1.3B model card." Hugging Face, May 2025. https://huggingface.co/Wan-AI/Wan2.1-VACE-1.3B ↩
6. ali-vilab. "VACE: All-in-One Video Creation and Editing (official implementation)." GitHub, 2025. https://github.com/ali-vilab/VACE ↩
7. Wan-Video. "Wan2.1 official repository." GitHub, 2025. https://github.com/Wan-Video/Wan2.1 ↩
8. ComfyUI. "Wan2.1-VACE Native Support and Ace-Step Workflow Refined." ComfyUI Blog, May 2025. https://blog.comfy.org/p/wan21-vace-native-support-and-ace ↩
9. AIBase. "Alibaba Qianwen Wan2.1-VACE Open Source Claims to Be the First Open-source Unified Video Editing Model." AIBase, May 2025. https://www.aibase.com/news/18059 ↩
10. Artificial Intelligence News. "Alibaba Wan2.1-VACE: Open-source AI video tool for all." May 2025. https://www.artificialintelligence-news.com/news/alibaba-wan2-1-vace-open-source-ai-video-tool-for-all/ ↩
11. DeepNewz. "Alibaba Launches Wan2.1-VACE Open-Source Video Generation Suite With 1.3B and 14B Models." May 2025. https://deepnewz.com/ai-modeling/alibaba-launches-wan2-1-vace-open-source-video-generation-suite-1-3b-14b-models-321dc439 ↩
12. The Decoder. "Alibaba's Wan2.5-Preview lets users turn photos and text prompts into videos with matching audio." September 2025. https://the-decoder.com/alibabas-wan2-5-preview-lets-users-turn-photos-and-text-prompts-into-videos-with-matching-audio/ ↩
13. Alibaba Cloud. "Alibaba Unveils Wan2.6 Series Enabling Everyone to Star in Videos." December 16, 2025. https://www.alibabacloud.com/en/press-room/alibaba-unveils-wan2-6-series-enabling-everyone ↩
14. Wang, Ang; Ai, Baole; Wen, Bin; et al. "Wan: Open and Advanced Large-Scale Video Generative Models." arXiv preprint arXiv:2503.20314, 2025. https://arxiv.org/abs/2503.20314 ↩
15. Alibaba Cloud. "Alibaba Releases Wan2.2 to Uplift Cinematic Video Production." Alibaba Cloud Community, July 2025. https://www.alibabacloud.com/blog/alibaba-releases-wan2-2-to-uplift-cinematic-video-production_602413 ↩
16. Alibaba PAI. "Wan2.2-VACE-Fun-A14B model card." Hugging Face, 2025. https://huggingface.co/alibaba-pai/Wan2.2-VACE-Fun-A14B ↩
17. Jiang, Zeyinzi; et al. "VACE: All-in-One Video Creation and Editing (ICCV 2025 poster)." IEEE/CVF International Conference on Computer Vision, 2025. https://iccv.thecvf.com/virtual/2025/poster/1005 ↩
18. Vchitect. "VBench Leaderboard." Hugging Face Spaces, 2025. https://huggingface.co/spaces/Vchitect/VBench_Leaderboard ↩
19. Alibaba Cloud. "Alibaba Unveils Wan2.7-Video to Elevate Creators from Executors to Directors." Alibaba Cloud Community, April 7, 2026. https://www.alibabacloud.com/blog/alibaba-unveils-wan2-7-video-to-elevate-creators-from-executors-to-directors_603009 ↩
20. Alibaba Group. "Alibaba Unveils its Latest Open-Source Video Generation Model." Alizila, 2025. https://www.alizila.com/alibaba-unveils-its-latest-open-source-video-generation-model/ ↩