DeepSeek V3
DeepSeek-V3 is a 671-billion-parameter open-weights Mixture of Experts large language model from Chinese AI lab DeepSeek, released on December 26, 2024, that activates only 37 billion parameters per token and…
Mixture of Experts
Explore Mixture of Experts through related topics and the articles other pages reference most.
Explore articles
Browse subtopics: Chinese AI
Articles that also belong to these categories. Counts cover all of Mixture of Experts.
All articles (53)Large Language Models (46)Open Source AI (40)AI Models (35)Chinese AI (28)Multimodal AI (8)AI Companies (7)AI Infrastructure (3)Transformer Models (3)Diffusion Models (2)Meta AI (2)Model Architecture (2)NVIDIA (2)Reasoning Models (2)AI Agents (1)AI Code Generation (1)AI Inference (1)Generative AI (1)Google (1)Google DeepMind (1)Healthcare AI (1)Natural Language Processing (1)OpenAI (1)Research Organizations (1)Training & Optimization (1)Video Generation (1)
Showing 1-28 of 28 articles
DeepSeek V3.1
DeepSeek V3.1 is a large language model developed by DeepSeek, released on August 19, 2025 and made broadly available via the official API on August 21, 2025.
DeepSeek V4
DeepSeek V4 is a family of open-weight Mixture of Experts large language models developed by DeepSeek, a Hangzhou-based AI research lab.
DeepSeek V4-Pro
DeepSeek V4-Pro is the flagship model of the DeepSeek V4 family: a Mixture of Experts large language model with 1.6 trillion total parameters, 49 billion of them activated per token, and a one-million-token…
DeepSeek V4.1-Flash
DeepSeek V4.1-Flash is an open-weight multimodal mixture-of-experts model released by DeepSeek on September 10, 2026. It accepts text and images and generates text.
DeepSeek-V2
DeepSeek-V2 is a 236-billion-parameter mixture-of-experts (MoE) large language model released in May 2024 by DeepSeek, the Chinese AI lab spun out of the quantitative hedge fund High-Flyer and led by Liang…
DeepSeek-VL2
DeepSeek-VL2 is an open-weights family of Mixture-of-Experts (MoE) vision-language models released by the Chinese AI laboratory DeepSeek on December 13, 2024.
GLM-4.5
GLM-4.5 is an open-weights large language model released by Zhipu AI (operating internationally as Z.ai) on July 28, 2025, built on a 355-billion-parameter Mixture of Experts architecture that activates 32…
GLM-4.6
GLM-4.6 is a flagship open-weight large language model released by Zhipu AI under its international brand Z.ai on September 30, 2025, built on a sparse Mixture of Experts (MoE) architecture with roughly 357…
GLM-5
GLM-5 is an open-weight flagship large language model released by the Chinese AI company Zhipu AI, under its international brand Z.ai, on February 11, 2026.
GLM-5.3-Flash
GLM-5.3-Flash is an open-weight, natively multimodal mixture-of-experts large language model released by Z.ai on August 26, 2026.
Hunyuan
Hunyuan is Tencent's brand for its foundation models, an umbrella covering large language models, video generation, image synthesis, 3D asset creation, and multimodal reasoning.
Hunyuan-A13B
Hunyuan-A13B is an open-weight mixture-of-experts large language model released by Tencent in late June 2025.
Hy4 Preview
Hy4 Preview is an open-weight large language model released by the Tencent Hy Team on August 28, 2026.
Kimi K2
Kimi K2 is an open-weights Mixture of Experts language model from Moonshot AI, a Beijing startup, released on July 11, 2025 with 1.04 trillion total parameters and 32.6 billion activated per token
Kimi K2.5
Kimi K2.5 is an open-weights, natively multimodal large language model developed by Moonshot AI and released on January 27, 2026 .
Kimi K3
Kimi K3 is an open-weight multimodal reasoning model developed by Moonshot AI. Moonshot made the model available through its hosted products on July 16, 2026 and published the weights, code, configuration…
Ling-1T
Ling-1T is a trillion-parameter open-weight language model released by Ant Group through its Inclusion AI research group on October 9, 2025.
Ling-3.0-flash
Ling-3.0-flash is an open-weight mixture-of-experts language model from inclusionAI, the open-source AI initiative of Ant Group, and the first model of the Ling 3.0 generation.
Ling-3.0-flash-Sante
Ling-3.0-flash-Sante is a health and medicine variant of Ling-3.0-flash, the 124-billion-parameter mixture-of-experts language model from inclusionAI, the open-source AI initiative of Ant Group.
MiniMax M2
MiniMax M2 is an open-weight large language model released on October 27, 2025 by the Shanghai-based AI company MiniMax, built as a Mixture of Experts model with 230 billion total parameters and roughly 10…
MiniMax-Text-01
MiniMax-Text-01 is an open-weights, large-scale mixture-of-experts (MoE) language model released by Shanghai-based AI company MiniMax on January 14, 2025.
MoonEP
MoonEP is an open-source expert-parallel communication library for mixture-of-experts models, released by Moonshot AI on July 27, 2026 under the MIT License.
Qwen3
Qwen3 is the third-generation family of large language models developed by the Qwen Team at Alibaba Cloud (also known as Tongyi Qianwen lab).
Qwen3-Max
Qwen3-Max is the flagship large language model in Alibaba's Qwen series and the first Qwen model to cross one trillion parameters, released in preview on September 5, 2025 and formally launched at the Apsara…
Qwen3.8-Flash-Next
Qwen3.8-Flash-Next is an experimental open-weight multimodal large language model released by Alibaba Group's Qwen team on August 26, 2026.
Tencent Hunyuan Hy3
Tencent Hunyuan Hy3 (marketed internationally as Tencent Hy3) is an open-weights large language model published by Tencent.
Yi-Lightning
Yi-Lightning is a closed-source large language model developed by Chinese artificial intelligence company 01.AI (零一万物, Língyī Wànwù), the company founded by Kai-Fu Lee.