Mixture of Experts

Explore Mixture of Experts through related topics and the articles other pages reference most.

53 articlesSearch and filter Follow updates by RSS

Explore articles

Browse subtopics: Open Source AI

Articles that also belong to these categories. Counts cover all of Mixture of Experts.

Showing 1-40 of 40 articles

DBRX

DBRX is an open-weight mixture of experts large language model developed by Databricks and its Mosaic AI research team, released on March 27, 2024.

AI Companies Large Language Models

DeepEP

DeepEP is an open-source GPU communication library built by DeepSeek for Mixture-of-Experts (MoE) models.

AI Infrastructure Open Source AI

DeepSeek-V3 is a 671-billion-parameter open-weights Mixture of Experts large language model from Chinese AI lab DeepSeek, released on December 26, 2024, that activates only 37 billion parameters per token and…

AI Models Chinese AI

DeepSeek V3.1

DeepSeek V3.1 is a large language model developed by DeepSeek, released on August 19, 2025 and made broadly available via the official API on August 21, 2025.

AI Models Chinese AI

DeepSeek V4

DeepSeek V4 is a family of open-weight Mixture of Experts large language models developed by DeepSeek, a Hangzhou-based AI research lab.

AI Models Chinese AI

DeepSeek V4-Pro

DeepSeek V4-Pro is the flagship model of the DeepSeek V4 family: a Mixture of Experts large language model with 1.6 trillion total parameters, 49 billion of them activated per token, and a one-million-token…

AI Models Chinese AI

DeepSeek V4.1-Flash

DeepSeek V4.1-Flash is an open-weight multimodal mixture-of-experts model released by DeepSeek on September 10, 2026. It accepts text and images and generates text.

AI Models Chinese AI

DiffusionGemma

DiffusionGemma is an experimental open-weight large language model developed by Google DeepMind for multimodal text generation through discrete diffusion.

Diffusion Models Google DeepMind

GLM-4.5

GLM-4.5 is an open-weights large language model released by Zhipu AI (operating internationally as Z.ai) on July 28, 2025, built on a 355-billion-parameter Mixture of Experts architecture that activates 32…

AI Models Chinese AI

GLM-4.6

GLM-4.6 is a flagship open-weight large language model released by Zhipu AI under its international brand Z.ai on September 30, 2025, built on a sparse Mixture of Experts (MoE) architecture with roughly 357…

AI Models Chinese AI

GLM-5

GLM-5 is an open-weight flagship large language model released by the Chinese AI company Zhipu AI, under its international brand Z.ai, on February 11, 2026.

AI Models Chinese AI

GLM-5.3-Flash

GLM-5.3-Flash is an open-weight, natively multimodal mixture-of-experts large language model released by Z.ai on August 26, 2026.

AI Models Chinese AI

Hunyuan

Hunyuan is Tencent's brand for its foundation models, an umbrella covering large language models, video generation, image synthesis, 3D asset creation, and multimodal reasoning.

AI Models Chinese AI

Hunyuan-A13B

Hunyuan-A13B is an open-weight mixture-of-experts large language model released by Tencent in late June 2025.

Chinese AI Large Language Models

Hy4 Preview

Hy4 Preview is an open-weight large language model released by the Tencent Hy Team on August 28, 2026.

AI Models Chinese AI

Jamba2

Jamba2 is the second generation of hybrid State Space Model and Transformer language models released by AI21 Labs on January 8, 2026.

AI Models Large Language Models

Kimi K2

Kimi K2 is an open-weights Mixture of Experts language model from Moonshot AI, a Beijing startup, released on July 11, 2025 with 1.04 trillion total parameters and 32.6 billion activated per token

AI Models Chinese AI

Kimi K2.5

Kimi K2.5 is an open-weights, natively multimodal large language model developed by Moonshot AI and released on January 27, 2026 .

AI Models Chinese AI

Kimi K3

Kimi K3 is an open-weight multimodal reasoning model developed by Moonshot AI. Moonshot made the model available through its hosted products on July 16, 2026 and published the weights, code, configuration…

AI Models Chinese AI

Leanstral 1.5

Leanstral 1.5 is an open-weight model from Mistral AI for formal proof engineering in Lean 4.

AI Models Large Language Models

Ling-1T

Ling-1T is a trillion-parameter open-weight language model released by Ant Group through its Inclusion AI research group on October 9, 2025.

Chinese AI Large Language Models

Ling-3.0-flash

Ling-3.0-flash is an open-weight mixture-of-experts language model from inclusionAI, the open-source AI initiative of Ant Group, and the first model of the Ling 3.0 generation.

AI Models Chinese AI

Llama 4 Behemoth

Llama 4 Behemoth is the announced but never publicly released flagship model in the Llama 4 family from Meta AI.

AI Models Large Language Models

Llama 4 Scout and Maverick

Llama 4 Scout and Llama 4 Maverick are open-weight, natively multimodal AI large language models developed by Meta and released on April 5, 2025.

AI Models Large Language Models

MAGI-2 Preview

MAGI-2 Preview is a public research release of a unified audio-video generation model developed by Sand.ai.

AI Models Generative AI

MiniMax M2

MiniMax M2 is an open-weight large language model released on October 27, 2025 by the Shanghai-based AI company MiniMax, built as a Mixture of Experts model with 230 billion total parameters and roughly 10…

AI Agents AI Models

Mixtral

Mixtral is a family of open-weight Sparse Mixture of Experts (SMoE) large language models developed by Mistral AI, a French artificial intelligence company founded in April 2023.

AI Companies Large Language Models

Mixtral 8x22B

Mixtral 8x22B is a sparse mixture-of-experts (MoE) large language model released by the French AI company Mistral AI on April 17, 2024.

AI Companies AI Models

MoonEP

MoonEP is an open-source expert-parallel communication library for mixture-of-experts models, released by Moonshot AI on July 27, 2026 under the MIT License.

AI Infrastructure Chinese AI

Nemotron 3.5 Lightning

NVIDIA Nemotron 3.5 Lightning is an open-weights 30 billion parameter mixture-of-experts language model with 3 billion active parameters per token, released by NVIDIA on August 11

AI Models Large Language Models

Nemotron-Labs-TwoTower

Nemotron-Labs-TwoTower is an open-weight diffusion language model released by NVIDIA in mid-2026.

AI Models Diffusion Models

North Mini Code

North Mini Code is an open-weight large language model developed by Cohere for agentic software development and AI code generation.

AI Code Generation AI Models

OLMoE

OLMoE (Open Mixture-of-Experts) is a fully open sparse mixture of experts large language model released by the Allen Institute for AI (Ai2) on September 3, 2024 .

AI Models Large Language Models

Qwen3

Qwen3 is the third-generation family of large language models developed by the Qwen Team at Alibaba Cloud (also known as Tongyi Qianwen lab).

AI Models Chinese AI

Qwen3.8-Flash-Next

Qwen3.8-Flash-Next is an experimental open-weight multimodal large language model released by Alibaba Group's Qwen team on August 26, 2026.

AI Models Chinese AI

Snowflake Arctic

Snowflake Arctic is an open large language model released by Snowflake AI Research on April 24, 2024.

AI Companies Large Language Models

ZAYA1-8B

ZAYA1-8B is an open-weight, reasoning-focused Mixture-of-Experts (MoE) large language model released by San Francisco-based AI research lab Zyphra on May 6, 2026.

AI Models Large Language Models

Zyphra

Zyphra is an American artificial intelligence research and product company headquartered in San Francisco, California, with a secondary office in London.

AI Companies Large Language Models

dots3-note Preview

dots3-note Preview is an open-weight multimodal model and large language model developed by dots studio, an AI team at Xiaohongshu.

AI Models Large Language Models

gpt-oss

gpt-oss is a family of open-weight large language models released by OpenAI on August 5, 2025, and OpenAI's first open-weight language models since GPT-2 in 2019.

AI Models Large Language Models