# Mistral Small

> Source: https://aiwiki.ai/wiki/mistral_small
> Updated: 2026-11-18
> Fact-checked: 2026-11-18
> Categories: AI Models, Large Language Models, Open Source AI
> License: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/) - attribute to "AI Wiki (aiwiki.ai)"
> Cite as: AI Wiki. "Mistral Small." aiwiki.ai, 18 Nov 2026. https://aiwiki.ai/wiki/mistral_small
> From AI Wiki (https://aiwiki.ai), the free encyclopedia of artificial intelligence. Reuse freely with attribution.

**Mistral Small** is a line of [large language models](https://aiwiki.ai/wiki/large_language_model) from the French company [Mistral AI](https://aiwiki.ai/wiki/mistral_ai), positioned between the company's smallest models and its flagship [Mistral Large](https://aiwiki.ai/wiki/mistral_large). The name first appeared in December 2023 as an API endpoint that served [Mixtral](https://aiwiki.ai/wiki/mixtral) 8x7B,[1] and from February 2024 it named a new Mistral model optimized for low-latency workloads.[2] Versions released since then include a 22-billion-parameter model under the non-commercial Mistral Research License (September 2024),[3][4] three dense 24-billion-parameter models under the [Apache 2.0](https://aiwiki.ai/wiki/apache_license) license (Mistral Small 3, 3.1 and 3.2, released between January and June 2025),[6][9][12] and [Mistral Small 4](https://aiwiki.ai/wiki/mistral_small_4), a sparse [mixture-of-experts](https://aiwiki.ai/wiki/mixture_of_experts) model with 119 billion total parameters released in March 2026.[15] Several other Mistral models, among them [Devstral](https://aiwiki.ai/wiki/devstral) Small, [Magistral](https://aiwiki.ai/wiki/magistral) Small and [Voxtral](https://aiwiki.ai/wiki/voxtral) Small, were trained on top of Mistral Small checkpoints.[17][18][19][20]

## History

### The mistral-small endpoint (December 2023)

Mistral opened beta access to its developer platform, La Plateforme, on December 11, 2023, with three chat endpoints of increasing capability: mistral-tiny, mistral-small and mistral-medium.[1] The mistral-small endpoint served Mixtral 8x7B, which Mistral called its newest model at the time; the company said it handled English, French, Italian, German, Spanish and code, and reported an [MT-Bench](https://aiwiki.ai/wiki/mt_bench) score of 8.3.[1] Mistral-tiny served Mistral 7B Instruct v0.2, and mistral-medium served a prototype model.[1]

### Mistral Small 24.02 (February 2024)

On February 26, 2024, in the same announcement that introduced Mistral Large, Mistral described "a new Mistral Small, optimised for low latency workloads," available through the endpoint mistral-small-2402.[2] The company said it outperformed Mixtral 8x7B with lower latency; the announcement itself gave no figures for it, pointing readers to benchmarks in Mistral's documentation instead, and presented it as an intermediate option between its open-weight models and its flagship.[2] Mistral Small shared Mistral Large's support for [retrieval-augmented generation](https://aiwiki.ai/wiki/retrieval_augmented_generation) and [function calling](https://aiwiki.ai/wiki/function_calling), and at launch function calling and a JSON output mode were available only on mistral-small and mistral-large.[2] Mistral's model documentation now lists this version as Mistral Small 1.0.[16]

### Mistral Small 24.09 (September 2024)

Mistral released Mistral Small v24.09 on September 17, 2024, calling it an upgrade of v24.02 with improvements in human alignment, reasoning and code.[3] It had 22 billion parameters and was presented as a mid-point between the 12B [Mistral NeMo](https://aiwiki.ai/wiki/mistral_nemo) and Mistral Large 2, aimed at tasks such as translation, summarization and sentiment analysis.[3] The weights were published on [Hugging Face](https://aiwiki.ai/wiki/hugging_face) as Mistral-Small-Instruct-2409, with a 32k-token sequence length, a vocabulary of 32,768 tokens and function-calling support.[4] They were licensed under the Mistral Research License (MRL), which allowed self-deployment only for non-commercial purposes.[3]

The same announcement cut the API price of Mistral Small by 80 percent, from $1 to $0.20 per million input tokens and from $3 to $0.60 per million output tokens, as part of a price reduction across Mistral's lineup.[3] Mistral's documentation lists this version as Mistral Small 2.0.[16]

### Mistral Small 3 (January 2025)

Mistral Small 3 was announced on January 30, 2025 as "a latency-optimized 24B-parameter model released under the Apache 2.0 license."[6] Both the pretrained base checkpoint and the instruction-tuned checkpoint were released under Apache 2.0, and the announcement said the company was "renewing our commitment to using Apache 2.0 license for our general purpose models, as we progressively move away from MRL-licensed models."[6] Mistral reported more than 81 percent accuracy on [MMLU](https://aiwiki.ai/wiki/mmlu) and a speed of 150 tokens per second, and said the model was competitive with larger models such as [Llama 3.3](https://aiwiki.ai/wiki/llama_3_3) 70B and Qwen 32B while running more than three times faster than Llama 3.3 70B on the same hardware.[6] It attributed the speed partly to the model having "far fewer layers than competing models."[6] The company also stated that the model was "neither trained with RL nor synthetic data," and suggested it as a base for building reasoning models.[6]

Mistral pitched the model as an open alternative to proprietary models such as [GPT-4o mini](https://aiwiki.ai/wiki/gpt_4o_mini), and listed uses including fast conversational assistance, low-latency function calling, fine-tuning for subject-matter experts and local inference: once [quantized](https://aiwiki.ai/wiki/quantization), it could run on a single RTX 4090 or a MacBook with 32 GB of RAM.[6] On launch day it was available on La Plateforme as mistral-small-2501 and through Hugging Face, [Ollama](https://aiwiki.ai/wiki/ollama), [Kaggle](https://aiwiki.ai/wiki/kaggle), [Together AI](https://aiwiki.ai/wiki/together_ai), [Fireworks AI](https://aiwiki.ai/wiki/fireworks_ai) and IBM watsonx.[6] The Hugging Face model card lists a 32k context window, the Tekken tokenizer with a 131k vocabulary, and support for languages including English, French, German, Spanish, Italian, Chinese, Japanese, Korean, Portuguese, Dutch and Polish.[7]

### Mistral Small 3.1 (March 2025)

Mistral Small 3.1, announced on March 17, 2025, kept the 24B size and the Apache 2.0 license and added image understanding and a context window of up to 128k tokens.[9][10] Mistral said it outperformed comparable models such as [Gemma 3](https://aiwiki.ai/wiki/gemma_3) and GPT-4o mini while running at 150 tokens per second, and again said it could run on a single RTX 4090 or a Mac with 32 GB of RAM.[9] Base and instruct checkpoints were released on Hugging Face, and the model was offered on La Plateforme and [Google Vertex AI](https://aiwiki.ai/wiki/google_vertex_ai), with [NVIDIA NIM](https://aiwiki.ai/wiki/nvidia_nim) and [Azure AI Foundry](https://aiwiki.ai/wiki/azure_ai_foundry) announced for the following weeks.[9] The model card describes native function calling and JSON output and support for dozens of languages.[10]

### Mistral Small 3.2 (June 2025)

Mistral Small 3.2 (Mistral-Small-3.2-24B-Instruct-2506) was a minor update to the 3.1 instruct model, built on the same 3.1 base checkpoint.[12] Mistral's documentation dates its release to June 20, 2025, under the API identifier mistral-small-2506, with a 128k context window and an Apache 2.0 license.[13] The model card lists three targeted changes: better instruction following, fewer infinite generations and repetitive answers, and a more robust function-calling template.[12] Mistral reported that its rate of infinite generations on an internal set of long, repetitive prompts fell from 2.11 percent to 1.29 percent, and that scores in other categories should "match or slightly improve" relative to 3.1.[12]

### Mistral Small Creative (December 2025)

Mistral Small Creative was an experimental model offered through Mistral's Labs program from December 11, 2025, under the API identifier labs-mistral-small-creative.[14] The documentation describes it as "an experimental specialized small model trained on meticulously curated data," designed for creative writing, narrative generation, roleplay and character-driven dialogue, with a 32k context window.[14] The page does not state a parameter count or whether weights were released. It was deprecated on March 31, 2026, with [Ministral](https://aiwiki.ai/wiki/ministral) 3 8B named as the model to use for new integrations.[14][16]

### Mistral Small 4 (March 2026)

Mistral Small 4, released on March 16, 2026, broke with the dense design of the 3.x models. It is a mixture-of-experts model with 119 billion total parameters across 128 experts, of which 4 are active for each token, giving about 6 billion active parameters (8 billion including the embedding and output layers).[15] Mistral's API documentation gives the active count as 6.5 billion.[23] It has a 256k context window, an Apache 2.0 license and a reasoning_effort setting that switches between fast responses in the style of Mistral Small 3.2 and step-by-step reasoning in the style of Magistral.[15] Mistral described it as the first of its models to combine the capabilities of Magistral, [Pixtral](https://aiwiki.ai/wiki/pixtral), Devstral and the Mistral Small instruct models, and reported a 40 percent cut in end-to-end completion time and three times the requests per second compared with Mistral Small 3.[15] Its minimum listed deployment hardware is four NVIDIA HGX H100, two HGX H200 or one DGX B200 system, well beyond the single consumer GPU that suited the 24B models.[15] The model is covered in detail in the [Mistral Small 4](https://aiwiki.ai/wiki/mistral_small_4) article.

## Versions

| Version | Released | API identifier | Parameters | Context | Weights license |
| --- | --- | --- | --- | --- | --- |
| mistral-small endpoint (Mixtral 8x7B) | 2023-12-11 | mistral-small | Mixtral 8x7B | not stated | not applicable (endpoint)[1] |
| Mistral Small 1.0 (24.02) | 2024-02-26 | mistral-small-2402 | not disclosed | not stated | API endpoint[2][16] |
| Mistral Small 2.0 (24.09) | 2024-09-17 | mistral-small-2409 | 22B dense | 32k | Mistral Research License[3][4] |
| Mistral Small 3 (25.01) | 2025-01-30 | mistral-small-2501 | 24B dense | 32k | Apache 2.0[6][7] |
| Mistral Small 3.1 (25.03) | 2025-03-17 | mistral-small-2503 | 24B dense, plus vision encoder | 128k | Apache 2.0[9][10] |
| Mistral Small 3.2 (25.06) | 2025-06-20 | mistral-small-2506 | 24B dense, plus vision encoder | 128k | Apache 2.0[12][13] |
| Mistral Small Creative (25.12) | 2025-12-11 | labs-mistral-small-creative | not stated | 32k | not stated[14] |
| Mistral Small 4 (26.03) | 2026-03-16 | mistral-small-2603 | 119B MoE, about 6B active | 256k | Apache 2.0[15][23] |

Mistral's documentation numbers the API versions 1.0 (24.02), 2.0 (24.09), 3.0 (25.01), 3.1 (25.03) and 3.2 (25.06).[16]

## Architecture

The 22B and 24B Mistral Small models are dense decoder-only [transformers](https://aiwiki.ai/wiki/transformers). Their published configuration files show that Mistral Small 3 was shallower and wider in its feed-forward layers than the 22B model it replaced, consistent with the "far fewer layers" Mistral cited as a source of its speed.[5][8][6] Both use [grouped-query attention](https://aiwiki.ai/wiki/grouped_query_attention), with 8 key-value heads shared across the query heads.[5][8]

| Setting | Small 24.09 (22B) | Small 3 (24B) | Small 3.1 and 3.2 (24B) |
| --- | --- | --- | --- |
| Layers | 56 | 40 | 40 |
| Hidden size | 6,144 | 5,120 | 5,120 |
| Feed-forward size | 16,384 | 32,768 | 32,768 |
| Attention heads (query / key-value) | 48 / 8 | 32 / 8 | 32 / 8 |
| Vocabulary | 32,768 | 131,072 | 131,072 |
| Maximum positions | 32,768 | 32,768 | 131,072 |
| Vision encoder | none | none | 24-layer Pixtral-type encoder |
| Source | [5] | [8] | [11][24] |

From version 3.1 the checkpoints add a vision encoder (24 layers, hidden size 1,024, 14-pixel patches) whose configuration is labelled as the Pixtral type.[11] The [rotary position embedding](https://aiwiki.ai/wiki/rotary_position_embedding) base value (rope_theta) is 100,000,000 in Mistral Small 3 and 1,000,000,000 in 3.1.[8][11] Mistral's model cards say that running the 24B models unquantized on a GPU takes about 55 GB of memory in bf16 or fp16.[7][10][12]

## Benchmarks

All figures below were reported by Mistral on its model cards, from its own evaluation pipeline, and have not been independently audited.

Mistral Small 3 instruct, compared with other models in the 2501 model card:[7]

| Benchmark | Mistral Small 3 | [Gemma 2](https://aiwiki.ai/wiki/gemma_2) 27B | Llama 3.3 70B | Qwen 2.5 32B | GPT-4o mini |
| --- | --- | --- | --- | --- | --- |
| [MMLU-Pro](https://aiwiki.ai/wiki/mmlu-pro) (5-shot CoT) | 0.663 | 0.536 | 0.666 | 0.683 | 0.617 |
| [GPQA](https://aiwiki.ai/wiki/gpqa) Main (5-shot CoT) | 0.453 | 0.344 | 0.531 | 0.404 | 0.377 |
| [HumanEval](https://aiwiki.ai/wiki/humaneval) (pass@1) | 0.848 | 0.732 | 0.854 | 0.909 | 0.890 |
| MT-Bench (dev) | 8.35 | 7.86 | 7.96 | 8.26 | 8.33 |
| [Arena Hard](https://aiwiki.ai/wiki/arena_hard) | 0.873 | 0.788 | 0.840 | 0.860 | 0.897 |
| [IFEval](https://aiwiki.ai/wiki/ifeval) | 0.829 | 0.8065 | 0.8835 | 0.8401 | 0.8499 |

Mistral Small 3.1 instruct, compared with other models in the 2503 model card:[10]

| Benchmark | Mistral Small 3.1 | Gemma 3 27B | GPT-4o mini | [Claude 3.5 Haiku](https://aiwiki.ai/wiki/claude_3_5_haiku) |
| --- | --- | --- | --- | --- |
| MMLU | 80.62% | 76.90% | 82.00% | 77.60% |
| MMLU-Pro | 66.76% | 67.50% | 61.70% | 65.00% |
| MATH | 69.30% | 89.00% | 70.20% | 69.20% |
| GPQA Main | 44.42% | 36.83% | 40.20% | 37.05% |
| HumanEval | 88.41% | 87.80% | 87.20% | 88.10% |
| [MMMU](https://aiwiki.ai/wiki/mmmu) | 64.00% | 64.90% | 59.40% | 60.50% |
| [MathVista](https://aiwiki.ai/wiki/mathvista) | 68.91% | 67.60% | 56.70% | 61.60% |
| [RULER](https://aiwiki.ai/wiki/ruler_benchmark) 128k | 81.20% | 66.00% | 65.80% | 91.90% |
| [LongBench](https://aiwiki.ai/wiki/longbench) v2 | 37.18% | 34.59% | 29.30% | 35.19% |

Mistral Small 3.2 instruct against 3.1 instruct, from the 2506 model card:[12]

| Benchmark | Small 3.1 | Small 3.2 |
| --- | --- | --- |
| [WildBench](https://aiwiki.ai/wiki/wildbench) v2 | 55.6% | 65.33% |
| Arena Hard v2 | 19.56% | 43.1% |
| Internal instruction-following accuracy | 82.75% | 84.78% |
| Infinite generations (lower is better) | 2.11% | 1.29% |
| MMLU-Pro (5-shot CoT) | 66.76% | 69.06% |
| HumanEval Plus (pass@5) | 88.99% | 92.90% |
| [MBPP](https://aiwiki.ai/wiki/mbpp) Plus (pass@5) | 74.63% | 78.33% |
| MMLU | 80.62% | 80.50% |
| GPQA Main (5-shot CoT) | 44.42% | 44.22% |
| MMMU | 64.00% | 62.50% |

The 3.2 table shows the update was not uniformly better: MMLU, GPQA Main, MMMU and some other vision scores dipped slightly while instruction following and coding improved.[12]

## Licensing

The line's licensing changed twice. The 24.02 model was announced as an API endpoint, placed between Mistral's open-weight models and its flagship.[2] The 24.09 weights were downloadable but covered by the Mistral Research License, under which self-deployment was permitted for non-commercial purposes.[3] Developer Simon Willison noted that earlier Mistral Small models had used a license that ruled out commercial use without a separately negotiated agreement, and read the January 2025 announcement as a move away from that license for Mistral's core models.[21] Mistral Small 3, 3.1, 3.2 and 4 were all released under Apache 2.0, which permits commercial and non-commercial use and modification.[6][9][12][15] Willison also reported that Mistral Small 3's API price was half that of the previous Mistral Small API model, at $0.10 per million input tokens and $0.30 per million output tokens.[21]

## Derived models

The 24B checkpoints served as the starting point for several later Mistral models:

| Model | Built on | Source |
| --- | --- | --- |
| Devstral Small (2505), coding agent | Mistral Small 3.1, with the vision encoder removed | [17] |
| Magistral Small (2506), reasoning | Mistral Small 3.1 (2503), with supervised fine-tuning on Magistral Medium traces and reinforcement learning | [18] |
| Magistral Small 1.2 (2509), reasoning | Mistral Small 3.2 (2506) | [19] |
| Voxtral Small (2507), audio input | Mistral Small 3.1 24B backbone, according to the Voxtral paper (the model card links the Mistral Small 3 base checkpoint) | [20][25] |

Outside Mistral, the Mistral Small 3.1 announcement pointed to DeepHermes 24B from [Nous Research](https://aiwiki.ai/wiki/nous_research) as a reasoning model built on Mistral Small 3.[9]

## Deprecation and retirement

Mistral retires older API versions on a published schedule, and as of November 2026 its documentation lists every Mistral Small API version before 4 as deprecated or retired:[16]

| API identifier | Deprecation | Retirement | Alternative named by Mistral |
| --- | --- | --- | --- |
| mistral-small-2402 | 2024-11-30 | 2025-06-16 | Mistral Small 4 |
| mistral-small-2409 | 2025-11-06 | 2025-11-30 | Mistral Small 4 |
| mistral-small-2501 | 2025-11-06 | 2025-11-30 | Mistral Small 4 |
| mistral-small-2503 | 2025-11-06 | 2025-11-30 | Mistral Small 4 |
| mistral-small-2506 | 2026-04-30 | 2026-07-31 | Mistral Small 4 |
| labs-mistral-small-creative | 2026-03-31 | 2026-04-30 | Ministral 3 8B |

The open-weight checkpoints of the 24.09, 3, 3.1 and 3.2 releases remain listed on Mistral's Hugging Face organization; the retirement dates apply to Mistral's hosted API.[4][7][10][12][16]

## Reception

Coverage of Mistral Small 3 focused on its size-to-quality ratio and its license. SiliconANGLE noted that Llama 3.3 70B, the model Mistral compared it with, has more than three times as many parameters, and reported Mistral's description of the model as catering to "the '80%' of generative AI tasks."[22] Willison welcomed a new open model in the roughly 20 GB class that he regarded as a good balance between memory use and usefulness, ran the 14 GB Ollama build locally, and observed that despite its name it appeared to be "the fourth release of a model under that label."[21]

## See also

- [Mistral AI](https://aiwiki.ai/wiki/mistral_ai)
- [Mistral Small 4](https://aiwiki.ai/wiki/mistral_small_4)
- [Mistral Large](https://aiwiki.ai/wiki/mistral_large)
- [Mistral 7B](https://aiwiki.ai/wiki/mistral_7b)
- [Codestral](https://aiwiki.ai/wiki/codestral)
- [Open-source AI](https://aiwiki.ai/wiki/open_source_ai)

## References

1. Mistral AI. "La Plateforme". Mistral AI news, 2023-12-11. https://mistral.ai/news/la-plateforme
2. Mistral AI. "Au Large". Mistral AI news, 2024-02-26. https://mistral.ai/news/mistral-large
3. Mistral AI. "AI in abundance". Mistral AI news, 2024-09-17. https://mistral.ai/news/september-24-release
4. Mistral AI. "mistralai/Mistral-Small-Instruct-2409". Hugging Face, 2024. https://huggingface.co/mistralai/Mistral-Small-Instruct-2409
5. Mistral AI. "params.json, mistralai/Mistral-Small-Instruct-2409". Hugging Face, 2024. https://huggingface.co/mistralai/Mistral-Small-Instruct-2409/blob/main/params.json
6. Mistral AI. "Mistral Small 3". Mistral AI news, 2025-01-30. https://mistral.ai/news/mistral-small-3
7. Mistral AI. "mistralai/Mistral-Small-24B-Instruct-2501". Hugging Face, 2025. https://huggingface.co/mistralai/Mistral-Small-24B-Instruct-2501
8. Mistral AI. "params.json, mistralai/Mistral-Small-24B-Instruct-2501". Hugging Face, 2025. https://huggingface.co/mistralai/Mistral-Small-24B-Instruct-2501/blob/main/params.json
9. Mistral AI. "Mistral Small 3.1". Mistral AI news, 2025-03-17. https://mistral.ai/news/mistral-small-3-1
10. Mistral AI. "mistralai/Mistral-Small-3.1-24B-Instruct-2503". Hugging Face, 2025. https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503
11. Mistral AI. "config.json, mistralai/Mistral-Small-3.1-24B-Instruct-2503". Hugging Face, 2025. https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/blob/main/config.json
12. Mistral AI. "mistralai/Mistral-Small-3.2-24B-Instruct-2506". Hugging Face, 2025. https://huggingface.co/mistralai/Mistral-Small-3.2-24B-Instruct-2506
13. Mistral AI. "Mistral Small 3.2". Mistral AI documentation. https://docs.mistral.ai/models/mistral-small-3-2-25-06
14. Mistral AI. "Mistral Small Creative". Mistral AI documentation. https://docs.mistral.ai/models/mistral-small-creative-25-12
15. Mistral AI. "Introducing Mistral Small 4". Mistral AI news, 2026-03-16. https://mistral.ai/news/mistral-small-4
16. Mistral AI. "Models Overview". Mistral AI documentation, accessed 2026-11-18. https://docs.mistral.ai/models
17. Mistral AI. "mistralai/Devstral-Small-2505". Hugging Face, 2025. https://huggingface.co/mistralai/Devstral-Small-2505
18. Mistral AI. "mistralai/Magistral-Small-2506". Hugging Face, 2025. https://huggingface.co/mistralai/Magistral-Small-2506
19. Mistral AI. "mistralai/Magistral-Small-2509". Hugging Face, 2025. https://huggingface.co/mistralai/Magistral-Small-2509
20. Mistral AI. "mistralai/Voxtral-Small-24B-2507". Hugging Face, 2025. https://huggingface.co/mistralai/Voxtral-Small-24B-2507
21. Simon Willison. "Mistral Small 3". Simon Willison's Weblog, 2025-01-30. https://simonwillison.net/2025/Jan/30/mistral-small-3/
22. Maria Deutscher. "Mistral, Ai2 release new open-source LLMs". SiliconANGLE, 2025-01-30. https://siliconangle.com/2025/01/30/mistral-ai2-release-new-open-source-llms
23. Mistral AI. "Mistral Small 4". Mistral AI documentation. https://docs.mistral.ai/models/mistral-small-4-0-26-03
24. Mistral AI. "params.json, mistralai/Mistral-Small-3.2-24B-Instruct-2506". Hugging Face, 2025. https://huggingface.co/mistralai/Mistral-Small-3.2-24B-Instruct-2506/blob/main/params.json
25. Alexander H. Liu et al. "Voxtral". arXiv:2507.13264, 2025. https://arxiv.org/abs/2507.13264

