Cohere Command A
Last edited
Fact-checked
In review queue
Sources
26 citations
Revision
v5 · 6,747 words
Fact-checks are independent of edits: a reviewer re-verifies the article against its sources and stamps the date. How we verify
Cohere Command A is a 111 billion parameter dense large language model released by Cohere on March 13, 2025, built for enterprise agents, Retrieval-Augmented Generation, and tool use across 23 languages.[2] It supports a 256,000 token context window, runs on as few as two H100 or A100 GPUs in 16-bit precision, and was Cohere's flagship general-purpose model at launch, succeeding the Command R and Command R+ series. Cohere describes Command A as "on par or better than GPT-4o and DeepSeek-V3 across agentic enterprise tasks, with significantly greater efficiency," and reports a token generation rate of 156 tokens per second, which it states is 1.75 times faster than GPT-4o and 2.4 times faster than DeepSeek V3.[2][8] Its open weights were published on Hugging Face under the Creative Commons Attribution-NonCommercial 4.0 license,[4] while commercial access is provided through Cohere's hosted API and through cloud partners including Amazon Bedrock, Vertex AI, Microsoft Azure AI Foundry, and Oracle Cloud Infrastructure.[8]
Cohere positioned Command A as a deliberate counterweight to larger frontier models like GPT-4o, Claude 3.7 Sonnet, and DeepSeek V3. Rather than chasing higher parameter counts or breaking new ground on academic chat benchmarks, the company emphasized hardware efficiency and the practical demands of business deployment. According to Cohere's own measurements, Command A delivers roughly 1.75 times the token streaming throughput of GPT-4o and 2.4 times that of DeepSeek V3 on long-context requests, while matching or exceeding both on tool-use and agentic benchmarks.[2] The accompanying 91 page technical report, posted to arXiv as paper 2504.00698, was credited to 228 contributors at Cohere and Cohere Labs and described a decentralized training pipeline that combined supervised fine-tuning, preference optimization, and model merging across capability-specific expert checkpoints.[5]
The Command A platform expanded over the following months into a family of specialized variants. Command A Vision, released July 31, 2025, added image input through a SigLIP2 encoder grafted onto the same text tower.[10] Command A Reasoning, announced August 21, 2025, introduced a configurable thinking-token budget for deeper inference-time deliberation.[11] Command A Translate, released August 28, 2025, was tuned specifically for high-quality machine translation across the same 23-language set.[12] In May 2026 Cohere shipped Command A+, a 218 billion parameter sparse mixture-of-experts model with native citations released under the permissive Apache 2.0 license.[26] Each variant retained the small-footprint deployment target and, with the exception of Command A+, the CC-BY-NC open-weights distribution model that defined the original release.
What is Cohere Command A?
Cohere is a Canadian AI company headquartered in Toronto with additional offices in San Francisco, New York, London, Paris, Seoul, and Montreal. It was founded in 2019 by Aidan Gomez, Ivan Zhang, and Nick Frosst.[25] Gomez was one of the eight co-authors of the 2017 paper "Attention Is All You Need," the work that introduced the Transformer architecture, and Frosst was a researcher at Google Brain.[24] From the start the company concentrated on enterprise customers rather than consumer chatbots, providing models for search, document processing, customer support, and workflow automation.
The Command product line predates Command A by several years. The first generation, simply called Command and Command Light, served as general-purpose text generators. In March 2024 Cohere shifted strategy with the launch of Command R, a 35 billion parameter model purpose-built for Retrieval-Augmented Generation and tool use. Command R was followed a month later by the larger Command R+ at 104 billion parameters. An August 2024 refresh of both models brought throughput improvements and pricing reductions. In December 2024 Cohere added Command R7B at the small end, a 7 billion parameter model that was explicitly described as the final entry in the R series. Command A, announced three months later, was the first model in the next generation.[2] It carries forward several R-series design choices, including the focus on grounded generation with inline citations and on enterprise-grade tool use, while changing the underlying architecture and dramatically increasing the context window.
Cohere has consistently differentiated itself from competitors on deployment flexibility. Customers can call Cohere's hosted API, deploy through one of the major cloud marketplaces, run the models inside a virtual private cloud, or install them on premises.[7] This matters for regulated industries such as banking, healthcare, and government, where data residency and air-gapped deployments are often non-negotiable. The Bell Canada partnership announced in July 2025, which placed Cohere models inside Bell-owned Canadian data centers for use by public-sector clients, illustrates the pattern. By late 2025 Cohere had raised approximately 1.6 billion dollars in total funding, with a valuation reported at around 7 billion dollars after a September 2025 extension round, and counted RBC, Dell, LG, Ensemble Health Partners, Palantir, and Oracle among its disclosed customers.[20] A September 2025 partnership with AMD committed the company to deeper optimization of Command A on AMD Instinct accelerators, broadening the supported hardware beyond Nvidia and Google TPUs.[20]
The company's commercial positioning has shifted alongside the Command A family. Cohere has spent less effort competing for consumer mindshare and more on its North workspace platform, an agentic environment that uses Command A as its core reasoning engine and integrates with enterprise data sources such as email, document repositories, customer relationship management systems, and ticketing tools. Royal Bank of Canada announced in mid-2025 that it would co-develop a private deployment called North for Banking, optimized for wealth advisor and customer-support workloads. By the time Command A Reasoning shipped in August 2025, Cohere was describing North and Command A together as a vertically integrated stack rather than a single model release.
How is Command A built? (Architecture)
Command A is a dense decoder-only Transformer with 111 billion parameters and a 256,000 token context window.[5] The architecture builds directly on the hybrid attention design that Cohere first introduced in the smaller Command R7B and scales it up. Three out of every four transformer blocks use sliding window self-attention with a 4,096 token window, while the fourth block uses full global attention. Sliding window blocks rely on Rotary Position Embedding (RoPE) for positional information, whereas the global blocks omit explicit positional encoding so that distant tokens can interact with one another without being filtered through a particular position bias.[5]
The practical effect of this design is that the bulk of the model's compute stays cheap. Sliding window attention has linear complexity in the sequence length, which is what makes a 256K context tractable on modest hardware. The interleaved global attention blocks retain the model's ability to track relationships across the entire context, which matters for long-document RAG, repository-scale code understanding, and multi-step agent traces that revisit earlier observations. Cohere has described the global attention layers as the mechanism by which the model effectively notices a needle in a haystack while paying for it only once every four layers.
The model uses BFloat16 tensors in its native release and a proprietary chat template that delineates system, user, assistant, and tool turns with special tokens.[4] Tokenization continues to use Cohere's own multilingual tokenizer, which the company has measured as producing fewer tokens than OpenAI's tokenizer for non-English text. For Japanese the difference is around 1.67 times fewer tokens; for many other non-English languages the gap is smaller but still meaningful.[5] Lower token counts translate directly into lower API costs and longer effective context for non-English users.
A practical consequence of the dense rather than mixture-of-experts choice is that activation patterns are uniform across tokens. Mixture-of-experts models like DeepSeek V3 achieve large total parameter counts but require all experts to be resident in GPU memory, which inflates the hardware footprint even though only a fraction of parameters are activated per token. Cohere argued in the technical report that for a two-GPU serving target the dense layout was the better trade because it amortized communication overhead more predictably and made batched inference easier to schedule.[5] The same reasoning informed the choice to publish only the dense 111B configuration rather than a family of sizes, since each additional configuration would have required its own performance and safety evaluation pass.
How was Command A trained?
The Command A technical report describes a multi-stage training pipeline that the authors call decentralized training, in contrast to the more typical monolithic pretraining followed by a single round of instruction tuning. Pretraining ran on a large multilingual web and code corpus with a knowledge cutoff of June 1, 2024, after which the model was refined through a sequence of supervised fine-tuning, preference optimization, and model merging stages.[5]
The supervised fine-tuning stage produced a set of capability-specific expert checkpoints, each optimized for a domain such as code, math, RAG, tool use, multilingual chat, or safety. Rather than serving these specialists as discrete fine-tunes or routing between them at inference time, Cohere merged the expert checkpoints into a single set of base weights using parameter-space averaging and conflict-resolution techniques.[5] The result is a unified model whose behavior can be steered by the system prompt rather than by a model selector. Cohere's stated rationale was that enterprise workflows tend to combine domains, since a customer-service agent might call a code interpreter and a translation tool in the same session, and that a single set of weights eliminates the latency and infrastructure complexity of routing between specialists.
Preference optimization used two related losses. Self-Revising Preference Optimization, abbreviated SRPO, was introduced by Cohere to reinforce human-preferred style, tone, and formatting while teaching the model to self-refine its own outputs at inference time. SRPO normalizes the log-likelihoods of preferred and dispreferred completions by length, which controls for the well-known tendency of preference optimizers to prefer longer responses. Alongside SRPO, the team used Contrastive Preference Generation, abbreviated CoPG, with two generations per prompt and a mix of offline and online on-policy training. The two methods were interleaved in a ping-pong schedule that the authors said helped avoid the regressions and reward-model hacking patterns that plague single-pass preference training.[5]
Reinforcement learning from human feedback was layered on top to further align outputs with human raters' preferences. Prompts for the RLHF stage were drawn from the same domains used in supervised fine-tuning so that improvements in alignment did not erode capability. Cohere also reported using synthetic preference data generated by earlier Command models, with care taken to avoid mode collapse from training on too narrow a slice of its own outputs.[5]
A distillation pathway feeds back into Cohere's smaller multilingual line. Through a procedure the company calls Fusion, Command A is used as a teacher to synthesize safe and helpful responses that train the Aya Expanse 8B and 32B models.[5] The Aya line, which targets the same 23 languages as the Command family, benefits from Command A's strong crosslingual generalization in safety behaviors that are difficult to teach in lower-resource languages directly. The arrangement is symbiotic: Aya research feeds tokenization, preference data, and evaluation infrastructure back to the Command line, and Command A's safety and refusal patterns are propagated downstream to the smaller open-source releases.
What can Command A do? (Capabilities)
Command A is described by Cohere as a single model that performs well across the workloads its enterprise customers actually run, rather than one optimized for a particular leaderboard. The main capability buckets are summarized below.
| Capability | What it does | Typical use |
|---|---|---|
| Grounded generation with citations | Generates responses with inline citations mapping spans of text to specific source passages | Enterprise RAG pipelines, regulated document workflows |
| Single-step tool use | Selects a single tool from a list and produces JSON arguments matching the schema | Function calling, calculator, database lookups |
| Multi-step tool use | Plans and executes loops of action, observation, and reflection across multiple tools | Agentic AI workflows, customer service automation |
| Multilingual chat | Conversational fluency in 23 supported languages | Cross-border customer support, translation, localization |
| Code generation | Writes, explains, and translates code across languages, with strong SQL performance | Internal developer tools, analytics assistants |
| Long-context reasoning | Handles inputs up to 256K tokens with sliding window plus global attention | Repository-scale code review, contract analysis, multi-document summarization |
The 23 supported languages match the set introduced with Command R7B: English, French, Spanish, Italian, German, Portuguese, Japanese, Korean, Chinese, Arabic, Russian, Polish, Turkish, Vietnamese, Dutch, Czech, Indonesian, Ukrainian, Romanian, Greek, Hindi, Hebrew, and Persian.[1] Cohere noted improved handling of Arabic dialects compared with prior Command models, with internal evaluations placing Command A at 98.2 percent accuracy when responding in Arabic to English prompts, and on the FLoRES and WMT23 translation suites the model was reported as competitive with GPT-4o across the major European and East Asian languages.[5]
Citations are a particular point of pride for the Command line and remain a built-in feature of Command A rather than a separate post-processing step. The model can return responses in two citation modes. "Accurate" mode generates the answer first and then produces citations that map back to the underlying passages, optimizing for precision. "Fast" mode injects citation tags inline as tokens stream, which is more suitable for interactive applications where latency matters.[1] In both modes the citations reference document chunks that Cohere recommends sizing at 100 to 400 words, and the model's behavior was trained with both citation styles so that the same weights can switch between them based on the system prompt.
Multi-step tool use is the foundation of the model's agent capabilities. Given a list of tools defined by name, description, and JSON parameter schema, the model iterates through cycles of choosing actions, reading observations, and reflecting on whether to continue. Tools can be called in parallel when their inputs are independent, and the model is trained to recover from failed calls by retrying with different parameters or selecting an alternative tool. A built-in directly_answer tool lets it skip external calls when its own knowledge is sufficient.[1] This loop is what powers Cohere's North workspace platform, where Command A coordinates calls into Gmail, Slack, Salesforce, and customer systems on behalf of business users.
What are Command A's safety modes?
The API exposes a Safety Modes parameter that lets developers choose between three behavioral profiles without changing the underlying weights. Contextual mode is the default and follows the safety expectations described in the system prompt, allowing the model to handle mature or sensitive topics in contexts where they are appropriate, such as medical question answering or legal analysis. Strict mode applies a stricter refusal pattern suited to consumer-facing or unmoderated environments. None mode disables the safety system prompt entirely and is intended for research and red-teaming workflows where developers want to probe the model's underlying behavior.[9] The same safety pipeline carries through to the Command A Vision, Reasoning, and Translate variants, which inherit Command A's preference-trained refusal patterns rather than retraining their own.
How well does Command A perform on benchmarks?
Cohere published a wide array of benchmark and human-evaluation results in the Command A technical report and accompanying blog post. The headline claim is that Command A is "on par or better than GPT-4o and DeepSeek V3 across agentic enterprise tasks, with significantly greater efficiency."[2] The table below collects the figures Cohere reported alongside competitor scores in March 2025. As with any vendor-published numbers, readers should treat them as best-case results rather than independent evaluations.
| Benchmark | Command A | GPT-4o | DeepSeek V3 | Notes |
|---|---|---|---|---|
| MMLU | On par | Reference | Reference | Cohere reported parity with GPT-4o on general knowledge |
| MBPPPlus | On par | Reference | Reference | Code generation parity reported by Cohere |
| SQL generation | Leads | Behind | Behind | Cohere's internal SQL evaluation |
| BFCL v3 | Leads | Behind | Behind | Berkeley Function Calling Leaderboard, agentic tool use |
| Tau-bench | Leads | Behind | Behind | Tau-bench, conversational agent benchmark |
| RepoQA | Dominates | Behind | Behind | Long-context code understanding |
| IFEval | Strong | Reference | Reference | Instruction following |
| MATH | Competitive | Reference | Reference | Mathematical reasoning |
| Long-context throughput | 73 tok/s | 38 tok/s | 32 tok/s | Cohere measurement at 100K context |
| Peak streaming throughput | 156 tok/s | 89 tok/s | 65 tok/s | Cohere headline figure: 1.75x GPT-4o, 2.4x DeepSeek V3 |
Cohere's headline efficiency number is a token generation rate of 156 tokens per second, which the company states is 1.75 times higher than GPT-4o and 2.4 times higher than DeepSeek V3.[8][2] The company also reported that private deployments of Command A run up to 50 percent cheaper than API-based alternatives, framing the model as roughly 150 percent more efficient at inference time than the previous Command R+ 08-2024 generation.[2] In human evaluations Cohere ran across business analysis, coding, and agentic task categories, Command A was reported as winning or tying against both GPT-4o and DeepSeek V3 in the majority of head-to-head comparisons.[2] The company also reported that the model's 256K context window provides additional headroom for processing lengthy documents, extensive conversation histories, and large retrieval sets relative to GPT-4o's 128K window. On the Berkeley Function Calling Leaderboard, Command A's reported lead was particularly notable because BFCL is widely watched as a proxy for real-world function calling quality.
Independent reviewers reached more measured conclusions. The model holds up well on agentic and tool-use evaluations and on long-context tasks, where its hybrid attention design is a structural advantage. On standard chat-style benchmarks such as the LMSYS Chatbot Arena, Command A entered the leaderboard at a respectable but not class-leading position, climbing as high as rank 13 in 2025 but trailing several closed frontier models in raw preference ratings. Artificial Analysis, an independent benchmarking service, reported an Intelligence Index of 13 for Command A on its composite of academic and reasoning benchmarks, which placed the model in the middle of the 2025 flagship pack rather than at the top.[22]
Cohere's public response to the gap between its internal numbers and the LMSYS rankings was to argue that Arena votes are dominated by stylistic preferences and verbose answers, neither of which is what enterprise buyers are paying for. Cohere Labs vice president Sara Hooker described the broader pattern of leaderboard gaming as a "crisis" for the field,[23] and the company co-authored a 2025 paper titled "The Leaderboard Illusion" with researchers from Stanford, Princeton, Waterloo, the University of Washington, MIT, and the Allen Institute. The paper documented private pre-release testing patterns at major frontier labs, including the existence of 27 private Llama 4 variants tested before public release, and argued that the practice systematically advantaged well-resourced labs over open-source providers.[21] Independent evaluations by integrators who tested Command A on internal RAG and agent pipelines tended to report results closer to Cohere's published claims, particularly on long-context tasks and tool-use accuracy.
Why does Command A run on only two GPUs? (Hardware efficiency)
The most distinctive technical claim Cohere made about Command A is that it can be served on as few as two GPUs. In Cohere's reference deployment, this means two H100 SXM modules or two A100 80GB modules running BFloat16 weights.[2] Cohere has explicitly contrasted this with frontier models that require eight or more GPUs of comparable class to serve at the same precision. The 111 billion parameter count at BF16 takes roughly 222 gigabytes of memory before key-value cache, which fits inside two H100 modules with 80 gigabytes each only because Cohere also engineered the attention design and memory layout to keep activations and KV cache compact even at long context.
The efficiency claim is more than a bullet point. Two-GPU serving roughly halves the on-prem hardware footprint for an enterprise that wants to host a model behind its own firewall, and it makes the model accessible to mid-size companies that cannot justify the capital cost of an eight-GPU node per replica. It also has direct consequences for inference economics. Cohere's published throughput numbers, with 73 tokens per second of streaming output on a 100K context request and a peak generation rate of 156 tokens per second, are achieved on this same two-GPU footprint, which is what allows the model to undercut larger competitors on price while remaining profitable for Cohere to serve.[2][8]
For self-hosted deployments, the Hugging Face model card ships with a 128K context configuration by default but documents that the supported context length is 256K and that the configuration can be raised.[4] Quantized variants released through Cohere Labs make it possible to run the model on a single 80 gigabyte GPU at reduced precision, although Cohere reserves its accuracy claims for the BF16 configuration. The technical report emphasizes that the hardware-efficiency story is the result of architecture decisions made early in the design rather than after-the-fact compression: the sliding window plus global attention layout, the choice of dense rather than mixture-of-experts, and the training pipeline were all chosen to optimize for the two-GPU deployment target.[5]
How much does Command A cost, and how is it accessed? (API and pricing)
Command A is accessible through Cohere's hosted API as command-a-03-2025, with the same Chat, RAG, and Tool Use endpoints used by the rest of the Command family.[1] It is also available through Amazon Bedrock and SageMaker, Microsoft Azure AI Foundry, Google Cloud Vertex AI, and Oracle Cloud Infrastructure Generative AI.[17] Each cloud partner exposes the model through its own SDK and billing path, but the underlying weights are the same.
List pricing on Cohere's own platform at launch was set to match the GPT-4o reference rate, which served the company's positioning as a same-price-better-efficiency alternative. The maximum output length is capped at 8,000 tokens per request, which is larger than several peer flagship models but shorter than the unlimited streaming offered by some open-source releases.
| Tier | Input (per 1M tokens) | Output (per 1M tokens) |
|---|---|---|
| Cohere API list | $2.50 | $10.00 |
| Enterprise volume | Negotiated | Negotiated |
| VPC and on-prem | License fee | License fee |
The per-token API rate is identical to GPT-4o's at the time of Command A's launch and to Command R+ 08-2024's refreshed price.[6] Pricing across cloud partners varies slightly depending on the marketplace, with some providers including their own infrastructure markup or volume discounts. Enterprise customers that prefer a flat license over per-token billing can negotiate VPC or on-premises agreements directly with Cohere, in which case the weights are deployed inside the customer's controlled environment and Cohere never touches the inference traffic.[7] This is one of the structural reasons that Cohere wins business in finance, healthcare, and government segments where token-metered SaaS access is not an acceptable model.
The API supports the same parameters as earlier Command R models: system preambles, tool definitions, RAG documents with chunk metadata, citation mode selection, and Safety Modes for adjusting moderation behavior. Existing R-series customers can usually swap the model name and reuse most of their integration code, although Cohere documents some differences in the chat template and recommends a brief evaluation before migrating production workloads.
Is Command A open source? (Licensing)
Command A is released under a split licensing arrangement that has become Cohere's house style. The model weights themselves are distributed on Hugging Face as CohereLabs/c4ai-command-a-03-2025 under the Creative Commons Attribution-NonCommercial 4.0 (CC-BY-NC 4.0) license, together with the Cohere Labs Acceptable Use Policy.[4] This permits research and non-commercial use freely: academics, students, and hobbyists can download the weights and run the model locally on their own hardware without paying Cohere anything.
Commercial use of the open weights is not granted by the CC-BY-NC license. Organizations that want to use Command A in a product or for any other revenue-generating purpose must either call the model through Cohere's hosted API, license it through one of the cloud partner marketplaces, or negotiate a separate commercial agreement with Cohere directly. In practice this means that the open-weight release functions primarily as a research artifact and as a means for prospective enterprise customers to evaluate the model in detail before committing to a paid contract.
The split between "open weights" and "open source" is also worth noting. Cohere publishes the trained weights and a technical report, but it does not release the pretraining dataset, the full training code, or the model-merging recipes used to produce the final checkpoint. By the criteria of the Open Source Initiative, the original Command A release would not qualify as open source. It is closer in spirit to Meta's Llama series than to fully open releases such as the Allen Institute's OLMo models. Cohere has been consistent on this point across the Command R, Command R+, Command R7B, and Command A releases, and the company framed CC-BY-NC as a middle ground that captures community feedback while preserving the commercial value of the model. The company did shift on this question with Command A+ in May 2026, which it released under the OSI-approved Apache 2.0 license, its first model at this capability tier with no downstream commercial restrictions.[26]
What is in the Command A family?
Cohere did not stop at the base Command A model. Over the second half of 2025 and into 2026, the company released four specialized models that share lineage with the original. The first three (Vision, Reasoning, and Translate) reuse the underlying 111B weights and tokenizer but add or repurpose capability, while Command A+ is a larger mixture-of-experts model under a more permissive license. The 2025 variants preserve the two-GPU deployment target and the CC-BY-NC weight release alongside hosted API access.
| Variant | Released | Parameters | Context | Specialty |
|---|---|---|---|---|
| Command A | March 13, 2025 | 111B dense | 256K | General agentic and RAG flagship |
| Command A Vision | July 31, 2025 | 112B | 128K | Image, chart, and document understanding |
| Command A Reasoning | August 21, 2025 | 111B | 256K | Hybrid reasoning with token budget control |
| Command A Translate | August 28, 2025 | 111B | 16K | High-fidelity machine translation |
| Command A+ | May 20, 2026 | 218B MoE (25B active) | 128K | Apache 2.0 flagship for sovereign deployments |
Command A Vision pairs the 111 billion parameter Command A text tower with a SigLIP2 vision encoder, taking the total parameter count to roughly 112 billion. The vision variant accepts up to 20 images per request (or 20MB total) within a 128K context window and an 8K maximum output, and supports English, Portuguese, Italian, French, German, and Spanish rather than the full 23-language set, reflecting where document-understanding training data was strongest.[10] Cohere reported an average score of 83.1 percent across nine benchmarks, beating GPT-4.1 at 78.6 percent, Llama 4 Maverick at 80.5 percent, and Mistral Medium 3 at 78.3 percent on the same evaluations. The variant leads by 7.3 points over GPT-4.1 on DocVQA and by 6.7 points on OCRBench, two benchmarks that emphasize structured-document and OCR-style reasoning, although it trails on the MMMU academic-knowledge benchmark with a score of 65.3 percent against GPT-4.1's 74.8 percent.[14] The vision tower is deployed on the same two-A100 footprint as the base model.
Command A Reasoning was Cohere's first dedicated reasoning model. It introduces a token_budget parameter that lets developers cap the number of thinking tokens the model generates before its final answer, trading deliberation for latency and cost. When the budget is exceeded, the model halts its chain-of-thought and produces a response immediately.[11] The variant retains the 256K context window and is targeted at customer-service workflows, complex multi-step agent tasks, and decision-support scenarios where a few extra seconds of reasoning materially improve answer quality.[15] Like the base model, it is hybrid: developers can also disable thinking entirely and run it as a fast non-reasoning chat model on the same weights.
Command A Translate is the most specialized of the three 2025 variants. It was tuned for high-fidelity translation across the same 23 languages and ships with a shorter 16K context window appropriate for document-translation workloads rather than long-context reasoning.[12] Cohere claimed at launch that Command A Translate outperforms GPT-5, DeepSeek V3, DeepL Pro's LLM-backed product, and Google Translate across the supported language pairs, citing internal benchmarks scored with the MetricX-24-XL automatic translation metric.[19] The company also submitted a system called CommandA-WMT to the WMT 2025 shared task, augmenting the production translation model with Minimum Bayes Risk decoding and a step-by-step reasoning post-edit pass.
Command A+, released as command-a-plus-05-2026 on May 20, 2026, marked the biggest architectural departure in the family. Where the original Command A is dense, Command A+ is a sparse mixture-of-experts model with 218 billion total parameters and 25 billion active per token, and it ships with a 128K input context and 64K maximum output.[26] Cohere expanded language coverage to 48 languages, including all official European Union languages, and retained the native inline-citation feature that defines the Command line. Through a nearly lossless W4A4 quantization scheme, Cohere reports that Command A+ runs on a single NVIDIA Blackwell B200 or just two H100 GPUs, and that it delivers up to 110 percent higher throughput and 30 percent lower latency than Command A Reasoning.[26] Most significantly for the open-source community, Command A+ was Cohere's first frontier-tier model released under the permissive Apache 2.0 license with no downstream commercial restrictions, positioned for what the company calls sovereign critical infrastructure.[26]
How has the community used Command A?
The Hugging Face release of CohereLabs/c4ai-command-a-03-2025 quickly accumulated downstream artifacts.[4] Within weeks of launch, third-party packagers including Unsloth, Bartowski, and LM Studio Community had published GGUF-quantized builds at precisions ranging from 2-bit to 8-bit, allowing the model to run on consumer or single-GPU setups at the cost of accuracy. Inference frameworks such as llama.cpp, vLLM, and TGI added support for the hybrid sliding-window plus global attention pattern in the months after release, which had been a sticking point for early adopters because the unusual attention layout required framework-level changes rather than configuration tweaks.
Fine-tuning interest on the open weights has been moderate rather than large, partly because the CC-BY-NC license forecloses many commercial applications and partly because the 111 billion parameter size makes full-finetune training expensive. Parameter-efficient methods such as LoRA and QLoRA are the more common approach in the community. The Vision variant in particular has been picked up for fine-tuning experiments on document-understanding tasks where its OCR and chart-reading strengths are a useful starting point. Cohere Labs has run periodic community events around the Aya line, which uses Command A as a teacher model through the Fusion distillation procedure, and the Aya releases have provided a venue for academic researchers to engage with the Command stack without needing to license commercial use of the larger model. The Apache 2.0 release of Command A+ in 2026 is expected to broaden commercial fine-tuning of the family, since it removes the non-commercial restriction that had limited downstream production use of the earlier weights.
How does Command A compare to GPT-4o, DeepSeek V3, and other models?
The table below places Command A alongside the other flagship general-purpose models that were available during 2025 and into early 2026, drawing on Cohere's published numbers, vendor documentation, and contemporaneous reporting.
| Model | Release | Parameters | Context | Input price (per 1M) | Output price (per 1M) | Open weights | License |
|---|---|---|---|---|---|---|---|
| Cohere Command A | March 2025 | 111B dense | 256K | $2.50 | $10.00 | Yes | CC-BY-NC 4.0 |
| GPT-4o | May 2024 | Undisclosed | 128K | $2.50 | $10.00 | No | Proprietary |
| Claude 3.7 Sonnet | February 2025 | Undisclosed | 200K | $3.00 | $15.00 | No | Proprietary |
| Claude Sonnet 4 | 2025 | Undisclosed | 200K | $3.00 | $15.00 | No | Proprietary |
| DeepSeek V3 | December 2024 | 671B MoE (37B active) | 128K | Varies | Varies | Yes | MIT-style |
| Llama 3.1 405B | July 2024 | 405B dense | 128K | Varies | Varies | Yes | Llama 3.1 Community License |
| Mistral Large 2 | July 2024 | 123B dense | 128K | $2.00 | $6.00 | Yes | Mistral Research License |
| Mistral Large 3 | December 2025 | 675B MoE (41B active) | 256K | $0.50 | $1.50 | Yes | Apache 2.0 |
A few patterns stand out. Command A is priced identically to GPT-4o while offering double the context window and downloadable weights, which is the headline marketing message. Against DeepSeek V3 it concedes raw parameter count and the more permissive license but argues a hardware-efficiency advantage, since DeepSeek V3 in its native configuration requires substantially more GPU memory to serve at full precision than Command A's two-GPU footprint. Against Llama 3.1 405B, the open-weight comparison is more direct: Llama is roughly 3.6 times larger, requires substantially more memory to serve, and lags on the agentic and grounded-generation tasks that Cohere has built its product around, although Llama's broader community ecosystem and more permissive license remain advantages for many users.
Mistral Large 3, released in December 2025 as Mistral AI's first sparse mixture-of-experts flagship, redrew the competitive landscape in several ways. Its 675 billion parameter total count with 41 billion active per token gave it a higher capacity-to-compute ratio than Command A, its Apache 2.0 license made it fully open source, and its public list pricing of $0.50 per million input tokens and $1.50 per million output tokens undercut Command A's API by roughly 80 percent. The trade-off is hardware: serving Mistral Large 3 at full precision requires enough GPU memory for all 675 billion parameters to be resident even though only 41 billion are activated per token, which Mistral itself recommends on multi-GPU deployments larger than the two-GPU footprint Cohere targets. For enterprise on-prem deployments where capital expenditure on GPUs is the binding constraint, Command A retains an efficiency edge; for hosted API workloads where the per-token bill matters more than infrastructure, Mistral Large 3 has the cleaner economics. Cohere's own answer to the open-source-license question arrived in May 2026 with Command A+, which moved to Apache 2.0 while keeping the small-footprint deployment story intact.[26]
Against Anthropic's Claude line, Command A occupies a different niche. Claude 3.7 Sonnet and the Claude Sonnet 4 family from 2025 are priced at a premium to Command A and ship without downloadable weights, but they remain ahead on the academic chat benchmarks that drive Arena rankings and on long-form writing quality. Cohere's marketing has been explicit that Claude is not the comparison the company wants to encourage, since Claude is built for general assistant behavior across consumer and enterprise contexts and Command A is built for tool-using enterprise agents that need grounded citations.
The Gemini 2.5 family from Google released later in 2025 is a different kind of competitor again, with very long context windows and tight integration into Google Cloud, but its weights are not available for download. Direct head-to-head numbers between Command A and the Gemini 2.5 family were not part of Cohere's launch materials, so this article does not assert specific benchmark comparisons.
How was Command A received?
Coverage of the Command A launch focused heavily on the two-GPU efficiency claim, which functioned as a clear, quantifiable contrast with the larger and more compute-hungry frontier models. VentureBeat's coverage led with the framing that Cohere was targeting global enterprises with a highly multilingual model that requires only two GPUs,[13] and HPCwire used the headline "max performance, minimal compute" directly from Cohere's marketing.[16] Trade press across the financial-services and healthcare verticals picked up on the on-premises deployment story, which fit with existing narratives about regulated industries preferring vendors that offered hosted, VPC, and on-prem options under one product line.
Developer reaction on Hugging Face and Reddit was generally positive but cautious. Practitioners noted that the agentic and citation-heavy use cases were real strengths, particularly the model's tendency to refuse to fabricate citations when its grounding context did not actually support a claim. The 256K context window was widely tested and held up well for long-document tasks, although users sometimes ran into the default 128K configuration in the Hugging Face model card and had to update the configuration to access the full window.[4] The CC-BY-NC license drew the same criticism it had drawn for earlier Command R releases: research-friendly but not usable for production deployment outside Cohere's commercial channels. For purists in the open-source community this was a continuing disappointment; for enterprise buyers comparing it with fully proprietary alternatives it was largely a non-issue.
On the leaderboard side, Command A's debut on the LMSYS Chatbot Arena landed below several closed frontier models, which prompted some commentary that Cohere's vendor-published benchmarks did not fully transfer to user-preference contexts. Cohere acknowledged the gap and reiterated its position that Arena ratings reward stylistic verbosity and that the agentic and BFCL-style evaluations were a better fit for the enterprise audience the model was designed for. The release of the "Leaderboard Illusion" paper later in 2025, which Cohere Labs co-authored, gave that response sharper rhetorical edges and turned the LMSYS gap into a broader argument about the credibility of crowd-sourced evaluation.[21] Independent evaluations by integrators who tested the model on internal RAG and agent pipelines tended to report results closer to Cohere's published claims, particularly on long-context tasks and tool-use accuracy.
Follow-on releases extended the Command A line into specialized variants. Command A Vision, released in July 2025, added image input as Cohere's first multimodal Command model.[10] Command A Reasoning, announced in August 2025, was Cohere's first dedicated reasoning model, intended to think before generating final outputs and aimed at customer-service and complex enterprise tasks.[15] Command A Translate, released the same month, was a specialized translation model covering the same 23-language set with a 16K context window optimized for translation workloads.[18] In May 2026 Command A+ brought a mixture-of-experts architecture and an Apache 2.0 license to the family.[26] The fact that Cohere chose to extend the Command A line rather than launch a numbered successor suggests that the base model held up well in production through the second half of 2025 and into 2026.
See also
- Cohere
- Aidan Gomez
- Command R
- Command R+
- Command A Vision
- Command A Reasoning
- Command A Translate
- Retrieval-Augmented Generation
- Large Language Model
- Transformer
- Tool use (AI)
- Agentic AI
- Mixture of Experts
- GPT-4o
- Claude 3.7 Sonnet
- DeepSeek V3
- Llama 3.1
- Mistral Large
- MMLU
- Berkeley Function Calling Leaderboard
- Tau-bench
- Rotary Position Embedding
- Hugging Face
- Open Source AI
- Toronto
References
- Cohere. (2025). "Command A." Cohere Documentation. https://docs.cohere.com/docs/command-a ↩
- Cohere. (2025). "Introducing Command A: Max performance, minimal compute." Cohere Blog, March 13, 2025. https://cohere.com/blog/command-a ↩
- Cohere. (2025). "Announcing Command A." Cohere Changelog. https://docs.cohere.com/v2/changelog/command-a
- Cohere Labs. (2025). "c4ai-command-a-03-2025 Model Card." Hugging Face. https://huggingface.co/CohereLabs/c4ai-command-a-03-2025 ↩
- Cohere et al. (2025). "Command A: An Enterprise-Ready Large Language Model." arXiv:2504.00698. https://arxiv.org/abs/2504.00698 ↩
- Cohere. (2025). "Pricing." https://cohere.com/pricing ↩
- Cohere. (2025). "Deployment Options." https://cohere.com/deployment-options ↩
- Dataconomy. (2025). "Cohere's 111B-parameter AI model can run on just two GPUs." March 17, 2025. https://dataconomy.com/2025/03/17/cohere-111b-parameter-ai-model-can-run-on-just-two-gpus/ ↩
- Cohere. (2025). "Safety Modes." https://docs.cohere.com/docs/safety-modes ↩
- Cohere. (2025). "Announcing Cohere's Command A Vision Model." Cohere Changelog, July 31, 2025. https://docs.cohere.com/v1/changelog/2025-07-31-command-a-vision ↩
- Cohere. (2025). "Cohere's Command A Reasoning Model." https://docs.cohere.com/docs/command-a-reasoning ↩
- Cohere. (2025). "Cohere's Command A Translate Model." https://docs.cohere.com/docs/command-a-translate ↩
- VentureBeat. (2025). "Cohere targets global enterprises with new highly multilingual Command A model requiring only 2 GPUs." March 13, 2025. https://venturebeat.com/ai/cohere-targets-global-enterprises-with-new-highly-multilingual-command-a-model-requiring-only-2-gpus ↩
- VentureBeat. (2025). "New vision model from Cohere runs on two GPUs, beats top-tier VLMs on visual tasks." https://venturebeat.com/ai/new-vision-model-from-cohere-runs-on-two-gpus-beats-top-tier-vlms-on-visual-tasks ↩
- VentureBeat. (2025). "Don't sleep on Cohere: Command A Reasoning, its first reasoning model, is built for enterprise customer service and more." https://venturebeat.com/ai/dont-sleep-on-cohere-command-a-reasoning-its-first-reasoning-model-is-built-for-enterprise-customer-service-and-more ↩
- HPCwire. (2025). "Cohere Introduces Command A Model for Max Performance, Minimal Compute." March 13, 2025. https://www.hpcwire.com/aiwire/2025/03/13/cohere-introduces-command-a-model-for-max-performance-minimal-compute/ ↩
- Oracle. (2025). "Cohere Command A on OCI Generative AI." https://docs.oracle.com/en-us/iaas/Content/generative-ai/cohere-command-a-03-2025.htm ↩
- Cohere. (2025). "Announcing Command A Translate." Cohere Changelog, August 28, 2025. https://docs.cohere.com/changelog/2025-08-28-command-a-translate ↩
- Slator. (2025). "Cohere Targets Enterprise AI Translation with Command A Translate." https://slator.com/cohere-enterprise-ai-translation-command-a-translate/ ↩
- TechCrunch. (2025). "Cohere hits $7B valuation a month after its last raise, partners with AMD." September 24, 2025. https://techcrunch.com/2025/09/24/cohere-hits-7b-valuation-a-month-after-its-last-raise-partners-with-amd ↩
- Singh et al. (2025). "The Leaderboard Illusion." arXiv:2504.20879. https://arxiv.org/abs/2504.20879 ↩
- Artificial Analysis. (2025). "Command A - Intelligence, Performance & Price Analysis." https://artificialanalysis.ai/models/command-a ↩
- BetaKit. (2025). "Cohere Labs head calls 'unreliable' AI leaderboard rankings a 'crisis' in the field." https://betakit.com/cohere-labs-head-calls-unreliable-ai-leaderboard-rankings-a-crisis-in-the-field/ ↩
- Wikipedia. (2025). "Aidan Gomez." https://en.wikipedia.org/wiki/Aidan_Gomez ↩
- Wikipedia. (2025). "Cohere." https://en.wikipedia.org/wiki/Cohere ↩
- Cohere. (2026). "Announcing Cohere's Command A+." Cohere Changelog, May 20, 2026. https://docs.cohere.com/changelog/command-a-plus-05-2026 ↩
Improve this article
Add missing citations, update stale details, or suggest a clearer explanation. Every suggestion is reviewed for sourcing before it goes live.
4 revisions by 1 contributors · full history