AMD Instinct MI325X

The AMD Instinct MI325X is a data center GPU accelerator from AMD for AI training and inference, built on the CDNA 3 architecture with 256 GB of HBM3E memory and 6 TB/s of memory bandwidth, making it the highest-capacity production AI accelerator at its October 2024 launch.^[1] It is a mid-cycle refresh of the AMD Instinct MI300X that keeps the same compute dies but swaps HBM3 for denser, faster HBM3E, giving 1.8x the memory capacity and 1.3x the memory bandwidth of the NVIDIA H200.^[1] AMD announced it on October 10, 2024 at the Advancing AI 2024 event alongside its 5th generation EPYC server processors.^[2]

The MI325X targets large language model (LLM) inference and training workloads where memory capacity constrains which models can be served on a given number of GPUs. AMD positioned it as a direct answer to the NVIDIA H200 while production shipments of NVIDIA's next-generation Blackwell-based GPUs were still ramping.^[1] "AMD continues to deliver on our roadmap, offering customers the performance they need and the choice they want, to bring AI infrastructure, at scale, to market faster," said Forrest Norrod, AMD executive vice president and general manager of the Data Center Solutions Business Group, at the launch.^[1] Production shipments of the MI325X began in Q4 2024, with broad server platform availability from OEM partners beginning in Q1 2025.^[1]

What is the AMD Instinct MI325X?

The MI325X is a single-package, eight-stack OAM GPU accelerator that combines AMD's CDNA 3 compute silicon with 256 GB of HBM3E. In one sentence: it is AMD's late-2024 memory-upgraded flagship that delivers the largest GPU memory pool of its generation, designed so a single accelerator or a small cluster can hold model weights and key/value caches that would otherwise require more NVIDIA H200 GPUs.^[1] Because it reuses the MI300X compute dies, its peak compute (1,307.4 TFLOPS dense FP16, 2,614.9 TFLOPS dense FP8) is identical to the MI300X, and all of its generational improvement comes from the memory subsystem.^[3][18]

Background: from MI300X to MI325X

AMD introduced the AMD Instinct MI300X in December 2023 as its flagship AI accelerator, packing 192 GB of HBM3 memory across eight stacks onto a single OAM module. The MI300X marked a significant leap from the prior generation MI250X and attracted major cloud customers including Microsoft Azure, which deployed the accelerator to support OpenAI's GPT model serving workloads.

By early 2024, the memory capacity advantage the MI300X held over NVIDIA's H100 SXM5 (80 GB HBM3) had become a genuine selling point: large models that required multiple H100s to serve could sometimes run on a single MI300X or a smaller cluster of MI300Xs. However, NVIDIA's own H200 arrived with 141 GB of HBM3E and narrowed the gap. At its Computex 2024 appearance in June, AMD revealed a roadmap that included the MI325X as a Q4 2024 refresh, followed by the CDNA 4-based MI350 series in 2025.^[16] AMD's Computex announcement had specified 288 GB of HBM3E for the MI325X.^[16] By the October launch the shipping configuration was finalized at 256 GB across eight 32 GB stacks, with the 288 GB capacity point arriving instead on the CDNA 4-based MI355X.^[11]

The MI325X does not introduce new compute dies. AMD made a deliberate architectural decision to keep the same Aqua Vanjaram chip with its eight Compute Dies (XCDs) and four I/O Dies (IODs), fabricated on TSMC's 5nm and 6nm nodes respectively, and redirect engineering effort toward swapping the memory type. Each HBM3 stack was replaced by a denser HBM3E stack, raising per-GPU capacity from 192 GB to 256 GB and per-GPU bandwidth from approximately 5.3 TB/s to 6.0 TB/s.^[18] The result is a chip that an existing MI300X server can adopt with only firmware and cooling updates, since the physical OAM socket and server infrastructure carry over unchanged.

The power envelope, however, did increase. The MI325X has a rated TDP of 1,000 W per OAM module, compared to the MI300X's 750 W.^[3] This 33% rise in power reflects the higher energy draw of HBM3E at elevated bandwidth, and it meaningfully changes the cooling and power delivery requirements for data center deployment.

What architecture does the MI325X use?

The MI325X shares its full compute architecture with the MI300X under AMD's CDNA 3 (Compute DNA 3) generation. The chip contains 153 billion transistors across a multi-chip module (MCM) design.

Chiplet layout

The MI325X uses a 3D-stacked chiplet design with the following die configuration:

• Eight Compute Dies (XCDs): each manufactured on TSMC N5 (5nm), containing the matrix engines, vector units, scalar units, and L2 cache. Each XCD contributes 38 compute units, giving the full chip 304 compute units (1,216 matrix cores) in total.^[3][21]
• Four I/O Dies (IODs): manufactured on TSMC N6 (6nm), handling PCIe connectivity, Infinity Fabric links to peer GPUs, memory controllers, and cache hierarchy.
• Eight HBM3E stacks: mounted directly atop the IODs via through-silicon vias (TSVs), each stack providing 32 GB of capacity and contributing to the 256 GB total.^[3]

This arrangement, sometimes called the Aqua Vanjaram design, places eight compute tiles in a ring around four I/O tiles, with the memory stacks integrated vertically. The 2D footprint fits within the standard Open Accelerator Module (OAM) form factor defined by the Open Compute Project (OCP).^[3]

Compute units and matrix engines

Each compute unit in CDNA 3 contains four Matrix Core engines capable of processing FP8, FP16, BF16, and FP64 matrix multiplications.^[3] AMD refers to these as second-generation Matrix Core engines relative to the CDNA 2 generation. The accelerator does not expose tensor cores in NVIDIA's terminology; AMD's compute unit hierarchy pairs scalar, vector, and matrix operations differently.

At the full 304 compute unit count, the MI325X achieves:

• FP64: 81.7 TFLOPS
• FP32: 163.4 TFLOPS
• FP16/BF16: 1,307.4 TFLOPS
• FP8: 2,614.9 TFLOPS
• FP8 with structured sparsity: approximately 5,229.8 TFLOPS^[3]

These figures match the MI300X's compute performance, since the compute dies are identical.^[18] The bandwidth increase from HBM3E improves throughput for memory-bound operations without changing peak theoretical compute.

Memory subsystem

The HBM3E upgrade is the sole hardware change distinguishing the MI325X from the MI300X. High Bandwidth Memory 3E (HBM3E) is a denser and faster variant of the HBM3 standard, with per-stack density increasing from 24 GB (12-high stacks in the MI300X) to 32 GB (12-high stacks in the MI325X). The memory bus width remains 1,024 bits per stack, but HBM3E operates at higher transfer rates.

The resulting system-level numbers:

• Total capacity: 256 GB
• Total bandwidth: 6.0 TB/s (6,000 GB/s)
• Memory interface width: 8,192 bits (8 stacks x 1,024 bits)
• L2 Infinity Cache: 256 MB^[3][21]

The Infinity Cache sits between the compute dies and the memory stacks and serves as a last-level cache to reduce latency for frequently reused data. Its capacity is unchanged from the MI300X.^[21]

Inter-GPU interconnect

The MI325X uses AMD's Infinity Fabric for GPU-to-GPU communication within a server node. Each OAM module carries seven Infinity Fabric links, each running at 128 GB/s, for an aggregate inter-GPU bandwidth of 896 GB/s per device.^[3] In an eight-GPU node this creates a fully connected topology within a single compute partition, enabling the eight GPUs to share 2.048 TB of pooled HBM3E.^[4]

Infinity Fabric's per-link bandwidth trails NVIDIA's NVLink 4 interconnect, which the H200 uses in the HGX form factor. NVIDIA's NVSwitch 3 fabric in an HGX H200 node provides an all-to-all bisection bandwidth that exceeds what Infinity Fabric delivers at eight GPU scale. AMD has acknowledged this tradeoff: single-GPU and small-cluster advantages from greater memory capacity do not always translate to proportional multi-GPU training speedups because of the interconnect bottleneck.^[5]

The MI325X supports PCIe 5.0 x16 for host CPU communication alongside the Infinity Fabric peer links.^[3]

Why does the MI325X have 256 GB of HBM3E memory?

HBM3E is the third generation of High Bandwidth Memory, ratified by JEDEC in 2023. It raises per-die data rates above the 6.4 Gbps per pin achievable with HBM3 while keeping the same physical interface dimensions. SK Hynix was the first manufacturer to produce HBM3E at volume, with Samsung and Micron following. AMD's choice of supplier for the MI325X HBM3E stacks has not been publicly disclosed. AMD had initially targeted 288 GB using 36 GB stacks but settled on 256 GB across eight 32 GB stacks for the shipping configuration.^[11]

The practical advantage of 256 GB per accelerator is most visible in inference workloads for large models. A fully dense GPT-4-scale model (estimated around 1.8 trillion parameters in some analyses, though the exact count is not public) would require multiple accelerators regardless of memory size. More concretely, models in the 70 billion to 405 billion parameter range fit comfortably in either one or two MI325X GPUs at FP16 precision, whereas they require more H200 GPUs to service comparable batches. Llama 3.1 405B at BF16 occupies roughly 810 GB; four MI325X GPUs cover the model weights with headroom for KV cache, whereas seven H200 GPUs would be needed at equivalent precision.

The 6.0 TB/s bandwidth directly accelerates decode throughput in autoregressive inference. Because each output token requires loading the full model's key/value cache and weight matrices from memory, bandwidth determines tokens-per-second at a given batch size more than compute does in low-to-moderate batch regimes. AMD's internal benchmarks claimed 1.3x higher peak theoretical FP16 and FP8 performance over the H200 when accounting for both the compute units and the bandwidth increase.^[1]

What is the MI325X power and thermal design?

At 1,000 W TDP, the MI325X consumes approximately 33% more power than the MI300X.^[3][18] The maximum transient power is specified at 1.1 kW. This places the MI325X above NVIDIA's H200 SXM5 (700 W), and the absolute figure demands significant infrastructure.

AMD lists two board power configurations:

• Standard OAM: 1,000 W TDP, liquid cooled
• Air cooled variants: lower power configurations available in some OEM server designs

The dominant deployment scenario for the MI325X in high-performance data centers is direct liquid cooling. The OAM form factor plugs into an OCP-compliant Universal Baseboard that routes coolant through integrated cold plates. HPE's ProLiant Compute XD685, one of the first server platforms designed around the MI325X, offered both air and direct liquid cooling configurations in its eight-GPU, 5U chassis.^[8] Supermicro's H14 series similarly provided a liquid-cooled eight-GPU OAM board.

The power increase from 750 W to 1,000 W per GPU means an eight-GPU node draws roughly 8,000 W from the accelerators alone. Combined with host CPU, networking, and storage power, a dense MI325X node can approach 12-14 kW total rack unit demand, requiring power distribution units and facility infrastructure rated accordingly.

AMD and its OEM partners addressed this by retaining physical compatibility with MI300X server chassis wherever possible.^[1] The OAM socket and Universal Baseboard design are unchanged; operators upgrading from MI300X to MI325X primarily need to verify that existing liquid cooling loops can handle the higher thermal load and that power delivery circuits meet the 1,000 W per module spec.

How does the MI325X perform?

How does the MI325X compare to the MI300X?

Because the compute dies are identical, the MI325X's performance gains over the MI300X arise entirely from the memory subsystem upgrade. Operations that are compute-bound (i.e., where the GPU's matrix engines are the bottleneck) see little change. Operations that are memory-bandwidth-bound see gains proportional to the bandwidth increase, approximately 13% improvement in raw bandwidth.^[18]

The capacity increase of 33% (192 GB to 256 GB) yields larger practical gains for workloads that previously required model sharding across GPUs. Running Llama 2 70B inference on a single MI325X is possible at FP16 without tensor parallelism, whereas the same model on an MI300X requires FP8 quantization to fit in 192 GB with typical KV cache overhead. This consolidation reduces inter-GPU communication and simplifies deployment.

AMD's own benchmarking at launch cited a 1.3x improvement in inference throughput for large model serving compared to the MI300X on bandwidth-bound workloads.

MLPerf Inference v5.0

AMD submitted its first MI325X results in the MLPerf Inference v5.0 round, with partner submissions from Supermicro, ASUS, and Gigabyte.^[7] The workloads tested included Llama 2 70B (server and offline scenarios) and Stable Diffusion XL (text-to-image generation).^[7]

On Llama 2 70B, MI325X partner results were within 3% of AMD's reference submission performance, and the accelerator traded blows with the H200 across offline and server scenarios.^[7] The MLPerf submission used FP8 quantization via the OCP FP8-e4m3 format, multi-step vLLM scheduling to reduce CPU overhead, and GEMM tuning targeting critical matrix operations.^[7]

In MLPerf Inference v5.1 (September 2025), AMD submitted the MI355X in addition to the MI325X.^[23] The MI355X delivered 2.7x the tokens per second of the MI325X on Llama 2 70B offline inference, running MXFP4 precision against the MI325X's FP8, reflecting the architectural improvements of CDNA 4 rather than a memory-only change.^[23] The same round also brought MI325X submissions in the new interactive scenario for Llama 2 70B and Mixtral 8x7B, along with partner results on MI325X platforms from ASUS, Giga Computing, MangoBoost, MiTAC, QCT, Supermicro, and Vultr.^[23]

MLPerf Training v5.0

AMD made its first MLPerf Training submission in the v5.0 round, published in June 2025, with results for both the MI325X and the MI300X on the Llama 2 70B LoRA fine-tuning benchmark.^[22] An eight-GPU MI325X system (a Quanta QuantaGrid D74A-7U) completed the fine-tuning workload in 22.04 minutes, roughly 8 percent faster than the 23.97-minute average of comparable eight-GPU NVIDIA H200 submissions in the same round; the eight-GPU MI300X system finished in 29.25 minutes.^[22] AMD attributed the result to full activation checkpointing, optimized FlashAttention kernels, and GEMM tuning through the hipBLASLt library.^[22] Six OEM and ecosystem partners also submitted MLPerf Training results on Instinct MI300-series GPUs in the round, and MangoBoost published a 32-GPU multi-node MI300X result of 10.91 minutes on the same workload.^[22]

How does the MI325X compare to the NVIDIA H200?

The H200 carries 141 GB of HBM3E with 4.8 TB/s bandwidth.^[1] At a single accelerator level, the MI325X's advantages in memory capacity and bandwidth are real: AMD cited 1.8x the memory capacity, 1.3x the memory bandwidth, and 1.3x the peak theoretical FP16 and FP8 compute of the H200.^[1]

Scroll sideways for more →

AMD published a set of single-GPU inference comparisons against the H200 at launch, claiming 1.3x the throughput on Mistral 7B (FP16), 1.2x on Llama 3.1 70B (FP8), and 1.4x on Mixtral 8x7B (FP16).^[1] In terms of peak theoretical TFLOPS, the MI325X's numbers exceed the H200 because CDNA 3's Matrix Core architecture computes at a different ratio of dense operations. However, the H200 uses NVLink 4 and NVSwitch 3 for multi-GPU communication, which provides substantially higher all-to-all bisection bandwidth in eight-GPU nodes. This means MI325X's single-GPU advantage partially erodes in multi-GPU training workloads.^[5]

AMD claimed the MI325X delivered an eight-GPU Llama 2 70B inference throughput within 3 to 7 percent of an equivalent eight-GPU H200 system, and image generation on SDXL within 10 percent of H200.^[24] Independent analysis from The Next Platform noted that single-device advantages in bandwidth mostly held, but scaling efficiency at eight GPUs was limited by Infinity Fabric compared to NVSwitch.^[5]

How does the MI325X compare to the NVIDIA B200?

NVIDIA's Blackwell-based NVIDIA B200 was announced in March 2024 and entered production in late 2024. The B200 belongs to a different performance class: it carries 192 GB of HBM3E with 8.0 TB/s bandwidth and substantially higher FP8 compute (4,500+ TFLOPS), making direct comparisons with the MI325X less favorable for AMD. AMD positioned the MI325X against the H200 explicitly, not against Blackwell.^[5]

Scroll sideways for more →

The MI325X holds a memory capacity edge over the B200, but the B200 exceeds it in bandwidth and compute. AMD's response to Blackwell was the CDNA 4-based MI350 series, not the MI325X.

Who uses the AMD Instinct MI325X?

The MI325X was announced with commercial support from a broad set of OEM server builders and cloud providers.

OEM server platforms

At the Advancing AI 2024 event, AMD confirmed system support from Dell Technologies, Eviden, Gigabyte, Hewlett Packard Enterprise, Lenovo, and Supermicro. Production shipments from AMD started in Q4 2024, with OEM system availability broadening in Q1 2025.^[1]

HPE's ProLiant Compute XD685 was among the first validated platforms. It houses eight MI325X OAM modules alongside two AMD EPYC 9005-series CPUs in a 5U chassis supporting both air and direct liquid cooling.^[8] Supermicro's H14 8U 8-GPU MI325X platform offered a similarly dense configuration with optional liquid cooling.^[13]

Cloud providers

Vultr was the first cloud provider to make MI325X instances commercially available, launching in early 2025 with configurations pairing eight MI325X GPUs and 2.048 TB of pooled HBM3E.^[9][10] Vultr marketed the offering to enterprises that needed large-memory GPU instances for LLM serving, RAG pipelines, and fine-tuning.^[9]

Microsoft Azure had already deployed AMD Instinct MI300X accelerators in its ND MI300X V5 virtual machine series to power Azure OpenAI Service workloads. At the Advancing AI 2024 event, Microsoft was named among the cloud and AI ecosystem partners supporting the MI325X roadmap, though Azure's public MI325X VM SKUs were not announced at that time.^[2]

Oracle Cloud Infrastructure (OCI) has been a consistent AMD Instinct partner for both EPYC CPUs and Instinct accelerators. OCI announced expanded AMD EPYC compute instances at the same event, maintaining its status as a key AMD cloud partner.^[2]

Google Cloud participated in the Advancing AI 2024 ecosystem announcements.^[2] Its primary AMD deployments have been EPYC-based rather than Instinct GPU-based in public disclosures.

Meta was named among customers participating in AMD's launch announcements.^[2] Meta has deployed AMD Instinct accelerators as part of its diversified AI infrastructure strategy. In February 2026, AMD and Meta announced an expanded strategic partnership to deploy 6 gigawatts of AMD Instinct GPUs, beginning with a custom MI450-based accelerator in the second half of 2026; as part of the agreement AMD issued Meta a performance-based warrant for up to 160 million shares tied to shipment milestones.^[29]

TensorWave, a Las Vegas-based AI cloud provider built around AMD accelerators, raised a $100 million Series A round co-led by Magnetar and AMD Ventures in May 2025 to fund a large MI325X training cluster.^[25] In July 2025 the company completed deployment of 8,192 direct liquid-cooled MI325X GPUs, described as the largest AMD GPU training cluster in North America at the time.^[26] In June 2026, TensorWave raised a $350 million Series B at a $1.55 billion valuation, again led by Magnetar and AMD Ventures, to fund expansion into AMD Instinct MI355X clusters.^[27]

Adoption of the accelerator continued through 2025. On its second quarter 2025 earnings call, AMD said it had made "solid progress with MI300 and MI325 in the quarter, closing new wins and expanding adoption with Tier 1 customers, next-generation AI cloud providers and end users".^[28]

By mid-2025, the cloud GPU rental market showed MI325X pricing typically ranging from $2.00 to $2.25 per GPU per hour, compared to H200 pricing of approximately $3.72 to $10.60 per GPU per hour depending on provider and contract terms.^[20] The MI325X's lower rental price, combined with its larger memory, made it attractive for inference workloads that were not compute-bound.

What software does the MI325X run on?

The MI325X runs on AMD's ROCm (Radeon Open Compute) open-source software platform. ROCm provides the GPU runtime, HIP (Heterogeneous Interface for Portability), math libraries (rocBLAS, MIOpen, rocFFT), and communication libraries (RCCL, AMD's equivalent of NCCL).

Framework support covers PyTorch, TensorFlow, and JAX via ROCm backends. vLLM and SGLang, two widely used LLM inference frameworks, added MI300X and MI325X support throughout 2024, making inference deployment accessible without custom kernel development. ROCm 6.x releases during 2024 and into 2025 substantially improved PyTorch and JAX compatibility.

AMD announced ROCm 7 at its Advancing AI event in June 2025, positioning the release around inference performance: the company cited average inference throughput more than 3.5x that of ROCm 6, measured on an eight-GPU MI300X system across Llama 3.1 70B, Qwen2-72B, and DeepSeek-R1, with broad availability following in the third quarter of 2025.^[30][31]

ROCm's software maturity still trails CUDA's in several areas. Most AI frameworks have been developed and optimized for NVIDIA's CUDA ecosystem first. Operators running training workloads at scale reported that achieving performance parity with H200 on MI300X or MI325X required more effort: custom Docker builds, AMD engineering engagement, and manual GEMM tuning.^[15] RCCL, used for collective communication in distributed training, has shown lower efficiency than NCCL for some topology configurations. NVIDIA's tight vertical integration between its networking (InfiniBand, NVLink), communication libraries, and CUDA gave H200 clusters an advantage in multi-node training throughput that was not fully offset by AMD's memory capacity lead.^[15]

For inference workloads with vLLM or SGLang, the ROCm experience in 2024-2025 was substantially more accessible than earlier generations, with most popular models running without modification.

How much does the MI325X cost?

AMD has not published a suggested retail price for the MI325X. Data center GPU accelerators at this tier are sold through OEM channel deals and direct enterprise agreements rather than consumer retail. List prices for the MI300X in the $10,000-$15,000 USD per unit range have been cited by third-party market researchers, and the MI325X is expected to be priced comparably given the incremental nature of the upgrade.

Cloud rental pricing (as of mid-2025) places MI325X instances at approximately $2.00-$2.25 per GPU per hour.^[20] For reference, H200 SXM5 cloud instances on major hyperscalers ranged from roughly $3.72 to higher depending on provider and reservation type.^[20] The more favorable rental economics for the MI325X made it competitive for cost-sensitive inference deployments, particularly when memory capacity requirements ruled out H100.

What are the limitations of the MI325X?

Several limitations have shaped MI325X adoption relative to NVIDIA's offerings.

No architectural compute improvement over MI300X. Because the compute dies are unchanged, the MI325X does not address any compute-bound training workloads better than its predecessor. Customers who needed more raw TFLOPS rather than more memory saw no benefit from upgrading.

Higher power draw. The jump from 750 W to 1,000 W TDP affects total cost of ownership. Data centers optimized for MI300X power budgets need reassessment before deploying MI325X. Liquid cooling infrastructure becomes more strongly recommended rather than optional.

Infinity Fabric scaling ceiling. As noted in independent benchmarks, the Infinity Fabric interconnect limits scaling efficiency at eight-GPU node configurations relative to NVLink 4/NVSwitch 3.^[15] Training on large models that require tight GPU-to-GPU communication sees less benefit from the MI325X's memory advantages.

ROCm ecosystem maturity. Despite improvements in 2024-2025, the ROCm software ecosystem continues to require more operator expertise than CUDA for production deployments. Sparse library support, less mature debugging tooling, and lower community availability of ROCm-specific optimizations create real friction in training pipelines.^[15]

Rapid succession by MI350 series. AMD's MI350X and AMD Instinct MI355X launched in 2025 with CDNA 4 architecture, 288 GB of HBM3E, and 8.0 TB/s bandwidth.^[32] The short interval between MI325X availability and MI355X availability compressed the MI325X's window as AMD's flagship accelerator, and some cloud providers moved to offering MI355X rather than building out MI325X capacity.

No FP4 support. The CDNA 3 architecture does not natively support FP4 or FP6 data types that NVIDIA's Blackwell GPUs and AMD's own CDNA 4 chips added.^[32] For workloads using aggressive quantization to maximize throughput per watt, MI325X is at a disadvantage compared to B200 and MI355X.

What are the MI325X successors?

AMD's accelerator roadmap places the MI325X as the last CDNA 3 product before the CDNA 4-based MI350 series.

AMD Instinct MI350X and MI355X

The MI350X (air-cooled) and AMD Instinct MI355X (liquid-cooled) are built on the CDNA 4 architecture, manufactured on TSMC's 3nm process node.^[32] AMD production shipments of MI350 platforms began in June 2025.^[28] Both share:

• 288 GB HBM3E^[14]
• 8.0 TB/s memory bandwidth^[32]
• Native FP4 and FP6 data type support^[32]
• Up to 4x generational performance improvement (AMD's claimed figures, likely on specific inference workloads)^[14]

In MLPerf Inference v5.1, the MI355X achieved 2.7x the Llama 2 70B tokens per second of the MI325X.^[23] AMD also claims up to 35x faster inference performance versus the MI300X on certain configurations, though these figures represent favorable workload selection.^[16]

AMD Instinct MI400 series

AMD's MI400 series, powered by CDNA "Next" architecture, is planned for 2026 with the "Helios" rack architecture.^[16] AMD has previewed UALink over Ethernet connectivity in the MI400 platform, targeting a 72-accelerator scale-up domain analogous to NVIDIA's NVL72 configuration.^[14] AMD projects up to 10x performance improvement over the MI350 series for AI frontier model workloads.^[14]

At CES 2026 in January, AMD detailed the full MI400 family, including the flagship MI455X for large-scale training and inference, the MI440X for enterprise deployments, and the MI430X.^[34] The MI455X integrates 320 billion transistors with twelve 36 GB HBM4 stacks per GPU, and the Helios rack combines 72 MI455X GPUs with 18 EPYC "Venice" CPUs across 18 compute trays, targeting 2.9 exaFLOPS of FP4 compute per rack, with availability planned for later in 2026.^[33]

Demand for the MI400 generation has been anchored by large 2025-2026 agreements. In October 2025, AMD and OpenAI announced a strategic partnership to deploy 6 gigawatts of AMD Instinct GPUs across multiple generations, beginning with 1 gigawatt of MI450-series capacity in the second half of 2026; AMD issued OpenAI a warrant for up to 160 million shares tied to deployment and share-price milestones.^[35] Oracle followed with plans for a publicly available supercluster of 50,000 MI450-series GPUs on Oracle Cloud Infrastructure beginning in calendar Q3 2026.^[36]

What are the MI325X specifications?

Scroll sideways for more →

See also

• AMD Instinct MI300X - predecessor accelerator
• AMD Instinct MI355X - CDNA 4 successor
• NVIDIA H200 - primary competitive accelerator at launch
• NVIDIA B200 - next-generation NVIDIA accelerator
• HBM3E - High Bandwidth Memory 3E standard
• ROCm - AMD's open-source GPU compute platform
• CDNA 3 - AMD's compute GPU architecture generation
• Open Accelerator Module - OCP OAM form factor standard

References

1. AMD. "AMD Delivers Leadership AI Performance with AMD Instinct MI325X Accelerators." AMD Newsroom, October 10, 2024. https://www.amd.com/en/newsroom/press-releases/2024-10-10-amd-delivers-leadership-ai-performance-with-amd-in.html ↩
2. AMD. "AMD Unveils Leadership AI Solutions at Advancing AI 2024." AMD Newsroom, October 10, 2024. https://www.amd.com/en/newsroom/press-releases/2024-10-10-amd-unveils-leadership-ai-solutions-at-advancing-a.html ↩
3. AMD. "AMD Instinct MI325X Accelerator Data Sheet." https://www.amd.com/content/dam/amd/en/documents/instinct-tech-docs/product-briefs/instinct-mi325x-datasheet.pdf ↩
4. AMD. "AMD Instinct MI325X Platform Data Sheet." https://www.amd.com/content/dam/amd/en/documents/instinct-tech-docs/product-briefs/instinct-mi325x-platform-datasheet.pdf ↩
5. The Next Platform. "AMD Gives Nvidia Some Serious Heat In GPU Compute." October 10, 2024. https://www.nextplatform.com/2024/10/10/amd-gives-nvidia-some-serious-heat-in-gpu-compute/ ↩
6. Tom's Hardware. "AMD's Instinct MI325X smiles for the camera: 256 GB of HBM3E." https://www.tomshardware.com/tech-industry/artificial-intelligence/amds-instinct-mi325x-smiles-for-the-camera-256-gb-of-hbm3e
7. AMD ROCm Blogs. "AMD Instinct MI325X GPUs Produce Strong Performance in MLPerf Inference v5.0." https://rocm.blogs.amd.com/artificial-intelligence/mi325x-accelerates-mlperf-inference/README.html ↩
8. Data Center Dynamics. "HPE, Dell, Lenovo, and Supermicro detail new server offerings featuring AMD's new MI325X GPUs and Epyc CPUs." https://www.datacenterdynamics.com/en/news/hpe-dell-lenovo-and-supermicro-detail-new-server-offerings-featuring-amds-new-mi325x-gpus-and-epyc-cpus/ ↩
9. Vultr. "Announcing the AMD Instinct MI325X Accelerator on Vultr Cloud." https://blogs.vultr.com/MI325X ↩
10. Business Wire. "Vultr Announces Availability of AMD Instinct MI325X GPUs to Power Enterprise AI." February 18, 2025. https://www.businesswire.com/news/home/20250218448181/en/Vultr-Announces-Availability-of-AMD-Instinct-MI325X-GPUs-to-Power-Enterprise-AI ↩
11. VideoCardz.com. "AMD Instinct MI325X to feature 256GB HBM3E memory, CDNA4-based MI355X with 288GB." https://videocardz.com/newz/amd-instinct-mi325x-to-feature-256gb-hbm3e-memory-cdna4-based-mi355x-with-288gb ↩
12. SDxCentral. "AMD details Instinct MI325X GPU, with 256GB of HBM3E." https://www.sdxcentral.com/news/amd-details-instinct-mi325x-gpu-with-256gb-of-hbm3e/
13. Supermicro. "H14 8U 8-GPU MI325X Datasheet." October 2024. https://www.supermicro.com/datasheet/h14/datasheet_H14_8U_8GPU_MI325X.pdf ↩
14. AMD. "AMD Announces MI350X and MI355X AI GPUs." 2025. https://www.amd.com/en/newsroom/press-releases/2025-6-12-amd-unveils-vision-for-an-open-ai-ecosystem-detai.html ↩
15. SemiAnalysis. "MI300X vs H100 vs H200 Benchmark Part 1: Training - CUDA Moat Still Alive." https://newsletter.semianalysis.com/p/mi300x-vs-h100-vs-h200-benchmark-part-1-training ↩
16. AMD. "AMD Accelerates Pace of Data Center AI Innovation and Leadership with Expanded AMD Instinct GPU Roadmap." June 2, 2024. https://www.amd.com/en/newsroom/press-releases/2024-6-2-amd-accelerates-pace-of-data-center-ai-innovation-.html ↩
17. XPU.pub. "Nvidia Blackwell Shines, AMD MI325X Debuts in Latest MLPerf." April 2025. https://xpu.pub/2025/04/07/mlperf-5-0/
18. TensorWave. "MI325X vs MI300X: What's New, What Matters, and Why It Changes Your AI Stack." https://tensorwave.com/blog/mi325x-vs-mi300x-whats-new-what-matters-and-why-it-changes-your-ai-stack ↩
19. flopper.io. "AMD Instinct MI325X OAM GPU Specifications." https://flopper.io/gpu/amd-instinct-mi325x-oam
20. getdeploying.com. "MI325X Cloud Pricing: Compare Providers." https://getdeploying.com/gpus/amd-mi325x ↩
21. AMD ROCm Documentation. "GPU architecture specifications." https://rocm.docs.amd.com/en/latest/reference/gpu-arch-specs.html ↩
22. AMD ROCm Blogs. "AMD's MLPerf Training Debut: Optimizing LLM Fine-Tuning with Instinct GPUs." June 4, 2025. https://rocm.blogs.amd.com/artificial-intelligence/mlperf-training-v5.0/README.html ↩
23. AMD ROCm Blogs. "Technical Dive into AMD's MLPerf Inference v5.1 Submission." September 9, 2025. https://rocm.blogs.amd.com/artificial-intelligence/mlperf-inference-v5.1/README.html ↩
24. Samuel K. Moore. "Nvidia Blackwell Ahead in AI Inference, AMD Second." IEEE Spectrum, April 2, 2025. https://spectrum.ieee.org/ai-inference ↩
25. Business Wire. "TensorWave Secures $100 Million Series A Funding Co-Led by Magnetar and AMD Ventures." May 14, 2025. https://www.businesswire.com/news/home/20250514340458/en/TensorWave-Secures-$100-Million-Series-A-Funding-Co-Led-by-Magnetar-and-AMD-Ventures ↩
26. Tom's Hardware. "TensorWave just deployed the largest AMD GPU training cluster in North America - features 8,192 MI325X AI accelerators tamed by direct liquid-cooling." July 14, 2025. https://www.tomshardware.com/pc-components/gpus/tensorwave-just-deployed-the-largest-amd-gpu-training-cluster-in-north-america-features-8-192-mi325x-ai-accelerators-tamed-by-direct-liquid-cooling ↩
27. Business Wire. "TensorWave Raises $350 Million Series B at $1.55B Valuation to Expand Global AMD-Powered AI Infrastructure." June 10, 2026. https://www.businesswire.com/news/home/20260610650010/en/TensorWave-Raises-$350-Million-Series-B-at-$1.55B-Valuation-to-Expand-Global-AMD-Powered-AI-Infrastructure ↩
28. AMD. "AMD Fiscal Second Quarter 2025 Financial Results - Webcast Transcript." August 5, 2025. https://d1io3yog0oux5.cloudfront.net/_7b2f18b007009eb1081213779b888cdd/amd/db/841/9167/webcast_transcript/amd2q2025.pdf ↩
29. AMD. "AMD and Meta Announce Expanded Strategic Partnership to Deploy 6 Gigawatts of AMD GPUs." February 24, 2026. https://ir.amd.com/news-events/press-releases/detail/1279/amd-and-meta-announce-expanded-strategic-partnership-to-deploy-6-gigawatts-of-amd-gpus ↩
30. AMD. "Enabling the Future of AI: Introducing AMD ROCm 7 and AMD Developer Cloud." June 2025. https://www.amd.com/en/blogs/2025/enabling-the-future-of-ai-introducing-amd-rocm-7-and-the-amd-developer-cloud.html ↩
31. Tom's Hardware. "AMD unveils ROCm 7 - new platform boosts AI performance up to 3.5x, adds Radeon GPU support." June 13, 2025. https://www.tomshardware.com/pc-components/gpus/amd-unveils-rocm-7-new-platform-boosts-ai-performance-up-to-3-5x-adds-radeon-gpu-support ↩
32. The Register. "AMD zeroes in on Nvidia's Blackwell with MI350-series GPUs." June 12, 2025. https://www.theregister.com/2025/06/12/amd_mi355x/ ↩
33. ServeTheHome. "AMD's EPYC Venice, Instinct MI455X, & Helios Hardware On Display for First Time at CES 2026." January 7, 2026. https://www.servethehome.com/amds-epyc-venice-instinct-mi455x-helios-hardware-on-display-for-first-time-at-ces-2026/ ↩
34. Tom's Hardware. "AMD touts Instinct MI430X, MI440X, and MI455X AI accelerators and Helios rack-scale AI architecture at CES - full MI400-series family fulfills a broad range of infrastructure and customer requirements." January 6, 2026. https://www.tomshardware.com/tech-industry/artificial-intelligence/amd-touts-instinct-mi430x-mi440x-and-mi455x-ai-accelerators-and-helios-rack-scale-ai-architecture-at-ces-full-mi400-series-family-fulfills-a-broad-range-of-infrastructure-and-customer-requirements ↩
35. AMD. "AMD and OpenAI Announce Strategic Partnership to Deploy 6 Gigawatts of AMD GPUs." October 6, 2025. https://ir.amd.com/news-events/press-releases/detail/1260/amd-and-openai-announce-strategic-partnership-to-deploy-6-gigawatts-of-amd-gpus ↩
36. Oracle. "Oracle and AMD Expand Partnership to Help Customers Achieve Next-Generation AI Scale." October 14, 2025. https://www.oracle.com/news/announcement/ai-world-oracle-and-amd-expand-partnership-to-help-customers-achieve-next-generation-ai-scale-2025-10-14/ ↩