AI Accelerator
An AI accelerator is hardware designed or configured to execute artificial intelligence and machine learning workloads more efficiently than a general-purpose processor executing the same workload without…
AI Inference
Explore AI Inference through related topics and the articles other pages reference most.
Explore articles
Browse subtopics: AI Compute
Articles that also belong to these categories. Counts cover all of AI Inference.
All articles (120)AI Hardware (32)AI Infrastructure (32)AI Compute (23)Developer Tools (22)Large Language Models (21)Open Source AI (21)AI Companies (14)Machine Learning (11)NVIDIA (11)Deep Learning (9)Training & Optimization (8)MLOps (7)AI Models (5)Chinese AI (5)Model Architecture (4)Reasoning Models (4)Algorithms (3)Meta AI (3)Reinforcement Learning (3)AI Alignment (2)AI Research (2)AI Tools & Products (2)Anthropic (2)Artificial Intelligence (2)Data Centers (2)Edge computing (2)Google (2)Information Retrieval (2)AI Benchmarks (1)AI Safety (1)AI for Science (1)Computer Science (1)Consumer AI Devices (1)Diffusion Models (1)Enterprise AI (1)Generative AI (1)Image Generation (1)Microsoft (1)Mixture of Experts (1)Multimodal AI (1)Natural Language Processing (1)OpenAI (1)People (1)Prompt Engineering (1)Small Language Models (1)Software Development (1)Speech & Audio AI (1)Statistics (1)Transformer Models (1)Video Generation (1)
Showing 1-23 of 23 articles
AMD Instinct MI350P
The AMD Instinct MI350P is a PCIe add-in card built on AMD's CDNA 4 architecture, introduced on May 7, 2026 as the third member of the Instinct MI350 series and the first AMD Instinct product in a conventional…
AWS Inferentia
AWS Inferentia is a family of custom application specific integrated circuits (ASICs) designed by Amazon Web Services for machine learning inference in the cloud, built to deliver, in AWS's words, "high…
Etched Sohu
Sohu is a transformer-specialized application-specific integrated circuit (ASIC) built by Etched, a Silicon Valley AI hardware startup founded in 2022 by Harvard dropouts Gavin Uberti, Chris Zhu, and Robert…
FP4 (4-bit floating point)
FP4 (4-bit floating point) is a numerical format that stores a real number in just 4 bits, the smallest floating-point type in mainstream use for deep learning.
Google TPU 8i
Google TPU 8i is an eighth-generation Tensor Processing Unit from Google, built specifically for AI inference rather than model training.
Groq Hardware
Groq hardware is a family of artificial-intelligence accelerators and multi-chip systems built around a statically scheduled streaming architecture.
Humming
Humming is an open-source GPU kernel library for matrix multiplication in quantized inference.
InferenceX
InferenceX, launched in October 2025 under the name InferenceMAX, is an open-source benchmark that continuously measures large language model inference performance across AI accelerators and serving software.
Intel Crescent Island
Intel Crescent Island is a data-center GPU from Intel built for artificial-intelligence inference workloads.
MTIA
MTIA (Meta Training and Inference Accelerator) is a family of custom silicon chips that Meta designs for use in its own data centers rather than for sale.
NVIDIA Groq LPX Rack
NVIDIA Groq 3 LPX is a rack-scale inference accelerator that NVIDIA introduced at GTC 2026, built around 256 Groq Language Processing Units and designed to sit beside Vera Rubin NVL72 racks as a dedicated…
NVIDIA Rubin CPX
NVIDIA Rubin CPX is a class of GPU announced by NVIDIA on September 9, 2025, purpose-built to accelerate the compute-heavy "context" phase of large-model inference.
Neural Processing Unit
A neural processing unit (NPU) is a processor, or a block inside a larger chip, designed specifically to run neural network inference at high throughput and low power.
Positron AI
Positron AI is an American semiconductor startup headquartered in Reno, Nevada, that designs and manufactures purpose-built hardware for transformer inference.
Qualcomm AI200
Qualcomm AI200 is a rack-scale data-center accelerator for artificial intelligence inference, announced by Qualcomm on 27 October 2025 and slated for commercial availability in 2026.
Qualcomm AI250
Qualcomm AI250 is a planned data-center artificial intelligence inference accelerator and rack-scale system announced by Qualcomm in late October 2025.
Rebellions REBEL-Quad
REBEL-Quad is a chiplet-based AI inference accelerator developed by Rebellions, a South Korean AI-chip company.
Tenstorrent Galaxy Blackhole
Tenstorrent Galaxy Blackhole is an AI inference server built by Tenstorrent, the fabless semiconductor company led by chief executive Jim Keller.
Unconventional AI
Unconventional AI (legally Unconventional, Inc.) is an American AI hardware startup, headquartered in Mountain View, California, that is trying to build computers for artificial intelligence that compute with…
d-Matrix
d-Matrix is a privately held American semiconductor company headquartered in Santa Clara, California that builds accelerators, I/O cards and software for AI inference in data centers.
d-Matrix Corsair
Corsair is the first commercial AI accelerator product from d-Matrix, a Silicon Valley AI inference hardware startup based in Santa Clara, California.
d-Matrix Raptor
Raptor is the second-generation AI inference accelerator from d-Matrix, a Santa Clara semiconductor startup, and the first commercial chip built on the company's 3D stacked digital in-memory compute technology