AI Inference

Explore AI Inference through related topics and the articles other pages reference most.

Explore articles

Reset filters
Browse subtopics: AI Hardware

Articles that also belong to these categories. Counts cover all of AI Inference.

Showing 1-35 of 35 articles

AI Accelerator

An AI accelerator is hardware designed or configured to execute artificial intelligence and machine learning workloads more efficiently than a general-purpose processor executing the same workload without…

AI ComputeAI Hardware

AMD Instinct MI350P

The AMD Instinct MI350P is a PCIe add-in card built on AMD's CDNA 4 architecture, introduced on May 7, 2026 as the third member of the Instinct MI350 series and the first AMD Instinct product in a conventional…

AI ComputeAI Hardware

AWS Inferentia

AWS Inferentia is a family of custom application specific integrated circuits (ASICs) designed by Amazon Web Services for machine learning inference in the cloud, built to deliver, in AWS's words, "high…

AI ComputeAI Hardware

Edge TPU

The Edge TPU is a small application-specific integrated circuit (ASIC) designed by Google to run machine learning inference on low-power devices.

AI HardwareEdge computing

Etched Sohu

Sohu is a transformer-specialized application-specific integrated circuit (ASIC) built by Etched, a Silicon Valley AI hardware startup founded in 2022 by Harvard dropouts Gavin Uberti, Chris Zhu, and Robert…

AI ComputeAI Hardware

FP8

FP8 is a family of 8-bit floating-point number formats used to accelerate deep learning training and inference, built around two encodings, E4M3 (4 exponent bits, 3 mantissa bits) and E5M2 (5 exponent bits, 2…

AI ComputeAI Hardware

FPGA

A field-programmable gate array (FPGA) is an integrated circuit whose logic functions and internal wiring are set by the customer after the chip has been manufactured, and can be reset later.

AI HardwareAI Infrastructure

Google TPU 8i

Google TPU 8i is an eighth-generation Tensor Processing Unit from Google, built specifically for AI inference rather than model training.

AI ComputeAI Hardware

Groq Hardware

Groq hardware is a family of artificial-intelligence accelerators and multi-chip systems built around a statically scheduled streaming architecture.

AI ComputeAI Hardware

InferenceX

InferenceX, launched in October 2025 under the name InferenceMAX, is an open-source benchmark that continuously measures large language model inference performance across AI accelerators and serving software.

AI BenchmarksAI Compute

MTIA

MTIA (Meta Training and Inference Accelerator) is a family of custom silicon chips that Meta designs for use in its own data centers rather than for sale.

AI ComputeAI Hardware

MXFP4

MXFP4 (Microscaling FP4) is a 4-bit block-scaled number format for quantization in machine learning, defined in the Open Compute Project (OCP) Microscaling Formats (MX) Specification v1.0 of September 2023.

AI HardwareMachine Learning

NVIDIA DGX Spark

NVIDIA DGX Spark is a compact, deskside AI development system, marketed by NVIDIA as a "personal AI supercomputer," that puts a Grace Blackwell superchip on a desktop and delivers up to 1 petaFLOP (1,000 TOPS)…

AI ComputeAI Hardware

NVIDIA Groq LPX Rack

NVIDIA Groq 3 LPX is a rack-scale inference accelerator that NVIDIA introduced at GTC 2026, built around 256 Groq Language Processing Units and designed to sit beside Vera Rubin NVL72 racks as a dedicated…

AI ComputeAI Hardware

NVIDIA Picasso

NVIDIA Picasso is a cloud-based generative AI foundry from NVIDIA for building, training, and deploying visual generative models that produce images, video, and 3D content from text prompts.

AI HardwareAI Infrastructure

NVIDIA Rubin CPX

NVIDIA Rubin CPX is a class of GPU announced by NVIDIA on September 9, 2025, purpose-built to accelerate the compute-heavy "context" phase of large-model inference.

AI ComputeAI Hardware

On-device AI

On-device AI is the practice of running machine learning models on the phone, laptop, watch, or embedded board a person is actually using, instead of sending the input to a remote data center.

AI HardwareMachine Learning

Positron AI

Positron AI is an American semiconductor startup headquartered in Reno, Nevada, that designs and manufactures purpose-built hardware for transformer inference.

AI CompaniesAI Compute

Qualcomm AI200

Qualcomm AI200 is a rack-scale data-center accelerator for artificial intelligence inference, announced by Qualcomm on 27 October 2025 and slated for commercial availability in 2026.

AI ComputeAI Hardware

Qualcomm AI250

Qualcomm AI250 is a planned data-center artificial intelligence inference accelerator and rack-scale system announced by Qualcomm in late October 2025.

AI ComputeAI Hardware

SRAM

SRAM, or static random-access memory, is a semiconductor memory that stores each bit in a latch built from cross-coupled inverters.

AI HardwareAI Infrastructure

Unconventional AI

Unconventional AI (legally Unconventional, Inc.) is an American AI hardware startup, headquartered in Mountain View, California, that is trying to build computers for artificial intelligence that compute with…

AI CompaniesAI Compute

Zettascale Computing

Zettascale Computing (Zettascale Computing Corp., or "zscc" for short, in the company's own usage) is a San Francisco startup that designs reconfigurable AI chips it calls XPUs.

AI CompaniesAI Hardware

d-Matrix

d-Matrix is a privately held American semiconductor company headquartered in Santa Clara, California that builds accelerators, I/O cards and software for AI inference in data centers.

AI CompaniesAI Compute

d-Matrix Corsair

Corsair is the first commercial AI accelerator product from d-Matrix, a Silicon Valley AI inference hardware startup based in Santa Clara, California.

AI ComputeAI Hardware

d-Matrix Raptor

Raptor is the second-generation AI inference accelerator from d-Matrix, a Santa Clara semiconductor startup, and the first commercial chip built on the company's 3D stacked digital in-memory compute technology

AI ComputeAI Hardware