AI Infrastructure

AI Accelerator Comparison (H100 vs B200 vs MI300 vs TPU)

As of July 2026, the best AI accelerator depends on the metric you care about, so the honest answer to "H100 vs B200 vs MI300 vs TPU" is not a single winner....

AI HardwareData Centers

AI Infrastructure

AI infrastructure is the stack of hardware, facilities, and software that trains and serves artificial intelligence models: accelerator chips, the servers and...

AI accelerator

An AI accelerator (also called an AI chip or neural processing unit) is a class of specialized hardware designed to run artificial intelligence workloads,...

AI HardwareDeep Learning

AI energy consumption

AI energy consumption is the electricity, and the associated water, land, and emissions, required to train and operate artificial intelligence systems,...

AI Energy

AMD Helios

AMD Helios is a rack-scale artificial intelligence system from AMD that packages a full rack of 72 Instinct MI400 series GPUs, AMD EPYC "Venice" CPUs, and...

AI Hardware

AMD Instinct MI300X

The AMD Instinct MI300X is a data center GPU accelerator that Advanced Micro Devices released on December 6, 2023, built on the CDNA 3 architecture and paired...

AI HardwareData Centers

AMD Instinct MI325X

The AMD Instinct MI325X is a data center GPU accelerator from AMD for AI training and inference, built on the CDNA 3 architecture with 256 GB of HBM3E memory...

AI HardwareData Centers

AMD Instinct MI355X

The AMD Instinct MI355X is a data center GPU accelerator built on AMD's CDNA 4 architecture, announced at the AMD Advancing AI 2025 event on June 12, 2025,[1]...

AI HardwareData Centers

AQLM (Additive Quantization of Language Models)

AQLM, short for Additive Quantization of Language Models, is a weight-only post-training quantization method that compresses the weights of a large language...

Machine Learning

AWS Trainium

AWS Trainium is a family of custom machine learning accelerator chips designed by Annapurna Labs for Amazon Web Services, purpose-built for training and,...

AI Hardware

AWS Trainium 2

AWS Trainium 2 (also written as Trainium2 and abbreviated Trn2) is the second generation of Amazon Web Services' custom machine learning training accelerator,...

AI CompaniesAI Hardware

AWS Trainium 3

AWS Trainium 3 (also written as Trainium3 and abbreviated Trn3) is the third-generation custom AI training and inference accelerator from Amazon Web Services,...

AI Hardware

Abilene data center (Stargate)

The Abilene data center, also called the Crusoe Abilene Stargate Campus or Stargate I, is the flagship artificial intelligence data center of the Stargate...

OpenAI

Actor model

The actor model is a mathematical model of concurrent computation whose universal primitive is the actor: an autonomous, isolated entity that owns private...

Computer ScienceProgramming Languages

Agent Payments Protocol (AP2)

The Agent Payments Protocol (AP2) is an open specification that lets autonomous AI agents initiate, authorize, and settle payments on behalf of human users. It...

AI AgentsAgentic Commerce

Alexandr Wang

Alexandr Wang (born January 1997) is an American entrepreneur who co-founded Scale AI in 2016 and, in June 2025, became the first Chief AI Officer of Meta,...

AI CompaniesPeople

Alibaba AI

Alibaba AI refers to the artificial-intelligence work of Alibaba Group Holding Limited, a Chinese multinational technology conglomerate headquartered in...

AI CompaniesChinese AI

Amazon Nova

Amazon Nova is a family of foundation models developed by Amazon and offered through Amazon Bedrock, announced on December 3, 2024, at the AWS re:Invent...

Artificial IntelligenceGenerative AI

Amazon Q

Amazon Q is a family of generative AI-powered assistants from Amazon Web Services (AWS), announced on November 28, 2023, at the AWS re:Invent conference and...

AI Code GenerationArtificial Intelligence

Amazon SageMaker

Amazon SageMaker is Amazon Web Services' fully managed machine learning platform for building, training, and deploying models at scale, first launched at AWS...

AI Tools & ProductsMachine Learning

Amazon Web Services

Amazon Web Services (AWS) is the cloud computing division of Amazon, the world's largest provider of public cloud infrastructure, and one of the two dominant...

Andrew Tulloch

Andrew Tulloch is an Australian machine-learning researcher and engineer known for building large-scale machine-learning infrastructure at Meta (formerly...

People

Anthropic-Amazon Trainium expansion

The Anthropic-Amazon Trainium expansion is an enlarged compute and investment agreement between Anthropic and Amazon, announced on 20 April 2026, under which...

AnthropicData Centers

Anthropic-Google TPU deal

The Anthropic-Google TPU deal is a set of escalating compute and investment agreements between the AI lab Anthropic and Google Cloud, built around Anthropic...

AnthropicGoogle

Anyscale

Private Industry 2019; Berkeley, California Founders San Francisco, California, United States CEO Ray (open-source distributed computing framework) ...

AI Companies

Apache MXNet

Apache MXNet (pronounced "mix-net") was an open-source deep learning framework that combined imperative and symbolic execution in one runtime, created around...

Artificial IntelligenceDeveloper Tools

Applied Digital

Applied Digital Corporation (Nasdaq: APLD) is a United States designer, builder, and operator of large data centers for artificial intelligence and...

AI Companies

Automatic Differentiation

Automatic differentiation (abbreviated AD, also called algorithmic differentiation, autodiff, or autograd) is a family of techniques for computing exact...

Machine LearningMathematics

Baseten

Baseten is an inference platform for deploying, serving, and scaling machine learning models in production. The company converts ML models into...

AI CompaniesMLOps

Blackhole (Tenstorrent)

Blackhole is the third-generation AI accelerator architecture from Tenstorrent, the Toronto and Santa Clara based fabless semiconductor company led by CEO Jim...

AI Hardware

Bloom Energy

Bloom Energy Corporation (NYSE: BE) is an American power-generation company based in San Jose, California, that designs and manufactures solid oxide fuel...

AI Energy

Broadcom Tomahawk 6

The Broadcom Tomahawk 6 is an Ethernet switch chip built for the networks that connect large clusters of AI accelerators. Broadcom announced it on June 3,...

AI Hardware

CANN (Huawei)

CANN, short for Compute Architecture for Neural Networks, is the heterogeneous computing architecture and software stack that Huawei provides for its Ascend...

Chinese AIDeveloper Tools

CUDA

CUDA (Compute Unified Device Architecture) is NVIDIA's parallel computing platform and programming model that lets developers run general-purpose code on a...

Developer ToolsNVIDIA

CUTLASS

CUTLASS is an open-source library of reusable building blocks for writing high-performance matrix kernels on NVIDIA GPUs. The name expands to CUDA Templates...

Developer ToolsNVIDIA

Cerebras WSE-3

The Cerebras WSE-3 (Wafer-Scale Engine 3) is the third-generation wafer-scale AI chip developed by Cerebras Systems, announced on March 13, 2024, and is the...

AI HardwareData Centers

Chroma

Chroma is an open-source embedding database designed for artificial intelligence applications. It stores vector embeddings alongside their associated documents...

Open Source AI

Chunked prefill

Chunked prefill is a scheduling technique for large language model serving that splits the processing of a long input prompt (the prefill) into smaller,...

Machine Learning

Cloud AI GPU Pricing Comparison

As of July 2026, the cheapest credible on-demand NVIDIA H100 rental is about $2 per GPU-hour on marketplace neoclouds: Vast.ai lists a single H100 from roughly...

AI HardwareData Centers

Cloud TPU

Cloud TPU is Google Cloud's offering of Tensor Processing Units (TPUs), the family of custom application-specific integrated circuits (ASICs) that Google...

AI HardwareMachine Learning

Cloud computing

Cloud computing is the on-demand availability of computer system resources, especially data storage and computing power, delivered over the internet without...

AI Hardware

Cloudflare

Cloudflare, Inc. is an American internet infrastructure company that has become one of the most consequential players in the AI economy by running serverless...

AI Companies

Constellation Energy

Constellation Energy (Nasdaq: CEG) is the largest operator of nuclear power plants in the United States and the central electricity supplier to the artificial...

AI Energy

Context Parallelism

Context Parallelism (CP) is a distributed training strategy that partitions the input sequence dimension of a transformer across multiple accelerators and uses...

Training & Optimization

Continuous Batching

Continuous batching is a scheduling technique for large language model (LLM) inference servers that inserts new requests into a running batch at the...

AI Inference

Contrastive decoding

Contrastive decoding (CD) is a decoding strategy for text generation from a large language model that selects tokens by contrasting two models of different...

Machine Learning

CoreWeave

CoreWeave, Inc. is an American artificial intelligence cloud computing company headquartered in Livingston, New Jersey, that rents large clusters of NVIDIA...

AI Companies

Crusoe

Crusoe is an American AI infrastructure company headquartered in Denver, Colorado, that builds and operates data centers for artificial intelligence workloads....

AI CompaniesData Centers

Dask

Dask is an open-source Python library for parallel and distributed computing that scales the familiar APIs of libraries such as NumPy, pandas, and scikit-learn...

Data ScienceMachine Learning

Data Center

A data center is a dedicated physical facility that houses computer systems, networking equipment, storage arrays, and the supporting infrastructure (power...

AI Hardware

Data Parallelism

Data parallelism is a distributed training technique in which the same neural network model is replicated across multiple processing units (typically GPUs),...

Deep LearningMachine Learning

DeepEP

DeepEP is an open-source GPU communication library built by DeepSeek for Mixture-of-Experts (MoE) models. It provides fast all-to-all kernels for the two...

Mixture of ExpertsOpen Source AI

DeepGEMM

DeepGEMM is an open-source library from DeepSeek that provides fast FP8 general matrix multiplication (GEMM) kernels for NVIDIA Hopper GPUs. It was released on...

Developer ToolsOpen Source AI

DeepInfra

DeepInfra is a serverless AI inference cloud that hosts open-source and open-weight AI models and serves them to developers through a single pay-per-token API....

AI CompaniesAI Inference

DeepSpeed

DeepSpeed is an open-source deep learning optimization library developed by Microsoft that makes distributed training and inference of large models efficient,...

Deep LearningMachine Learning

Disaggregated serving

Disaggregated serving is an LLM inference architecture that physically separates the prefill phase and the decode phase of text generation onto different sets...

AI InferenceArtificial Intelligence

DriveNets

DriveNets is an Israeli networking-software company that builds large telecom and AI networks out of standard "white box" hardware controlled by cloud-native...

AI Companies

DualPipe

DualPipe is a bidirectional pipeline parallelism scheduling algorithm created by DeepSeek-AI to almost fully overlap computation with communication and shrink...

AI Agents

EAGLE (speculative decoding)

EAGLE (Extrapolation Algorithm for Greater Language-model Efficiency) is a lossless speculative decoding method that speeds up large language model (LLM)...

AI Inference

Edge computing

Edge computing is a distributed computing paradigm that runs computation and data storage close to where data is generated, at the "edge" of the network,...

AI Hardware