Cloudflare
Cloudflare, Inc. is an American internet infrastructure company that has become one of the most consequential players in the AI economy by running serverless AI inference at the network edge and by setting the…
Explore AI Infrastructure through related topics and the articles other pages reference most.
Articles that also belong to these categories. Counts cover all of AI Infrastructure.
Showing 61-120 of 338 articles
Cloudflare, Inc. is an American internet infrastructure company that has become one of the most consequential players in the AI economy by running serverless AI inference at the network edge and by setting the…
ClusterMAX is a rating and ranking system for GPU cloud providers published by the research firm SemiAnalysis.
Co-packaged optics (CPO) is a hardware architecture that places active optical engines on the same first-level package substrate as a host application-specific integrated circuit (ASIC).
Compute scarcity is a shortage of usable computing capacity relative to demand under specified technical, commercial and delivery conditions.
Compute derivatives are financial contracts whose value depends on the price of AI computing capacity.
Constellation Energy (Nasdaq: CEG) is the largest operator of nuclear power plants in the United States and the central electricity supplier to the artificial intelligence buildout
Context Parallelism (CP) is a distributed training strategy that partitions the input sequence dimension of a transformer across multiple accelerators and uses ring-style point-to-point communication to…
Continuous batching is a scheduling technique for large language model (LLM) inference servers that inserts new requests into a running batch at the granularity of individual model iterations rather than…
Contrastive decoding (CD) is a decoding strategy for text generation from a large language model that selects tokens by contrasting two models of different sizes.
CoreWeave, Inc. is an American artificial intelligence cloud computing company headquartered in Livingston, New Jersey, that rents large clusters of NVIDIA GPUs to AI developers and enterprises and builds the…
The CoreWeave Zero Trust AI Framework is a security model that CoreWeave, the American AI cloud provider, announced on October 21, 2026, at NVIDIA's GTC Berlin conference.
Cowboy Space Corporation, called Aetherflux until May 2026, is a US space company based in San Carlos, California. Robinhood co-founder Baiju Bhatt founded it in 2024.
Cross-model KV cache transfer is an experimental technique for converting the KV cache produced by one large language model into the cache representation expected by another model.
Crusoe is an American AI infrastructure company headquartered in Denver, Colorado, that develops and operates data centers for artificial intelligence workloads, rents GPU capacity through its Crusoe Cloud…
Dynamic random-access memory (DRAM) is the working memory of nearly every computer built since the late 1970s, and the physical substrate on which modern AI hardware runs.
Dask is an open-source Python library for parallel and distributed computing that scales the familiar APIs of libraries such as NumPy, pandas, and scikit-learn to process larger-than-memory datasets.
A data center is a purpose-built facility, or a dedicated part of a facility, that houses and interconnects information technology and telecommunications equipment together with the power…
Data parallelism is a distributed training technique in which the same neural network model is replicated across multiple processing units (typically GPUs), each device trains on a different shard of the input…
DeepEP is an open-source communication library built by DeepSeek for distributed training and inference, written first for Mixture-of-Experts (MoE) models.
DeepGEMM is an open-source tensor-core kernel library from DeepSeek. It began as a set of FP8 general matrix multiplication (GEMM) kernels for NVIDIA Hopper GPUs, released on 26 February 2025 as the third…
DeepInfra is a serverless AI inference cloud that hosts open-source and open-weight AI models and serves them to developers through a single pay-per-token API.
DeepSeek Elastic Compute (DSec) is the production sandbox platform that DeepSeek uses to run the isolated execution environments behind agentic reinforcement learning (RL) training and evaluation of its…
DeepSelect is an open-source library of top-k selection kernels published by the Chinese AI company DeepSeek.
DeepSpeed is an open-source deep learning optimization library, originally developed by Microsoft, that makes distributed training and inference of large models efficient, easy to use, and cost-effective.
Disaggregated serving is an LLM inference architecture that physically separates the prefill phase and the decode phase of text generation onto different sets of GPU hardware.
DriveNets is an Israeli networking-software company that builds large telecom and AI networks out of standard "white box" hardware controlled by cloud-native software instead of traditional proprietary routers.
DualPipe is a bidirectional pipeline parallelism scheduling algorithm created by DeepSeek-AI to almost fully overlap computation with communication and shrink the idle time, called the pipeline "bubble," that…
EAGLE (Extrapolation Algorithm for Greater Language-model Efficiency) is a lossless speculative decoding method that speeds up large language model (LLM) inference by 2x to 6.5x by doing autoregression at the…
Edge computing is a distributed computing paradigm that runs computation and data storage close to where data is generated, at the "edge" of the network
Ethernet is the family of wired computer networking technologies standardized by the IEEE 802.3 working group.
Exa AI (formerly Metaphor) is an artificial intelligence company that builds a search engine designed specifically for AI applications.
Expert Parallelism (EP) is a model-parallelism strategy specific to Mixture of Experts (MoE) neural networks in which the individual expert sub-networks (typically feed-forward blocks) are sharded across…
FAISS (Facebook AI Similarity Search) is an open-source library from Meta for efficient similarity search and clustering of dense vectors
A field-programmable gate array (FPGA) is an integrated circuit whose logic functions and internal wiring are set by the customer after the chip has been manufactured, and can be reset later.
A feature store is a centralised data system that stores, serves, discovers, shares, monitors and reuses machine-learning features, separating feature computation from model training and inference so the same…
Fermi America is a United States power and data center developer attempting to build what it calls the world's largest energy and computing complex
The Fire-Flyer File System (3FS) is a distributed file system built by DeepSeek and the Chinese quantitative fund High-Flyer for AI training and inference workloads.
Firebase is a backend-as-a-service (BaaS) platform developed by Google. It began in 2012 as a real-time database product launched by Andrew Lee and James Tamplin and was acquired by Google on October 21, 2014.
FlashInfer is an open-source GPU kernel library and code-generation system for large language model inference.
FlashMLA is an open-source library of attention kernels from DeepSeek, built around Multi-head Latent Attention (MLA), the attention variant DeepSeek uses to shrink the KV cache in its large language models.
Frozen v2 is the informal internal codename for a specialized artificial-intelligence inference chip that Google is reportedly developing to run its Gemini models more cheaply and with far less energy.
Fully Sharded Data Parallel (FSDP) is a distributed training technique implemented in PyTorch that shards a model's parameters, gradients, and optimizer states across data-parallel workers, allowing models…
GE Vernova (NYSE: GEV) is an American energy and electric-power equipment company, headquartered in Cambridge, Massachusetts, that builds and services much of the hardware used to generate and move…
GEM (Generative Ads Recommendation Model) is a proprietary foundation model for advertising recommendation developed by Meta Platforms.
A GPU cluster is a group of servers containing graphics processing units that are connected by high-bandwidth, low-latency networks and operated as one computational pool.
GPU depreciation concerns the allocation of the cost of graphics processing units over their useful lives and the loss of their economic value.
GPU computing is the use of a graphics processing unit (GPU) to perform general-purpose computation that was traditionally handled by the central processing unit (CPU).
Genesis is an open-source, generative physics simulation platform for robotics and embodied AI, announced on December 18, 2024 (UTC
Google Axion is Google's first custom Arm-based central processing unit designed for the data center.
Google Cloud is the enterprise cloud business of Google and the name of a reportable segment in Alphabet's financial statements.
Virgo Network is a megascale data-center fabric introduced by Google at Google Cloud Next 2026 in April 2026.
Groq hardware is a family of artificial-intelligence accelerators and multi-chip systems built around a statically scheduled streaming architecture.
HUMAIN is a Saudi Arabian artificial intelligence company launched on 12 May 2025 and owned by the Public Investment Fund (PIF), the kingdom's roughly trillion-dollar sovereign wealth fund.
High-Flyer (Chinese: 幻方量化, pinyin Huànfāng Liànghuà), also styled High-Flyer Quant, is a Chinese quantitative hedge fund group based in Hangzhou that trades Chinese A-shares with machine-learning models and…
Horovod is an open-source distributed training framework for deep learning that lets a single-GPU training script scale across many GPUs and many machines by adding only a few lines of code.
Huawei Ascend is a family of AI accelerators designed by Huawei around a custom processor architecture called Da Vinci.
The Huawei Ascend 910B is a data-center AI accelerator designed by Huawei's HiSilicon unit that became China's most widely deployed domestic alternative to restricted NVIDIA data-center GPUs across roughly…
The Huawei Ascend 910C is a data-center artificial intelligence accelerator developed by Huawei and positioned as China's leading domestic alternative to high-end NVIDIA GPUs that are barred from sale to…
Humming is an open-source GPU kernel library for matrix multiplication in quantized inference.
Hyperion is an artificial intelligence data center campus built by Meta in Richland Parish, in northeast Louisiana, United States.