AI Infrastructure

Explore AI Infrastructure through related topics and the articles other pages reference most.

Explore articles

Browse subtopics (58)

Articles that also belong to these categories. Counts cover all of AI Infrastructure.

Showing 61-120 of 338 articles

Cloudflare

Cloudflare, Inc. is an American internet infrastructure company that has become one of the most consequential players in the AI economy by running serverless AI inference at the network edge and by setting the…

AI Companies

Co-Packaged Optics

Co-packaged optics (CPO) is a hardware architecture that places active optical engines on the same first-level package substrate as a host application-specific integrated circuit (ASIC).

AI ComputeAI Hardware

Compute Scarcity

Compute scarcity is a shortage of usable computing capacity relative to demand under specified technical, commercial and delivery conditions.

AI Compute

Constellation Energy

Constellation Energy (Nasdaq: CEG) is the largest operator of nuclear power plants in the United States and the central electricity supplier to the artificial intelligence buildout

AI Energy

Context Parallelism

Context Parallelism (CP) is a distributed training strategy that partitions the input sequence dimension of a transformer across multiple accelerators and uses ring-style point-to-point communication to…

Training & Optimization

Continuous Batching

Continuous batching is a scheduling technique for large language model (LLM) inference servers that inserts new requests into a running batch at the granularity of individual model iterations rather than…

AI Inference

Contrastive decoding

Contrastive decoding (CD) is a decoding strategy for text generation from a large language model that selects tokens by contrasting two models of different sizes.

Machine Learning

CoreWeave

CoreWeave, Inc. is an American artificial intelligence cloud computing company headquartered in Livingston, New Jersey, that rents large clusters of NVIDIA GPUs to AI developers and enterprises and builds the…

AI CompaniesAI Compute

Cowboy Space

Cowboy Space Corporation, called Aetherflux until May 2026, is a US space company based in San Carlos, California. Robinhood co-founder Baiju Bhatt founded it in 2024.

AI CompaniesAI Compute

Crusoe

Crusoe is an American AI infrastructure company headquartered in Denver, Colorado, that develops and operates data centers for artificial intelligence workloads, rents GPU capacity through its Crusoe Cloud…

AI CompaniesAI Compute

Dask

Dask is an open-source Python library for parallel and distributed computing that scales the familiar APIs of libraries such as NumPy, pandas, and scikit-learn to process larger-than-memory datasets.

Data ScienceMachine Learning

Data Center

A data center is a purpose-built facility, or a dedicated part of a facility, that houses and interconnects information technology and telecommunications equipment together with the power…

AI ComputeAI Hardware

Data Parallelism

Data parallelism is a distributed training technique in which the same neural network model is replicated across multiple processing units (typically GPUs), each device trains on a different shard of the input…

Deep LearningMachine Learning

DeepEP

DeepEP is an open-source communication library built by DeepSeek for distributed training and inference, written first for Mixture-of-Experts (MoE) models.

Chinese AIMixture of Experts

DeepGEMM

DeepGEMM is an open-source tensor-core kernel library from DeepSeek. It began as a set of FP8 general matrix multiplication (GEMM) kernels for NVIDIA Hopper GPUs, released on 26 February 2025 as the third…

Chinese AIDeveloper Tools

DeepInfra

DeepInfra is a serverless AI inference cloud that hosts open-source and open-weight AI models and serves them to developers through a single pay-per-token API.

AI CompaniesAI Inference

DeepSeek Elastic Compute (DSec)

DeepSeek Elastic Compute (DSec) is the production sandbox platform that DeepSeek uses to run the isolated execution environments behind agentic reinforcement learning (RL) training and evaluation of its…

AI AgentsChinese AI

DeepSpeed

DeepSpeed is an open-source deep learning optimization library, originally developed by Microsoft, that makes distributed training and inference of large models efficient, easy to use, and cost-effective.

Deep LearningMachine Learning

DriveNets

DriveNets is an Israeli networking-software company that builds large telecom and AI networks out of standard "white box" hardware controlled by cloud-native software instead of traditional proprietary routers.

AI Companies

DualPipe

DualPipe is a bidirectional pipeline parallelism scheduling algorithm created by DeepSeek-AI to almost fully overlap computation with communication and shrink the idle time, called the pipeline "bubble," that…

AI Agents

EAGLE (speculative decoding)

EAGLE (Extrapolation Algorithm for Greater Language-model Efficiency) is a lossless speculative decoding method that speeds up large language model (LLM) inference by 2x to 6.5x by doing autoregression at the…

AI Inference

Edge computing

Edge computing is a distributed computing paradigm that runs computation and data storage close to where data is generated, at the "edge" of the network

AI Hardware

FPGA

A field-programmable gate array (FPGA) is an integrated circuit whose logic functions and internal wiring are set by the customer after the chip has been manufactured, and can be reset later.

AI HardwareAI Inference

Feature store

A feature store is a centralised data system that stores, serves, discovers, shares, monitors and reuses machine-learning features, separating feature computation from model training and inference so the same…

MLOps

Fermi America

Fermi America is a United States power and data center developer attempting to build what it calls the world's largest energy and computing complex

AI Energy

Firebase

Firebase is a backend-as-a-service (BaaS) platform developed by Google. It began in 2012 as a real-time database product launched by Andrew Lee and James Tamplin and was acquired by Google on October 21, 2014.

Developer ToolsGoogle

FlashMLA

FlashMLA is an open-source library of attention kernels from DeepSeek, built around Multi-head Latent Attention (MLA), the attention variant DeepSeek uses to shrink the KV cache in its large language models.

AI InferenceDeveloper Tools

Frozen v2 (Google AI chip)

Frozen v2 is the informal internal codename for a specialized artificial-intelligence inference chip that Google is reportedly developing to run its Gemini models more cheaply and with far less energy.

AI ComputeAI Hardware

GE Vernova

GE Vernova (NYSE: GEV) is an American energy and electric-power equipment company, headquartered in Cambridge, Massachusetts, that builds and services much of the hardware used to generate and move…

AI Energy

GEM (Meta)

GEM (Generative Ads Recommendation Model) is a proprietary foundation model for advertising recommendation developed by Meta Platforms.

AI ModelsEnterprise AI

GPU Cluster

A GPU cluster is a group of servers containing graphics processing units that are connected by high-bandwidth, low-latency networks and operated as one computational pool.

AI ComputeAI Hardware

GPU computing

GPU computing is the use of a graphics processing unit (GPU) to perform general-purpose computation that was traditionally handled by the central processing unit (CPU).

AI ComputeAI Hardware

Groq Hardware

Groq hardware is a family of artificial-intelligence accelerators and multi-chip systems built around a statically scheduled streaming architecture.

AI ComputeAI Hardware

HUMAIN

HUMAIN is a Saudi Arabian artificial intelligence company launched on 12 May 2025 and owned by the Public Investment Fund (PIF), the kingdom's roughly trillion-dollar sovereign wealth fund.

AI CompaniesAI Compute

High-Flyer

High-Flyer (Chinese: 幻方量化, pinyin Huànfāng Liànghuà), also styled High-Flyer Quant, is a Chinese quantitative hedge fund group based in Hangzhou that trades Chinese A-shares with machine-learning models and…

AI CompaniesChinese AI

Horovod

Horovod is an open-source distributed training framework for deep learning that lets a single-GPU training script scale across many GPUs and many machines by adding only a few lines of code.

Developer ToolsOpen Source AI

Huawei Ascend 910B

The Huawei Ascend 910B is a data-center AI accelerator designed by Huawei's HiSilicon unit that became China's most widely deployed domestic alternative to restricted NVIDIA data-center GPUs across roughly…

AI ComputeAI Hardware

Huawei Ascend 910C

The Huawei Ascend 910C is a data-center artificial intelligence accelerator developed by Huawei and positioned as China's leading domestic alternative to high-end NVIDIA GPUs that are barred from sale to…

AI ComputeAI Hardware