Hyperscaler
A hyperscaler is a company that builds and operates computing infrastructure at a scale far beyond a conventional enterprise IT estate: globally distributed fleets of data centers holding millions of servers…
Explore AI Infrastructure through related topics and the articles other pages reference most.
Articles that also belong to these categories. Counts cover all of AI Infrastructure.
Showing 121-180 of 338 articles
A hyperscaler is a company that builds and operates computing infrastructure at a scale far beyond a conventional enterprise IT estate: globally distributed fleets of data centers holding millions of servers…
IREN Limited is an Australian-founded data center company listed on the Nasdaq Global Select Market under the ticker IREN.
Inferact is an artificial intelligence infrastructure company founded by creators and core maintainers of vLLM, the open-source inference engine that emerged from the University of California, Berkeley in 2023.
Inference economics is the study of the resources, costs and revenue associated with running a trained AI model. It connects the price of compute with the work a serving system delivers.
InfiniBand is a high throughput, low latency networking interconnect standard used to connect servers, storage, and accelerators inside high performance computing systems and large artificial intelligence…
The Internet of Things (IoT) is the network of physical objects ("things") embedded with sensors, software, and connectivity that lets them collect data, exchange it with other devices and systems over the…
Invisible Technologies is an American artificial intelligence company that combines a global network of vetted human experts with its own orchestration software to provide AI training data, reinforcement…
Ion Stoica is a Romanian-American computer scientist, professor of electrical engineering and computer sciences at the University of California, Berkeley, and a serial entrepreneur whose academic and…
Jalapeño is a custom AI accelerator designed by OpenAI with silicon implementation and networking technology from Broadcom.
KAI Scheduler is an open-source Kubernetes scheduler that optimizes the allocation of GPU resources for artificial intelligence and machine learning workloads.
KV cache offloading is the practice of moving part or all of a Transformer model's KV cache out of accelerator memory (GPU HBM) into a larger, slower tier such as CPU DRAM, local NVMe storage, or remote…
KV cache quantization is a family of large language model inference optimizations that store the attention key and value (KV) cache in low-bit numeric formats, typically 2 to 4 bits per value
Kairos Power is a United States advanced nuclear reactor developer, founded in 2016 and headquartered in Alameda, California
Kioxia is a Japanese flash memory manufacturer, the direct corporate descendant of the Toshiba division where flash memory was invented in the 1980s.
Kiro is an AI development tool built by Amazon Web Services, first released as an agentic integrated development environment (IDE) in public preview on July 14, 2025.
Kubernetes, often abbreviated K8s, is an open-source system for deploying and managing containerized applications across a cluster of machines.
An LLM inference engine (also called an LLM serving engine or LLM inference server) is the systems software stack that loads trained large language model weights into GPU or CPU memory and answers user…
LMDeploy is an open-source toolkit for compressing, deploying, and serving large language models, developed by the MMRazor and MMDeploy teams associated with the InternLM project at the Shanghai AI Laboratory.
Lambda Labs (operating as Lambda, Inc.) is an American AI infrastructure company that provides GPU cloud computing, on-premises GPU hardware, and deep learning software for artificial intelligence research and…
LanceDB is an open-source, developer-friendly vector database and multimodal lakehouse built on the Lance columnar storage format, designed to store vector embeddings, images, video, audio, and structured…
Land, power, and shell (LPS) is an emerging commercial label for the physical site, deliverable electricity, and building structure needed before computing equipment can be installed in a large data center.
LangSmith is a commercial observability, evaluation, and deployment platform for large language model (LLM) applications and AI agents, developed and operated by LangChain Inc. It provides developers and…
As of July 2026, the largest AI funding round on record is OpenAI's $122 billion raise, which closed in March 2026 at an $852 billion post-money valuation, the biggest private financing in history.
Larry Ellison (born August 17, 1944) is an American businessman who co-founded the database company that became Oracle Corporation in 1977.
Lenovo Group Limited is a Chinese multinational technology company that is the world's largest personal computer vendor by unit shipments and one of the largest builders of AI-optimized data center hardware…
Lepton AI was an American AI cloud company, founded in 2023, that built a cloud-native inference platform for serving large language models, generative image models, and other AI workloads on NVIDIA GPUs.
The Linux Foundation is an American 501(c)(6) nonprofit trade association based in San Francisco, California, that supports the development of Linux and other open-source software projects.
This list covers agreements for AI computing capacity announced or credibly reported between January 2023 and October 2026: cloud capacity contracts, chip supply agreements, data center leases and builds, the…
Lonestar Data Holdings (usually shortened to Lonestar) is a US startup that sells off-Earth data storage, mainly as a disaster-recovery and data-sovereignty service, and has flown small test payloads to the…
An MCP server is a program that implements the Model Context Protocol (MCP) to expose tools, resources, and prompts to MCP clients running inside an AI application or AI agent
MTIA (Meta Training and Inference Accelerator) is a family of custom silicon chips that Meta designs for use in its own data centers rather than for sale.
Google Cloud is the public cloud arm of Google and one of the three dominant providers of machine learning infrastructure, alongside Amazon Web Services and Microsoft Azure.
Mark Zuckerberg is the co-founder, chairman, and chief executive officer of Meta Platforms, and since the early 2010s he has directed one of the largest corporate artificial-intelligence programs in the world
MediaTek Inc. is a Taiwanese fabless semiconductor company headquartered in Hsinchu, Taiwan.
Medusa is a large language model inference acceleration framework that speeds up text generation by adding multiple lightweight decoding heads on top of an existing model to predict several future tokens in…
Meta Compute is a top-level organization that Meta created in January 2026 to plan, build, and run the gigawatt-scale data center capacity behind its push toward artificial general intelligence and what the…
MTIA (Meta Training and Inference Accelerator) is a family of custom AI chips that Meta designs in-house to run its largest artificial intelligence workloads, beginning with the deep learning recommendation…
Private Processing is Meta's confidential computing infrastructure for running AI workloads on user data in its data centers.
Meta Superintelligence Labs (MSL) is the artificial intelligence division that Meta created on June 30, 2025 to consolidate its research, foundation models, and AI products under a single organization aimed at…
Microscaling (MX) formats are a family of low-precision number formats for machine learning in which a small block of values, normally 32 of them, shares one common scale factor while each value is stored in a…
Microsoft Azure is the public cloud computing platform operated by Microsoft, and the world's second-largest cloud provider, behind Amazon Web Services (AWS) and ahead of Google Cloud.
Fairwater is Microsoft's name for a class of large AI datacenter built to train and serve frontier artificial intelligence models.
Foundry Local is an on-device artificial intelligence runtime from Microsoft that lets applications run open weight language models entirely on a user's own hardware.
Microsoft Maia 200 is a custom artificial intelligence accelerator designed by Microsoft for inference workloads in the Azure cloud.
Milvus is an open-source vector database built for billion-scale similarity search, developed by Zilliz and governed under the Linux Foundation AI & Data Foundation.
The MoE load balancing loss is an auxiliary training objective used in sparse mixture of experts (MoE) neural networks to keep work spread evenly across the expert sub-networks.
Modal is a serverless cloud computing platform that lets developers run compute-intensive artificial intelligence, machine learning, and data-processing workloads on cloud GPUs by writing ordinary Python, with…
Model parallelism is a distributed training and inference technique that splits a single neural network across multiple processing units so that no individual accelerator has to hold the entire model.
Model deployment is the MLOps process of taking a trained machine learning model and making it available in a production environment so it can serve predictions to applications, users, or downstream systems.
A model hub is an online platform or repository where people discover, share, version, and download machine learning models.
Modular (legally Modular Inc, also referred to as Modular AI) is an American AI infrastructure software company that builds tools for running AI models on chips from many vendors without rewriting code for…
MoonEP is an open-source expert-parallel communication library for mixture-of-experts models, released by Moonshot AI on July 27, 2026 under the MIT License.
Mooncake is a KVCache-centric, disaggregated serving architecture for large language models, built by Moonshot AI together with researchers at Tsinghua University.
Mubadala Investment Company is a state-owned strategic investor based in Abu Dhabi and wholly owned by the government of the emirate.
NAND flash memory is the non-volatile storage technology that holds the data in solid-state drives, memory cards, USB sticks, phones and the flash tiers of a modern data center.
NCCL, the NVIDIA Collective Communications Library, is a library of topology-aware communication primitives for NVIDIA GPU systems.
NLWeb (short for Natural Language Web) is an open project from Microsoft that makes it easy to add a natural-language conversational interface to a website, drawing on the site's own existing structured data…
NVHBM is an announced custom high-bandwidth memory architecture from NVIDIA for custom AI accelerators that participate in the company's NVLink Fusion platform. NVIDIA introduced it on August 26, 2026.
NVIDIA AI Enterprise is an end-to-end, cloud-native software suite sold by Nvidia as a paid subscription for developing and deploying production artificial intelligence and data analytics.
The NVIDIA AI compute infrastructure financing platforms are a set of proposed, independently run financing vehicles that NVIDIA announced on August 10, 2026, together with Apollo, BlackRock, Blackstone…