Category

AI Infrastructure

215 articlesRSS

Showing 61-120 of 215 articles

Exa AI

Exa AI (formerly Metaphor) is an artificial intelligence company that builds a search engine designed specifically for AI applications. Unlike traditional...

AI CompaniesInformation Retrieval

Expert Parallelism

Expert Parallelism (EP) is a model-parallelism strategy specific to Mixture of Experts (MoE) neural networks in which the individual expert sub-networks...

Mixture of ExpertsTraining & Optimization

FAISS

FAISS (Facebook AI Similarity Search) is an open-source library from Meta for efficient similarity search and clustering of dense vectors, and it is the de...

Information RetrievalOpen Source AI

Feature store

A feature store is a centralised data system that stores, serves, discovers, shares, monitors and reuses machine-learning features, separating feature...

MLOps

Fermi America

Fermi America is a United States power and data center developer attempting to build what it calls the world's largest energy and computing complex, an 11...

AI Energy

Firebase

Firebase is a backend-as-a-service (BaaS) platform developed by Google. It began in 2012 as a real-time database product launched by Andrew Lee and James...

Developer ToolsGoogle

FlashMLA

FlashMLA is an open-source GPU kernel from DeepSeek that accelerates the decoding step of Multi-head Latent Attention (MLA), the attention variant DeepSeek...

Developer ToolsOpen Source AI

Fully Sharded Data Parallel (FSDP)

Fully Sharded Data Parallel (FSDP) is a distributed training technique implemented in PyTorch that shards a model's parameters, gradients, and optimizer states...

Deep LearningDeveloper Tools

GE Vernova

GE Vernova (NYSE: GEV) is an American energy and electric-power equipment company, headquartered in Cambridge, Massachusetts, that builds and services much of...

AI Energy

GPU cluster

A GPU cluster is a tightly coupled collection of servers, each populated with multiple graphics processing units, interconnected by high-bandwidth low-latency...

AI HardwareData Centers

GPU computing

GPU computing is the use of a graphics processing unit (GPU) to perform general-purpose computation that was traditionally handled by the central processing...

AI HardwareDeep Learning

Genesis (simulator)

Genesis is an open-source, generative physics simulation platform for robotics and embodied AI, released on December 19, 2024 after a roughly two-year...

Open Source AIRobotics

Google Axion

Google Axion is Google's first custom Arm-based central processing unit designed for the data center. Google announced it on April 9, 2024 at the Google Cloud...

AI HardwareGoogle

Google Cloud

Google Cloud is the cloud computing division of Google and its parent Alphabet, and one of the world's largest suppliers of AI computing, selling custom tensor...

AI Companies

Google Virgo Network

Virgo Network is a megascale data-center fabric introduced by Google at Google Cloud Next 2026 in April 2026. It connects large fleets of AI accelerators...

Data CentersGoogle

HUMAIN

HUMAIN is a Saudi Arabian artificial intelligence company launched on 12 May 2025 and owned by the Public Investment Fund (PIF), the kingdom's roughly...

AI Companies

Horovod

Horovod is an open-source distributed training framework for deep learning that lets a single-GPU training script scale across many GPUs and many machines by...

Developer ToolsOpen Source AI

Huawei Ascend 910B

Value --- Data-center AI training and inference accelerator (NPU) Designer Huawei Ascend Architecture 7nm class: SMIC (variously called N+1 or N+2);...

AI HardwareChinese AI

Huawei Ascend 910C

The Huawei Ascend 910C is a data-center artificial intelligence accelerator developed by Huawei and positioned as China's leading domestic alternative to...

AI HardwareChinese AI

Hyperion (Meta data center)

Hyperion is an artificial intelligence data center campus built by Meta in Richland Parish, in northeast Louisiana, United States. Meta has said the site will...

Data CentersMeta AI

IREN

IREN Limited is an Australian-founded data center company listed on the Nasdaq Global Select Market under the ticker IREN. It began in 2018 as Iris Energy, a...

AI Companies

InfiniBand

InfiniBand is a high throughput, low latency networking interconnect standard used to connect servers, storage, and accelerators inside high performance...

AI Hardware

Internet of Things

The Internet of Things (IoT) is the network of physical objects ("things") embedded with sensors, software, and connectivity that lets them collect data,...

AI HardwareEnterprise AI

Invisible Technologies

Invisible Technologies is an American artificial intelligence company that combines a global network of vetted human experts with its own orchestration...

AI Companies

Ion Stoica

Ion Stoica is a Romanian-American computer scientist, professor of electrical engineering and computer sciences at the University of California, Berkeley, and...

Computer SciencePeople

KV-cache quantization

KV cache quantization is a family of large language model inference optimizations that store the attention key and value (KV) cache in low-bit numeric formats,...

Machine Learning

Kairos Power

Kairos Power is a United States advanced nuclear reactor developer, founded in 2016 and headquartered in Alameda, California, that is building the Kairos Power...

AI Energy

Kiro (AI IDE)

Kiro is an agentic integrated development environment (IDE) built by Amazon Web Services and released in public preview on July 14, 2025 [1][2]. The tool is...

AI AgentsAI Code Generation

LLM inference engine

An LLM inference engine (also called an LLM serving engine or LLM inference server) is the systems software stack that loads trained large language model...

AI InferenceLarge Language Models

LMDeploy

LMDeploy is an open-source toolkit for compressing, deploying, and serving large language models, developed by the MMRazor and MMDeploy teams associated with...

Developer ToolsOpen Source AI

Lambda Labs

Lambda Labs (operating as Lambda, Inc.) is an American AI infrastructure company that provides GPU cloud computing, on-premises GPU hardware, and deep learning...

AI Companies

LanceDB

LanceDB is an open-source, developer-friendly vector database and multimodal lakehouse built on the Lance columnar storage format, designed to store vector...

AI CompaniesDeveloper Tools

LangSmith

LangSmith is a commercial observability, evaluation, and deployment platform for large language model (LLM) applications and AI agents, developed and operated...

AI CompaniesDeveloper Tools

Largest AI Funding Rounds and Valuations

As of July 2026, the largest AI funding round on record is OpenAI's $122 billion raise, which closed in March 2026 at an $852 billion post-money valuation, the...

AI CompaniesVenture Capital

Lenovo

Lenovo Group Limited is a Chinese multinational technology company that is the world's largest personal computer vendor by unit shipments and one of the...

AI CompaniesAI Hardware

Lepton AI

Subsidiary of NVIDIA (since 2025); formerly private company Industry 2023 Founders Cupertino / San Francisco Bay Area, California, United States Key...

AI CompaniesNVIDIA

Linux Foundation

The Linux Foundation is an American 501(c)(6) nonprofit trade association based in San Francisco, California, that supports the development of Linux and other...

Open Source AIResearch Organizations

MCP server

An MCP server is a program that implements the Model Context Protocol (MCP) to expose tools, resources, and prompts to MCP clients running inside an AI...

AI AgentsAnthropic

Machine learning terms/Google Cloud

Google Cloud is the public cloud arm of Google and one of the three dominant providers of machine learning infrastructure, alongside Amazon Web Services and...

GoogleMachine Learning

Mark Zuckerberg

Mark Zuckerberg is the co-founder, chairman, and chief executive officer of Meta Platforms, and since the early 2010s he has directed one of the largest...

AI CompaniesPeople

Medusa

Medusa is a large language model inference acceleration framework that speeds up text generation by adding multiple lightweight decoding heads on top of an...

AI Inference

Meta Compute

Meta Compute is a top-level organization that Meta created in January 2026 to plan, build, and run the gigawatt-scale data center capacity behind its push...

Data CentersMeta AI

Meta MTIA

MTIA (Meta Training and Inference Accelerator) is a family of custom AI chips that Meta designs in-house to run its largest artificial intelligence workloads,...

AI Hardware

Meta Superintelligence Labs

Meta Superintelligence Labs (MSL) is the artificial intelligence division that Meta created on June 30, 2025 to consolidate its research, foundation models,...

AI CompaniesArtificial Intelligence

Microscaling formats

Microscaling (MX) formats are a family of low-precision number formats for machine learning in which a small block of values, normally 32 of them, shares one...

AI HardwareMachine Learning

Microsoft Azure

Microsoft Azure is the public cloud computing platform operated by Microsoft, and the world's second-largest cloud provider, behind Amazon Web Services (AWS)...

Microsoft

Microsoft Fairwater

Fairwater is Microsoft's name for a class of large AI datacenter built to train and serve frontier artificial intelligence models. The first Fairwater site, in...

Data CentersMicrosoft

Microsoft Foundry Local

Foundry Local is an on-device artificial intelligence runtime from Microsoft that lets applications run open weight language models entirely on a user's own...

Developer ToolsMicrosoft

Microsoft Maia 200

Microsoft Maia 200 is a custom artificial intelligence accelerator designed by Microsoft for inference workloads in the Azure cloud. It is the second chip in...

AI HardwareMicrosoft

Milvus

Milvus is an open-source vector database built for billion-scale similarity search, developed by Zilliz and governed under the Linux Foundation AI & Data...

Open Source AI

MoE load-balancing loss

The MoE load balancing loss is an auxiliary training objective used in sparse mixture of experts (MoE) neural networks to keep work spread evenly across the...

AI Agents

Modal (platform)

Modal is a serverless cloud computing platform that lets developers run compute-intensive artificial intelligence, machine learning, and data-processing...

AI Companies

Model Parallelism

See also: Machine learning terms, Data parallelism, GPU computing, Deep learning Model parallelism is a distributed training and inference technique that...

Deep LearningMachine Learning

Model deployment

Model deployment is the MLOps process of taking a trained machine learning model and making it available in a production environment so it can serve...

MLOps

Model hubs

A model hub is an online platform or repository where people discover, share, version, and download machine learning models. At its simplest, a hub is a place...

AI Tools & ProductsOpen Source AI

Mooncake (LLM serving)

Mooncake is a KVCache-centric, disaggregated serving architecture for large language models, built by Moonshot AI together with researchers at Tsinghua...

Developer ToolsOpen Source AI

NCCL (NVIDIA Collective Communications Library)

NCCL (the NVIDIA Collective Communications Library, pronounced "Nickel") is an open-source library from Nvidia that provides topology-aware, multi-GPU and...

AI HardwareNVIDIA

NLWeb

NLWeb (short for Natural Language Web) is an open project from Microsoft that makes it easy to add a natural-language conversational interface to a website,...

AI Agents

NVIDIA AI Enterprise

NVIDIA AI Enterprise is an end-to-end, cloud-native software suite sold by Nvidia as a paid subscription for developing and deploying production artificial...

Enterprise AINVIDIA

NVIDIA B200

The NVIDIA B200 is a data center GPU based on the NVIDIA Blackwell microarchitecture, announced by Jensen Huang at GTC 2024 on March 18, 2024.[^1] It is the...

AI HardwareData Centers