Category

AI Infrastructure

215 articlesRSS

Showing 121-180 of 215 articles

NVIDIA ConnectX

NVIDIA ConnectX is a family of high-speed network adapters and SmartNICs (smart network interface cards) that connect a server to the data center fabric and...

AI HardwareNVIDIA

NVIDIA DGX B300

The NVIDIA DGX B300 is an 8-GPU AI supercomputer node built around NVIDIA's Blackwell Ultra architecture. Announced at GTC 2025 in March[4] and shipping from...

AI HardwareData Centers

NVIDIA DGX Cloud

NVIDIA DGX Cloud is a managed AI-supercomputing-as-a-service offering from Nvidia that rents enterprises access to multi-node clusters of NVIDIA DGX...

NVIDIA

NVIDIA DGX SuperPOD

The NVIDIA DGX SuperPOD is a reference-architecture artificial intelligence supercomputer designed and sold by Nvidia. It is a turnkey, factory-validated...

Data CentersNVIDIA

NVIDIA Dynamo

NVIDIA Dynamo is an open-source, low-latency distributed inference serving framework designed to deploy and scale generative AI and reasoning models across...

AI InferenceDeveloper Tools

NVIDIA GB300 NVL72

The NVIDIA GB300 NVL72 is a liquid-cooled, rack-scale AI computing system that integrates 72 NVIDIA Blackwell Ultra (B300) GPUs and 36 Arm-based NVIDIA Grace...

AI HardwareData Centers

NVIDIA GH200 Grace Hopper Superchip

The NVIDIA GH200 Grace Hopper Superchip is a single-module processor from NVIDIA that combines a 72-core Grace Arm CPU with a Hopper-generation H100-class GPU...

AI HardwareNVIDIA

NVIDIA H100

NVIDIA H100 (also called the H100 Tensor Core GPU) is a data-center graphics processing unit built by NVIDIA on the Hopper microarchitecture, fabricated with...

AI HardwareNVIDIA

NVIDIA Holoscan

NVIDIA Holoscan is a domain-agnostic, multimodal AI sensor processing platform and software development kit (SDK) built by NVIDIA for real-time, low-latency...

Edge computingHardware

NVIDIA NIM

NVIDIA NIM (NVIDIA Inference Microservices) is a set of containerized, prebuilt-and-optimized model-serving microservices from NVIDIA that package an AI model,...

AI InferenceDeveloper Tools

NVIDIA NeMo

NVIDIA NeMo is an open, end-to-end framework from NVIDIA for building, customizing, and deploying generative AI models, described by NVIDIA as "a scalable...

Developer ToolsNVIDIA

NVIDIA Picasso

See also: Model Deployment and artificial intelligence applications See also: Image generation, Video generation, and 3D generation NVIDIA Picasso is a...

AI HardwareAI Inference

NVIDIA Quantum-X Photonics

NVIDIA Quantum-X Photonics is a family of co-packaged-optics network switches that NVIDIA announced at its GTC conference on March 18, 2025. The switches carry...

AI HardwareNVIDIA

NVIDIA Spectrum-X Photonics

NVIDIA Spectrum-X Photonics is a co-packaged optics (CPO) Ethernet switch platform from Nvidia, announced at the company's GPU Technology Conference (GTC) on...

AI HardwareNVIDIA

NVIDIA Spectrum-XGS

NVIDIA Spectrum-XGS, marketed in full as NVIDIA Spectrum-XGS Ethernet, is a networking technology from NVIDIA designed to link several geographically separated...

AI Hardware

NVLink Fusion

NVLink Fusion is a program and silicon technology from NVIDIA that opens its NVLink high speed interconnect to third party chips. It lets partners connect...

AI HardwareNVIDIA

Nebius

Nebius is an AI cloud company incorporated in the Netherlands and listed on the Nasdaq stock exchange under the ticker symbol NBIS, where it carried a market...

AI Companies

Neuromorphic computing

Neuromorphic computing is brain-inspired computer hardware that processes information with spiking neural networks (SNNs) and event-driven, in-memory...

AI HardwareNeural Networks

Nscale

Nscale is a British AI infrastructure company, usually described as a neocloud, that builds GPU-dense data center capacity and rents large-scale compute to...

AI Companies

Nvidia-OpenAI partnership

The Nvidia-OpenAI partnership is a strategic agreement announced on September 22, 2025, under which NVIDIA said it intends to invest up to $100 billion in...

AI Companies

OctoAI

OctoAI (originally OctoML) was an American artificial intelligence infrastructure company that operated a generative-AI inference platform and, before its...

AI CompaniesAI Inference

Oklo

Oklo Inc. (NYSE: OKLO) is an American advanced-fission company developing the Aurora "powerhouse," a small sodium-cooled fast reactor that Oklo plans to build,...

AI Energy

OpenAI AgentKit

Agent development platform Developer 6 October 2025 Venue Included with standard API model pricing Key components Reinforcement fine-tuning on GPT-5...

AI AgentsDeveloper Tools

OpenAI-Broadcom AI accelerators

The OpenAI-Broadcom collaboration is a strategic partnership, announced on October 13, 2025, under which OpenAI designs its own custom AI inference...

AI HardwareOpenAI

Oracle Corporation

Oracle Corporation is an American multinational technology company, founded in 1977 and headquartered in Austin, Texas, that since 2024 has become one of the...

AI Companies

PagedAttention

PagedAttention is a KV-cache memory management algorithm for serving large language models that applies the virtual-memory paging technique used by operating...

AI InferenceModel Architecture

Pallas (JAX kernel language)

Pallas is an experimental extension to JAX that lets users write custom hardware kernels in Python and lower them to both Tensor Processing Units and NVIDIA...

Developer ToolsGoogle

Parallel Web Systems

Parallel Web Systems is an American artificial-intelligence infrastructure company founded in early 2024 by Parag Agrawal, the former chief executive of...

AI AgentsAI Companies

Pathways (Google AI)

Pathways is the name Google has used for two related but distinct things in its artificial-intelligence work: a research vision for a next-generation AI...

AI ResearchGoogle

Pinecone

Pinecone is a managed vector database for artificial intelligence applications that lets developers store, index, and query high-dimensional vector embeddings...

Pipeline Parallelism

Pipeline parallelism (often abbreviated PP) is a distributed training strategy that splits the layers of a deep neural network across multiple accelerator...

Large Language ModelsTraining & Optimization

Prefix caching (automatic prefix caching)

Prefix caching is an inference optimization for large language model serving that stores and reuses the key-value (KV) cache computed for a shared prompt...

Machine Learning

Prime Intellect

Prime Intellect is a San Francisco based artificial intelligence company building infrastructure for decentralized AI development, with a focus on training...

AI Companies

Product quantization

Product quantization (PQ) is a vector-compression technique for approximate nearest-neighbor (ANN) search that splits each high-dimensional vector into M equal...

AI InferenceInformation Retrieval

Project Rainier

Project Rainier is a distributed artificial intelligence supercomputer built by Amazon Web Services around its in-house AWS Trainium accelerators, created...

AI HardwareData Centers

Prometheus (Meta data center)

Prometheus is a roughly 1-gigawatt AI supercluster built by Meta at its data center campus in New Albany, Ohio.[1][2] Announced by chief executive Mark...

Data CentersMeta AI

Prompt lookup decoding

Prompt lookup decoding (PLD), also called n-gram speculative decoding, is an inference acceleration method for large language models that speeds up text...

Machine Learning

Qdrant

Qdrant (pronounced "quadrant") is an open-source vector database and similarity search engine written in Rust and designed for high-performance retrieval over...

Open Source AI

QuIP / QuIP#

QuIP (Quantization with Incoherence Processing) is a family of weight-only post-training quantization methods for large language models developed in the...

Machine Learning

Quantization-Aware Training (QAT)

Quantization-aware training (QAT) is a model compression technique in which the effects of quantization are simulated during the training or fine-tuning of a...

Machine Learning

ROCm

ROCm is AMD's open software stack for GPU computing and the main alternative to NVIDIA's CUDA platform. AMD's own documentation defines it as "a software...

AI HardwareDeveloper Tools

RadixAttention

RadixAttention is a KV cache management technique introduced in SGLang that uses a radix tree data structure to automatically share and reuse cached key-value...

AI InferenceModel Architecture

Ray (framework)

Ray is an open-source distributed computing framework, developed at the University of California, Berkeley's RISELab and commercialized by Anyscale, that lets...

Developer ToolsMachine Learning

Ray Serve

Ray Serve is a scalable, framework-agnostic model serving library built on top of the Ray (framework) distributed computing system. It allows developers to...

MLOpsOpen Source AI

Reliance Jamnagar AI data center

The Reliance Jamnagar AI data center is a planned gigawatt-scale artificial intelligence computing campus that Reliance Industries, India's largest company by...

Replicate

Replicate is a cloud platform for running, deploying, and sharing machine learning models via a simple API. Founded in 2019 by Ben Firshman and Andreas...

AI CompaniesDeveloper Tools

Replit

Replit is an online integrated development environment (IDE) and AI-powered coding platform that lets users write, run, and deploy software directly from a web...

AI Code GenerationDeveloper Tools

Research SuperCluster (RSC)

The Research SuperCluster (RSC) is an AI supercomputer built by Meta AI, the artificial intelligence research division of Meta Platforms (the company formerly...

Data CentersMeta AI

Robot

A robot is a programmable machine that senses its environment, computes a decision, and acts on the physical world through a closed loop of perception,...

AI HardwareRobotics

Run:ai

Run:ai (legal name Runai Labs Ltd.) is an Israeli software company that developed a Kubernetes-based orchestration and scheduling platform for graphics...

AI CompaniesMLOps

RunPod

RunPod is a globally distributed GPU cloud computing platform that provides on-demand and serverless GPU compute for artificial intelligence training,...

AI Companies

SambaNova SN40L

The SambaNova SN40L is a reconfigurable dataflow AI accelerator designed by SambaNova Systems and unveiled on September 19, 2023.[1][2] Marketed as a...

AI Hardware

SambaNova SN50

The SambaNova SN50 is a reconfigurable dataflow accelerator that SambaNova Systems unveiled in late February 2026 as the successor to its SN40L chip. The...

AI Hardware

Self-speculative decoding (LayerSkip)

Self-speculative decoding is a family of speculative decoding methods that accelerate large language model (LLM) inference by using the target model itself,...

Machine Learning

Sequence Parallelism

Sequence parallelism (SP) is a family of distributed training techniques for transformer-based neural networks that partitions activations along the sequence...

Deep LearningTraining & Optimization

Snowflake AI

Snowflake AI is the suite of artificial intelligence and machine learning capabilities built into the Snowflake AI Data Cloud, anchored by Cortex AI (managed...

AI CompaniesEnterprise AI

Snowflake-AWS chip deal

The Snowflake-AWS chip deal is a five-year, roughly $6 billion infrastructure commitment that the data-cloud company Snowflake made to Amazon Web Services...

Enterprise AI

SpinQuant

SpinQuant is a post-training quantization method for large language models that inserts learned rotation matrices into a transformer network to make its...

Machine Learning

Stargate Argentina

Stargate Argentina is an announced, early-stage plan to build a large artificial intelligence data center of up to 500 megawatts (MW) in Argentina, described...

OpenAI

Stargate Initiative

The Stargate Initiative (formally The Stargate Project, incorporated in Delaware as Stargate LLC) is an American joint venture announced on January 21, 2025 at...

AI Companies