Amazon Q
Amazon Q is a family of generative AI-powered assistants from Amazon Web Services (AWS), announced on November 28, 2023, at the AWS re:Invent conference and made generally available on April 30, 2024.
AI Infrastructure
Explore AI Infrastructure through related topics and the articles other pages reference most.
Explore articles
Browse subtopics: Developer Tools
Articles that also belong to these categories. Counts cover all of AI Infrastructure.
All articles (281)AI Hardware (98)AI Companies (57)Data Centers (43)Developer Tools (37)Open Source AI (37)NVIDIA (35)Machine Learning (29)AI Inference (26)Google (13)AI Energy (11)Chinese AI (10)MLOps (9)Training & Optimization (9)AI Agents (8)OpenAI (8)Computer Science (7)Deep Learning (7)Enterprise AI (7)Information Retrieval (7)Large Language Models (7)AI Policy & Regulation (6)People (6)Artificial Intelligence (5)Meta AI (5)Microsoft (4)Robotics (4)AI Code Generation (3)AI Research (3)AI Tools & Products (3)Anthropic (3)Generative AI (3)Mixture of Experts (3)Venture Capital (3)AI Models (2)Model Architecture (2)Model Evaluation (2)Programming Languages (2)AI in Gaming (1)Agentic Commerce (1)Data & Datasets (1)Data Science (1)Edge computing (1)Embodied AI (1)Finance AI (1)Hardware (1)Image Generation (1)Mathematics (1)Neural Networks (1)Physical AI (1)Research Organizations (1)Software Development (1)Video Generation (1)
Showing 1-37 of 37 articles
Apache MXNet
Apache MXNet (pronounced "mix-net") was an open-source deep learning framework that combined imperative and symbolic execution in one runtime, created around 2015 by the DMLC (Distributed Machine Learning…
CANN (Huawei)
CANN, short for Compute Architecture for Neural Networks, is the heterogeneous computing architecture and software stack that Huawei provides for its Ascend line of AI processors.
CUDA
CUDA (Compute Unified Device Architecture) is NVIDIA's platform and programming model for general-purpose computation on its graphics processing units.
CUTLASS
CUTLASS is an open-source library of reusable building blocks for writing high-performance matrix kernels on NVIDIA GPUs.
DeepGEMM
DeepGEMM is an open-source library from DeepSeek that provides fast FP8 general matrix multiplication (GEMM) kernels for NVIDIA Hopper GPUs.
Firebase
Firebase is a backend-as-a-service (BaaS) platform developed by Google. It began in 2012 as a real-time database product launched by Andrew Lee and James Tamplin and was acquired by Google on October 21, 2014.
FlashInfer
FlashInfer is an open-source GPU kernel library and code-generation system for large language model inference.
FlashMLA
FlashMLA is an open-source GPU kernel from DeepSeek that accelerates the decoding step of Multi-head Latent Attention (MLA)
Fully Sharded Data Parallel (FSDP)
Fully Sharded Data Parallel (FSDP) is a distributed training technique implemented in PyTorch that shards a model's parameters, gradients, and optimizer states across data-parallel workers, allowing models…
Horovod
Horovod is an open-source distributed training framework for deep learning that lets a single-GPU training script scale across many GPUs and many machines by adding only a few lines of code.
Kiro (AI IDE)
Kiro is an agentic integrated development environment (IDE) built by Amazon Web Services and released in public preview on July 14, 2025 .
LMDeploy
LMDeploy is an open-source toolkit for compressing, deploying, and serving large language models, developed by the MMRazor and MMDeploy teams associated with the InternLM project at the Shanghai AI Laboratory.
LanceDB
LanceDB is an open-source, developer-friendly vector database and multimodal lakehouse built on the Lance columnar storage format, designed to store vector embeddings, images, video, audio, and structured…
LangSmith
LangSmith is a commercial observability, evaluation, and deployment platform for large language model (LLM) applications and AI agents, developed and operated by LangChain Inc. It provides developers and…
Microsoft Foundry Local
Foundry Local is an on-device artificial intelligence runtime from Microsoft that lets applications run open weight language models entirely on a user's own hardware.
Mooncake (LLM serving)
Mooncake is a KVCache-centric, disaggregated serving architecture for large language models, built by Moonshot AI together with researchers at Tsinghua University.
NVIDIA Deep Learning Institute
NVIDIA Deep Learning Institute (DLI) is the training and education arm of NVIDIA, offering hands-on courses, instructor-led workshops, and professional certifications in artificial intelligence, accelerated…
NVIDIA Dynamo
NVIDIA Dynamo is an open-source, low-latency distributed inference serving framework designed to deploy and scale generative AI and reasoning models across large GPU clusters.
NVIDIA NIM
NVIDIA NIM (NVIDIA Inference Microservices) is a set of containerized, prebuilt-and-optimized model-serving microservices from NVIDIA that package an AI model, an optimized inference engine, and an…
NVIDIA NeMo
NVIDIA NeMo is an open, end-to-end framework from NVIDIA for building, customizing, and deploying generative AI models, described by NVIDIA as "a scalable generative AI framework built for researchers and…
NVIDIA NeMo Switchyard
NVIDIA NeMo Switchyard is an open-source proxy and Rust library for routing requests among configured large language models.
NVIDIA OSMO
NVIDIA OSMO is an open-source workflow orchestration platform developed by Nvidia for physical AI and robotics development.
OpenAI AgentKit
OpenAI AgentKit is a suite of agent-building tools that OpenAI introduced at OpenAI DevDay on 6 October 2025 to take AI agents from prototype to production on OpenAI's hosted models.
Pallas (JAX kernel language)
Pallas is an experimental extension to JAX that lets users write custom hardware kernels in Python and lower them to both Tensor Processing Units and NVIDIA GPUs from a single source.
ROCm
ROCm is AMD's open software stack for GPU computing and the main alternative to NVIDIA's CUDA platform.
Ray (framework)
Ray is an open-source distributed computing framework, developed at the University of California, Berkeley's RISELab and commercialized by Anyscale, that lets developers scale Python and artificial…
Replicate
Replicate is a cloud platform for running, deploying, and sharing machine learning models via a simple API.
Replit
Replit is an online integrated development environment (IDE) and AI-powered coding platform that lets users write, run, and deploy software directly from a web browser, including by describing an application…
Slurm
Slurm is an open-source workload manager and job scheduler for Linux clusters, developed and maintained by SchedMD, which NVIDIA acquired in December 2025 .
Supabase
Supabase is an open-source backend-as-a-service (BaaS) platform that bundles a hosted PostgreSQL database with authentication, file storage, real-time subscriptions, edge functions, and vector similarity…
ThunderKittens
ThunderKittens (often abbreviated TK) is an embedded C++ domain-specific language and header-only library for writing high-performance AI kernels on modern NVIDIA GPUs.
Turbopuffer
Turbopuffer is a serverless vector and full-text search database built from first principles on object storage such as Amazon S3 and Google Cloud Storage.
Vector database
A vector database is a database that stores data as high-dimensional vectors (numerical embeddings produced by a machine learning model) and retrieves records by similarity rather than exact match
Vercel
Vercel (originally ZEIT) is an American cloud platform-as-a-service (PaaS) company headquartered in San Francisco, California, best known as the creator of Next.js and as a hosting platform for modern frontend…
XLA (Accelerated Linear Algebra)
XLA (Accelerated Linear Algebra) is Google's open-source machine learning compiler that takes computational graphs from frameworks such as TensorFlow, JAX, and PyTorch and transforms them into highly optimized…
llm-d
llm-d is an open-source, Kubernetes-native framework for serving large language models in a distributed way at production scale.