Amazon Nova
Amazon Nova is a family of foundation models developed by Amazon and offered through Amazon Bedrock, announced on December 3, 2024, at the AWS re:Invent conference in Las Vegas.
AI Infrastructure
Explore AI Infrastructure through related topics and the articles other pages reference most.
Explore articles
Browse subtopics: Large Language Models
Articles that also belong to these categories. Counts cover all of AI Infrastructure.
All articles (281)AI Hardware (98)AI Companies (57)Data Centers (43)Developer Tools (37)Open Source AI (37)NVIDIA (35)Machine Learning (29)AI Inference (26)Google (13)AI Energy (11)Chinese AI (10)MLOps (9)Training & Optimization (9)AI Agents (8)OpenAI (8)Computer Science (7)Deep Learning (7)Enterprise AI (7)Information Retrieval (7)Large Language Models (7)AI Policy & Regulation (6)People (6)Artificial Intelligence (5)Meta AI (5)Microsoft (4)Robotics (4)AI Code Generation (3)AI Research (3)AI Tools & Products (3)Anthropic (3)Generative AI (3)Mixture of Experts (3)Venture Capital (3)AI Models (2)Model Architecture (2)Model Evaluation (2)Programming Languages (2)AI in Gaming (1)Agentic Commerce (1)Data & Datasets (1)Data Science (1)Edge computing (1)Embodied AI (1)Finance AI (1)Hardware (1)Image Generation (1)Mathematics (1)Neural Networks (1)Physical AI (1)Research Organizations (1)Software Development (1)Video Generation (1)
Showing 1-7 of 7 articles
Cross-Model KV Cache Transfer
Cross-model KV cache transfer is an experimental technique for converting the KV cache produced by one large language model into the cache representation expected by another model.
KV cache offloading
KV cache offloading is the practice of moving part or all of a Transformer model's KV cache out of accelerator memory (GPU HBM) into a larger, slower tier such as CPU DRAM, local NVMe storage, or remote…
LLM inference engine
An LLM inference engine (also called an LLM serving engine or LLM inference server) is the systems software stack that loads trained large language model weights into GPU or CPU memory and answers user…
Pipeline Parallelism
Pipeline parallelism (often abbreviated PP) is a distributed training strategy that splits the layers of a deep neural network across multiple accelerator devices so that each device holds one contiguous block…
Snowflake AI
Snowflake AI is the suite of artificial intelligence and machine learning capabilities built into the Snowflake AI Data Cloud, anchored by Cortex AI (managed generative AI services callable in SQL), the…
Tensor Parallelism
Tensor parallelism (TP) is a distributed training technique that splits the individual weight matrices of a neural network layer across multiple devices, so that each device computes a partial result that is…