MLOps

Arize Phoenix

Arize Phoenix is an open-source AI observability and evaluation platform developed by Arize AI for tracing, evaluating, and debugging large language model...

AI CompaniesDeveloper Tools

AutoML (Automated Machine Learning)

AutoML (Automated Machine Learning) is the automation of the end-to-end pipeline of applying machine learning to real-world data, replacing manual trial and...

Developer ToolsModel Architecture

Baseten

Baseten is an inference platform for deploying, serving, and scaling machine learning models in production. The company converts ML models into...

AI CompaniesAI Infrastructure

BentoML

BentoML is an open-source Python framework for packaging, serving, and deploying machine learning and AI models as production inference services. It was first...

Developer ToolsOpen Source AI

Concept drift

Concept drift is the change over time in the statistical relationship between a model's inputs and its target, formally when the joint distribution P(X, Y)...

Data ScienceMachine Learning

Data-centric AI (DCAI)

Data-centric AI (DCAI) is the discipline of systematically engineering and improving the data used to train a machine learning model, rather than holding the...

Data & Datasets

Distributed training

Distributed training is the practice of training a single machine learning model using many compute devices in parallel, splitting the data, the model, or both...

Training & Optimization

Dynamic model

See also: Machine learning terms A dynamic model in machine learning is a model that is retrained frequently or continuously as new data arrives, so that its...

Machine Learning

Feature store

A feature store is a centralised data system that stores, serves, discovers, shares, monitors and reuses machine-learning features, separating feature...

AI Infrastructure

Google Vertex AI

Google Vertex AI is the unified machine learning and generative artificial intelligence platform offered by Google Cloud, announced at Google I/O on May 18,...

Enterprise AIGoogle

Helicone

Helicone is an open-source LLM observability platform and AI gateway founded in 2023 by Justin Torre, Cole Gottdank, Barak Oshri, and Scott...

AI CompaniesDeveloper Tools

Inference

AI inference is the process of running a fully trained machine learning model on new, previously unseen data to produce a prediction, classification, or...

Deep LearningMachine Learning

Kubeflow

Kubeflow is an open-source MLOps platform that runs the entire machine learning lifecycle on Kubernetes, described by its creators as a project "dedicated to...

Developer ToolsMachine Learning

LangSmith

LangSmith is a commercial observability, evaluation, and deployment platform for large language model (LLM) applications and AI agents, developed and operated...

AI CompaniesAI Infrastructure

Langfuse

Langfuse is an open-source LLM engineering platform that provides observability, tracing, prompt management, evaluation, and dataset tooling for applications...

AI CompaniesDeveloper Tools

Lightning AI

Lightning AI is a New York based artificial intelligence platform company founded by William Falcon, the creator of the pytorch lightning deep learning...

AI CompaniesDeveloper Tools

MLOps

MLOps (Machine Learning Operations) is a set of practices, principles, and tools for deploying, monitoring, and maintaining machine learning models in...

MLflow

MLflow is an open-source platform for managing the end-to-end machine learning lifecycle, covering experiment tracking, model packaging, a model registry,...

Developer ToolsMachine Learning

Model deployment

Model deployment is the MLOps process of taking a trained machine learning model and making it available in a production environment so it can serve...

AI Infrastructure

NVIDIA Picasso

See also: Model Deployment and artificial intelligence applications See also: Image generation, Video generation, and 3D generation NVIDIA Picasso is a...

AI HardwareAI Inference

Neural architecture search

Neural architecture search (NAS) is a technique for automating the design of neural network architectures. Rather than relying on human experts to hand-craft...

Deep LearningMachine Learning

Offline inference

Offline inference (also called batch inference, static inference, or bulk scoring) is the practice of running a trained machine learning model over a known set...

AI Inference

Online inference

Online inference (also called dynamic inference, real-time inference, or on-demand prediction) is the practice of running a trained machine learning model...

AI Inference

Operation (op)

See also: Machine learning terms In machine learning, an operation (often abbreviated as op) is a basic computational unit that manipulates data, typically...

Developer Tools

Parameter Server (PS)

See also: Distributed training, Machine learning systems The Parameter Server (PS) is a distributed system architecture for training large machine learning...

Training & Optimization

Partitioning strategy

See also: Data parallelism, Model parallelism, Pipeline parallelism, Tensor parallelism, Distributed training A partitioning strategy in distributed deep...

Training & Optimization

Patronus AI

Patronus AI is an automated LLM evaluation, observability, and guardrails platform founded in 2023[1] and headquartered in San Francisco. The company builds...

AI CompaniesAI Safety

Pipeline

This article is about machine learning pipelines (the end-to-end ML workflow). For splitting a model across devices by layer during distributed training, see...

Machine Learning

Pipelining

See also: Machine learning terms Pipelining is a term used in two distinct senses within machine learning and artificial intelligence. The first refers to the...

Machine LearningTraining & Optimization

Post-processing

In machine learning, post-processing is any operation applied to a model's raw outputs after the prediction step but before the results reach a downstream...

AI Inference

Ray Serve

Ray Serve is a scalable, framework-agnostic model serving library built on top of the Ray (framework) distributed computing system. It allows developers to...

AI InfrastructureOpen Source AI

Replicate

Replicate is a cloud platform for running, deploying, and sharing machine learning models via a simple API. Founded in 2019 by Ben Firshman and Andreas...

AI CompaniesAI Infrastructure

Run:ai

Run:ai (legal name Runai Labs Ltd.) is an Israeli software company that developed a Kubernetes-based orchestration and scheduling platform for graphics...

AI CompaniesAI Infrastructure

SavedModel

A SavedModel is the standardized, language-neutral serialization format that TensorFlow uses to package a complete, trained model (its computation graph, its...

Developer Tools

Serving

In machine learning, serving (also called model serving or inference serving) is the process of deploying a trained model into a production environment so it...

Machine Learning

Static inference

Static inference is a machine learning serving pattern in which a model generates a batch of predictions offline, ahead of time, and caches them so that...

AI Inference

TensorFlow Serving

TensorFlow Serving (often shortened to TF Serving) is Google's open source system for serving machine learning models in production: it loads trained models,...

AI InferenceDeveloper Tools

Training-Serving Skew

Training-serving skew is a difference between a machine learning model's performance during training and its performance during serving (production inference)....

Data & DatasetsMachine Learning