MLOps

Arize Phoenix

Arize Phoenix is an open-source AI observability and evaluation platform developed by Arize AI for tracing, evaluating, and debugging large language model...

AI CompaniesDeveloper Tools

AutoML (Automated Machine Learning)

AutoML (Automated Machine Learning) is the automation of the end-to-end pipeline of applying machine learning to real-world data, replacing manual trial and...

Developer ToolsModel Architecture

Baseten

Baseten is an inference platform for deploying, serving, and scaling machine learning models in production. The company converts ML models into...

AI CompaniesAI Infrastructure

BentoML

BentoML is an open-source Python framework for packaging, serving, and deploying machine learning and AI models as production inference services. It was first...

Developer ToolsOpen Source AI

Concept drift

Concept drift is the change over time in the statistical relationship between a model's inputs and its target, formally when the joint distribution P(X, Y)...

Data ScienceMachine Learning

Data-centric AI (DCAI)

Data-centric AI (DCAI) is the discipline of systematically engineering and improving the data used to train a machine learning model, rather than holding the...

Data & Datasets

Distributed training

Distributed training is the practice of training a single machine learning model using many compute devices in parallel, splitting the data, the model, or both...

Training & Optimization

Dynamic model

See also: Machine learning terms A dynamic model in machine learning is a model that is retrained frequently or continuously as new data arrives, so that its...

Machine Learning

Feature store

A feature store is a centralised data system that stores, serves, discovers, shares, monitors and reuses machine-learning features, separating feature...

AI Infrastructure

Google Vertex AI

Google Vertex AI is the unified machine learning and generative artificial intelligence platform offered by Google Cloud, announced at Google I/O on May 18,...

Enterprise AIGoogle

Helicone

Helicone is an open-source LLM observability platform and AI gateway founded in 2023 by Justin Torre, Cole Gottdank, Barak Oshri, and Scott...

AI CompaniesDeveloper Tools

Inference

In machine learning, inference is the execution of a trained model to produce an output from an input. A classifier may return class scores, a regressor may...

Deep LearningMachine Learning

KAI Scheduler

KAI Scheduler is an open-source Kubernetes scheduler that optimizes the allocation of GPU resources for artificial intelligence and machine learning workloads....

AI InfrastructureNVIDIA

Kubeflow

Kubeflow is an open-source MLOps platform that runs the entire machine learning lifecycle on Kubernetes, described by its creators as a project "dedicated to...

Developer ToolsMachine Learning

LangSmith

LangSmith is a commercial observability, evaluation, and deployment platform for large language model (LLM) applications and AI agents, developed and operated...

AI CompaniesAI Infrastructure

Langfuse

Langfuse is an open-source LLM engineering platform that provides observability, tracing, prompt management, evaluation, and dataset tooling for applications...

AI CompaniesDeveloper Tools

Lightning AI

Lightning AI is a New York based artificial intelligence platform company founded by William Falcon, the creator of the pytorch lightning deep learning...

AI CompaniesDeveloper Tools

MLOps

MLOps (Machine Learning Operations) is a set of practices, principles, and tools for deploying, monitoring, and maintaining machine learning models in...

MLflow

MLflow is an open-source platform for managing the end-to-end machine learning lifecycle, covering experiment tracking, model packaging, a model registry,...

Developer ToolsMachine Learning

Mistral Forge

Mistral Forge, branded by its developer simply as Forge, is an enterprise platform and engineering service from Mistral AI for building custom large language...

AI Tools & ProductsEnterprise AI

Model deployment

Model deployment is the MLOps process of taking a trained machine learning model and making it available in a production environment so it can serve...

AI Infrastructure

NVIDIA Picasso

See also: Model Deployment and artificial intelligence applications See also: Image generation, Video generation, and 3D generation NVIDIA Picasso is a...

AI HardwareAI Inference

Neural architecture search

Neural architecture search (NAS) is a technique for automating the design of neural network architectures. Rather than relying on human experts to hand-craft...

Deep LearningMachine Learning

Offline inference

See also: online inference, static inference, dynamic inference, inference, machine learning terms Offline inference (also called batch inference, static...

AI Inference

Online inference

See also: offline inference, static inference, dynamic inference, inference, machine learning terms Online inference (also called dynamic inference, real-time...

AI Inference

Operation (op)

See also: Machine learning terms In machine learning, an operation (often abbreviated as op) is a basic computational unit that manipulates data, typically...

Developer Tools

Parameter Server (PS)

See also: Distributed training, Machine learning systems The Parameter Server (PS) is a distributed system architecture for training large machine learning...

Training & Optimization

Partitioning strategy

See also: Data parallelism, Model parallelism, Pipeline parallelism, Tensor parallelism, Distributed training A partitioning strategy in distributed deep...

Training & Optimization

Patronus AI

Patronus AI is an automated LLM evaluation, observability, and guardrails platform founded in 2023[1] and headquartered in San Francisco. The company builds...

AI CompaniesAI Safety

Pipeline

See also: Machine learning, MLOps, Model deployment This article is about machine learning pipelines (the end-to-end ML workflow). For splitting a model across...

Machine Learning

Pipelining

See also: Machine learning terms Pipelining is a term used in two distinct senses within machine learning and artificial intelligence. The first refers to the...

Machine LearningTraining & Optimization

Post-processing

See also: Machine learning terms In machine learning, post-processing is any operation applied to a model's raw outputs after the prediction step but before...

AI Inference

Ray Serve

Ray Serve is a scalable, framework-agnostic model serving library built on top of the Ray (framework) distributed computing system. It allows developers to...

AI InfrastructureOpen Source AI

Replicate

Replicate is a cloud platform for running, deploying, and sharing machine learning models via a simple API. Founded in 2019 by Ben Firshman and Andreas...

AI CompaniesAI Infrastructure

Run:ai

Run:ai (legal name Runai Labs Ltd.) is an Israeli software company that developed a Kubernetes-based orchestration and scheduling platform for graphics...

AI CompaniesAI Infrastructure

SavedModel

See also: Machine learning terms A SavedModel is the standardized, language-neutral serialization format that TensorFlow uses to package a complete, trained...

Developer Tools

Serving

See also: Inference, Model, Training, MLOps In machine learning, serving (also called model serving or inference serving) is the process of deploying a trained...

Machine Learning

Static inference

See also: Inference, Offline inference, Dynamic inference Static inference is a machine learning serving pattern in which a model generates a batch of...

AI Inference

TensorFlow Serving

See also: Machine learning terms TensorFlow Serving (often shortened to TF Serving) is Google's open source system for serving machine learning models in...

AI InferenceDeveloper Tools

Training-Serving Skew

Training-serving skew is a difference between a machine learning model's performance during training and its performance during serving (production inference)....

Data & DatasetsMachine Learning