MLOps

Explore MLOps through related topics and the articles other pages reference most.

Explore articles

Reset filters
Browse subtopics: AI Inference

Articles that also belong to these categories. Counts cover all of MLOps.

Showing 1-6 of 6 articles

NVIDIA Picasso

NVIDIA Picasso is a cloud-based generative AI foundry from NVIDIA for building, training, and deploying visual generative models that produce images, video, and 3D content from text prompts.

AI HardwareAI Inference

Offline inference

Offline inference (also called batch inference, static inference, or bulk scoring) is the practice of running a trained machine learning model over a known set of inputs ahead of time and storing the resulting…

AI Inference

Online inference

Online inference (also called dynamic inference, real-time inference, or on-demand prediction) is the practice of running a trained machine learning model synchronously inside a request path

AI Inference

Post-processing

In machine learning, post-processing is any operation applied to a model's raw outputs after the prediction step but before the results reach a downstream system or end user.

AI Inference

Static inference

Static inference is a machine learning serving pattern in which a model generates a batch of predictions offline, ahead of time, and caches them so that applications read the precomputed answer from storage…

AI Inference

TensorFlow Serving

TensorFlow Serving (often shortened to TF Serving) is Google's open source system for serving machine learning models in production: it loads trained models, exposes them over gRPC and REST APIs, and manages…

AI InferenceDeveloper Tools