Agentic video understanding
Agentic video understanding is an approach to video analysis in which a reasoning model chooses which parts of a video to inspect for a particular question.
Explore Computer Vision through related topics and the articles other pages reference most.
Articles that also belong to these categories. Counts cover all of Computer Vision.
Showing 1-41 of 41 articles
Agentic video understanding is an approach to video analysis in which a reasoning model chooses which parts of a video to inspect for a particular question.
AlexNet is a deep learning convolutional neural network, built by Alex Krizhevsky, Ilya Sutskever, and Geoffrey Hinton at the University of Toronto, that won the ImageNet Large Scale Visual Recognition…
Average precision (AP) is an evaluation metric that summarizes the precision-recall curve of a ranked list into a single number between 0 and 1, equal to the area under that curve.
A bounding box is a rectangular region defined by a set of coordinates that encloses an object of interest within an image, video frame, or three-dimensional space.
CIDEr (Consensus-based Image Description Evaluation) is an automatic evaluation metric for image captioning that scores a machine-generated caption by how closely it matches the consensus of several human…
CLIP, short for Contrastive Language-Image Pre-training, is a family of neural networks developed by OpenAI researchers to learn a shared representation of images and natural-language descriptions.
COCO (Common Objects in Context) is a large-scale dataset for object detection, image segmentation, keypoint detection, and image captioning.
Computer vision is the study of computational methods that extract, estimate, or generate useful representations from visual measurements.
A computer-use agent (CUA) is a category of AI agent in artificial intelligence that performs tasks by directly operating a general-purpose computer's graphical user interface (GUI) the way a human does, by…
A convolutional filter (also called a kernel or feature detector) is a small matrix of learnable weights that slides across an input and computes a dot product at each position to produce a feature map.
A convolutional layer is the core building block of a convolutional neural network (CNN): it slides a small set of learnable filters (also called kernels) across the input, computing a convolution (technically…
A convolutional neural network (CNN, or ConvNet) is a neural network that uses convolution-like linear operators in at least some layers.
The convolutional operation is a mathematical procedure that combines two functions to produce a third function expressing how the shape of one is modified by the other.
DINO (self-DIstillation with NO labels) is a family of self-supervised learning methods for computer vision from Meta AI that trains Vision Transformers (ViTs) on unlabeled images and produces general-purpose…
A depthwise separable convolution is a factorized form of convolution that decomposes a standard convolutional operation into two sequential steps: a depthwise convolution and a pointwise convolution.
A diffusion model is a generative model that learns to transform samples from a simple reference distribution into samples resembling a data distribution by reversing a gradual corruption process.
Earth Mover's Distance (EMD), also known as the Wasserstein-1 distance, Kantorovich-Rubinstein metric, or Mallows's distance
Focal loss is a loss function that reshapes standard cross-entropy loss by adding a (1 - p_t)^gamma modulating factor, which down-weights well-classified (easy) examples so that training concentrates on hard
Grad-CAM (Gradient-weighted Class Activation Mapping) is a technique for producing visual explanations from convolutional neural network (CNN) models by using the gradients of a target class flowing into the…
I-JEPA (Image-based Joint-Embedding Predictive Architecture) is a self-supervised learning method for computer vision developed by Meta AI.
Image recognition is the field of artificial intelligence and computer vision that enables machines to identify, classify, and interpret the objects, patterns, and features contained in a digital image or…
Image classification is the task of assigning a whole image to one category drawn from a fixed set of labels.
Image segmentation is the computer vision task of partitioning a digital image into multiple regions by assigning every pixel a label, producing a pixel-level map of what each part of the image contains.
ImageNet is a large, hierarchically organized image dataset created to support research in computer vision, especially object recognition.
LAION (Large-scale Artificial Intelligence Open Network) is a German non-profit organization
Landmarks are reference points used as anchors in two largely separate areas of machine learning.
LeVJEPA is a self-supervised learning method for training video encoders. It applies the LeJEPA objective to video
The Modified National Institute of Standards and Technology (MNIST) database is a collection of 70,000 grayscale images of handwritten digits (0 through 9) that has served as one of the most widely used…
The key machine learning terms for computer vision describe how neural networks turn pixels into predictions: a convolution slides a small learned filter (kernel) across an image to detect patterns, a…
Masked autoencoder (MAE) is a self-supervised learning method for vision transformers that masks roughly 75% of an input image's patches and trains a network to reconstruct the missing pixels from the small…
A multimodal model is a machine learning model, or a model-based system, that processes, relates, or produces information across more than one kind of data. Each kind is called a modality.
OCR Models are artificial intelligence (AI) systems that convert images of typed, handwritten, or printed text into machine-readable digital text through Optical Character Recognition (OCR).
Object detection is a computer vision task that finds instances of interest in an image and assigns each one a category.
PASCAL VOC (Pattern Analysis, Statistical Modelling and Computational Learning Visual Object Classes) is a long-running benchmark dataset and annual challenge for object recognition, object detection…
Pose estimation is the computer vision task of detecting and localizing the keypoints (also called landmarks or joints) of a human body, hand, face, animal, or rigid object in images and video, then connecting…
Pre-training is a stage of machine learning in which a model learns parameters from a source dataset or source objective before those parameters are reused or adapted for a target use.
SimCLR (Simple Framework for Contrastive Learning of Visual Representations) is a self-supervised learning method for computer vision in which a network is trained to recognise that two differently augmented…
Spatial pooling is a downsampling operation in convolutional neural networks (CNNs) that replaces a local region of a feature map with a single summary statistic, such as the maximum or the average of the…
Stride is the step size by which a filter (or pooling window) moves across the input in a convolutional neural network (CNN): a stride of 1 shifts the filter one position at a time and visits every location…
U-Net is a convolutional neural network architecture designed for biomedical image segmentation.
V-JEPA (Video Joint Embedding Predictive Architecture) is a self-supervised video model from Meta AI that learns by predicting masked regions of a video in an abstract latent representation space rather than…