Showing 301-314 of 314 articles
Wasserstein GAN (WGAN)
A Wasserstein GAN (WGAN) is a generative adversarial network that trains its two networks to minimise the Wasserstein-1 distance, also called the Earth mover's...
Generative AIMathematics
Wav2Vec
Wav2Vec is a family of self-supervised learning models from Meta AI (formerly Facebook AI Research) that learn speech representations directly from raw audio...
Meta AINatural Language Processing
WaveNet
WaveNet is a deep generative model for raw audio waveforms developed by DeepMind that synthesizes speech by predicting one waveform sample at a time, each...
Google DeepMindSpeech & Audio AI
Whisper
Whisper is an open-source family of automatic speech recognition (ASR) models developed by OpenAI and first released on September 21, 2022.[^1] Built on an...
Natural Language ProcessingOpenAI
Word Embedding
A word embedding is a learned representation of text in which words are mapped to dense vectors of real numbers in a continuous vector space, so that words...
Machine LearningNatural Language Processing
XLNet
XLNet is a generalized autoregressive pretraining method for natural language processing that combines the strengths of autoregressive and autoencoding...
Machine LearningNatural Language Processing
YOLO (object detection)
YOLO (You Only Look Once) is a family of object detection models that treat detection as a single regression problem, predicting bounding boxes and class...
Computer VisionNeural Networks
YaRN
YaRN (Yet another RoPE extensioN) is a compute-efficient method for extending the context window of large language models that use Rotary Position Embeddings...
AI InferenceModel Architecture
ZeRO (Zero Redundancy Optimizer)
ZeRO (Zero Redundancy Optimizer) is a family of memory-optimization techniques for training large neural networks introduced by Samyam Rajbhandari, Jeff...
MicrosoftTraining & Optimization
muP (Maximal Update Parametrization)
muP, short for Maximal Update Parametrization (often written muP, μP, or mu-P), is a parametrization scheme for deep neural networks in which a small set of...
Training & Optimization
tf.keras
tf.keras is the high-level deep learning API built directly into the TensorFlow machine learning framework, and it has been TensorFlow's official and...
Developer ToolsMachine Learning
tinygrad
tinygrad is an open-source deep learning framework written primarily in Python that aims to occupy the space between Andrej Karpathy's pedagogical micrograd...
Developer ToolsOpen Source AI
torch.compile
torch.compile is the just-in-time graph capture and compilation feature introduced in PyTorch 2.0, a release first announced at the PyTorch Conference on...
Developer ToolsTraining & Optimization
xLSTM
xLSTM (Extended Long Short-Term Memory) is a recurrent neural network architecture introduced in May 2024 by Maximilian Beck, Korbinian Pöppel, Sepp...
Model ArchitectureNeural Networks