Discrete diffusion language model
A discrete diffusion language model is a class of generative model for text that produces tokens by iteratively denoising a corrupted sequence, rather than by predicting one token at a time from left to right.
Diffusion Models
Explore Diffusion Models through related topics and the articles other pages reference most.
Explore articles
Browse subtopics: Natural Language Processing
Articles that also belong to these categories. Counts cover all of Diffusion Models.
All articles (43)Generative AI (19)Image Generation (18)Open Source AI (12)Large Language Models (7)Video Generation (7)Google DeepMind (5)AI Companies (4)AI Models (4)OpenAI (4)AI for Science (2)Mixture of Experts (2)NVIDIA (2)Natural Language Processing (2)Deep Learning (1)Drug Discovery (1)Google (1)Machine Learning (1)Model Architecture (1)Multimodal AI (1)Robotics (1)Statistics (1)Transformer Models (1)
Showing 1-2 of 2 articles
SEDD (Score Entropy Discrete Diffusion)
Score Entropy Discrete Diffusion (SEDD) is a discrete diffusion model for language and other discrete data introduced by Aaron Lou, Chenlin Meng, and Stefano Ermon at Stanford University in the paper Discrete…