Chinchilla scaling laws
The Chinchilla scaling laws are a set of empirical findings published by DeepMind researchers in 2022 showing that, for a fixed compute budget, a large language model trains most efficiently when its number of…
Machine Learning
Explore learning methods, model architectures, datasets, and practical applications.
Explore articles
Browse subtopics: AI Research
Articles that also belong to these categories. Counts cover all of Machine Learning.
All articles (858)Deep Learning (187)Natural Language Processing (92)Statistics (90)Training & Optimization (70)Data & Datasets (65)Neural Networks (58)Reinforcement Learning (58)Model Evaluation (55)Artificial Intelligence (54)Large Language Models (49)Mathematics (48)Computer Vision (41)AI Ethics (35)AI Infrastructure (29)AI Safety (26)Open Source AI (25)Data Science (24)AI Benchmarks (22)Developer Tools (20)Algorithms (18)AI Hardware (17)AI Tools & Products (17)Google (16)Generative AI (14)Information Retrieval (14)Model Architecture (13)People (13)AI Agents (12)Interpretability (12)Robotics (12)AI Companies (11)Transformer Models (11)AI Inference (10)MLOps (10)AI Models (8)Computer Science (8)AI Code Generation (7)AI Research (7)Multimodal AI (7)Speech & Audio AI (7)Chinese AI (6)AI Policy & Regulation (5)Meta AI (5)Programming Languages (5)AI History (4)AI for Science (4)Prompt Engineering (4)AI Alignment (3)AI Events (3)Reasoning Models (3)Embodied AI (2)Software Development (2)2025 in artificial intelligence (1)Anthropic (1)Diffusion Models (1)Drug Discovery (1)Education AI (1)Enterprise AI (1)Healthcare AI (1)Image Generation (1)NVIDIA (1)Small Language Models (1)World Models (1)
Showing 1-7 of 7 articles
LeVJEPA
LeVJEPA is a self-supervised learning method for training video encoders. It applies the LeJEPA objective to video
Neural Tangent Kernel
The neural tangent kernel (NTK) is a kernel function built from the parameter gradients of a neural network.
Program Synthesis
Program synthesis is the task of automatically constructing a program that satisfies a specification expressed at a higher level than the code itself: a logical formula, a set of input-output examples, a…
Sanjay Ghemawat
Sanjay Ghemawat (born 1966) is an American computer scientist and software engineer, best known for co-creating the core distributed-systems infrastructure that powered Google's rise, including the Google File…
Scaling Laws for Neural Language Models
Scaling Laws for Neural Language Models is a landmark research paper published by OpenAI on January 23, 2020 (arXiv:2001.08361) that established that the test loss of a neural language model falls as a smooth…
Training AI to Paint with Code
Training AI to Paint with Code is an experimental AI art project published by designer and researcher Surya Narreddi in March 2026.