Self-Instruct
Self-Instruct is a semi-automated framework for aligning a pretrained large language model with instruction-following behavior by bootstrapping its training data from the model itself, introduced in December…
Data & Datasets
Explore Data & Datasets through related topics and the articles other pages reference most.
Explore articles
Browse subtopics: Training & Optimization
Articles that also belong to these categories. Counts cover all of Data & Datasets.
All articles (116)Machine Learning (65)Natural Language Processing (15)Open Source AI (15)Computer Vision (13)AI Benchmarks (11)Large Language Models (11)Statistics (10)AI Ethics (6)Meta AI (6)Robotics (5)Embodied AI (4)AI Companies (3)Model Evaluation (3)NVIDIA (3)AI Research (2)Data Science (2)Deep Learning (2)MLOps (2)Multimodal AI (2)Training & Optimization (2)AI Code Generation (1)AI History (1)AI Infrastructure (1)AI Models (1)AI Policy & Regulation (1)AI Safety (1)AI Tools & Products (1)AI for Science (1)Algorithms (1)Artificial Intelligence (1)Chinese AI (1)Developer Tools (1)Enterprise AI (1)Generative AI (1)Google (1)Google DeepMind (1)Mathematics (1)Robotics Companies (1)
Showing 1-2 of 2 articles
WRAP (Web Rephrase Augmented Pre-training)
WRAP (Web Rephrase Augmented Pre-training) is a synthetic-data pre-training method introduced in the paper "Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling," posted to arXiv on 29…