KTO
KTO (Kahneman-Tversky Optimization) is a method for aligning large language models with human feedback using only a binary signal of whether a model output is desirable or undesirable, rather than the paired…
Reinforcement Learning
Explore Reinforcement Learning through related topics and the articles other pages reference most.
Explore articles
Browse subtopics: AI Alignment
Articles that also belong to these categories. Counts cover all of Reinforcement Learning.
All articles (118)Machine Learning (57)Robotics (17)Deep Learning (12)Google DeepMind (12)People (11)AI Models (8)Algorithms (8)AI Research (7)AI in Gaming (7)Artificial Intelligence (7)Training & Optimization (7)Open Source AI (6)OpenAI (6)AI Agents (5)AI Alignment (5)AI Safety (5)Mathematics (5)AI Inference (3)Embodied AI (3)NVIDIA (3)AI Benchmarks (2)AI Hardware (2)Chinese AI (2)Large Language Models (2)Meta AI (2)Model Evaluation (2)Reasoning Models (2)Statistics (2)World Models (2)AI Companies (1)Computer Science (1)Developer Tools (1)Generative AI (1)Google (1)Humanoid Robots (1)Image Generation (1)Multimodal AI (1)Research Organizations (1)
Showing 1-5 of 5 articles
RLOO (REINFORCE Leave-One-Out)
RLOO (REINFORCE Leave-One-Out) is an online reinforcement learning algorithm for aligning large language models with reward signals such as those derived from human preferences.
Recursive reward modeling
Recursive reward modeling (RRM) is a proposed approach to the scalable oversight problem in AI alignment
Reward hacking
Reward hacking (also called specification gaming) is a failure mode in artificial intelligence in which a system maximizes its given objective or reward signal through unintended shortcuts, exploits, or…
Specification gaming
Specification gaming is the phenomenon in which an optimizer satisfies the literal specification of an objective without producing the outcome that the designer actually wanted.