Axolotl
Axolotl is a free and open source framework for fine-tuning and post-training large language models, written in Python and driven entirely by a single YAML configuration file.
Open Source AI
Explore Open Source AI through related topics and the articles other pages reference most.
Explore articles
Browse subtopics: Training & Optimization
Articles that also belong to these categories. Counts cover all of Open Source AI.
All articles (444)Large Language Models (165)AI Models (120)Developer Tools (109)Chinese AI (77)AI Agents (53)AI Companies (42)Mixture of Experts (40)AI Infrastructure (37)Multimodal AI (28)NVIDIA (28)Robotics (28)Machine Learning (25)AI Code Generation (23)Natural Language Processing (23)AI Tools & Products (18)Generative AI (18)Meta AI (17)Small Language Models (16)Data & Datasets (15)Video Generation (13)Computer Vision (12)Diffusion Models (12)Image Generation (12)Information Retrieval (12)Google (11)Reasoning Models (11)AI Research (10)Artificial Intelligence (10)AI Hardware (9)AI Inference (9)Microsoft (9)Research Organizations (9)Speech & Audio AI (9)Embodied AI (8)Google DeepMind (8)MLOps (7)Training & Optimization (7)AI for Science (6)Reinforcement Learning (6)Robot Hardware (6)Deep Learning (5)Drug Discovery (5)OpenAI (5)Voice AI (5)AI Benchmarks (4)AI Safety (4)Healthcare AI (4)Model Evaluation (4)Algorithms (3)Conversational AI (3)AI Ethics (2)Agentic Commerce (2)Anthropic (2)Enterprise AI (2)Humanoid Robots (2)Interpretability (2)Mathematics (2)Model Architecture (2)Neural Networks (2)People (2)Physical AI (2)Programming Languages (2)Software Development (2)Transformer Models (2)AI Incidents & Controversies (1)AI Policy (1)AI Policy & Regulation (1)Data Science (1)Music & Audio Generation (1)Quantum Computing (1)Robotics Companies (1)World Models (1)
Showing 1-7 of 7 articles
DeepSeek-R1-Distill
DeepSeek-R1-Distill is a family of six open-weight reasoning language models released by DeepSeek on January 20, 2025, alongside the flagship DeepSeek-R1 reasoning model.
HuggingFace PEFT
PEFT (Parameter-Efficient Fine-Tuning) is an open-source Python library from Hugging Face that adapts large pretrained models to new tasks by training only a small set of added or selected parameters, often…
HuggingFace TRL
TRL (Transformer Reinforcement Learning, now stylized as Transformers Reinforcement Learning) is an open-source Python library maintained by Hugging Face for post-training large language models with…
LLaMA-Factory
LLaMA-Factory is an open-source unified framework for the efficient fine-tuning of large language models (LLMs) and vision-language models (VLMs).
Megatron-LM
Megatron-LM is NVIDIA's open-source framework for training very large transformer language models across GPU clusters
Unsloth
Unsloth is an open-source Python library that fine-tunes large language models up to two times faster while using up to 70 percent less GPU memory and, in its own words, with "no accuracy loss".