Axolotl
Axolotl is a free and open source framework for fine-tuning and post-training large language models, written in Python and driven entirely by a single YAML configuration file.
Open Source AI
Explore Open Source AI through related topics and the articles other pages reference most.
Explore articles
Browse subtopics: Training & Optimization
Articles that also belong to these categories. Counts cover all of Open Source AI.
All articles (517)Large Language Models (184)AI Models (134)Developer Tools (129)Chinese AI (92)AI Agents (69)AI Companies (48)AI Infrastructure (46)Mixture of Experts (43)Multimodal AI (32)NVIDIA (31)Robotics (31)AI Code Generation (28)Machine Learning (26)AI Inference (23)Natural Language Processing (23)Meta AI (20)Small Language Models (19)AI Tools & Products (18)Generative AI (18)Data & Datasets (16)Diffusion Models (15)Video Generation (15)Speech & Audio AI (14)Computer Vision (13)Image Generation (13)Information Retrieval (13)Reasoning Models (13)AI Research (12)Google (11)Research Organizations (11)Training & Optimization (11)AI Safety (10)Embodied AI (10)Microsoft (10)Reinforcement Learning (10)AI for Science (9)Artificial Intelligence (9)Google DeepMind (8)MLOps (8)Robot Hardware (8)Voice AI (7)Enterprise AI (6)OpenAI (6)AI Benchmarks (5)AI Hardware (5)Deep Learning (5)Drug Discovery (5)Healthcare AI (5)Model Evaluation (5)AI Policy & Regulation (3)Algorithms (3)Anthropic (3)Conversational AI (3)Humanoid Robots (3)Interpretability (3)Mathematics (3)People (3)Software Development (3)World Models (3)AI Compute (2)AI Ethics (2)AI in Gaming (2)Agentic Commerce (2)Model Architecture (2)Neural Networks (2)Physical AI (2)Programming Languages (2)Transformer Models (2)AI Events (1)AI Incidents & Controversies (1)Autonomous Vehicles (1)Consumer AI Devices (1)Data Science (1)Finance AI (1)Music & Audio Generation (1)Quantum Computing (1)Robotics Companies (1)
Showing 1-11 of 11 articles
DeepSeek-R1-Distill
DeepSeek-R1-Distill is a family of six open-weight reasoning language models released by DeepSeek on January 20, 2025, alongside the flagship DeepSeek-R1 reasoning model.
HuggingFace PEFT
PEFT (Parameter-Efficient Fine-Tuning) is an open-source Python library from Hugging Face that adapts large pretrained models to new tasks by training only a small set of added or selected parameters, often…
HuggingFace TRL
TRL (Transformer Reinforcement Learning, now stylized as Transformers Reinforcement Learning) is an open-source Python library maintained by Hugging Face for post-training large language models with…
LLaMA-Factory
LLaMA-Factory is an open-source unified framework for the efficient fine-tuning of large language models (LLMs) and vision-language models (VLMs).
Megatron-LM
Megatron-LM is NVIDIA's open-source framework for training very large transformer language models across GPU clusters
Olmo-core
Olmo-core is an open-source Python library for modeling and large-scale distributed training with PyTorch. The Allen Institute for AI (Ai2) develops and maintains it under the Apache 2.0 license.
SkyRL
SkyRL is an open-source reinforcement learning (RL) library for post-training large language models and multi-turn agents.
TorchTitan
TorchTitan (styled torchtitan in its repository) is an open-source, PyTorch-native platform for training large generative AI models
Unsloth
Unsloth is an open-source Python library that fine-tunes large language models up to two times faster while using up to 70 percent less GPU memory and, in its own words, with "no accuracy loss".
Zephon
Zephon is an open-source data loader for training foundation models on text and multimodal data, developed by DatologyAI and released under the Apache License 2.0 in October 2026.