RWKV-7 (Goose)
RWKV-7, codenamed Goose, is an attention-free, RNN-style large-language-model architecture introduced in March 2025 that runs inference in linear time with constant memory per token while still training in…
Open Source AI
Explore Open Source AI through related topics and the articles other pages reference most.
Explore articles
Browse subtopics: Neural Networks
Articles that also belong to these categories. Counts cover all of Open Source AI.
All articles (444)Large Language Models (165)AI Models (120)Developer Tools (109)Chinese AI (77)AI Agents (53)AI Companies (42)Mixture of Experts (40)AI Infrastructure (37)Multimodal AI (28)NVIDIA (28)Robotics (28)Machine Learning (25)AI Code Generation (23)Natural Language Processing (23)AI Tools & Products (18)Generative AI (18)Meta AI (17)Small Language Models (16)Data & Datasets (15)Video Generation (13)Computer Vision (12)Diffusion Models (12)Image Generation (12)Information Retrieval (12)Google (11)Reasoning Models (11)AI Research (10)Artificial Intelligence (10)AI Hardware (9)AI Inference (9)Microsoft (9)Research Organizations (9)Speech & Audio AI (9)Embodied AI (8)Google DeepMind (8)MLOps (7)Training & Optimization (7)AI for Science (6)Reinforcement Learning (6)Robot Hardware (6)Deep Learning (5)Drug Discovery (5)OpenAI (5)Voice AI (5)AI Benchmarks (4)AI Safety (4)Healthcare AI (4)Model Evaluation (4)Algorithms (3)Conversational AI (3)AI Ethics (2)Agentic Commerce (2)Anthropic (2)Enterprise AI (2)Humanoid Robots (2)Interpretability (2)Mathematics (2)Model Architecture (2)Neural Networks (2)People (2)Physical AI (2)Programming Languages (2)Software Development (2)Transformer Models (2)AI Incidents & Controversies (1)AI Policy (1)AI Policy & Regulation (1)Data Science (1)Music & Audio Generation (1)Quantum Computing (1)Robotics Companies (1)World Models (1)
Showing 1-2 of 2 articles
Retentive Network (RetNet)
RetNet (Retentive Network) is a sequence-modeling architecture proposed by Microsoft Research and Tsinghua University in July 2023 as a successor to the Transformer for large language models.