RWKV-7 (Goose)
RWKV-7, codenamed Goose, is an attention-free, RNN-style large-language-model architecture introduced in March 2025 that runs inference in linear time with constant memory per token while still training in…
Neural Networks
Explore Neural Networks through related topics and the articles other pages reference most.
Explore articles
Browse subtopics: Open Source AI
Articles that also belong to these categories. Counts cover all of Neural Networks.
All articles (116)Deep Learning (81)Machine Learning (58)Computer Vision (17)Model Architecture (15)Interpretability (6)AI History (5)Artificial Intelligence (4)Generative AI (4)Natural Language Processing (4)Transformer Models (4)AI Hardware (3)AI Research (3)Mathematics (3)Google DeepMind (2)Information Retrieval (2)Open Source AI (2)People (2)AI Ethics (1)AI Infrastructure (1)AI for Science (1)Developer Tools (1)Google (1)Large Language Models (1)MLOps (1)Model Evaluation (1)Programming Languages (1)Statistics (1)Training & Optimization (1)
Showing 1-2 of 2 articles
Retentive Network (RetNet)
RetNet (Retentive Network) is a sequence-modeling architecture proposed by Microsoft Research and Tsinghua University in July 2023 as a successor to the Transformer for large language models.