AI Wiki
Category

Neural Networks

116 articles

Activation Function

Deep Learning, Machine Learning

Attention

Deep Learning, Machine Learning

Attention Is All You Need (Transformer)

AI Research, Deep Learning, Machine Learning

Attention sink

Deep Learning

Backpropagation

Deep Learning, Machine Learning

Batch Normalization

Deep Learning, Machine Learning

Bayesian Neural Network

Deep Learning, Machine Learning

Bias

AI Ethics, Machine Learning

Bias (Math) or Bias Term

Machine Learning, Mathematics

Bidirectional

Model Architecture

Boltzmann machine

AI History, Generative AI

Calibration Layer

Deep Learning, Machine Learning, Model Evaluation

Candidate Sampling

Machine Learning, Natural Language Processing, Training & Optimization

Co-Adaptation

Deep Learning, Machine Learning

Continual learning

Deep Learning, Machine Learning

ConvNeXt

Computer Vision, Deep Learning

Convolutional Neural Network

Computer Vision, Deep Learning, Machine Learning

Convolutional Operation

Computer Vision, Machine Learning

Cross-encoder

Information Retrieval, Natural Language Processing

Decoder

Deep Learning, Machine Learning

Deep Learning

Artificial Intelligence, Deep Learning, Machine Learning

Deep Neural Network

Deep Learning, Machine Learning

DeepNorm / DeepNet

Deep Learning

DeepSeek Sparse Attention (DSA)

Deep Learning

Dense Layer

Deep Learning, Machine Learning

DenseNet

Computer Vision, Deep Learning

Depthwise separable convolutional neural network (sepCNN)

Computer Vision, Model Architecture

Discriminator

Generative AI, Machine Learning

EfficientNet

Computer Vision, Deep Learning

Embedding Layer

Machine Learning, Natural Language Processing

Epoch

Deep Learning, Machine Learning

Expert Choice routing

Deep Learning

Exploding Gradient Problem

Deep Learning, Machine Learning

Feedforward Neural Network (FFN)

Deep Learning, Machine Learning

Forget Gate

Machine Learning

Full Softmax

Deep Learning, Machine Learning, Natural Language Processing

Fully Connected Layer

Deep Learning, Machine Learning

GELU (Gaussian Error Linear Unit)

Artificial Intelligence, Deep Learning

Gated DeltaNet

Deep Learning

Generative adversarial network

Deep Learning, Generative AI, Machine Learning

Generator

Generative AI, Machine Learning

Graph Neural Network

Deep Learning

GraphCast

AI for Science, Google DeepMind

H-Net (dynamic chunking)

Deep Learning

Hidden Layer

Deep Learning, Machine Learning

Hymba

Deep Learning

Inception (deep learning)

Computer Vision, Deep Learning

Input Layer

Deep Learning, Machine Learning

Intel Loihi

AI Hardware

Jürgen Schmidhuber

Deep Learning, People

Kolmogorov-Arnold Network

Deep Learning, Machine Learning

LSTM

Deep Learning, Model Architecture

Layer

Deep Learning, Machine Learning

LeNet

Artificial Intelligence, Computer Vision, Deep Learning

Lightning Attention

Deep Learning

Linear Probes

Interpretability

Logits

Deep Learning, Machine Learning, Statistics

Long Short-Term Memory (LSTM)

Deep Learning, Machine Learning, Model Architecture

Mixture of Block Attention (MoBA)

Deep Learning

Mixture of Experts (MoE)

Deep Learning, Machine Learning