AI Wiki
Category

Neural networks

79 articles

Activation Function

Deep Learning, Machine Learning

Attention

Deep Learning, Machine Learning

Attention Is All You Need (Transformer)

Deep Learning, Machine Learning, Natural Language Processing

Backpropagation

Deep Learning, Machine Learning

Batch Normalization

Deep Learning, Machine Learning

Bayesian Neural Network

Deep Learning, Machine Learning

Bias

AI Ethics, Algorithmic Fairness, Machine Learning

Bias (Math) or Bias Term

Machine Learning, Mathematics

Bidirectional

Architectures

Boltzmann machine

Energy-Based Models, Generative Models, History of AI

Calibration Layer

Deep Learning, Machine Learning, Model Calibration

Candidate Sampling

Machine Learning, Natural Language Processing, Training Techniques

Co-Adaptation

Deep Learning, Machine Learning

Continual learning

Deep Learning, Machine Learning

ConvNeXt

Computer Vision, Convolutional Neural Networks, Deep Learning

Convolutional Neural Network

Computer Vision, Deep Learning, Machine Learning

Convolutional Operation

Computer Vision, Machine Learning

Decoder

Deep Learning, Machine Learning

Deep Learning

Artificial Intelligence, Deep Learning, Machine Learning

Deep Neural Network

Deep Learning, Machine Learning

Dense Layer

Deep Learning, Machine Learning

DenseNet

Computer Vision, Convolutional Neural Networks, Deep Learning

Discriminator

Generative Adversarial Networks, Machine Learning

EfficientNet

Computer Vision, Convolutional Neural Networks, Deep Learning

Embedding Layer

Machine Learning, Natural Language Processing

Epoch

Deep Learning, Machine Learning

Exploding Gradient Problem

Deep Learning, Machine Learning

Feedforward Neural Network (FFN)

Deep Learning, Machine Learning

Forget Gate

Machine Learning, Recurrent Neural Networks

Full Softmax

Deep Learning, Machine Learning, Natural Language Processing

Fully Connected Layer

Deep Learning, Machine Learning

GELU (Gaussian Error Linear Unit)

2016 in AI, Activation functions, Deep learning

Generative adversarial network

Deep Learning, Generative AI, Machine Learning

Generator

Generative Adversarial Networks, Machine Learning

Graph Neural Network

Deep Learning

Hidden Layer

Deep Learning, Machine Learning

Inception (deep learning)

Computer Vision, Convolutional Neural Networks, Deep Learning

Input Layer

Deep Learning, Machine Learning

Kolmogorov-Arnold Network

Deep Learning, Machine Learning

Layer

Deep Learning, Machine Learning

Logits

Deep Learning, Machine Learning, Statistics

Long Short-Term Memory (LSTM)

Deep Learning, Machine Learning, Sequence Models

Mixture of Experts (MoE)

Deep Learning, Machine Learning

MobileNet

Computer Vision, Deep Learning, Edge AI

Multi-Head Self-Attention

Attention Mechanisms, Deep Learning, Machine Learning

Multi-head Latent Attention

Attention mechanisms, Deep learning, Machine Learning

NeRF

3D Vision, Computer Vision, Deep Learning

Neural Network

Deep Learning, Machine Learning

Neural architecture search

AutoML, Deep Learning, Machine Learning

Neuromorphic computing

AI Hardware, Brain-Inspired Computing, Computing

Neuron

Machine Learning

Node (neural network)

Architectures

Output Layer

Deep Learning, Machine Learning

Parameter

Machine Learning

Perceptron

Machine Learning

RWKV

Deep Learning, Machine Learning, Sequence Models

RWKV-7 (Goose)

AI Research, Large Language Models, Open Source AI

Rectified Linear Unit (ReLU)

Deep Learning, Machine Learning

Recurrent Neural Network

Deep Learning, Machine Learning, Sequence Models

ResNet

Computer Vision, Convolutional Neural Networks, Deep Learning