Category
Transformer models
14 articles
ALBERT
Deep Learning, Natural Language Processing
DETR
Computer Vision, Deep Learning, Object Detection
DeBERTa
Deep Learning, Microsoft, Natural Language Processing
DeiT
Computer Vision, Deep Learning
ELECTRA
Deep Learning, Natural Language Processing
Flash Attention 3
AI Algorithms, GPU Computing
Mixture of Depths
Deep Learning, Efficiency, Machine Learning
Multi-head Latent Attention
Attention mechanisms, Deep learning, Machine Learning
PaLM
Google DeepMind, Large Language Models, Natural Language Processing
Positional encoding
Deep Learning, Natural Language Processing
RoBERTa
Deep Learning, Machine Learning, Natural Language Processing
Sparse attention
Deep Learning, Efficiency, Machine Learning
Swin Transformer
Computer Vision, Deep Learning, Neural Networks
XLNet
Deep Learning, Machine Learning, Natural Language Processing