AI Wiki
Category

Position encoding

2 articles

Rotary Position Embedding

Deep learning, Large Language Models, Transformers

Rotary position embedding (RoPE)

Deep Learning, Large Language Models, Transformers