Algebraic Positional Encodings

Contributed (Poster, Spotlight) @ The Thirty-Eighth Annual Conference on Neural Information Processing Systems
December 11, 2024
Slides

Positional encodings as group homomorphisms; or: how to extend RoPE to grids, trees and other cool structures.