Algebraic Positional Encodigns
Contributed (Poster, Spotlight) @ The Thirty-Eighth Annual Conference on Neural Information Processing Systems
December 11, 2024
Positional encodings as group homomorphisms; or: how to extend RoPE to grids, trees and other cool structures.