Math on a Helix - LLMs Use Trigonometry To Add
henningsittler
Posts: 33
Language Models Use Trigonometry to Do Addition
https://arxiv.org/abs/2502.00873We first discover that numbers are represented in these LLMs as a generalized helix, which is strongly causally implicated for the tasks of addition and subtraction, and is also causally relevant for integer division, multiplication, and modular arithmetic.
