Math on a Helix - LLMs Use Trigonometry To Add

Language Models Use Trigonometry to Do Addition

https://arxiv.org/abs/2502.00873

We first discover that numbers are represented in these LLMs as a generalized helix, which is strongly causally implicated for the tasks of addition and subtraction, and is also causally relevant for integer division, multiplication, and modular arithmetic. 

Tagged:
Sign In or Register to comment.

About Cookies

This website uses cookies to ensure you get the best experience on our website.

Learn more: https://www.cookiesandyou.com/