Michal Stefanik's Avatar

Michal Stefanik

@michalstefanik.bsky.social

NLP Researcher: Robust Language Models | Masaryk University & GaussAlgo

41 Followers  |  279 Following  |  2 Posts  |  Joined: 23.11.2024  |  1.6811

Latest posts by michalstefanik.bsky.social on Bluesky

arxiv.org/abs/2506.08966

14.06.2025 14:44 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Post image Post image Post image

Thought language models are bad with numbers?
So did we.

โŒ Turns out we were wrong.

Models just use their own special representation for numeric values.
Similar to binary, closer to sinusoidal.

If we interpret this space right, we can recover values they represent with 100% accuracy!

#llms #nlp

14.06.2025 14:43 โ€” ๐Ÿ‘ 4    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

@michalstefanik is following 19 prominent accounts