Acyr Locatelli

One feature missing from @bsky.app is bookmarks. Need to keep feeding the hoarding monster

23.11.2024 10:28 — 👍 3    🔁 0    💬 0    📌 0

Great book by Thurston -- changed my approach to the field.
His talks are great as well.

22.11.2024 23:14 — 👍 4    🔁 0    💬 0    📌 0

Laura Ruis, Maximilian Mozes, Juhan Bae, Siddhartha Rao Kamalakara, Dwarak Talupuru, Acyr Locatelli, Robert Kirk, Tim Rockt\"aschel, Edward Grefenstette, Max Bartolo
Procedural Knowledge in Pretraining Drives Reasoning in Large Language Models
https://arxiv.org/abs/2411.12580

20.11.2024 07:01 — 👍 14    🔁 6    💬 0    📌 1

How do LLMs learn to reason from data? Are they ~retrieving the answers from parametric knowledge🦜? In our new preprint, we look at the pretraining data and find evidence against this:

Procedural knowledge in pretraining drives LLM reasoning ⚙️🔢

🧵⬇️

20.11.2024 16:31 — 👍 861    🔁 141    💬 38    📌 24