Daniel Kunin

🚀 An other Exciting news! Our paper "From Lazy to Rich: Exact Learning Dynamics in Deep Linear Networks" has been accepted at ICLR 2025!

arxiv.org/abs/2409.14623

A thread on how relative weight initialization shapes learning dynamics in deep networks. 🧵 (1/9)

Get rich quick: exact solutions reveal how unbalanced initializations promote rapid feature learning While the impressive performance of modern neural networks is often attributed to their capacity to efficiently extract task-relevant features from data, the mechanisms underlying this rich feature le...

Check out our #NeurIPS2024 spotlight "Get rich quick: exact solutions reveal how unbalanced initializations promote rapid feature learning."
Thu 12 Dec 4:30-7:30 pm
East Exhibit Hall A-C #2102
Paper: arxiv.org/abs/2406.06158
Thread: x.com/KuninDaniel/...

Come check out our #NeurIPS2024 spotlight poster on feature learning tomorrow!

📍 East Exhibit Hall A-C #2102
📅 Thu 12 Dec 4:30 p.m. — 7:30 p.m. PST
📝 arxiv.org/abs/2406.06158

Had an amazing time with @marcofm.bsky.social @danielkunin.bsky.social @david-klindt.bsky.social and Feng Chen doing science 🧑‍🔬 and surfing 🌊 in Santa Barbara for the Follow-on Program at the Kavli Institute for Theoretical Physics! 🌴 #ScienceAndSurf #KITP