Berfin Simsek's Avatar

Berfin Simsek

@bsimsek.bsky.social

Deep Learning x {Symmetries, Structures, Randomness} πŸ¦„ Researcher at Flatiron Computational Maths in NYC. PhD from EPFL. https://www.bsimsek.com/

24 Followers  |  41 Following  |  3 Posts  |  Joined: 21.01.2025  |  1.4382

Latest posts by bsimsek.bsky.social on Bluesky

Preview
Simons Foundation Co-Founder, Mathematician and Investor Jim Simons Dies at 86 Simons Foundation Co-Founder, Mathematician and Investor Jim Simons Dies at 86 on Simons Foundation

It's been one year since Jim Simons passed away. He remains one of the greatest philanthropists of our time. His commitment to fundamental scientific research was truly extraordinary and remains essential for advancing humanity.
www.simonsfoundation.org/2024/05/10/s...

10.05.2025 17:37 β€” πŸ‘ 29    πŸ” 7    πŸ’¬ 1    πŸ“Œ 0

Below this threshold, a mild overparameterization (log k factor) for k index vectors is sufficient to match the neurons to the ideal vectors due to a coupon collector argument. 🀠

03.05.2025 22:06 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

When the ideal vectors form an equiangular frame, all learned weights converge to their average (no matter how much overparameterization is used), which has turned from a saddle to a local minimum after a certain threshold of the dot product. 😲

03.05.2025 22:06 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Searching for an exact inverse map from learned weights to ideal (concept) vectors is an intricate geometry question, even for "simple" idealized models. 🧐

03.05.2025 22:06 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
SAM.gov

DARPA's "Exponentiating mathematics" (expMath) program, which is launching a challenge to develop and evaluate "AI collaborators" for assist in decomposing and formalizing informal mathematical proofs, is now taking short abstract proposal submissions: sam.gov/opp/869c8d73...

01.05.2025 17:36 β€” πŸ‘ 27    πŸ” 6    πŸ’¬ 5    πŸ“Œ 1

@bsimsek is following 20 prominent accounts