[The 3D plot of ReLU above is from addxorrol.blogspot.com/2024/07/some... ]. Guido Montufar has an excellent paper showing that the number of regions in the piecewise-affine function defined this way is exponential in the depth of the network: proceedings.neurips.cc/paper_files/... 3/3.
16.02.2025 15:57 — 👍 0 🔁 0 💬 0 📌 0
I will use that for the deep learning class I teach. Feel free to reuse ! In general I love the "origami effect" explanation of why deep learning works well. This is particularly clear for "ReLU" non linearities. You can then view each layer as folding your space in two. 2/n
16.02.2025 15:55 — 👍 0 🔁 0 💬 1 📌 0
I just had a lot of fun creating this animation, inspired by a quote from @fchollet.bsky.social 's book "Deep Learning with Python" 😊. You can view the layers of a DNN as progressively unfolding the intertwined manifolds of the classes you want to separate, like two crumbled sheets of paper. 🧵 1/n
16.02.2025 15:50 — 👍 2 🔁 0 💬 1 📌 0
Hi Jonathan! 🙂
20.11.2024 10:03 — 👍 1 🔁 0 💬 1 📌 0
Hello there! Checking out whether the sky is bluer here 🙂
20.11.2024 09:58 — 👍 3 🔁 0 💬 1 📌 0
Research Director @ Inria, Grenoble
Mathematician at UCLA. My primary social media account is https://mathstodon.xyz/@tao . I also have a blog at https://terrytao.wordpress.com/ and a home page at https://www.math.ucla.edu/~tao/
AudioML research scientist at https://audioshake.ai, before: post-doc @inria@social.numerique.gouv.fr, Editor at https://bsky.app/profile/joss-openjournals.bsky.social
All in 17.68% of grey, located in Frankfurt (Germany)
Creator of http://steinberg.net/spectralayers and http://torchstudio.ai
Lives in Paris, France
"Sensing Emotions...coz Mental Health matters"
PhD Candidate | IIITD, India | HCAI | Ubiquitous Computing | Sensing | Data Centric AI
https://alchemy18.github.io/pragyasingh/
CNRS Researcher in maths & computer science. My (current) focus is machine learning and optimization. I live & work in Nice 🇫🇷
website: https://samuelvaiter.com
Ph.D. in Artificial Intelligence and Music, C4DM
https://saurjya.github.io/
Postdoctoral researcher at Meta
CNRS researcher. Hates genAI with passion. Food and music 🎹 https://linktr.ee/bluecurlmusic
Research Scientist @ Meta GenAI in NYC.
Working on audio/speech for LLaMA.
Previously: PhD @ JHU CLSP
desh2608.github.io
CEO of Bluesky, steward of AT Protocol.
Let’s build a federated republic, starting with this server. 🌱 🪴 🌳
Researcher in computational physics,,
Scientific director of Program Inria Quadrant
2018-2022 director of Inria Nancy G-Est,
ERC GOODSHAPE-VORPALINE,
#riscv ambassador
PhD, climate scientist @lsce-ipsl.bsky.social @CEAParisSaclay @IPSL_outreach @hc_climat. Was co-chair @ipcc.bsky.social (AR6 WGI). Member of French Academy of Technology and Academy of Sciences.
« Le Monde » est un journal français fondé par Hubert Beuve-Méry en 1944. C'est aussi un compte Bluesky qui poste l'actualité en continu de façon automatisée.
P(A|B) = [P(A)*P(B|A)]/P(B), all the rest is commentary. Click to read Astral Codex Ten, by Scott Alexander, a […] [bridged from astralcodexten.com on the web: https://fed.brid.gy/web/astralcodexten.com ]