Antoine Deleforge's Avatar

Antoine Deleforge

@adeleforge.bsky.social

Research scientist at #Inria. Audio signal processing, Acoustics, Machine Learning, Bicycle Riding, Lindy Hop Dancing.

194 Followers  |  41 Following  |  5 Posts  |  Joined: 20.11.2024  |  1.3721

Latest posts by adeleforge.bsky.social on Bluesky

[The 3D plot of ReLU above is from addxorrol.blogspot.com/2024/07/some... ]. Guido Montufar has an excellent paper showing that the number of regions in the piecewise-affine function defined this way is exponential in the depth of the network: proceedings.neurips.cc/paper_files/... 3/3.

16.02.2025 15:57 — 👍 0    🔁 0    💬 0    📌 0
Video thumbnail

I will use that for the deep learning class I teach. Feel free to reuse ! In general I love the "origami effect" explanation of why deep learning works well. This is particularly clear for "ReLU" non linearities. You can then view each layer as folding your space in two. 2/n

16.02.2025 15:55 — 👍 0    🔁 0    💬 1    📌 0
Video thumbnail

I just had a lot of fun creating this animation, inspired by a quote from @fchollet.bsky.social 's book "Deep Learning with Python" 😊. You can view the layers of a DNN as progressively unfolding the intertwined manifolds of the classes you want to separate, like two crumbled sheets of paper. 🧵 1/n

16.02.2025 15:50 — 👍 2    🔁 0    💬 1    📌 0

Hi Jonathan! 🙂

20.11.2024 10:03 — 👍 1    🔁 0    💬 1    📌 0

Hello there! Checking out whether the sky is bluer here 🙂

20.11.2024 09:58 — 👍 3    🔁 0    💬 1    📌 0

@adeleforge is following 20 prominent accounts