Stephane Deny

Joint rotational invariance and adversarial training of a dual-stream Transformer yields state of the art Brain-Score for Area V4 Modern high-scoring models of vision in the brain score competition do not stem from Vision Transformers. However, in this paper, we provide evidence against the unexpected trend of Vision Transformer...

Arturo Deza had this work (arxiv.org/abs/2203.06649), but if I understand well is the kind of model you are not looking for. But Arturo may have good answers to your question.

Guardian article screenshot Heading: Microsoft blocks Israel’s use of its technology in mass surveillance of Palestinians Subheading: Exclusive: Tech firm ends military unit’s access to AI and data services after Guardian reveals secret spy project Body text: Microsoft has terminated the Israeli military’s access to technology it used to operate a powerful surveillance system that collected millions of Palestinian civilian phone calls made each day in Gaza and the West Bank, the Guardian can reveal.

Palestinians have for years pointed out how Microsoft, HPE, AWS — virtually the entire tech industry — has enthusiastically assisted occupation and genocide of Palestinians. Only now, because the tide is turning, can a story like this get mainstream attention. Zionism is in trouble.

(1/6) Thrilled to share our triple-N dataset (Non-human Primate Neural Responses to Natural Scenes)! It captures thousands of high-level visual neuron responses in macaques to natural scenes using #Neuropixels.

Training Large Neural Networks With Low-Dimensional Error Feedback Training deep neural networks typically relies on backpropagating high dimensional error signals a computationally intensive process with little evidence supporting its implementation in the brain. Ho...

(1/6) Excited to share a new preprint from our lab! Can large, deep nonlinear neural networks trained with indirect, low-dimensional error signals compete with full-fledged backpropagation? Tl;dr: Yes! arxiv.org/abs/2502.20580.

This is great stuff!

A comparison between humans and AI at recognizing objects in unusual poses

Netta Ollikka, Amro Kamal Mohamed Abbas, Andrea Perin, Markku Kilpeläinen, Stephane Deny

Action editor: Andrew Lampinen

https://openreview.net/forum?id=yzbAFf8vd5

#poses #recognition #recognizing

this would be a more apt analogy if the pilots (politicians) were piloting the planes remotely from land (politicians can be corrupt and rarely bare the consequences of their policies) and if common sense was of no relevance in politics (it is).

hmm, thanks gpt, that's very clear now what a MRAC is

new edito by N Arthaud, new banger: x.com/n_arthaud/st...

Le discours de gauche existe toujours, mais ce n'est chez les democrates americains / macronistes qu'on le trouve, et étonamment cette gauche la n'a pas quitté twitter, peut-etre justement car les classes populaires y sont mieux representee? x.com/n_arthaud/st...

My work routine summarized in two words: "2fac authentication". Thanks Microsoft 💀

New Preprint: "On the Ability of Deep Networks to Learn Symmetries from Data: A Neural Kernel Theory" by Andrea Perin and myself. Retweets of this post or the thread below are highly appreciated! Follow @zazzarazzaz.bsky.social for future updates on this line of work.

😆

I agree with all said. I think the degree of control a mentor will want to exert on mentee also depends on the pressures the mentor receive to deliver (eg CV for grants / deadline for graduations / required number of publications). There is so much leeway one can have.

which journal? noteworthy information

Interesting work on symmetries and learning!

Geometry and dynamics of representations in a precisely balanced memory network related to olfactory cortex Computational modeling revealed that balanced assemblies of excitatory and inhibitory neurons shape representational manifolds in olfactory cortex-like recurrent networks, resulting in joint maps of s...

Now published in @elife.bsky.social doi.org/10.7554/eLif... a fun collaboration with
@clairemb90.bsky.social and Rainer Friedrich

I did my PhD with Ed Deci, who usually says very few words. In our meetings, it was his reserved nature that gradually allowed me to come out of my shell, be my own person. That experience teaches me one valuable lesson now that I mentor others: know when to shut up.

interesting! do you think there is a balance to find, for instance if the student seems to be taking too much risk in a project

Thanks Kameron, means a lot coming from you! Hope you enjoy the work which is certainly a product of slow science : )

New Preprint: "On the Ability of Deep Networks to Learn Symmetries from Data: A Neural Kernel Theory" by Andrea Perin and myself. Retweets of this post or the thread below are highly appreciated! Follow @zazzarazzaz.bsky.social for future updates on this line of work.

I would like to be added is possible. Many thanks!

On the Ability of Deep Networks to Learn Symmetries from Data: A Neural Kernel Theory Symmetries (transformations by group actions) are present in many datasets, and leveraging them holds significant promise for improving predictions in machine learning. In this work, we aim to underst...

Little is known about how deep networks interact with structure in data. An important aspect of this structure is symmetry (e.g., pose transformations). Here, we (w/ @stphtphsn.bsky.social) study the generalization ability of deep networks on symmetric datasets: arxiv.org/abs/2412.11521 (1/n)

Pre-print 🧠🧪
Is mechanism modeling dead in the AI era?

ML models trained to predict neural activity fail to generalize to unseen opto perturbations. But mechanism modeling can solve that.

We say "perturbation testing" is the right way to evaluate mechanisms in data-constrained models

1/8

Should text be also readable without looking at the figures? the back and forth is sometimes annoying I feel.

2024: A Review of the Year in Neuroscience Feeling a bit wired

Cutting it a bit fine, but here’s my review of the year in neuroscience for 2024

The eighth of these, would you believe? We’ve got dark neurons, tiny monkeys, the most complete brain wiring diagram ever constructed, and much more…
Published on The Spike

Enjoy!

medium.com/the-spike/20...

count me in plz. I was in paris, a long time ago 🙏

why?

thinking of calling this "The Illusion Illusion"

(more examples below)

The Center for Neural Science at NYU is aiming to add another computational neuroscientist to our community: apply.interfolio.com/157767
Come join us!
Deadline 31 Dec 2024