Beatrix M. G. Nielsen's Avatar

Beatrix M. G. Nielsen

@beatrixmgn.bsky.social

PhD student in machine learning at DTU, Copenhagen. Especially interested in model representations.

75 Followers  |  102 Following  |  15 Posts  |  Joined: 20.11.2024  |  1.6519

Latest posts by beatrixmgn.bsky.social on Bluesky

The promise of AI chat assistants: they solve 90% of the problems users have (by looking up the docs and telling them)

My reality: need to spend 10 minutes trying to get to a human, to solve an issue I need customer support to look into

Around minute 8 I sign up to a competitor

04.11.2025 16:14 β€” πŸ‘ 117    πŸ” 17    πŸ’¬ 8    πŸ“Œ 4
EurIPS Copenhagen 2025 - A NeurIPS-endorsed conference in Europe A NeurIPS-endorsed conference in Europe held in Copenhagen, Denmark

5/5
@ema-ridopoco.bsky.social and @andreadittadi.bsky.social will be presenting a poster in San Diego and Luigi and I will be presenting at Eurips (eurips.cc) in Copenhagen so come on by! πŸ˜„

21.10.2025 05:49 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

4/5
We also show that it is possible to define a metric between probability distributions and a measure of representational dissimilarity such that when distributions are close in this sense, we get similar representations.

21.10.2025 05:48 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

3/5
The two models agree on their prediction for the highest likelihood label. They also disagree on the ranking by likelihood of the remaining labels, and while this has a negligible effect on the KL divergence, it means the relation between their representations is non-linear.

21.10.2025 05:48 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

2/5
We prove that a small KL divergence between models is not enough to guarantee similar representations. Here is an example of how to construct two models with small KL divergence, but representations which are far from being linear transformations of each other.

21.10.2025 05:47 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

1/5
We study when and why representations learned by different neural networks are similar from the perspective of identifiability theory, which suggests that a measure of representational similarity should be invariant to transformations that leave the model distribution unchanged.

21.10.2025 05:47 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Preview
When Does Closeness in Distribution Imply Representational Similarity? An Identifiability Perspective When and why representations learned by different deep neural networks are similar is an active research topic. We choose to address these questions from the perspective of identifiability theory, whi...

I am happy to announce that our article "When Does Closeness in Distribution Imply Representational Similarity? An Identifiability Perspective" has been accepted at NeurIPS 2025! πŸŽ‰ arxiv.org/abs/2506.037...

Details below πŸ‘‡

21.10.2025 05:45 β€” πŸ‘ 7    πŸ” 1    πŸ’¬ 1    πŸ“Œ 1
Post image

Andrej Karpathy’s take on AI coding agents feels grounded. The industry’s chasing full autonomy when models still hallucinate too much.

Agents that churn out a thousand lines of code leave you either blindly trusting them or slogging through reviews. These tools should embrace their fallibility.

19.10.2025 16:33 β€” πŸ‘ 160    πŸ” 25    πŸ’¬ 12    πŸ“Œ 8
ELLIS UnConference - A NeurIPS-endorsed conference in Europe A NeurIPS-endorsed conference in Europe held in Copenhagen, Denmark

So if you did not have the opportunity to come by at ACL in Vienna then here is your second chance! :D
Hope to see you there! eurips.cc/ellis.

15.10.2025 06:40 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Preview
Prediction hubs are context-informed frequent tokens in LLMs Hubness, the tendency for a few points to be among the nearest neighbours of a disproportionate number of other points, commonly arises when applying standard distance measures to high-dimensional dat...

Good news everyone!
I’ll be presenting the paper I did with Marco and Iuri "Prediction Hubs are Context-Informed Frequent tokens in LLMs" at the ELLIS UnConference on December 2nd in Copenhagen. arxiv.org/abs/2502.10201

15.10.2025 06:40 β€” πŸ‘ 3    πŸ” 2    πŸ’¬ 1    πŸ“Œ 0
Post image

How can we make AI explanations provably correct β€” not just convincing? πŸ€”

Join us for the Theory of Explainable Machine Learning Workshop, part of the ELLIS UnConference Copenhagen πŸ‡©πŸ‡° on Dec 2, co-located with #EurIPS.

πŸ•’ Call for contributions open until Oct 15 (AoE)
πŸ”— eurips.cc/ellis

13.10.2025 09:10 β€” πŸ‘ 13    πŸ” 4    πŸ’¬ 1    πŸ“Œ 0
Post image

πŸš€ Applications for the @ellis.eu PhD Program 2025 are now open!
Join Europe’s leading network in AI & Machine Learning research,🌍
πŸ“š Choose among three collaboration pathways: Academic, Industry, or Interdisciplinary.β€¨πŸ—“οΈ Apply by Oct 31, 2025β€¨πŸ”— ellis.eu/phd-program

07.10.2025 11:19 β€” πŸ‘ 3    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0
Post image

✨ EurIPS registration is now open! Get one of the 1,500 tickets available. 500 tickets are discounted for students πŸŽ“.

In Copenhagen πŸ‡©πŸ‡° on Dec 2-7, 2025.

❗ Entrance to the ELLIS UnConference is free with a #EurIPS ticket.

Get your ticket now: https://eurips.cc/

@euripsconf.bsky.social

02.10.2025 09:23 β€” πŸ‘ 14    πŸ” 3    πŸ’¬ 0    πŸ“Œ 0
Preview
AI for Scientific Discovery in Physics The ELLIS mission is to create a diverse European network that promotes research excellence and advances breakthroughs in AI, as well as a pan-European PhD program to educate the next generation of AI...

🏹 Job alert: Several fully-funded open Post-Doc positions for 'AI for Scientific Discovery in Physics' at @unituebingen.bsky.social

πŸ“ TΓΌbingen πŸ‡©πŸ‡ͺ
πŸ“… Apply by Oct 28th (unless filled before)
πŸ”— ellis.eu/jobs/ai-for-...

30.09.2025 14:42 β€” πŸ‘ 2    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0
Preview
Boxes of numbers Machine learning's universal theory of data representation

Without any theory, machine learning has evolved a universal theory of data representation. Can we post-hoc rationalize it with math?

25.09.2025 14:31 β€” πŸ‘ 14    πŸ” 2    πŸ’¬ 2    πŸ“Œ 0
Post image

Congratulations to everyone who got their @neuripsconf.bsky.social papers accepted πŸŽ‰πŸŽ‰πŸŽ‰

At #EurIPS we are looking forward to welcoming presentations of all accepted NeurIPS papers, including a new β€œSalon des RefusΓ©s” track for papers which were rejected due to space constraints!

19.09.2025 09:13 β€” πŸ‘ 50    πŸ” 16    πŸ’¬ 1    πŸ“Œ 5
Preview
PhD fellowship in Explainable Natural Language Understanding Department of Computer Science Faculty of SCIENCE University of Copenhagen The Natural Language Processing Section at the Department of Computer Science, Faculty of Science at the University of Copenhagen invites applicants for a PhD f

- Fully funded PhD fellowship on Explainable NLU: apply by 31 October 2025, start in Spring 2026: candidate.hr-manager.net/ApplicationI...

- Open-topic PhD positions: express your interest through ELLIS by 31 October 2025, start in Autumn 2026: ellis.eu/news/ellis-p...

#NLProc #XAI

01.09.2025 14:20 β€” πŸ‘ 8    πŸ” 7    πŸ’¬ 1    πŸ“Œ 0
Preview
The Banal Evil of AI Safety Chatbot companies are harmful and dishonest. How can we hold them accountable?

I wrote about the tragic death of Adam Raine and the venal negligence of "AI Safety." www.argmin.net/p/the-banal-...

28.08.2025 14:30 β€” πŸ‘ 77    πŸ” 39    πŸ’¬ 1    πŸ“Œ 10
Preview
ELLIS PhD Program: Call for Applications 2025 The ELLIS mission is to create a diverse European network that promotes research excellence and advances breakthroughs in AI, as well as a pan-European PhD program to educate the next generation of AI researchers. ELLIS also aims to boost economic growt...

πŸŽ“ Interested in a #PhD in machine learning or #AI? The ELLIS PhD Program connects top students with leading researchers across Europe. The application portal opens on Oct 1st. Curious? Join our info session on the same day. Get all the info πŸ‘‰

29.08.2025 07:14 β€” πŸ‘ 16    πŸ” 13    πŸ’¬ 0    πŸ“Œ 2

I've been using Kagi for over a year as my default search engine. It's excellent.

22.08.2025 20:03 β€” πŸ‘ 41    πŸ” 7    πŸ’¬ 0    πŸ“Œ 1
Post image

Direct your research. Forge lifelong connections. Apply for the 2026 Complexity Postdoctoral Fellowships. SFI is looking for recent PhD graduates with quantitative and computational skills interested in theoretical collaborative research.

Deadline: Oct 1, 2025
Apply: santafe.edu/sfifellowship

05.08.2025 17:24 β€” πŸ‘ 23    πŸ” 13    πŸ’¬ 0    πŸ“Œ 0
Preview
EPFL NLP Postdoctoral Scholar Posting - Swiss AI LLMs The EPFL Natural Language Processing (NLP) lab is looking to hire a postdoctoral researcher candidate in the area of multilingual LLM design, training, and evaluation. This postdoctoral position is as...

The EPFL NLP lab is looking to hire a postdoctoral researcher on the topic of designing, training, and evaluating multilingual LLMs:

docs.google.com/document/d/1...

Come join our dynamic group in beautiful Lausanne!

04.08.2025 15:54 β€” πŸ‘ 21    πŸ” 12    πŸ’¬ 0    πŸ“Œ 1
Post image

Thank you to everyone who came to talk to us at ACL!

Very happy that so many people are interested in our work :D

If you didn’t manage to have a look yet: This work is relevant if you want to compare representations in language models, and it can be read here: arxiv.org/abs/2502.10201

01.08.2025 20:02 β€” πŸ‘ 4    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Machine Learning and Computer Vision Group -- Christoph Lampert -- ISTA Computer Vision and Machine Learning, ISTA: open postdoc positions, Machine Learning, curiosity-driven, fully-funded

🏹 Job alert: Postdoc in Machine Learning (basic research) at @istaresearch.bsky.social in the group of Christoph Lampert (@mlcv-at-ista.bsky.social)

πŸ“Klosterneuburg πŸ‡¦πŸ‡Ή
πŸ“… Apply asap
πŸ”— More info: cvml.ista.ac.at/Postdoc-ML.h...

23.07.2025 13:57 β€” πŸ‘ 9    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0
Dara

Open PhD positions in Denmark! daracademy.dk/fellowship/f...

If you want to apply to work with me and Johannes Bjerva at @aau.dk Copenhagen, I'll be at @ic2s2.bsky.social this week and @aclmeeting.bsky.social next week! DM me if you'd like to meet :)

21.07.2025 13:26 β€” πŸ‘ 10    πŸ” 5    πŸ’¬ 0    πŸ“Œ 0
Post image

EurIPS is coming! πŸ“£ Mark your calendar for Dec. 2-7, 2025 in Copenhagen πŸ“…

EurIPS is a community-organized conference where you can present accepted NeurIPS 2025 papers, endorsed by @neuripsconf.bsky.social and @nordicair.bsky.social and is co-developed by @ellis.eu

eurips.cc

16.07.2025 22:00 β€” πŸ‘ 140    πŸ” 70    πŸ’¬ 2    πŸ“Œ 19

1/
🚨 New paper at #ICML2025!
Identifying Latent Metric Structures in Deep Latent Variable Models πŸŽ‰
We solve part of the identifiability puzzle in generative models β€” using geometry. 🧡

14.07.2025 05:45 β€” πŸ‘ 6    πŸ” 2    πŸ’¬ 1    πŸ“Œ 0

We will present the poster on Wednesday 30th of July between 11.00 and 12.30.

If you are in Vienna, let's have a chat about representations in language models and how and when it makes sense to compare them :)

07.07.2025 10:48 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

Our paper "Prediction Hubs are Context-Informed Frequent Tokens in LLMs" has been accepted at ACL 2025!

Main points:
1. Hubness is not a problem when language models do next-token prediction.
2. Nuisance hubness can appear when other comparisons are made.

07.07.2025 10:48 β€” πŸ‘ 8    πŸ” 1    πŸ’¬ 1    πŸ“Œ 2

@beatrixmgn is following 20 prominent accounts