Come join our group! Still one day left for applying. 😊
3) Aligning LLMs on political opinions with English data transfers to all other Western languages we've evaluated on: FR, IT, GE, ES.
Congrats team for the acceptance and for the great work! @franziweeber.bsky.social will be presenting it in person at EACL between March 24–29. 😊
Models do become more right-leaning on close-ended questions, but they only become a little less left-leaning on open-ended evaluations such as writing opinionated paragraphs on certain political issues.
2) Aligning LLMs with DPO on right-leaning opinions does have an impact on the stance of the models. However, this comes with a caveat.
Some findings that I find particularly impactful for the area of political biases in LLMs:
1) Aligning LLMs with DPO on left-leaning opinions does not have a significant impact on the stance of the models given that vanilla LLMs already reflect a more left-leaning alignment.
🚀 We’re opening 2 fully funded postdoc positions in #NLP!
Join the MilaNLP team and contribute to our upcoming research projects.
🔗 More details: milanlproc.github.io/open_positio...
⏰ Deadline: Jan 31, 2026
I will be @euripsconf.bsky.social this week to present our paper as non-archival at the PAIG workshop (Beyong Regulation:
Private Governance & Oversight Mechanisms for AI). Very much looking forward to the discussions!
If you are at #EurIPS and want to chat about LLM's training data. Reach out!
We could fool ourselves saying that it's because there's no panettone in other periods of the year :P
We go out of the routine every now and then at the lab. :)
In this paper, we investigate how well media frames generalize across different media landscapes. The 15 MFC frames remain broadly applicable, but requires revisions of the guidelines to adapt to the local context.
More on aclanthology.org/2025.starsem...
@agnesedaff.bsky.social presented our work on "Generalizability of Media Frames: Corpus creation and analysis across countries" at *SEM co-located with EMNLP 2025 in China.
@mmitchell.bsky.social
Does anyone know any good resource that systematically documents information about the training data of different LLMs (e.g. name of datasets, language proportion, etc whenever available)?
Proud to present our #EMNLP2025 papers!
Catch our team across Main, Findings, Workshops & Demos 👇
Great, thanks a lot!
As I wasn't at the conference, I'd love to be able to watch the recording. Is it available online anywhere? :)
Great collaboration with Dmitry Nikolaev, @dominsta.bsky.social and @deboranozza.bsky.social ☺️
- Finally, and for me, most interestingly, our analysis suggests that political biases are already encoded during the pre-training stage.
Taken these evidences together, we highlight important implications these results play on data processing in the development of fairer LLMs.
- There's a strong correlation (Pearson r=0.90) between the predominant stances in the training data and the models’ behavior when probed for political bias on eight policy issues (e.g., environmental protection, migration, etc).
- Source domains of pre-training documents differ significantly, with right-leaning content containing twice as many blog posts and left-leaning content 3 times as many news outlets.
- The framing of political topics varies considerably: right-leaning labeled documents prioritize stability, sovereignty, and cautious reform via technology or deregulation, while left-leaning documents emphasize urgent, science-led mobilization for systemic transformation and equity.
- left-leaning documents consistently outnumber right-leaning ones by a factor of 3 to 12 across training datasets.
- pre-training corpora contains about 4 times more politically engaged content than post-training data.
We have the answers of these questions here : arxiv.org/pdf/2509.22367
We analyze the political content of the training data from OLMO2, the largest fully open-source model.
🕵️♀️ We run an analysis in all the datasets (2 pre- and 2 post-training) used to train the models. Here are our findings:
📣 New Preprint!
Have you ever wondered what the political content in LLM's training data is? What are the political opinions expressed? What is the proportion of left- vs right-leaning documents in the pre- and post-training data? Do they correlate with the political biases reflected in models?
Tanise Ceron, Dmitry Nikolaev, Dominik Stammbach, Debora Nozza: What Is The Political Content in LLMs' Pre- and Post-Training Data? https://arxiv.org/abs/2509.22367 https://arxiv.org/pdf/2509.22367 https://arxiv.org/html/2509.22367
Thanks SoftwareCampus for supporting Multiview, the organizers of INRA, and Sourabh Dattawad and @agnesedaff.bsky.social for the great collaboration!
Our evaluation with normative metrics shows that this approach does not diversify only frames in user's history, but also sentiment and news categories. These findings demonstrate that framing acts as a control lever for enhancing normative diversity.
In this paper, we propose introduce media frames as a device for diversifying perspectives in news recommenders. Our results show an improvement in exposure to previously unclicked frames up to 50%.
Today Sourabh Dattawad presented our work "Leveraging Media Frames to Improve Normative Diversity in News Recommendations" at INRA (International Workshop on News Recommendation and Analytics) co-located with RecSys 2025 in Prague.
arxiv.org/pdf/2509.02266
