Ondrej Dusek

Picture of the One Pillar Pagoda in Hanoi, a pagoda raised up over a green pond surrounded by greenery

The registration page for #INLG2025 is now live! Join us in Vietnam at the Oct 29 - Nov 2 for the best conference on #NaturalLanguageGeneration

2025.inlgmeeting.org/registration...

Curious to see what will be presented? Check out this list of accepted papers! 2025.inlgmeeting.org/accepted-pap...

SCAI 2025 Online Event on Search-Oriented Conversational AI.

Check out the slides from our SCAI'2025 #convsearch workshop collocated with @ijcai.org #IJCAI2025 on LLMs, retrieval & QA, recommendations, negotiations, evaluation and transparency

scai.info/scai-2025

@patuchen.bsky.social @maik-froebe.bsky.social @tuetschek.bsky.social @mila-quebec.bsky.social

Our paper "OpeNLGauge: An Explainable Metric for NLG Evaluation with Open-Weights LLMs" has been accepted to #INLG2025 conference!

You can read the preprint here: arxiv.org/abs/2503.11858

It's fine by me if they generate it, as long as it works and they know how... but I've been getting loads of roughly plausible but non-functional code, with hallucinated API calls etc. 😒. Not that many emojis though (in docs only).

FreshTab: Sourcing Fresh Resources for Table-to-Text Generation Evaluation
by @navitas.bsky.social, ‪@oplatek.bsky.social‬, ‪@zdenekkasner.bsky.social‬, @tuetschek.bsky.social .bsky.social‬

ReproHum #0669-08: Reproducing Sentiment Transfer Evaluation
by @navitas.bsky.social, M. Lango, @patuchen.bsky.social, @tuetschek.bsky.social
Challenge to reproduce human evaluations from NLP papers, testing the reproducibility of evaluation studies

OpeNLGauge: An Explainable Metric for NLG Evaluation with Open-Weights LLMs
by @ivankartac.bsky.social, M. Lango, @tuetschek.bsky.social
arxiv.org/abs/2503.11858
Open-source NLG evaluation metric that explains errors and matches human judgments without proprietary models

#ACL2025NLP in Vienna 🇦🇹 starts today with 23 🤯 @ufal-cuni.bsky.social folks presenting their work both at the main conference and workshops. Check out our main conference papers today and on Wednesday 👇

ICML found hidden prompts in accepted papers. They have released a statement icml.cc/Conferences/...

Yes, it’s unacceptable. So is using an LLM to review a paper. Peer review is so broken.

#Eurovision is tonight, and here's a hilarious fun fact about it: Israel has started a massive offensive against civilian populations in Gaza with the explicit aim of conquering the entire territory and ethnically cleansing its population, and Eurovision has aggressively refused to give a shit.

It is a little weird to me countries aren’t more aggressively, formally trying to take advantage of the U.S. science brain drain. Once in a lifetime opportunity to buy low on Non-Dumbass Americans with PhDs who just wanna look into microscopes and quietly cure ass cancer as our country eats shit.

Ondrej Dusek MLPrague 2025 Evaluating LLM outputs with humans and LLMs Ondřej Dušek MLPrague 30 April 2025 These slides: https://bit.ly/mlprague25-od

Slides and links to papers at bit.ly/mlprague25-od 🤓

The 👉Machine Learning Prague 2025👈 is happening right now! Today, @patuchen.bsky.social and @navitas.bsky.social presented their posters on text generation with LLMs. Also, don't miss @tuetschek.bsky.social's invited talk tomorrow at 11 a.m.

🚨 NEW WORKSHOP ALERT 🚨

We're thrilled to announce the first-ever Tokenization Workshop (TokShop) at #ICML2025 @icmlconf.bsky.social! 🎉

Submissions are open for work on tokenization across all areas of machine learning.

📅 Submission deadline: May 30, 2025
🔗 tokenization-workshop.github.io

“is my calculator horny?“ our tech columnist asks. “i entered 5318008 into it and turned it upside down. what i saw surprised me”

Large Language Models as Span Annotators Website for the paper Large Language Models as Span Annotators

How do LLMs compare to human crowdworkers in annotating text spans? 🧑🤖

And how can span annotation help us with evaluating texts?

Find out in our new paper: llm-span-annotators.github.io

Arxiv: arxiv.org/abs/2504.08697

Participate in the 👉 CRAC 2025 Shared Task on Multilingual Coreference Resolution❗ ufal.mff.cuni.cz/corefud/crac25
If you have not already done so, register first. 👆 Then start discovering how words refer to each other in 1️⃣7️⃣ languages. This year includes a new ✨LLM✨ track 😮.

LINGUIST List 36.1018 Jobs: Morphology, Pragmatics, Semantics, Syntax: Post-Doc in Empirical and Theoretical Linguistics, Faculty of Arts, Charles University The LINGUIST List, International Linguistics Community Online.

A 3-year full-time post-doc position in Prague! I'll be grateful for reposts. Feel free to get in touch if you have questions. linguistlist.org/issues/36/10...

It’s kind of quaint to think the big worry a few years ago was that AI chatbots would destroy humanity. We’re quite capable of doing that without their help.

Univerzita Karlova v čele evropského výzkumu AI „Naším hlavním cílem je vyrobit jazykový model, který bude konkurencí stávajícím modelům, a navíc bude fungovat velmi dobře pro všechny evropské jazyky,“ uvedl profesor Jan Hajič z ÚFAL MFF UK, který ...

👨‍💻👩‍💻 Pod vedením @ufal-cuni.bsky.social #MFFUK @unikarlova.cuni.cz se začíná budovat rodina velkých jazykových modelů pro všechny evropské jazyky. V Karolinu dnes odstartoval mezinárodní projekt @openeurollm.bsky.social. 👏
www.ukforum.cz/rubriky/aktu...

Sadly they're not "exposed" to the millions of people who don't follow politics and consume shitty media 😕

The CVPR program chairs acted on the reviewing crisis in ML/CV conferences. This is a first!

Papers of authors who acted as irresponsable reviewers have been desk rejected. 19 papers are affected in 2025.

This has also been announced for ICCV 2025.

The 6th International Workshop on Designing Meaning Representation (#DMR2025) will be in Prague, Aug 4-5, right after #ACL2025 in Vienna!

Submit your work on meaning representations: annotation, parsing, multilinguality, neuro-symbolic methods & more. Details: dmr2025.github.io/index

Ok here's the theory so far for how the LLM-generated ARR submission experiment went down. Researchers generated papers, then created fake reviewer profiles by identifying existing papers from a real author st the set of papers would maximize expertise affinity score wrt the LLM-generated paper.

Homepage | European Alternatives We help you find European alternatives for digital service and products, like cloud services and SaaS products.

I’m doing the same. It’s important to do what we can. I’ve changed to Signal where possible, Proton mail, Startpage browser/search or , Qwant search on Firefox. This is a good site for European alternatives: european-alternatives.eu

The image shows a ChatGPT conversation where someone requested a recipe for pancakes using whole rolled oats without a blender, with measurements in grams. The recipe ingredients are listed as: - 150g whole rolled oats - 250ml milk (dairy or plant-based) - 2 large eggs (approximately 100g) - 30g melted butter (or neutral oil) + extra for cooking - 20g sugar (optional, adjust to taste) - 8g baking powder (about 2 tsp) - 2g salt (about 1/2 tsp) - 5ml vanilla extract (optional)

This image shows a webpage from "the kitchn" website featuring a recipe for "Easy Oatmeal Pancakes." The recipe appears to be highly rated with 5 stars from 64 reviews. The page shows a navigation path of RECIPES > BREAKFAST > PANCAKES, and there's a banner at the top advertising "Our Laziest, Most Delicious Dinners Ever (Ready in 30 Minutes or Less)." The image also shows part of a photo featuring what appears to be melted butter being whisked into a mixture. There's a Google sign-in prompt overlaying part of the page.

The rise of ChatGPT isn't just about AI—it's about how cluttered the web has become. Compare these recipes: ChatGPT gives me ingredients instantly, while a cooking website shows me an auto-playing video and a prompt to log into Google so I can see an ad

Čech povede evropský výzkum AI - 3. února 05:59 - Studio 6 | Česká televize Jan Hajič

We've been making the media rounds!
👉📺 @hajicjan.bsky.social talked about the new OpenEuroLLM project on Czech TV's Studio 6 www.ceskatelevize.cz/porady/10969...
👉📻 @tuetschek.bsky.social discussed #LLMs on Czech Radio radiozurnal.rozhlas.cz/proc-umela-i...).

Good that they see Trump for what he is, but it's ridiculous they rank Putin so low 🙄