Anna Schjøtt

The Politics of Machine Learning Evaluation: From Present to Future | médialab Sciences Po Le médialab reçoit Anna Schjøtt Hansen et Dieuwertje Luitse pour le prochain séminaire du 3 juin 2025. Elles feront une présentation d'ouverture sur les politiques d'évaluation de l'apprentissage auto...

Mardi 3 juin, découvrez comment l’évaluation des modèles IA évolue et soulève un enjeu politique majeur.

Une présentation d’ @annaschjoett.bsky.social et @dluitse.bsky.social suivie d’un échange sur le lancement de la collection « The Politics of ML Evaluation » dans Digital Society.

Plus d'info 🔽

Sage Journals: Discover world-class research Subscription and open access journals from Sage, the world's leading independent academic publisher.

The introduction to our SI on bridging the research-practice gap in journalism has now been published!

You can read here: journals.sagepub.com/doi/10.1177/...

It was a pleasure to co-edit this special issue with @annaschjoett.bsky.social, @nadjaschaetz.bsky.social, and @claudiamellado.bsky.social

Taming Affect: On the Construction of Objectivity in Data Annotation Practices - Digital Society Affective computing applications promise to decode human emotional expressions and provide objective insights into users’ affective experience, ranging from frustration and boredom to states of clinic...

✨ Very happy to share that my new paper on data annotation practices in affective computing is out ✨ link.springer.com/article/10.1...

🙏 thanks to the fantastic editors of this SI on the politics of machine learning evaluation @dluitse.bsky.social @annaschjoett.bsky.social & Tobias Blanke

An Accidental Benchmark: The History, Contingent Power, and Lasting Traces of the GTZAN Dataset - Digital Society In 2002, George Tzanetakis presented a paper on how researchers could automatically classify musical genre from audio signals. Claiming that his model worked as well as human classifiers, Tzanetakis m...

The second paper, 'An Accidental Benchmark: The History, Contingent Power, and Lasting Traces of the GTZAN Dataset' by Allison Jerzak traces the history of the GTZAN dataset, which remains the most widely used dataset for Music Genre Recognition. link.springer.com/article/10.1...

State-of-the-Art: The Temporal Order of Benchmarking Culture - Digital Society This commentary situates the epistemic values of machine learning’s culture of benchmarking and evaluation within larger temporal structures. Beyond questions of validity, whether model comparisons ar...

The first paper is a short reflection by @alexcampolo.bsky.social titled 'State-of-the-Art: The Temporal Order of Benchmarking Culture', which explores how benchmarks produce certain temporal values and expectations link.springer.com/article/10.1...

✨The first two papers in our Topical Collection on the 'Politics of Machine Learning Evaluation' are out in Digital Society!

The collection is edited together with @dluitse.bsky.social and Tobias Blanke, with the great support of Digital Society and Federica Russo.
link.springer.com/collections/...

State-of-the-Art: The Temporal Order of Benchmarking Culture - Digital Society This commentary situates the epistemic values of machine learning’s culture of benchmarking and evaluation within larger temporal structures. Beyond questions of validity, whether model comparisons ar...

I have a short reflection on benchmarking in machine learning, titled "State-of-the-Art." Beyond questions of construct validity and rankings, how do benchmarks and model evaluation produce orientations towards progress or the future? Open access: doi.org/10.1007/s442...

This came out of an excellent conference, organized by @dluitse.bsky.social and @annaschjoett.bsky.social of the University of Amsterdam titled - "The Politics of Machine Learning Evaluation." Look out for the other contributions to this forum, some of which are forthcoming. Super important topic.

The Critical AI Seminar Series returns Catherine Breslin / Better Images of AI / Silicon Closeup / CC-BY 4.0 The Critical AI Seminar series will continue in 2024 and 2025 with another five lectures that critically address Artificial Intell...

The seminar series is organised together with @dluitse.bsky.social and Tobias Blanke. More information can be found here: www.create.humanities.uva.nl/seminar-seri...

#5 Critical AI Seminar Series: AI and the (Re)Shaping of Intelligence Invited lecture by Wendy Chun & Matt Canute on 'AI and the (Re)Shaping of Intelligence' Wendy Hui Kyong Chun is Simon Fraser University’s Canada 150 Research Chair in New Media, Professor in the Schoo...

On May 14, we are delighted to host @whkchun.bsky.social and Matt Canute as the final speakers in our Critical AI Seminar Series.

The seminar is online and open to everyone. To receive the link, sign up via the link below.

🗓️ May 14, 5:30-7 PM (CEST). www.create.humanities.uva.nl/events/5-cri...

#4 Critical AI Seminar Series: Synthetic Vision/Algorithmic Violence Invited lecture by Rocco Bellanova & Francesco Ragazzi on 'Synthetic Vision/Algorithmic Violence' Rocco Bellanova is a Research Professor at the Vrije Universiteit Brussel (interdisciplinary research ...

✨Interested in questions of synthetic vision and algorithmic violence?

Then join the online #CriticalAI Seminar series next Wednesday (March 12) from 5:30-7PM with @ikkibop.bsky.social and Francesco Ragazzi.

Organised with @dluitse.bsky.social and Tobias Blanke. Open to everyone, sign up below: