The CALAMITA (Challenging the Abilities of LAnguage Models in ITAlian) paper is now available on arXiv:
arxiv.org/abs/2512.04759
We warmly thank all the individuals involved for their extraordinary work, dedication, and collaborative spirit that made this project possible!
09.12.2025 18:19 โ ๐ 3 ๐ 4 ๐ฌ 0 ๐ 0
Letโs present the tasks at #EVALITA2026!
Last but not least: FadeIT ๐๐ฌ
Can your system spot fallacies in social media posts?
FadeIT focuses on Italian texts about migration, climate change & public health.
Detect flawed reasoning โ where it spreads fastest.
#NLProc
24.10.2025 07:24 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
Letโs present the tasks at #EVALITA2026!
Tenth up: PFB โ Prometeia Financial Benchmark ๐ถ๐
Can LLMs handle finance?
PFB evaluates open & closed models on domain-specific MCQs, with a twist: each question has a complexity score.
2 tasks: Italian and Multilingual QA
From GPT to finance pro.
#NLProc
22.10.2025 08:38 โ ๐ 1 ๐ 0 ๐ฌ 0 ๐ 0
Letโs present the tasks at #EVALITA2026!
Ninth up: Cruciverb-IT ๐งฉ๐ฎ๐น
Ready to crack some Italian crosswords?
Cruciverb-IT offers a challenging playground for NLP systems:
1๏ธโฃ Answer clues from real crosswords
2๏ธโฃ Autonomously solve full crossword grids
Wordplay meets AI.
#NLProc
20.10.2025 08:38 โ ๐ 1 ๐ 0 ๐ฌ 0 ๐ 1
Letโs present the tasks at #EVALITA2026!
Eighth up: SVELA ๐ง ๐งฝ
Can LLMs forget on purpose?
SVELA tackles Machine Unlearning: design and evaluate metrics to verify if a model forgets specific knowledge while keeping the rest intact.
Selective forgetting, measurable impact.
#NLProc
17.10.2025 11:14 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
Letโs present the tasks at #EVALITA2026!
Seventh up: MultiPRIDE ๐ณ๏ธโ๐๐ง
Can a system tell when a slur is reclaimed?
๐ฌ In this multilingual task (IT/ES/EN), classify whether LGBTQ+ terms in context are used with reclamatory intent.
Itโs not just about words, itโs about meaning.
#NLProc
15.10.2025 15:53 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
Letโs present the tasks at #EVALITA2026!
Sixth up: DeSegMa-It ๐ค๐
Can you spot the line between human and machine?
DeSegMa-It challenges systems to:
1๏ธโฃ Detect machine-generated texts
2๏ธโฃ Segment where the human ends & the machine begins
Human or AI? Letโs find out.
#NLProc
13.10.2025 08:45 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
Letโs present the tasks at #EVALITA2026!
Fifth up: Enhanced-VWSD ๐ผ๏ธ๐
Can you pick the right image for a word in context?
Given a sentence and 10 images, choose the one that best captures the meaning of a target word.
A vision meets language challenge!
#NLProc
10.10.2025 13:07 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
Letโs present the tasks at #EVALITA2026!
Fourth up: IMPOLS ๐ณ๏ธ
Can systems detect whatโs not said in political speech?
๐ฌ IMPOLS targets implicit, questionable content that sounds true but isnโt explicit.
๐ Tasks:
1๏ธโฃ Detect implicit contents
2๏ธโฃ Classify them
3๏ธโฃ Classify implicatures
#NLProc
08.10.2025 14:01 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
Letโs present the tasks at #EVALITA2026!
Third up: ATE-IT ๐ท๏ธ
Time to extract key concepts automatically, with the first large-scale eval of Automatic Term Extraction for Italian on institutional texts.
Subtasks:
๐น Term Extraction
๐น Term Variants Clustering
Letโs make terminology smarter.
#NLProc
06.10.2025 08:18 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
Letโs present the tasks at #EVALITA2026!
Second up: GSI:detect
Can machines detect gender stereotypes in Italian texts?
๐ง Score sentences for stereotypical content
๐ท๏ธ Classify them into stereotype categories
From classification to social awareness.
#NLProc
30.09.2025 07:32 โ ๐ 3 ๐ 0 ๐ฌ 0 ๐ 0
Pictures of #clicit2025 social dinner!
26.09.2025 20:34 โ ๐ 3 ๐ 1 ๐ฌ 0 ๐ 0
Thanks to all the participants! #clicit2025
26.09.2025 17:28 โ ๐ 11 ๐ 5 ๐ฌ 0 ๐ 0
#clicit2025 awards winners!
26.09.2025 15:08 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
Last oral session at #clicit2025!
26.09.2025 14:49 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
Letโs present the tasks at #EVALITA2026!
First up: EXPLAINITA ๐
Can you explain what a latent neuron means?
๐ง Describe Sparse Autoencoder latents
๐ Decide if a text activates a latent based on its explanation
From prediction to interpretability ๐ฌ
#NLProc
26.09.2025 10:03 โ ๐ 3 ๐ 0 ๐ฌ 0 ๐ 0
Next year #clicit2026 will be inโฆโฆPalermo!
25.09.2025 16:54 โ ๐ 3 ๐ 2 ๐ฌ 0 ๐ 0
๐ Excited to present FAMA, the first large-scale #OpenScience #Speech foundation model for ๐ฎ๐น Italian & ๐ฌ๐ง English, at #clicit2025 (17:30โ18:45 oral session)!
๐ Models: hf.co/collections/...
๐ Data: hf.co/datasets/FBK...
๐ป Code: github.com/hlt-mt/FBK-f...
๐ Preprint: arxiv.org/pdf/2505.22759
24.09.2025 13:20 โ ๐ 7 ๐ 2 ๐ฌ 0 ๐ 0
Our very own @sarapapi.bsky.social presenting FAMA at #clicit2025:
๐Paper: clic2025.unica.it/wp-content/u...
๐ Models: hf.co/collections/...
๐ Data: hf.co/datasets/FBK...
๐ป Code: github.com/hlt-mt/FBK-f...
Joint work with @speechtekfbk.bsky.social
25.09.2025 14:49 โ ๐ 5 ๐ 2 ๐ฌ 0 ๐ 0
The second day of #clicit2025 has started with an oral session on Linked Data, relation extraction and legal information retrieval
25.09.2025 08:11 โ ๐ 2 ๐ 1 ๐ฌ 0 ๐ 0
Last oral session of the first #clicit2025 day! See you all at the welcome drink!
24.09.2025 16:41 โ ๐ 2 ๐ 1 ๐ฌ 0 ๐ 0
we invented the wearable poster - with @mrovera.bsky.social at CLIC-it @ailc-nlp.bsky.social
24.09.2025 15:24 โ ๐ 5 ๐ 3 ๐ฌ 0 ๐ 0
Interview with Paola Merlo: a lot of interesting questions from #NLProc students
24.09.2025 15:28 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
First poster session at #clicit2025
24.09.2025 15:01 โ ๐ 2 ๐ 2 ๐ฌ 0 ๐ 0
First #clicit2025 oral session on benchmarks and LLMs evaluation
24.09.2025 13:38 โ ๐ 2 ๐ 0 ๐ฌ 0 ๐ 0
Opening session of #clicit2025! Welcome to Cagliari!
24.09.2025 12:40 โ ๐ 2 ๐ 0 ๐ฌ 0 ๐ 0
In Cagliari for #clicit2025! Tomorrow I will presents two papers: 1) Ciallabacialla! Modeling and Linking a Regional Lexical Resource to Include Sicilian in the SemanticWeb; 2) Annotating Manzoni: Challenges in the Annotation of Lemmas, POS and Features in โI Promessi Sposiโ
@ailc-nlp.bsky.social
24.09.2025 09:12 โ ๐ 3 ๐ 1 ๐ฌ 0 ๐ 0
Researcher
Computational Linguistics/Natural Language Processing
University of Gothenburg
Posting about research fby and events and news relevant for the Amsterdam NLP community. Account maintained by @wzuidema@bsky.social
she/her ๐ | MSCA at Ghent University | co-founder of aequa-tech | #NLProc | #RAINBOW | #LGBTQIA+ | #NoHateSpeech
๐ฆ alessandrateresacignarella.github.io
๐ฉ๐ปโ๐ป a PhD computer engineer working in NLP @ #UniPa
Associate Professor University of Rome Tor Vergata, working on #MachineLearning for #NLProc and #PrecisionMedicine. Passionated for #AIEthics.
Opinions are my own.
Associate Professor at the Department of Linguistics and Communication, University of Birmingham, as well as a Visiting Scientist at the Center for Advanced Intelligence Project, RIKEN.
Website: http://www.akira-murakami.com/
Twitter (X): @mrkm_a
Coordinator DH Network @ University of Potsdam // Computational Literary Studies + Cultural Analytics // More info: https://lucagiovannini7.github.io
Bizarre digital classicist. Tenure track in Latin & DH at Kore University, Enna, Italy. Curious guy. Formerly: UCLA lecturer; Lincei Acad. post-doc; UniPA [โฆ]
๐ bridged from https://scholar.social/@paolomonella on the fediverse by https://fed.brid.gy/
Studio il web e le digital humanities.
Lavoro con i social media.
Racconto, spesso in aula, le cose che vedo e le esperienze che faccio.
Digital Humanist & PhD Student at University of Bologna
Web Application | NLP | Ontology Design | Semantic Web | Classical Literature
Professor of DH and Computational Literary Studies @ Tor Vergata University of Roma.
Associazione per lโInformatica Umanistica e la Cultura Digitale
Italian Association of Digital Humanities
www.aiucd.it
Topics: #multilingualism, #terminology, #translation, #NLProc, #LLMs, #corpuslinguistics, #digitalhumanities, #citizenscience
The Language Technology Group (LTG) at the University of Oslo, Norway do research on a range of topics in Natural Language Processing (NLP), including language modeling for Norwegian and other languages.
๐ Full-time Researcher (RTD) at ItaliaNLP Lab, Institute for Computational Linguistics "A. Zampolli" (CNR-ILC) #NLProc
https://alemiaschi.github.io/
Computational Linguistics MS @ UW | Staff Data Scientist (NLP) @ Cision
ibrahimsharaf.github.io
Senior Research Scientist @fbk-mt.bsky.social - he/him
๐ Associate @LaStatale | Political institutions, causation -- and the science fiction of daily life