Gabriele Pergola

🚨 Paper submission deadline extended! 🚨

🌟 You now have until Friday, Dec 6th to submit your work to the AI4MFDD 2025 Workshop on AI for Multimedia Forensics & Disinformation Detection.

📅 WACV 2025, Feb 28–Mar 4, Tucson, AZ.
🔗 : shorturl.at/HHB3N

#AI #Forensics #DisinformationDetection

SciGisPy: a Novel Metric for Biomedical Text Simplification via Gist Inference Score Biomedical literature is often written in highly specialized language, posing significant comprehension challenges for non-experts. Automatic text simplification (ATS) offers a solution by making such...

🚀 Takeaway: SciGisPy is a novel library for domain-specific text evaluation, enabling automatic simplification (#ATS) for technical fields. Dive into the full details here: arxiv.org/abs/2410.09632. 🙌
#EMNLP #ACL #NLP #TextSimplification

📊 Impactful Results:

- On the Cochrane biomedical dataset, SciGisPy correctly identifies simplified texts in 84% of cases, compared to 44.8% for SARI.
- Ablation studies confirm the contributions of semantic chunking, cohesion, and sentence-level measures.

⚙️ Refined Metric Design: SciGisPy improves on GIS (Gist Inference Score) by:

- Removing indices unsuitable for biomedical contexts (e.g., word imageability).
- Adding metrics for sentence length & cohesion.
- Revising WordNet-based hypernym paths with domain-specific IC measures.

🌟 What's new:
- Introduces semantic chunking to measure text coherence.
- Incorporates information content theory for better word specificity.
- Uses #biomedical embeddings (e.g., #BioWordVec, #BioSimCSE) to capture complex concepts.

🔍 What’s SciGisPy?: SciGisPy evaluates #gist inference - how well #simplified texts convey their essential meaning or core ideas.

Inspired by #Fuzzy-Trace Theory, it bridges linguistic simplicity with comprehension of critical content, especially for domain-specific texts.

⚕️What if evaluation #metrics for text simplification focused on understanding the gist of biomedical texts?

We present “SciGisPy,” a gist-based metric for biomedical text evaluation.

📄: shorturl.at/dss4Z

#EMNLP2024 #nlp #nlpproc #biomedical #clinical #textsimplification #gist #metric #evaluation

📝 Challenges & Solutions:

1️⃣ Balancing Accuracy & Simplicity: Agents are tuned to avoid oversimplification that loses key medical details

2️⃣ Time Complexity: Parallel processing and efficient feedback mechanisms minimize delays.

🔄 Interaction Loop:

The agents collaborate through an iterative refinement loop:
1️⃣ Propose: Agents generate initial simplifications independently.
2️⃣ Evaluate: Feedback is collected via scoring mechanisms.
3️⃣ Refine: Agents adjust simplifications based on collective input.

🤖 Agent Roles in our framework:

1️⃣ Medical Terminology Simplifier: Simplifies technical jargon while preserving meaning.

2️⃣ Sentence Rewriter: Breaks down complex sentence structures.

3️⃣ Coherence Validator: Ensures text flow remains logical post-simplification.

🔬 The “Society of Medical Simplifiers” builds on the idea that multiple specialized agents can collaborate to simplify medical texts. Each agent has a unique role, ensuring a balance between clarity and technical accuracy.
Here’s how it works: 👇

Society of Medical Simplifiers Chen Lyu, Gabriele Pergola. Proceedings of the Third Workshop on Text Simplification, Accessibility and Readability (TSAR 2024). 2024.

🩺 What if #simplifying medical texts could be a collaborative effort among #agents?
See how our “Society of Medical Simplifiers” makes it possible!

📄: aclanthology.org/2024.tsar-1.7/

#nlpproc #nlp #textsimplification #ats #biomedical #EMNLP2024