Isra Salazar's Avatar

Isra Salazar

@israsalazar.bsky.social

PhD fellow @coastalcph | MVA @ENS_ParisSaclay | Engineer @uchile. πŸ€–πŸ§ β˜•πŸ»πŸ₯βœˆοΈπŸƒπŸ½πŸ‡¨πŸ‡±πŸŽΈ πŸŠπŸ½β€β™‚οΈ

100 Followers  |  343 Following  |  3 Posts  |  Joined: 22.10.2024
Posts Following

Posts by Isra Salazar (@israsalazar.bsky.social)

Preview
Kaleidoscope: In-language Exams for Massively Multilingual Vision Evaluation The evaluation of vision-language models (VLMs) has mainly relied on English-language benchmarks, leaving significant gaps in both multilingual and multicultural coverage. While multilingual benchmark...

Check out the paper at:
πŸ“œPaper: arxiv.org/abs/2504.07072
πŸ’ΏData: hf.co/datasets/Coh...
🌐Website: cohere.com/research/kal...
Huge thanks to everyone involved! This was a big collaboration πŸ‘

10.04.2025 10:31 β€” πŸ‘ 2    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0
Post image

Today we are releasing Kaleidoscope πŸŽ‰

A comprehensive multimodal & multilingual benchmark for VLMs! It contains real questions from exams in different languages.

🌍 20,911 questions and 18 languages
πŸ“š 14 subjects (STEM β†’ Humanities)
πŸ“Έ 55% multimodal questions

10.04.2025 10:31 β€” πŸ‘ 25    πŸ” 6    πŸ’¬ 1    πŸ“Œ 1

Me :)

27.11.2024 15:57 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0