They say it's something like 20-30% but 0% of my papers get accepted!! Something definitely wrong here
23.01.2025 11:05 β π 1 π 0 π¬ 0 π 0
The paper comes with mysterious fig 1. ποΈ
23.01.2025 01:50 β π 9 π 1 π¬ 0 π 0
Our experiments are on machine translation, but this method works with any generator + reranker setup!
Eager to hear your thoughts, and happy reranking!
23.01.2025 01:32 β π 2 π 0 π¬ 0 π 0
Bonus: we show how to use multi-fidelity Bayesian optimization to use a smaller and faster proxy scoring model to search even more efficiently. We get the best performance by training a distilled model from our main CometKiwi model.
23.01.2025 01:32 β π 2 π 0 π¬ 1 π 0
The candidate pool is actually a search space, and you can model your uncertainty about scores you haven't scored yet with GP regression. Use BayesOpt to search the pool for promising candidates.
This nearly gets the maximum achievable score with only 70/200 scoring calls!
23.01.2025 01:32 β π 1 π 0 π¬ 1 π 0
Reranking is expensive and we show that you don't need to score every candidate in the candidate pool.
Use Bayesian optimization with GPs!
23.01.2025 01:32 β π 1 π 0 π¬ 1 π 0
Language models for MT are good at generating large candidate pools that contain good translations; they're less good at assigning the highest score to the best translation.
This is where reranking comes in: rescoring with COMET, noisy channel decoding, minimum Bayes risk, etc.
23.01.2025 01:32 β π 1 π 0 π¬ 1 π 0
Happy to announce that our work "A Bayesian Optimization Approach to Machine Translation" was accepted to NAACL 2025!
Special thanks to @ufal-cuni.bsky.social for organizing MT Marathon 2025 where I was able to team up with @maikezufle.bsky.social and @zouharvi.bsky.social !
Explainer below:
23.01.2025 01:32 β π 11 π 2 π¬ 1 π 1
PhD student at the University of Edinburgh.
Co-creator of AlWird (Arabic Wordle).
Research interests: Diversity of Arabic Dialects, Arabic NLP, Multilinguality.
https://amr-keleg.github.io/
Assistant professor with too many opinions. Texpat, politics academia, gay stuff, anti-carbrain. Not an AI brain genius guy. "Train Linguist." π΅πΈπ³οΈβππΊπ¦π³οΈββ§οΈ
"See you divas on the streets."
E me aperta pra eu quase sufocar
BayesForDays@lingo.lol on Mastodon.
CS PhD @umdclip
Multilingual / Culture #NLProc, MT
https://dayeonki.github.io/
Decoding, Machine Translation, kNN, Quantization, Efficiency.
Gentoo, LISP, Rust, functional programming.
Bebop-style Jazz Pianist.
Assistant professor in NLP @UniMelb
Bell Labs research scientist - Maths & NLP
& also French Team Canopy Piloting competitor
Assistant Professor in Humane AI and NLP at the University of Groningen (GroNLP)
Postdoctoral researcher at the Institute for Logic, Language and Computation at the University of Amsterdam.
Previously PhD Student at NLPNorth at the IT University of Copenhagen, with internships at AWS, Parameter Lab, Pacmed.
dennisulmer.eu
Postdoc at βͺMila & McGill University π¨π¦ with a PhD in NLP from the University of Edinburgh π΄σ §σ ’σ ³σ £σ ΄σ Ώ interpretability x memorisation x (non-)compositionality. she/her π©βπ» π³π±
a mediocre combination of a mediocre AI scientist, a mediocre physicist, a mediocre chemist, a mediocre manager and a mediocre professor.
see more at https://kyunghyuncho.me/
Researcher at @fbk-mt.bsky.social | inclusive and trustworthy machine translation | #NLP #Fairness #Ethics | she/her
#NLP #NLProc Lecturer (Assistant Professor) at Cardiff University.
http://nedjmaou.github.io
CS PhD student at UT Austin in #NLP
Interested in language, reasoning, semantics and cognitive science. One day we'll have more efficient, interpretable and robust models!
Other interests: math, philosophy, cinema
https://www.juandiego-rodriguez.com/
ML Engineer at NVIDIA. Previously: Stealth GPU startup; Stability AI; AMD; Autodesk; CEO of 2 startups (3D + AI). Toronto, Canada
Postdoc at @hitz-zentroa.bsky.social / internship @IKER zentroa (UMR5478)
Participatory research
Human-Centered NLP
Machine Translation
(eu) kontu pertsonala:
https://mastodon.eus/@XabierSoto
USC Graduate Student | USC ISI NLP Researcher | 3x Apple Intern | Self-proclaimed Michelin 3-star Foodie | she/her
website: https://t.co/ml5yPJjZLO Natural Language Processing and Machine Learning researcher at the University of Cambridge. Member of the PaNLP group: https://www.panlp.org/ and fellow of Fitzwilliam College.
Artificial Intelligence for Language Technologies (AI4LT) Group, at
@kit.edu
NLP/ML researcher in Lisbon
