Harrie Oosterhuis's Avatar

Harrie Oosterhuis

@harrieo.bsky.social

Machine learning and information retrieval researcher. | Assistant professor at Radboud University Nijmegen and visiting research scholar at Google DeepMind. | Previously at Google Research, Twitter and University of Amsterdam.

123 Followers  |  127 Following  |  12 Posts  |  Joined: 13.01.2025
Posts Following

Posts by Harrie Oosterhuis (@harrieo.bsky.social)

Informagus @ SIGIR 2025
Sunday: Heydar (doctoral consortium)
Monday: Djoerd (short paper), Daria & Arjen (short paper), Santiago & Harrie et al. (short paper), etc., etc.

Informagus @ SIGIR 2025 Sunday: Heydar (doctoral consortium) Monday: Djoerd (short paper), Daria & Arjen (short paper), Santiago & Harrie et al. (short paper), etc., etc.

Colleague @harrieo.bsky.social made this impressive poster of all Radboud U. contributions to #SIGIR2025

11.07.2025 11:14 โ€” ๐Ÿ‘ 4    ๐Ÿ” 3    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Informagus @ SIGIR & ICTIR 2025

Sunday July 13 โ€“ Tutorials and DC Consortium

Enhancing Knowledge Injection in Large Language Models for Efficient and Trustworthy Responses
Heydar Soudani
Doctoral Consortium Paper - 16:30 - Doctoral Consortium

Monday July 14 โ€“ Main Conference

Score-Fitted Indexes and Constant Length Indexes for Information Retrieval
Djoerd Hiemstra
Short Paper - 14:00 - Short Papers Posters 1
In a Few Words: Comparing Weak Supervision and LLMs for Short Query Intent Classification
Daria Alexander, Arjen P. de Vries
Short Paper - 14:00 - Short Papers Posters 1
RecGaze: The First Eye Tracking and User Interaction Dataset for Carousel Interfaces
Santiago de Leon-Martinez, Jingwei Kang, Robert Moro, Maarten de Rijke, Branislav Kveton, Harrie Oosterhuis, Maria Bielikova
Resource Paper - 14:00 - Resource Papers Posters 1

Tuesday July 15 โ€“ Main Conference

Optimizing Compound Retrieval Systems
Harrie Oosterhuis, Rolf Jagerman, Zhen Qin, Xuanhui Wang
Full Paper - 14:00 - Search and Ranking 1

Wednesday July 16 โ€“ Main Conference

Learning to Rank with Variable Result Presentation Lengths
Norman Knyazev, Harrie Oosterhuis
Full Paper - 10:30 - Reranking
Adaptive Orchestration of Modular Generative Information Access Systems
Mohanna Hoveyda, Harrie Oosterhuis, Arjen P. de Vries, Maarten de Rijke, Faegheh Hasibi
Perspectives Paper - 12:15 - Perspectives 1

Thursday July 17 โ€“ Workshops

On the Neural Hype and Improving Efficiency of Sparse Retrieval
Djoerd Hiemstra
Keynote - 10:30 - ReNeuIRโ€™25 Workshop
Harnessing Pairwise Ranking Prompting Through Sample-Efficient Ranking Distillation
Junru Wu, Le Yan, Zhen Qin, Honglei Zhuang, Paul Suganthan G.C., Tianqi Liu, Zhe Dong, Xuanhui Wang, Harrie Oosterhuis
Workshop Paper - 14:15 - ReNeuIRโ€™25 Workshop
An Axiomatic Examination of Uncertainty Estimation in RAG Systems
Heydar Soudani, Evangelos Kanoulas, Faegheh Hasibi
Workshop Paper - Time TBA - IR-RAGโ€™25 Workshop
FACE: A Fine-grained Reference Free Evaluator for Coโ€ฆ

Informagus @ SIGIR & ICTIR 2025 Sunday July 13 โ€“ Tutorials and DC Consortium Enhancing Knowledge Injection in Large Language Models for Efficient and Trustworthy Responses Heydar Soudani Doctoral Consortium Paper - 16:30 - Doctoral Consortium Monday July 14 โ€“ Main Conference Score-Fitted Indexes and Constant Length Indexes for Information Retrieval Djoerd Hiemstra Short Paper - 14:00 - Short Papers Posters 1 In a Few Words: Comparing Weak Supervision and LLMs for Short Query Intent Classification Daria Alexander, Arjen P. de Vries Short Paper - 14:00 - Short Papers Posters 1 RecGaze: The First Eye Tracking and User Interaction Dataset for Carousel Interfaces Santiago de Leon-Martinez, Jingwei Kang, Robert Moro, Maarten de Rijke, Branislav Kveton, Harrie Oosterhuis, Maria Bielikova Resource Paper - 14:00 - Resource Papers Posters 1 Tuesday July 15 โ€“ Main Conference Optimizing Compound Retrieval Systems Harrie Oosterhuis, Rolf Jagerman, Zhen Qin, Xuanhui Wang Full Paper - 14:00 - Search and Ranking 1 Wednesday July 16 โ€“ Main Conference Learning to Rank with Variable Result Presentation Lengths Norman Knyazev, Harrie Oosterhuis Full Paper - 10:30 - Reranking Adaptive Orchestration of Modular Generative Information Access Systems Mohanna Hoveyda, Harrie Oosterhuis, Arjen P. de Vries, Maarten de Rijke, Faegheh Hasibi Perspectives Paper - 12:15 - Perspectives 1 Thursday July 17 โ€“ Workshops On the Neural Hype and Improving Efficiency of Sparse Retrieval Djoerd Hiemstra Keynote - 10:30 - ReNeuIRโ€™25 Workshop Harnessing Pairwise Ranking Prompting Through Sample-Efficient Ranking Distillation Junru Wu, Le Yan, Zhen Qin, Honglei Zhuang, Paul Suganthan G.C., Tianqi Liu, Zhe Dong, Xuanhui Wang, Harrie Oosterhuis Workshop Paper - 14:15 - ReNeuIRโ€™25 Workshop An Axiomatic Examination of Uncertainty Estimation in RAG Systems Heydar Soudani, Evangelos Kanoulas, Faegheh Hasibi Workshop Paper - Time TBA - IR-RAGโ€™25 Workshop FACE: A Fine-grained Reference Free Evaluator for Coโ€ฆ

If you are attending #SIGIR2025 and #ICTIR2025, come check out our research group's presentations! ๐Ÿ˜Š
We have 14 presentations in total, with at least one every day. ๐Ÿ˜„

If you want to know more about our group, e.g., the meaning of the Informagus name ๐Ÿ˜, do reach out to us.

See you in Padua! ๐Ÿ˜Ž โ˜€๏ธ ๐Ÿ‡ฎ๐Ÿ‡น

11.07.2025 08:49 โ€” ๐Ÿ‘ 12    ๐Ÿ” 4    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Post image

Rethinking Click Models in Light of Carousel Interfaces: Theory-Based Categorization and Design of Click Models

Jingwei Kang, Maarten de Rijke, Santiago de Leon-Martinez, Harrie Oosterhuis

arxiv.org/abs/2506.18548

Presentation: Friday 18 July 11:55 - ICTIRโ€™25 Oral Presentations

๐Ÿงต 6/6

08.07.2025 16:53 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Post image

Harnessing Pairwise Ranking Prompting Through Sample-Efficient Ranking Distillation

Junru Wu, Le Yan, Zhen Qin, Honglei Zhuang, Paul Suganthan G.C., Tianqi Liu, Zhe Dong, Xuanhui Wang, Harrie Oosterhuis

arxiv.org/abs/2507.04820

Presentation: Thursday 17 July 14:15 - ReNeuIR25 Paper Session

๐Ÿงต 5/6

08.07.2025 16:53 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Post image

Adaptive Orchestration of Modular Generative Information Access Systems

Mohanna Hoveyda, Harrie Oosterhuis, Arjen P. de Vries, Maarten de Rijke, Faegheh Hasibi

arxiv.org/abs/2504.17454

Code: github.com/informagi/AQA

Presentation: Wednesday 16 July 12:15 - Perspectives 1

๐Ÿงต 4/6

08.07.2025 16:53 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Post image

Learning to Rank with Variable Result Presentation Lengths

Norman Knyazev, Harrie Oosterhuis

arxiv.org/abs/2506.23319

Code: github.com/NKNY/varlenr...

Presentation: Wednesday 16 July 10:30 - Reranking

๐Ÿงต 3/6

08.07.2025 16:53 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Post image

Optimizing Compound Retrieval Systems

Harrie Oosterhuis, Rolf Jagerman, Zhen Qin, Xuanhui Wang

arxiv.org/abs/2504.12063

Code: github.com/google-deepm...

Presentation: Tuesday 15 July 11:15 - Search and Ranking 1

๐Ÿงต 2/6

08.07.2025 16:53 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Post image

RecGaze: The First Eye Tracking and User Interaction Dataset for Carousel Interfaces

Santiago de Leon-Martinez, Jingwei Kang, Robert Moro, Maarten de Rijke, Branislav Kveton, Harrie Oosterhuis, Maria Bielikova

arxiv.org/abs/2504.20792

Monday 14 July 14:00 - Resource Papers Posters 1

๐Ÿงต 1/6

08.07.2025 16:53 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

Next week, I'll be in Padua, Italy for #SIGIR25 & #ICTIR25. ๐Ÿ‡ฎ๐Ÿ‡น๐Ÿ๐Ÿ•๐Ÿท๐Ÿนโ˜€๏ธ
SIGIR is one of my favourite conferences, so I'm very happy to have six co-authored works there, two of which I'll present myself. ๐Ÿ˜„
I'm looking forward to seeing many of you there! ๐Ÿ™‚

Come check out our presentations! ๐Ÿงต๐Ÿ‘‡๐Ÿ˜„ 0/6

08.07.2025 16:53 โ€” ๐Ÿ‘ 2    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
DIR 2025

#DIR2025, the 22nd Dutch-Belgian Information Retrieval workshop will take place at Radboud University Nijmegen on 27 October 2025!

https://informagus.nl/dir2025/

06.06.2025 09:07 โ€” ๐Ÿ‘ 5    ๐Ÿ” 8    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Very excited for the 4th edition of CONSEQUENCES at the RecSys 2025 conference! ๐Ÿ˜„
Check our our call for contributions below, and follow @consequencesrecsys.bsky.social for more info.

16.05.2025 08:02 โ€” ๐Ÿ‘ 4    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Santiago de Leon-Martinez, Jingwei Kang, Robert Moro, Maarten de Rijke, Branislav Kveton, Harrie Oosterhuis, Maria Bielikova
RecGaze: The First Eye Tracking and User Interaction Dataset for Carousel Interfaces
https://arxiv.org/abs/2504.20792

30.04.2025 04:15 โ€” ๐Ÿ‘ 1    ๐Ÿ” 1    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Mohanna Hoveyda, Harrie Oosterhuis, Arjen P. de Vries, Maarten de Rijke, Faegheh Hasibi
Adaptive Orchestration of Modular Generative Information Access Systems
https://arxiv.org/abs/2504.17454

25.04.2025 04:55 โ€” ๐Ÿ‘ 1    ๐Ÿ” 1    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Harrie Oosterhuis, Rolf Jagerman, Zhen Qin, Xuanhui Wang
Optimizing Compound Retrieval Systems
https://arxiv.org/abs/2504.12063

17.04.2025 04:03 โ€” ๐Ÿ‘ 1    ๐Ÿ” 1    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

I'm looking forward to reading this, Bhaskar!

12.03.2025 18:47 โ€” ๐Ÿ‘ 3    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

Those damn aliens are always so hard to reach! ๐Ÿ‘ฝ

28.01.2025 13:07 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Preview
Large Language Models are Effective Text Rankers with Pairwise Ranking Prompting Zhen Qin, Rolf Jagerman, Kai Hui, Honglei Zhuang, Junru Wu, Le Yan, Jiaming Shen, Tianqi Liu, Jialu Liu, Donald Metzler, Xuanhui Wang, Michael Bendersky. Findings of the Association for Computational ...

My colleagues published about pairwise relevance labeling this last year (and even earlier on arXiv):
aclanthology.org/2024.finding...

Why I personally think it works better, mainly because it's hard to calibrate a pointwise relevance prediction, but a pairwise prediction hardly needs calibration.

14.01.2025 09:29 โ€” ๐Ÿ‘ 3    ๐Ÿ” 1    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 1