no code implementations • 11 Jan 2024 • Maria Vlachou, Craig Macdonald
Still, evaluating systems in offline settings with simulators suffers from problems, such as focusing entirely on a single target item (not addressing the exploratory nature of a recommender system), and exhibiting extreme patience (consistent feedback over a large number of turns).
no code implementations • 17 Oct 2023 • Maria Vlachou, Craig Macdonald
Our approach introduces a new setting for obtaining richer information on query differences in dense QPP that can explain potential unstable performance of existing predictors and outlines the unique characteristics of different query types on dense retrieval models.