Proceedings of the International Workshop on Reproducibility and Replication in Recommender Systems Evaluation

The workshop gathered researchers and practitioners interested in defining clear guidelines for their experimental needs to allow fair comparisons to related work. The workshop provided an informal setting for exchanging and discussing ideas, sharing experiences and viewpoints. We aimed to identify and better understand the current gaps in the implementation of recommender system evaluation methodologies, help lay directions for progress in addressing them, and foster the consolidation and convergence of experimental methods and practice. The workshop sought to identify the main challenges related to reproduction and replication of prior research, along with an exploration of possible directions to overcome these limitations.