Improving accountability in recommender systems research through reproducibility
Entity
UAM. Departamento de Ingeniería InformáticaPublisher
SpringerDate
2021-10-21Citation
10.1007/s11257-021-09302-x
User Model User-adapt Interact 31.5 (2021): 941–977
ISSN
0924-1868DOI
10.1007/s11257-021-09302-xFunded by
This work has been funded by the Ministerio de Ciencia, Innovación y Universidades (reference: PID2019-108965GB-I00)Project
Gobierno de España. PID2019-108965GB-I00Editor's Version
https://doi.org/10.1007/s11257-021-09302-xSubjects
Accountability; Evaluation; Recommender systems; Reproducibility; InformáticaNote
The version of record of this article, first published in User Modeling and User-adapted Interaction, is available online at Publisher’s website: http://dx.doi.org/10.1007/s11257-021-09302-xRights
© The Author(s) 2021Abstract
Reproducibility is a key requirement for scientific progress. It allows the reproduction of the works of others, and, as a consequence, to fully trust the reported claims and results. In this work, we argue that, by facilitating reproducibility of recommender systems experimentation, we indirectly address the issues of accountability and transparency in recommender systems research from the perspectives of practitioners, designers, and engineers aiming to assess the capabilities of published research works. These issues have become increasingly prevalent in recent literature. Reasons for this include societal movements around intelligent systems and artificial intelligence striving toward fair and objective use of human behavioral data (as in Machine Learning, Information Retrieval, or Human–Computer Interaction). Society has grown to expect explanations and transparency standards regarding the underlying algorithms making automated decisions for and around us. This work surveys existing definitions of these concepts and proposes a coherent terminology for recommender systems research, with the goal to connect reproducibility to accountability. We achieve this by introducing several guidelines and steps that lead to reproducible and, hence, accountable experimental workflows and research. We additionally analyze several instantiations of recommender system implementations available in the literature and discuss the extent to which they fit in the introduced framework. With this work, we aim to shed light on this important problem and facilitate progress in the field by increasing the accountability of research
Files in this item
Google Scholar:Bellogin Kouki, Alejandro
-
Said, Alan
This item appears in the following Collection(s)
Related items
Showing items related by title, author, creator and subject.