Fourth International Workshop on
Algorithmic Bias in Search and Recommendation (Bias 2023)

to be held as part of the 45th European Conference on Information Retrieval (ECIR 2023)

April 2, 2023 - Dublin, Ireland (with support for remote attendance)

Workshop Aims and Scope

Creating efficient and effective search and recommendation algorithms has been the main objective of industry practitioners and academic researchers over the years. However, recent research has shown how these algorithms trained on historical data lead to models that might exacerbate existing biases and generate potentially negative outcomes. Defining, assessing and mitigating these biases throughout experimental pipelines is a primary step for devising search and recommendation algorithms that can be responsibly deployed in real-world applications. This workshop aims to collect novel contributions in this field and offer a common ground for interested researchers and practitioners.

Workshop Topics

The workshop accepts contributions in all topics related to algorithmic bias and fairness in search and recommendation, focused (but not limited) to:

  • Data Set Collection and Preparation:
    • Studying the interplay between bias and imbalanced data or rare classes
    • Designing methods for dealing with imbalances and inequalities in data
    • Creating collection pipelines that lead to fair and less unbiased data sets
    • Collecting data sets useful for the analysis of biased and unfair situations
    • Designing collection protocols for data sets tailored to research on bias
  • Countermeasure Design and Development:
    • Formalizing and operationalizing bias and fairness concepts
    • Conducting exploratory analysis that uncover novel types of bias
    • Designing treatments that mitigate biases in pre-/in-/post-processing
    • Devising methods for explaining bias in search and recommendation
    • Studying causal and counterfactual reasoning for bias and fairness
  • Evaluation Protocol and Metric Formulation:
    • Performing auditing studies with respect to bias and fairness
    • Conducting quantitative experimental studies on bias and unfairness
    • Defining objective metrics that consider fairness and/or bias
    • Formulating bias-aware protocols to evaluate existing algorithms
    • Evaluating existing mitigation strategies in unexplored domains
    • Comparative studies of existing evaluation protocols and strategies
    • Analysing efficiency and scalability issues of debiasing methods
  • Case Study Exploration:
    • E-commerce platforms
    • Educational environments
    • Entertainment websites
    • Healthcare systems
    • Social media
    • News platforms
    • Digital libraries
    • Job portals
    • Dating platforms

Important Dates

  • Submissions: January 12, 2023
  • Notifications: February 16, 2023
  • Camera-Ready: March 2, 2023
  • Workshop: April 2, 2023 - Dublin, Ireland (with support for remote attendance)

All deadlines are 11:59pm, AoE time (Anywhere on Earth).

Submission Details

We invite authors to submit unpublished original papers, written in English. Submitted papers should not have been previously published or accepted for publication in substantially similar form in any peer-reviewed venue, such as journals, conferences, or workshops.

The authors should consult ECIR paper guidelines and Fuhr’s guide to avoid common IR evaluation mistakes, for the preparation of their papers. The authors should consult the Springer’s authors’ guidelines and use their proceedings templates, either LaTeX or Word.

Papers should be submitted as PDF files to Easychair at

We will consider three different submission types:

  • Full papers (12 pages) should be clearly placed with respect to the state of the art and state the contribution of the proposal in the domain of application, even if presenting preliminary results. In particular, research papers should describe the methodology in detail, experiments should be repeatable, and a comparison with the existing approaches in the literature should be made.
  • Reproducibility papers (12 pages) should repeat prior experiments using the original source code and datasets to show how, why, and when the methods work or not (replicability papers) or should repeat prior experiments, preferably using the original source code, in new contexts (e.g., different domains and datasets, different evaluation and metrics) to further generalize and validate or not previous work (reproducibility papers).
  • Short or position papers (6 pages) should introduce new point of views in the workshop topics or summarize the experience of a group in the field. Practice and experience reports should present in detail real-world scenarios in which search and recommender systems are exploited.

Submissions should not exceed the indicated number of pages, including any diagrams and references.

All submissions will go through a double-blind review process and be reviewed by at least three reviewers on the basis of relevance for the workshop, novelty/originality, significance, technical quality and correctness, quality and clarity of presentation, quality of references and reproducibility.

Submitted papers will be rejected without review in case they are not properly anonymized, do not comply with the template, or do not follow the above guidelines.

The accepted papers and the material generated during the meeting will be available on the workshop website. The workshop proceedings will be published as a Springer's Communications in Computer and Information Science (CCIS) revised post-proceedings volume, indexed on Google Scholar, DBLP and Scopus. The authors of selected papers may be invited to submit an extended version in a journal special issue.

Please be aware that at least one author per paper needs to register and attend the workshop to present the work.

We expect authors, the program committee, and the organizing committee to adhere to the ACM’s Conflict of Interest Policy and the ACM’s Code of Ethics and Professional Conduct.


Workshop Chairs

Program Committee

  • Marcelo Gabriel Armentano, National University of Central Buenos Aires, Argentina
  • Ashwathy Ashokan, University of Nebraska Omaha, USA
  • Ebrahim Bagheri, Ryerson University, Canada
  • Christine Bauer, Utrecht University, The Netherlands
  • Alejandro Bellogin, Universidad Autónoma de Madrid, Spain
  • Jeffrey Chan, RMIT University, Australia
  • Evgenia Christoforou, CYENS Centre of Excellence, Cyprus
  • Giordano D'Aloisio, University of L'Aquila, Italy
  • Andrea D'Angelo, University of L'Aquila, Italy
  • Yashar Deldjoo, Polytechnic University of Bari, Italy
  • Danilo Dessì, GESIS – Leibniz Institute for the Social Sciences, Germany
  • Francesco Fabbri, Spotify, Spain
  • Nina Grgic-Hlaca, Max Planck Institute for Software Systems, Germany
  • Danila Hettiachchi, RMIT University, Australia
  • Toshihiro Kamishima, National Institute of Advanced Industrial Science and Technology, Japan
  • Kunal Khadilkar, MIT College of Engineering, USA
  • Dominik Kowald, Know-Center, Austria
  • Emanuel Lacic, Technical University of Graz, Austria
  • Dana Mckay, RMIT University, Australia
  • Giacomo Medda, Univrsity of Cagliari, Italy
  • Cataldo Musto, University of Bari, Italy
  • Julia Neidhardt, Technical University of Wien, Austria
  • Harrie Oosterhuis, Radboud University, The Netherlands
  • Panagiotis Papadakos, Information Systems Laboratory - FORTH-ICS, Greece
  • Simone Paolo Ponzetto, University of Mannheim, Germany
  • Lorenzo Porcaro, Joint Research Centre EC, Italy
  • Erasmo Purificato, Otto-von-Guericke Universität Magdeburg, Germany
  • Alessandro Raganato, University of Helsinki, Finland
  • Amifa Raj, Boise State University, USA
  • Vaijanath Rao, Quicken Inc., USA
  • Yongli Ren, RMIT University, Australia
  • Manel Slokom, Delft University of Technology, The Netherlands
  • Tom Sühr, Technische Universität Berlin, Germany
  • Marko Tkalcic, University of Primorska, Slovenia
  • Christoph Trattner, University of Bergen, Norway
  • Rohini U, Glassdoor, USA
  • Eva Zangerle, University of Innsbruck, Austria
  • Arkaitz Zubiaga, Queen Mary University of London, UK


The registration will be managed by the Main Conference organization at Registration is yet to open.


For general enquiries on the workshop, please send an email to,,, and