Third International Workshop on
Algorithmic Bias in Search and Recommendation (Bias 2022)

to be held as part of the 44th European Conference on Information Retrieval (ECIR 2022)

April 10, 2022 - Stavanger, Norway (with support for remote attendance)

Workshop Aims and Scope

Creating search and recommendation algorithms that are efficient and effective has been the main objective for the industry and the academia for years. However, recent research has shown that these algorithms lead to models, trained on historical data, that might exacerbate existing biases and generate potentially negative outcomes. Defining, assessing and mitigating these biases throughout experimental pipelines is therefore a primary step for devising search and recommendation algorithms that can be responsibly deployed in real-world applications. In this workshop, we aim to collect novel contributions in this field and offer a common ground for interested researchers and practitioners.

Workshop Topics

The workshop welcomes contributions in all topics related to algorithmic bias and fairness in search and recommendation, focused (but not limited) to:

  • Data Set Collection and Preparation:
    • Studying the interplay between bias and imbalanced data or rare classes
    • Designing methods for dealing with imbalances and inequalities in data
    • Creating collection pipelines that lead to fair and less unbiased data sets
    • Collecting data sets useful for the analysis of biased and unfair situations
    • Designing collection protocols for data sets tailored to research on bias
  • Countermeasure Design and Development:
    • Formalizing and operationalizing bias and fairness concepts
    • Conducting exploratory analysis that uncover novel types of bias
    • Designing treatments that mitigate biases in pre-/in-/post-processing
    • Devising methods for explaining bias in search and recommendation
    • Studying causal and counterfactual reasoning for bias and fairness
  • Evaluation Protocol and Metric Formulation:
    • Performing auditing studies with respect to bias and fairness
    • Conducting quantitative experimental studies on bias and unfairness
    • Defining objective metrics that consider fairness and/or bias
    • Formulating bias-aware protocols to evaluate existing algorithms
    • Evaluating existing mitigation strategies in unexplored domains
    • Comparative studies of existing evaluation protocols and strategies
    • Analysing efficiency and scalability issues of debiasing methods
  • Case Study Exploration:
    • E-commerce platforms
    • Educational environments
    • Entertainment websites
    • Healthcare systems
    • Social media
    • News platforms
    • Digital libraries
    • Job portals
    • Dating platforms

Important Dates

  • Submissions: January 13, 2022
  • Notifications: February 13, 2022
  • Camera-Ready: March 3, 2022
  • Workshop: April 10, 2022 - Stavanger, Norway (with support for remote attendance)

All deadlines are 11:59pm, AoE time (Anywhere on Earth).

Submission Details

We invite authors to submit unpublished original papers, written in English. Submitted papers should not have been previously published or accepted for publication in substantially similar form in any peer-reviewed venue, such as journals, conferences, or workshops.

The authors should consult ECIR paper guidelines and Fuhr’s guide to avoid common IR evaluation mistakes, for the preparation of their papers. The authors should consult the Springer’s authors’ guidelines and use their proceedings templates, either LaTeX or Word.

Papers should be submitted as PDF files to Easychair at

We will consider three different submission types:

  • Full papers (12 pages) should be clearly placed with respect to the state of the art and state the contribution of the proposal in the domain of application, even if presenting preliminary results. In particular, research papers should describe the methodology in detail, experiments should be repeatable, and a comparison with the existing approaches in the literature should be made.
  • Reproducibility papers (12 pages) should repeat prior experiments using the original source code and datasets to show how, why, and when the methods work or not (replicability papers) or should repeat prior experiments, preferably using the original source code, in new contexts (e.g., different domains and datasets, different evaluation and metrics) to further generalize and validate or not previous work (reproducibility papers).
  • Short or position papers (6 pages) should introduce new point of views in the workshop topics or summarize the experience of a group in the field. Practice and experience reports should present in detail real-world scenarios in which search and recommender systems are exploited.

Submissions should not exceed the indicated number of pages, including any diagrams and references.

All submissions will go through a double-blind review process and be reviewed by at least three reviewers on the basis of relevance for the workshop, novelty/originality, significance, technical quality and correctness, quality and clarity of presentation, quality of references and reproducibility.

Submitted papers will be rejected without review in case they are not properly anonymized, do not comply with the template, or do not follow the above guidelines.

The accepted papers and the material generated during the meeting will be available on the workshop website. We plan to publish the workshop proceedings as a Springer's Communications in Computer and Information Science (CCIS) revised post-proceedings volume (approval pending), indexed on Google Scholar, DBLP and Scopus. The authors of selected papers may be invited to submit an extended version in a journal special issue.

Please be aware that at least one author per paper needs to register and attend the workshop to present the work.

We expect authors, the program committee, and the organizing committee to adhere to the ACM’s Conflict of Interest Policy and the ACM’s Code of Ethics and Professional Conduct.


Workshop Chairs

Program Committee

  • Mehwish Alam, FIZ Karlsruhe and Karlsruhe Institute of Technology, Germany
  • Marcelo Gabriel Armentano, National University of Central Buenos Aires, Argentina
  • Alejandro Bellogin, Universidad Autónoma de Madrid, Spain
  • Iván Cantador, Universidad Autónoma de Madrid, Spain
  • Evgenia Christoforou, CYENS Centre of Excellence, Cyprus
  • Danilo Dessì, University of Cagliari, Italy
  • Francesco Fabbri, Universitat Pompeu Fabra, Spain
  • Saeed Farzi, K. N. Toosi University of Technology, Iran
  • Eduard Fosch-Villaronga, Leiden University, The Netherlands
  • Nina Grgic-Hlaca, Max Planck Institute for Software Systems, Germany
  • Frank Hopfgartner, The University of Sheffield, UK
  • Bipin Indurkhya, AGH University of Science and Technology, Poland
  • Toshihiro Kamishima, National Institute of Advanced Industrial Science and Technology, Japan
  • Karrie Karahalios, University of Illinois, USA
  • Arvind Karunakaran, McGill University, Canada
  • Aonghus Lawlor, University College Dublin, Ireland
  • Sandy Mayson, University of Georgia, USA
  • Rishabh Mehrotra, Spotify Research, UK
  • Brent Mittelstadt, University of Oxford, UK
  • Cataldo Musto, University of Bari, Italy
  • Fedelucio Narducci, Politecnico di Bari, Italy
  • Kalia Orphanou, Open University of Cyprus, Cyprus
  • Jahna Otterbacher, Open University of Cyprus, Cyprus
  • Panagiotis Papadakos, Information Systems Laboratory - FORTH-ICS, Greece
  • Mykola Pechenizkiy, Eindhoven University of Technology, The Netherlands
  • Emma Pierson, Stanford University, USA
  • Simone Paolo Ponzetto, University of Mannheim, Germany
  • Erasmo Purificato, Otto-von-Guericke Universität Magdeburg, Germany
  • Alessandro Raganato, University of Helsinki, Finland
  • Elissa Redmiles, University of Maryland, USA
  • Flora D. Salim, RMIT University, Australia
  • Babak Salimi, University of California, USA
  • Falk Scholer, RMIT University, Australia
  • Manel Slokom, Delft University of Technology, The Netherlands
  • Nataliya Sokolovska, Sorbonne University, France
  • Damiano Spina, RMIT University, Australia
  • Tom Sühr, Technische Universität Berlin, Germany
  • Marko Tkalcic, University of Primorska, Slovenia
  • Antonela Tommasel, National University of Central Buenos Aires, Argentina
  • Joris Van Hoboken, University of Amsterdam, The Netherlands
  • Eva Zangerle, University of Innsbruck, Austria
  • Markus Zanker, Free University of Bozen-Bolzano, Italy
  • Dong Zhou, Tsinghua University, China
  • Arkaitz Zubiaga, Queen Mary University of London, UK


The registration will be managed by the Main Conference organization at Registration is yet to open.


For general enquiries on the workshop, please send an email to,,, and