Home Organizers Schedule Materials

Tutorial Schedule

15 minutes Part One: Biases and Heuristics
1) Welcome and introductions;
2) Exercise: How biased are you?
45 minutes Part Two: Cognitive Biases in Search and Evaluation
1) An overview of the space and spectrum of different cognitive bias ((Azzopardi, 2021, Liu, 2023)
2) Rational Choice and Expected Utility Theory (von Neuman and Morgenstern, 1947) System 1 versus System 2
3) Judgment under Uncertainty: Heuristics and Biases (Tversky and Kahneman, 1974)
  • a) Cognitive Biases in Query Formulation;
  • b) Biases in Evaluation of Search Engine Result Pages (SERPs);
  • c) Biases, in-situ Evaluation and Retrospective Evaluation;
  • d) Biases in Health Information Search;
  • e) Study Design and Methodological Challenges.
    • Bounded Rationality
    90 minutes Part Three - Bias Mitigation Strategies
    1) Bias mitigation algorithms and techniques in Information Retrieval
    2) Bias mitigation algorithms and techniques in Recommender Systems
    3) Bias mitigation experiments and insights from Human-Computer Interaction research
    90 minutes Part Four - Cognitive Biases and GenIR
    1) Opportunities and challenges in understanding cognitive biases in human-AI interactions
    2) Breakout group discussions
    3) User studies or experiments design exercises