Skip to main content

Unbiased Recommender Learning for Enhanced Relevance and Coverage

  • Conference paper
  • First Online:
HCI International 2024 – Late Breaking Papers (HCII 2024)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 15382))

Included in the following conference series:

  • 487 Accesses

Abstract

In recent years, the effect of cognitive bias on recommender systems has become a major concern. These biases are commonly found in data collected through the feedback loop. Ignoring them may cause problems such as homogenization among users and increasing disparity among items. Therefore, it is necessary to address these biases for sustainable and effective operation of the recommender system. To address exposure bias, a method has been proposed that maximizes the relevance of recommendations by integrating matrix factorization (MF) with an inverse propensity score (IPS) estimator in the pointwise loss function. Although MF achieves a high recommendation accuracy, it tends to bias interactions, for instance, by limiting exposure opportunities for certain items. In this study, we demonstrate that incorporating factorization machines (FM), which can handle various features, into the IPS estimator can improve both the relevance and coverage of recommendations—attributes that typically have a trade-off relationship—using biased data. Experimental results from semi-synthetic data indicate that our approach can significantly enhance item coverage while maintaining the high relevance of recommendations, particularly in a large-scale data environment. This advancement allows many users to discover relevant content from biased data and increases exposure opportunities for a broader range of content.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
€34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
EUR 29.95
Price includes VAT (Germany)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
EUR 53.49
Price includes VAT (Germany)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
EUR 70.61
Price includes VAT (Germany)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

') var buybox = document.querySelector("[data-id=id_"+ timestamp +"]").parentNode var buyingOptions = buybox.querySelectorAll(".buying-option") ;[].slice.call(buyingOptions).forEach(initCollapsibles) var buyboxMaxSingleColumnWidth = 480 function initCollapsibles(subscription, index) { var toggle = subscription.querySelector(".buying-option-price") subscription.classList.remove("expanded") var form = subscription.querySelector(".buying-option-form") var priceInfo = subscription.querySelector(".price-info") var buyingOption = toggle.parentElement if (toggle && form && priceInfo) { toggle.setAttribute("role", "button") toggle.setAttribute("tabindex", "0") toggle.addEventListener("click", function (event) { var expandedBuyingOptions = buybox.querySelectorAll(".buying-option.expanded") var buyboxWidth = buybox.offsetWidth ;[].slice.call(expandedBuyingOptions).forEach(function(option) { if (buyboxWidth buyboxMaxSingleColumnWidth) { toggle.click() } else { if (index === 0) { toggle.click() } else { toggle.setAttribute("aria-expanded", "false") form.hidden = "hidden" priceInfo.hidden = "hidden" } } }) } initialStateOpen() if (window.buyboxInitialised) return window.buyboxInitialised = true initKeyControls() })()

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    Details on the experiment implementation are available at: https://github.com/tatsuki1107/Unbiased-Recommender-Learning-for-Enhanced-Relevance-and-Coverage.

  2. 2.

    Kuairec: https://kuairec.com/.

  3. 3.

    Coat: https://www.cs.cornell.edu/~schnabts/mnar/.

References

  1. Saito, Y., Aihara, S., Matsutani, M., Narita, Y. Open Bandit Dataset and Pipeline: Towards Realistic and Reproducible Off-Policy Evaluation. arXiv preprint arXiv:2008.07146 (2020)

  2. Covington, P., Jay, A., Sargin, E. Deep neural networks for YouTube recommendations. In: Proceedings of the 10th ACM Conference on Recommender Systems (RecSys ’16). Association for Computing Machinery, New York, NY, USA, pp. 191–198 (2016)

    Google Scholar 

  3. Mehrotra, R., McInerney, J., Bouchard, H., Lalmas, M., Diaz, F. Towards a fair marketplace: counterfactual evaluation of the trade-off between relevance, fairness & satisfaction in recommendation systems. In: Proceedings of the 27th ACM International Conference on Information and Knowledge Management (CIKM ’18). Association for Computing Machinery, New York, NY, USA, pp. 2243–2251 (2018)

    Google Scholar 

  4. Chen, J., Dong, H., Wang, X., Feng, F., Wang, M., He, X.: Bias and debias in recommender system: a survey and future directions. ACM T. Inform. Sys. 41(3), 1–39 (2023)

    MATH  Google Scholar 

  5. Baeza-Yates, R.: Bias on the web. Commun. ACM 61(6), 54–61 (2018). https://doi.org/10.1145/3209581

  6. Chaney, A.J.B., Stewart, B.M., Engelhardt, B.E.: How algorithmic confounding in recommendation systems increases homogeneity and decreases utility. In: Proceedings of the 12th ACM Conference on Recommender Systems, pp. 224-232. ACM (2018)

    Google Scholar 

  7. Rendle, S.: Factorization machines. In: ICDM’10, pp. 995-1000 (2010)

    Google Scholar 

  8. Saito, Y., Yaginuma, Y., Nishino, Y., Sakata, H., Nakata, K.: Unbiased recommender learning from missing-not-at-random implicit feedback. In: Proceedings of the 13th International Conference on Web Search and Data Mining, pp. 501–509 (2020)

    Google Scholar 

  9. Saito, Y.: Unbiased pairwise learning from biased implicit feedback. In: Proceedings of the 2020 ACM SIGIR on International Conference on Theory of Information Retrieval (ICTIR ’20). Association for Computing Machinery, New York, NY, USA, pp. 5–12 (2020)

    Google Scholar 

  10. Koren, Y., Bell, R., Volinsky, C.: Matrix factorization techniques for recommender systems. Comput. 8, 30–37 (2009)

    MATH  Google Scholar 

  11. Yang, L., Cui, Y., Xuan, Y., Wang, C., Belongie, S., Estrin, D.: Unbiased offline recommender evaluation for missing-not-at-random implicit feedback. In: Proceedings of the 12th ACM Conference on Recommender Systems (RecSys ’18). Association for Computing Machinery, New York, NY, USA, pp. 279–287 (2018)

    Google Scholar 

  12. Cremonesi, P., Koren, Y., Turrin, R.: Performance of recommender algorithms on top-n recommendation tasks. In: Proceedings of the fourth ACM conference on Recommender systems (RecSys ’10). Association for Computing Machinery, New York, NY, USA, pp. 39–46 (2010)

    Google Scholar 

  13. Bernardi, L., Mavridis, T., Estevez, P.: 150 successful machine learning models: 6 lessons learned at booking.com. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD ’19). Association for Computing Machinery, New York, NY, USA, pp. 1743–1751 (2019)

    Google Scholar 

  14. Marlin, M., Zemel, S., Roweis, S., Slaney, M.: Collaborative filtering and the missing at random assumption. In: Proceedings of the Twenty-Third Conference on Uncertainty in Artificial Intelligence (UAI’07). AUAI Press, Arlington, Virginia, USA, pp. 267–275 (2007)

    Google Scholar 

  15. Schnabel, T., Swaminathan, A., Singh, A., Chandak, N., Joachims, T.: Recommendations as treatments: debiasing learning and evaluation. In: Proceedings of the 33rd International Conference on International Conference on Machine Learning - Volume 48 (ICML’16). JMLR.org, pp. 1670–1679 (2016)

    Google Scholar 

  16. Ai, Q., Bi, K., Luo, C., Guo, J., Croft, W.B.: Unbiased learning to rank with unbiased propensity estimation. In: The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval (SIGIR ’18). Association for Computing Machinery, New York, NY, USA, pp. 385–394 (2018)

    Google Scholar 

  17. Dudík, M., Langford, J., Li, L.: Doubly robust policy evaluation and learning. In: Proceedings of the 28th International Conference on International Conference on Machine Learning (ICML’11). Omnipress, Madison, WI, USA, pp. 1097–1104 (2011)

    Google Scholar 

  18. Saito, Y., Joachims, T.: Off-policy evaluation for large action spaces via embeddings. In: International Conference on Machine Learning, pp. 19089–19122. PMLR (2022)

    Google Scholar 

  19. Li, S., Abbasi-Yadkori, Y., Kveton, B., Muthukrishnan, S., Vinay, V., Wen, Z.: Offline evaluation of ranking policies with click models. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD ’18). Association for Computing Machinery, New York, NY, USA, pp. 1685–1694 (2018)

    Google Scholar 

  20. Gao, C., et al.: KuaiRec: A Fully-observed Dataset and Insights for Evaluating Recommender Systems. arXiv preprint arXiv:2202.10842 (2022)

    Google Scholar 

  21. Saito, Y.: Doubly robust estimator for ranking metrics with post-click conversions. In: Proceedings of the 14th ACM Conference on Recommender Systems (RecSys ’20). Association for Computing Machinery, New York, NY, USA, pp. 92–100 (2020)

    Google Scholar 

Download references

Acknowledgements

We would like to express our gratitude to Chuo University for providing the grant for conference participation, which greatly facilitated the presentation and dissemination of our research findings. This support was invaluable in enhancing the impact and reach of our work.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tatsuki Takahashi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Takahashi, T., Shoji, H. (2024). Unbiased Recommender Learning for Enhanced Relevance and Coverage. In: Degen, H., Ntoa, S. (eds) HCI International 2024 – Late Breaking Papers. HCII 2024. Lecture Notes in Computer Science, vol 15382. Springer, Cham. https://doi.org/10.1007/978-3-031-76827-9_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-76827-9_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-76826-2

  • Online ISBN: 978-3-031-76827-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics