Title: Diversity in news recommendations using contextual bandits
Authors: Alexander Semenov - University of Florida and Saint Petersburg State University (United States) [presenting]
Gaurav Pandey - The University of Jyvaskyla (Finland)
Maciej Rysz - Miami University (United States)
Guanglin Xu - The University of North Carolina at Charlotte (United States)
Abstract: Contextual bandit techniques have recently been used for generating personalized user recommendations in situations where collaborative filtering based algorithms may be inefficient. They are often used in cases when input data are dynamically changing as new users, and content items constantly change. One such setting involves recommending news articles to users based on context, i.e., user and article features. Contextual bandit methods sequentially select articles for recommendation to a user and continuously modify their strategies to present users with articles that maximize clicks. However, exclusively focusing on maximizing the number of clicks can lead to over-exposure of certain articles, while under-representing others. In an era of the ever-growing demand for digital news delivery, this, in turn, invokes the important notion of presenting news content to users in a ``socially responsible'' way. We present a technique based on the contextual bandit framework that, in addition to maximization of the click rate, also considers the historical frequency of an article as the ``cost'' associated with recommending it. It is demonstrated that this approach results in a more balanced distribution and a diverse set of recommended articles. Experiments utilizing a benchmark news dataset demonstrate the trade-off between clicks and diversity of recommended articles.