[go: up one dir, main page]

skip to main content
research-article

Updatable, Accurate, Diverse, and Scalable Recommendations for Interactive Applications

Published: 19 December 2016 Publication History

Abstract

Recommender systems form the backbone of many interactive systems. They incorporate user feedback to personalize the user experience typically via personalized recommendation lists. As users interact with a system, an increasing amount of data about a user’s preferences becomes available, which can be leveraged for improving the systems’ performance. Incorporating these new data into the underlying recommendation model is, however, not always straightforward. Many models used by recommender systems are computationally expensive and, therefore, have to perform offline computations to compile the recommendation lists. For interactive applications, it is desirable to be able to update the computed values as soon as new user interaction data is available: updating recommendations in interactive time using new feedback data leads to better accuracy and increases the attraction of the system to the users. Additionally, there is a growing consensus that accuracy alone is not enough and user satisfaction is also dependent on diverse recommendations.
In this work, we tackle this problem of updating personalized recommendation lists for interactive applications in order to provide both accurate and diverse recommendations. To that end, we explore algorithms that exploit random walks as a sampling technique to obtain diverse recommendations without compromising on efficiency and accuracy. Specifically, we present a novel graph vertex ranking recommendation algorithm called RP3β that reranks items based on three-hop random walk transition probabilities. We show empirically that RP3β provides accurate recommendations with high long-tail item frequency at the top of the recommendation list. We also present approximate versions of RP3β and the two most accurate previously published vertex ranking algorithms based on random walk transition probabilities and show that these approximations converge with an increasing number of samples.
To obtain interactively updatable recommendations, we additionally show how our algorithm can be extended for online updates at interactive speeds. The underlying random walk sampling technique makes it possible to perform the updates without having to recompute the values for the entire dataset.
In an empirical evaluation with three real-world datasets, we show that RP3β provides highly accurate and diverse recommendations that can easily be updated with newly gathered information at interactive speeds (≪ 100ms).

References

[1]
Gediminas Adomavicius and YoungOk Kwon. 2011. Maximizing aggregate recommendation diversity: A graph-theoretic approach. In Proceedings of the 1st International Workshop on Novelty and Diversity in Recommender Systems (DiveRS’11). Citeseer, 3--10.
[2]
Gediminas Adomavicius and YoungOk Kwon. 2012. Improving aggregate recommendation diversity using ranking-based techniques. IEEE Transactions on Knowledge and Data Engineering, 24, 5 (2012), 896--911.
[3]
Charu C. Aggarwal, Joel L. Wolf, Kun-Lung Wu, and Philip S. Yu. 1999. Horting hatches an egg: A new graph-theoretic approach to collaborative filtering. In Proceedings of the 5th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 201--212.
[4]
David Aldous and Jim Fill. 2002. Reversible Markov chains and random walks on graphs. Unfinished Monograph. http://www.stat.berkeley.edu/∼aldous/RWG/book.html.
[5]
Bahman Bahmani, Abdur Chowdhury, and Ashish Goel. 2010. Fast incremental and personalized pagerank. Proceedings of the VLDB Endowment 4, 3 (2010), 173--184.
[6]
Shumeet Baluja, Rohan Seth, D. Sivakumar, Yushi Jing, Jay Yagnik, Shankar Kumar, Deepak Ravichandran, and Mohamed Aly. 2008. Video suggestion and discovery for Youtube: Taking random walks through the view graph. In Proceedings of the 17th International Conference on World Wide Web. ACM, 895--904.
[7]
Pavel Berkhin. 2006. Bookmark-coloring algorithm for personalized Pagerank computing. Internet Mathematics 3, 1 (2006), 41--62.
[8]
Toine Bogers. 2010. Movie recommendation using random walks over the contextual graph. In Proceedings of the 2nd International Workshop on Context-Aware Recommender Systems.
[9]
Matthew Brand. 2005. A random walks perspective on maximizing satisfaction and profit. In Proceedings of the 2005 SIAM International Conference on Data Mining (SDM). SIAM, 12--19.
[10]
John S. Breese, David Heckerman, and Carl Kadie. 1998. Empirical analysis of predictive algorithms for collaborative filtering. In Proceedings of the 14th Conference on Uncertainty in Artificial Intelligence. Morgan Kaufmann Publishers, 43--52.
[11]
Steve Chien, Cynthia Dwork, Ravi Kumar, Daniel R. Simon, and D. Sivakumar. 2004. Link evolution: Analysis and algorithms. Internet Mathematics 1, 3 (2004), 277--304.
[12]
Fabian Christoffel, Bibek Paudel, Chris Newell, and Abraham Bernstein. 2015. Blockbusters and wallflowers: Speeding up diverse and accurate recommendations with random walks. In 9th ACM Conference on Recommender Systems RecSys 2015, Jennifer Golbeck and Giovanni Semeraro (Eds.). ACM Press, New York, NY.
[13]
Colin Cooper, Sang Hyuk Lee, Tomasz Radzik, and Yiannis Siantos. 2014. Random walks in recommender systems: Exact computation and simulations. In Proceedings of the Companion Publication of the 23rd International Conference on World Wide Web Companion. International World Wide Web Conferences Steering Committee, 811--816.
[14]
Paolo Cremonesi, Franca Garzotto, Sara Negro, Alessandro Vittorio Papadopoulos, and Roberto Turrin. 2011. Looking for “good” recommendations: A comparative evaluation of recommender systems. In INTERACT 2011. Springer, 152--168.
[15]
Daniel Fleder and Kartik Hosanagar. 2009. Blockbuster culture’s next rise or fall: The impact of recommender systems on sales diversity. Management Science 55, 5 (2009), 697--712.
[16]
Daniel M. Fleder and Kartik Hosanagar. 2007. Recommender systems and their impact on sales diversity. In Proceedings of the 8th ACM Conference on Electronic Commerce. ACM, 192--199.
[17]
Dániel Fogaras, Balázs Rácz, Károly Csalogány, and Tamás Sarlós. 2005. Towards scaling fully personalized Pagerank: Algorithms, lower bounds, and experiments. Internet Mathematics 2, 3 (2005), 333--358.
[18]
Francois Fouss, Alain Pirotte, and Marco Saerens. 2005. A novel way of computing similarities between nodes of a graph, with application to collaborative recommendation. In Proceedings of the 2005 IEEE/WIC/ACM International Conference on Web Intelligence. IEEE Computer Society, 550--556.
[19]
Zeno Gantner, Steffen Rendle, Christoph Freudenthaler, and Lars Schmidt-Thieme. 2011. MyMediaLite: A free recommender system library. In Proceedings of the 5th ACM Conference on Recommender Systems. ACM, 305--308.
[20]
David Goldberg, David Nichols, Brian M. Oki, and Douglas Terry. 1992. Using collaborative filtering to weave an information tapestry. Communications of the ACM 35, 12 (1992), 61--70.
[21]
Daniel G. Goldstein and Dominique C. Goldstein. 2006. Profiting from the long tail. Harvard Business Review 84, 6 (2006), 24--28.
[22]
Marco Gori, Augusto Pucci, V. Roma, and I. Siena. 2007. ItemRank: A random-walk based scoring algorithm for recommender engines. In IJCAI, Vol. 7. 2766--2771.
[23]
Pankaj Gupta, Ashish Goel, Jimmy Lin, Aneesh Sharma, Dong Wang, and Reza Zadeh. 2013. Wtf: The who to follow service at Twitter. In Proceedings of the 22nd International Conference on World Wide Web. International World Wide Web Conferences Steering Committee, 505--514.
[24]
Taher H. Haveliwala. 2002. Topic-sensitive pagerank. In Proceedings of the 11th International Conference on World Wide Web. ACM, 517--526.
[25]
Jonathan L. Herlocker, Joseph A. Konstan, Al Borchers, and John Riedl. 1999. An algorithmic framework for performing collaborative filtering. In Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 230--237.
[26]
Jonathan L. Herlocker, Joseph A. Konstan, Loren G. Terveen, and John T. Riedl. 2004. Evaluating collaborative filtering recommender systems. ACM Transactions on Information Systems (TOIS) 22, 1 (2004), 5--53.
[27]
Zan Huang, Hsinchun Chen, and Daniel Zeng. 2004. Applying associative retrieval techniques to alleviate the sparsity problem in collaborative filtering. ACM Transactions on Information Systems (TOIS) 22, 1 (2004), 116--142.
[28]
Mohsen Jamali and Martin Ester. 2009. Trustwalker: A random walk model for combining trust-based and item-based recommendation. In Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 397--406.
[29]
Glen Jeh and Jennifer Widom. 2002. SimRank: A measure of structural-context similarity. In Proceedings of the 8th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 538--543.
[30]
Glen Jeh and Jennifer Widom. 2003. Scaling personalized web search. In Proceedings of the 12th International Conference on World Wide Web. ACM, 271--279.
[31]
Yehuda Koren, Robert Bell, and Chris Volinsky. 2009. Matrix factorization techniques for recommender systems. Computer 8 (2009), 30--37.
[32]
Amy N. Langville and Carl D. Meyer. 2006. Updating Markov chains with an eye on Google’s PageRank. SIAM Journal of Matrix Analysis and Applications 27, 4 (2006), 968--987.
[33]
Sangkeun Lee, Sungchan Park, Minsuk Kahng, and Sang-goo Lee. 2012. Pathrank: A novel node ranking measure on a heterogeneous graph for recommender systems. In Proceedings of the 21st ACM International Conference on Information and Knowledge Management. ACM, 1637--1641.
[34]
Grzegorz Malewicz, Matthew H. Austern, Aart J. C. Bik, James C. Dehnert, Ilan Horn, Naty Leiser, and Grzegorz Czajkowski. 2010. Pregel: A system for large-scale graph processing. In Proceedings of the 2010 ACM SIGMOD International Conference on Management of Data (SIGMOD’10). 135--146.
[35]
Sean M. McNee, John Riedl, and Joseph A. Konstan. 2006. Being accurate is not enough: How accuracy metrics have hurt recommender systems. In CHI’06 Extended Abstracts on Human Factors in Computing Systems. ACM, 1097--1101.
[36]
Jakob Nielsen. 1993. Usability Engineering. Morgan Kaufmann Publishers.
[37]
Naoto Ohsaka, Takanori Maehara, and Ken-ichi Kawarabayashi. 2015. Efficient PageRank tracking in evolving networks. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 875--884.
[38]
Lawrence Page, Sergey Brin, Rajeev Motwani, and Terry Winograd. 1999. The PageRank citation ranking: Bringing order to the web. Technical Report. Stanford InfoLab. http://ilpubs.stanford.edu:8090/422/.
[39]
Eli Pariser. 2011. The Filter Bubble: What the Internet is Hiding From You. Penguin.
[40]
Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009. BPR: Bayesian personalized ranking from implicit feedback. In Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence. AUAI Press, 452--461.
[41]
Paul Resnick, Neophytos Iacovou, Mitesh Suchak, Peter Bergstrom, and John Riedl. 1994. GroupLens: An open architecture for collaborative filtering of netnews. In Proceedings of the 1994 ACM Conference on Computer Supported Cooperative Work. ACM, 175--186.
[42]
Ruslan Salakhutdinov and Andriy Mnih. 2008. Bayesian probabilistic matrix factorization using Markov chain Monte Carlo. In Proceedings of the 25th International Conference on Machine Learning. ACM, 880--887.
[43]
Ruslan Salakhutdinov and Andriy Mnih. 2011. Probabilistic matrix factorization. In NIPS, Vol. 20. 1--8.
[44]
Purnamrita Sarkar, Andrew W. Moore, and Amit Prakash. 2008. Fast incremental proximity search in large graphs. In Proceedings of the 25th International Conference on Machine Learning. ACM, 896--903.
[45]
Badrul Sarwar, George Karypis, Joseph Konstan, and John Riedl. 2001. Item-based collaborative filtering recommendation algorithms. In Proceedings of the 10th International Conference on World Wide Web. ACM, 285--295.
[46]
Philip Stutz, Abraham Bernstein, and William Cohen. 2010. Signal/collect: Graph algorithms for the (semantic) web. In Proceedings of the 9th International Semantic Web Conference on the Semantic Web - Volume Part I (ISWC’10). 764--780.
[47]
Philip Stutz, Daniel Strebel, and Abraham Bernstein. 2016. Signal/collect: Processing large graphs in seconds. Semantic Web Journal 7 (2016), 139--166.
[48]
Saúl Vargas and Pablo Castells. 2011. Rank and relevance in novelty and diversity metrics for recommender systems. In Proceedings of the 5th ACM Conference on Recommender Systems. ACM, 109--116.
[49]
Liang Xiang, Quan Yuan, Shiwan Zhao, Li Chen, Xiatian Zhang, Qing Yang, and Jimeng Sun. 2010. Temporal recommendation on graphs via long-and short-term preference fusion. In Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 723--732.
[50]
Hongzhi Yin, Bin Cui, Jing Li, Junjie Yao, and Chen Chen. 2012. Challenging the long tail recommendation. Proceedings of the VLDB Endowment 5, 9 (2012), 896--907.
[51]
Liyan Zhang, Kai Zhang, and Chunping Li. 2008. A topical pagerank based algorithm for recommender systems. In Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 713--714.
[52]
Yuan Cao Zhang, Diarmuid Ó Séaghdha, Daniele Quercia, and Tamas Jambor. 2012. Auralist: Introducing serendipity into music recommendation. In Proceedings of the 5th ACM International Conference on Web Search and Data Mining. ACM, 13--22.
[53]
Peixiang Zhao, Jiawei Han, and Yizhou Sun. 2009. P-rank: A comprehensive structural similarity measure over information networks. In Proceedings of the 18th ACM Conference on Information and Knowledge Management. ACM, 553--562.
[54]
Tao Zhou, Zoltán Kuscsik, Jian-Guo Liu, Matúš Medo, Joseph Rushton Wakeling, and Yi-Cheng Zhang. 2010. Solving the apparent diversity-accuracy dilemma of recommender systems. Proceedings of the National Academy of Sciences 107, 10 (2010), 4511--4515.
[55]
Cai-Nicolas Ziegler, Sean M. McNee, Joseph A. Konstan, and Georg Lausen. 2005. Improving recommendation lists through topic diversification. In Proceedings of the 14th International Conference on World Wide Web. ACM, 22--32.

Cited By

View all
  • (2024)Diverse but Relevant Recommendations with Continuous Ant Colony OptimizationMathematics10.3390/math1216249712:16(2497)Online publication date: 13-Aug-2024
  • (2024)A Novel Evaluation Perspective on GNNs-based Recommender Systems through the Topology of the User-Item GraphProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3688070(549-559)Online publication date: 8-Oct-2024
  • (2023)Broadening the Scope: Evaluating the Potential of Recommender Systems beyond prioritizing AccuracyProceedings of the 17th ACM Conference on Recommender Systems10.1145/3604915.3610649(1139-1145)Online publication date: 14-Sep-2023
  • Show More Cited By

Index Terms

  1. Updatable, Accurate, Diverse, and Scalable Recommendations for Interactive Applications

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Transactions on Interactive Intelligent Systems
        ACM Transactions on Interactive Intelligent Systems  Volume 7, Issue 1
        March 2017
        175 pages
        ISSN:2160-6455
        EISSN:2160-6463
        DOI:10.1145/3028254
        Issue’s Table of Contents
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 19 December 2016
        Accepted: 01 July 2016
        Revised: 01 July 2016
        Received: 01 March 2016
        Published in TIIS Volume 7, Issue 1

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. Recommender systems
        2. bipartite graph
        3. diversity
        4. evolving graphs
        5. item ranking
        6. long-tail
        7. random walks
        8. sampling
        9. top-N recommendation
        10. updating recommendations

        Qualifiers

        • Research-article
        • Research
        • Refereed

        Funding Sources

        • Hasler Foundation

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)90
        • Downloads (Last 6 weeks)6
        Reflects downloads up to 15 Oct 2024

        Other Metrics

        Citations

        Cited By

        View all
        • (2024)Diverse but Relevant Recommendations with Continuous Ant Colony OptimizationMathematics10.3390/math1216249712:16(2497)Online publication date: 13-Aug-2024
        • (2024)A Novel Evaluation Perspective on GNNs-based Recommender Systems through the Topology of the User-Item GraphProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3688070(549-559)Online publication date: 8-Oct-2024
        • (2023)Broadening the Scope: Evaluating the Potential of Recommender Systems beyond prioritizing AccuracyProceedings of the 17th ACM Conference on Recommender Systems10.1145/3604915.3610649(1139-1145)Online publication date: 14-Sep-2023
        • (2023)Challenging the Myth of Graph Collaborative Filtering: a Reasoned and Reproducibility-driven AnalysisProceedings of the 17th ACM Conference on Recommender Systems10.1145/3604915.3609489(350-361)Online publication date: 14-Sep-2023
        • (2023)Bootstrapped Personalized Popularity for Cold Start Recommender SystemsProceedings of the 17th ACM Conference on Recommender Systems10.1145/3604915.3608820(715-722)Online publication date: 14-Sep-2023
        • (2023)It's Enough: Relaxing Diagonal Constraints in Linear Autoencoders for RecommendationProceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3539618.3591704(1639-1648)Online publication date: 19-Jul-2023
        • (2023)Comparison of Real-Time and Batch Job RecommendationsIEEE Access10.1109/ACCESS.2023.324935611(20553-20559)Online publication date: 2023
        • (2023)Auditing Consumer- and Producer-Fairness in Graph Collaborative FilteringAdvances in Information Retrieval10.1007/978-3-031-28244-7_3(33-48)Online publication date: 17-Mar-2023
        • (2022)Offline Evaluation of Recommender Systems in a User Interface With Multiple CarouselsFrontiers in Big Data10.3389/fdata.2022.9100305Online publication date: 9-Jun-2022
        • (2022)United We Stand, Divided We Fall: Leveraging Ensembles of Recommenders to Compete with Budget Constrained ResourcesProceedings of the Recommender Systems Challenge 202210.1145/3556702.3556845(34-38)Online publication date: 18-Sep-2022
        • Show More Cited By

        View Options

        Get Access

        Login options

        Full Access

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media