[go: up one dir, main page]

skip to main content
research-article

An Empirical Analysis of Design Choices in Neighborhood-Based Collaborative Filtering Algorithms

Published: 01 October 2002 Publication History

Abstract

Collaborative filtering systems predict a user's interest in new items based on the recommendations of other people with similar interests. Instead of performing content indexing or content analysis, collaborative filtering systems rely entirely on interest ratings from members of a participating community. Since predictions are based on human ratings, collaborative filtering systems have the potential to provide filtering based on complex attributes, such as quality, taste, or aesthetics. Many implementations of collaborative filtering apply some variation of the neighborhood-based prediction algorithm. Many variations of similarity metrics, weighting approaches, combination measures, and rating normalization have appeared in each implementation. For these parameters and others, there is no consensus as to which choice of technique is most appropriate for what situations, nor how significant an effect on accuracy each parameter has. Consequently, every person implementing a collaborative filtering system must make hard design choices with little guidance. This article provides a set of recommendations to guide design of neighborhood-based prediction systems, based on the results of an empirical study. We apply an analysis framework that divides the neighborhood-based prediction approach into three components and then examines variants of the key parameters in each component. The three components identified are similarity computation, neighbor selection, and rating combination.

References

[1]
Aggarwal CC, Wolf JL, Wu K-L and Yu PS (1999) Horting hatches an Egg: A new graph-theoretic approach to collaborative filtering. In: Proceedings of ACM SIGKDD International Conference on Knowledge Discovery & Data Mining.
[2]
Basu C, Hirsh H, and Cohen WW Rich C and Mostow J Recommendation as classification: Using social and content-based information in recommendation Proceedings of the Fifteenth National Conference on Artificial Intelligence (AAAI-98) 1998 Menlo Park, CA AAAI Press 714-720
[3]
Billsus D and Pazzani MJ Rich C and Mostow J Learning collaborative information filters Proceedings of the Fifteenth National Conference on Artificial Intelligence (AAAI-98) 1998 Menlo Park, CA AAAI Press 46-53
[4]
Breese JS, Heckerman D, and Kadie C Cooper GF and Moral S Empirical analysis of predictive algorithms for collaborative filtering Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence (UAI-98) 1998 San Francisco Morgan Kaufmann 43-52
[5]
Condliff MK, Lewis DD, Madigan D and Posse C (1999) Bayesian mixed-effect models for recommender systems.In: 1999 SIGIR Workshop on Recommender Systems.
[6]
Delgado J and Ishii N (1999) Memory-based weighted majority prediction for recommender systems. In: 1999 SIGIR Workshop on Recommender Systems.
[7]
Goldberg K, Roeder T, Guptra D, and Perkins C Eigentaste:Aconstant-time collaborative filtering algorithm Information Retrieval 2001 4 2 133-151
[8]
Good N, Schafer JB, Konstan JA, Borchers A, Sarwar BM, Herlocker JL, and Riedl J Hendler J and Subramanian D Combining collaborative filtering with personal agents for better recommendations Proceedings of the Sixteenth National Conference on Artificial Intelligence (AAAI-99) 1999 Menlo Park AAAI Press 439-446
[9]
Herlocker JL (2000) Understanding and improving automated collaborative filtering systems. Ph.D. Dissertation.University of Minnesota, 9-30-2000.
[10]
Herlocker JL, Konstan JA, Borchers A, and Riedl J Hearst MA, Gey F, and Tong R An algorithmic framework for performing collaborative filtering Proceedings of the 22nd International Conference on Research and Development in Information Retrieval (SIGIR ‘99) 1999 New York ACM Press 230-237
[11]
Hill W, Stead L, Rosenstein M, and Furnas GW Recommending and evaluating choices in a virtual community of use Proceedings of ACM CHI'95 Conference on Human Factors in Computing Systems 1995 New York ACM Press 194-201
[12]
Hofmann T and Puzicha J (1999) Latent class models for collaborative filtering. In: Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence, pp. 688–693.
[13]
Pennock DM, Horvitz E, and Giles CL Kautz H and Porter B Social choice theory and recommender systems: Analysis of the axiomatic foundations of collaborative filtering Proceedings of the Seventeenth National Conference on Artificial Intelligence (AAAI-2000) 2000 Menlo Park, CA AAAI Press 729-734
[14]
Pennock DM, Horvitz E, Lawrence S, and Giles CL Collaborative filtering by personality diagnosis: A hybrid memory-and model-based approach Proceedings of the Sixteenth Annual Conference on Uncertainty in Artificial Intelligence (UAI-2000) 2000 San Francisco Morgan Kaufmann 473-480
[15]
Press WH, Flannery BP, Teukolsky SA, and Yan T Numerical Recipes: The Art of Scientific Computing 1986 New York, NY Cambridge University Press
[16]
Resnick P, Iacovou N, Suchak M, Bergstrom P, and Riedl J Furuta R and Neuwirth C GroupLens:Anopen architecture for collaborative filtering of netnews Proceedings of the 1994 Conference on Computer Supported Collaborative Work 1994 New York ACM Press 175-186
[17]
Sarwar BM, Karypis G, Konstan JA, and Riedl J Analysis of recommendation algorithms for e-Commerce Proceedings of the 2nd ACM Conference on Electronic Commerce (EC'00) 2000 New York ACM Press 285-295
[18]
Sarwar BM, Karypis G, Konstan JA and Riedl J (2000b) Application of dimensionality reduction in recommender system-A case study. In: ACM WebKDD 2000 Web Mining for E-Commerce Workshop.
[19]
Sarwar BM, Konstan JA, Borchers A, Herlocker JL, Miller BN, and Riedl J Using filtering agents to improve prediction quality in the grouplens research collaborative filtering system Proceedings of the ACM 1998 Conference on Computer Supported Cooperative Work (CSCW ‘98) 1998 New York ACM Press
[20]
Shardanand U and Maes P Social information filtering: Algorithms for automating "word of mouth Proceedings of ACM CHI'95 Conference on Human Factors in Computing Systems 1995 New York ACM 210-217

Cited By

View all
  • (2024)Bringing Equity to Coarse and Fine-Grained Provider Groups in Recommender SystemsProceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization10.1145/3627043.3659552(18-23)Online publication date: 22-Jun-2024
  • (2024)An empirical study on metamorphic testing for recommender systemsInformation and Software Technology10.1016/j.infsof.2024.107410169:COnline publication date: 1-May-2024
  • (2024)Integrating textual reviews into neighbor-based recommender systemsExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.123648249:PBOnline publication date: 1-Sep-2024
  • Show More Cited By

Index Terms

  1. An Empirical Analysis of Design Choices in Neighborhood-Based Collaborative Filtering Algorithms
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image Information Retrieval
        Information Retrieval  Volume 5, Issue 4
        Oct 2002
        87 pages

        Publisher

        Kluwer Academic Publishers

        United States

        Publication History

        Published: 01 October 2002

        Author Tags

        1. collaborative filtering
        2. information filtering
        3. empirical studies
        4. preference prediction

        Qualifiers

        • Research-article

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)0
        • Downloads (Last 6 weeks)0
        Reflects downloads up to 10 Feb 2025

        Other Metrics

        Citations

        Cited By

        View all
        • (2024)Bringing Equity to Coarse and Fine-Grained Provider Groups in Recommender SystemsProceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization10.1145/3627043.3659552(18-23)Online publication date: 22-Jun-2024
        • (2024)An empirical study on metamorphic testing for recommender systemsInformation and Software Technology10.1016/j.infsof.2024.107410169:COnline publication date: 1-May-2024
        • (2024)Integrating textual reviews into neighbor-based recommender systemsExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.123648249:PBOnline publication date: 1-Sep-2024
        • (2024)Modeling users’ heterogeneous taste with diversified attentive user profilesUser Modeling and User-Adapted Interaction10.1007/s11257-023-09376-934:2(375-405)Online publication date: 1-Apr-2024
        • (2024)MOReGIn: Multi-Objective Recommendation at the Global and Individual LevelsAdvances in Information Retrieval10.1007/978-3-031-56027-9_2(21-38)Online publication date: 24-Mar-2024
        • (2023)An anatomization of research paper recommender systemEngineering Applications of Artificial Intelligence10.1016/j.engappai.2022.105641118:COnline publication date: 1-Feb-2023
        • (2023)CrowdAssistJournal of Software: Evolution and Process10.1002/smr.240435:6Online publication date: 1-Jun-2023
        • (2022)Does Utilizing Online Social Relations Improve the Diversity of Personalized Recommendations?International Journal of Strategic Decision Sciences10.4018/IJSDS.30154713:1(1-15)Online publication date: 29-Jun-2022
        • (2022)What Questions Are You Inclined to Answer? Effects of Hierarchy in Corporate Q&A CommunitiesInformation Systems Research10.1287/isre.2021.105233:1(244-264)Online publication date: 1-Mar-2022
        • (2022)A Personalized Recommendation Method for Ancient Chinese Literary Works Based on a Collaborative Filtering AlgorithmMobile Information Systems10.1155/2022/44606282022Online publication date: 1-Jan-2022
        • Show More Cited By

        View Options

        View options

        Figures

        Tables

        Media

        Share

        Share

        Share this Publication link

        Share on social media