Abstract
Despite the omnipresent use of recommender systems in electronic markets, previous research has not analyzed how consumer preferences affect the accuracy of recommender systems. Markets, however, are characterized by a certain structure of consumers’ preferences. Consequently, it is not known in which markets recommender systems perform well. In this paper, we introduce a microeconomic model that allows a systematical analysis of different structures of consumers’ preferences. We develop a model-specific metric to measure the recommendation accuracy. We employ our model in a simulation to evaluate the impact of the structure of the consumers’ preferences on the accuracy of a popular collaborative filtering algorithm. Our study shows that recommendation accuracy is significantly affected by the similarity and number of consumer types and the distribution of consumers. The investigation reveals that in certain markets even random product recommendations outperform the collaborative filtering algorithm.
Similar content being viewed by others
Notes
For example, the MovieLens data set is often used for evaluation (Herlocker et al. 2004).
If the most preferred product is positioned at the edge of the differentiation spectrum, the preference spectrum would be smaller. For example, c u = 0.1 would lead to a length of the preference spectrum of 0.35.
The minor gap to an efficiency of 100 % (perfect recommendations) is caused by the random bootstrapping.
References
Adomavicius, G., & Tuzhilin, A. (2005). Toward the Next Generation of Recommender Systems: A Survey of the State-of-the-Art and Possible Extensions. IEEE Transactions on Knowledge and Data Engineering, 17(6), 734–749. doi:10.1109/TKDE.2005.99 .
Adomavicius, G., Bockstedt, J., Curley, S., & Zhang, J. (2011). Recommender Systems, Consumer Preferences, and Anchoring Effects. In Proceedings of the RecSys 2011 Workshop on Human Decision Making in Recommender Systems (pp. 35–42).
Anderson, C. (2006). The long tail: why the future of business is selling less of more (1st ed.). New York: Hyperion.
Bennett, J., & Lanning, S. (2007). The Netflix Prize. In Proceedings of KDD Cup and Workshop (pp. 3–6).
Bergemann, D., & Ozmen, D. (2006). Optimal Pricing with Recommender Systems. In: EC ‘06, Proceedings of the 7th ACM Conference on Electronic Commerce (pp. 43–51). New York: ACM. doi:10.1145/1134707.1134713 .
Davidson, J., Liebald, B., Liu, J., Nandy, P., & van Vleet, T. (2010). The YouTube Video Recommendation System. In X. Amatriain, M. Torrens, P. Resnick, & M. Zanker (Eds.), Proceedings of the Fourth ACM Conference on Recommender Systems (pp. 293–296). doi:10.1145/1864708.1864770 .
Desrosiers, C., & Karypis, G. (2011). A Comprehensive Survey of Neighborhood-based Recommendation Methods. In F. Ricci, L. Rokach, B. Shapira, & P. B. Kantor (Eds.), Recommender Systems Handbook (pp. 107–144). Springer. doi:10.1007/978-0-387-85820-3_4 .
Ekstrand, M. D. (2010). Collaborative Filtering Recommender Systems. FNT in Human–Computer Interaction (Foundations and Trends in Human–Computer Interaction), 4(2), 81–173. doi:10.1561/1100000009 .
Felfernig, A., Friedrich, G., & Schmidt-Thieme, L. (2007). Recommender Systems. IEEE Intelligent Systems, 22, 18–21. doi:10.1109/MIS.2007.52.
Fleder, D., & Hosanagar, K. (2007). Recommender Systems and Their Impact on Sales Diversity. In: EC ‘07, Proceedings of the 8th ACM Conference on Electronic Commerce (pp. 192–199). New York: ACM. doi:10.1145/1250910.1250939 .
Gemmis, M. D., Iaquinta, L., Lops, P., Musto, C., Narducci, F., & Semeraro, G. (2011). Learning Preference Models in Recommender Systems. In J. Fürnkranz & E. Hüllermeier (Eds.), Preference Learning (1st ed., pp. 387–407). s.l.: Springer-Verlag. doi:10.1007/978-3-642-14125-6_18 .
Herlocker, J. L., Konstan, J. A., Borchers, A., & Riedl, J. (1999). An Algorithmic Framework for Performing Collaborative Filtering. In: SIGIR ‘99, Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 230–237). New York: ACM. doi:10.1145/312624.312682.
Herlocker, J. L., Konstan, J. A., Terveen, L. G., & Riedl, J. T. (2004). Evaluating Collaborative Filtering Recommender Systems. ACM Transactions on Information Systems (TOIS), 22(1), 5–53. doi:10.1145/963770.963772 .
Hervas-Drane, A. (2015). Recommended For You: The Effect of Word of Mouth on Sales Concentration. International Journal of Research in Marketing, 32(2), 207–218. doi:10.1016/j.ijresmar.2015.02.005 .
Hinz, O., & Eckert, J. (2010). The Impact of Search and Recommendation Systems on Sales in Electronic Commerce. BISE (Business & Information Systems Engineering), 2(2), 67–77. doi:10.1007/s12599-010-0092-x .
Hotelling, H. (1929). Stability in Competition. The Economic Journal, 39(153), 41–57.
Jannach, D., Zanker, M., Felfernig, A., & Friedrich, G. (2011). Recommender systems: an introduction. Cambridge: Cambridge University Press.
Jawaheer, G., Weller, P., & Kostkova, P. (2014). Modeling User Preferences in Recommender Systems: A Classification Framework for Explicit and Implicit User Feedback. ACM Transactions on Interactive Intelligent Systems, 4(2), 1–26. doi:10.1145/2512208 .
Karatzoglou, A., & Weimer, M. (2011). Collaborative Preference Learning. In J. Fürnkranz & E. Hüllermeier (Eds.), Preference Learning (1st ed., pp. 409–427). s.l.: Springer-Verlag. doi:10.1007/978-3-642-14125-6_ 19.
Levin, A. M., Levin, I. P., & Heath, C. E. (2003). Product Category Dependent Consumer Preferences for Online and Offline Shopping Features and Their Influence on Multi-Channel Retail Alliances. Journal of Electronic Commerce Research, 4(3), 85–93.
Linden, G., Smith, B., & York, J. (2003). Amazon.com Recommendations: Item-to-Item Collaborative Filtering. IEEE Internet Computing, 7(1), 76–80. doi:10.1109/MIC.2003.1167344 .
Lops, P., Gemmis, M. d., & Semeraro, G. (2011). Content-based Recommender Systems: State of the Art and Trends. In F. Ricci, L. Rokach, B. Shapira, & P. B. Kantor (Eds.), Recommender Systems Handbook (pp. 73–105). Springer.
Miller, B. N., Albert, I., Lam, S. K., Konstan, J. A., & Riedl, J. (2003). MovieLens Unplugged: Experiences with an Occasionally Connected Recommender System. In D. Leake, L. Johnson, & E. Andre (Eds.), Proceedings of the 8th International Conference on Intelligent User Interfaces (pp. 263–266). doi:10.1145/604045.604094 .
Pfeiffer, J., & Scholz, M. (2013). A Low-Effort Recommendation System with High Accuracy. BISE (Business & Information Systems Engineering), 5(6), 397–408. doi:10.1007/s12599-013-0295-z .
Rashid, A. M., Albert, I., Cosley, D., Lam, S. K., McNee, S. M., Konstan, J. A., & Riedl, J. (2002). Getting to Know You: Learning New User Preferences in Recommender Systems. In: IUI ‘02, Proceedings of the 7th International Conference on Intelligent User Interfaces (pp. 127–134). New York, NY, USA: ACM. doi:10.1145/502716.502737 .
Resnick, P., & Varian, H. R. (1997). Recommender Systems. Communications of the ACM, 40(3), 56–58. doi:10.1145/245108.245121.
Ricci, F., Rokach, L., & Shapira, B. (2011). Introduction to Recommender Systems Handbook. In F. Ricci, L. Rokach, B. Shapira, & P. B. Kantor (Eds.), Recommender Systems Handbook (pp. 1–35). Springer.
Sarwar, B., Karypis, G., Konstan, J., & Riedl, J. (2001). Item-based Collaborative Filtering Recommendation Algorithms. In: WWW ‘01, Proceedings of the 10th International Conference on World Wide Web (pp. 285–295). New York: ACM. doi:10.1145/371920.372071.
Schafer, J. B., Konstan, J., & Riedl, J. (1999). Recommender Systems in E-Commerce. In: EC ‘99, Proceedings of the 1st ACM Conference on Electronic Commerce (pp. 158–166). New York: ACM. doi:10.1145/336992.337035 .
Scholz, M., Dorner, V., Franz, M., & Hinz, O. (2015). Measuring consumers’ willingness to pay with utility-based recommendation systems. Decision Support Systems, 72, 60–71. doi:10.1016/j.dss.2015.02.006 .
Su, X., & Khoshgoftaar, T. M. (2009). A Survey of Collaborative Filtering Techniques. Advances in Artificial Intelligence., 4. doi:10.1155/2009/421,425 .
Tirole, J. (1988). The theory of industrial organization. Cambridge: MIT Press.
Wedel, M., & Kamakura, W. A. (2000). Market Segmentation: Conceptual and Methodological Foundations (2nd ed.). International series in quantitative marketing: Vol. 7. Boston: Kluwer Academic.
Wu, L.-L., Joung, Y.-J., & Chiang, T.-E. (2011). Recommendation Systems and Sales Concentration: The Moderating Effects of Consumers’ Product Awareness and Acceptance to Recommendations. In: HICSS ‘11, Proceedings of the 2011 44th Hawaii International Conference on System Sciences (pp. 1–10). Washington, DC: IEEE Computer Society. doi:10.1109/HICSS.2011.357 .
Zhou, T., Kuscsik, Z., Liu, J.-G., Medo, M., Wakeling, J. R., & Zhang, Y.-C. (2010). Solving the Apparent Diversity-Accuracy Dilemma of Recommender Systems. Proceedings of the National Academy of Sciences, 107(10), 4511–4515. doi:10.1073/pnas.1000488107 .
Author information
Authors and Affiliations
Corresponding author
Additional information
Responsible Editor: Rainer Alt
Rights and permissions
About this article
Cite this article
Köhler, S., Wöhner, T. & Peters, R. The impact of consumer preferences on the accuracy of collaborative filtering recommender systems. Electron Markets 26, 369–379 (2016). https://doi.org/10.1007/s12525-016-0232-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12525-016-0232-3