Abstract
While the recent emergence of a large number of online course resources has made life more convenient for many people, it has also caused information overload. According to a user’s situation and behavior, course recommendation systems can recommend courses of interest to the user, so that the user can quickly sift through a massive amount of information to find courses that meet his or her needs. This paper provide a systematic review of deep learning-based recommendation systems in e-learning environments. Firstly, the concept of recommendation systems is introduced in e-learning environments, and present a comprehensive survey and classification of deep learning techniques for course recommendation. And then, a detailed analysis of existing recommendation system is conducted based on the collected literature, and an overall course recommendation system framework is presented. Subsequently, this artical main focus is on multilayer perceptual machines, recurrent neural networks, convolutional neural networks, neural attention mechanisms, and deep reinforcement learning-based recommendation, and summarize the existing research on the use of the five techniques mentioned above in e-learning environments. The last section discusses seven flaws in the current recommendation systems used in e-learning environments and identify opportunities for future research.









Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Abdessamad C, Faddouli NEE (2018) Deep learning for a smart e-learning system. In: International conference on smart digital environment (ICSDE’18)
Adomavicius G, Tuzhilin A (2005) Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions. IEEE Comput Archit Lett 17(6):734–749
Agrebi M, Sendi M, Abed M (2019) Deep reinforcement learning for personalized recommendation of distance learning. In: World conference on information systems and technologies (WorldCist’19)
Aher SB, Lobo LMRJ (2013) Combination of machine learning algorithms for recommendation of courses in e-learning system based on historical data. Knowl Based Syst 51(oct):1–14
Anandakumar DK, Rathipriya K, Bharathi DA (2014a) A survey on methodologies for personalized e-learning recommender systems. Int J Innov Res Comput Commun Eng 2(6):4738–4743
Anandakumar K, Rathipriya K, Bharathi A (2014b) A survey on methodologies for personalized e-learning recommender systems. Int J Innov Res Comput Commun Eng 2(6):4738–4743
Aïmeur E, Brassard G, Fernandez JM, Onana FSM (2008) A lambic : a privacy-preserving recommender system for electronic commerce. Int J Inf Secur 7(5):307–334
Batmaz Z, Yurekli A, Bilge A, Kaleli C (2019) A review on deep learning for recommender systems: challenges and remedies. Artif Intell Rev 52(1):1–37
Bhanuse R, Mal S (2021) A systematic review: deep learning based e-learning recommendation system. In: 2021 international conference on artificial intelligence and smart systems (ICAIS), IEEE, pp 190–197
Burke R (2002) Hybrid recommender systems: survey and experiments. User Model User Adapt Interact 12(4):331–370
Cheng HT, Koc L, Harmsen J, Shaked T, Chandra T, Aradhye H, Anderson G, Corrado G, Chai W, Ispir M, Anil R, Haque Z, Hong L, Jain V, Liu X, Shah H (2016) Wide & deep learning for recommender systems. In: Proceedings of the 1st workshop on deep learning for recommender systems, pp 7–10
Choi S, Ha H, Hwang U, Kim C, Ha JW, Yoon S (2018) Reinforcement learning based recommender system using biclustering technique. arXiv preprint arXiv:180105532
Chung J, Gülçehre Ç, Cho K, Bengio Y (2014) Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:14123555
Conneau A, Schwenk H, Barrault L, Lecun Y (2017) Very deep convolutional networks for text classification. In: Proceedings of the 15th conference of the european chapter of the association for computational linguistics: Volume 1, Long Papers, vol 1, pp 1107–1116
Cosley D, Lam SK, Albert I, Konstan JA, Riedl J (2003) Is seeing believing?: how recommender system interfaces affect users’ opinions. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 585–592
Da’u A, Salim N (2020) Recommendation system based on deep learning methods: a systematic review and new directions. Artif Intell Rev 53(4):2709–2748
Del Rio S, Benítez JM, Herrera F (2015) Analysis of data preprocessing increasing the oversampling ratio for extremely imbalanced big data classification. In: 2015 IEEE Trustcom/BigDataSE/ISPA, IEEE, vol 2, pp 180–185
Elkahky AM, Song Y, He X (2015) A multi-view deep learning approach for cross domain user modeling in recommendation systems. In: Proceedings of the 24th international conference on world wide web, pp 278–288
Fernández-Tobías I, Cantador I, Kaminskas M, Ricci F (2012) Cross-domain recommender systems: a survey of the state of the art. In: Spanish conference on information retrieval, sn, pp 1–12
Goodfellow I, Bengio Y, Courville A, Bengio Y (2016) Deep learning, vol 1. MIT Press, Cambridge
Graves A (2012) Supervised sequence labelling with recurrent neural networks. Stud Comput Intell 385
Guo G, Ouyang S, He X, Yuan F, Liu X (2019) Dynamic item block and prediction enhancing block for sequential recommendation. In: Proceedings of the twenty-eighth international joint conference on artificial intelligence, IJCAI-19, international joint conferences on artificial intelligence organization, pp 1373–1379, https://doi.org/10.24963/ijcai.2019/190
Hao X, Zhang G, Ma S (2016) Deep learning. Int J Semant Comput 10(03):417–439
He X, Liao L, Zhang H, Nie L, Hu X, Chua TS (2017) Neural collaborative filtering. In: Proceedings of the 26th international conference on world wide web, pp 173–182
He X, He Z, Song J, Liu Z, Jiang YG, Chua TS (2018) Nais: neural attentive item similarity model for recommendation. IEEE Trans Knowl Data Eng 30(12):2354–2366
Hernández-Blanco A, Herrera-Flores B, Tomás D, Navarro-Colorado B (2019) A systematic review of deep learning approaches to educational data mining. Complexity 2019
Hidasi B, Karatzoglou A, Baltrunas L, Tikk D (2015) Session-based recommendations with recurrent neural networks. arXiv preprint arXiv:151106939
Hochreiter S (1991) Untersuchungen zu dynamischen neuronalen Netzen [in German] Diploma Thesis. TU Münich
Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput. 9(8):1735–1780
Hornik K, Stinchcombe M, White H (1989) Multilayer feedforward networks are universal approximators. Neural Netw 2(5):359–366
Huang L, Jiang B, Lv S, Liu Y, Li D (2018) Survey on deep learning based recommender systems. Chin J Comput 41(7):1619–1647
Jannach D, Zanker M, Felfernig A, Friedrich G (2010) Recommender systems: an introduction. Cambridge University Press, Cambridge
Joachims T, Granka L, Pan B, Hembrooke H, Gay G (2017) Accurately interpreting clickthrough data as implicit feedback. In: ACM SIGIR Forum, Acm New York, NY, USA 51:4–11
Kabbur S, Ning X, Karypis G (2013) Fism: factored item similarity models for top-n recommender systems. In: Proceedings of the 19th ACM SIGKDD international conference on knowledge discovery and data mining, pp 659–667
Kang Y (2014) An analysis on spoc: post-mooc era of online education. Tsinghua J Educ 35(1):85–93
Khan A, Sohail A, Zahoora U, Qureshi AS (2020) A survey of the recent architectures of deep convolutional neural networks. Artif Intell Rev 53(8):5455–5516
Khan MM, Ibrahim R, Ghani I (2017) Cross domain recommender systems: a systematic literature review. ACM Comput Surv (CSUR) 50(3):1–34
Khanal SS, Prasad PWC, Alsadoon A, Maag A (2019) A systematic review: machine learning based recommendation systems for e-learning. Educ Inf Technol 1–30
Klašnja-Milićević A, Ivanović M, Nanopoulos A (2015) Recommender systems in e-learning environments: a survey of the state-of-the-art and possible extensions. Artif Intell Rev 44(4):571–604
LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324
Lika B, Kolomvatsos K, Hadjiefthymiades S (2014) Facing the cold start problem in recommender systems. Expert Syst Appl 41(4):2065–2073
Ling G, Lyu MR, King I (2014) Ratings meet reviews, a combined approach to recommend. In: Proceedings of the 8th ACM conference on recommender systems, pp 105–112
Liu J, Zhang H, Liu Z (2020) Research on online learning resource recommendation method based on wide & deep and elmo model. In: Journal of physics: conference series. IOP Publishing, vol 1437, p 012015
Luong MT, Pham H, Manning CD (2015) Effective approaches to attention-based neural machine translation. arXiv preprint arXiv:150804025
McAuley J, Leskovec J (2013) Hidden factors and hidden topics: understanding rating dimensions with review text. In: Proceedings of the 7th ACM conference on recommender systems, pp 165–172
Mnih V, Kavukcuoglu K, Silver D, Graves A, Antonoglou I, Wierstra D, Riedmiller M (2013) Playing atari with deep reinforcement learning. arXiv preprint arXiv:13125602
Mrhar K, Abik M (2019) Toward a deep recommender system for moocs platforms. In: Proceedings of the 2019 3rd international conference on advances in artificial intelligence, pp 173–177
Munemasa I, Tomomatsu Y, Hayashi K, Takagi T (2018) Deep reinforcement learning for recommender systems. In: 2018 International conference on information and communications technology (icoiact), IEEE, pp 226–233
Ouyang W, Zhang X, Zhao L, Luo J, Zhang Y, Zou H, Liu Z, Du Y (2020) Minet: mixed interest network for cross-domain click-through rate prediction. In: Proceedings of the 29th ACM international conference on information & knowledge management, pp 2669–2676
Pan L, Wang X, Li C, Li J, Tang J (2017) Course concept extraction in moocs via embedding-based graph propagation. In: Proceedings of the eighth international joint conference on natural language processing (Volume 1: Long Papers), pp 875–884
Pan W, Xiang E, Liu N, Yang Q (2010) Transfer learning in collaborative filtering for sparsity reduction. In: Proceedings of the AAAI conference on artificial intelligence, vol 24
Pazzani MJ, Billsus D (2007) Content-based recommendation systems. The adaptive web. Springer, New York, pp 325–341
Premalatha M, Viswanathan V, Suganya G, Kaviya M, Vijaya A (2018) Educational data mining and recommender systems survey. Int J Web Portals (IJWP) 10(1):39–53
Qi Y, Wu Q, Wang H, Tang J, Sun M (2018) Bandit learning with implicit feedback. In: Proceedings of the 32nd international conference on neural information processing systems, pp 7287–7297
Rehman F, Khalid O, Madani SA (2017) A comparative study of location-based recommendation systems. Knowl Eng Rev 32:e7
Roy S, Madhyastha M, Lawrence S, Rajan V (2019) Inferring concept prerequisite relations from online educational resources. In: Proceedings of the AAAI conference on artificial intelligence 33:9589–9594
Sakboonyarat S, Tantatsanawong P (2019) Massive open online courses (moocs) recommendation modeling using deep learning. In: 2019 23rd International computer science and engineering conference (ICSEC)
Sarwar S, Qayyum ZU, García-Castro R, Safyan M, Munir RF (2019) Ontology based e-learning framework: a personalized, adaptive and context aware model. Multimed Tools Appl 78(24):34745–34771
Schein AI, Popescul A, Ungar LH, Pennock DM (2002) Methods and metrics for cold-start recommendations. In: Proceedings of the 25th annual international ACM SIGIR conference on research and development in information retrieval, pp 253–260
Seo S, Huang J, Yang H, Liu Y (2017a) Interpretable convolutional neural networks with dual local and global attention for review rating prediction. In: Proceedings of the eleventh ACM conference on recommender systems, pp 297–305
Seo S, Huang J, Yang H, Liu Y (2017b) Interpretable convolutional neural networks with dual local and global attention for review rating prediction. In: the Eleventh ACM conference, pp 297–305
Shah D (2019) Year of mooc-based degrees: a review of mooc stats and trends in 2018. Class Central
Shen X, Yi B, Zhang Z, Shu J, Liu H (2016) Automatic recommendation technology for learning resources with convolutional neural network. In: 2016 international symposium on educational technology (ISET), IEEE, pp 30–34
Shu J, Shen X, Hai L, Yi B, Zhang Z (2017) A content-based recommendation algorithm for learning resources. Multimed Syst 1:1–11
Shyong K, Frankowski D, Riedl J, et al. (2006) Do you trust your recommendations? an exploration of security and privacy issues in recommender systems. In: International conference on emerging trends in information and communication security. Springer, pp 14–29
Silva N, Carvalho D, Pereira AC, Mourão F, Rocha L (2019) The pure cold-start problem: a deep study about how to conquer first-time users in recommendations domains. Inf Syst 80:1–12
Socher R, Bengio Y, Manning CD (2012) Deep learning for nlp (without magic). Tutor Abstr ACL 2012:5–5
Tan C, Han R, Ye R, Chen K (2020) Adaptive learning recommendation strategy based on deep q-learning. Appl Psychol Meas 44(4):251–266
Tan J, Chang L, Liu T, Zhao X (2020b) Attentional autoencoder for course recommendation in mooc with course relevance. In: 2020 international conference on cyber-enabled distributed computing and knowledge discovery (CyberC), IEEE, pp 190–196
Tay Y, Luu AT, Hui SC (2018) Multi-pointer co-attention networks for recommendation. In: Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, pp 2309–2318
Van Hasselt H, Guez A, Silver D (2016) Deep reinforcement learning with double q-learning. In: Proceedings of the AAAI conference on artificial intelligence, vol 30
Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser L, Polosukhin I (2017) Attention is all you need. arXiv preprint arXiv:170603762
Volkovs M, Yu GW, Poutanen T (2017) Dropoutnet: addressing cold start in recommender systems. In: NIPS, pp 4957–4966
Wang X, Wang Y, Hsu D, Wang Y (2014) Exploration in interactive personalized music recommendation: a reinforcement learning approach. ACM Trans Multimed Comput Commun Appl (TOMM) 11(1):1–22
Wang X, Zhang Y, Yu S, Liu X, Yuan Y, Wang FY (2017) E-learning recommendation framework based on deep learning. In: 2017 IEEE international conference on systems, man, and cybernetics (SMC), IEEE, pp 455–460
Wen M, Rosé CP (2014) Identifying latent study habits by mining learner behavior patterns in massive open online courses. In: Proceedings of the 23rd ACM international conference on conference on information and knowledge management, pp 1983–1986
Werbos PJ (1990) Backpropagation through time: what it does and how to do it. Proc IEEE 78(10):1550–1560
West DM (2012) Big data for education: data mining, data analytics, and web dashboards. Gov Stud Brook 4(1):1–10
Wongchokprasitti C, Peltonen J, Ruotsalo T, Bandyopadhyay P, Jacucci G, Brusilovsky P (2015) User model in a box: cross-system user model transfer for resolving cold start problems. In: International conference on user modeling, adaptation, and personalization. Springer, pp 289–301
Xiao J, Ye H, He X, Zhang H, Wu F, Chua TS (2017) Attentional factorization machines: Learning the weight of feature interactions via attention networks. arXiv preprint arXiv:170804617
Xu W, Zhou Y (2020) Course video recommendation with multimodal information in online learning platforms: a deep learning framework. Br J Educ Technol 51(5):1734–1747
Yu J, Wang C, Luo G, Hou L, Li J, Tang J, Liu Z (2019) Course concept expansion in moocs with external knowledge and interactive game. arXiv preprint arXiv:190907739
Yu J, Luo G, Xiao T, Zhong Q, Wang Y, Luo J, Wang C, Hou L, Li J, Liu Z, et al. (2020) Mooccube: a large-scale data repository for nlp applications in moocs. In: Proceedings of the 58th annual meeting of the association for computational linguistics, pp 3135–3142
Zhang H, Huang T, Lv Z, Liu SY, Zhou Z (2018) Mcrs: a course recommendation system for moocs. Multimed Tools Appl 77(6):7051–7069
Zhang H, Huang T, Lv Z, Liu S, Yang H (2019a) Moocrc: a highly accurate resource recommendation model for use in mooc environments. Mob Netw Appl 24(1):34–46
Zhang J, Hao B, Chen B, Li C, Chen H, Sun J (2019b) Hierarchical reinforcement learning for course recommendation in moocs. Proc AAAI Conf Artif Intell 33:435–442
Zhang M, Liu S, Wang Y (2020) Str-sa: session-based thread recommendation for online course forum with self-attention. In: 2020 IEEE global engineering education conference (EDUCON), IEEE, pp 374–381
Zhang S, Yao L, Sun A, Tay Y (2019c) Deep learning based recommender system: a survey and new perspectives. ACM Comput Surv (CSUR) 52(1):1–38
Zhang T, Zhao P, Liu Y, Sheng VS, Xu J, Wang D, Liu G, Zhou X (2019d) Feature-level deeper self-attention network for sequential recommendation. In: IJCAI, pp 4320–4326
Zhang X, Zhao J, LeCun Y (2015) Character-level convolutional networks for text classification. arXiv preprint arXiv:150901626
Zhang ZK, Liu C, Zhang YC, Zhou T (2010) Solving the cold-start problem in recommender systems with social tags. EPL (Europhys Lett) 92(2):28002
Zheng L, Noroozi V, Yu PS (2017) Joint deep modeling of users and items using reviews for recommendation. In: Proceedings of the tenth ACM international conference on web search and data mining, pp 425–434
Zhong L, Wei Y, Yao H, Deng W, Wang Z, Tong M (2020) Review of deep learning-based personalized learning recommendation. In: Proceedings of the 2020 11th International conference on E-education, E-business, E-management, and E-learning, pp 145–149
Zhou Y, Huang C, Hu Q, Zhu J, Tang Y (2018) Personalized learning full-path recommendation model based on lstm neural networks. Inf Sci 444:135–152
Zhu Y, Li H, Liao Y, Wang B, Guan Z, Liu H, Cai D (2017) What to do next: modeling user behaviors by time-lstm. IJCAI 17:3602–3608
Acknowledgements
This work was supported by the Natural Science Foundation of China (Nos. U1811264, U1711263, 61966009), the Natural Science Foundation of Guangxi Province (Nos. 2018GXNSFDA281045, 2018GXNSFAA138090,2019GXNSFBA245049, 2019GXNSFBA245059), Guangxi Key Laboratory of Trusted Software (No. KX202058) and the Innovation Project of Guang Xi Graduate Education (No.YCBZ2021072).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Liu, T., Wu, Q., Chang, L. et al. A review of deep learning-based recommender system in e-learning environments. Artif Intell Rev 55, 5953–5980 (2022). https://doi.org/10.1007/s10462-022-10135-2
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10462-022-10135-2