Efficient Course Recommendation using Deep Transformer based Ensembled Attention Model

A Madhavi; A Nagesh; A Govardhan

doi:10.4108/eetel.4470

Authors

A Madhavi VNR Vignana Jyothi of Engineering and Technology
A Nagesh Mahatma Gandhi Institute of Technology
A Govardhan Jawaharlal Nehru Technological University, Hyderabad

DOI:

https://doi.org/10.4108/eetel.4470

Keywords:

Course Recommendation, BERT, MLM, Transformers, Deep Transformer based Ensembled Attention Model, DTEAM

Abstract

The exponential development of online learning resources has led to an information overload problem. Therefore, recommender systems play a crucial role in E-learning to provide learners with personalised course recommendations by automatically identifying their preferences. In addition, e-Learning platforms such as MOOCs and LMS have been criticised for their low course completion rates, and one of the primary reasons is that they do not provide personalised course recommendations for users with varying interests. Rapidly locating the courses that users are interested in on enormous e-Learning platforms can have a significant impact on the quality of learning and the dissemination of knowledge to the learner. This paper examines the most prevalent recommendation techniques utilised in E-learning. We examined how to apply Deep Transformer based Ensembled Attention Model (DTEAM) on e-Learning system in order to achieve personalized course recommendations. The proposed recommendation model uses BERT as its foundation integrated MLM and Transformers. Predicted course recommendations are more aligned with the interests of users. Our experimental results proved that traditional recommendation algorithms, such as collaborative filtering and item-based filtering are incapable of producing superior results. The consequence of the research can assist students in selecting courses according to their preferences and improve their learning caliber

References

Alhijawi, B., & Kilani, Y. (2016). Using genetic algorithms for measuring the similarity values between users in collaborative filtering recommender systems. Proceedings of the IEEE/ACIS 15th international conference on computer and information science (ICIS). IEEEhttps://doi.org/10.1109/icis.2016.7550751.

Alhijawi, B., & Kilani, Y. (2020). The recommender system: A survey. International Journal of Advanced Intelligence Paradigms, 15(3), 229–251. https://doi.org/10. 1504/IJAIP.2020.105815.

Chen, L., Chen, G., & Wang, F. (2015). Recommender systems based on user reviews: the state of the art. User Modeling and User-Adapted Interaction, 25(2), 99–154. https://doi.org/10.1007/s11257-015-9155-5.

Ricci, F., Rokach, L., & Shapira, B. (2011). Introduction to recommender systems handbook. Recommender systems handbook. Springer1–35.

Sharma, L., & Gera, A. (2013). A survey of recommendation system: Research challenges. International Journal of Engineering Trends and Technology (IJETT), 4(5), 1989–1992

Bobadilla, J., Ortega, F., Hernando, A., & Gutiérrez, A. (2013). Recommender systems survey. Knowledge-Based Systems, 46, 109–132. https://doi.org/10.1016/j. knosys.2013.03.012.

Alhijawi, B., Obeid, N., Awajan, A., & Tedmori, S. (2018). Improving collaborative filtering recommender systems using semantic information. Proceedings of the 9th international conference on information and communication systems (ICICS). IEEEhttps://doi.org/10.1109/iacs.2018.8355454.

Chen, L., Chen, G., & Wang, F. (2015). Recommender systems based on user reviews: the state of the art. User Modeling and User-Adapted Interaction, 25(2), 99–154. https://doi.org/10.1007/s11257-015-9155-5

Alhijawi, B. (2019a). Improving collaborative filtering recommender system results and performance using satisfaction degree and emotions of users. Web Intelligence, 17(3), 229241. https://doi.org/10.3233/WEB-190415.

Bobadilla, J., Ortega, F., Hernando, A., & Gutiérrez, A. (2013). Recommender systems survey. Knowledge-Based Systems, 46, 109–132. https://doi.org/10.1016/j. knosys.2013.03.012.

Alhijawi, B. (2019b). Improving collaborative filtering recommender system results using optimization technique. Proceedings of the 3rd international conference on advances in artificial intelligence. ACMhttps://doi.org/10.1145/3369114.3369126.

Gao, L., & Li, C. (2008). Hybrid personalized recommended model based on genetic algorithm. Proceedings of the 4th International conference on wireless communications, networking and mobile computing. IEEEhttps://doi.org/10.1109/wicom.2008.2152.

Ho, Y., Fong, S., & Yan, Z. (2007). A hybrid ga-based collaborative filtering model for online recommenders.,. (pp. 200–203)

H. Zhang, T. Huang, Z. Lv, S. Liu, Z. Zhou, MCRS: A course recommendation system for MOOCs, Multimedia Tools Appl. 77 (6) (2018) 7051–7069.

P. Chang, C. Lin, M. Chen, A hybrid course recommendation system by integrating collaborative filtering and artificial immune systems, Algorithms 9 (3) (2016) 47.

M.E. Ibrahim, Y. Yang, D. Ndzi, Using ontology for personalised course recommendation applications, in: Proceedings of the 17th International Conference on Computational Science and Its Applications, 2017, pp. 426–438.

F. Bousbahi, H. Chorfi, MOOC-Rec: A case based recommender system for MOOCs, Procedia Social Behav. Sci. 195 (3) (2015) 1813–1822.

X. Jing, J. Tang, Guess you like: course recommendation in moocs, in: Proceedings of the International Conference on Web Intelligence, 2017, pp. 783–789

X. Zhou, S. Wu, Rating LDA model for collaborative filtering, Knowl.-Based Syst. 110 (2016) 135–143.

S. Kabbur, X. Ning, G. Karypis, FISM: factored item similarity models for top-N recommender systems, in: Proc. ACM SIGKDD Conf., 2013, pp. 659–667.

X. He, Z. He, J. Song, Z. Liu, Y.-G. Jiang, T.-S. Chua, NAIS: Neural attentive item similarity model for recommendation, IEEE Trans. Knowl. Data Eng. 30 (12) (2018) 2354–2366.

X. Li, X. Li, J. Tang, T. Wang, Y. Zhang, H. Chen, Improving deep itembased collaborative filtering with Bayesian personalized ranking for MOOC course recommendation, in: Proceedings of International Conference on Knowledge Science, Engineering and Management, 2020, pp. 247–258.

J. Li, P. Ren, Z. Chen, Z. Ren, T. Lian, J. Ma, Neural attentive session based recommendation, in: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, 2017, pp. 1419–1428.

J. Zhang, B. Hao, B. Chen, C. Li, H. Chen, J. Sun, Hierarchical Reinforcement Learning for Course Recommendation in MOOCs, in: Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence, 2019, pp. 435–442

D. Wu, J. Lu, G. Zhang, A fuzzy tree matching-based personalized e-learning recommender system, IEEE Trans. Fuzzy Syst. 23 (6) (2015) 2412–2426.

W. Chen, Z. Niu, X. Zhao, Y. Li, A hybrid recommendation algorithm adapted in e-learning environments, World Wide Web 17 (2) (2014) 271–284.

S. Wan, Z. Niu, An e-learning recommendation approach based on the self-organization of learning resource, Knowl.-Based Syst. 160 (2018) 71–87

J. Zhang, F. Gu, Y. J. Ji, and J. F. Guo, “Personalized scientific and technological literature resources recommendation based on deep learning,” Journal of Intelligent Fuzzy Systems, vol. 41, no. 2, pp. 2981–2996, 2021.

Zhang B, Yang FZ, Fan LN. Query recommendation based on document content user focuses on. Appl Mech Mater 2014;511:385–8

Son J, Kim SB. Content-based filtering for recommendation systems using multiattribute networks[J]. Expert Syst Appl 2017;89:404–12

Ng YK. CBRec: a book recommendation system for children using the matrix factorisation and content-based filtering approaches[J]. Int J Bus Intell Data Min 2020;16(2):129–49.

Sakboonyarat S, Tantatsanawong P. Massive open online courses (MOOCs) recommendation modeling using deep learning[C]//. In: Proceedings of the 2019 23rd international computer science and engineering conference (ICSEC). IEEE; 2019. p. 275–80

Verbert K, Manouselis N, Ochoa X. Context-aware recommender systems for learning: a survey and future challenges[J]. IEEE Trans Learn Technol 2012;5(4): 318–35

Zapata A, Menendez VH, Prieto ME. A hybrid recommender method for learning objects [J]. In: IJCA Proceedings on design and evaluation of digital content for education (DEDCE). 1; 2011. p. 1–7.

Salehi M, Kamalabadi IN, Ghoushchi MBG. An effective recommendation framework for personal learning environments using a learner preference tree and a GA[J]. IEEE Trans Learn Technol 2013;6(4):350–63.

M.L. Littman, Reinforcement learning improves behaviour from evaluative feedback, Nature 521 (2015) 445–451.

D. Silver, T. Hubert, J. Schrittwieser, I. Antonoglou, M. Lai, A. Guez, M. Lanctot, L. Sifre, D. Kumaran, T. Graepel, et al., A general reinforcement learning algorithm that masters chess, shogi, and go through self-play, Science 362 (6419) (2018) 1140–1144.

A. Kara, I. Dogan, Reinforcement learning approaches for specifying ordering policies of perishable inventory systems, Expert Syst. Appl. 91 (2018) 150–158.

X. Wang, Y. Wang, D. Hsu, Y. Wang, Exploration in interactive personalized music recommendation: A reinforcement learning approach, ACM Trans. Multimed. Comput. Comm. Appl. 11 (1) (2014) 22

F. Liu, X. Li, H. Guo, R. Tang, Y. Ye, X. He, End-to-end deep reinforcement learning based recommendation with supervised embedding, in: Proceedings of the 13th ACM International Conference on Web Search and Data Mining, 2020, pp. 384–392.

G. Zheng, F. Zhang, Z. Zheng, Y. Xiang, N.J. Yuan, X. Xie, Z.J. Li, DRN: A deep reinforcement learning framework for news recommendation, in: Proceedings of the 27th International Conference on World Wide Web, 2018, pp. 167–176

[43] V. Mnih, K. Kavukcuoglu, D. Silver, A.A. Rusu, J. Veness, M.G. Bellemare, A. Graves, M. Riedmiller, A.K. Fidjeland, G. Ostrovski, et al., Human-level control through deep reinforcement learning, Nature 518 (7540) (2015) 529–533.

J.K. Gupta, M. Egorov, M. Kochenderfer, Cooperative multi-agent control using deep reinforcement learning, in: G. Sukthankar, J. Rodriguez Aguilar (Eds.), Autonomous Agents and Multiagent Systems, Springer, Cham, 2017, pp. 66–83

S. Almahdi, S.Y. Yang, An adaptive portfolio trading system: A riskreturn portfolio optimization using recurrent reinforcement learning with expected maximum drawdown, Expert Syst. Appl. 87 (2017) 267–279.

P. Gabrielsson, U. Johansson, High-frequency equity index futures trading using recurrent reinforcement learning with candlesticks, in: IEEE Symposium Series on Computational Intelligence, 2015, pp. 734–741.

P. Basile, C. Greco, A. Suglia, G. Semeraro, Deep learning and hierarchical reinforcement learning for modeling a conversational recommender system, Intell. Artif. 12 (2) (2018) 125–141.

O. Nachum, S.S. Gu, H. Lee, S. Levine, Data-efficient hierarchical reinforcement learning, in: Advances in Neural Information Processing Systems, 2018, pp. 3307–3317.

A.S. Vezhnevets, S. Osindero, T. Schaul, N. Heess, M. Jaderberg, D. Silver, K. Kavukcuoglu, FeUdal networks for hierarchical reinforcement learning, in: Proceedings of the 34th International Conference on Machine Learning, 2017, pp. 3540–3549.

J. Zhang, B. Hao, B. Chen, C. Li, H. Chen, J. Sun, Hierarchical Reinforcement Learning for Course Recommendation in MOOCs, in: Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence, 2019, pp. 435–442.

X. Wang, Y. Chen, J. Yang, L. Wu, Z. Wu, X. Xie, A reinforcement learning framework for explainable recommendation, in: Proceedings of IEEE International Conference on Data Mining, 2018, pp. 587–596.

Y. Xian, Z. Fu, S. Muthukrishnan, G. de Melo, Y. Zhang, Reinforcement knowledge graph reasoning for explainable recommendation, in: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, 2019, pp. 285–294.

H. Fang, D. Zhang, Y. Shu, G. Guo, Deep learning for sequential recommendation: Algorithms, influential factors, and evaluations, ACM Trans. Inf. Syst. 39 (1) (2021) 1–42.

J. Tang, K. Wang, Personalized top-N sequential recommendation via convolutional sequence embedding, in: Proceedings of the 11th ACM International Conference on Web Search and Data Mining, 2018, pp. 565–573.

X. Xin, A. Karatzoglou, I. Arapakis, J.M. Jose, Self-supervised reinforcement learning for recommender systems, in: Proceedings of the 43nd International ACM SIGIR Conference on Research and Development in Information Retrieval, 2020, pp. 931–940.

O. Moling, L. Baltrunas, F. Ricci, Optimal radio channel recommendations with explicit and implicit feedback, in: Proceedings of the 6th ACM Conference on Recommender Systems, 2012, pp. 75–82.

L. Wang, W. Zhang, X. He, H. Zha, Supervised reinforcement learning with recurrent neural network for dynamic treatment recommendation, in: Proc. ACM SIGKDD Conf., 2018, pp. 2447–2456.

J. Huang, W.X. Zhao, H. Dou, J.-R. Wen, E.Y. Chang, Improving sequential recommendation with knowledge-enhanced memory networks, in: Proceedings of the 41nd International ACM SIGIR Conference on Research and Development in Information Retrieval, 2018, pp. 505–514.

B. Hidasi, A. Karatzoglou, L. Baltrunas, D. Tikk, Session-based recommendations with recurrent neural networks, in: Proceedings of the International Conference on Learning Representations, 2016.

P. Wang, Y. Fan, L. Xia, W.X. Zhao, S. Niu, J. Huang, KERL: A knowledgeguided reinforcement learning model for sequential recommendation, in: Proceedings of the 43nd International ACM SIGIR Conference on Research and Development in Information Retrieval, 2020, pp. 209–218.

J.K. Tarus, Z. Niu, A. Yousif, A hybrid knowledge-based recommender system for e-learning based on ontology and sequential pattern mining, Future Gener. Comput. Syst. 72 (2017) 37–48.

J.K. Tarus, Z. Niu, D. Kalui, A hybrid recommender system for e-learning based on context awareness and sequential pattern mining, Soft Comput. 22 (8) (2018) 2449–2461.

X. Zhang, S. Li, L. Sha, H. Wang, Attentive interactive neural networks for answer selection in community question answering, in: Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, 2017, pp. 3525–3531.

W. Song, Z. Xiao, Y. Wang, L. Charlin, M. Zhang, J. Tang, Session-based social recommendation via dynamic graph attention networks, in: Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining, 2019, pp. 555–563.

L. Zhang, P. Liu, J.A. Gulla, Dynamic attention-integrated neural network for session-based news recommendation, Mach. Learn. 108 (10) (2019) 1851–1875.

J. Chen, H. Zhang, X. He, L. Nie, W. Liu, T.-S. Chua, Attentive collaborative filtering: Multimedia recommendation with item- and component-level attention, in: Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2017, pp. 335–344.

E-khool learning platforms dataset, https://ekhool.com/, accessed on November 2022

Devlin J., Chang M.W., Lee K., Toutanova K. Bert: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805, 2018: 1–8.

Madhavi, A.; Nagesh, A.; Govardhan, A. A Study on E-Learning and Recommendation System. Recent Adv. Comput. Sci. Commun. Former. Recent Pat. Comput. Sci. 2022, 15, 748–764.

Bifeng Li, Gangfeng Li, Jingxiu Xu, Xueguang Li, Xiaoyan Liu, Mei Wang, Jianhui Lv. "A personalized recommendation framework based on MOOC system integrating deep learning and big data" , Computers and Electrical Engineering, 2023,Elsevier Publishers.

Yuanguo Lin, Shibo Feng, Fan Lin, Wenhua Zeng, Yong Liu, Pengcheng Wu. "Adaptive course recommendation in MOOCs" , Knowledge-Based Systems, 2021, Elsevier Publishers

RAO, P.S., NAGINI, S., Sudheer, D., BAPIRAJ, V., VARDHAN, M.V. and HARSHITHA, M., 2022. STUDENT PERFORMANCE ANALYSIS FOR OUTCOME BASED EDUCATION. International Journal of Early Childhood Special Education, 14(5).

Devulapalli, S., Venkatesh, B. and Somula, R., 2023. Business Analysis During the Pandemic Crisis Using Deep Learning Models. In AI-Driven Intelligent Models for Business Excellence (pp. 68-80). IGI Global.