CNN Based Face Emotion Recognition System for Healthcare Application

Authors

  • R Kishore Kanna Jerusalem College of Engineering
  • Bhawani Sankar Panigrahi Vardhaman College of Engineering image/svg+xml
  • Susanta Kumar Sahoo Indira Gandhi Institute of Technology image/svg+xml
  • Anugu Rohith Reddy Vardhaman College of Engineering image/svg+xml
  • Yugandhar Manchala Vardhaman College of Engineering image/svg+xml
  • Nirmal Keshari Swain Vardhaman College of Engineering image/svg+xml

DOI:

https://doi.org/10.4108/eetpht.10.5458

Keywords:

CNN, BCI, Emotions, ML

Abstract

INTRODUCTION: Because it has various benefits in areas such psychology, human-computer interaction, and marketing, the recognition of facial expressions has gained a lot of attention lately.

OBJECTIVES: Convolutional neural networks (CNNs) have shown enormous potential for enhancing the accuracy of facial emotion identification systems. In this study, a CNN-based approach for recognizing facial expressions is provided. METHODS: To boost the model's generalizability, transfer learning and data augmentation procedures are applied. The recommended strategy defeated the existing state- of-the-art models when examined on multiple benchmark datasets, including the FER-2013, CK+, and JAFFE databases.

RESULTS: The results suggest that the CNN-based approach is fairly excellent at properly recognizing face emotions and has a lot of potential for usage in detecting facial emotions in practical scenarios.

CONCLUSION: Several diverse forms of information, including oral, textual, and visual, maybe applied to comprehend emotions. In order to increase prediction accuracy and decrease loss, this research recommended a deep CNN model for emotion prediction from facial expression.

Downloads

Download data is not yet available.

References

Vala, Jaykumar M., and Udesang K. Jaliya. "Analytical Review and Study on Emotion Recognition Strategies Using Multimodal Signals." Advancements in Smart Computing and Information Security: First International Conference, ASCIS 2022, Rajkot, India, November 24–26, 2022, Revised Selected Papers, Part I. Cham: Springer Nature Switzerland, 2023. DOI: https://doi.org/10.1007/978-3-031-23092-9_21

Moin, Anam, et al. "Emotion recognition framework using multiple modalities for an effective human–computer interaction." The Journal of Supercomputing (2023): 1-30.

Rooj, Suparna, Aurobinda Routray, and Manas K. Mandal. "Feature based analysis of thermal images for emotion recognition." Engineering Applications of Artificial Intelligence 120 (2023): 105809. DOI: https://doi.org/10.1016/j.engappai.2022.105809

R. K. Kanna, R. Chandrasekaran, A. A. Khafel, M. Brayyich, K. A.Jabbar and H. Al- Chlidi, "Study On Diabetic Conditions Monitoring Using Deep Learning Application," 2023 3rd International Conference on Advance Computing and Innovative Technologies in Engineering (ICACITE), Greater Noida, India, 2023, pp. 363-366, doi: 10.1109/ICACITE57410.2023.10183002. DOI: https://doi.org/10.1109/ICACITE57410.2023.10183002

Shehada, D., Turky, A., Khan, W., Khan, B., & Hussain, A. (2023). A Lightweight Facial Emotion Recognition System Using Partial Transfer Learning for Visually Impaired People. IEEE Access, 11, 36961-36969. DOI: https://doi.org/10.1109/ACCESS.2023.3264268

K. K. Ravikumar, M. Ishaque, B. S. Panigrahi, and C. R. Pattnaik, “Detection of Covid- 19 Using AI Application”, EAI Endorsed Trans Perv Health Tech, vol. 9, Jun. 2023. DOI: https://doi.org/10.4108/eetpht.9.3349

Turuk, Mousami Prashant, et al. "AI-Based Emotion Recognition." Encyclopedia of Data Science and Machine Learning. IGI Global, 2023. 849-869. DOI: https://doi.org/10.4018/978-1-7998-9220-5.ch049

R. K. Kanna, S. Prasath Alias Surendhar, M. R. AL-Hameed, A. M. Lafta, R. Khalid and Hussain, "Smart Prosthetic Arm Using Cognitive Application," 2023 3rd International Conference on Advance Computing and Innovative Technologies in Engineering (ICACITE), Greater Noida, India, 2023, pp. 1330-1334, doi: 10.1109/ICACITE57410.2023.10182794. DOI: https://doi.org/10.1109/ICACITE57410.2023.10182794

Shahzad, H. M., Bhatti, S. M., Jaffar, A., Akram, S., Alhajlah, M., & Mahmood, A. (2023). Hybrid Facial Emotion Recognition Using CNN-Based Features. Applied Sciences, 13(9), 5572. DOI: https://doi.org/10.3390/app13095572

Assiri, Basem, and Mohammad Alamgir Hossain. "Face emotion recognition based on infrared thermal imagery by applying machine learning and parallelism." MathematicalBiosciences and Engineering 20.1 (2023): 913-929. DOI: https://doi.org/10.3934/mbe.2023042

Lei, Yuanyuan, and Houwei Cao. "Audio-Visual Emotion Recognition With Preference Learning Based on Intended and Multi-Modal Perceived Labels." IEEE Transactions onAffective Computing (2023). DOI: https://doi.org/10.1109/TAFFC.2023.3234777

Kanna, R. Kishore, N. Kripa, and R. Vasuki. "Systematic Design Of Lie Detector System Utilizing EEG Signals Acquisition." International Journal of Scientific & Technology Research 9: 610-2.

Liu, Xia, Zhijing Xu, and Kan Huang. "Multimodal Emotion Recognition Based on Cascaded Multichannel and Hierarchical Fusion." Computational Intelligence and Neuroscience 2023 (2023). DOI: https://doi.org/10.1155/2023/9645611

Park, Sung, and Mincheol Whang. "Special Issue “Emotion Intelligence Based on SmartSensing”." Sensors 23.3 (2023): 1098. DOI: https://doi.org/10.3390/s23031098

R. K. Kanna, U. Mutheeswaran, V. S. Ramya, R. Gomalavalli, L. K. Hema and A. Ambikapathy, "Computing Model for Alzheimer Prediction Using Support Vector Machine Classifier," 2022 IEEE International Conference on Current Development in Engineering and Technology (CCET), Bhopal, India, 2022, pp. 1-6, doi: 10.1109/CCET56606.2022.10080346. DOI: https://doi.org/10.1109/CCET56606.2022.10080346

Prasath Alias Surendhar, S., Kanna, R. K., & Indumathi, R. (2023). Ensemble Feature Extraction with Classification Integrated with Mask RCNN Architecture in Breast Cancer Detection Based on Deep Learning Techniques. SN Computer Science, 4(5), 618. DOI: https://doi.org/10.1007/s42979-023-01893-z

R. K. Kanna, U. Mutheeswaran, K. A. Jabbar, A. A. Ftaiet, R. Khalid and H. Al-Chlidi, "Clinical Analysis of EEG for Cognitive Activation Using MATLAB Applications," 2023 3rd International Conference on Advance Computing and Innovative Technologies in Engineering (ICACITE), Greater Noida, India, 2023, pp. 2604-2608. DOI: https://doi.org/10.1109/ICACITE57410.2023.10182561

R. K. Kanna, U. Mutheeswaran, A. J. Jouda, M. Asaad Hussein, A. Hussain and M. Al-Tahee, "Computational Cognitive Analysis of ADHD Patients using Matlab Applications," 2023 3rd International Conference on Advance Computing and Innovative Technologies in Engineering (ICACITE), Greater Noida, India, 2023, pp. 1344-1348. DOI: https://doi.org/10.1109/ICACITE57410.2023.10182435

Jebakumar, S., Hemalatha, R.J., Kanna, R.K. (2023). GSM Enabled Patient Monitoring System Using Arduino Application for Cardiac Support. In: Nandan Mohanty, S., Garcia Diaz, V., Satish Kumar, G.A.E. (eds) Intelligent Systems and Machine Learning. ICISML 2022. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 470. Springer, Cham. DOI: https://doi.org/10.1007/978-3-031-35078-8_24

Rubi J, A. V, kanna KR, G. U. Bringing Intelligence to Medical Devices Through Artificial Intelligence. Advances in Medical Technologies and Clinical Practice [Internet]. 2023 Jan 13;154–68. Available from: http://dx.doi.org/10.4018/978-1-6684-6434-2.ch007 DOI: https://doi.org/10.4018/978-1-6684-6434-2.ch007

Downloads

Published

18-03-2024

How to Cite

1.
Kishore Kanna R, Panigrahi BS, Sahoo SK, Reddy AR, Manchala Y, Swain NK. CNN Based Face Emotion Recognition System for Healthcare Application. EAI Endorsed Trans Perv Health Tech [Internet]. 2024 Mar. 18 [cited 2024 May 3];10. Available from: https://publications.eai.eu/index.php/phat/article/view/5458