Privacy-Preserving Abnormal Gait Detection Using Computer Vision and Machine Learning
DOI:
https://doi.org/10.4108/eetpht.11.9094Keywords:
Computer Vision, Gait Analysis, Abnormal Gait DetectionAbstract
Gait analysis plays a pivotal role in diagnosing a spectrum of neurological and musculoskeletal disorders. Variations in gait patterns often serve as early indicators of underlying health conditions, underscoring the importance of precise and timely analysis for effective intervention and treatment. In recent years, computer vision techniques have emerged as robust tools for automated gait analysis, offering non-invasive, costeffective, and scalable solutions. However, existing approaches often overlook the critical aspect of privacy preservation. In this study, we propose the world’s pioneering computer vision-based abnormal gait detection system with a privacy-preserving mechanism. Specifically, we extract 2D skeletons from encrypted images using a deep neural network model, which is facilitated by an optical system incorporating a custom-made refractive optical element. These extracted features are then fed into machine learning models for the detection of normal versus abnormal gait patterns. Evaluations across various models including random forest, decision tree, K-nearest neighbor, support vector machine, neural network, and convolutional neural network reveal that the random forest model attains the highest classification performance based on 2D skeletons extracted from encrypted images.
Downloads
References
[1]. Pirker, W., Katzenschlager, R.: Gait disorders in adults and the elderly: A clinical guide. Wien Klin Wochenschr 129(3), 81–95 (2017)
[2]. Dai, Y., Gao, J., Zhang, W., Wu, X., Zhu, X., Gu, W.: Smart Insoles for GaitAnalysis Based on Meshless Conductive Rubber Sensors and Neural Networks. Journal of Physics: Conference Series 2500(2023), 1–8 (2007)
[3]. Potluri, S., Ravuri, S., Diedrich, C., Schega, L.: Deep Learning based Gait Abnormality Detection using Wearable Sensor System. In: 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Berlin, Germany, 2019
[4]. Hundal, J., Badu, B.: Computer Vision and Abnormal Patient Gait: A Comparison of Methods. The Open Artificial Intelligence Journal 6, 29–34 (2020)
[5]. Bauckhage, C., Tsotsos, J., Bunn, F.: Detecting Abnormal Gait. In: The 2nd Canadian Conference on Computer and Robot Vision (CRV’05), Victoria, BC, Canada, 2005
[6]. Rupprechter, S., et al.: A Clinically Interpretable Computer-Vision Based Method for Quantifying Gait in Parkinson’s Disease. Sensors 21(16), 1–21 (2021)
[7]. Rani, M., Arumugam, G.: Children Abnormal GAIT Classification Using Extreme Learning Machine. Global Journal of Computer Science and Technology 22(20), 11–22 (2022)
[8]. Li, Q., Wang, Y., Sharf, A., Cao, Y., Tu, C., Chen, B., Yu, S.: Classification of gait Anomalies from Kinect. The Visual Computer 34, 229–241 (2018)
[9]. Yang, Z.: An Efficient Automatic Gait Anomaly Detection Method Based on Semi supervised Clustering. Computational Intelligence and Neuroscience 2021
[10]. Gong, L., Li, J., Yu, M., Zhu, M., Clifford, R.: A novel computer vision-based gait analysis technique for normal and Parkinson’s gaits classification. In: 2020 IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech), Calgary, AB, Canada, 2020
[11]. Chen, B., Chen, C., Hu, J., Sayeed, Z., et al.: Computer Vision and Machine Learning-Based Gait Pattern Recognition for Flat Fall Prediction. Sensors 22(20), 11–22 (2022)
[12]. Nieto-Hidalgo, M., Ferrandez-Pastor, F., Valdivieso-Sarabia, R., Mora-Pascual, J.,Garcia-Chamizo, J.: A vision-based proposal for classification of normal and abnormal gait using RGB camera. Journal of Biomedical Informatics 63, 82–89 (2016)
[13]. Chakraborty, S., Sambhavi, S., Nandy, A.: Deep Learning in Gait Abnormality Detection: Principles and Illustrations. In: Suresh, A., et al. (eds.) Bioinformatics and Medical Applications: Big Data Using Deep Learning Algorithms, pp. 63–72. Scrivener Publishing LLC, 2022
[14]. Diraco, G., Manni, A., Leone, A.: Integrating Abnormal Gait Detection with Activities of Daily Living Monitoring in Ambient Assisted Living: A 3D Vision Approach. Sensors 24(1), 1–22 (2024)
[15]. Jun, K., Lee, S., Lee, D., Kim, M.: Deep Learning-Based Multimodal AbnormalGait Classification Using a 3D Skeleton and Plantar Foot Pressure. IEEE Access 9, 161576–161589 (2021)
[16]. Hinojosa, C., Niebles, J., Arguello, H.: Learning privacy-preserving optics for human pose estimation. In: IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada, 2021
[17]. Hinojosa, C., Marquez, M., Arguello, H., Adeli, E., Fei-Fei, L., Niebles, J.: PrivHAR: Recognizing Human Actions from Privacy-Preserving Lens. In: European Conference on Computer Vision, Tel Aviv, Israel, 2022
[18]. Arguello, P., Lopez, J., Hinojosa, C., Arguello, H.: Optics Lens Design for Privacy Preserving Scene Captioning. In: IEEE International Conference on Image Processing (ICIP), Bordeaux, France, 2022
[19]. Liu, J., Xia, Y., Tang, Z.: Privacy-preserving video fall detection using visual shielding information. Vis. Comput. 37, 359–370 (2021)
[20]. Gong, L., Mccall, S., Yu, M.: Enhancing privacy with optical element design forfall detection. Electronic Letters 59(20), (2023)
[21]. Goodman, J.: Introduction to Fourier optics. 4th edn. Macmillan Learning, 2017
[22]. He, K., Gkioxari, G., Dollr, P., Girshick, R.: Mask R-CNN. In: 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy, 2017
[23].COCO: Common Objects in Context, https://cocodataset.org/home. Last accessed 28 Mar 2024
[24]. scikit-learn Machine Learning in Python, https://scikit-learn.org/stable/. Last accessed 28 Mar 2024
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Afreen Naz, Pandey Shourya Prasad, Sheldon Mccall, Chan Chi Leung, Ifeoma Ochi, Liyun Gong, Miao Yu

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
This is an open access article distributed under the terms of the CC BY-NC-SA 4.0, which permits copying, redistributing, remixing, transformation, and building upon the material in any medium so long as the original work is properly cited.