A Deep Survey on Human Activity Recognition Using Mobile and Wearable Sensors
DOI:
https://doi.org/10.4108/eetpht.9.4483Keywords:
Human Activity Recognition, HAR, IoT, Smart Phones, Smart WatchesAbstract
Activity-based wellness management is thought to be a powerful application for mobile health. It is possible to provide context-aware wellness services and track human activity thanks to accessing for multiple devices as well as gadgets that we use every day. Generally in smart gadgets like phones, watches, rings etc., the embedded sensors having a wealth data that can be incorporated to person task tracking identification. In a real-world setting, all researchers shown effective boosting algorithms can extract information in person task identification. Identifying basic person tasks such as talk, walk, sit along sleep. Our findings demonstrate that boosting classifiers perform better than conventional machine learning classifiers. Moreover, the feature engineering for differentiating an activity detection capability for smart phones and smart watches. For the purpose of improving the classification of fundamental human activities, upcoming mechanisms give the guidelines for identification for various sensors and wearable devices.
Downloads
References
Vogels, E.A. About One-in-five Americans Use a SmartWatch or Fitness Tracker. Available online:org/fact-tank/2020/01/09/about-one-in-five-americans-use-a-smart-watch-or-fitness-tracker/ (accessed on 10 February 2022).
Research, M. Wearable Devices Market by Product Type (Smartwatch, Earwear, Eyewear, and others), End-Use Industry (Consumer Electronics, Healthcare, Enterprise and Industrial, Media and Entertainment), Connectivity Medium, and Region— Global Forecast to 2025. Available online: (accessed on 10 February 2022).
Cybenko G. Approximation by superpositions of a sigmoidal function. Math. Control. Signals Syst. 1989, 2, 303–314. DOI: https://doi.org/10.1007/BF02551274
Schäfer et al., Recurrent Neural Networks Are Universal Approximators. In Artificial Neural Networks— ICANN 2006; Kollias, S.D., Stafylopatis, A., Duch,W., Oja, E., Eds.; Springer: Berlin/Heidelberg, Germany, 2006; pp. 632–640. DOI: https://doi.org/10.1007/11840817_66
Zhou, D.X. Universality of deep convolutional neural networks. Appl. Comput. Harmon. Anal. 2020, 48, 787–794. DOI: https://doi.org/10.1016/j.acha.2019.06.004
Wearable Technology Database. Available online: https://data.world/crowdflower/wearable-technology-database (accessed on 10 February 2022).
Goodfellow et al., A. Deep Learning. 2016. Available online: http://www.deeplearningbook.org (accessed on 10 February 2022).
Sutton et al., Reinforcement Learning: An Introduction. 2018. Available online: (accessed on 10 February 2022).
T. L. M. van Kasteren et al., "Activity recognition using semi-Markov models on real world smart home datasets," Journal of Ambient Intelligence and Smart Environments, vol. 2, no. 3, pp. 311–325, Jan. 2010, DOI: 10.3233/AIS-2010-0070.
A.S. Crandall et al "Casas: A smart home in a box,". Computer, vol. 46, no. 7, pp. 62–69, Jul. 2013, DOI: 10.1109/MC.2012.328. DOI: https://doi.org/10.1109/MC.2012.328
D. J. Cook, "Learning setting-generalized activity models for smart spaces," IEEE Intelligent Systems, vol. 99, no. 1, Sep. 2011. DOI: 10.1109/MIS.2010.112. DOI: https://doi.org/10.1109/MIS.2010.112
G. Singlaet al., "Recognizing independent and joint activities among multiple residents in smart environments," Journal of ambient intelligence and humanized computing, vol. 1, no. 1, pp. 57-63, Mar. 2010, DOI: 10.1007/s12652-009-0007-1. DOI: https://doi.org/10.1007/s12652-009-0007-1
D. Anguita et al., "A public domain dataset for Human Activity Recognition using smartphones," 21th European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, ESANN 2013. Bruges, Belgium, pp. 437-442, Apr. 2013
R. Chavarriaga et al., "The Opportunity challenge: A benchmark database for on-body sensor-based activity recognition," Pattern Recognition Letters, vol. 34, no. 15, pp. 2033-2042, Nov. 2013, DOI: 10.1016/j.patrec.2012.12.014. DOI: https://doi.org/10.1016/j.patrec.2012.12.014
O. Banos et al., "mHealthDroid: a novel framework for agile development of mobile health applications," Pro-ceedings of the 6th International Work-conference on Ambient Assisted Living an Active Ageing (IWAAL 2014), Belfast, Northern Ireland, pp 91-98, Dec. 2014, DOI: 10.1007/978-3-319-13105-4_14. DOI: https://doi.org/10.1007/978-3-319-13105-4_14
S.K. Das et al., "Designing Smart Environments: A Paradigm Based on Learning and Prediction," In: Pal S.K., Bandyopadhyay S., Biswas S. (eds) Pattern Recognition and Machine Intelligence. PReMI 2005. Lecture Notes in Computer Science, Springer, Berlin, Heidelberg, vol. 3776, pp. 80-90, 2005, DOI: 10.1007/11590316_11. DOI: https://doi.org/10.1007/11590316_11
Institute for Social Research - University of Michigan. USA. ICPSR Dataset. [Online]. Available: https://www.icpsr.umich.edu/icpsrweb/content/about/, Accessed on: Jul. 31, 2018.
IRBS. International Review Boards [Online]. Available: https://www.icpsr.umich.edu/icpsrweb/ICPSR/irb/index.jsp, Accessed on: Jul. 31, 2018.
N. Rodríguez et al., "A fuzzy ontology for semantic modelling and recognition of human behaviour," Knowledge-Based Systems, vol. 66, pp. 46-60, Aug. 2014, DOI: 10.1016/j.knosys.2014.04.016. DOI: https://doi.org/10.1016/j.knosys.2014.04.016
F. Quesada et al., "Generation of a partitioned dataset with single, interleave and multioccupancy daily living activities," International Conference on Ubiquitous Computing and Ambient Intelligence, Springer, Cham, pp 60-71, 2015, DOI: 10.1007/978-3-319-26401-1_6. DOI: https://doi.org/10.1007/978-3-319-26401-1_6
D. Cook et al., "Collecting and disseminating smart home sensor data in the CASAS project," In: Proceedings of the CHI Work-shop on Developing Shared Home Behaviour Datasets to Advance HCI and Ubiquitous Computing Research, pp. 1–7, 2009.
G. Singla et al., "Tracking activities in complex settings using smart environment technologies," Int. J. Biosci. Psychiatry Technol. (IJBSPT), vol. 1, no. 1, pp. 25-35, Jan. 2009.
UCI Machine Learning Repository. [Online]. Available: https://archive.ics.uci.edu/ml/index.php, Accessed on: Jul. 31, 2018.
T. L. M. van Kasterenet al., "Activity recognition using semi-Markov models on real world smart home datasets," Journal of Ambient Intelligence and Smart Environments, vol. 2, no. 3, pp. 311–325, Jan. 2010, DOI: 10.3233/AIS-2010-0070. DOI: https://doi.org/10.3233/AIS-2010-0070
François Chollet et al. 2015. Keras. Retrieved from https://keras.io.
T. Choudhury et al., The mobile sensing platform: An embedded activity recognition system. IEEE Perv. Comput. 7, 2 (Apr. 2008), 32–41. https://doi.org/10.1109/MPRV.2008.39 DOI: https://doi.org/10.1109/MPRV.2008.39
Junyoung Chung et al., 2014. Empirical evaluation of gated recurrent neural networks on sequence modeling. In Workshop on Deep Learning (NIPS’14).
Zhao et al., MobiGesture: Mobility-aware hand gesture recognition for healthcare. Smart Health 2018, 9–10, 129–143. DOI: https://doi.org/10.1016/j.smhl.2018.07.010
A. Akbari et al, "Personalizing Activity Recognition Models Through Quantifying Different Types of Uncertainty Using Wearable Sensors," in IEEE Transactions on Biomedical Engineering, vol. 67, no. 9, pp. 2530-2541, Sept. 2020. DOI: https://doi.org/10.1109/TBME.2019.2963816
Pratik Tarafdar et al, Recognition of human activities for wellness management using a smartphone and a smart watch: A boosting approach, Decision Support Systems, Volume 140,2021. DOI: https://doi.org/10.1016/j.dss.2020.113426
Jessica Sena et al,Human activity recognition based on smartphone and wearable sensors using multi scale DCNN ensemble, Neuro-computing, Volume 444, 2021, Pages 226-243. DOI: https://doi.org/10.1016/j.neucom.2020.04.151
Henry Friday Nweke et al, Deep learning algorithms for human activity recognition using mobile and wearable sensor networks: State of the art and research challenges, Expert Systems with Applications,Volume 105,2018,Pages 233-261. DOI: https://doi.org/10.1016/j.eswa.2018.03.056
Chaolei Han et al, Human activity recognition using wearable sensors by heterogeneous convolutional neural networks, Expert Systems with Applications, Volume 198, 2022. DOI: https://doi.org/10.1016/j.eswa.2022.116764
Saurabh Gupta, Deep learning based human activity recognition (HAR) using wearable sensor data, International Journal of Information Management Data Insights, Volume 1, Issue 2, 2021. DOI: https://doi.org/10.1016/j.jjimei.2021.100046
Nandy et al, C. Novel features for intensive human activity recognition based on wearable and smartphone sensors. MicrosystTechnol 26, 1889–1903 (2020). DOI: https://doi.org/10.1007/s00542-019-04738-z
F. John Dian et al, "Wearables and the Internet of Things (IoT), Applications, Opportunities, and Challenges: A Survey," in IEEE Access, vol. 8, pp. 69200-69211, 2020, doi: 10.1109/ACCESS.2020.2986329. DOI: https://doi.org/10.1109/ACCESS.2020.2986329
F. Demrozi et al, "Human Activity Recognition Using Inertial, Physiological and Environmental Sensors: A Comprehensive Survey," in IEEE Access, vol. 8, pp. 210816-210836, 2020, doi: 10.1109/ACCESS.2020.3037715. DOI: https://doi.org/10.1109/ACCESS.2020.3037715
K. Xia et al, "LSTM-CNN Architecture for Human Activity Recognition," in IEEE Access, vol. 8, pp. 56855-56866, 2020, doi: 10.1109/ACCESS.2020.2982225. DOI: https://doi.org/10.1109/ACCESS.2020.2982225
Dua, et al, M.L.S. (2022). A Survey on Human Activity Recognition Using Deep Learning Techniques and Wearable Sensor Data, vol 1762.Springer, Cham. https://doi.org/10.1007/978-3-031-24352-3_5. DOI: https://doi.org/10.1007/978-3-031-24352-3_5
Liu et al, (2022). An Overview of Human Activity Recognition Using Wearable Sensors: Healthcare and Artificial Intelligence. In: Tekinerdogan, B., Wang, Y., Zhang, LJ. (eds) Internet of Things – ICIOT 2021.ICIOT 2021. Lecture Notes in Computer Science (), vol 12993, Springer, Cham. DOI: https://doi.org/10.1007/978-3-030-96068-1_1
Uddin et al, Human activity recognition using wearable sensors, discriminant analysis, and long short-term memory-based neural structured learning. Sci Rep 11, 16455 (2021). DOI: https://doi.org/10.1038/s41598-021-95947-y
Iqbal A, et al. Wearable Internet-of-Things platform for human activity recognition and health care. International Journal of Distributed Sensor Networks. 2020;16(6). DOI: https://doi.org/10.1177/1550147720911561
Transparent Reporting of Systematic Reviews and Meta-Analyses. Available online: http://www.prisma-statement.org/(accessed on 10 February 2022).
Kiran, et al., Multi-Layered Deep Learning Features Fusion for Human Action Recognition. Comput. Mater. Contin. 2021, 69, 4061–4075. DOI: https://doi.org/10.32604/cmc.2021.017800
M. E. Grams et al., "Validation of CKD and related conditions in existing datasets: A Systematic Review," American Journal of Kidney Diseases, vol. 57, no. 1, pp. 44–54, Jan. 2011, DOI: 10.1053/j.ajkd.2010.05.013. DOI: https://doi.org/10.1053/j.ajkd.2010.05.013
C. Nugent et al., "An initiative for the creation of open datasets within pervasive healthcare," In Pervasive health Conference 2016 - Future of Pervasive Health Workshop 2016, Mexico, Jan 2016, DOI: 10.4108/eai.16-5-2016.2263830. DOI: https://doi.org/10.4108/eai.16-5-2016.2263830
L N Vankateswaran et al. FingerPing: Recognizing Fine-grained Hand Poses Using Active Acoustic On-body Sensing. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI’18), Montreal, QC, Canada, 21–26 April 2018; ACM: New York, NY, USA, 2018;pp. 437:1–437:10.
Xia et al., A wearable haptic device to avoid occlusions in hand tracking. In Proceedings of the 2016 IEEE Haptics Symposium (HAPTICS), Philadelphia, PA, USA, 8–11 April 2016;pp. 134–139.
G Single et al., Development of a wearable HCI controller throughs EMG& IMU sensor fusion. In Proceedings of the2016 13th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI), Sofitel Xian on Renmin Square, Xi’an,China, 19–22 August 2016; pp. 83–87.
D Anguita et al., Monitoring eating habits using a piezoelectric sensor-based necklace. Comput. Biol. Med. 2015, 58, 46–55. DOI: https://doi.org/10.1016/j.compbiomed.2015.01.005
R Chavarriga et al., A Multi-Sensor Necklace for Detecting Eating Activities in Free-Living Conditions. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2020, 4, 1–26. DOI: https://doi.org/10.1145/3397313
O Banos et al., Continuously Tracking Full Facial Expressions on Neck-Mounted Wearable’s. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2021, 5, 1–31. DOI: https://doi.org/10.1145/3463511
Rahman, S et al., Performance analysis of boosting classifiers in recognizing activities of daily living. International journal of environmental research and public health, 2020, 17(3), 1082. DOI: https://doi.org/10.3390/ijerph17031082
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Shaik Jameer, Hussain Syed
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
This is an open access article distributed under the terms of the CC BY-NC-SA 4.0, which permits copying, redistributing, remixing, transformation, and building upon the material in any medium so long as the original work is properly cited.
