Real-Time Remote-Controlled Human Manipulation Medical Robot Using IoT Module

Authors

DOI:

https://doi.org/10.4108/eetiot.6241

Keywords:

IoT, Robotics, Healthcare, Remote

Abstract

INTRODUCTION: Innovative robotics and advanced computer vision technology converge in the Human Manipulation-Controlled Robot, utilized for medical applications. The robot operates through human gestures, and includes a camera module for real-time visual feedback, enhancing its functionality and user interaction.

OBJECTIVES: The primary goal of the research was to harness the natural expressiveness of human gestures to provide a more intuitive and engaging method of controlling medical robots. The focus is on enabling precise control through programmed responses to specific gestures, ensuring effective interaction with medical tasks.

METHODS: The robot’s hardware configuration consists of a mobile platform with motorized components, an ESP32 module, gesture recognition sensors and a camera modules. The ESP32 module interprets signals from gesture recognition sensors to execute precise commands for the robot's movements and actions. Simultaneously, the camera module captures live footage, providing visual feedback through an intuitive interface for seamless interaction.

RESULTS: The Human Manipulation-Controlled Robot has been successfully developed, featuring a fetch arm capable of autonomous movement and object manipulation. This research address critical needs in medical centers, demonstrating the feasibility of using only minimalistic EEG electrode wireless transmission to operate a robot effectively. 

CONCLUSION: Through the provision of a more intuitive and engaging method of controlling and interacting with medical robots, this innovation has the potential to significantly improve user experience. It represents a most important development in medical robotic vehicles, enhancing user experience and operational efficiency through advanced human-robot interaction techniques.

Downloads

Download data is not yet available.
<br data-mce-bogus="1"> <br data-mce-bogus="1">

References

Fakhr Abdollahi A, Shaheed MH, Thaha MA, Vepa R. A review of modeling and control of remote-controlled capsule endoscopes. Expert Review of Medical Devices. 2024 Apr 6:1-4. DOI: https://doi.org/10.1080/17434440.2024.2336135

Joans SM, Gomathi N, Ponsudha P. Wireless vision-based digital media fixed-point DSP processor depending robots for natural calamities. Robotica. 2024 Mar 15:1-8.

Kebede GA, Gelaw AA, Andualem H, Hailu AT. Review of the characteristics of mobile robots for health care application. International Journal of Intelligent Robotics and Applications. 2024 Mar 26:1-23.

Kanna RK, Devi KY, Gomalavalli R, Ambikapathy A. Smart Detection and Removal of Artifacts in Cognitive Signals Using Biomedical Signal Intelligence Applications. InQuantum Innovations at the Nexus of Biomedical Intelligence 2024 (pp. 223-244). IGI Global. DOI: https://doi.org/10.4018/979-8-3693-1479-1.ch013

Gazali NA, Bakar RA, Tan CI, Bo J, Lee SH, Ho HP, Lim SY, Cheong WK, Liaw SC, Ooi CC. Comparing conventional abdominal ultrasound scanning versus a ROBotic assisted UltraSonography sysTem (ROBUST). WFUMB Ultrasound Open. 2024 Jun 1;2(1):100040. DOI: https://doi.org/10.1016/j.wfumbo.2024.100040

Kanna RK, Pradhan NR, Panigrahi BS, Basa SS, Mohanty S. Smart Assist System Module for Paralysed Patient Using IoT Application. EAI Endorsed Transactions on Internet of Things. 2024 Mar 6;10. DOI: https://doi.org/10.4108/eetiot.5315

Li N, Wang Y, Zhao H, Ding H. Robotic Systems Design in Endovascular Treatment. IEEE Transactions on Medical Robotics and Bionics. 2024 Mar 18. DOI: https://doi.org/10.1109/TMRB.2024.3377374

Zhang J, Chen YM, Yang S, Yang Y, Rani A, Sun X, He Y. Remote-controlled saline tolerant tough-yet-strong solar vapor evaporator based on multifunctional Fe3O4 nanoparticle reinforced gel-nacre. Desalination. 2024 Apr 16:117640. DOI: https://doi.org/10.1016/j.desal.2024.117640

Sushma BS, Singhal P, Kanna RK. Optimization of Network Performance using MPLS. In2023 3rd International Conference on Advancement in Electronics & Communication Engineering (AECE) 2023 Nov 23 (pp. 715-718). IEEE. DOI: https://doi.org/10.1109/AECE59614.2023.10428461

Kanna RK, Athawale SV, Naniwadekar MY, Choudhari CS, Talhar NR, Dhengre S. Anxiety Controlling Application using EEG Neurofeedback System. EAI Endorsed Transactions on Pervasive Health and Technology. 2024 Mar 15;10. DOI: https://doi.org/10.4108/eetpht.10.5432

Yuan B. Programmable Liquid Metal. InHandbook of Liquid Metals 2024 Feb 10 (pp. 1-34). Singapore: Springer Nature Singapore. DOI: https://doi.org/10.1007/978-981-19-2797-3_30-1

Mohammad H, You HW, Umapathi M, Ravikumar KK, Mishra S. Strategies of Artificial intelligence tools in the domain of nanomedicine. Journal of Drug Delivery Science and Technology. 2023 Nov 10:105157. DOI: https://doi.org/10.1016/j.jddst.2023.105157

Li J, Huang Z, Hu C, Zhang Z, Shi C. Development of a 7-DoF Haptic Operator Interface Based on Redundantly Actuated Parallel Mechanism. IEEE Transactions on Medical Robotics and Bionics. 2024 Mar 14.

Ravikumar KK, Ishaque M, Panigrahi BS, Pattnaik CR. Detection of Covid-19 using AI application. EAI endorsed transactions on pervasive health and technology. 2023 Jun 28;9. DOI: https://doi.org/10.4108/eetpht.9.3349

Bessaad N, Qilian B, Jiankang Z, Benoudina N. TrashInst: real-time floating litter instance segmentation model. Engineering Research Express. 2024 Jan 30;6(1):015062. DOI: https://doi.org/10.1088/2631-8695/ad2036

Bernhard L, Schwingenschlögl P, Hofmann J, Wilhelm D, Knoll A. Boosting the hospital by integrating mobile robotic assistance systems: a comprehensive classification of the risks to be addressed. Autonomous Robots. 2024 Jan;48(1):1. DOI: https://doi.org/10.1007/s10514-023-10154-0

Ambikapathy A, Beeta TD, Kanna RK, Danquah-Amoah A, Ramya VS, Mutheeswaran U. Biometric Application on Facial Image Recognition Techniques. In2024 IEEE International Conference on Computing, Power and Communication Technologies (IC2PCT) 2024 Feb 9 (Vol. 5, pp. 848-851). IEEE. DOI: https://doi.org/10.1109/IC2PCT60090.2024.10486608

Marques B, Silva S, Pedrosa E, Barros F, Teixeira A, Santos BS. Towards Unlimited Task Coverage and Direct (far-off) Manipulation in eXtended Reality Remote Collaboration. InCompanion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction 2024 Mar 11 (pp. 745-749). DOI: https://doi.org/10.1145/3610978.3640737

Kanna RK, Mutheeswaran U, Jabbar KA, Ftaiet AA, Khalid R, Al-Chlidi H. Clinical Analysis of EEG for Cognitive Activation Using MATLAB Applications. In2023 3rd International Conference on Advance Computing and Innovative Technologies in Engineering (ICACITE) 2023 May 12 (pp. 2604-2608). IEEE. DOI: https://doi.org/10.1109/ICACITE57410.2023.10182561

Gameiro T, Pereira T, Viegas C, Di Giorgio F, Ferreira NF. Robots for Forest Maintenance. Forests. 2024 Feb 18;15(2):381. DOI: https://doi.org/10.3390/f15020381

Li J, Huang Z, Hu C, Zhang Z, Shi C. Development of a 7-DoF Haptic Operator Interface Based on Redundantly Actuated Parallel Mechanism. IEEE Transactions on Medical Robotics and Bionics. 2024 Mar 14. DOI: https://doi.org/10.1109/TMRB.2024.3377376

Xu R, Xu Q. A Survey of Recent Developments in Magnetic Microrobots for Micro-/Nano-Manipulation. Micromachines. 2024 Mar 29;15(4):468. DOI: https://doi.org/10.3390/mi15040468

Rubi J, Vijayalakshmi A, Umashankar G. Bringing intelligence to medical devices through artificial intelligence. InRecent Advancements in Smart Remote Patient Monitoring, Wearable Devices, and Diagnostics Systems 2023 (pp. 154-168). IGI Global. DOI: https://doi.org/10.4018/978-1-6684-6434-2.ch007

Heo JK, Kausthubharam, Jung M, Kim W, Jeong S, Song DS, Quan YJ, Jeon JH, Ribeiro de Moura R, Ahn SH. Scaling effects of manufacturing processes and actuation sources on control of remotely powered micro actuators. The International Journal of Robotics Research. 2024 Feb 22:02783649241235215. DOI: https://doi.org/10.1177/02783649241235215

Rengarajan A, Gupta MV, Kanna RK. Extracting Features Using Discrete Wavelet Transform (DWT) and Gray Level Co-occurrence Matrix (GLCM) to Produce Colorization of Images. In2023 3rd International Conference on Advancement in Electronics & Communication Engineering (AECE) 2023 Nov 23 (pp. 711-714). IEEE. DOI: https://doi.org/10.1109/AECE59614.2023.10428481

Kanna K, Ambikapathy A, AL-Hameed MR, Aishwarya BK, Gupta M. Detection of Emotion Employing Deep Learning Modelling Approach. In2023 10th IEEE Uttar Pradesh Section International Conference on Electrical, Electronics and Computer Engineering (UPCON) 2023 Dec 1 (Vol. 10, pp. 1475-1481). IEEE. DOI: https://doi.org/10.1109/UPCON59197.2023.10434343

Shah SH, Karlsen AS, Solberg M, Hameed IA. An efficient and lightweight multiperson activity recognition framework for robot-assisted healthcare applications. Expert Systems with Applications. 2024 May 1;241:122482. DOI: https://doi.org/10.1016/j.eswa.2023.122482

Kripa N, Vasuki R, Kanna RK. Realtime neural interface controlled au-pair BIMA bot. International Journal of Recent Technology and Engineering. 2019;8(1):992-4.

Raghavendra R, Chakravarty A, Kanna RK. Utilization of Spatial Filtering for Enhancement of Fingerprint Images. In2023 3rd International Conference on Advancement in Electronics & Communication Engineering (AECE) 2023 Nov 23 (pp. 707-710). IEEE. DOI: https://doi.org/10.1109/AECE59614.2023.10428296

Kanna RK, Surendhar PA, Rubi J, Jyothi G, Ambikapathy A, Vasuki R. Human Computer Interface Application for Emotion Detection Using Facial Recognition. In2022 IEEE International Conference on Current Development in Engineering and Technology (CCET) 2022 Dec 23 (pp. 1-7). IEEE. DOI: https://doi.org/10.1109/CCET56606.2022.10080678

Downloads

Published

19-06-2024

How to Cite

[1]
R. K. Kanna, B. Sankar Panigrahi, S. Sucharita, B. Pravallika, and S. K. Sahoo, “Real-Time Remote-Controlled Human Manipulation Medical Robot Using IoT Module”, EAI Endorsed Trans IoT, vol. 10, Jun. 2024.