The Object Detection, Perspective and Obstacles In Robotic: A Review :

Ge  Xu; Amir Sohail Khan; Ata Jahangir Moshayedi; Xiaohong  Zhang; Yang Shuxin

doi:10.4108/airo.v1i1.2709

Authors

Ge Xu Jiangxi University of Science and Technology
Amir Sohail Khan Jiangxi University of Science and Technology
Ata Jahangir Moshayedi Jiangxi University of Science and Technology https://orcid.org/0000-0002-9457-6267
Xiaohong Zhang Jiangxi University of Science and Technology
Yang Shuxin Jiangxi University of Science and Technology

DOI:

https://doi.org/10.4108/airo.v1i1.2709

Keywords:

Deep Learning, Object Detection, Image Processing, Salient Object Detection (SOD), 3D object detection

Abstract

A few years back, when the image processing hardware and software were created, it was limited, and most of the time, object detection would fail., But as with time, the advancement in technology has significantly changed the scenario. A lot of researchers worked in this field to carry out a solution through which they can detect objects in any field, especially in the robotic domain [1]. In today's world, with so much research in the field of deep learning, it is very easy to identify and detect any object using computer vision. This paper focuses on the various deep learning technologies and algorithms through which object detection can be done. A new and advanced deep learning technology known as salient object detection has been discussed. Also, the 3D object detection and the end-to-end approach for object detection are discussed. The existing methods of deep learning through which object detection can be done. The applications in which object detection is being used and the importance of object detection. It also reports; what the predecessors have done, what problems have been solved by them, how they solved these problems, the characteristics of the predecessors' methods and their future work.

Downloads

Download data is not yet available.

References

A. J. Moshayedi and D. C. Gharpure, “Priority-based algorithm for plume tracking robot,” Proc. - ISPTS-1, 1st Int. Symp. Phys. Technol. Sensors, pp. 51–54, 2012, DOI: 10.1109/ISPTS.2012.6260876.

K. Li and L. Cao, "A Review of Object Detection Techniques," 2020 5th International Conference on Electromechanical Control Technology and Transportation (ICECTT), 2020, pp. 385-390, DOI: 10.1109/ICECTT50890.2020.00091.

A. J. Moshayedi, Z. Chen, L. Liao and S. Li, "Sunfa Ata Zuyan machine learning models for moon phase detection: algorithm prototype and performance comparison", TELKOMNIKA Telecomm. Compute. Electron. Control, vol. 20, no. 1, pp. 129-140, 2022. DOI: 10.12928/telkomnika.v20i1.22338

J. Wang, S. Gao, B. Zhang and S. Lv, "A Survey of Fault Diagnosis Methods for White body Welding Production Line," 2019 CAA Symposium on Fault Detection, Supervision and Safety for Technical Processes (SAFEPROCESS), 2019, pp. 304-308, DOI: 10.1109/SAFEPROCESS45799.2019.9213399.

M. S. A. Rahman and H. Hasbullah, "Early detection method of corrosion on buried steel gas pipeline using wireless sensor network," 2010 The 2nd International Conference on Computer and Automation Engineering (ICCAE), 2010, pp. 553-556, DOI: 10.1109/ICCAE.2010.5451824.

A. Firasanti, T. E. Ramadhani, M. A. Bakri and E. A. Zaki Hamidi, "License Plate Detection Using OCR Method with Raspberry Pi," 2021 15th International Conference on Telecommunication Systems, Services, and Applications (TSSA), 2021, pp. 1-5, DOI: 10.1109/TSSA52866.2021.9768252.

A. J. Moshayedi, S. S. Fard, L. Liao and S. A. Eftekhari, "Design and Development of Pipe Inspection Robot Meant for Resizable PipeLines", Int. J. Robot. Control, vol. 2, no. 1, pp. 25, 2019.

W. Zhiqiang and L. Jun, "A review of object detection based on convolutional neural network," 2017 36th Chinese Control Conference (CCC), 2017, pp. 11104-11109, DOI: 10.23919/ChiCC.2017.8029130.

A. J. . Moshayedi A. S. . Roy, A. Kolahdooz, and Y. . Shuxin, “Deep Learning Application Pros And Cons Over Algorithm”, EAI Endorsed Trans AI Robotics, vol. 1, no. 1, p. e7, Feb. 2022. DOI: 10.4108/airo.v1i.19

A. J. Moshayedi, A. S. Khan, S. Yang and S. M. Zanjani, "Personal Image Classifier Based Handy Pipe Defect Recognizer (HPD): Design and Test," 2022 7th International Conference on Intelligent Computing and Signal Processing (ICSP), 2022, pp. 1721-1728, DOI: 10.1109/ICSP54964.2022.9778676.

R. Xie, Q. Zhang, E. Yang and Q. Zhu, "A Method of Small Face Detection Based on CNN," 2019 4th International Conference on Computational Intelligence and Applications (ICCIA), 2019, pp. 78-82, DOI:10.1109/ICCIA.2019.00022.

H. Xin, C. Ma and D. Li, "Comic Text Detection and Recognition Based on Deep Learning," 2021 3rd International Conference on Applied Machine Learning (ICAML), 2021, pp. 20-23, DOI: 10.1109/ICAML54311.2021.00012.

T. Yasunaga, T. Oda, N. Saito, A. Hirata, K. Toyoshima and K. Katayama, "Object Detection and Pose Estimation Approaches for Soldering Danger Detection," 2021 IEEE 10th Global Conference on Consumer Electronics (GCCE), 2021, pp. 697-698, DOI: 10.1109/GCCE53005.2021.9621849.

E. P. Myint and M. M. Sein, "People Detecting and Counting System," 2021 IEEE 3rd Global Conference on Life Sciences and Technologies (LifeTech), 2021, pp. 289-290, DOI: 10.1109/LifeTech52111.2021.9391951.

A. J. Moshayedi and D. C. Gharpure, “Development of position monitoring system for studying performance of wind tracking algorithms,” 7th Ger. Conf. Robot. Robot. 2012, vol. 32, pp. 161–164, 2012.

W. Zhang, S. Wang, S. Thachan, J. Chen and Y. Qian, "Deconv R-CNN for Small Object Detection on Remote Sensing Images," IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium, 2018, pp. 2483-2486, DOI: 10.1109/IGARSS.2018.8517436.

C. Lee, H. J. Kim and K. W. Oh, "Comparison of faster R-CNN models for object detection," 2016 16th International Conference on Control, Automation and Systems (ICCAS), 2016, pp. 107-110, DOI: 10.1109/ICCAS.2016.7832305.

D. Kumar and X. Zhang, "Improving More Instance Segmentation and Better Object Detection in Remote Sensing Imagery Based on Cascade Mask R-CNN," 2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS, 2021, pp. 4672-4675, DOI: 10.1109/IGARSS47720.2021.9554512.

C. Gao, Y. Zhai and X. Guo, "Visual Object Detection and Tracking System Design based on MobileNet-SSD," 2021 7th International Conference on Computer and Communications (ICCC), 2021, pp. 589-593, DOI: 10.1109/ICCC54389.2021.9674450.

B. Wu, A. Wan, F. Iandola, P. H. Jin and K. Keutzer, "SqueezeDet: Unified, Small, Low Power Fully Convolutional Neural Networks for Real-Time Object Detection for Autonomous Driving," 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2017, pp. 446-454, DOI: 10.1109/CVPRW.2017.60.

A. Sarda, S. Dixit and A. Bhan, "Object Detection for Autonomous Driving using YOLO [You Only Look Once] algorithm," 2021 Third International Conference on Intelligent Communication Technologies and Virtual Mobile Networks (ICICV), 2021, pp. 1370-1374, DOI:10.1109/ICICV50876.2021.9388577.

J. Fan, J. Lee, I. Jung and Y. Lee, "Improvement of Object Detection Based on Faster R-CNN and YOLO," 2021 36th International Technical Conference on Circuits/Systems, Computers and Communications (ITC-CSCC), 2021, pp. 1-4, DOI: 10.1109/ITC-CSCC52171.2021.9501480.

S. T. Blue and M. Brindha, "Edge detection based boundary box construction algorithm for improving the precision of object detection in YOLOv3," 2019 10th International Conference on Computing, Communication and Networking Technologies (ICCCNT), 2019, pp. 1-5, DOI: 10.1109/ICCCNT45670.2019.8944852.

S. Ali, A. Siddique, H. F. Ateş and B. K. Güntürk, "Improved YOLOv4 for Aerial Object Detection," 2021 29th Signal Processing and Communications Applications Conference (SIU), 2021, pp. 1-4, DOI: 10.1109/SIU53274.2021.9478027.

M. Sharma et al., "YOLOrs: Object Detection in Multimodal Remote Sensing Imagery," in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 14, pp. 1497-1508, 2021, DOI: 10.1109/JSTARS.2020.3041316.

S. Mane and S. Mangale, "Moving Object Detection and Tracking Using Convolutional Neural Networks," 2018 Second International Conference on Intelligent Computing and Control Systems (ICICCS), 2018, pp. 1809-1813, DOI: 10.1109/ICCONS.2018.8662921.

B. Li, "3D fully convolutional network for vehicle detection in point cloud," 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2017, pp. 1513-1518, DOI: 10.1109/IROS.2017.8205955.

A. J. Moshayedi, J. Li and L. Liao, "Simulation study and PID Tune of Automated Guided Vehicles (AGV)," 2021 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA), 2021, pp. 1-7, DOI: 10.1109/CIVEMSA52099.2021.9493679.

A. Mousavian, D. Anguelov, J. Flynn and J. Košecká, "3D Bounding Box Estimation Using Deep Learning and Geometry," 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp. 5632-5640, DOI: 10.1109/CVPR.2017.597.

P. Zhang, D. Wang, H. Lu, H. Wang and B. Yin, "Learning Uncertain Convolutional Features for Accurate Saliency Detection," 2017 IEEE International Conference on Computer Vision (ICCV), 2017, pp. 212-221, DOI: 10.1109/ICCV.2017.32.

X. Zhou, W. Gong, W. Fu and F. Du, "Application of deep learning in object detection," 2017 IEEE/ACIS 16th International Conference on Computer and Information Science (ICIS), 2017, pp. 631-634, DOI: 10.1109/ICIS.2017.7960069.

C. Aker and S. Kalkan, "Using deep networks for drone detection," 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), 2017, pp. 1-6, DOI: 10.1109/AVSS.2017.8078539.

S. Schneider, G. W. Taylor and S. Kremer, "Deep Learning Object Detection Methods for Ecological Camera Trap Data," 2018 15th Conference on Computer and Robot Vision (CRV), 2018, pp. 321-328, DOI: 10.1109/CRV.2018.00052.

T. -T. Do, A. Nguyen and I. Reid, "AffordanceNet: An End-to-End Deep Learning Approach for Object Affordance Detection," 2018 IEEE International Conference on Robotics and Automation (ICRA), 2018, pp. 5882-5889, DOI: 10.1109/ICRA.2018.8460902.

Y. Zhou and O. Tuzel, "VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection," 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2018, pp. 4490-4499, DOI: 10.1109/CVPR.2018.00472.

W. Wang, J. Shen, X. Dong and A. Borji, "Salient Object Detection Driven by Fixation Prediction," 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2018, pp. 1711-1720, DOI: 10.1109/CVPR.2018.00184.

C. R. Qi, W. Liu, C. Wu, H. Su and L. J. Guibas, "Frustum PointNets for 3D Object Detection from RGB-D Data," 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2018, pp. 918-927, DOI: 10.1109/CVPR.2018.00102.

F. Xu et al., "Real-Time Detecting Method of Marine Small Object with Underwater Robot Vision," 2018 OCEANS - MTS/IEEE Kobe Techno-Oceans (OTO), 2018, pp. 1-4, DOI: 10.1109/OCEANSKOBE.2018.8558804.

L. Sun, S. -a. Wang, H. Chen and Y. Chen, "A novel object detection before tracking filter framework for assistive robot under global vision," 2018 IEEE 4th Information Technology and Mechatronics Engineering Conference (ITOEC), 2018, pp. 1011-1014, DOI: 10.1109/ITOEC.2018.8740736.

G. Zhang, S. Jia, D. Zeng and Z. Zheng, "Object Detection and Grabbing Based on Machine Vision for Service Robot," 2018 IEEE 9th Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON), 2018, pp. 89-94, DOI: 10.1109/IEMCON.2018.8615062.

Z. Kuang, Y. Yang, T. Hau and Y. He, "Research on Biomimetic Coordination Action of Service Robot Based on Stereo Vision," 2018 2nd IEEE Advanced Information Management,Communicates,Electronic and Automation Control Conference (IMCEC), 2018, pp. 769-773, DOI: 10.1109/IMCEC.2018.8469748.

J. Guo, P. Chen, Y. Jiang, H. Yokoi and S. Togo, "Real-time Object Detection with Deep Learning for Robot Vision on Mixed Reality Device," 2021 IEEE 3rd Global Conference on Life Sciences and Technologies (LifeTech), 2021, pp. 82-83, DOI: 10.1109/LifeTech52111.2021.9391811.

A. J. Moshayedi, A. Kolahdooz, and L. Liefa, Unity in Embedded System Design and Robotics: A Step-by-step Guide, CRC Press, Routledge, 2022

Zhang, X., Song, Z., Moshayedi, A.J. et al. Security scheduling and transaction mechanism of virtual power plants based on dual blockchains. J Cloud Comp 11, 4 (2022). DOI: 10.1186/s13677-021-00273-3

Ata Jahangir Moshayedi, Atanu Shuvam Roy, Liefa liao, Hong Lan, Mehdi Gheisari,Aaqif Afzaal Abbasi and Seyed Mojtaba Hosseini Bamakan, "Automation Attendance Systems Approaches: A Practical Review BOHR International Journal of Internet of Things Research2022, Vol. 1, No. 1, pp. 7–15, DOI: 10.54646/bijiotr.003

Gheisari, M., Esnaashari, M. (2017). A survey to face recognition algorithms: advantageous and disadvantageous. Journal Modern Technology & Engineering, V. 2(1), pp. 57-65.

Ata Jahangir Moshayedi, Amin Kolahdooz, Atanu Shuvam Roy, Seyyed Ali Latifi Rostami, and Xiaoyun Xie "Design and promotion of cost-effective IOT-based heart rate monitoring", Proc. SPIE 12303, International Conference on Cloud Computing, Internet of Things, and Computer Applications (CICA 2022), 123031N (28 July 2022); DOI: 10.1117/12.2642725.

Alzubi J.A., Yaghoubi A., Gheisari M., Qin Y. (2018) Improve Heteroscedastic Discriminant Analysis by Using CBP Algorithm. In: Vaidya J., Li J. (eds) Algorithms and Architectures for Parallel Processing. ICA3PP 2018. Lecture Notes in Computer Science, vol 11335. Springer, Cham.

A. J. Moshayedi, S. K. Sambo and A. Kolahdooz, "Design And Development of Cost-Effective Exergames For Activity Incrementation," 2022 2nd International Conference on Consumer Electronics and Computer Engineering (ICCECE), 2022, pp. 133-137, DOI: 10.1109/ICCECE54139.2022.9712844.

Mukkamala Rohith Sri Sai, Sindhusha Rella, Sainagesh Veeravalli, “Object Detection and Identification” B.Tech Thesis, November 2019 [Online] Available at: https://www.researchgate.net/publication/337464355

A. J. Moshayedi, A. Shuvam Roy, S. K. Sambo, Y. . Zhong, and L. Liao, “ Review On: The Service Robot Mathematical Model ”, EAI Endorsed Trans AI Robotics, vol. 1, no. 1, p. e8, Feb. 2022.DOI: 10.4108/airo.vli.20