Simulation and Control of the KUKA KR6 900EX Robot in Unity 3D: Advancing Industrial Automation through Virtual Environments

Anand Ajayakumar Sujatha; Amin Kolahdooz; Mohammadreza Jafari; Alireza Hajfathalian

doi:10.4108/airo.8026

Authors

Anand Ajayakumar Sujatha De Montfort University
Amin Kolahdooz De Montfort University https://orcid.org/0000-0002-7888-0410
Mohammadreza Jafari De Montfort University
Alireza Hajfathalian Babol Noshirvani University of Technology

DOI:

https://doi.org/10.4108/airo.8026

Keywords:

Unity 3D, Robotics Simulation, Creo, Automated Systems, Pick-and-Place Operations, Industrial Automation

Abstract

This study presents the development of a virtual simulation of a KUKA robot within the Unity 3D platform, focusing on its ability to execute pick-and-place operations in an industrial setting. The research emphasizes the importance of digital simulations as cost-effective and safe alternatives to physical prototypes in industrial automation. By replicating robotic tasks in a virtual environment, organizations can mitigate wear and tear on expensive machinery and minimize safety hazards inherent in real-world operations. The simulation process commenced with the creation of a detailed 3D model of the KUKA robot utilizing Creo CAD software. This model was subsequently imported into the Unity 3D environment, where an interactive and realistic simulation environment was constructed. A manual control system was implemented through custom C# scripts, enabling precise joint manipulation via keyboard inputs. While the current control mechanism remains manual, this study provides a foundational framework for the future integration of advanced algorithms for trajectory planning and autonomous control. The simulation successfully demonstrates the feasibility of performing industrial robotic tasks within a virtual environment. It serves as a platform for further research, including the automation of robotic movements and the integration of virtual reality and digital twin technologies. These advancements have the potential to significantly enhance real-time monitoring, operator training, and overall operational efficiency in industrial applications. This work underscores the growing significance of virtual simulation technologies in industrial automation, presenting a scalable and flexible solution for prototyping, testing, and training within complex industrial ecosystems.

Downloads

References

[1] Chen, S., et al., Digital Twin Virtual Welding Approach of Robotic Friction Stir Welding Based on Co-Simulation of FEA Model and Robotic Model. Sensors, 2024. 24(3): p. 1001.

[2] Li, Y., et al., Advances in the Application of AI Robots in Critical Care: Scoping Review. Journal of Medical Internet Research, 2024. 26: p. e54095.

[3] Li, B., et al. Unity 3d-based simulation data driven robotic assembly sequence planning using genetic algorithm. in 2022 14th International Conference on Computer and Automation Engineering (ICCAE). 2022. IEEE.

[4] Moshayedi, A.J., et al., Design and Development of FOODIEBOT Robot: From Simulation to Design. IEEE Access, 2024.

[5] Moshayedi, A.J., et al., Robots in Agriculture: Revolutionizing Farming Practices. EAI Endorsed Transactions on AI and Robotics, 2024. 3.

[6] Zarei, M., et al. Indoor UAV object detection algorithms on three processors: implementation test and comparison. in 2023 3rd International Conference on Consumer Electronics and Computer Engineering (ICCECE). 2023. IEEE.

[7] Osmani, K. and D. Schulz, Comprehensive Investigation of Unmanned Aerial Vehicles (UAVs): An In-Depth Analysis of Avionics Systems. Sensors, 2024. 24(10): p. 3064.

[8] Singh, B., N. Sellappan, and P. Kumaradhas, Evolution of industrial robots and their applications. International Journal of emerging technology and advanced engineering, 2013. 3(5): p. 763-768.

[9] Krüger, J., T.K. Lien, and A. Verl, Cooperation of human and machines in assembly lines. CIRP annals, 2009. 58(2): p. 628-646.

[10] Kyrarini, M., et al., A survey of robots in healthcare. Technologies, 2021. 9(1): p. 8.

[11] Marchuk, V.Y., O. Harmash, and O. Ovdiienko, World trends in warehousing logistics. Intellect. Logist. Supply Chain. Manag, 2020. 2: p. 32-50.

[12] da Silva, N.P., S. Eloy, and R. Resende, Robotic construction analysis: simulation with virtual reality. Heliyon, 2022. 8(10).

[13] Li, Y., G. Li, and X. Wang, Research on Trajectory Planning of Autonomous Vehicles in Constrained Spaces. Sensors, 2024. 24(17): p. 5746.

[14] Armansyah, A., et al., Optimization of air suspension system for improved ride and handling performance in road vehicles dynamic. Mechanical Engineering for Society and Industry, 2024. 4(2).

[15] Latifi Rostami, S.A., et al., Robust topology optimization of continuum structures with smooth boundaries using moving morphable components. Structural and Multidisciplinary Optimization, 2023. 66(6): p. 121.

[16] Devan, P.A.M., et al., A novel hybrid harris hawk-arithmetic optimization algorithm for industrial wireless mesh networks. Sensors, 2023. 23(13): p. 6224.

[17] Žlajpah, L., Simulation in robotics. Mathematics and Computers in Simulation, 2008. 79(4): p. 879-897.

[18] Cyril, X., G. Jaar, and J. St.-Pierre. Advanced space robotics simulation for training and operations. in Modeling and Simulation Technologies Conference. 2000.

[19] Xiong, L., et al., An optimized trajectory planner and motion controller framework for autonomous driving in unstructured environments. Sensors, 2021. 21(13): p. 4409.

[20] Pham, Q.-C., Trajectory planning. Handbook of Manufacturing Engineering and Technology, 2015: p. 1873-1887.

[21] Hou, S., et al., A data-driven approach for motion planning of industrial robots controlled by high-level motion commands. Frontiers in Robotics and AI, 2023. 9: p. 1030668.

[22] Moshayedi, A.J., et al., Deep learning application pros and cons over algorithm deep learning application pros and cons over algorithm. EAI Endorsed Transactions on AI and Robotics, 2022. 1(1).

[23] Boscariol, P., A. Gasparetto, and L. Scalera, Path planning for special robotic operations, in Robot Design: From Theory to Service Applications. 2022, Springer. p. 69-95.

[24] Hwang, P.-J., et al., Vision-Based Learning from Demonstration System for Robot Arms. Sensors, 2022. 22(7): p. 2678.

[25] Savir, S., et al., Virtual reality: The future of invasive procedure training? Journal of cardiothoracic and vascular anesthesia, 2023.

[26] Durojaye, A., et al., Immersive horizons: exploring the transformative power of virtual reality across economic sectors. EAI Endorsed Transactions on AI and Robotics, 2023. 2.

[27] Durojaye, A., A. Kolahdooz, and A. Hajfathalian, Enhancing Virtual Reality Experiences in Architectural Visualization of an Academic Environment. EAI Endorsed Transactions on AI and Robotics, 2025. 4.

[28] Pan, J., et al. Real-time VR simulation of laparoscopic cholecystectomy based on parallel position-based dynamics in GPU. in 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 2020. IEEE.

[29] Sun, F., et al., Digital-Twin-Assisted Skill Learning for 3C Assembly Tasks. IEEE Transactions on Cybernetics, 2024.

[30] Peng, H., N. Shi, and G. Wang, Remote sensing traffic scene retrieval based on learning control algorithm for robot multimodal sensing information fusion and human-machine interaction and collaboration. Frontiers in neurorobotics, 2023. 17: p. 1267231.

[31] Unity Technologies, "Unity 3D". Available from: https://unity.com/.

[32] Ding, L., et al. Numerical Calculation and Optimization Algorithm Based on Unity Physics Engine. in 2024 IEEE 13th International Conference on Communication Systems and Network Technologies (CSNT). 2024. IEEE.

[33] Moshayedi, A.J., A. Kolahdooz, and L. Liao, Unity in Embedded System Design and Robotics: A Step-by-step Guide. 2022: Chapman and Hall/CRC.

[34] Jangra, S., et al. Interactivity Development Using Unity 3D Software and C# Programming. in 2023 14th International Conference on Computing Communication and Networking Technologies (ICCCNT). 2023. IEEE.

[35] Ortega, A., et al., Composable and executable scenarios for simulation-based testing of mobile robots. Frontiers in Robotics and AI, 2024. 11: p. 1363281.

[36] Pan, X., et al. Virtual Assembly of educational robot parts based on VR technology. in 2019 IEEE 11th International Conference on Engineering Education (ICEED). 2019. IEEE.

[37] Al-Tawil, B., et al., A review of visual SLAM for robotics: evolution, properties, and future applications. Frontiers in Robotics and AI, 2024. 11: p. 1347985.

[38] Moshayedi, A.J., et al., Integrating virtual reality and robotic operation system (ROS) for AGV navigation. EAI Endorsed Transactions on AI and Robotics, 2023. 2.

[39] EK Studio, "Low poly factory machine pack demo". Jun 3 [cited 08/19/2024; Available from: https://assetstore.unity.com/packages/3d/props/industrial/low-poly-factory-machine-pack-demo-272637.

[40] 3.D. Unity, "Unity AssetStore". Available from: https://assetstore.unity.com.

[41] real virtual, "Game4Automation parts4cad". 08/05/2024]; Available from: https://assetstore.unity.com/packages/3d/environments/industrial/game4automation-parts4cad-150998#description.