EAI Endorsed Transactions on AI and Robotics

Lightweight Keyword Spotting with Inter-Domain Interaction and Attention for Real-Time Voice-Controlled Robotics

Hien Vu Pham, Thuy Phuong Vu, Huong Thi Nguyen, Minhhuy Le — Tue, 18 Mar 2025 00:00:00 +0000

This study introduces a novel lightweight Keyword Spotting (KWS) model optimized for deployment on resource-constrained microcontrollers, with potential applications in robotic control and end-effector operations. The proposed model employs inter-domain interaction to effectively extract features from both Mel-frequency cepstral coefficients (MFCCs) and temporal audio characteristics, complemented by an attention mechanism to prioritize relevant audio segments for enhanced keyword detection. Achieving a 93.70% accuracy on the Google Command v2-12 commands dataset, the model outperforms existing benchmarks. It also demonstrates remarkable efficiency in inference speed (0.359 seconds) and resource utilization (34.9KB peak RAM and 98.7KB flash memory), offering a 3x faster inference time and reduced memory footprint compared to the DS-CNN-S model. These attributes make it particularly suitable for real-time voice command applications in low-power robotic systems, enabling intuitive and responsive control of robotic arms, end-effectors, and navigation systems. In this work, however, the KWS model is demonstrated in a simple non-destructive testing system for controlling sensor movement. This research lays the groundwork for advancing voice-activated robotic technologies on resource-limited hardware platforms.

Simulation and Control of the KUKA KR6 900EX Robot in Unity 3D: Advancing Industrial Automation through Virtual Environments

Thu, 20 Mar 2025 00:00:00 +0000

This study presents the development of a virtual simulation of a KUKA robot within the Unity 3D platform, focusing on its ability to execute pick-and-place operations in an industrial setting. The research emphasizes the importance of digital simulations as cost-effective and safe alternatives to physical prototypes in industrial automation. By replicating robotic tasks in a virtual environment, organizations can mitigate wear and tear on expensive machinery and minimize safety hazards inherent in real-world operations. The simulation process commenced with the creation of a detailed 3D model of the KUKA robot utilizing Creo CAD software. This model was subsequently imported into the Unity 3D environment, where an interactive and realistic simulation environment was constructed. A manual control system was implemented through custom C# scripts, enabling precise joint manipulation via keyboard inputs. While the current control mechanism remains manual, this study provides a foundational framework for the future integration of advanced algorithms for trajectory planning and autonomous control. The simulation successfully demonstrates the feasibility of performing industrial robotic tasks within a virtual environment. It serves as a platform for further research, including the automation of robotic movements and the integration of virtual reality and digital twin technologies. These advancements have the potential to significantly enhance real-time monitoring, operator training, and overall operational efficiency in industrial applications. This work underscores the growing significance of virtual simulation technologies in industrial automation, presenting a scalable and flexible solution for prototyping, testing, and training within complex industrial ecosystems.

Apple Disease Detection and Classification using Random Forest (One-vs-All)

Zengming Wen, Hong Lan, Muhammad Asim Khan — Wed, 22 Jan 2025 00:00:00 +0000

Fruit diseases detection and recognition are a common problem worldwide. Fruit Disease detection is a hot topic among researchers and is very complex due to structure and color similarity factors. In this research we proposed a new model to detect and classify the apple disease with the help of digital image processing and machine learning. First, image processing techniques were applied to enhance the image contrast and remove the noise, which helped to segment the region of interest accurately also help to extract feature without garbage data. Then K-means clustering technique with fuzzy C-mean method was implemented to segment the images. GLCM feature extraction was used after the segmentation. Real images of apple disease with multi-disease regions were used in the research method. These features were preprocessed with methods like LDA. K-Fold cross validation was used for training and testing, with combination of random forest machine learning method. The result showed high accuracy with comparison of existing techniques.

Advancing Food Security through Precision Agriculture: YOLOv8’s Role in Efficient Pest Detection and Management

Ameer Tamoor Khan, Sign Marie Jensen, Noman Khan — Fri, 24 Jan 2025 00:00:00 +0000

In response to the growing global population and the consequent need for sustainable food security, effective pest management is critical for enhancing agricultural productivity. This research presents YOLOv8, a state-of-the-art deep learning model optimized for pest detection in agricultural environments, contributing to modern food security efforts. Evaluated using the complex IP102 dataset, YOLOv8 demonstrated notable improvements in pest detection accuracy, achieving scores of 66.9 mAP@0.5 and 42.1 mAP@[0.5:0.95]. These results underscore YOLOv8’s robust performance across diverse detection scenarios, enabling more precise pest control and reducing crop loss. However, in-depth dataset analysis revealed a bias towards larger pests, likely due to bounding box size variations, which presents an opportunity for model improvement. Future work will focus on addressing data imbalances, enhancing sensitivity to smaller pests, and validating YOLOv8 in varied real-world agricultural settings. These advancements are expected to significantly improve pest management practices, ultimately boosting agricultural productivity and supporting global food security through the application of modern agricultural technologies.

Enhancing Virtual Reality Experiences in Architectural Visualization of an Academic Environment

Abiodun Durojaye, Amin Kolahdooz, Alireza Hajfathalian — Wed, 29 Jan 2025 00:00:00 +0000

Virtual Reality (VR) technology possesses the capability to transport users into immersive, alternative environments, providing them with a convincing sense of presence within a simulated world. This project leverages VR to develop an interactive, educational system centered around the De Montfort University (DMU) Queens Building, simulating key facilities and infrastructure through the integration of 360-degree imagery and Adobe Captivate software. Designed in response to contemporary challenges, such as the COVID-19 pandemic, which underscored the need for flexible and innovative learning methodologies, the VR system offers an immersive educational platform enriched with essential information to enhance student engagement and learning outcomes. A comprehensive literature review explored the expanding applications of VR across diverse sectors, including education, healthcare, robotics, and manufacturing. The findings of this review underscored VR's transformative potential in enhancing educational engagement and facilitating a deeper understanding of complex concepts. The project methodology involved meticulously mapping the physical layout of the Queens Building, capturing targeted 360-degree scenarios using a Ricoh Theta V camera, and subsequently transforming these into immersive VR scenarios enriched with interactive hotspots, meticulously synchronized with the building's design layout. The VR system successfully achieved the project's objectives by simulating key educational and informational use cases. It provides students with an alternative learning medium, offering interactive insights into the functionalities of equipment and facilities within the building. Furthermore, the system enables a virtual tour of the DMU campus, facilitating familiarization with the university environment. Findings from the VR application highlight its potential as a dynamic educational tool, positioning it as a valuable complement to traditional learning methods. This innovative approach demonstrates the capacity of VR to enhance student understanding, support academic and research pursuits, and ultimately enrich the overall student experience.

From Social Media Reactions to Grades: A Machine Learning-Based SocialNet Analysis for Academic Performance Prediction

Muhammad Ramzan, Naeem Ahmed — Mon, 17 Mar 2025 00:00:00 +0000

The impact of social media on student academic performance has garnered significant research interest in recent years. The pervasive use of social networking sites (SNS) among college and university students, both in and outside classrooms, has raised concerns about its potential effects on academic achievement. This study investigates the relationship between social media usage and academic performance through a dataset of 550 participants. Machine learning models, including Random Forest, Decision Trees, and Long Short-Term Memory (LSTM), were employed to analyze and predict the impact of social media on students' academic outcomes. The models were trained using clean and well-engineered data. The results indicate a moderate influence of social media usage on academic performance, with the LSTM model outperforming traditional approaches in predictive accuracy. These findings highlight the importance of considering sequential usage patterns in understanding the academic implications of social media.

A Multi-Channel Spam Detection System Utilizing Natural Language Processing and Machine Learning

Mohini Tyagi, Pradeep Kumar Singh, Shivam Kumar Yadav, Sanjay Kumar Soni — Tue, 18 Mar 2025 00:00:00 +0000

As digital communication rapidly expands, the issue of unsolicited and unwanted messages, commonly known as spam, has become a major concern. This paper introduces an advanced spam detection system that integrates Natural Language Processing (NLP) and Machine Learning (ML) techniques. The system differentiates between spam and legitimate messages by employing a hybrid model that combines Naive Bayes, Support Vector Machines (SVM), and deep learning models like Bidirectional Encoder Representations from
Transformers (BERT). The model demonstrates high effectiveness across various communication platforms, including emails, SMS, and social media, achieving an accuracy exceeding 98.5%.

A Deep Learning Based Optical Character Recognition Model for Old Turkic

Thu, 10 Apr 2025 00:00:00 +0000

This study presents the development and evaluation of a deep learning-based optical character recognition (OCR) model specifically designed for recognizing Old Turkic script. Utilizing a convolutional neural network (CNN), the project aimed to achieve high classification accuracy across a dataset comprising 38 distinct Old Turkic characters. To enhance the model’s robustness and generalization capabilities, sophisticated data augmentation techniques were employed, generating 760 augmented images from the original 38 characters. The model was rigorously trained and validated, achieving an overall ac- curacy of 96.34%. Evaluation metrics such as precision, recall, and F1-scores were systematically analyzed, showing superior performance in most classes while identifying areas for further optimization. The results underscore the effectiveness of CNN architectures in specialized OCR tasks, demonstrating their potential in preserving and digitizing historical scripts. This study not only advances the field of document analysis and OCR but also contributes to the digital preservation and accessibility of ancient scripts.

A malware detection method based on LLM to mine semantics of API

Ronghao Hou, Xiaoping Tian, Guanggang Geng — Wed, 07 May 2025 00:00:00 +0000

In recent years, the application of the LLM model has played an increasing role in more and more fields, including network security. Some attackers use LLM to attack, generate malicious code for attack, generate phishing emails, and analyze the vulnerability of the software. This also inspires us to utilize LLM to maintain net security. In the past research on malware detection, there were many feature engineering aspects that we had to ask experts to analyze, and this work is very difficult and resource-consuming due to the frequent updates of malware. In this paper, we propose a malware detection method for intrinsic semantics. The method first designs an API intrinsic semantic feature encoder, which extracts intrinsic semantic features from API names and Microsoft's official API definitions based on the LLM's prompt engineering and sentence embedding techniques. Then the API co-occurrence feature encoder is designed, which mines the contextual co-occurrence features of API from API call sequences based on the word2vec. The API semantic features and API co-occurrence features are combined to improve the malware detection performance. Also, it uses TCN-GRU to capture dependencies between API calls. Results on several public datasets show that our method achieves better performance than other methods, and in addition, ablation study results demonstrate the important role of intrinsic semantics in malware detection algorithms.