Exploring The Efficiency of Metaheuristics in Optimal Hyperparameter Tuning for Ensemble Models on Varied Data Modalities

Authors

DOI:

https://doi.org/10.4108/eetismla.6461

Keywords:

Kidney disease dataset, heart disease dataset, breast-cancer dataset, diabetes dataset, SVM, KNN, Naïve Bayes, Logistic Regression, Random Search, Grid Search, PSO

Abstract

Effective disease detection systems play an important role in healthcare by supporting diagnosis and treatment. This study provides a comparison of hyperparameter tuning methods for disease detection systems using four health datasets; kidney disease, diabetes detection, heart disease and breast cancer detection. The main objective of this research is to prepare datasets by normalizing the input and testing machine learning models such as Naive Bayes Support Vector Machine (SVM), Logistic Regression and k Nearest Neighbor (kNN). to identify effective models for each data set. After implementing the models, we apply three hyperparameter tuning techniques: Grid search, random search, and particle ensemble optimization (PSO). These methods are used to tune the model parameters. Improve overall performance metrics. The evaluation focuses on accuracy measurements to compare model performance before and after hyperparameter tuning. The results of this study illustrate how different tuning techniques can improve the performance of disease detection systems across a range of healthcare datasets. By conducting testing and analysis, we determine the appropriate tuning method for each data set, yielding valuable insights, to develop an accurate and effective disease detection system .These discoveries serve to advance the field of healthcare analytics and machine learning  to deliver outcomes for patients and healthcare services.

Downloads

Download data is not yet available.

References

Abdul Samad, S. R., Balasubaramanian, S., Al-Kaabi, A. S., Sharma, B., Chowdhury, S., Mehbodniya, A., ... & Bostani, A. (2023). Analysis of the performance impact of fine-tuned machine learning model for phishing URL detection. Electronics, 12(7), 1642.

Ahamad, G. N., Shafiullah, Fatima, H., Imdadullah, Zakariya, S. M., Abbas, M., ... & Usman, M. (2023). Influence of optimal hyperparameters on the performance of machine learning algorithms for predicting heart disease. Processes, 11(3), 734.

Ma, Y., Lu, Q., Yuan, F., & Chen, H. (2023). Comparison of the effectiveness of different machine learning algorithms in predicting new fractures after PKP for osteoporotic vertebral compression fractures. Journal of orthopaedic surgery and research, 18(1), 62.

Georgiou, G. P. (2023). Comparison of the prediction accuracy of machine learning algorithms in crosslinguistic vowel classification. Scientific Reports, 13(1), 15594.

Ustebay, S., Sarmis, A., Kaya, G. K., & Sujan, M. (2023). A comparison of machine learning algorithms in predicting COVID-19 prognostics. Internal and Emergency Medicine, 18(1), 229-239.

Gallón, V. M., Vélez, S. M., Ramírez, J., & Bolaños, F. (2024). Comparison of machine learning algorithms and feature extraction techniques for the automatic detection of surface EMG activation timing. Biomedical Signal Processing and Control, 94, 106266.

More, S., Antonopoulos, G., Hoffstaedter, F., Caspers, J., Eickhoff, S. B., Patil, K. R., & Alzheimer's Disease Neuroimaging Initiative. (2023). Brain-age prediction: A systematic comparison of machine learning workflows. NeuroImage, 270, 119947.

Bischl, B., Binder, M., Lang, M., Pielok, T., Richter, J., Coors, S., ... & Lindauer, M. (2023).Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 13(2), e1484.

Ali, Y. A., Awwad, E. M., Al-Razgan, M., & Maarouf, A. (2023). Hyperparameter search for machine learning algorithms for optimizing the computational complexity. Processes, 11(2), 349.

Gupta, S. C., & Goel, N. (2023). Predictive modeling and analytics for diabetes using hyperparameter tuned machine learning techniques. Procedia Computer Science, 218, 1257-1269.

Ay, Ş., Ekinci, E., & Garip, Z. (2023). A comparative analysis of meta-heuristic optimization algorithms for feature selection on ML-based classification of heart-related diseases. The Journal of Supercomputing, 79(11), 11797-11826.

Kanamarlapudi, S., Yakkala, V. S., Gayathri, B., Nusimala, K. V., Aravinth, S. S., & Srithar, S. (2023, February). Comparison and Analysis of Various Machine Learning Algorithms for Disease Prediction. In 2023 7th International Conference on Computing Methodologies and Communication (ICCMC) (pp. 246-250). IEEE.

Mohammed, A., & Kora, R. (2023). A comprehensive review on ensemble deep learning: Opportunities and challenges. Journal of King Saud University-Computer and Information Sciences, 35(2), 757-774.

Hanifi, S., Cammarono, A., & Zare-Behtash, H. (2024). Advanced hyperparameter optimization of deep learning models for wind power prediction. Renewable Energy, 221, 119700.

Fang, J., Liu, W., Chen, L., Lauria, S., Miron, A., & Liu, X. (2023). A survey of algorithms, applications and trends for particle swarm optimization. International Journal of Network Dynamics and Intelligence, 24-50.

Downloads

Published

06-08-2024

How to Cite

[1]
Vivek BC, “Exploring The Efficiency of Metaheuristics in Optimal Hyperparameter Tuning for Ensemble Models on Varied Data Modalities”, EAI Endorsed Trans Int Sys Mach Lear App, vol. 1, Aug. 2024.