AML-TSCRA: A Machine Learning-Based Task Scheduling and Computational Resource Adaptive Allocation Method for Library Distributed Databases
DOI:
https://doi.org/10.4108/eetsis.11808Keywords:
Adaptive Scheduling, Computational Resource Allocation, Machine Learning, Distributed Database, Reinforcement LearningAbstract
INTRODUCTION: As libraries increasingly rely on distributed database systems to manage growing data volumes and service demands, conventional task scheduling and resource allocation strategies often struggle to adapt to dynamic workloads, leading to suboptimal resource utilization and performance bottlenecks.
OBJECTIVES: This paper aims to develop an intelligent adaptive framework that jointly optimizes task scheduling and computational resource allocation, thereby improving responsiveness, load balancing, and overall system efficiency.
METHODS: We propose AML-TSCRA (Adaptive Machine Learning-based Task Scheduling and Computational Resource Allocation), which integrates LSTM-based load forecasting with reinforcement learning-based scheduling and adaptive resource allocation based on real-time system states.
RESULTS: Experiments on three representative datasets, including Amazon EC2 Logs, Google Cluster Data, and SLURM Workload Manager, show that AML-TSCRA achieves its strongest performance on Amazon EC2 Logs, with a task completion rate of 88.9%, resource utilization of 81.8%, an average response time of 1.31 s, and system throughput of 23.7 tasks/s. The model also shows moderate gains on Google Cluster Data and smaller but consistent advantages on the more heterogeneous SLURM workload. In addition, it demonstrates relatively better robustness than the learning-based baselines under noisy conditions.
CONCLUSION: AML-TSCRA improves the efficiency and adaptability of distributed library-oriented service systems by combining predictive foresight, adaptive scheduling, and coordinated resource allocation. The proposed framework provides a practical basis for intelligent resource orchestration in modern data-intensive environments.
References
[1] Yakubu, A. S., Yagana, A. A., & Umar, S. I. Y. (2023). Investigating librarians’ intention to use artificial intelligence for effective library service delivery: A partial least square-structural equation modeling-based approach. Dutse Journal of Pure and Applied Sciences, 9(1b), 1-14.
[2] Dube, T. V. (2025). Research data management in academic libraries: institutional repositories as a reservoir for research data. Library Management, 46(5), 319-331.
[3] Fahimullah, M., Ahvar, S., Agarwal, M., & Trocan, M. (2024). Machine learning-based solutions for resource management in fog computing. Multimedia Tools and Applications, 83(8), 23019-23045.
[4] Kulkanjanapiban, P., Silwattananusarn, T., & Lambovska, M. (2025). Research on AI-driven innovations and services in academic libraries: A bibliometric and systematic literature review. Journal of Data and Information Science, 10(4), 146-196.
[5] Anjum, S., Upadhyay, D., Singh, K., & Upadhyay, P. (2024, March). Machine learning-based resource allocation algorithms for 6G networks. In 2024 2nd International Conference on Disruptive Technologies (ICDT) (pp. 1086-1091). IEEE.
[6] Zhou, H. (2023). A novel approach to cloud resource management: hybrid machine learning and task scheduling. Journal of Grid Computing, 21(4), 68.
[7] Li, Y., Zhang, X., Zeng, T., Duan, J., Wu, C., Wu, D., & Chen, X. (2023). Task placement and resource allocation for edge machine learning: A gnn-based multi-agent reinforcement learning paradigm. IEEE Transactions on Parallel and Distributed Systems, 34(12), 3073-3089.
[8] Zhou, G., Tian, W., Buyya, R., Xue, R., & Song, L. (2024). Deep reinforcement learning-based methods for resource scheduling in cloud computing: A review and future directions. Artificial Intelligence Review, 57(5), 124.
[9] Li, P., Xiao, Z., Wang, X., Huang, K., Huang, Y., & Gao, H. (2023). EPtask: Deep reinforcement learning based energy-efficient and priority-aware task scheduling for dynamic vehicular edge computing. IEEE Transactions on Intelligent Vehicles, 9(1), 1830-1846.
[10] Chahare, P. B. (2024). Cloud technology for enhanced academic library services: A comprehensive review. InSight Bulletin, 1(2), 1-5.
[11] Sinha, P., A, S., & Sinha, M. K. (2025). Research data management services in academic libraries: A comparative study of South Asia and Southeast Asia. Global Knowledge, Memory and Communication, 74(3-4), 777-793.
[12] Bhat, J. A., & Hasan, S. (2024). A comprehensive overview of digital preservation in the digital library landscape. Academic Libraries, 220.
[13] Saidi, K., & Bardou, D. (2023). Task scheduling and VM placement to resource allocation in Cloud computing: challenges and opportunities. Cluster Computing, 26(5), 3069-3087.
[14] Pal, S., Jhanjhi, N. Z., Abdulbaqi, A. S., Akila, D., Alsubaei, F. S., & Almazroi, A. A. (2023). An intelligent task scheduling model for hybrid internet of things and cloud environment for big data applications. Sustainability, 15(6), 5104.
[15] Tang, S., Yu, Y., Wang, H., Wang, G., Chen, W., Xu, Z., ... & Gao, W. (2023). A survey on scheduling techniques in computing and network convergence. IEEE Communications Surveys & Tutorials, 26(1), 160-195.
[16] Abraham, O. L., Ngadi, M. A. B., Sharif, J. B. M., & Sidik, M. K. M. (2024). Task scheduling in cloud environment–Techniques, applications, and tools: A systematic literature review. IEEE Access, 12, 138252-138279.
[17] Tang, S., Yu, Y., Wang, H., Wang, G., Chen, W., Xu, Z., ... & Gao, W. (2023). A survey on scheduling techniques in computing and network convergence. IEEE Communications Surveys & Tutorials, 26(1), 160-195.
[18] Banerjee, P., Roy, S., Sinha, A., Hassan, M. M., Burje, S., Agrawal, A., ... & El-Shafai, W. (2023). MTD-DHJS: makespan-optimized task scheduling algorithm for cloud computing with dynamic computational time prediction. IEEE Access, 11, 105578-105618.
[19] Sanjalawe, Y., Al-E’mari, S., Fraihat, S., & Makhadmeh, S. (2025). AI-driven job scheduling in cloud computing: a comprehensive review. Artificial Intelligence Review, 58(7), 197.
[20] Singh, G., & Chaturvedi, A. K. (2024). Hybrid modified particle swarm optimization with genetic algorithm (GA) based workflow scheduling in cloud-fog environment for multi-objective optimization. Cluster Computing, 27(2), 1947-1964.
[21] Kareem Awad, W., Zainol Ariffin, K. A., Nazri, M. Z. A., & Yassen, E. T. (2025). Resource allocation strategies and task scheduling algorithms for cloud computing: A systematic literature review. Journal of Intelligent Systems, 34(1), 20240441.
[22] Jalali Khalil Abadi, Z., Mansouri, N., & Javidi, M. M. (2024). Deep reinforcement learning-based scheduling in distributed systems: a critical review. Knowledge and Information Systems, 66(10), 5709-5782.
[23] Lu, X., Liu, C., Zhu, S., Mao, Y., Lio, P., & Hui, P. (2023). RLPTO: A reinforcement learning-based performance-time optimized task and resource scheduling mechanism for distributed machine learning. IEEE Transactions on Parallel and Distributed Systems, 34(12), 3266-3279.
[24] Agarwal, G., Gupta, S., Ahuja, R., & Rai, A. K. (2023). Multiprocessor task scheduling using multi-objective hybrid genetic Algorithm in Fog–cloud computing. Knowledge-Based Systems, 272, 110563.
[25] Prity, F. S., Uddin, K. A., & Nath, N. (2024). Exploring swarm intelligence optimization techniques for task scheduling in cloud computing: algorithms, performance analysis, and future prospects. Iran Journal of Computer Science, 7(2), 337-358.
[26] Khiat, A., Haddadi, M., & Bahnes, N. (2024). Genetic-based algorithm for task scheduling in fog–cloud environment. Journal of Network and Systems Management, 32(1), 3.
[27] Reiss, C., Wilkes, J., & Hellerstein, J. L. (2011). Google cluster-usage traces: format+ schema. Google Inc., White Paper, 1, 1-14.
[28] Feitelson, D. G., Tsafrir, D., & Krakov, D. (2014). Experience with using the parallel workloads archive. Journal of Parallel and Distributed Computing, 74(10), 2967-2982.
[29] Zhu, L., Zhang, Z., Liu, L., Feng, L., Lin, P., & Zhang, Y. (2023). Online distributed learning-based load-aware heterogeneous vehicular edge computing. IEEE Sensors Journal, 23(15), 17350-17365.
[30] Liu, W. X., Lu, J., Cai, J., Zhu, Y., Ling, S., & Chen, Q. (2021). DRL-PLink: Deep reinforcement learning with private link approach for mix-flow scheduling in software-defined data-center networks. IEEE Transactions on Network and Service Management, 19(2), 1049-1064.
[31] Khan, A. R. (2024). Dynamic load balancing in cloud computing: optimized RL-based clustering with multi-objective optimized task scheduling. Processes, 12(3), 519.
[32] Hurtado Sanchez, J. A., Casilimas, K., & Caicedo Rendon, O. M. (2022). Deep reinforcement learning for resource management on network slicing: A survey. Sensors, 22(8), 3031.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Can Ma
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
This is an open access article distributed under the terms of the CC BY-NC-SA 4.0, which permits copying, redistributing, remixing, transformation, and building upon the material in any medium so long as the original work is properly cited.
