Optimization of Load Balancing and Real-Time Scheduling in Distributed Systems for Cross-Language Text Processing Tasks
DOI:
https://doi.org/10.4108/eetsis.11807Keywords:
Cross-language Text Processing, Distributed Systems, Load Balancing, Real-time Scheduling, Reinforcement LearningAbstract
INTRODUCTION: With the rapid expansion of cross-language text processing applications, distributed systems must support large-scale multilingual workloads with high efficiency and responsiveness. Effective load balancing and real-time scheduling are therefore essential for maintaining system performance. However, many existing approaches rely on static or general-purpose scheduling strategies, which fail to capture language-dependent workload variations, resulting in limited scalability and inefficient resource utilization.
OBJECTIVES: This study aims to improve load balancing efficiency and real-time scheduling performance in distributed systems for cross-language text processing. The focus is on addressing dynamic task variations, heterogeneous resource demands, and robustness challenges in multilingual, noisy, and fluctuating computing environments.
METHODS: A cross-language-aware dynamic load balancing and scheduling optimization framework based on reinforcement learning is proposed. The framework incorporates language pair, task type, priority, input length, estimated resource demand, and real-time node status into an adaptive scheduling strategy. Denoising mechanisms and feature fusion modules are further introduced to enhance scheduling stability and decision robustness.
RESULTS: Experimental results show that the proposed method outperforms existing approaches in response time, resource utilization, and task completion rate. The framework achieves a task completion rate of 96.5%. Under high-noise conditions, the reduction in task completion rate is approximately 50% lower than that of baseline methods, demonstrating improved robustness.
CONCLUSION: The proposed framework provides an effective solution for dynamic scheduling and load balancing in cross-language text processing systems. By coupling multilingual task characteristics with distributed resource states, it offers scalable support for multilingual distributed computing and new insights into reinforcement learning-based scheduling optimization.
References
[1] Nawaz, A. (2025). Advancements in Natural Language Processing for Multilingual Information Retrieval Systems. Multidisciplinary Research in Computing Information Systems, 5(3), 197-216.
[2] Park, G., Park, J., & Lee, H. (2025). Cross-Lingual Summarization for Low-Resource Languages Using Multilingual Retrieval-Based In-Context Learning. Applied Sciences, 15(14), 7800.
[3] Jain, D. (2025). Multilingual and Cross-Linguistic Challenges in NLP. In Transformative Natural Language Processing: Bridging Ambiguity in Healthcare, Legal, and Financial Applications (pp. 157-177). Cham: Springer Nature Switzerland.
[4] Shubham, M. (2024). Breaking Language Barriers: Advancements in Machine Translation for Enhanced Cross-Lingual Information Retrieval. J. Electrical Systems, 20(9s), 2860-2875.
[5] Zhou, G., Tian, W., Buyya, R., Xue, R., & Song, L. (2024). Deep reinforcement learning-based methods for resource scheduling in cloud computing: A review and future directions. Artificial Intelligence Review, 57(5), 124.
[6] Albalawi, N. S. (2025). Dynamic scheduling strategies for cloud-based load balancing in parallel and distributed systems. Journal of Cloud Computing, 14(1), 33.
[7] Li, T., Ying, S., Zhao, Y., & Shang, J. (2023). Batch jobs load balancing scheduling in cloud computing using distributional reinforcement learning. IEEE Transactions on Parallel and Distributed Systems, 35(1), 169-185.
[8] Zhang, S., Zhao, Z., Liu, C., & Qin, S. (2023). Data-intensive workflow scheduling strategy based on deep reinforcement learning in multi-clouds. Journal of Cloud Computing, 12(1), 125.
[9] Devi, N., Dalal, S., Solanki, K., Dalal, S., Lilhore, U. K., Simaiya, S., & Nuristani, N. (2024). A systematic literature review for load balancing and task scheduling techniques in cloud computing. Artificial Intelligence Review, 57(10), 276.
[10] Liu, J., Li, K., Zhu, A., Hong, B., Zhao, P., Dai, S., ... & Su, H. (2024). Application of deep learning-based natural language processing in multilingual sentiment analysis. Mediterranean Journal of Basic and Applied Sciences (MJBAS), 8(2), 243-260.
[11] Huang, Z., Yu, P., & Allan, J. (2023, February). Improving cross-lingual information retrieval on low-resource languages via optimal transport distillation. In Proceedings of the Sixteenth ACM International Conference on Web Search and Data Mining (pp. 1048-1056).
[12] Xu, N., & Wu, Y. (2024, October). Progress in Cross Language Text Sentiment Analysis Based on Deep Learning. In 2024 3rd International Conference on Data Analytics, Computing and Artificial Intelligence (ICDACAI) (pp. 321-325). IEEE.
[13] Agostinelli, V., Alumäe, T., Anastasopoulos, A., Bentivogli, L., Bojar, O., Borg, C., ... & Züfle, M. (2025, July). Findings of the IWSLT 2025 evaluation campaign. In Proceedings of the 22nd International Conference on Spoken Language Translation (IWSLT 2025) (pp. 412-481).
[14] Papi, S., Gaido, M., Karakanta, A., Cettolo, M., Negri, M., & Turchi, M. (2023). Direct speech translation for automatic subtitling. Transactions of the Association for Computational Linguistics, 11, 1355-1376.
[15] Mondal, S. K., Zhang, H., Kabir, H. D., Ni, K., & Dai, H. N. (2023). Machine translation and its evaluation: a study. Artificial Intelligence Review, 56(9), 10137-10226.
[16] NLLB Team. (2024). Scaling neural machine translation to 200 languages. Nature, 630, 841–846.
[17] Guo, X., Adnan, H. M., & Abidin, M. Z. Z. (2024). Detecting offensive language on malay social media: A zero-shot, cross-language transfer approach using dual-branch mbert. Applied Sciences, 14(13), 5777.
[18] Nguyen, N., Takeda, H., & Karunathilake, L. (2025). Empowering Weak Languages Through Cross-Language Hyperlink Recommendation. Information, 16(9), 749.
[19] Gardazi, N. M., Daud, A., Malik, M. K., Bukhari, A., Alsahfi, T., & Alshemaimri, B. (2025). BERT applications in natural language processing: a review. Artificial Intelligence Review, 58(6), 1-49.
[20] Raeisi-Varzaneh, M., Dakkak, O., Fazea, Y., & Kaosar, M. G. (2024). Advanced cost-aware Max–Min workflow tasks allocation and scheduling in cloud computing systems. Cluster computing, 27(9), 13407-13419.
[21] Esmaeili, M. E., Khonsari, A., Sohrabi, V., & Dadlani, A. (2024). Reinforcement learning-based dynamic load balancing in edge computing networks. Computer Communications, 222, 188-197.
[22] Wang, J., Li, S., Zhang, X., Wu, F., & Xie, C. (2024). Deep reinforcement learning task scheduling method based on server real-time performance. PeerJ Computer Science, 10, e2120.
[23] Mangalampalli, S., Karri, G. R., Ratnamani, M. V., Mohanty, S. N., Jabr, B. A., Ali, Y. A., ... & Abdullaeva, B. S. (2024). Efficient deep reinforcement learning based task scheduler in multi cloud environment. Scientific Reports, 14(1), 21850.
[24] Shen, W., Lin, W., Wu, W., Wu, H., & Li, K. (2025). Reinforcement learning-based task scheduling for heterogeneous computing in end-edge-cloud environment. Cluster Computing, 28(3), 179.
[25] Jalali Khalil Abadi, Z., Mansouri, N., & Javidi, M. M. (2024). Deep reinforcement learning-based scheduling in distributed systems: a critical review. Knowledge and Information Systems, 66(10), 5709-5782.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Hongying Pu, Jixiang Wang
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
This is an open access article distributed under the terms of the CC BY-NC-SA 4.0, which permits copying, redistributing, remixing, transformation, and building upon the material in any medium so long as the original work is properly cited.
