Evaluation of Frameworks for MLOps and Microservices





Machine Learning, Machine Learning Operations, Microservices


Information Technology involves solutions for many kinds of industries and organizations, offering conditions for solving problems of different types and complexities. Artificial Intelligence, and more specifically applications that considers Machine Learning (ML) and Software Technology are part of these solutions for solving problems, including solutions for solving problems that involve smart cities approach. In order to present frameworks that deal with the operationalization of Machine Learning and Software technology, this article is based on the study and evaluation of frameworks that involve Machine Learning Operations (MLOps) and microservices. Specifically, three frameworks that integrate ML algorithms with microservices are evaluated based on a bibliographical review in scientific journals of relevance to the area. From an exploratory analysis of these frameworks, it was possible to highlight their main objectives, their benefits, and their ability to offer solutions that favor the large-scale use of Machine Learning algorithms in problem solving. The main results are highlighted in the article through a qualitative analysis that considers six evaluation criteria, such as: capacity for sharing resources, scope of use by users, and use in a cloud environment. The results achieved are satisfactory since the work allows, through a qualitative view of the evaluated frameworks, a perspective of how the integration of MLOps and microservices has been carried out, its benefits and possible results achieved through this integration.


Download data is not yet available.


El Naqa, I., Murphy, M. J. What is machine learning? In: Machine Learning in Radiation Oncology. Springer International Publishing. 2015. 3-11. DOI: https://doi.org/10.1007/978-3-319-18305-3_1

Shinde, P. P., Shah, S. A review of machine learning and deep learning applications. In: 2018 Fourth International Conference on Computing Communication Control and Automation (ICCUBEA) IEEE. 2018. 1-6. DOI: 10.1109/ICCUBEA.2018.8697857. DOI: https://doi.org/10.1109/ICCUBEA.2018.8697857

Silva, R., Silva, M., Caldas, G., Portela, F., Santos, H. Intelligent Dashboards to Monitor the Occurrences in Smart Cities–A Portuguese Case Study. EAI Endorsed Transactions on Smart Cities. 2022; 6(4):1-8. DOI: 10.4108/eetsc.v6i4.2796 DOI: https://doi.org/10.4108/eetsc.v6i4.2796

Adamuscin, A., Golej, J., Panik, M. The challenge for the development of Smart City Concept in Bratislava based on examples of smart cities of Vienna and Amsterdam. EAI Endorsed Transactions on Smart Cities. 2016; 1(1):1-13. DOI: https://doi.org/10.4108/eai.18-7-2016.151629

Yousif, M., Microservices. IEEE Cloud Computing. 2016; 3(5):4-5. DOI: 10.1109/MCC.2016.101. DOI: https://doi.org/10.1109/MCC.2016.101

Larrucea, X. et al. Microservices. IEEE Software. 2018; 35(3), 96-100. DOI: 10.1109/MS.2018.2141030. DOI: https://doi.org/10.1109/MS.2018.2141030

Riehle, D. Framework Design: A role modeling approach. 2000. (Doctoral dissertation). ETH Zurich.

Kreuzberger, D., Kuhl, N., Hirschl, S. Machine Learning Operations (MLOps): Overview, Definition, and Architecture. arXiv preprint arXiv:2205.02302, 2022. DOI: https://doi.org/10.1109/ACCESS.2023.3262138

Symeonidis, G., et al. MLOps-Definitions, Tools, and Challenges. In: 2022 IEEE 12th Annual Computing and Communication Workshop and Conference (CCWC) IEEE. 2022. 453-460. DOI: 10.1109/CCWC54503.2022.9720902. DOI: https://doi.org/10.1109/CCWC54503.2022.9720902

Goyal, A. Machine Learning Operations. International Journal of Information Technology Insights & Transformations. 2020; 4(2).

Thones, J. Microservices. IEEE Software. 2015; 32(1): 116-116. DOI: 10.1109/MS.2015.11. DOI: https://doi.org/10.1109/MS.2015.11

Newman, S. Building Microservices. O'Reilly Media Inc., 2021.

De Lauretis, L. From monolithic architecture to microservices architecture. In: 2019 IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW). IEEE. 2019. 93-96. DOI: 10.1109/ISSREW.2019.00050. DOI: https://doi.org/10.1109/ISSREW.2019.00050

Hassan, S., Bahsoon, R. Microservices and their design trade-offs: A self-adaptive roadmap. In: 2016 IEEE International Conference on Services Computing (SCC). IEEE. 2016. 813-818. DOI: 10.1109/SCC.2016.113. DOI: https://doi.org/10.1109/SCC.2016.113

Jamshidi, P. et al. Microservices: The journey so far and challenges ahead. IEEE Software. 2018; 35(3): 24-35. DOI: 10.1109/MS.2018.2141039. DOI: https://doi.org/10.1109/MS.2018.2141039

Bass, L., Clements, P., Kazman, R. Software Architecture in practice. Boston: Addison-Wesley Professional Publishing, 2003.

Wang, H., Ma, C., Zhou, L. A brief review of Machine Learning and its application. In: 2009 International Conference on Information Engineering and Computer science. IEEE. 2009. 1-4. DOI: 10.1109/ICIECS.2009.5362936. DOI: https://doi.org/10.1109/ICIECS.2009.5362936

Prudius, A. A., Karpunin, A. A., Vlasov, A. I. Analysis of Machine Learning Methods to improve efficiency of Big Data processing in Industry 4.0. Journal of Physics: Conference Series. 2019; 1333(3):1-6. DOI: 10.1088/1742-6596/1333/3/032065. DOI: https://doi.org/10.1088/1742-6596/1333/3/032065

Ayodele, T. O. Types of Machine Learning Algorithms. New Advances in Machine Learning. 2010; 3(1):19-48.

Mohri, M., Rostamizadeh, A., Talwalkar, A. Foundations of Machine Learning. MIT Press, 2018.

Leite, L. et al. A survey of DevOps concepts and challenges. ACM Computing Surveys (CSUR). 2019; 52(6): 1-35. DOI: https://doi.org/10.1145/3359981

Wang, R. Y., Kon, H. B., Madnick, S. E. Data quality requirements analysis and modeling. In: Proceedings of IEEE 9th International Conference on Data Engineering. IEEE. 1993. 670-677. DOI: 10.1109/ICDE.1993.344012. DOI: https://doi.org/10.1109/ICDE.1993.344012

Dyck, A., Penners, R., Lichter, H. Towards definitions for release engineering and DevOps. In: 2015 IEEE/ACM 3rd International Workshop on Release Engineering. IEEE. 2015. 3-3. DOI: 10.1109/RELENG.2015.10. DOI: https://doi.org/10.1109/RELENG.2015.10

Garg, S. et al. On continuous integration/continuous delivery for automated deployment of machine learning models using MLOps. In: 2021 IEEE Fourth International Conference on Artificial Intelligence and Knowledge Engineering (AIKE). IEEE. 2021. 25-28. DOI: 10.1109/AIKE52691.2021.00010. DOI: https://doi.org/10.1109/AIKE52691.2021.00010

Mei, S. et al. Model Provenance Management in MLOps Pipeline. In: 2022 The 8th International Conference on Computing and Data Engineering. 2022. 45-50. DOI: https://doi.org/10.1145/3512850.3512861. DOI: https://doi.org/10.1145/3512850.3512861

Liu, Y. et al. Building A Platform for Machine Learning Operations from OpenSource Frameworks. IFAC-PapersOnLine. 2020; 53(5): 704-709. DOI: https://doi.org/10.1016/j.ifacol.2021.04.161. DOI: https://doi.org/10.1016/j.ifacol.2021.04.161

Raj, E. Engineering MLOps. Packt Publishing, 2021.

Pahl, M., Loipfinger, M. Machine Learning as a reusable microservice. In: NOMS 2018-2018 IEEE/IFIP Network Operations and Management Symposium. IEEE. 2018. 1-7. DOI: 10.1109/NOMS.2018.8406165. DOI: https://doi.org/10.1109/NOMS.2018.8406165

Duvvuri, V. Minerva: A portable Machine Learning Microservice Framework for Traditional Enterprise SaaS applications. arXiv preprint arXiv:2005.00866, 2020. DOI: https://doi.org/10.5121/csit.2020.100410

Ribeiro, J. L. et al. A microservice based architecture topology for machine learning deployment. In: 2019 IEEE International Smart Cities Conference (ISC2). IEEE. 2019. 426-431. DOI: 10.1109/ISC246665.2019.9071708. DOI: https://doi.org/10.1109/ISC246665.2019.9071708




How to Cite

I. Urias and R. Rossi, “Evaluation of Frameworks for MLOps and Microservices”, EAI Endorsed Trans Smart Cities, vol. 7, no. 3, Nov. 2023.