Database System Based on 3Dmax Big Data Mining Technology
DOI:
https://doi.org/10.4108/eetsis.3727Keywords:
Frequent item set, 3Dmax, FP-Growth, Big data mining, Map Reduce Programming ModelAbstract
INTRODUCTION: This project intends to study the mining method of FP-growth frequent items in 3Dmax big data under the Hadoop framework and combined with the Map Reduce development model. Firstly, the transaction database is selected according to the frequency of each transaction and the corresponding projection library is generated. Then the obtained image database is distributed on each node computer. Then, under the guidance of the node machine, the projection is divided into different regions to produce several smaller sub-databases. The method is parallelized by using node machine to generate local frequency items. Finally, all the local frequency sets are merged into one complete frequency set. This method does not need to generate as many FP trees as the regular FP-growth method. This method can overcome the computational failure problem caused by the limited memory of a single computer by the conventional FP-Growth method and other methods. At the same time, because the sublibraries of partitions are similar in size, the load distributed to each node machine is more balanced. The effectiveness of the algorithm is improved.
References
Putera, P. B., Suryanto, S., Ningrum, S., Widianingsih, I., & Rianto, Y. Using convergent parallel mixed methods and datasets for science, technology, and innovation policy dynamics research in Indonesia. ASEAN Journal on Science and Technology for Development,2022; 39(2): 61-68.
Santoso, M. H. Application of Association Rule Method Using Apriori Algorithm to Find Sales Patterns Case Study of Indomaret Tanjung Anom. Brilliance: Research of Artificial Intelligence,2021; 1(2):54-66.
Stylos, N., Zwiegelaar, J., & Buhalis, D. Big data empowered agility for dynamic, volatile, and time-sensitive service industries: the case of tourism sector. International Journal of Contemporary Hospitality Management,2021; 33(3):1015-1036.
Mabrouki, J., Azrour, M., Dhiba, D., Farhaoui, Y., & El Hajjaji, S. IoT-based data logger for weather monitoring using arduino-based wireless sensor networks with remote graphical application and alerts. Big Data Mining and Analytics,2021; 4(1): 25-32.
He, Q., Borgonovi, F., & Suárez‐Álvarez, J. Clustering sequential navigation patterns in multiple‐source reading tasks with dynamic time warping method. Journal of Computer Assisted Learning,2023; 39(3):719-736.
Kh-Madhloom, J. Dynamic Cryptography Integrated Secured Decentralized Applications with Blockchain Programming. Wasit Journal of Computer and Mathematics Science,2022; 1(2): 21-33.
Sunhare, P., Chowdhary, R. R., & Chattopadhyay, M. K. Internet of things and data mining: An application oriented survey. Journal of King Saud University-Computer and Information Sciences, 2022;34(6): 3569-3590.
Haoxiang, W., & Smys, S. Big data analysis and perturbation using data mining algorithm. Journal of Soft Computing Paradigm (JSCP),2021; 3(1): 19-28.
Nahar, K., Shova, B. I., Ria, T., Rashid, H. B., & Islam, A. S. Mining educational data to predict students performance: A comparative study of data mining techniques. Education and Information Technologies, 2021;26(5): 6051-6067.
Arun, S., & Sudharson, K. DEFECT: discover and eradicate fool around node in emergency network using combinatorial techniques. Journal of Ambient Intelligence and Humanized Computing, 2023;14(5):5995-6006.
Nasereddin, M., ALKhamaiseh, A., Qasaimeh, M., & Al-Qassas, R. A systematic review of detection and prevention techniques of SQL injection attacks. Information Security Journal: A Global Perspective,2023; 32(4): 252-265.
Patro, K. K., Jaya Prakash, A., Jayamanmadha Rao, M., & Rajesh Kumar, P. An efficient optimized feature selection with machine learning approach for ECG biometric recognition. IETE Journal of Research,2022; 68(4): 2743-2754.
Hasan, B. M. S., & Abdulazeez, A. M. A review of principal component analysis algorithm for dimensionality reduction. Journal of Soft Computing and Data Mining,2021; 2(1): 20-30.
Garg, S., Sinha, S., Kar, A. K., & Mani, M. A review of machine learning applications in human resource management. International Journal of Productivity and Performance Management,2022; 71(5): 1590-1610.
Nandy, A., Duan, C., & Kulik, H. J. Using machine learning and data mining to leverage community knowledge for the engineering of stable metal–organic frameworks. Journal of the American Chemical Society,2021;143(42):17535-17547.
Rehman, A., Naz, S., & Razzak, I. Leveraging big data analytics in healthcare enhancement: trends, challenges and opportunities. Multimedia Systems,2022; 28(4): 1339-1371.
Xin, W. A. N. G., Zi-Yi, W. A. N. G., Zheng, J. H., & Shao, L. I. TCM network pharmacology: a new trend towards combining computational, experimental and clinical approaches. Chinese Journal of Natural Medicines,2021; 19(1): 1-11.
Chen, X., Zou, D., Xie, H., & Cheng, G. Twenty years of personalized language learning. Educational Technology & Society, 2021;24(1): 205-222.
Alzamily, J. Y. I., Ariffin, S. B., & Abu-Naser, S. S. Classification of Encrypted Images Using Deep Learning–Resnet50. Journal of Theoretical and Applied Information Technology, 2022;100(21): 6610-6620.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Xiaoyu Chen, Junkai Zhang, Pengshan Ren, Xian Hua, Yanfeng Ni
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
This is an open access article distributed under the terms of the CC BY-NC-SA 4.0, which permits copying, redistributing, remixing, transformation, and building upon the material in any medium so long as the original work is properly cited.
Funding data
-
Science and Technology Department of Henan Province
Grant numbers 232102210037
