Robustness of Classification Algorithm in the Face of Label Noise
DOI:
https://doi.org/10.4108/eetiot.v9i1.3270Keywords:
Label noise, Machine learning, Transition matrix, Robustness of algorithmAbstract
Label noise is an important part in the process of machine learning. Transition matrix provides an effective way to reduce the impact of label noise on classification algorithm. In this experiment, we study logistic regression algorithm and random forest algorithm. We use the known real transition matrix to evaluate the robustness of the algorithm on two datasets. We also design a transition matrix estimator to estimate the transition matrix of three datasets and evaluate the robustness of the two algorithms. We use average error to evaluate the effectiveness of the transition matrix estimator and the top-1 accuracy to evaluate our method.
Downloads
References
Algan, G., & Ulusoy, I. (2020). Label noise types and their effects on deep learning. arXiv preprint arXiv:2003.10471.
Díaz, A., & Steele, D. (2021). Analysis of classifiers robust to noisy labels. arXiv preprint arXiv:2106.00274.
Frénay, B., & Verleysen, M. (2013). Classification in the presence of label noise: a survey. IEEE transactions on neural networks and learning systems, 25(5), 845-869. DOI: https://doi.org/10.1109/TNNLS.2013.2292894
Han, B., Yao, Q., Yu, X., Niu, G., Xu, M., Hu, W., ... & Sugiyama, M. (2018). Co-teaching: Robust training of deep neural networks with extremely noisy labels. Advances in neural information processing systems, 31.
Hou, T., Zheng, G., Zhang, P., Jia, J., Li, J., Xie, L., Wei, C., & Li, Y. (2014). LAceP: lysine acetylation site prediction using logistic regression classifiers. PloS one, 9(2), e89575. DOI: https://doi.org/10.1371/journal.pone.0089575
Maas, A. E., Rottensteiner, F., & Heipke, C. (2019). A label noise tolerant random forest for the classification of remote sensing data based on outdated maps for training. Computer Vision and Image Understanding, 188, 102782. DOI: https://doi.org/10.1016/j.cviu.2019.07.002
Downloads
Published
How to Cite
Issue
Section
Categories
License
Copyright (c) 2023 EAI Endorsed Transactions on Internet of Things
This work is licensed under a Creative Commons Attribution 3.0 Unported License.
This is an open-access article distributed under the terms of the Creative Commons Attribution CC BY 3.0 license, which permits unlimited use, distribution, and reproduction in any medium so long as the original work is properly cited.
