An_adaptive_multi-class_imbalanced_classification_framework_based_on_ensemble_methods_and_deep_network.pdf (455.04 kB)
An adaptive multi-class imbalanced classification framework based on ensemble methods and deep network
journal contributionposted on 2023-03-14, 11:32 authored by Xuezheng Jiang, Junyi Wang, Qinggang MengQinggang Meng, Mohamad SaadaMohamad Saada, Haibin CaiHaibin Cai
Data imbalance is one of the most difficult problems in machine learning. The improved ensemble learning model is a promising solution to mitigate this challenge. In this paper, an improved multi-class imbalanced data classification framework is proposed by combining the Focal Loss with Boosting model (FL-Boosting). By addressing the confusion of the second-order derivation of Focal Loss in the traditional ensemble learning model, the proposed model achieves a more efficient and accurate classification of the imbalanced data. More specifically, a Highly Adaptive Focal Loss (HAFL) is proposed to ensure that the model maintains lasting attention to the minority samples, which could be combined with boosting model to build HAFL-Boosting to achieve better performance. The framework has the scalability to adapt to different situations according to typical ensemble learning algorithms such as LightGBM, XGBoost and CatBoost. In addition, to implement the application of the proposed framework on deep models, a two-stage classification method combining ConvNeXt with the improved boosting model is proposed, which could improve the recognition ability to high-dimensional imbalanced data. We evaluate the HAFL-Boosting and the two-stage class imbalance classification method by ablation experiments and benchmark experiments, which demonstrated that the proposed methods obviously improved the scores on several evaluation indexes. The comparative experiments with the latest classification models show that the proposed methods could achieve leading performance from multiple perspectives.
Research on Event-Triggered Synchronous Control of Input-Saturated Complex Networks in Network Environment
National Natural Science Foundation of ChinaFind out more...
Guangdong Basic and Applied Basic Research Foundation (2022A1515140126, 2023A1515011172)
Young and Middle-aged Science and Technology Innovation Talent of Shenyang (RC220485)
- Computer Science
Published inNeural Computing and Applications
- AM (Accepted Manuscript)
Rights holderThe Author(s), under exclusive licence to Springer-Verlag London Ltd., part of Springer Nature
DepositorDr Haibin Cai. Deposit date: 14 March 2023