location: Current position: Home >> Scientific Research >> Paper Publications

Learning imbalanced datasets based on SMOTE and Gaussian distribution

Hits:

Indexed by:Journal Papers

Date of Publication:2020-02-01

Journal:INFORMATION SCIENCES

Included Journals:EI、SCIE

Volume:512

Page Number:1214-1233

ISSN No.:0020-0255

Key Words:Imbalanced; Oversample; Gaussian distribution; SMOTE

Abstract:The learning of imbalanced datasets is a ubiquitous challenge for researchers in the fields of data mining and machine learning. Conventional classifiers are often biased towards the majority class, and loss functions attempt to optimize the quantities. In this paper, we present two effective sampling methods that improve the data distributions. One rebalanced method, the Adaptive-SMOTE, improves the SMOTE method by adaptively selecting groups of Inner and Danger data from the minority class such that a new minority class is compiled based on the selected data, thus preventing an expansion of the category boundary and strengthening the distributional characteristics of the original data. The other method, Gaussian Oversampling, combines dimension reduction with the Gaussian distribution, which makes the tail of the Gaussian distribution thinner. Cross-validation experiments on 15 datasets show that the two sampling methods achieve significant improvements compared with other typical methods. The Adaptive-SMOTE has higher F-measure and Acc values than other existing sampling methods and higher robustness to classifiers and datasets with different values of imb. Gaussian Oversampling is more efficient when dealing with extremely imbalanced classifications. (C) 2019 Elsevier Inc. All rights reserved.

Pre One:Interpretability for Neural Networks from the Perspective of Probability Density

Next One:A new training algorithm for a fuzzy perceptron and its convergence