A novel evolutionary preprocessing method based on over-sampling and under-sampling for imbalanced datasets

Publication Type:
Conference Proceeding
IECON Proceedings (Industrial Electronics Conference), 2013, pp. 2354 - 2359
Issue Date:
Filename Description Size
06699499.pdfPublished version157.75 kB
Adobe PDF
79EE8C8A-8644-427E-B8C3-2CCDB1D9F15D am.pdfaccepted Manuscript Version828.27 kB
Adobe PDF
Full metadata record
Imbalanced datasets are commonly encountered in real-world classification problems. However, many machine learning algorithms are originally designed for well-balanced datasets. Re-sampling has become an important step to preprocess imbalanced dataset. It aims at balancing the datasets by increasing the sample size of the smaller class or decreasing the sample size of the larger class, which are known as over-sampling and under-sampling respectively. In this paper, a novel sampling strategy based on both over-sampling and under-sampling is proposed, in which the new samples of the smaller class are created by the Synthetic Minority Over-sampling Technique (SMOTE). The improvement of the datasets is done by the evolutionary computational method of CHC that works on both the minority class and majority class samples. The result is a hybrid data preprocessing method that combines both over-sampling and under-sampling techniques to re-sample datasets. The evaluation is done by applying the learning algorithm C4.5 to obtain a classification model from the re-sampled datasets. Experimental results reported that the proposed approach can decrease the over-sampling rate about 50% with only around 3% discrepancy on the accuracy. © 2013 IEEE.
Please use this identifier to cite or link to this item: