Mining with noise knowledge: Error-aware data mining

Publication Type:
Journal Article
Citation:
IEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans, 2008, 38 (4), pp. 917 - 932
Issue Date:
2008-07-01
Metrics:
Full metadata record
Files in This Item:
Filename Description Size
Thumbnail2011000594OK.pdf1.08 MB
Adobe PDF
Real-world data mining deals with noisy information sources where data collection inaccuracy, device limitations, data transmission and discretization errors, or man-made perturbations frequently result in imprecise or vague data. Two common practices are to adopt either data cleansing approaches to enhance the data consistency or simply take noisy data as quality sources and feed them into the data mining algorithms. Either way may substantially sacrifice the mining performance. In this paper, we consider an error-aware (EA) data mining design, which takes advantage of statistical error information (such as noise level and noise distribution) to improve data mining results. We assume that such noise knowledge is available in advance, and we propose a solution to incorporate it into the mining process. More specifically, we use noise knowledge to restore original data distributions, which are further used to rectify the model built from noise-corrupted data. We materialize this concept by the proposed EA naive Bayes classification algorithm. Experimental comparisons on real-world datasets will demonstrate the effectiveness of this design. © 2008 IEEE.
Please use this identifier to cite or link to this item: