"Missing is useful": Missing values in cost-sensitive decision trees

Publication Type:
Journal Article
Citation:
IEEE Transactions on Knowledge and Data Engineering, 2005, 17 (12), pp. 1689 - 1693
Issue Date:
2005-12-01
Metrics:
Full metadata record
Files in This Item:
Filename Description Size
Thumbnail2005000762.pdf969.99 kB
Adobe PDF
Many real-world data sets for machine learning and data mining contain missing values and much previous research regards it as a problem and attempts to impute missing values before training and testing. In this paper, we study this issue in cost-sensitive learning that considers both test costs and misclassification costs. If some attributes (tests) are too expensive in obtaining their values, it would be more cost-effective to miss out their values, similar to skipping expensive and risky tests (missing values) in patient diagnosis (classification). That is, "missing is useful" as missing values actually reduces the total cost of tests and misclassifications and, therefore, it is not meaningful to impute their values. We discuss and compare several strategies that utilize only known values and that "missing is useful" for cost reduction in cost-sensitive decision tree learning. © 2005 IEEE.
Please use this identifier to cite or link to this item: