Sign consistency for the linear programming discriminant rule

Publisher:
Elsevier BV
Publication Type:
Journal Article
Citation:
Pattern Recognition, 2020, 100, pp. 107083-107083
Issue Date:
2020-04-01
Filename Description Size
1-s2.0-S003132031930384X-main.pdf931.6 kB
Adobe PDF
Full metadata record
Linear discriminant analysis (LDA) is an important conventional model for data classification. Classical theory shows that LDA is Bayes consistent for a fixed data dimensionality p and a large training sample size n. However, in high-dimensional settings when p ≫ n, LDA is difficult due to the inconsistent estimation of the covariance matrix and the mean vectors of populations. Recently, a linear programming discriminant (LPD) rule was proposed for high-dimensional linear discriminant analysis, based on the sparsity assumption over the discriminant function. It is shown that the LPD rule is Bayes consistent in high-dimensional settings. In this paper, we further show that the LPD rule is sign consistent under the sparsity assumption. Such sign consistency ensures the LPD rule to select the optimal discriminative features for high-dimensional data classification problems. Evaluations on both synthetic and real data validate our result on the sign consistency of the LPD rule.
Please use this identifier to cite or link to this item: