Inverse matrix-free incremental proximal support vector machine

Publication Type:
Journal Article
Decision Support Systems, 2012, 53 (3), pp. 395 - 405
Issue Date:
Filename Description Size
Thumbnail2011007990OK.pdfPublished Version1.02 MB
Adobe PDF
Full metadata record
Traditional Support Vector Machines (SVMs) based learners are commonly regarded as strong classifiers for many learning tasks. Their efficiency for large-scale high dimensional data, however, has shown to be unsatisfactory. Consequently, many alternative SVM solutions exist for large-scale and/or high dimensional data. Among them, proximal support vector machine (PSVM) is a simple but effective SVM classifier. Its incremental version (ISVM) is also available for large-scale data. Nevertheless, the computational efficiency of the ISVM for high dimensional data still needs to be improved, mainly because it requires explicit matrix inversion for updating the decision model. To solve this problem, we propose, in this paper, an inverse matrix-free incremental PSVM (IMISVM) with the following two characteristics. Firstly, IMISVM avoids explicit matrix inversion and hence derives simple formulas for updating model parameters. Secondly, IMISVM achieves faster convergence speed than ISVM. Experimental results on synthetic and real-world data sets confirm that the proposed incremental classifier outperforms ISVM. © 2012 Elsevier B.V. All rights reserved.
Please use this identifier to cite or link to this item: