FEATURE SELECTION VIA LEAST SQUARES SUPPORT FEATURE MACHINE

Jianping Li, Zhenyu Chen (), Liwei Wei (), Weixuan Xu () and Gang Kou ()
Additional contact information
Zhenyu Chen: Institute of Policy & Management, Chinese Academy of Sciences, Beijing 100080, P.R. China;
Liwei Wei: Institute of Policy & Management, Chinese Academy of Sciences, Beijing 100080, P.R. China;
Weixuan Xu: Institute of Policy & Management, Chinese Academy of Sciences, Beijing 100080, P.R. China
Gang Kou: Thomson Corporation, St. Paul, MN55123, USA

International Journal of Information Technology & Decision Making (IJITDM), 2007, vol. 06, issue 04, 671-686

Abstract: In many applications such as credit risk management, data are represented as high-dimensional feature vectors. It makes the feature selection necessary to reduce the computational complexity, improve the generalization ability and the interpretability. In this paper, we present a novel feature selection method — "Least Squares Support Feature Machine" (LS-SFM). The proposed method has two advantages comparing with conventional Support Vector Machine (SVM) and LS-SVM. First, the convex combinations of basic kernels are used as the kernel and each basic kernel makes use of a single feature. It transforms the feature selection problem that cannot be solved in the context of SVM to an ordinary multiple-parameter learning problem. Second, all parameters are learned by a two stage iterative algorithm. A 1-norm based regularized cost function is used to enforce sparseness of the feature parameters. The "support features" refer to the respective features with nonzero feature parameters. Experimental study on some of the UCI datasets and a commercial credit card dataset demonstrates the effectiveness and efficiency of the proposed approach.

Keywords: Feature selection; Support Vector Machine; credit assessment (search for similar items in EconPapers)
Date: 2007
References: View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.worldscientific.com/doi/abs/10.1142/S0219622007002733
Access to full text is restricted to subscribers

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wsi:ijitdm:v:06:y:2007:i:04:n:s0219622007002733

Ordering information: This journal article can be ordered from

DOI: 10.1142/S0219622007002733

Access Statistics for this article

International Journal of Information Technology & Decision Making (IJITDM) is currently edited by Yong Shi

More articles in International Journal of Information Technology & Decision Making (IJITDM) from World Scientific Publishing Co. Pte. Ltd.
Bibliographic data for series maintained by Tai Tone Lim ().