作者投稿和查稿 主编审稿 专家审稿 编委审稿 远程编辑

计算机工程 ›› 2011, Vol. 37 ›› Issue (22): 145-147. doi: 10.3969/j.issn.1000-3428.2011.22.047

• 人工智能及识别技术 • 上一篇    下一篇

最小二乘支持向量机分类的稀疏化方法研究

陈圣磊 1,陈 耿 1,薛 晖 2   

  1. (1. 南京审计学院信息科学学院,南京 211815;2. 东南大学计算机科学与工程学院,南京 210096)
  • 收稿日期:2011-08-12 出版日期:2011-11-18 发布日期:2011-11-20
  • 作者简介:陈圣磊(1977-),男,讲师、博士,主研方向:机器学习,数据挖掘;陈 耿,教授、博士;薛 晖,讲师、博士
  • 基金资助:

    国家自然科学基金资助项目(70971067, 60905002);江苏省高校自然科学重大基础研究基金资助项目(08KJA520001);江苏 省六大人才高峰基金资助项目(2007148);江苏高校“青蓝工程”基金资助项目;江苏政府留学奖学金基金资助项目

Research on Sparsification Approach for Least Squares Support Vector Machine Classification

CHEN Sheng-lei 1, CHEN Geng 1, XUE Hui 2   

  1. (1. School of Information Science, Nanjing Audit University, Nanjing 211815, China; 2. School of Computer Science and Engineering, Southeast University, Nanjing 210096, China)
  • Received:2011-08-12 Online:2011-11-18 Published:2011-11-20

摘要: 最小二乘支持向量机在提高求解效率的同时,会丧失解的稀疏性,导致其在预测新样本时速度较慢。为此,提出一种稀疏化最小二乘支持向量机分类算法。在特征空间中寻找近似线性无关向量组,构造分类判别函数的稀疏表示,相应的最小二乘支持向量机优化问题可以通过线性方程组求解,从而得到最优判别函数。实验结果表明,该算法在不损失分类精度的前提下,能够获得比最小二乘支持向量机更快的预测速度。

关键词: 支持向量机, 最小二乘, 稀疏化, 分类, 特征空间, 二次规划

Abstract: Least Squares Support Vector Machine(LSSVM) increases the algorithm’s efficiency, but the sparsity of the solution is lost, which results in the low prediction speed of new samples. A new sparsified LSSVM classification algorithm is proposed. The approximate linear independent vector set in feature space is first searched and thus the sparse discriminative function can be constructed. The corresponding optimization problem of LSSVM can then be solved through the linear equation set. So the optimal discriminative function is achieved. Experiments show that the prediction speed of the proposed algorithm is faster than that of LSSVM without the loss of classification accuracy.

Key words: Support Vector Machine(SVM), least squares, sparsification, classification, feature space, quadratic programming

中图分类号: