作者投稿和查稿 主编审稿 专家审稿 编委审稿 远程编辑

›› 2005, Vol. 31 ›› Issue (20): 28-30.

• 论文 • 上一篇    下一篇

一种SVM非线性回归算法

业宁,梁作鹏,董逸生,王厚立   

  1. 东南大学计算机科学与工程系,东南大学计算机科学与工程系,东南大学计算机科学与工程系,南京林业大学信息学院计算机系 南京 210096,南京林业大学信息学院计算机系,南京 210037
  • 发布日期:2005-10-25

SVM Nonlinear Regression Algorithm

YE Ning1,2,LIANG Zuopeng1,DONG Yisheng1,WANG Huoli2   

  1. (1.Department of Computer Science and Engineering,Southeast University,Nanjing 210096;2.Department of Computer Information College,Nanjing Forestry University,Nanjing 210037)
  • Published:2005-10-25

摘要: 提出了一种新的基于分类的SVM非线性回归算法(CSVR),首先将Y扩展为Y+ε和Y-ε两个数据集,再将n维输入空间X中的数据连同Y+ε和Y-ε组成n+1维空间χ中的两类数据,并用Z∈{+1,-1}来标识两类数据,再利用标准的SVM二分类算法求解。利用该算法对一系列的基准函数进行测试,取得了令人满意的结果。该算法对噪声数据不敏感,具有较好的鲁棒性,并且可以根据实际需要设定ε的大小,防止出现过拟合现象。该算法由于不需要先验地建立一个参数未知的回归模型,因此可以用在其他传统统计回归算法失效的场合。

关键词: 非线性, 回归算法, 支持向量机

Abstract: A novel SVM nonlinear regression algorithm based on classification(CSVR) is proposed to solve the difficult problem of obtaining nonlinear regression function Y =f(X) under the condition of having no knowledge about regression model.First,Y is extended into two data sets,Y + ε and Y-ε.Then two n+1 dimension data sets labeled with Z∈{+1,-1} are achieved by adding n-dimension data of input space X to those two data sets.Next the two nonlinear unclassified data sets are transformed to linear classified data sets in a higher dimension feature space by a particular mapping function Φ.Finally,the paper trains the data sets with standard SVM two classification algorithm.Experiment is conducted on a series of benchmark functions and the result shows that the approach is satisfactory.This algorithm is robust and insensitive to noise.It can prevents from over-fitting by setting the value of ε empirically.Since the algorithm does not require a prior regression model with unknown variables,it can be utilized in the circumstances where other traditional statistical regression algorithms fail.

中图分类号: