Abstract:
When L1-norm support vector machine and L2-norm support vector machine are used to analyse the datasets with small sample, high dimension and high correlation in parts of the variables, the effects of them are not satisfactory. Taking the good advantages of the two methods, an improvement algorithm of doubly regularized support vector machine is proposed. But the inequality constraints and the non-differentiable norm bring many troubles. A positive function and a quadratic polynomial loss function are introduced to change the optimization problem into a differentiable and unconditional constraints one which is easy to compute using many optimization algorithms. Experimental results show the improvement gains better effects.
Key words:
L1-norm support vector machine,
L2-norm support vector machine,
positive function,
quadratic polynomial function,
BFGS algorithm,
doubly regularization
摘要: 针对L1范数支持向量机和L2范数支持向量机在分析部分小样本、高维数、变量高相关的数据时效果不理想的问题,在综合利用这2种支持向量机优点的基础上,提出一种双重正则化支持向量机的改进算法。通过正号函数和二次多项式损失函数将问题转化为可微的无条件约束优化问题,便于采用多种优化算法进行运算。实验结果证明,该改进算法可取得较好的分类准确率。
关键词:
L1范数支持向量机,
L2范数支持向量机,
正号函数,
二次多项式函数,
BFGS算法,
双重正则化
CLC Number:
QIN Chuan-Dong, LIU San-Yang. An Improvement Algorithm of Doubly Regularized Support Vector Machine[J]. Computer Engineering, 2012, 38(24): 179-181.
秦传东, 刘三阳. 一种双重正则化支持向量机的改进算法[J]. 计算机工程, 2012, 38(24): 179-181.