This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication

Year(s) from:  to 
Keywords (separated by spaces):

Fast Algorithms for Linear and Kernel SVM+

Wen Li and Dengxin Dai and Mingkui Tan and Dong Xu and Luc Van Gool
Computer Vision and Pattern Recognition (CVPR)
July 2016


The SVM+ approach has shown excellent performance in visual recognition tasks for exploiting privileged information in the training data. In this paper, we propose two efficient algorithms for solving the linear and kernel SVM+, respectively. For linear SVM+, we absorb the bias term into the weight vector, and formulate a new optimization problem with simpler constraints in the dual form. Then, we develop an efficient dual coordinate descent algorithm to solve the new optimization problem. For kernel SVM+, we further apply the ℓ2-loss, which leads to a simpler optimization problem in the dual form with only half of dual variables when compared with the dual form of the original SVM+ method. More interestingly, we show that our new dual problem can be efficiently solved by using the SMO algorithm of the one-class SVM problem. Comprehensive experiments on three datasets clearly demonstrate that our proposed algorithms achieve significant speed-up than the state-of-the-art solvers for linear and kernel SVM+.

Download in pdf format
  author = {Wen Li and Dengxin Dai and Mingkui Tan and Dong Xu and Luc Van Gool},
  title = {Fast Algorithms for Linear and Kernel SVM+},
  booktitle = {Computer Vision and Pattern Recognition (CVPR)},
  year = {2016},
  month = {July},
  keywords = {}