Deep Learning with SVM

An interesting paper: Deep Learning using Support Vector Machines To date, deep learning for classi cation using fully connected layers and convolutional layers have almost always used softmax layer objective to learn the lower level parameters. There are exceptions, notably the supervised embedding with nonlinear NCA, and semisupervised deep embedding. In this paper, we propose using multiclass SVM's objective to train deep neural nets for classi fication tasks.