City Research Online

Robust Classification via Support Vector Machines

Asimit, V. ORCID: 0000-0002-7706-0066, Kyriakou, I. ORCID: 0000-0001-9592-596X, Santoni, S. ORCID: 0000-0002-5928-3901, Scognamiglio, S. and Zhu, R. ORCID: 0000-0002-9944-0369 (2021). Robust Classification via Support Vector Machines. .

Abstract

The loss function choice for any Support Vector Machine classifier has raised great interest in the literature due to the lack of robustness of the Hinge loss, which is the standard loss choice. In this paper, we plan to robustify the binary classifier by maintaining the overall advantages of the Hinge loss, rather than modifying this standard choice. We propose two robust classifiers under data uncertainty. The first is called Single Perturbation SVM (SP-SVM) and provides a constructive method by allowing a controlled perturbation to one feature of the data. The second method is called Extreme Empirical Loss SVM (EEL-SVM) and is based on a new empirical loss estimate, namely, the Extreme Empirical Loss (EEL), that puts more emphasis on extreme violations of the classification hyper-plane, rather than taking the usual sample average with equal importance for all hyper-plane violations. Extensive numerical investigation reveals the advantages of the two robust classifiers on simulated data and well-known real datasets.

Publication Type: Monograph (Working Paper)
Additional Information: © 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Subjects: H Social Sciences > HA Statistics
Q Science > QA Mathematics
Departments: Business School > Actuarial Science & Insurance
Date Deposited: 21 Apr 2021 13:25
URI: https://openaccess.city.ac.uk/id/eprint/25936
[img]
Preview
Text - Pre-print
Download (452kB) | Preview

Export

Downloads

Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login