Single-Pass Distributed Learning of Multi-Class SVMs using Core-Sets

Lodi, Stefano; Nanculef, Ricardo; Sartori, Claudio; Parthasarathy, Srinivasan; Liu, Bing; Goethals, Bart; Pei, Jian; Kamath, Chandrika

Keywords: Support Vector Machines, Distributed Learning

Abstract

We explore a technique to learn Support Vector Models (SVMs) when training data is partitioned among several data sources. The basic idea is to consider SVMs which can be reduced to Minimal Enclosing Ball (MEB) problems in an feature space. Computation of such SVMs can be efficiently achieved by finding a core-set for the image of the data in the feature space. Our main result is that the union of local core-sets provides a close approximation to a global core-set from which the SVM can be recovered. The method requires hence a single pass through each source of data in order to compute local core-sets and then to recover the SVM from its union. Extensive simulations in small and large datasets are presented in order to evaluate its classification accuracy, transmission efficiency and global complexity, comparing its results with a widely used single-pass heuristic to learn standard SVMs.

Más información

Fecha de publicación: 2010
Año de Inicio/Término: 29 Abril 2010 - 01 Mayo 2010
Página de inicio: 257
Página final: 268
Idioma: Inglés
URL: http://dx.doi.org/10.1137/1.9781611972801.23
Notas: http://epubs.siam.org/doi/abs/10.1137/1.9781611972801.23 http://dx.doi.org/10.1137/1.9781611972801.23