Support Cluster Machine

1
Support Cluster Machine Paper from ICML2007 Read
by Haiqin Yang 2007-10-18
This paper, Support Cluster Machine, was written
by Bin Li, Mingmin Chi, Jianping Fan, Xiangyang
Xue, which was published in 2007.
2
Outline

• Background and Motivation
• Support Cluster Machine - SCM
• Kernel in SCM
• Experiments
• An Interesting Application Privacy-preserving
  Data Mining
• Discussions

3
Background and Motivation

• Large scale classification problem
• Decomposition methods
• Osuna et al., 1997
• Joachims, 1999
• Platt, 1999
• Collobert Bengio, 2001
• Keerthi et al., 2001
• Incremental algorithms
• Cauwenberghs Poggio, 2000
• Fung Mangasarian, 2002
• Laskov et al., 2006

• Parallel techniques
• Collobert et al., 2001
• Graf et al., 2004
• Approximate formula
• Fung Mangasarian, 2001
• Lee Mangasarian, 2001
• Choose representatives
• Active learning - Schohn Cohn, 2003
• Cluster Based-SVM -Yu et al., 2003
• Core Vector Machine (CVM) -Tsang et al., 2005
• Clustering SVM -Boley, D. Cao, 2004

4
Support Cluster Machine - SCM

• Given training samples
• Procedure

5
SCM Solution

• Dual representation
• Decision function

6
Kernel

• Probability product kernel
• By Gaussian assumption, i.e.,
• Hence

7
Kernel

• Property I
• That is
• Decision function
• Property II

8
Experiments

• Datasets
• Toydata
• MNIST