Multiple Kernel Learning (MKL) aims to learn kernel machines for solving a real machine learning problem (e.g. classification) by exploring the combinations of multiple kernels. The traditional MKL approach is in general “shallow” in the sense that the target kernel is simply a linear (or convex) combination of some base kernels. In this paper, we investigate a framework of Multi-Layer Multiple Kernel Learning (MLMKL) that aims to learn “deep” kernel machines by exploring the combinations of multiple kernels in a multi-layer structure, which goes beyond the conventional MKL approach. Through a multiple layer mapping, the proposed MLMKL framework offers higher flexibility than the regular MKL for finding the optimal kernel for applications. As the first attempt to this new MKL framework, we present a two-Layer Multiple Kernel Learning (2LMKL) method together with two efficient algorithms for classification tasks. We analyze their generalization performances and have conducted an extensive set of experiments over 16 benchmark datasets, in which encouraging results showed that our method outperformed the conventional MKL methods.
Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics (AISTATS-11)
City or Country
Fort Lauderdale, FL
Zhuang, JInfeng; Tsang, Ivor W.; and HOI, Chu Hong.
Two-Layer Multiple Kernel Learning. (2011). Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics (AISTATS-11). 909-917. Research Collection School Of Information Systems.
Available at: http://ink.library.smu.edu.sg/sis_research/2293
Copyright Owner and License
Creative Commons License
This work is licensed under a Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 License.