Publication Type
Journal Article
Version
acceptedVersion
Publication Date
12-2008
Abstract
Extreme learning machine (ELM) represents one of the recent successful approaches in machine learning, particularly for performing pattern classification. One key strength of ELM is the significantly low computational time required for training new classifiers since the weights of the hidden and output nodes are randomly chosen and analytically determined, respectively. In this paper, we address the architectural design of the ELM classifier network, since too few/many hidden nodes employed would lead to underfitting/overfitting issues in pattern classification. In particular, we describe the proposed pruned-ELM (P-ELM) algorithm as a systematic and automated approach for designing ELM classifier network. P-ELM uses statistical methods to measure the relevance of hidden nodes. Beginning from an initial large number of hidden nodes, irrelevant nodes are then pruned by considering their relevance to the class labels. As a result, the architectural design of ELM network classifier can be automated. Empirical study of P-ELM on several commonly used classification benchmark problems and with diverse forms of hidden node functions show that the proposed approach leads to compact network classifiers that generate fast response and robust prediction accuracy on unseen data, comparing with traditional ELM and other popular machine learning approaches.
Keywords
Feedforward networks, Extreme learning machine (ELM), Pattern classification
Discipline
Databases and Information Systems | Numerical Analysis and Scientific Computing
Research Areas
Data Science and Engineering
Publication
Neurocomputing
Volume
72
Issue
1-3
First Page
359
Last Page
366
ISSN
0925-2312
Identifier
10.1016/j.neucom.2008.01.005
Publisher
Elsevier
Citation
RONG, Hai-Jun; ONG, Yew-Soon; TAN, Ah-hwee; and ZHU, Zexuan.
A fast pruned‐extreme learning machine for classification problem. (2008). Neurocomputing. 72, (1-3), 359-366.
Available at: https://ink.library.smu.edu.sg/sis_research/5210
Copyright Owner and License
Authors
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.
Additional URL
https://doi.org/10.1016/j.neucom.2008.01.005
Included in
Databases and Information Systems Commons, Numerical Analysis and Scientific Computing Commons