Publication Type
Journal Article
Version
publishedVersion
Publication Date
12-2007
Abstract
This letter proposes to use multiorder neurons for clustering irregularly shaped data arrangements. Multiorder neurons are an evolutionary extension of the use of higher-order neurons in clustering. Higher-order neurons parametrically model complex neuron shapes by replacing the classic synaptic weight by higher-order tensors. The multiorder neuron goes one step further and eliminates two problems associated with higher-order neurons. First, it uses evolutionary algorithms to select the best neuron order for a given problem. Second, it obtains more information about the underlying data distribution by identifying the correct order for a given cluster of patterns. Empirically we observed that when the correlation of clusters found with ground truth information is used in measuring clustering accuracy, the proposed evolutionary multiorder neurons method can be shown to outperform other related clustering methods. The simulation results from the Iris, Wine, and Glass data sets show significant improvement when compared to the results obtained using self-organizing maps and higher-order neurons. The letter also proposes an intuitive model by which multiorder neurons can be grown, thereby determining the number of clusters in data.
Keywords
Neural networks, clustering
Discipline
Databases and Information Systems | OS and Networks
Research Areas
Data Science and Engineering
Publication
Neural Computation
Volume
19
Issue
12
First Page
3369
Last Page
3391
ISSN
0899-7667
Identifier
10.1162/neco.2007.19.12.3369
Publisher
Massachusetts Institute of Technology Press
Citation
RAMANATHAN, Kiruthika and GUAN, Sheng Uei.
Multi-order Neurons for evolutionary higher order clustering and growth. (2007). Neural Computation. 19, (12), 3369-3391.
Available at: https://ink.library.smu.edu.sg/sis_research/7361
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.
Additional URL
https://doi.org/10.1162/neco.2007.19.12.3369