Publication Type
Conference Proceeding Article
Version
publishedVersion
Publication Date
1-2000
Abstract
Many data analysts require tools which can integrate their database management packages (e.g. Microsoft Access) with their data analysis ones (e.g. SAS, SPSS), and provide guidance for the selection of appropriate mining algorithms. In addition, the analysts need to extract and validate statistical results to facilitate data mining. In this paper, we describe an integrated data mining system called the Linear Correlation Discovery System (LCDS) that meets the above requirement. LCDS consists of four major sub-components, two of which, the selection assistant and the statistics coupler, are discussed in this paper. The former examines the schema and instances to determine appropriate association measurement functions (e.g. chi-square, linear regression, ANOVA). The latter invokes the appropriate statistical function on a sample data set, and extracts relevant statistical output such as ?2, and R2 for effective mining of data. We also describe a new validation algorithm based on measuring the consistency of mining results applied to multiple test sets.
Discipline
Databases and Information Systems | Numerical Analysis and Scientific Computing
Research Areas
Data Science and Engineering
Publication
Proceedings of the 33rd Hawaii International Conference on System Sciences (HICSS): January 4-7, 2000, Maui, HI
First Page
1
Last Page
10
ISBN
9780769504933
Identifier
10.1109/HICSS.2000.926650
Publisher
IEEE
City or Country
Pistacataway
Citation
CHUA, Cecil; CHIANG, Roger Hsiang-Li; and LIM, Ee Peng.
An integrated data mining system to automate discovery. (2000). Proceedings of the 33rd Hawaii International Conference on System Sciences (HICSS): January 4-7, 2000, Maui, HI. 1-10.
Available at: https://ink.library.smu.edu.sg/sis_research/1005
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.
Additional URL
https://doi.ieeecomputersociety.org/10.1109/HICSS.2000.926650
Included in
Databases and Information Systems Commons, Numerical Analysis and Scientific Computing Commons