Parameter Estimation in Semi-Random Decision Tree Ensembling on Streaming Data
Conference Proceeding Article
The induction error in random tree ensembling results mainly from the strength of decision trees and the dependency between base classifiers. In order to reduce the errors due to both factors, a Semi-Random Decision Tree Ensembling (SRDTE) for mining streaming data is proposed based on our previous work on SRMTDS. The model contains semi-random decision trees that are independent in the generation process and have no interaction with each other in the individual decisions of classification. The main idea is to minimize correlation among the classifiers. We claim that the strength of decision trees is closely related to the estimation values of the parameters, including the height of a tree, the count of trees and the parameter of n min in the Hoeffding Bounds. We analyze these parameters of the model and design strategies for better adaptation to streaming data. The main strategies include an incremental generation of sub-trees after seeing real training instances, a data structure for quick search and a voting mechanism for classification. Our evaluation in the 0-1 loss function shows that SRDTE has improved the performance in terms of predictive accuracy and robustness. We have applied SRDTE to e-business data streams and proved its feasibility and effectiveness.
Random decision trees - data streams - parameter estimation
Data Management and Analytics
Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining
LI, Peipei; LIANG, Qianhui (Althea); WU, Xindong; and Hu, X..
Parameter Estimation in Semi-Random Decision Tree Ensembling on Streaming Data. (2009). Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining. 376-388. Research Collection School Of Information Systems.
Available at: http://ink.library.smu.edu.sg/sis_research/454