Title: A simple regression based heuristic for learning model trees
Authors: Vens, Celine ×
Blockeel, Hendrik #
Issue Date: 2006
Publisher: Elsevier Science, Inc.
Series Title: Intelligent Data Analysis vol:10 issue:3 pages:215-236
Abstract: The term "model trees" is commonly used for regression trees that contain some non-trivial model in their leaves. Popular implementations of model tree learners build trees with linear regression models in their leaves. They use reduction of variance as a heuristic for selecting tests during the tree construction process. In this article, we show that systems employing this heuristic may exhibit pathological behaviour in some quite simple cases. This is not visible in the predictive accuracy of the tree, but it reduces its explanatory power. We propose an alternative heuristic that yields equally accurate but simpler trees with better explanatory power, and this at little or no additional computational cost. The resulting model tree induction algorithm is experimentally evaluated and compared with simpler and more complex approaches on a variety of synthetic and real world data sets.
ISSN: 1088-467X
Publication status: published
KU Leuven publication type: IT
Appears in Collections:Informatics Section
× corresponding author
# (joint) last author

Files in This Item:
File Status SizeFormat
41951.pdf Published 297KbAdobe PDFView/Open


All items in Lirias are protected by copyright, with all rights reserved.

© Web of science