Title: Seeing the forest through the trees: Learning a comprehensible model from an ensemble
Authors: Van Assche, Anneleen ×
Blockeel, Hendrik #
Issue Date: 2007
Publisher: Springer
Host Document: Lecture notes in computer science vol:4701 pages:418-429
Conference: 18th European Conference on Machine Learning location:Warsaw, Poland date:September 17-21, 2007
Abstract: Ensemble methods are popular learning methods that usually increase the predictive accuracy of a classifier though at the cost of interpretability and insight in the decision process. In this paper we aim to overcome this issue of comprehensibility by learning a single decision tree that approximates an ensemble of decision trees. The new model is obtained by exploiting the class distributions predicted by the ensemble. These are employed to compute heuristics for deciding which tests are to be used in the new tree. As such we acquire a model that is able to give insight in the decision process, while being more accurate than the single model directly learned on the data. The proposed method is experimentally evaluated on a large number of UCI data sets, and compared to an existing approach that makes use of artificially generated data.
ISSN: 0302-9743
Publication status: published
KU Leuven publication type: IC
Appears in Collections:Informatics Section
× corresponding author
# (joint) last author

Files in This Item:
File Status SizeFormat
ECML07.pdf Submitted 135KbAdobe PDFView/Open


All items in Lirias are protected by copyright, with all rights reserved.

© Web of science