Title: Ensembles of multi-objective decision trees
Authors: Kocev, Dragi ×
Vens, Celine
Struyf, Jan
Dzeroski, Saso #
Issue Date: 2007
Publisher: Springer
Host Document: Lecture notes in computer science vol:4701 pages:624-631
Conference: European Conference on Machine Learning edition:18 location:Warsaw, Poland date:September 17-21, 2007
Abstract: Ensemble methods are able to improve the predictive performance of many base classifiers. Up till now, they have been applied to classifiers that predict a single target attribute. Given the non-trivial interactions that may occur among the different targets in multi-objective prediction tasks, it is unclear whether ensemble methods also improve the performance in this setting. In this paper, we consider two ensemble learning techniques, bagging and random forests, and apply them to multi-objective decision trees (MODTs), which are decision trees that predict multiple target attributes at once. We empirically investigate the performance of ensembles of MODTs. Our most important conclusions are: (1) ensembles of MODTs yield better predictive performance than MODTs, and (2) ensembles of MODTs are equally good, or better than ensembles of single-objective decision trees, i.e., a set of ensembles for each target. Moreover, ensembles of MODTs have smaller model size and are faster to learn than ensembles of single-objective decision trees.
ISBN: 978-3-540-74957-8
ISSN: 0302-9743
Publication status: published
KU Leuven publication type: IC
Appears in Collections:Informatics Section
× corresponding author
# (joint) last author

Files in This Item:
File Status SizeFormat
42796.pdf Published 161KbAdobe PDFView/Open


All items in Lirias are protected by copyright, with all rights reserved.

© Web of science