Title: Speeding up the wrapper feature subset selection in regression by mutual information relevance and redundancy analysis
Authors: Van Dijck, Gert ×
Van Hulle, Marc #
Issue Date: 2006
Publisher: Springer
Series Title: Lecture Notes in Computer Science vol:4131 pages:31-40
Abstract: A hybrid filter/wrapper feature subset selection algorithm for regression is proposed. First, features are filtered by means of a relevance and redundancy filter using mutual information between regression and target variables. We introduce permutation tests to find statistically significant relevant and redundant features. Second, a wrapper searches for good candidate feature subsets by taking the regression model into account. The advantage of a hybrid approach is threefold. First, the filter provides interesting features independently from the regression model and, hence, allows for an easier interpretation. Secondly, because the filter part is computationally less expensive, the global algorithm will faster provide good candidate subsets compared to a stand-alone wrapper approach. Finally, the wrapper takes the bias of the regression model into account, because the regression model guides the search for optimal features. Results are shown for the 'Boston housing' and 'orange juice' benchmarks based on the multilayer perceptron regression model.
ISSN: 0302-9743
Publication status: published
KU Leuven publication type: IT
Appears in Collections:Laboratory for Neuro- and Psychofysiology
Research Group Neurophysiology
× corresponding author
# (joint) last author

Files in This Item:
File Status SizeFormat
id_443.pdf Published 203KbAdobe PDFView/Open Request a copy

These files are only available to some KU Leuven Association staff members


All items in Lirias are protected by copyright, with all rights reserved.

© Web of science