Title: Using rule extraction to improve the comprehensibility of predictive models
Authors: Huysmans, Johan
Baesens, Bart
Vanthienen, Jan
Issue Date: 2006
Publisher: K.U.Leuven - Faculty of Economics and Applied Economics
Series Title: DTEW - KBI_0612 pages:1-55
Abstract: Whereas newer machine learning techniques, like artifficial neural net-works and support vector machines, have shown superior performance in various benchmarking studies, the application of these techniques remains largely restricted to research environments. A more widespread adoption of these techniques is foiled by their lack of explanation capability which is required in some application areas, like medical diagnosis or credit scoring. To overcome this restriction, various algorithms have been proposed to extract a meaningful description of the underlying `blackbox' models. These algorithms' dual goal is to mimic the behavior of the black box as closely as possible while at the same time they have to ensure that the extracted description is maximally comprehensible. In this research report, we first develop a formal definition of`rule extraction and comment on the inherent trade-off between accuracy and comprehensibility. Afterwards, we develop a taxonomy by which rule extraction algorithms can be classiffied and discuss some criteria by which these algorithms can be evaluated. Finally, an in-depth review of the most important algorithms is given.This report is concluded by pointing out some general shortcomings of existing techniques and opportunities for future research.
Publication status: published
KU Leuven publication type: IR
Appears in Collections:Research Center for Management Informatics (LIRIS), Leuven

Files in This Item:
File Status SizeFormat
KBI_0612.pdf Published 541KbAdobe PDFView/Open


All items in Lirias are protected by copyright, with all rights reserved.