Title: Reinforcement learning with the use of costly features
Authors: Goetschalckx, Robby ×
Sanner, Scott
Driessens, Kurt #
Issue Date: 28-Nov-2008
Publisher: Springer
Series Title: Lecture notes in computer science vol:5323/2008 pages:124-135
Conference: European workshop on reinforcement learning (EWRL) edition:8 location:Villeneuve D'Ascq, France date:30 June - 4 July 2008
Article number: 10
Abstract: In many practical reinforcement learning problems, the state space is too large to permit an exact representation of the value function, much less the time required to compute it. In such cases, a common solution approach is to compute an approximation of the value function in terms of state features. However, relatively little attention has been paid to the cost of computing these state features. For example, search-based features may be useful for value prediction, but their computational cost must be traded off with their impact on value accuracy. To this end, we introduce a new cost-sensitive sparse linear regression paradigm for value function approximation in reinforcement learning where the learner is able to select only those
costly features that are sufficiently informative to justify their computation. We illustrate the learning behavior of our approach using a simple experimental domain that allows us to explore the effects of a range of costs on the cost-performance trade-off.
ISBN: 978-3-540-89721-7
ISSN: 0302-9743
Publication status: published
KU Leuven publication type: IC
Appears in Collections:Informatics Section
× corresponding author
# (joint) last author

Files in This Item:
File Description Status SizeFormat
RobbyEWRL.pdfMain article Accepted 188KbAdobe PDFView/Open


All items in Lirias are protected by copyright, with all rights reserved.

© Web of science