Linear Fitted-Q Iteration with Multiple Reward Functions

Daniel J. Lizotte, Michael Bowling, and Susan A. Murphy. Linear Fitted-Q Iteration with Multiple Reward Functions. Journal of Machine Learning Research, 13:3253–3295, 2012.




We present a general and detailed development of an algorithm for finite-horizon fitted-Q iteration with an arbitrary number of reward signals and linear value function approximation using an arbitrary number of state features. This includes a detailed treatment of the 3-reward function case using triangulation primitives from computational geometry and a method for identifying globally dominated actions. We also present an example of how our methods can be used to construct a real-world decision aid by considering symptom reduction, weight gain, and quality of life in sequential treatments for schizophrenia. Finally, we discuss future directions in which to take this work that will further enable our methods to make a positive impact on the field of evidence-based clinical decision support.


  Title = "Linear Fitted-{Q} Iteration with Multiple Reward Functions",
  Author = "Daniel J. Lizotte and Michael Bowling and Susan A. Murphy",
  Journal = "Journal of Machine Learning Research",
  Volume = "13",
  Pages = "3253--3295",
  Year = "2012"

Generated by (written by Patrick Riley) on Fri Feb 13, 2015 15:54:26