Erratum: The sentence in Section 6 ``While it is guaranteed that LSPI
will converge... '' is incorrect. The authors acknowledge Ronald Parr
for highlighting that LSPI need not converge--it could oscillate
(Lagoudakis and Parr (2003), see Theorem 7.1).