Two good links for POMDP value iteration

[Subbarao Kambhampati <rao@asu.edu>]

Here is a longer, more methodical example of value iteration (than is found in R&N)

There is a methodical value iteration example in there: 

  

         http://www.pomdp.org/pomdp/tutorial/pomdp-vi-example.shtml

Also, here is a nice online demo

  http://www.dechelotte.com/en/pomdp.php

Rao