mdp.py has no implementation of POMDP value-iteration. It cannot be directly implemented as we need to build a pomdp class. There are subtle differences between an mdp and a pomdp and I would like suggestions on whether to inherit from the mdp class or implement the pomdp class from scratch. @norvig @MrDupin what do you suggest?