A partially observable Markov decision process is a generalization of a Markov decision process. A POMDP models an agent decision process in which it is assumed that the system dynamics are determined by an MDP, but the agent cannot directly... Wikipedia