Action Value Estimation in Markov Decision Processes - Coding problem | OneNoughtOne