Microsoft Interview Question

Questions surrounding Markov chains etc