Week - 1 |
Definition of the stochastic process |
Week - 2 |
Definition of Markov Processes |
Week - 3 |
Transition Probabilities |
Week - 4 |
Probability vector and probability matrix |
Week - 5 |
The relationship between first and n-step probability vector |
Week - 6 |
Two state Markov chain |
Week - 7 |
Classifications of states |
Week - 8 |
Limit Theorems |
Week - 9 |
Generationing Functions |
Week - 10 |
Irreducible Markov chain |
Week - 11 |
Reducible Markov chain - I |
Week - 12 |
Reducible Markov chain - II |
Week - 13 |
Embeding time and probabilities at Finite Markov chains - I |
Week - 14 |
Embeding time and probabilities at Finite Markov chains - II |