A first course in stachastic processes - Karlin, Samuel; Taylor, Haward M. (New York : Academic Press, 1975)
Elements of stachastic processes
Markov chains
The basic limit theorem of Markov chain and applications
Classical examples of continuos time Markov chains
Renewal processes
Martingales
Keywords: Procesos de Markov; Probabilidades