Systematic study of Markov chains and some of the simpler Markov processes including renewal theory, limit theorems for Markov chains, branching processes, queuing theory, birth and death processes, ...

Markov processes form a fundamental class of stochastic models in which the evolution of a system is delineated by the memoryless property. In such processes, the future state depends solely on the ...

Metastability and random walks constitute central paradigms in the study of stochastic processes, providing deep insights into transient phenomena and long-term dynamics in complex systems.