In this book, exercises are carried out regarding the following mathematical topics: Markov chains and Markovian stochastic processes time-dependent and time-independent stochastic processes random walks and Brownian motion Initial theoretical hints are also presented to make the performance of the exercises understood.