I am looking for something like the \'msm\' package, but for discrete Markov chains. For example, if I had a transition matrix defined as such
Pi <- matrix
You can now use the markovchain package available in CRAN. The user manual. is pretty good and has several examples.
markovchain