Ok, then look at this one. There are some downloadable xla (Excel Add-ins) and a lot of detail on how they were constructed, I think at one point it goes off into VBA land, but I bet you would find it usefull:

http://www.me.utexas.edu/~jensen/ORMM/computation/unit/markov_collection/index.html

based on what you have been saying, I would wager what you are looking for is right here:

http://www.me.utexas.edu/~jensen/ORMM/computation/unit/stoch_mod/index.html