Notes: Markov decision processes (MDPs) provide a mathematical framework for modeling decision making in situations where outcomes are partly random and partly under the control of a decision maker. MDPs are used…
Tag: markov
HTK (Hidden Markov Model Toolkit) & Dialog Systems
Notes: The Hidden Markov Model (HMM) Toolkit is a set of software tools and algorithms for working with hidden Markov models (HMMs). HMMs are a type of statistical model that is used…
MCMC (Markov Chain Monte Carlo) & Dialog Systems
Notes: Markov chain Monte Carlo (MCMC) is a statistical method that is used to sample from a complex probability distribution in order to estimate various quantities of interest. MCMC algorithms work by…