Multistate Markov models are frequently used to characterize disease processes, but their estimation from longitudinal data is often hampered by complex patterns of incompleteness. Two algorithms for ...
Erkyihun S.T., E Zagona, B. Rajagopalan, (2017). “Wavelet and Hidden Markov-Based Stochastic Simulation Methods Comparison on Colorado River Streamflow,” Journal of Hydrologic Engineering 2017, 22(9): ...
This paper deals with discrete-time Markov decision processes (MDPs) under constraints where all the objectives have the same form of expected total cost over the infinite time horizon. The existence ...