Browse All Reviews
Mathematics Of Computing (G)
Probability And Statistics (G.3)
> Markov Processes (G.3...)
All Media Types
1-10 of 22 Reviews about "
Markov Processes (G.3...)
Answer set programming for non-stationary Markov decision processes
Ferreira L., Bianchi R., Santos P., Lopez de Mantaras R. Applied Intelligence 47(4): 993-1007, 2017. Type: Article
Problem solving with computers often involves the exploration of paths from an initial state to a goal state. In addition to the size of this search space, there are many factors complicating this approach, especially in realistic envi...
Mar 13 2018
Markov chains and Markov decision processes in Isabelle/HOL
Hölzl J. Journal of Automated Reasoning 59(3): 345-387, 2017. Type: Article
The intermingling of rather different domains can, at times, produce rather interesting results. Here the author explores the intersection of probability theory (in the guise of Markov chains and Markov decision processes) and formal p...
Jan 11 2018
MixedTrails: Bayesian hypothesis comparison on heterogeneous sequential data
Becker M., Lemmerich F., Singer P., Strohmaier M., Hotho A. Data Mining and Knowledge Discovery 31(5): 1359-1390, 2017. Type: Article
This well-written paper includes adequate definitions to enable a layperson to understand the principles (generative processes of heterogeneous sequence data of human movement in a city) examined in its simulated experimental study. It...
Dec 7 2017
Markov chain aggregation for agent-based models
Banisch S., Springer International Publishing, New York, NY, 2015. 195 pp. Type: Book (978-3-319248-75-2)
Most techniques for modeling dynamic systems fall into one of two categories. Equation-based models such as system dynamics and other differential equation formalisms seek a closed-form expression for the overall dynamics, but typicall...
Jul 12 2017
An examination of HMM-based investment strategies for asset allocation
Erlwein C., Mamon R., Davison M. Applied Stochastic Models in Business and Industry 27(3): 204-221, 2011. Type: Article
Many researchers propose investment strategies to aid investors in buying either growth or value stocks. The authors of this paper have developed two investment strategies--switching investment strategy (SIS) and mixed investm...
Sep 26 2011
Statistical anomaly detection with sensor networks
Paschalidis I., Chen Y. ACM Transactions on Sensor Networks 7(2): 1-23, 2010. Type: Article
When you are entering a dark building at night, the sudden lighting at the door--the sensors at work--may startle you. On a highway, you can speed through a tollgate without stopping because an electronic toll collect...
Feb 25 2011
How long does it take to catch a wild kangaroo?
Montenegro R., Tetali P. STOC 2009 (Proceedings of the 41st Annual ACM Symposium on Theory of Computing, Bethesda, MD, May 31-Jun 2, 2009) 553-560, 2009. Type: Proceedings
The kangaroo in question is Pollard’s kangaroo (or lambda method) , in the distinguished points variant . The eponymous feature of the method is that it has two kangaroos, one tame (or known) and one wild, that make (ps...
Oct 14 2009
Markov chains and stochastic stability
Meyn S., Tweedie R., Cambridge University Press, New York, NY, 2009. 622 pp. Type: Book (9780521731829)
First published in 1993, this second edition is a classic book on Markov chains. As Sean Meyn notes in the preface, this second edition is a way to honor the second author, Richard Tweedie, who passed in 2001, leaving significant contr...
Sep 14 2009
Mathematics and technology
Rousseau C., Saint-Aubin Y., Springer Publishing Company, Incorporated, New York, NY, 2008. 582 pp. Type: Book (9780387692159)
While some find mathematics attractive simply because of its austere beauty, most of us, mere mortals, cope with its intellectual demands primarily because of its utility. The subject is so vast that, in order to cover it, most high sc...
Jun 24 2009
Semi-Markov chains and hidden semi-Markov models toward applications: their use in reliability and DNA analysis
Barbu V., Limnios N., Springer Publishing Company, Incorporated, 2008. 226 pp. Type: Book (9780387731711)
Barbu and Limnios’ goal is to present a complete picture of the basic theory of finite state space semi-Markov processes in discrete time, describe its applications to reliability and DNA analysis, and obtain estimation resul...
Mar 3 2009
Reproduction in whole or in part without permission is prohibited. Copyright 1999-2023 ThinkLoud