Markov chains : models, algorithms and applications /

Saved in:
Bibliographic Details
Edition:2nd ed.
Imprint:New York : Springer, 2013.
Description:1 online resource (xvi, 243 p.) : ill.
Language:English
Series:International series in operations research & management science, 0884-8289 ; 189
International series in operations research & management science ; v.189.
Subject:Markov processes.
Economics.
Distribution (Probability theory)
Operations research.
Economics/Management Science.
Operation Research/Decision Theory.
Operations Research, Management Science.
Probability Theory and Stochastic Processes.
Distribution (Probability theory)
Economics.
Markov processes.
Operations research.
Electronic books.
Electronic books.
Format: E-Resource Book
URL for this record:http://pi.lib.uchicago.edu/1001/cat/bib/9850504
Hidden Bibliographic Details
Other authors / contributors:Ching, Wai Ki, 1969-
ISBN:9781461463122 (electronic bk.)
1461463122 (electronic bk.)
9781461463115 (print)
Notes:Includes bibliographical references and index.
Description based on online resource; title from PDF title page (SpringerLink, viewed May 6, 2013).
Summary:"This new edition of Markov Chains: Models, Algorithms and Applications has been completely reformatted as a text, complete with end-of-chapter exercises, a new focus on management science, new applications of the models, and new examples with applications in financial risk management and modeling of financial data.This book consists of eight chapters. Chapter 1 gives a brief introduction to the classical theory on both discrete and continuous time Markov chains. The relationship between Markov chains of finite states and matrix theory will also be highlighted. Some classical iterative methods for solving linear systems will be introduced for finding the stationary distribution of a Markov chain. The chapter then covers the basic theories and algorithms for hidden Markov models (HMMs) and Markov decision processes (MDPs).Chapter 2 discusses the applications of continuous time Markov chains to model queueing systems and discrete time Markov chain for computing the PageRank, the ranking of websites on the Internet. Chapter 3 studies Markovian models for manufacturing and re-manufacturing systems and presents closed form solutions and fast numerical algorithms for solving the captured systems. In Chapter 4, the authors present a simple hidden Markov model (HMM) with fast numerical algorithms for estimating the model parameters. An application of the HMM for customer classification is also presented. Chapter 5 discusses Markov decision processes for customer lifetime values. Customer Lifetime Values (CLV) is an important concept and quantity in marketing management. The authors present an approach based on Markov decision processes for the calculation of CLV using real data.Chapter 6 considers higher-order Markov chain models, particularly a class of parsimonious higher-order Markov chain models. Efficient estimation methods for model parameters based on linear programming are presented. Contemporary research results on applications to demand predictions, inventory control and financial risk measurement are also presented. In Chapter 7, a class of parsimonious multivariate Markov models is introduced. Again, efficient estimation methods based on linear programming are presented. Applications to demand predictions, inventory control policy and modeling credit ratings data are discussed. Finally, Chapter 8 re-visits hidden Markov models, and the authors present a new class of hidden Markov models with efficient algorithms for estimating the model parameters. Applications to modeling interest rates, credit ratings and default data are discussed."--Publisher description.
Target Audience:"This book is aimed at senior undergraduate students, postgraduate students, professionals, practitioners, and researchers in applied mathematics, computational science, operational research, management science and finance, who are interested in the formulation and computation of queueing networks, Markov chain models and related topics. Readers are expected to have some basic knowledge of probability theory, Markov processes and matrix theory."--Publisher description.
Standard no.:10.1007/978-1-4614-6312-2
LEADER 06377cam a2200637Ia 4500
001 9850504
003 ICU
005 20140128112500.0
006 m o d
007 cr |||
008 130413s2013 xxua eob 001 0 eng d
020 |a 9781461463122 (electronic bk.) 
020 |a 1461463122 (electronic bk.) 
020 |z 9781461463115 (print) 
024 7 |a 10.1007/978-1-4614-6312-2  |2 doi 
035 |a (OCoLC)838812431 
035 |a (ICU)9850504 
040 |a DKDLA  |b eng  |c DKDLA  |d OCLCO  |d ZMC  |d GW5XE  |d NOC  |d N$T  |d COO  |d E7B  |d DEBSZ 
049 |a CGUA 
072 7 |a BUS  |x 019000  |2 bisacsh 
082 0 4 |a 658.40301  |2 23 
090 |a QA274.7  |b .M37 2013 
245 0 0 |a Markov chains :  |b models, algorithms and applications /  |c Wai-Ki Ching...[et al.]. 
250 |a 2nd ed. 
260 |a New York :  |b Springer,  |c 2013. 
300 |a 1 online resource (xvi, 243 p.) :  |b ill. 
336 |a text  |b txt  |2 rdacontent  |0 http://id.loc.gov/vocabulary/contentTypes/txt 
337 |a computer  |b c  |2 rdamedia  |0 http://id.loc.gov/vocabulary/mediaTypes/c 
338 |a online resource  |b cr  |2 rdacarrier  |0 http://id.loc.gov/vocabulary/carriers/cr 
490 1 |a International series in operations research & management science,  |x 0884-8289 ;  |v 189 
504 |a Includes bibliographical references and index. 
505 0 0 |t Introduction --  |t Queueing Systems and the Web --  |t Manufacturing and Re-manufacturing Systems --  |t A Hidden Markov Model for Customer Classification --  |t Markov Decision Processes for Customer Lifetime Value --  |t Higher-Order Markov Chains --  |t Multivariate Markov Chains --  |t Hidden Markov Chains. 
520 2 |a "This new edition of Markov Chains: Models, Algorithms and Applications has been completely reformatted as a text, complete with end-of-chapter exercises, a new focus on management science, new applications of the models, and new examples with applications in financial risk management and modeling of financial data.This book consists of eight chapters. Chapter 1 gives a brief introduction to the classical theory on both discrete and continuous time Markov chains. The relationship between Markov chains of finite states and matrix theory will also be highlighted. Some classical iterative methods for solving linear systems will be introduced for finding the stationary distribution of a Markov chain. The chapter then covers the basic theories and algorithms for hidden Markov models (HMMs) and Markov decision processes (MDPs).Chapter 2 discusses the applications of continuous time Markov chains to model queueing systems and discrete time Markov chain for computing the PageRank, the ranking of websites on the Internet. Chapter 3 studies Markovian models for manufacturing and re-manufacturing systems and presents closed form solutions and fast numerical algorithms for solving the captured systems. In Chapter 4, the authors present a simple hidden Markov model (HMM) with fast numerical algorithms for estimating the model parameters. An application of the HMM for customer classification is also presented. Chapter 5 discusses Markov decision processes for customer lifetime values. Customer Lifetime Values (CLV) is an important concept and quantity in marketing management. The authors present an approach based on Markov decision processes for the calculation of CLV using real data.Chapter 6 considers higher-order Markov chain models, particularly a class of parsimonious higher-order Markov chain models. Efficient estimation methods for model parameters based on linear programming are presented. Contemporary research results on applications to demand predictions, inventory control and financial risk measurement are also presented. In Chapter 7, a class of parsimonious multivariate Markov models is introduced. Again, efficient estimation methods based on linear programming are presented. Applications to demand predictions, inventory control policy and modeling credit ratings data are discussed. Finally, Chapter 8 re-visits hidden Markov models, and the authors present a new class of hidden Markov models with efficient algorithms for estimating the model parameters. Applications to modeling interest rates, credit ratings and default data are discussed."--Publisher description. 
521 |a "This book is aimed at senior undergraduate students, postgraduate students, professionals, practitioners, and researchers in applied mathematics, computational science, operational research, management science and finance, who are interested in the formulation and computation of queueing networks, Markov chain models and related topics. Readers are expected to have some basic knowledge of probability theory, Markov processes and matrix theory."--Publisher description. 
588 |a Description based on online resource; title from PDF title page (SpringerLink, viewed May 6, 2013). 
650 0 |a Markov processes.  |0 http://id.loc.gov/authorities/subjects/sh85081369 
650 0 |a Economics.  |0 http://id.loc.gov/authorities/subjects/sh85040850 
650 0 |a Distribution (Probability theory)  |0 http://id.loc.gov/authorities/subjects/sh85038545 
650 0 |a Operations research.  |0 http://id.loc.gov/authorities/subjects/sh85095020 
650 4 |a Economics/Management Science. 
650 4 |a Operation Research/Decision Theory. 
650 4 |a Operations Research, Management Science. 
650 4 |a Probability Theory and Stochastic Processes. 
650 7 |a Distribution (Probability theory)  |2 fast  |0 http://id.worldcat.org/fast/fst00895600 
650 7 |a Economics.  |2 fast  |0 http://id.worldcat.org/fast/fst00902116 
650 7 |a Markov processes.  |2 fast  |0 http://id.worldcat.org/fast/fst01010347 
650 7 |a Operations research.  |2 fast  |0 http://id.worldcat.org/fast/fst01046387 
655 4 |a Electronic books. 
655 0 |a Electronic books. 
700 1 |a Ching, Wai Ki,  |d 1969-  |0 http://id.loc.gov/authorities/names/n00006067  |1 http://viaf.org/viaf/117366008 
830 0 |a International series in operations research & management science ;  |v v.189. 
856 4 0 |u http://dx.doi.org/10.1007/978-1-4614-6312-2  |y SpringerLink 
903 |a HeVa 
929 |a eresource 
999 f f |i 4eba149d-702a-5a12-9a4b-e898278fd850  |s 889012c3-d2fb-5681-a225-455c94c467d9 
928 |t Library of Congress classification  |a QA274.7 .M37 2013  |l Online  |c UC-FullText  |u http://dx.doi.org/10.1007/978-1-4614-6312-2  |z SpringerLink  |g ebooks  |i 11492426