Understanding Markov chains : examples and applications /

Saved in:
Bibliographic Details
Author / Creator:Privault, Nicolas, author.
Edition:Second edition.
Imprint:Singapore : Springer, 2018.
Description:1 online resource (xvii, 372 pages) : illustrations
Language:English
Series:Springer undergraduate mathematics series, 1615-2085
Springer undergraduate mathematics series,
Subject:
Format: E-Resource Book
URL for this record:http://pi.lib.uchicago.edu/1001/cat/bib/11690117
Hidden Bibliographic Details
ISBN:9789811306594
9811306591
9811306583
9789811306587
9789811306600
9811306605
9789811306587
Digital file characteristics:text file PDF
Notes:Includes bibliographical references and indexes.
Online resource; title from PDF title page (SpringerLink, viewed August 8, 2018).
Summary:This book provides an undergraduate-level introduction to discrete and continuous-time Markov chains and their applications, with a particular focus on the first step analysis technique and its applications to average hitting times and ruin probabilities. It also discusses classical topics such as recurrence and transience, stationary and limiting distributions, as well as branching processes. It first examines in detail two important examples (gambling processes and random walks) before presenting the general theory itself in the subsequent chapters. It also provides an introduction to discrete-time martingales and their relation to ruin probabilities and mean exit times, together with a chapter on spatial Poisson processes. The concepts presented are illustrated by examples, 138 exercises and 9 problems with their solutions.--
Other form:Printed edition: 9789811306587
Printed edition: 9789811306600
Standard no.:10.1007/978-981-13-0659-4
10.1007/978-981-13-0

MARC

LEADER 00000cam a2200000Ii 4500
001 11690117
005 20210625185108.5
006 m o d
007 cr cnu|||unuuu
008 180808s2018 si a ob 001 0 eng d
015 |a GBB968257  |2 bnb 
016 7 |a 019340553  |2 Uk 
019 |a 1081254315  |a 1086438456  |a 1096240410  |a 1105181350  |a 1125682811  |a 1136485721  |a 1251926811 
020 |a 9789811306594  |q (electronic bk.) 
020 |a 9811306591  |q (electronic bk.) 
020 |a 9811306583 
020 |a 9789811306587 
020 |a 9789811306600  |q (print) 
020 |a 9811306605 
020 |z 9789811306587  |q (print) 
024 7 |a 10.1007/978-981-13-0659-4  |2 doi 
024 8 |a 10.1007/978-981-13-0 
035 |a (OCoLC)1048003614  |z (OCoLC)1081254315  |z (OCoLC)1086438456  |z (OCoLC)1096240410  |z (OCoLC)1105181350  |z (OCoLC)1125682811  |z (OCoLC)1136485721  |z (OCoLC)1251926811 
035 9 |a (OCLCCM-CC)1048003614 
037 |a com.springer.onix.9789811306594  |b Springer Nature 
040 |a GW5XE  |b eng  |e rda  |e pn  |c GW5XE  |d YDX  |d OCLCF  |d FIE  |d UAB  |d STF  |d OTZ  |d LVT  |d U3W  |d VT2  |d CAUOI  |d MERER  |d LEAUB  |d OCLCQ  |d UKMGB  |d LQU  |d OCLCQ  |d UKAHL  |d EBLCP  |d N$T 
049 |a MAIN 
050 4 |a QA274.7 
072 7 |a PBT  |2 bicssc 
072 7 |a MAT029000  |2 bisacsh 
072 7 |a PBT  |2 thema 
072 7 |a PBWL  |2 thema 
100 1 |a Privault, Nicolas,  |e author.  |0 http://id.loc.gov/authorities/names/no2009054431 
245 1 0 |a Understanding Markov chains :  |b examples and applications /  |c Nicolas Privault. 
250 |a Second edition. 
264 1 |a Singapore :  |b Springer,  |c 2018. 
300 |a 1 online resource (xvii, 372 pages) :  |b illustrations 
336 |a text  |b txt  |2 rdacontent 
337 |a computer  |b c  |2 rdamedia 
338 |a online resource  |b cr  |2 rdacarrier 
347 |a text file  |b PDF  |2 rda 
490 1 |a Springer undergraduate mathematics series,  |x 1615-2085 
504 |a Includes bibliographical references and indexes. 
588 0 |a Online resource; title from PDF title page (SpringerLink, viewed August 8, 2018). 
505 0 |a Probability Background -- Gambling Problems -- Random Walks -- Discrete-Time Markov Chains -- First Step Analysis -- Classification of States -- Long-Run Behavior of Markov Chains -- Branching Processes -- Continuous-Time Markov Chains -- Discrete-Time Martingales -- Spatial Poisson Processes -- Reliability Theory. 
520 |a This book provides an undergraduate-level introduction to discrete and continuous-time Markov chains and their applications, with a particular focus on the first step analysis technique and its applications to average hitting times and ruin probabilities. It also discusses classical topics such as recurrence and transience, stationary and limiting distributions, as well as branching processes. It first examines in detail two important examples (gambling processes and random walks) before presenting the general theory itself in the subsequent chapters. It also provides an introduction to discrete-time martingales and their relation to ruin probabilities and mean exit times, together with a chapter on spatial Poisson processes. The concepts presented are illustrated by examples, 138 exercises and 9 problems with their solutions.--  |c Provided by publisher. 
650 0 |a Markov processes.  |0 http://id.loc.gov/authorities/subjects/sh85081369 
650 7 |a Markov processes.  |2 fast  |0 (OCoLC)fst01010347 
655 0 |a Electronic books. 
655 4 |a Electronic books. 
776 0 8 |i Printed edition:  |z 9789811306587 
776 0 8 |i Printed edition:  |z 9789811306600 
830 0 |a Springer undergraduate mathematics series,  |x 1615-2085  |0 http://id.loc.gov/authorities/names/n97070454 
903 |a HeVa 
929 |a oclccm 
999 f f |i 489ddaf7-9eec-5f67-9b9c-20e8efede92a  |s 862c5355-2ba8-5fbf-9808-72b0c5cb51fe 
928 |t Library of Congress classification  |a QA274.7  |l Online  |c UC-FullText  |u https://link.springer.com/10.1007/978-981-13-0659-4  |z Springer Nature  |g ebooks  |i 12555412