Discrete-time Markov chains : two-time-scale methods and applications /

Saved in:
Bibliographic Details
Author / Creator:Yin, George, 1954-
Imprint:New York : Springer, c2005.
Description:1 online resource (xix, 347 p.) : ill.
Language:English
Series:Applications of mathematics ; 55
Applications of mathematics ; 55.
Subject:
Format: E-Resource Book
URL for this record:http://pi.lib.uchicago.edu/1001/cat/bib/8874565
Hidden Bibliographic Details
Other authors / contributors:Zhang, Qing, 1959-
ISBN:038721948X (alk. paper)
9780387219486 (alk. paper)
0387268715 (electronic bk.)
9780387268712 (electronic bk.)
6610263094 (electronic bk.)
9786610263097 (electronic bk.)
Notes:Includes bibliographical references and index.
Summary:"This book presents results including asymptotic expansions of probability vectors, structural properties of occupation measures, exponential bounds, aggregation and decomposition and associated limit processes, and interface of discrete-time and continuous-time systems. One of the salient features is that it contains a diverse range of applications on filtering, estimation, control, optimization, Markov decision processes, and financial engineering. This book will be an important reference for researchers in the areas of applied probability, control theory, operations research, as well as for practitioners who use optimization techniques. Part of the book can also be used in a graduate course of applied probability, stochastic processes, and applications."--Jacket.
Other form:Print version: Yin, George, 1954- Discrete-time Markov chains. New York : Springer, c2005 038721948X

MARC

LEADER 00000cam a22000004a 4500
001 8874565
003 ICU
005 20120827142700.0
006 m d
007 cr |n|
008 040512s2005 nyua ob 001 0 eng c
019 |a 133157376  |a 144515892  |a 262677581  |a 320976497 
020 |a 038721948X (alk. paper) 
020 |a 9780387219486 (alk. paper) 
020 |a 0387268715 (electronic bk.) 
020 |a 9780387268712 (electronic bk.) 
020 |a 6610263094 (electronic bk.) 
020 |a 9786610263097 (electronic bk.) 
035 |a (OCoLC)62879335  |z (OCoLC)133157376  |z (OCoLC)144515892  |z (OCoLC)262677581  |z (OCoLC)320976497 
037 |a 978-0-387-21948-6  |b Springer  |n http://www.springerlink.com 
040 |a COO  |b eng  |c COO  |d N$T  |d YDXCP  |d UAB  |d BAKER  |d DKU  |d GW5XE  |d CNTRU  |d OCLCQ  |d MHW  |d TUU  |d OCLCQ 
042 |a pcc 
049 |a CGUA 
072 7 |a QA  |2 lcco 
072 7 |a MAT  |x 029040  |2 bisacsh 
082 0 4 |a 519.2/33  |2 22 
090 |a QA274.7  |b .Y57 2005 
100 1 |a Yin, George,  |d 1954-  |0 http://id.loc.gov/authorities/names/n96040582  |1 http://viaf.org/viaf/114965304 
245 1 0 |a Discrete-time Markov chains :  |b two-time-scale methods and applications /  |c G. George Yin, Qing Zhang. 
260 |a New York :  |b Springer,  |c c2005. 
300 |a 1 online resource (xix, 347 p.) :  |b ill. 
336 |a text  |b txt  |2 rdacontent  |0 http://id.loc.gov/vocabulary/contentTypes/txt 
337 |a computer  |b c  |2 rdamedia  |0 http://id.loc.gov/vocabulary/mediaTypes/c 
338 |a online resource  |b cr  |2 rdacarrier  |0 http://id.loc.gov/vocabulary/carriers/cr 
490 1 |a Applications of mathematics ;  |v 55 
504 |a Includes bibliographical references and index. 
520 1 |a "This book presents results including asymptotic expansions of probability vectors, structural properties of occupation measures, exponential bounds, aggregation and decomposition and associated limit processes, and interface of discrete-time and continuous-time systems. One of the salient features is that it contains a diverse range of applications on filtering, estimation, control, optimization, Markov decision processes, and financial engineering. This book will be an important reference for researchers in the areas of applied probability, control theory, operations research, as well as for practitioners who use optimization techniques. Part of the book can also be used in a graduate course of applied probability, stochastic processes, and applications."--Jacket. 
505 0 |a Introduction, Overview, and Examples; Mathematical Preliminaries; Asymptotic Expansions; Occupation Measures; Exponential Bounds; Interim Summary and Extensions; Stability of Dynamic Systems; Filtering; Markov Decision Processes; LQ Controls; Mean-Variance Controls; Production Planning; Stochastic Approximation. 
650 0 |a Markov processes.  |0 http://id.loc.gov/authorities/subjects/sh85081369 
650 6 |a Markov, Processus de. 
650 7 |a MATHEMATICS  |x Probability & Statistics  |x Stochastic Processes.  |2 bisacsh 
650 1 7 |a Markov-processen.  |2 gtt 
650 1 7 |a Discrete gebeurtenissen.  |2 gtt 
655 4 |a Electronic books. 
650 7 |a Markov processes.  |2 fast  |0 http://id.worldcat.org/fast/fst01010347 
700 1 |a Zhang, Qing,  |d 1959-  |0 http://id.loc.gov/authorities/names/n94043389  |1 http://viaf.org/viaf/68157458 
776 0 8 |i Print version:  |a Yin, George, 1954-  |t Discrete-time Markov chains.  |d New York : Springer, c2005  |z 038721948X  |w (DLC) 2004049169  |w (OCoLC)55286549 
830 0 |a Applications of mathematics ;  |v 55. 
856 4 0 |u http://dx.doi.org/10.1007/b138226  |y SpringerLink 
903 |a HeVa 
035 |a (ICU)8874565 
929 |a eresource 
999 f f |i 3daab5ab-bfc1-5433-b9da-1566b40ec104  |s b6a58e5c-eb72-56c5-8421-e96217f781f9 
928 |t Library of Congress classification  |a QA274.7 .Y57 2005  |l Online  |c UC-FullText  |u http://dx.doi.org/10.1007/b138226  |z SpringerLink  |g ebooks  |i 11472833