On longest consecutive patterns in Markov chains

dc.contributor.advisorErnst, Philip A.
dc.creatorXia, Yizhou
dc.date.accessioned2019-11-12T13:49:31Z
dc.date.available2020-12-01T06:01:10Z
dc.date.created2019-12
dc.date.issued2019-11-11
dc.date.submittedDecember 2019
dc.date.updated2019-11-12T13:49:33Z
dc.description.abstractThe length of longest consecutive head in Bernoulli trials L(n) has been studied extensively and has been found applications in biology, finance and non-parametric statistics. The study of longest consecutive successes in random trials dates the work of de Moivre. Limiting theorems and large deviation results are provided for L(n) with the assumption of existence of stationary distribution. Given a discrete-time homogeneous Markov chain with initial state i, one extension from previous Bernoulli case is to study the distribution of L(j,n), the length of the longest consecutive visits of this chain to state j until time n. Our work focuses on studying L(j,n) for both homogeneous and time-nonhomogeneous Markov chains. In the existing literature, no limiting theorems of L(j,n) are derived under the case of time nonhomogeneous Markov chains. We are able to solve this by first deriving a new exact formula of the distribution of L(j,n) and then derive an upper and lower bound of P(L(j,n)<k) without the assumption of the existence of stationary distribution. Then we offer one convergence in probability theorem and one convergence almost surely theorem of L(j,n). We also offer a limiting result respect to the expectation of L(j,n). We also close an open problem about the large deviation results of L(j,n). We first establish asymptotics for the moment generating function of L(j,n) in general Markov chains without the assumption of the existence of stationary distribution and then we provide two large deviation principles of L(j,n). The existing large deviation results only consider Bernoulli trials and two state homogeneous Markov chains. Last, we provide two extensions. One is to study the length of longest consecutive visit of a pattern in Markov chains and the other one is to study the length of longest consecutive visit of a set of states in Markov chains. We consider Matrix to represent probabilities and theorems of primitive matrix help us to prove limiting theorems. Simulation results are also included.
dc.embargo.terms2020-12-01
dc.format.mimetypeapplication/pdf
dc.identifier.citationXia, Yizhou. "On longest consecutive patterns in Markov chains." (2019) Diss., Rice University. <a href="https://hdl.handle.net/1911/107670">https://hdl.handle.net/1911/107670</a>.
dc.identifier.urihttps://hdl.handle.net/1911/107670
dc.language.isoeng
dc.rightsCopyright is held by the author, unless otherwise indicated. Permission to reuse, publish, or reproduce the work beyond the bounds of fair use or other exemptions to copyright law must be obtained from the copyright holder.
dc.subjectMarkov chain
dc.subjectDiscrete stochastic process
dc.subjectLarge deviation principle
dc.subjectLaw of large number
dc.titleOn longest consecutive patterns in Markov chains
dc.typeThesis
dc.type.materialText
thesis.degree.departmentStatistics
thesis.degree.disciplineEngineering
thesis.degree.grantorRice University
thesis.degree.levelDoctoral
thesis.degree.nameDoctor of Philosophy
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
XIA-DOCUMENT-2019.pdf
Size:
786.71 KB
Format:
Adobe Portable Document Format
License bundle
Now showing 1 - 2 of 2
No Thumbnail Available
Name:
PROQUEST_LICENSE.txt
Size:
5.84 KB
Format:
Plain Text
Description:
No Thumbnail Available
Name:
LICENSE.txt
Size:
2.6 KB
Format:
Plain Text
Description: