Repository logo
 

Geometric ergodicity in a weighted sobolev space

Accepted version
Peer-reviewed

Type

Article

Change log

Authors

Devraj, A 
Kontoyiannis, Ioannis  ORCID logo  https://orcid.org/0000-0001-7242-6375
Meyn, S 

Abstract

For a discrete-time Markov chain {X(t)} evolving on with transition kernel P, natural, general conditions are developed under which the following are established:

  1. The transition kernel P has a purely discrete spectrum, when viewed as a linear operator on a weighted Sobolev space Lv,1 of functions with norm, $$ |f|{v,1} = \sup{x \in \Re^\ell} \frac{1}{v(x)} \max {|f(x)|, |\partial_1 f(x)|,\ldots,|\partial_\ell f(x)|}, $$ where v:→[1,) is a Lyapunov function and i:=/xi.
  2. The Markov chain is geometrically ergodic in Lv,1: There is a unique invariant probability measure π and constants B< and δ>0 such that, for each fLv,1, any initial condition X(0)=x, and all t≥0: $$\Big| \text{E}_x[f(X(t))] - \pi(f)\Big| \le Be^{-\delta t}v(x),\quad |\nabla \text{E}_x[f(X(t))] |_2 \le Be^{-\delta t} v(x), $$ where π(f)=∫fdπ.
  3. For any function fLv,1 there is a function hLv,1 solving Poisson's equation: [ h-Ph = f-\pi(f). ] Part of the analysis is based on an operator-theoretic treatment of the sensitivity process that appears in the theory of Lyapunov exponents.

Description

Keywords

Markov chain, stochastic Lyapunov function, discrete spectrum, sensitivity process, weighted Sobolev space, Lyapunov exponent

Journal Title

Annals of Probability

Conference Name

Journal ISSN

0091-1798
2168-894X

Volume Title

48

Publisher

Institute of Mathematical Statistics