You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: lectures/markov_chains_II.md
+15-19Lines changed: 15 additions & 19 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -27,23 +27,19 @@ In addition to what's in Anaconda, this lecture will need the following librarie
27
27
28
28
## Overview
29
29
30
-
Markov chains are a standard way to model time series with some dependence
31
-
between observations.
30
+
This lecture continues the journey in Markov chain.
32
31
33
-
For example,
32
+
Specifically, we will introduce irreducibility and ergodicity, and how they connect to stionarity.
34
33
35
-
* inflation next year depends on inflation this year
36
-
* unemployment next month depends on unemployment this month
34
+
Irreducibility is a concept that describes the ability of a Markov chain to move between any two states in the system.
37
35
38
-
Markov chains are one of the workhorse models of economics and finance.
36
+
Ergodicity is a sample path property that describes the behavior of the system over long periods of time.
39
37
40
-
The theory of Markov chains is beautiful and provides many insights into
41
-
probability and dynamics.
38
+
The concepts of irreducibility and ergodicity are closely related to the idea of stationarity.
42
39
43
-
In this introductory lecture, we will
40
+
An irreducible Markov chain guarantees the existence of a unique stationary distribution, while an ergodic Markov chain ensures that the system eventually reaches its stationary distribution, regardless of its initial state.
44
41
45
-
* review some of the key ideas from the theory of Markov chains and
46
-
* show how Markov chains appear in some economic applications.
42
+
Together, these concepts provide a foundation for understanding the long-term behavior of Markov chains.
47
43
48
44
Let's start with some standard imports:
49
45
@@ -344,7 +340,7 @@ It is still irreducible, however, so ergodicity holds.
344
340
P = np.array([[0, 1],
345
341
[1, 0]])
346
342
ts_length = 10_000
347
-
mc = MarkovChain(P)
343
+
mc = qe.MarkovChain(P)
348
344
n = len(P)
349
345
fig, axes = plt.subplots(nrows=1, ncols=n)
350
346
ψ_star = mc.stationary_distributions[0]
@@ -406,18 +402,18 @@ $$
406
402
407
403
Benhabib el al. {cite}`benhabib_wealth_2019` estimated that the transition matrix for social mobility as the following
0 commit comments