Zulip Chat Archive
Stream: Is there code for X?
Topic: Stationary distribution of Markov chains
Markus de Medeiros (Apr 23 2025 at 14:50):
Are there any results proven for the stationary distributions of (discrete time + discrete state) Markov chains?
David Ledvinka (Apr 23 2025 at 21:40):
I don't even think Markov process or the Markov property are defined. As is the case with Martingales I think the initial theory should be given in as general as possible setting and then can become more specialized as it becomes harder to treat the theory in a unified way
David Ledvinka (Apr 23 2025 at 22:02):
Transition kernels are defined however (and a bunch of theory for them). I suppose you could define stationary measure of a Transition kernel.
Markus de Medeiros (Apr 23 2025 at 22:27):
Thanks!
Rémy Degenne (Apr 24 2025 at 05:18):
We have a definition https://leanprover-community.github.io/mathlib4_docs/Mathlib/Probability/Kernel/Invariance.html#ProbabilityTheory.Kernel.Invariant but nothing about it
Matteo Cipollina (Apr 24 2025 at 07:39):
FYI there is some basic framework in this direction here (as part of our ongoing formalization of neural networks) https://github.com/or4nge19/HopfieldNet/blob/master/HopfieldNet/Markov.lean, but the Markov chains part is still at a very early stage yet and an ongoing WIP
Last updated: May 02 2025 at 03:31 UTC