Zulip Chat Archive

Stream: Is there code for X?

Topic: Stationary distribution of Markov chains


Markus de Medeiros (Apr 23 2025 at 14:50):

Are there any results proven for the stationary distributions of (discrete time + discrete state) Markov chains?

David Ledvinka (Apr 23 2025 at 21:40):

I don't even think Markov process or the Markov property are defined. As is the case with Martingales I think the initial theory should be given in as general as possible setting and then can become more specialized as it becomes harder to treat the theory in a unified way

David Ledvinka (Apr 23 2025 at 22:02):

Transition kernels are defined however (and a bunch of theory for them). I suppose you could define stationary measure of a Transition kernel.

Markus de Medeiros (Apr 23 2025 at 22:27):

Thanks!

Rémy Degenne (Apr 24 2025 at 05:18):

We have a definition https://leanprover-community.github.io/mathlib4_docs/Mathlib/Probability/Kernel/Invariance.html#ProbabilityTheory.Kernel.Invariant but nothing about it

Matteo Cipollina (Apr 24 2025 at 07:39):

FYI there is some basic framework in this direction here (as part of our ongoing formalization of neural networks) https://github.com/or4nge19/HopfieldNet/blob/master/HopfieldNet/Markov.lean, but the Markov chains part is still at a very early stage yet and an ongoing WIP


Last updated: May 02 2025 at 03:31 UTC