stormvogel.examples.mixed_mec

Functions

create_mixed_mec_mdp()

MDP illustrating trivial MECs, non-trivial MECs, and non-MEC cycling.

Module Contents

stormvogel.examples.mixed_mec.create_mixed_mec_mdp()

MDP illustrating trivial MECs, non-trivial MECs, and non-MEC cycling.

States

s0 : entry state; routes to each region s1 : cycle with stochastic exit — NOT a MEC (notmec1) s2 : cycle with stochastic exit — NOT a MEC; labeled “target” (notmec2) s3 : non-trivial MEC via “loop”; “escape” exits to s1 (mec1) s4 : non-trivial MEC via “loop”; “self” self-loops (mec2) s5 : absorbing self-loop — trivial MEC (sink)

Extra actions on s3/s4 highlight that being in an EC is about the existence of a scheduler that stays forever, not that every scheduler does.