stormvogel.examples.four_state_reachability

4-State POMDP reachability example.

States s1 and s2 share observation z, so the agent cannot distinguish them. Action a (commit) attempts to reach the target with state-dependent probability; action b (evolve) mixes the belief. The initial belief puts weight p on s1 and 1 − p on s2.

Functions

create_4state_reachability_pomdp(...)	Return the 4-state reachability POMDP.
create_4state_reachability_pomdp_variantb(...)	Return the 4-state reachability POMDP.

Module Contents

stormvogel.examples.four_state_reachability.create_4state_reachability_pomdp(p: Fraction | float = Fraction(1, 2)) → stormvogel.model.Model

Return the 4-state reachability POMDP.

Parameters:

p – Initial probability of being in s1 (must be in (0, 1)).

Returns:

A stormvogel POMDP model.

Raises:

ValueError – If p is not in (0, 1).

stormvogel.examples.four_state_reachability.create_4state_reachability_pomdp_variantb(p: Fraction | float = Fraction(1, 2)) → stormvogel.model.Model

Return the 4-state reachability POMDP.

Parameters:

p – Initial probability of being in s1 (must be in (0, 1)).

Returns:

A stormvogel POMDP model.

Raises:

ValueError – If p is not in (0, 1).