stormpy.pomdp.developer

Warning

The stormpy developer API is internal and can be subject to change.

Raw pybind11 bindings for storm-pomdp.

This module is only meant for developers. Use stormpy.pomdp for the public API.

The naming of functions and classes of the bindings mirrors the corresponding storm::pomdp C++ functions and classes.

Functions

create_iterative_policy_search(env, pomdp, ...)

Create the iterative policy search for a qualitative reachability query

prepare_pomdp_for_qualitative_search(pomdp, ...)

Make all states absorbing from which the target is not reached almost surely

verify_with_belief_discretization(...)

Approximate an unbounded reachability probability or expected reachability reward by discretizing the belief space

verify_with_belief_unfolding(...)

Approximate an unbounded reachability probability or expected reachability reward by unfolding the belief MDP

Classes

ApplyFiniteSchedulerToPomdp

Transformer applying an unknown finite-state controller to a POMDP

BeliefBasedModelCheckerOptions

Options for belief-based verification of POMDPs

BinaryPomdpTransformer

Transformer making a POMDP binary, i.e., each state has at most two actions

GenerateMonitorVerifier

Generator of POMDP used in verifying monitors against Markov chains

GenerateMonitorVerifierOptions

Options for generating the monitor verifier POMDP

MakePOMDPCanonic

Transformer making the representation of a POMDP canonic

MemlessSearchOptions(self)

Options for the iterative policy search

NondeterministicBeliefTrackerOptions

Options for the nondeterministic belief tracker

ObservationTraceUnfolderOptions(self)

Options for unfolding observation traces

PomdpMemoryBuilder(self)

MemoryBuilder for POMDP policies

PomdpMemoryUnfolder

Transformer unfolding a memory structure into a POMDP

PomdpTransformationResult

Result of a POMDP transformation