stormvogel.examples.atva20¶

POMDP example from ATVA 2020.

States s0, s5, s6 share observation z0 (white); states s1, s2 share observation z1 (orange); states s3, s4 share observation z2 (yellow).

The agent starts at s0 and can explore within the white cluster or move into the orange cluster. From the orange cluster it can commit to the yellow cluster, where action b leads directly to the goal from s3 and directly to failure from s4.

Functions¶

create_atva20_pomdp(→ stormvogel.model.Model)

Return the ATVA 2020 POMDP example.

Module Contents¶

stormvogel.examples.atva20.create_atva20_pomdp() → stormvogel.model.Model¶

Return the ATVA 2020 POMDP example.

Transitions:

s0  --a-->  s1 (3/5),  s2 (1/5),  s0 (1/5)
s0  --b-->  s5 (1/6),  s6 (1/3),  s0 (1/2)

s5  --a-->  s1 (1)
s5  --b-->  s5 (1/4),  s6 (3/4)

s6  --a-->  s2 (1)
s6  --b-->  s5 (2/3),  s6 (1/3)

s1  --a-->  s3 (1)
s1  --b-->  s3 (2/3),  s4 (1/3)

s2  --a-->  s3 (3/4),  s4 (1/4)
s2  --b-->  s4 (1)

s3  --a-->  goal (2/5),  fail (3/5)
s3  --b-->  goal (1)

s4  --a-->  goal (3/4),  fail (1/4)
s4  --b-->  fail (1)

Returns:: A stormvogel POMDP model.