{
"cells": [
{
"cell_type": "markdown",
"id": "f9c68aeb",
"metadata": {},
"source": [
"# Simulator\n",
"If we have a transition system, it might be nice to run a simulation. In this case, we have an MDP that models a hungry lion. Depending on the state it is in, it needs to decide whether it wants to 'rawr' or 'hunt' in order to prevent reaching the state 'dead'."
]
},
{
"cell_type": "code",
"execution_count": 1,
"id": "0dc8f203",
"metadata": {
"execution": {
"iopub.execute_input": "2026-04-16T05:27:12.755407Z",
"iopub.status.busy": "2026-04-16T05:27:12.755162Z",
"iopub.status.idle": "2026-04-16T05:27:13.194017Z",
"shell.execute_reply": "2026-04-16T05:27:13.193400Z"
}
},
"outputs": [
{
"data": {
"text/html": [
"\n",
"\n",
"\n",
" \n",
" Network\n",
" \n",
" \n",
" \n",
" \n",
" \n",
" \n",
" \n",
" \n",
" \n",
"\n"
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/plain": [
""
]
},
"execution_count": 1,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"from stormvogel import *\n",
"\n",
"lion = examples.create_lion_mdp()\n",
"show(lion)"
]
},
{
"cell_type": "markdown",
"id": "b1e3011c",
"metadata": {},
"source": [
"Now, let's run a simulation of the lion! If we do not provide a scheduling function, then the simulator just does a random walk, taking a random choice each time."
]
},
{
"cell_type": "code",
"execution_count": 2,
"id": "1a31fbef",
"metadata": {
"execution": {
"iopub.execute_input": "2026-04-16T05:27:13.201179Z",
"iopub.status.busy": "2026-04-16T05:27:13.200859Z",
"iopub.status.idle": "2026-04-16T05:27:13.203808Z",
"shell.execute_reply": "2026-04-16T05:27:13.203327Z"
},
"lines_to_next_cell": 2
},
"outputs": [],
"source": [
"path = simulate_path(lion, steps=5, seed=1234)"
]
},
{
"cell_type": "markdown",
"id": "9014618b",
"metadata": {
"lines_to_next_cell": 2
},
"source": [
"We could also provide a scheduling function to choose the actions ourselves. This is somewhat similar to the `bird` API."
]
},
{
"cell_type": "code",
"execution_count": 3,
"id": "406cc661",
"metadata": {
"execution": {
"iopub.execute_input": "2026-04-16T05:27:13.205441Z",
"iopub.status.busy": "2026-04-16T05:27:13.205277Z",
"iopub.status.idle": "2026-04-16T05:27:13.208303Z",
"shell.execute_reply": "2026-04-16T05:27:13.207828Z"
},
"lines_to_next_cell": 0
},
"outputs": [],
"source": [
"def scheduler(s: State) -> Action:\n",
" return Action(\"rawr\")\n",
"\n",
"\n",
"path2 = stormvogel.simulator.simulate_path(\n",
" lion, steps=5, seed=1234, scheduler=scheduler\n",
")"
]
},
{
"cell_type": "markdown",
"id": "9f9b1159",
"metadata": {},
"source": [
"We can also use the scheduler to create a partial model. This model contains all the states that have been discovered by the the simulation."
]
},
{
"cell_type": "code",
"execution_count": 4,
"id": "7aa955a0",
"metadata": {
"execution": {
"iopub.execute_input": "2026-04-16T05:27:13.209907Z",
"iopub.status.busy": "2026-04-16T05:27:13.209745Z",
"iopub.status.idle": "2026-04-16T05:27:13.240690Z",
"shell.execute_reply": "2026-04-16T05:27:13.240083Z"
}
},
"outputs": [
{
"data": {
"text/html": [
"\n",
"\n",
"\n",
" \n",
" Network\n",
" \n",
" \n",
" \n",
" \n",
" \n",
" \n",
" \n",
" \n",
" \n",
"\n"
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/plain": [
""
]
},
"execution_count": 4,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"partial_model = stormvogel.simulator.simulate(\n",
" lion, steps=5, scheduler=scheduler, seed=1234\n",
")\n",
"show(partial_model)"
]
}
],
"metadata": {
"kernelspec": {
"display_name": "Python 3 (ipykernel)",
"language": "python",
"name": "python3"
},
"language_info": {
"codemirror_mode": {
"name": "ipython",
"version": 3
},
"file_extension": ".py",
"mimetype": "text/x-python",
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.12.13"
},
"widgets": {
"application/vnd.jupyter.widget-state+json": {
"state": {
"0f70ae41cc8642f9a2544d40f60dfb17": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "2.0.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "2.0.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "2.0.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border_bottom": null,
"border_left": null,
"border_right": null,
"border_top": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"1ff7751afff946f8b21365c4f629ee5f": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "2.0.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "2.0.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "2.0.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border_bottom": null,
"border_left": null,
"border_right": null,
"border_top": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"2237a8695f4649f48177cbdad8cdaae3": {
"model_module": "@jupyter-widgets/output",
"model_module_version": "1.0.0",
"model_name": "OutputModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/output",
"_model_module_version": "1.0.0",
"_model_name": "OutputModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/output",
"_view_module_version": "1.0.0",
"_view_name": "OutputView",
"layout": "IPY_MODEL_315ec82f21d846e8b608cfbba24c6713",
"msg_id": "",
"outputs": [],
"tabbable": null,
"tooltip": null
}
},
"315ec82f21d846e8b608cfbba24c6713": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "2.0.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "2.0.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "2.0.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border_bottom": null,
"border_left": null,
"border_right": null,
"border_top": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"3424ad5262d54f5ba0aaf3a384bdd295": {
"model_module": "@jupyter-widgets/output",
"model_module_version": "1.0.0",
"model_name": "OutputModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/output",
"_model_module_version": "1.0.0",
"_model_name": "OutputModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/output",
"_view_module_version": "1.0.0",
"_view_name": "OutputView",
"layout": "IPY_MODEL_1ff7751afff946f8b21365c4f629ee5f",
"msg_id": "",
"outputs": [],
"tabbable": null,
"tooltip": null
}
},
"6cd7525545224b468f2a72eaf185fe02": {
"model_module": "@jupyter-widgets/output",
"model_module_version": "1.0.0",
"model_name": "OutputModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/output",
"_model_module_version": "1.0.0",
"_model_name": "OutputModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/output",
"_view_module_version": "1.0.0",
"_view_name": "OutputView",
"layout": "IPY_MODEL_7c583d6426ad42df8246eee6019dfec9",
"msg_id": "",
"outputs": [],
"tabbable": null,
"tooltip": null
}
},
"7c583d6426ad42df8246eee6019dfec9": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "2.0.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "2.0.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "2.0.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border_bottom": null,
"border_left": null,
"border_right": null,
"border_top": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"810f2ffa86524f43970a10604d182d52": {
"model_module": "@jupyter-widgets/output",
"model_module_version": "1.0.0",
"model_name": "OutputModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/output",
"_model_module_version": "1.0.0",
"_model_name": "OutputModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/output",
"_view_module_version": "1.0.0",
"_view_name": "OutputView",
"layout": "IPY_MODEL_0f70ae41cc8642f9a2544d40f60dfb17",
"msg_id": "",
"outputs": [],
"tabbable": null,
"tooltip": null
}
}
},
"version_major": 2,
"version_minor": 0
}
}
},
"nbformat": 4,
"nbformat_minor": 5
}