Controlling the Continuos Positive Airway Pressure-Device Using Partial Observable Markov Decision Processes

Clemens Kreutz () and Josef Honerkamp ()
Additional contact information
Clemens Kreutz: Freiburg Center for Data Analysis and Modeling FDM
Josef Honerkamp: Freiburg Center for Data Analysis and Modeling FDM

A chapter in Modeling, Simulation and Optimization of Complex Processes, 2005, pp 273-286 from Springer

Abstract: Summary Partial Observable Markov Decision Processes (POMDP's) allow finding an optimal control of a hidden Markov model. We develop within this framework a control of a CPAP-device (Continuous Positive Airway Pressure). People who suffer from an obstructive sleep apnoea syndrome may use such a device by which a small additive air pressure is applied to the patient through a mask so that the occlusion of the respiratory tract is prevented. Different values of the pressure will correspond to different actions in the POMDP-approach. We study the performance of a control determined by a POMDP-approach in comparison with other, more traditional control strategies. In commercial devices the applied pressure is held on a constant level, carefully determined in a sleep laboratory. More recently, the pressure is controlled by a classification of the airflow during breathing and then choosing the action in dependence on the classification features. Within the POMDP approach, we introduce the unobservable state of the airway as the hidden state and regard the features of the airflow during breathing as the observations. The parameters of the hidden models are chosen with help of experience from laboratories, where such devices are developed. We will compare the POMDP control with direct control strategies in dependence of parameters of a POMDP model. We will show that the advantage of POMDP control is substantial in general, however, that there are also cases, where the performance of the belief control does not differ too much from some direct control. We discuss, when this does happen and thus find a criterion for the implementation of the POMDP-control instead of a direct control.

Date: 2005
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:sprchp:978-3-540-27170-3_21

Ordering information: This item can be ordered from
http://www.springer.com/9783540271703

DOI: 10.1007/3-540-27170-8_21

Access Statistics for this chapter

More chapters in Springer Books from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().