In this document, we explore in more detail our published work (Komorowski,
Celi, Badawi, Gordon, & Faisal, 2018) for the benefit of the AI in Healthcare
research community. In the above paper, we developed the AI Clinician system,
which demonstrated how reinforcement learning could be used to make useful
recommendations towards optimal treatment decisions from intensive care data.
Since publication a number of authors have reviewed our work (e.g. Abbasi,
2018; Bos, Azoulay, & Martin-Loeches, 2019; Saria, 2018). Given the difference
of our framework to previous work, the fact that we are bridging two very
different academic communities (intensive care and machine learning) and that
our work has impact on a number of other areas with more traditional
computer-based approaches (biosignal processing and control, biomedical
engineering), we are providing here additional details on our recent
publication.