Modelling temporal document sequences for clinical ICD coding
File(s)2023.eacl-main.120.pdf (310.11 KB)
Published version
Author(s)
Ng, Boon Liang Clarence
Santos, Diogo
Rei, Marek
Type
Conference Paper
Abstract
Past studies on the ICD coding problem focus on predicting clinical codes primarily based on the discharge summary. This covers only a small fraction of the notes generated during each hospital stay and leaves potential for improving performance by analysing all the available clinical notes. We propose a hierarchical transformer architecture that uses text across the entire sequence of clinical notes in each hospital stay for ICD coding, and incorporates embeddings for text metadata such as their position, time, and type of note. While using all clinical notes increases the quantity of data substantially, superconvergence can be used to reduce training costs. We evaluate the model on the MIMIC-III dataset. Our model exceeds the prior state-of-the-art when using only discharge summaries as input, and achieves further performance improvements when all clinical notes are used as input.
Date Issued
2023
Date Acceptance
2023-05-02
Citation
Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, 2023, pp.1640-1649
Publisher
Association for Computational Linguistics
Start Page
1640
End Page
1649
Journal / Book Title
Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics
Copyright Statement
ACL materials are Copyright © 1963–2024 ACL; other materials are copyrighted by their respective copyright holders. Materials prior to 2016 here are licensed under the Creative Commons Attribution-NonCommercial-ShareAlike 3.0 International License. Permission is granted to make copies for the purposes of teaching and research. Materials published in or after 2016 are licensed on a Creative Commons Attribution 4.0 International License.
License URL
Identifier
http://dx.doi.org/10.18653/v1/2023.eacl-main.120
Source
Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics
Publication Status
Published
Start Date
2023-05-02
Finish Date
2023-05-06
Date Publish Online
2023