Generating Synthetic Training Data for Supervised De-Identification of Electronic Health Records

Claudia Alessandra Libbi, Jan Trienes, Dolf Trieschnigg and Christin Seifert
Additional contact information
Claudia Alessandra Libbi: Faculty of EEMCS, University of Twente, PO Box 217, 7500 AE Enschede, The Netherlands
Jan Trienes: Nedap Healthcare, 7141 DC Groenlo, The Netherlands
Dolf Trieschnigg: Nedap Healthcare, 7141 DC Groenlo, The Netherlands
Christin Seifert: Faculty of EEMCS, University of Twente, PO Box 217, 7500 AE Enschede, The Netherlands

Future Internet, 2021, vol. 13, issue 5, 1-24

Abstract: A major hurdle in the development of natural language processing (NLP) methods for Electronic Health Records (EHRs) is the lack of large, annotated datasets. Privacy concerns prevent the distribution of EHRs, and the annotation of data is known to be costly and cumbersome. Synthetic data presents a promising solution to the privacy concern, if synthetic data has comparable utility to real data and if it preserves the privacy of patients. However, the generation of synthetic text alone is not useful for NLP because of the lack of annotations. In this work, we propose the use of neural language models (LSTM and GPT-2) for generating artificial EHR text jointly with annotations for named-entity recognition. Our experiments show that artificial documents can be used to train a supervised named-entity recognition model for de-identification, which outperforms a state-of-the-art rule-based baseline. Moreover, we show that combining real data with synthetic data improves the recall of the method, without manual annotation effort. We conduct a user study to gain insights on the privacy of artificial text. We highlight privacy risks associated with language models to inform future research on privacy-preserving automated text generation and metrics for evaluating privacy-preservation during text generation.

Keywords: natural language processing; medical records; privacy protection; synthetic text; generative language models; named-entity recognition; natural language generation (search for similar items in EconPapers)
JEL-codes: O3 (search for similar items in EconPapers)
Date: 2021
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/1999-5903/13/5/136/pdf (application/pdf)
https://www.mdpi.com/1999-5903/13/5/136/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jftint:v:13:y:2021:i:5:p:136-:d:558478

Access Statistics for this article

Future Internet is currently edited by Ms. Grace You

More articles in Future Internet from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().