Quality Performance Measurement Using the Text of Electronic Medical Records

Serguei Pakhomov, Susan Bjornsen, Penny Hanson and Steven Smith
Additional contact information
Serguei Pakhomov: Department of Pharmaceutical Care and Health Systems, University of Minnesota, Rochester, Department of Health Sciences Research, Mayo Clinic, Rochester, Minnesota
Susan Bjornsen: Department of Endocrinology, Mayo Clinic, Rochester, Minnesota
Penny Hanson: Department of Endocrinology, Mayo Clinic, Rochester, Minnesota
Steven Smith: Department of Health Sciences Research, Mayo Clinic, Rochester, Minnesota, pakh0002@umn.edu, Department of Endocrinology, Mayo Clinic, Rochester, Minnesota

Medical Decision Making, 2008, vol. 28, issue 4, 462-470

Abstract: Background. Annual foot examinations (FE) constitute a critical component of care for diabetes. Documented evidence of FE is central to quality-of-care reporting; however, manual abstraction of electronic medical records (EMR) is slow, expensive, and subject to error. The objective of this study was to test the hypothesis that text mining of the EMR results in ascertaining FE evidence with accuracy comparable to manual abstraction. Methods. The text of inpatient and outpatient clinical reports was searched with natural-language (NL) queries for evidence of neurological, vascular, and structural components of FE. A manual medical records audit was used for validation. The reference standard consisted of 3 independent sets used for development ( n=200 ), validation ( n=118 ), and reliability ( n=80 ). Results. The reliability of manual auditing was 91% (95% confidence interval [CI] = 85 — 97) and was determined by comparing the results of an additional audit to the original audit using the records in the reliability set. The accuracy of the NL query requiring 1 of 3 FE components was 89% (95% CI = 83 — 95). The accuracy of the query requiring any 2 of 3 components was 88% (95% CI = 82 — 94). The accuracy of the query requiring all 3 components was 75% (95% CI = 68 — 83). Conclusions. The free text of the EMR is a viable source of information necessary for quality of health care reporting on the evidence of FE for patients with diabetes. The low-cost methodology is scalable to monitoring large numbers of patients and can be used to streamline quality-of-care reporting.

Keywords: performance measures; quality indicators; data mining. (search for similar items in EconPapers)
Date: 2008
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://journals.sagepub.com/doi/10.1177/0272989X08315253 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:medema:v:28:y:2008:i:4:p:462-470

DOI: 10.1177/0272989X08315253

Access Statistics for this article

More articles in Medical Decision Making
Bibliographic data for series maintained by SAGE Publications ().