Automatic Evaluation of Cancer Treatment Texts for Gist Inferences and Comprehension

Christopher R. Wolfe, Mitchell Dandignac, Rachel Sullivan, Tatum Moleski and Valerie F. Reyna
Additional contact information
Christopher R. Wolfe: Department of Psychology, Miami University, Oxford, OH, USA
Mitchell Dandignac: Department of Psychology, Miami University, Oxford, OH, USA
Rachel Sullivan: Department of Psychology, Miami University, Oxford, OH, USA
Tatum Moleski: Department of Psychology, Miami University, Oxford, OH, USA
Valerie F. Reyna: Department of Human Development, Cornell University, Ithaca, NY, USA

Medical Decision Making, 2019, vol. 39, issue 8, 939-949

Abstract: Background. It is difficult to write about cancer for laypeople such that everyone understands. One common approach to readability is the Flesch-Kincaid Grade Level (FKGL). However, FKGL has been shown to be less effective than emerging discourse technologies in predicting readability. Objective. Guided by fuzzy-trace theory, we used the discourse technology Coh-Metrix to create a Gist Inference Score (GIS) and applied it to texts from the National Cancer Institute website written for patients and health care providers. We tested the prediction that patient cancer texts with higher GIS scores are likely to be better understood than others. Design. In study 1, all 244 cancer texts were systematically subjected to an automated Coh-Metrix analysis. In study 2, 9 of those patient texts (3 each at high, medium, and low GIS) were systematically converted to fill-the-blanks (Cloze) tests in which readers had to supply the missing words. Participants (162) received 3 texts, 1 at each GIS level. Measures. GIS was measured as the mean of 7 Coh-Metrix variables, and comprehension was measured through a Cloze procedure. Results. Although texts for patients scored lower on FKGL than those for providers, they also scored lower on GIS, suggesting difficulties for readers. In study 2, participants scored higher on the Cloze task for high GIS texts than for low- or medium-GIS texts. High-GIS texts seemed to better lend themselves to correct responses using different words. Limitations. GIS is limited to text and cannot assess inferences made from images. The systematic Cloze procedure worked well in aggregate but does not make fine-grained distinctions. Conclusions. GIS appears to be a useful, theoretically motivated supplement to FKGL for use in research and clinical practice.

Keywords: patient education; psycholinguistics and medical decision making; readability; understanding cancer (search for similar items in EconPapers)
Date: 2019
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://journals.sagepub.com/doi/10.1177/0272989X19874316 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:medema:v:39:y:2019:i:8:p:939-949

DOI: 10.1177/0272989X19874316

Access Statistics for this article

More articles in Medical Decision Making
Bibliographic data for series maintained by SAGE Publications ().