Quantifying data quality after removing respondents who fail data quality checks

Ross H. Taplin

Current Issues in Tourism, 2025, vol. 28, issue 16, 2570-2581

Abstract: Check Questions (CQs) are used to scrutinise whether respondents are providing quality data and these are becoming more important to ensure data quality, especially with the use of online panels. Often the proportion of people passing these questions are used as a summary of data quality, but this is flawed and of limited value when assessing the quality of a study. This paper introduces a new statistic, the data quality index $\hat{Q}$Qˆ, to measure the quality of data after respondents who fail CQs are removed. This index is interpretable as the estimated proportion of respondents (after excluding respondents who fail the CQs) who answer the survey conscientiously. The index is derived using simple probability, its properties explored, and directions provided on how it should be used and interpreted. The use of $\hat{Q}$Qˆ in published research will increase transparency and confidence in the quality of research findings.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/13683500.2024.2378611 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:rcitxx:v:28:y:2025:i:16:p:2570-2581

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/rcit20

DOI: 10.1080/13683500.2024.2378611

Access Statistics for this article

Current Issues in Tourism is currently edited by Jennifer Tunstall

More articles in Current Issues in Tourism from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().