Quality and rigor of the concept mapping methodology: A pooled study analysis

Scott R. Rosas and Mary Kane

Evaluation and Program Planning, 2012, vol. 35, issue 2, 236-245

Abstract: The use of concept mapping in research and evaluation has expanded dramatically over the past 20 years. Researchers in academic, organizational, and community-based settings have applied concept mapping successfully without the benefit of systematic analyses across studies to identify the features of a methodologically sound study. Quantitative characteristics and estimates of quality and rigor that may guide for future studies are lacking. To address this gap, we conducted a pooled analysis of 69 concept mapping studies to describe characteristics across study phases, generate specific indicators of validity and reliability, and examine the relationship between select study characteristics and quality indicators. Individual study characteristics and estimates were pooled and quantitatively summarized, describing the distribution, variation and parameters for each. In addition, variation in the concept mapping data collection in relation to characteristics and estimates was examined. Overall, results suggest concept mapping yields strong internal representational validity and very strong sorting and rating reliability estimates. Validity and reliability were consistently high despite variation in participation and task completion percentages across data collection modes. The implications of these findings as a practical reference to assess the quality and rigor for future concept mapping studies are discussed.

Keywords: Concept mapping; Pooled analysis; Quality; Benchmarking; Validity; Reliability (search for similar items in EconPapers)
Date: 2012
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (43)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0149718911000784
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:epplan:v:35:y:2012:i:2:p:236-245

DOI: 10.1016/j.evalprogplan.2011.10.003

Access Statistics for this article

Evaluation and Program Planning is currently edited by Jonathan A. Morell

More articles in Evaluation and Program Planning from Elsevier
Bibliographic data for series maintained by Catherine Liu ().