Consequences of survey modification in a program evaluation: An exploratory research on evaluation study

Colin Braman and Tarek Azzam

Evaluation and Program Planning, 2023, vol. 98, issue C

Abstract: The purpose of this exploratory research on evaluation study was to examine how modified and unmodified scales of critical thinking and interest in science careers would affect the evaluation conclusions. Surveys measuring various outcomes that are used in program evaluation are frequently modified from their original versions in response to the unique context of programs. Modifying existing published surveys by removing or adding items can affect the psychometric properties of the original scale and may produce differing results. The results of the comparisons found that unmodified and modified surveys had similar reliabilities; however, one of the scales produced contradictory evaluation findings. Lessons learned from this study suggest that scales can be modified in evaluation, but great care is needed to address the potential strengths and limitations of the modified scale and balance the technical needs with responsiveness to program context.

Keywords: Modified surveys; Evaluation; Standardized surveys; Research on evaluation; Scales; Evaluative conclusions (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0149718923000514
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:epplan:v:98:y:2023:i:c:s0149718923000514

DOI: 10.1016/j.evalprogplan.2023.102274

Access Statistics for this article

Evaluation and Program Planning is currently edited by Jonathan A. Morell

More articles in Evaluation and Program Planning from Elsevier
Bibliographic data for series maintained by Catherine Liu ().