IMPROVING THE QUALITY OF RESEARCH SYNTHESIS IN PROGRAM EVALUATION

Fred B. Bryant

Review of Policy Research, 1986, vol. 5, issue 4, 709-721

Abstract: Because research synthesis enables one to determine either the overall effectiveness of different types of treatments, it is becoming increasingly popular as a tool in program evaluation. Numerous methodological problems arise, however, when research synthesis is applied to studies conducted in field settings. The present paper categorlzes and discusses these problems as being threats to either the (1) internal validity (whether one can draw conclusions about cause and effect), (2) statistical conclusion validity (whether one's inferential statistics are capable of detecting cause‐and effect relationships, (3) construct validity (whether one's treatments and outcome measures are valid operationalizations of the independent and dependent variables of interest), or (4) external validity (whether one can generalize results to particular populations, settings, or time periods) of research synthesis (see Cook & Campbell, 1979). Specific recommendations are made for minimizing these threats to validity, In order to improve the quality of research synthesis in program evaluation. Finally, the validit framework is applied to an actual synthesis to identify strengths, weaknesses, and potential means of enhancing research quality.

Date: 1986
References: Add references at CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1111/j.1541-1338.1986.tb00523.x

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:revpol:v:5:y:1986:i:4:p:709-721

Ordering information: This journal article can be ordered from
http://www.wiley.com/bw/subs.asp?ref=1541-132x

Access Statistics for this article

Review of Policy Research is currently edited by Christopher Gore

More articles in Review of Policy Research from Policy Studies Organization Contact information at EDIRC.
Bibliographic data for series maintained by Wiley Content Delivery ().