Developing and validating measures for child welfare agencies to self-monitor fidelity to a child safety intervention

Sarah Kaye and Philip J. Osteen

Children and Youth Services Review, 2011, vol. 33, issue 11, 2146-2151

Abstract: Building evidence of effective practice in child welfare requires practitioners and researchers to know the extent to which programs are implemented in order to understand evaluation results. Fidelity monitoring is a critical strategy for ensuring that evidence-based and promising practices are implemented as intended and can be studied in real-world contexts. This paper addresses challenges to measuring fidelity in child welfare systems and presents an approach taken with one state to define fidelity criteria and measure fidelity to a child safety intervention. Measurement challenges were addressed by using existing documents and case review mechanisms to assess fidelity, and measuring the quality of practitioner judgment using expert reviewers. Validity of fidelity criteria and fidelity review instruments was established through consensus with model developers and local purveyors. Twelve cases were reviewed by a panel of raters to assess inter-rater reliability and discrepancy between local purveyors and model developers. This participatory and capacity-building method can be replicated and used to develop and embed valid and reliable fidelity monitoring systems in public child welfare to continue to build evidence about what works in child welfare services.

Keywords: Child welfare; Fidelity; Reliability; Validity (search for similar items in EconPapers)
Date: 2011
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (4)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0190740911002349
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:cysrev:v:33:y:2011:i:11:p:2146-2151

DOI: 10.1016/j.childyouth.2011.06.020

Access Statistics for this article

Children and Youth Services Review is currently edited by Duncan Lindsey

More articles in Children and Youth Services Review from Elsevier
Bibliographic data for series maintained by Catherine Liu ().