Self-evaluating participatory research projects: A content validation of the InSPIRES online impact evaluation tool

Content Validity and Reliability of Single Items or Questionnaires

Florence Gignac, Anne-Sophie Gresle, Valeria Santoro Lamelas, Montserrat Yepes-Baldó, Leonardo de la Torre, Maria-Jesus Pinazo and the InSPIRES Consortium

Research Evaluation, 2021, vol. 30, issue 4, 500-513

Abstract: Research projects involving science shops and citizen science in their promotion of participatory approaches are flourishing globally. However, an instrument evaluating the impacts of such approaches at different stages of a participatory research processes has yet to be validated. The InSPIRES H2020 project developed an impact evaluation tool for just this purpose, consisting of 64 items that reflect upon the dimensions of knowledge democracy, citizen-led research, participatory dynamics, transformative change, and integrity. In this article, we seek to test the content validity of this tool and to provide recommendations that can ensure its validity. A panel of nine experts was created to evaluate each item as regards the following three criteria: representativeness, relevance, and clarity. The Aiken’s V and Wilson Score methods were used to assess the tool’s content validity based on the experts’ ratings. Experts’ written comments were also reviewed. At the panel level, 75% of the items were considered satisfactory in relation to each of the three validity criteria. However, at the population level, 72% of the items suggested that parts of the tool were not valid and required revision. The main suggestions from the experts pointed to the need to reformulate items in which the separation between science and society appeared reinforced and to develop more items about the gender perspective of a research project. The revised version of the tool should serve as a well-founded, comprehensive evaluation instrument for on-going and future projects whose goal is to self-reflect and compare participatory research processes.

Keywords: : participatory research; impact evaluation; responsible research and innovation; citizen science; science shops (search for similar items in EconPapers)
Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1093/reseval/rvab026 (application/pdf)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:oup:rseval:v:30:y:2021:i:4:p:500-513.

Access Statistics for this article

Research Evaluation is currently edited by Julia Melkers, Emanuela Reale and Thed van Leeuwen

More articles in Research Evaluation from Oxford University Press
Bibliographic data for series maintained by Oxford University Press ().