Evaluating the Impact of Science, Technology and Innovation Programs: a Methodological Toolkit

Gustavo Crespi, Alessandro Maffioli (), Pierre Mohnen and Gonzalo Vázquez ()

No 1104, SPD Working Papers from Inter-American Development Bank, Office of Strategic Planning and Development Effectiveness (SPD)

Abstract: The purpose of this guideline is to provide ideas and technical advice on how to measure the effectiveness of Science, Technology and Innovation Programs (STIP). The paper addresses the specific challenges of evaluating STIP, from the assessment of the intervention logic to the choice of the most appropriate method to solve the attribution problem. Much attention is devoted to the topic of data, discussing pros and cons of different data sources, data quality issues, and strategies for data collection. The paper analyzes in detail the potential application of experimental and quasi-experimental methods to STIP. For each method, the paper highlights characteristics and assumptions, practical issues related to the implementation, and strengths and weakness specifically related to the application to STIP. Other specific issues related to the evaluation of STIP are also considered: the timing of effects, intensity of treatment, multiple treatments, impact heterogeneity, externalities, and general equilibrium effects. Concrete examples of rigorous evaluations of STIP support the discussion of the various topics throughout the guideline.

Keywords: Impact Evaluation; Science; Technology Innovation; Development Effectiveness (search for similar items in EconPapers)
JEL-codes: H43 O12 O14 O22 O31 O32 O38 (search for similar items in EconPapers)
Date: 2011-12
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (12)

Downloads: (external link)
http://www.iadb.org/document.cfm?id=36693990 (application/pdf)
Our link check indicates that this URL is bad, the error code is: 403 Forbidden (http://www.iadb.org/document.cfm?id=36693990 [301 Moved Permanently]--> https://www.iadb.org/document.cfm?id=36693990 [302 Found]--> https://idbdocs.iadb.org/wsdocs/getdocument.aspx?docnum=36693990 [301 Moved Permanently]--> https://wa-p-ezshare-ecmgetdocumentpage.azurewebsites.net:443/getdocument.aspx?docnum=36693990 [301 Moved Permanently]--> https://wa-p-ezshare-ecmgetdocumentpage.azurewebsites.net:443/getdocument?docnum=36693990 [302 Found]--> https://iadb-ezshare-prod.s3.amazonaws.com/IDBDocsPublic/EZSHARE-1728116555-6271?AWSAccessKeyId=AKIA2UJKEGX4WA3MQ7BN&Expires=1743163584&response-cache-control=No-cache&response-content-disposition=attachment%3B%20filename%3DEvaluating%20the%20Impact%20of%20Science_%20Technology%20and%20Innovation%20Programs_%20a%20Methodological%20Toolkit%20%5B36693990%5D.PDF&response-content-type=application%2Fpdf&Signature=KgM7fDeTwH%2BELI3KvOxp%2FcAsmJg%3D)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:idb:spdwps:1104

Access Statistics for this paper

More papers in SPD Working Papers from Inter-American Development Bank, Office of Strategic Planning and Development Effectiveness (SPD) Contact information at EDIRC.
Bibliographic data for series maintained by Felipe Herrera Library ().