Applying the criteria indicators and metrics evaluation method on ICT research: The HUMBOLDT project

Zaheer Khan, David Ludlow and Joachim Rix

Research Evaluation, 2012, vol. 22, issue 1, 30-40

Abstract: Evaluating an Information Technology (IT) based research and development project from an end-user's perspective is necessary in order to discover whether or not the outcomes of the project are successful. However, it is not straightforward to design and implement a generic user evaluation methodology that can be applied to a large-scale collaborative integrated research and development project. In this article, we share our experience based on the research evaluation carried out in a large-scale integrated ICT research project--The HUMBOLDT project. The project develops IT tools and services for cross-border geospatial data harmonization, which are applied to nine different application scenarios. A novel user-oriented evaluation methodology, namely--Criteria Indicators and Metrics (CIM)--is defined and utilized for the evaluation of the project research outcomes. The user evaluation results reveal the extent to which the research and development objectives of the project are achieved, and also demonstrate the benefits and limitations of the evaluation methodology. The results of this article can be usefully applied to other collaborative research projects in a variety of domains. Copyright The Author 2012. Published by Oxford University Press. All rights reserved. For Permissions, please email: journals.permissions@oup.com, Oxford University Press.

Date: 2012
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1093/reseval/rvs037 (application/pdf)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:oup:rseval:v:22:y:2012:i:1:p:30-40

Access Statistics for this article

Research Evaluation is currently edited by Julia Melkers, Emanuela Reale and Thed van Leeuwen

More articles in Research Evaluation from Oxford University Press
Bibliographic data for series maintained by Oxford University Press ().