On the Evaluation of Semantic Web Service Frameworks

Ulrich Küster, Birgitta König-Ries, Charles Petrie and Matthias Klusch
Additional contact information
Ulrich Küster: Friedrich-Schiller-University Jena, Germany
Birgitta König-Ries: Friedrich-Schiller-University Jena, Germany
Charles Petrie: Stanford University, USA
Matthias Klusch: German Research Center for Artificial Intelligence, Germany

International Journal on Semantic Web and Information Systems (IJSWIS), 2008, vol. 4, issue 4, 31-55

Abstract: In recent years, a huge amount of research effort and funding has been devoted to the area of Semantic Web services (SWS). This has resulted in the proposal of numerous competing approaches to facilitate the automation of mediation, choreography, and discovery for Web services using semantic annotations. However, despite a wealth of theoretical work, too little effort has been spent toward the comparative experimental evaluation of the competing approaches so far. Progress in scientific development and industrial adoption is thereby hindered. An established evaluation methodology and standard benchmarks that allow the comparative evaluation of different frameworks are thus needed for the further advancement of the field. To this end, a criteria model for SWS evaluation is presented, and the existing approaches toward SWS evaluation are comprehensively analyzed. Their shortcomings are discussed in order to identify the fundamental issues of SWS evaluation. Based on this discussion, a research agenda toward agreed upon evaluation methodologies is proposed.

Date: 2008
References: Add references at CitEc
Citations:

Downloads: (external link)
https://services.igi-global.com/resolvedoi/resolve ... 018/jswis.2008100102 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:igg:jswis0:v:4:y:2008:i:4:p:31-55

Access Statistics for this article

International Journal on Semantic Web and Information Systems (IJSWIS) is currently edited by Brij Gupta

More articles in International Journal on Semantic Web and Information Systems (IJSWIS) from IGI Global
Bibliographic data for series maintained by Journal Editor ().