AI Watch: Methodology to Monitor the Evolution of AI Technologies

Fernando Martinez-Plumed (), Jose Hernandez-Orallo () and Emilia Gomez Gutierrez ()
Additional contact information
Jose Hernandez-Orallo: Universitat Politècnica de Valencia
Emilia Gomez Gutierrez: European Commission - JRC, https://joint-research-centre.ec.europa.eu/index_en

No JRC120090, JRC Research Reports from Joint Research Centre

Abstract: In this report, we present a methodology to assess the evolution of AI technologies in the context of the AI WATCH initiative. The methodology is centred on building the AIcollaboratory, a data-driven framework to collect and explore data about AI results, progress and ultimately capabilities. From the collaborator framework we later extract qualitative information related to the state of the art, challenges and trends of AI research and development. This report first describes the administrative context of study, followed by the proposed methodology to build the AIcollaboratory framework and exploit it for qualitative assessment. In addition, we present some preliminary results of this monitoring process and some conclusions and suggestions for future work. This document is an internal report of the AI WATCH initiative, to be agreed for future work on Task 2 of the administrative arrangement between the Joint Research Centre and DG CNECT.

Keywords: AI WATCH; AICollaboratory; AI evaluation; AI progress; methodology (search for similar items in EconPapers)
Date: 2020-03
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://publications.jrc.ec.europa.eu/repository/handle/JRC120090 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ipt:iptwpa:jrc120090

Access Statistics for this paper

More papers in JRC Research Reports from Joint Research Centre Contact information at EDIRC.
Bibliographic data for series maintained by Publication Officer ().