AI Watch: Methodology to Monitor the Evolution of AI Technologies
Fernando Martinez-Plumed (),
Jose Hernandez-Orallo () and
Emilia Gomez Gutierrez ()
Additional contact information
Jose Hernandez-Orallo: Universitat Politècnica de Valencia
Emilia Gomez Gutierrez: European Commission - JRC, https://ec.europa.eu/jrc/en
No JRC120090, JRC Working Papers from Joint Research Centre (Seville site)
In this report, we present a methodology to assess the evolution of AI technologies in the context of the AI WATCH initiative. The methodology is centred on building the AIcollaboratory, a data-driven framework to collect and explore data about AI results, progress and ultimately capabilities. From the collaborator framework we later extract qualitative information related to the state of the art, challenges and trends of AI research and development. This report first describes the administrative context of study, followed by the proposed methodology to build the AIcollaboratory framework and exploit it for qualitative assessment. In addition, we present some preliminary results of this monitoring process and some conclusions and suggestions for future work. This document is an internal report of the AI WATCH initiative, to be agreed for future work on Task 2 of the administrative arrangement between the Joint Research Centre and DG CNECT.
Keywords: AI WATCH; AICollaboratory; AI evaluation; AI progress; methodology (search for similar items in EconPapers)
References: View references in EconPapers View complete reference list from CitEc
Citations: Track citations by RSS feed
Downloads: (external link)
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
Persistent link: https://EconPapers.repec.org/RePEc:ipt:iptwpa:jrc120090
Access Statistics for this paper
More papers in JRC Working Papers from Joint Research Centre (Seville site) Contact information at EDIRC.
Bibliographic data for series maintained by Publication Officer ().