Can Verbal Performance Appraisals and Machine Learning Models Improve the Accuracy of Performance Evaluations?

Jana Kim Gutt (), Kirsten Thommes () and Miro Mehic ()
Additional contact information
Jana Kim Gutt: Paderborn University
Kirsten Thommes: Paderborn University
Miro Mehic: Paderborn University

No 132, Working Papers Dissertations from Paderborn University, Faculty of Business Administration and Economics

Abstract: Performance appraisals are subject to recent debates with one common denominator: most discussions point to their lack of accuracy. In theory, performance appraisals aim to reflect an employee’s performance over a certain period of time. However, recent research shows that appraisals fall short in reaching this goal. Although many studies acknowledge the benefits of performance comments over ratings on a scale, research has paid little attention to the potential of performance comments to achieve higher accuracy in performance evaluations. To approach this issue, we conducted a laboratory experiment and collected objective performance data as well as numerical and verbal performance appraisals. In particular, we compile numerical ratings, written comments, and spoken comments on performance from independent evaluators. To make the numbers (assigned ratings) and the comments comparable, we applied a Random Forest algorithm to transfer the comments into numerical ratings (algorithmic ratings). By analyzing each rating (assigned and algorithmic) in relation to the performance, we find evidence that spoken comments reflect performance differences most accurately within a team. Our results offer important insights into how performance appraisals may be approached to reflect objective performance more accurately.

Keywords: performance appraisal; rating accuracy; rating format; performance appraisal comment; rating scale (search for similar items in EconPapers)
JEL-codes: D91 J24 M51 (search for similar items in EconPapers)
Pages: 44
Date: 2025-02
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://groups.uni-paderborn.de/wp-wiwi/RePEc/pdf/dispap/DP132.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:pdn:dispap:132

Access Statistics for this paper

More papers in Working Papers Dissertations from Paderborn University, Faculty of Business Administration and Economics Contact information at EDIRC.
Bibliographic data for series maintained by WP-WiWi-Info ().