Computational Indicators in the Legal Profession: Can Artificial Intelligence Measure Lawyers' Performance?

David Restrepo-Amariles, Pablo Marcello Baquero, Paul Boniol, Rajaa El Hamdani and Michalis Vazirgiannis
Additional contact information
David Restrepo-Amariles: HEC Paris
Pablo Marcello Baquero: HEC Paris
Paul Boniol: University of Paris
Rajaa El Hamdani: HEC Paris

No 1446, HEC Research Papers Series from HEC Paris

Abstract: The assessment of the legal professionals’ performance is increasingly important in the market of legal services to provide relevant information both to consumers and to law firms regarding the quality of legal services. In this article, we explore how computational indicators are produced to assess lawyers’ performance in courtroom litigation, analyzing the specific types of information they can generate. We capitalize on artificial intelligence (AI) methods to analyze a sample of 8,045 cases from the French Courts of Appeal, explore different associations involving lawyers, courts, and cases, and assess the strengths and flaws of the resulting metrics to evaluate the performance of legal professionals. The methods we use include natural language processing, machine learning, graph mining and advanced visualization. Based on the examination of the resulting analytics, we uncover both the advantages and challenges of assessing performance in the legal profession through AI methods. We argue that computational indicators need to address deficiencies regarding their methodology and diffusion to users to become effective means of information in the market of legal services. We conclude proposing adjustments to computational indicators and existing regulatory tools to achieve this purpose, seeking to pave the way for further research on this topic.

Keywords: Law and technology; artificial intelligence; legal informatics; machine learning; NLP (search for similar items in EconPapers)
JEL-codes: K10 K41 O33 (search for similar items in EconPapers)
Pages: 49 pages
Date: 2021-12-07
References: Add references at CitEc
Citations:

Downloads: (external link)
https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3974526 Full text (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ebg:heccah:1446

Access Statistics for this paper

More papers in HEC Research Papers Series from HEC Paris HEC Paris, 78351 Jouy-en-Josas cedex, France. Contact information at EDIRC.
Bibliographic data for series maintained by Antoine Haldemann ().