Professor GPT: Having a large language model write a commentary on freedom of assembly

Johannes Kruse and Christoph Engel
Additional contact information
Johannes Kruse: Max Planck Institute for Research on Collective Goods, Bonn

No 2024_14, Discussion Paper Series of the Max Planck Institute for Research on Collective Goods from Max Planck Institute for Research on Collective Goods

Abstract: In many jurisdictions, academia is at the service of legal practice. Law professors write commentaries that summarize the state of the art of doctrine, chiefly of jurisprudence. In the spirit of a proof of concept, using the guarantee of freedom of assembly in the European Convention on Human Rights, we show that this task can be completely outsourced to large language models. We develop a validation tool that works without costly human coding. The commentary fully written by GPT is on par with its best human written competitor, the Guide provided by the Court itself.

Keywords: commentary; automation; large language model; validation; benchmark; freedom of assembly; European Convention on Human Rights (search for similar items in EconPapers)
JEL-codes: C45 C63 C88 K38 K41 (search for similar items in EconPapers)
Date: 2024-10, Revised 2025-02
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.coll.mpg.de/pdf_dat/2024_14online.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:mpg:wpaper:2024_14

Access Statistics for this paper

More papers in Discussion Paper Series of the Max Planck Institute for Research on Collective Goods from Max Planck Institute for Research on Collective Goods Contact information at EDIRC.
Bibliographic data for series maintained by Marc Martin ().