Analysing similarities between legal court documents using natural language processing approaches based on transformers

Raphael Souza de Oliveira and Erick Giovani Sperandio Nascimento

PLOS ONE, 2025, vol. 20, issue 4, 1-24

Abstract: Recent advancements in Artificial Intelligence have yielded promising results in addressing complex challenges within Natural Language Processing (NLP), serving as a vital tool for expediting judicial proceedings in the legal domain. This study focuses on the detection of similarity among judicial documents within an inference group, employing eight NLP techniques grounded in transformer architecture, specifically applied to a case study of legal proceedings in the Brazilian judicial system. The transformer-based models utilised — BERT, GPT-2, RoBERTa, and LlaMA — were pre-trained on general-purpose corpora of Brazilian Portuguese and subsequently fine-tuned for the legal sector using a dataset of 210,000 legal cases. Vector representations of each legal document were generated based on their embeddings, facilitating the clustering of lawsuits and enabling an evaluation of each model’s performance through the cosine distance between group elements and their centroid. The results demonstrated that transformer-based models outperformed traditional NLP techniques, with the LlaMA model, specifically fine-tuned for the Brazilian legal domain, achieving the highest accuracy. This research presents a methodology employed in a real case involving substantial documentary content that can be adapted for various applications. It conducts a comparative analysis of existing techniques focused on a non-English language to quantitatively explain the results obtained with various NLP transformers-based models. This approach advances the current state of the art in NLP applications within the legal sector and contributes to the achievement of Sustainable Development Goals.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0320244 (text/html)
https://journals.plos.org/plosone/article/file?id= ... 20244&type=printable (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:plo:pone00:0320244

DOI: 10.1371/journal.pone.0320244

Access Statistics for this article

More articles in PLOS ONE from Public Library of Science
Bibliographic data for series maintained by plosone ().