Overview and Discussion of the Competition on Legal Information Extraction/Entailment (COLIEE) 2021

Juliano Rabelo (), Randy Goebel (), Mi-Young Kim (), Yoshinobu Kano (), Masaharu Yoshioka () and Ken Satoh ()
Additional contact information
Juliano Rabelo: University of Alberta
Randy Goebel: University of Alberta
Mi-Young Kim: University of Alberta
Yoshinobu Kano: Shizuoka University
Masaharu Yoshioka: Hokkaido University
Ken Satoh: National Institute of Informatics

The Review of Socionetwork Strategies, 2022, vol. 16, issue 1, 111-133

Abstract: Abstract We summarize the 8th Competition on Legal Information Extraction and Entailment. In this edition, the competition included five tasks on case law and statute law. The case law component includes an information retrieval Task (Task 1), and the confirmation of an entailment relation between an existing case and an unseen case (Task 2). The statute law component includes an information retrieval Task (Task 3), an entailment/question answering task based on retrieved civil code statutes (Task 4) and an entailment/question answering task without retrieved civil code statutes (Task 5). Participation was open to any group based on any approach. Eight different teams participated in the case law competition tasks, most of them in more than one task. We received results from six teams for Task 1 (16 runs) and 6 teams for Task 2 (17 runs). On the statute law task, there were eight different teams participating, most in more than one task. Six teams submitted a total of 18 runs for Task 3, 6 teams submitted a total of 18 runs for Task 4, and 4 teams submitted a total of 12 runs for Task 5. Here we summarize the approaches, our official evaluation, and analysis on our data and submission results.

Keywords: COLIEE2021; Legal information retrieval; Legal information entailment (search for similar items in EconPapers)
Date: 2022
References: View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
http://link.springer.com/10.1007/s12626-022-00105-z Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:trosos:v:16:y:2022:i:1:d:10.1007_s12626-022-00105-z

Ordering information: This journal article can be ordered from
https://www.springer ... ystems/journal/12626

DOI: 10.1007/s12626-022-00105-z

Access Statistics for this article

The Review of Socionetwork Strategies is currently edited by Katsutoshi Yada, Yasuharu Ukai and Marshall Van Alstyne

More articles in The Review of Socionetwork Strategies from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().