Recounting the Courts? Applying Automated Content Analysis to Enhance Empirical Legal Research

Michael Evans, Wayne McIntosh, Jimmy Lin and Cynthia Cates

Journal of Empirical Legal Studies, 2007, vol. 4, issue 4, 1007-1039

Abstract: Political scientists in general and public law specialists in particular have only recently begun to exploit text classification using machine learning techniques to enable the reliable and detailed content analysis of political/legal documents on a large scale. This article provides an overview and assessment of this methodology. We describe the basics of text classification, suggest applications of the technique to enhance empirical legal research (and political science more broadly), and report results of experiments designed to test the strengths and weaknesses of alternative approaches for classifying the positions and interpreting the content of advocacy briefs submitted to the U.S. Supreme Court. We find that the Wordscores method (introduced by Laver et al. 2003), and various models using a Naïve Bayes classifier, perform well at accurately classifying the ideological direction of amicus curiae briefs submitted in the Bakke (1978) and Bollinger (2003) affirmative action cases. We also find that automated feature selection techniques can enable the detection of disparate issue conceptualizations by opposing sides in a single case, and facilitate analysis of relative linguistic “reliance” and “dominance” over time. We conclude by discussing the implications of our results and pointing to areas where technical and infrastructure improvements are most needed.

Date: 2007
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (8)

Downloads: (external link)
https://doi.org/10.1111/j.1740-1461.2007.00113.x

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wly:empleg:v:4:y:2007:i:4:p:1007-1039

Access Statistics for this article

More articles in Journal of Empirical Legal Studies from John Wiley & Sons
Bibliographic data for series maintained by Wiley Content Delivery ().