Comparative Evaluation of Automated Approaches for Legal Aid Document Generation: Template-Based, Rule-Based, and LLM-Based Methods

Hanfei Zhang

Journal of Sustainability, Policy, and Practice, 2026, vol. 2, issue 3, 62-79

Abstract: The accessibility of legal services remains a critical challenge in the United States, with over 80% of low-income individuals unable to obtain necessary civil legal assistance. This study presents a systematic comparative evaluation of three automated document generation approaches for legal aid applications: template-based document generation, rule-based conditional generation, and large language model (LLM)-based intelligent drafting. The study compiled and anonymized N=247 housing-related legal aid cases spanning eviction defense, security deposit claims, and repair request letters, drawn from publicly available eviction records in the Atlanta metropolitan area and supplemented by open legal datasets including Multi-LexSum and LegalBench. The evaluation framework assessed four dimensions: legal element completeness (92.3% for templates, 94.7% for rules, 96.1% for LLMs), linguistic accuracy (88.5%, 91.2%, 94.8%), jurisdictional compliance (95.1%, 93.4%, 89.7%), and practitioner usability scores (7.2/10, 8.1/10, 8.9/10). The findings reveal distinct performance trade-offs: template methods excel in standard cases with high efficiency but limited flexibility; rule-based approaches handle moderate complexity at increased maintenance costs; and LLM methods demonstrate superior adaptability in non-standard scenarios that require rigorous post-processing validation mechanisms.

Keywords: Legal document automation; Legal aid technology; Natural language processing; Document generation evaluation (search for similar items in EconPapers)
Date: 2026
References: Add references at CitEc
Citations:

Downloads: (external link)
https://pinnaclepubs.com/index.php/jspp/article/view/718/691 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:dba:jsppaa:v:2:y:2026:i:3:p:62-79

Access Statistics for this article

More articles in Journal of Sustainability, Policy, and Practice from Pinnacle Academic Press
Bibliographic data for series maintained by Joseph Clark ().