Computer‐Assisted Keyword and Document Set Discovery from Unstructured Text

Gary King, Patrick Lam and Margaret E. Roberts

American Journal of Political Science, 2017, vol. 61, issue 4, 971-988

Abstract: The (unheralded) first step in many applications of automated text analysis involves selecting keywords to choose documents from a large text corpus for further study. Although all substantive results depend on this choice, researchers usually pick keywords in ad hoc ways that are far from optimal and usually biased. Most seem to think that keyword selection is easy, since they do Google searches every day, but we demonstrate that humans perform exceedingly poorly at this basic task. We offer a better approach, one that also can help with following conversations where participants rapidly innovate language to evade authorities, seek political advantage, or express creativity; generic web searching; eDiscovery; look‐alike modeling; industry and intelligence analysis; and sentiment and topic analysis. We develop a computer‐assisted (as opposed to fully automated or human‐only) statistical approach that suggests keywords from available text without needing structured data as inputs. This framing poses the statistical problem in a new way, which leads to a widely applicable algorithm. Our specific approach is based on training classifiers, extracting information from (rather than correcting) their mistakes, and summarizing results with easy‐to‐understand Boolean search strings. We illustrate how the technique works with analyses of English texts about the Boston Marathon bombings, Chinese social media posts designed to evade censorship, and others.

Date: 2017
References: Add references at CitEc
Citations: View citations in EconPapers (22)

Downloads: (external link)
https://doi.org/10.1111/ajps.12291

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wly:amposc:v:61:y:2017:i:4:p:971-988

Access Statistics for this article

More articles in American Journal of Political Science from John Wiley & Sons
Bibliographic data for series maintained by Wiley Content Delivery ().