A geolocated dataset of German news articles

Lukas Kriesch () and Sebastian Losacker ()
Additional contact information
Lukas Kriesch: Justus-Liebig-Universität Gießen, Postal: Senckenbergstr. 1, 35390 Gießen, Germany
Sebastian Losacker: Justus-Liebig-Universität Gießen, Postal: Senckenbergstr. 1, 35390 Gießen, Germany

No 2025/4, Papers in Innovation Studies from Lund University, CIRCLE - Centre for Innovation Research

Abstract: The emergence of large language models and the exponential growth of digitized text data have revolutionized research methodologies across a broad range of social sciences. News articles are an important source of digitized text data in this context. News data is crucial for the social sciences as it provides real-time insights into public discourse and societal trends, helping to understand various social phenomena and dynamics. However, most research involving news data is conducted at the national level, as geographically more granular news data is often unavailable. In this paper, we address this gap by providing insights into how news articles can be geolocated and how the texts can then be further analyzed. More specifically, we collect data from the CommonCrawl News dataset and clean the text data for further analysis. We then use a named-entity recognition model for geocoding, linking news articles to geographic locations. Finally, we transform the news articles into text embeddings using SBERT, enabling semantic searches within the news data corpus. In the paper, we apply this process to all German news articles and make the German location data, as well as the embeddings, available for download. As a result, we compile a dataset containing text embeddings for about 50 million German news articles, of which about 70% include geographic locations. The process can be replicated for news data from other countries, as we provide all code and workflows.

Keywords: News data; Natural language processing; Geography (search for similar items in EconPapers)
JEL-codes: C45 O33 R12 (search for similar items in EconPapers)
Pages: 18 pages
Date: 2026-09-25
Note: We acknowledge financial support by the German Federal Ministry of Education and Research (BMBF 031B1281).
References: Add references at CitEc
Citations:

Downloads: (external link)
https://journals.lub.lu.se/piis/article/view/27643/24091 Full text (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:hhs:lucirc:2025_004

Access Statistics for this paper

More papers in Papers in Innovation Studies from Lund University, CIRCLE - Centre for Innovation Research CIRCLE - Centre for Innovation Research, Lund University, PO Box 117, SE-22100 Lund, Sweden. Contact information at EDIRC.
Bibliographic data for series maintained by Torben Schubert ().