Classifying the content of social media images to support cultural ecosystem service assessments using deep learning models

Ana Sofia Cardoso, Francesco Renna, Ricardo Moreno-Llorca, Domingo Alcaraz-Segura, Siham Tabik, Richard J. Ladle and Ana Sofia Vaz

Ecosystem Services, 2022, vol. 54, issue C

Abstract: Crowdsourced social media data has become popular for assessing cultural ecosystem services (CES). Nevertheless, social media data analyses in the context of CES can be time consuming and costly, particularly when based on the manual classification of images or texts shared by people. The potential of deep learning for automating the analysis of crowdsourced social media content is still being explored in CES research. Here, we use freely available deep learning models, i.e., Convolutional Neural Networks, for automating the classification of natural and human (e.g., species and human structures) elements relevant to CES from Flickr and Wikiloc images. Our approach is developed for Peneda-Gerês (Portugal) and then applied to Sierra Nevada (Spain). For Peneda-Gerês, image classification showed promising results (F1-score ca. 80%), highlighting a preference for aesthetics appreciation by social media users. In Sierra Nevada, even though model performance decreased, it was still satisfactory (F1-score ca. 60%), indicating a predominance of people’s pursuit for cultural heritage and spiritual enrichment. Our study shows great potential from deep learning to assist in the automated classification of human-nature interactions and elements from social media content and, by extension, for supporting researchers and stakeholders to decode CES distributions, benefits, and values.

Keywords: Computer vision; Convolutional neural networks; Culturomics; iEcology; Nature contributions to people; Transfer learning (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S2212041622000067
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:ecoser:v:54:y:2022:i:c:s2212041622000067

DOI: 10.1016/j.ecoser.2022.101410

Access Statistics for this article

Ecosystem Services is currently edited by Leon C Braat

More articles in Ecosystem Services from Elsevier
Bibliographic data for series maintained by Catherine Liu ().