Sustainability assessment of agricultural systems: The validity of expert opinion and robustness of a multi-criteria analysis

Farahnaz Pashaei Kamali, João A.R. Borges, Miranda P.M. Meuwissen, Imke J.M. de Boer and Alfons G.J.M. Oude Lansink

Agricultural Systems, 2017, vol. 157, issue C, 118-128

Abstract: Sustainability assessment of agricultural systems is frequently hampered by data availability. Elicitation of expert opinions combined with multi-criteria assessment (MCA) could be a useful approach for sustainability assessments in data-scarce situations. To our knowledge, the validity of expert opinion used to score sustainability performance of agricultural systems, however, has not been addressed. Also, robustness of the overall outcome of MCA to uncertainty about scores obtained from expert elicitation and weights used to aggregate scores is generally not addressed. The objectives of this study were to evaluate the validity of expert opinion, and to evaluate the robustness of the overall MCA outcome to uncertainty about scores and weights. The case study considers three soybean agricultural systems in Latin America: conventional agricultural system, with either genetically modified (GM) or non-genetically modified (non-GM) soybeans, and organic agricultural system. The validation was carried out by comparing the sustainability scores of experts with values from scientific studies. The robustness of the overall outcome of the MCA to uncertainty about scores and weights was assessed using Monte Carlo simulation. The comparison of expert opinion with reviewed studies showed that expert opinions are a potential alternative to extensive data-rich methods. The validity of expert opinions can be increased by considering a larger group of experts, with a high level of knowledge about agricultural systems and sustainability issues. With regard to robustness, the overall outcome of the MCA showed higher variation for organic soybean agricultural systems compared with GM and non-GM, in both Brazil and Argentina.

Keywords: Multi-criteria assessment; Sustainability; Monte Carlo simulation; Validation; Robustness; Agricultural systems (search for similar items in EconPapers)
Date: 2017
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (6)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0308521X16303699
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:agisys:v:157:y:2017:i:c:p:118-128

DOI: 10.1016/j.agsy.2017.07.013

Access Statistics for this article

Agricultural Systems is currently edited by J.W. Hansen, P.K. Thornton and P.B.M. Berentsen

More articles in Agricultural Systems from Elsevier
Bibliographic data for series maintained by Catherine Liu ().