A multi‐dimensional index of evaluating systems thinking skills from textual data

Ning‐Yuan Georgia Liu, Hesam Mahmoudi, Konstantinos Triantis and Navid Ghaffarzadegan

Systems Research and Behavioral Science, 2025, vol. 42, issue 6, 1528-1542

Abstract: Systems thinking (ST) includes a set of critical skills and approaches for addressing today's complex societal problems. Therefore, it has been introduced into the curricula of many educational programmes around the world. Despite all the attention to ST, there is less consensus when it comes to evaluating and assessing ST skills. Particularly, a quantitative assessment approach that captures ST's multi‐dimensionality is crucial when evaluating the degree to which one has learned and utilizes ST. This paper proposes a systematic approach to create such a multi‐dimensional Index of ST from textual data. Initially, we provide an overview of the theoretical background as it pertains to different measurement approaches of ST skills. Then we provide a conceptual framework based on ST skill measures and transform this framework into a quantifiable model. Finally, using student data, we provide an illustration of an integrated index of ST skills. We compute this index by using a mixed methods approach, including robust principal component analysis, data envelopment analysis and two‐staged bootstrapping approach. The results show that (i) our model serves as a systematic multi‐dimensional ST approach by including multiple measures of ST skills and (ii) international students and self‐reported math skills are found as significant predictors of one's level of ST in the graduate student dataset (N = 30), however no significant factors are found in the first‐year engineering student dataset (N = 144).

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1002/sres.3033

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:srbeha:v:42:y:2025:i:6:p:1528-1542

Ordering information: This journal article can be ordered from
http://www.blackwell ... bs.asp?ref=1092-7026

Access Statistics for this article

More articles in Systems Research and Behavioral Science from Wiley Blackwell
Bibliographic data for series maintained by Wiley Content Delivery ().