Unsuccessful and successful complex problem solvers – A log file analysis of complex problem solving strategies across multiple tasks

Björn Nicolay, Florian Krieger, Jörg-Tobias Kuhn, Arthur C. Graesser, Dirk Ifenthaler, Ryan Baker and Samuel Greiff

Intelligence, 2023, vol. 101, issue C

Abstract: Complex problem solving (CPS) is a key competence in educational contexts with strong conceptual links to students' overall intelligence. However, the mechanisms underlying successful CPS are not fully understood. Therefore, this study investigated several factors presumed to be relevant to CPS success using log file data to code each individual student action during six CPS tasks with different characteristics (N = 1276). We coded individual strategy combinations per student for each item for different strategy combinations of vary-one-thing-at-a-time (VOTAT), hold-one-thing-at-a-time (HOTAT), vary-no-thing-at-a-time (NOTAT), and change-all (CA). Results from generalized linear mixed models showed that CPS success was likely to be achieved by using VOTAT. However, there was an increased chance of solving an item when additional strategies, such as NOTAT or NOTAT plus HOTAT were used. This result was moderated by the presence/absence of eigendynamics as an important determinant of item difficulty. Strategy combinations of VOTAT together with other strategies (all including NOTAT) showed higher chances of CPS success when eigendynamics were present. Additionally, higher chances of solving an item when using VOTAT with additional strategies was demonstrated for items without eigendynamics. Overall, our results suggest that flexibility in strategy application is the driving force for successful CPS performance. Implications are discussed in light of the presumed benefit of pedagogically relevant metacognitive skills, such as planning, monitoring and reflecting, for CPS success. Based on our findings, we provide specific recommendations for the development of computer-based learning simulations to train CPS and related competencies, ultimately enhancing students' skills in educational contexts.

Keywords: Complex problem solving; Strategies; Log file analysis; Computer-based learning simulations; Intelligence; Education (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0160289623000740
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:intell:v:101:y:2023:i:c:s0160289623000740

DOI: 10.1016/j.intell.2023.101793

Access Statistics for this article

Intelligence is currently edited by R.J. Haier

More articles in Intelligence from Elsevier
Bibliographic data for series maintained by Catherine Liu ().