eComplex: validity and reliability of rubric for assessing reasoning for complexity competency

Isolda Margarita Castillo-Martínez (), María Soledad Ramírez-Montoya, Leonardo David Glasserman-Morales and Jorge Antonio Millán-Arellano
Additional contact information
Isolda Margarita Castillo-Martínez: Tecnologico de Monterrey
María Soledad Ramírez-Montoya: Tecnologico de Monterrey, Institute for the Future of Education
Leonardo David Glasserman-Morales: Tecnologico de Monterrey
Jorge Antonio Millán-Arellano: Universidad Regiomontana

Quality & Quantity: International Journal of Methodology, 2024, vol. 58, issue 2, No 24, 1545-1563

Abstract: Abstract In the absence of available instruments that measure reasoning-for-complexity competency in higher education, we designed a rubric to measure university students' levels of mastery of that competency. This article presents the process to estimate the validity and reliability that led to the final version of the "eComplex" rubric, which consists of 27 items. This validation process considered experts' consultation, the internal consistency estimation using Cronbach's alpha coefficient, and correlation matrix analysis, there was also qualitative analysis by reviewing the experts' comments in detail and making the appropriate adjustments. The results were: (a) a high concordance index of the judges for the evaluated criteria of the items, (b) an instrument with high internal consistency and reliability, and (c) improvement in the wording of the items thanks to the observations and contributions of the experts, this was reinforced by conducting a second phase of expert validation using the Delphi Method to provide further support for the Clarity criterion. The instrument is expected to validate measuring the development and appropriation of reasoning-for-complexity competency in university students.

Keywords: Reasoning-for-complexity; Higher education; Educational innovation; Validity; Rubric (search for similar items in EconPapers)
Date: 2024
References: Add references at CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s11135-023-01697-6 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:qualqt:v:58:y:2024:i:2:d:10.1007_s11135-023-01697-6

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11135

DOI: 10.1007/s11135-023-01697-6

Access Statistics for this article

Quality & Quantity: International Journal of Methodology is currently edited by Vittorio Capecchi

More articles in Quality & Quantity: International Journal of Methodology from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().