Assessing transparency and methodological precision in variable measurement within organizational research: implications for validity

Elise Øby ()
Additional contact information
Elise Øby: Kristiania University College

Quality & Quantity: International Journal of Methodology, 2025, vol. 59, issue 1, No 20, 489-506

Abstract: Abstract This study addresses the call for enhanced transparency in methodological reporting by critically assessing methodological rigor and transparency, particularly in variable measurement, within primary cross-sectional survey-based research in organizational studies. Through a combined approach of scoping review for systematic literature identification and qualitative analysis, instances of inadequate reporting transparency and lack of methodological rigor are revealed. Analyzing data from 68 published studies, the findings highlight unclear construct definitions and a consistent absence of theoretical limitations when presenting study findings, pointing to a need for better reporting transparency. Additionally, the study uncovers the presence of elusive links between variable constructs and measures, and misplaced claims of prior validation for measurement instruments, indicating a lack of methodological rigor. Collectively, these findings challenge the interpretation and validity of research results, potentially leading to misconceptions and misinterpretations about what is known about the variable(s) in question. In turn, this may lead to researchers and practitioners basing their research or practice on flawed assumptions about what a group of studies is saying or indicating. While acknowledging prior recommendations on variable measurement and transparency, this study brings renewed focus to these areas. It also explores the role of measurement proficiency, debating whether the observed limitations reflect ethical concerns or are indicative of researchers’ capabilities in variable measurement, validity assessment, and reporting.

Keywords: Methodological challenges; Variable measurement; Transparency; Reporting practices; Validity assessment (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s11135-024-01991-x Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:qualqt:v:59:y:2025:i:1:d:10.1007_s11135-024-01991-x

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11135

DOI: 10.1007/s11135-024-01991-x

Access Statistics for this article

Quality & Quantity: International Journal of Methodology is currently edited by Vittorio Capecchi

More articles in Quality & Quantity: International Journal of Methodology from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().