Second-order synthesis of meta-analytic studies in applied linguistics (1998–2021)

Mohammad Reza Anani Sarab () and Mohammad Amini Farsani ()
Additional contact information
Mohammad Reza Anani Sarab: Shahid Beheshti University
Mohammad Amini Farsani: Iran University of Science and Technology

Quality & Quantity: International Journal of Methodology, 2024, vol. 58, issue 2, No 23, 1517-1543

Abstract: Abstract The present article reports on a study which examined research synthetic studies over a period of 24 years from 1998 to 2021 collected from 30 representative applied linguistic journals. The study aimed to investigate the adequacy of reporting and adherence to standards of rigor and transparency in all steps of the meta-analyses. Following a synthetic approach, we synthesized 90 meta-analyses in applied linguistics (AL) journals. The results revealed strengths in all steps and a number of weaknesses in some steps of the process. AL meta-analysts did fairly well in locating the candidate studies by using different databases and supplementary search strategies. In their data analysis phase, they used random effects models more than a combination of random and fixed effects models. To interpret the effect sizes, almost half of the studies used Cohen’s benchmark and almost one third of them used Plonsky and Oswald’s field-specific benchmark. The areas which need to be addressed in future synthetic studies were identified as: more precise identification of moderator variables; more reliable data collection by paying adequate attention to coding sheet piloting and coder qualifications and training; and more reliance on measures other than Q-statistics. The implications of these results are discussed.

Keywords: Applied linguistics; Research synthesis; Second-order research synthesis; Research synthesis process; Meta-analysis (search for similar items in EconPapers)
Date: 2024
References: Add references at CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s11135-023-01692-x Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:qualqt:v:58:y:2024:i:2:d:10.1007_s11135-023-01692-x

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11135

DOI: 10.1007/s11135-023-01692-x

Access Statistics for this article

Quality & Quantity: International Journal of Methodology is currently edited by Vittorio Capecchi

More articles in Quality & Quantity: International Journal of Methodology from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().