Assessing moderating effect in meta-analysis: a re-analysis of top management support studies and suggestions for researchers

Mark I Hwang and Frank L Schmidt

European Journal of Information Systems, 2011, vol. 20, issue 6, 693-702

Abstract: Meta-analysis has been increasingly used as a knowledge cumulation tool by IS researchers. In recent years many meta-analysts have conducted moderator analyses in an attempt to develop and test theories. These studies suffer from several methodological problems and, as a result, may have contributed to rather than resolved inconsistent research findings. For example, a previous meta-analysis reports that task interdependence moderates the effect of top management support to render it a non-critical component in systems implementation projects when task interdependence is low. We show that this conclusion is the result of uncorrected measurement error and an erroneous application of a fixed effects regression analysis. We discuss other pitfalls in the detection and confirmation of moderators including the use of the Q statistic and significance tests. Our recommended approach is to break the sample into subgroups and compare their credibility and confidence intervals. This approach is illustrated in a re-analysis of the top management support literature. Our results indicate that top management support is important in both high and low task interdependence groups and in fact may be equally important in both groups. Guidelines are developed to help IS researchers properly conduct moderator analyses in future meta-analytic studies.

Date: 2011
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://hdl.handle.net/10.1057/ejis.2011.12 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:tjisxx:v:20:y:2011:i:6:p:693-702

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/tjis20

DOI: 10.1057/ejis.2011.12

Access Statistics for this article

European Journal of Information Systems is currently edited by Par Agerfalk

More articles in European Journal of Information Systems from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().