Modelling method effects as individual causal effects

Steffi Pohl, Rolf Steyer and Katrin Kraus

Journal Of The Royal Statistical Society Series A, 2008, vol. 171, issue 1, pages 41-63

Abstract: Method effects often occur when different methods are used for measuring the same construct. We present a new approach for modelling this kind of phenomenon, consisting of a definition of method effects and a first model, the "method effect model", that can be used for data analysis. This model may be applied to multitrait-multimethod data or to longitudinal data where the same construct is measured with at least two methods at all occasions. In this new approach, the definition of the method effects is based on the theory of individual causal effects by Neyman and Rubin. Method effects are accordingly conceptualized as the individual effects of applying measurement method "j" instead of "k". They are modelled as latent difference scores in structural equation models. A reference method needs to be chosen against which all other methods are compared. The model fit is invariant to the choice of the reference method. The model allows the estimation of the average of the individual method effects, their variance, their correlation with the traits (and other latent variables) and the correlation of different method effects among each other. Furthermore, since the definition of the method effects is in line with the theory of causality, the method effects may (under certain conditions) be interpreted as causal effects of the method. The method effect model is compared with traditional multitrait-multimethod models. An example illustrates the application of the model to longitudinal data analysing the effect of negatively (such as 'feel bad') as compared with positively formulated items (such as 'feel good') measuring mood states. Copyright 2008 Royal Statistical Society.

Downloads: (external link)
http://www.blackwell ... 67-985X.2007.00517.x link to full text (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Ordering information: This journal article can be ordered from
http://www.blackwell ... bs.asp?ref=0964-1998

Access Statistics for this article

Journal Of The Royal Statistical Society Series A is edited by A. Fielding and G. Verbeke

More articles in Journal Of The Royal Statistical Society Series A from Royal Statistical Society
Series data maintained by Christopher F. Baum ().