Combining Aggregate and Individual Level Data to Estimate an Individual Level Correlation Coefficient

Trivellore E. Raghunathan, Paula K. Diehr and Allen D. Cheadle

Journal of Educational and Behavioral Statistics, 2003, vol. 28, issue 1, 1-19

Abstract: Methods are developed that use aggregate data, possibly based on a large number of individuals, and individual level data, from a small fraction of individuals from the same or similar population, to eliminate ecological bias inherent in the analysis of aggregate data. The primary focus is on estimating the individual level correlation coefficient but the proposed methodology can be extended to estimate regression coefficients. Two approaches, the method of moments and the maximum likelihood, are developed for a bivariate distribution, but can be extended to a multivariate distribution. The method of moments develops a corrected estimate of the within-group covariance matrix, which is then used to estimate the individual level correlation and regression coefficients. The second method assumes bivariate normality and maximizes the combined likelihood function based on the two data sets. The maximum likelihood estimates are obtained using the EM-algorithm. A simulation study investigates the repeated sampling properties of these procedures in terms of bias and the mean square error of the point estimates and the actual coverage of the confidence intervals. The maximum likelihood estimates are almost unbiased and the confidence intervals are well calibrated for simulation conditions considered. The method of moments estimates have the same desirable properties for some simulation conditions. Under all conditions, the correlation coefficient between aggregate variables is severely biased as an estimate of the individual level correlation coefficient.

Keywords: ecological fallacy; EM-algorithm; maximum likelihood; method of moments; random effects (search for similar items in EconPapers)
Date: 2003
References: Add references at CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
https://journals.sagepub.com/doi/10.3102/10769986028001001 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:jedbes:v:28:y:2003:i:1:p:1-19

DOI: 10.3102/10769986028001001

Access Statistics for this article

More articles in Journal of Educational and Behavioral Statistics
Bibliographic data for series maintained by SAGE Publications ().