EVALUATING ALTERNATIVE METHODS OF DEALING WITH MISSING OBSERVATIONS - AN ECONOMIC APPLICATION

Yuko Onozaka

No 19875, 2002 Annual meeting, July 28-31, Long Beach, CA from American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association)

Abstract: This paper compares methods to remedy missing value problems in survey data. The commonly used methods to deal with this issue are to delete observations that have missing values (case-deletion), replace missing values with sample mean (mean imputation), and substitute a fitted value from auxiliary regression (regression imputation). These methods are easy to implement but have potentially serious drawbacks such as bias and inefficiency. In addition, these methods treat imputed values as known so that they ignore the uncertainty due to 'missingness', which can result in underestimating the standard errors. An alternative method is Multiple Imputation (MI). In this paper, Expectation Maximization (EM) and Data Augmentation (DA) are used to create multiple complete datasets, each with different imputed values due to random draws. EM is essentially maximum-likelihood estimation, utilizing the interdependency between missing values and model parameters. DA estimates the distribution of missing values given the observed data and the model parameters through Markov Chain Monte Carlo (MCMC). These multiple datasets are subsequently combined into a single imputation, incorporating the uncertainty due to the missingness. Results from the Monte Carlo experiment using pseudo data show that MI is superior to other methods for the problem posed here.

Keywords: Research; Methods/Statistical; Methods (search for similar items in EconPapers)
Pages: 20
Date: 2002
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://ageconsearch.umn.edu/record/19875/files/sp02on02.pdf (application/pdf)

Related works:
Working Paper: Evaluating Alternative Methods of Dealing with Missing Observations An Economic Application (2002)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ags:aaea02:19875

DOI: 10.22004/ag.econ.19875

Access Statistics for this paper

More papers in 2002 Annual meeting, July 28-31, Long Beach, CA from American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association) Contact information at EDIRC.
Bibliographic data for series maintained by AgEcon Search ().