Using Firth's method for model estimation and market segmentation based on choice data

Roselinde Kessels, Bradley Jones and Peter Goos ()

Journal of choice modelling, 2019, vol. 31, issue C, 1-21

Abstract: Using maximum likelihood (ML) estimation for discrete choice modeling of small datasets causes two problems. The first problem is that the data may exhibit separation, in which case the ML estimates do not exist. Also, provided they exist, the ML estimates are biased. In this paper, we show how to adapt Firth's penalized likelihood estimation for use in discrete choice modeling. A powerful advantage of Firth's estimation is that, unlike ML estimation, it provides useful estimates in the case of data separation. For aggregates of six or more respondents, Firth estimates have negligible bias. For preference estimates on an individual level, Firth estimates show little bias as long as each person evaluates a sufficient number of choice sets. Additionally, Firth's individual-level estimation makes it possible to construct an empirical distribution of the respondents' preferences without imposing any a priori population distribution and to effectively predict people's choices and detect market segments. Segment recovery may even be better when individual-level estimates are obtained using Firth's method instead of hierarchical Bayes estimation under a normal prior. We base all findings on data from a stated choice study on various forms of employee compensation.

Keywords: Discrete choice modeling; Data separation; Firth's penalized maximum likelihood; Hierarchical Bayes estimation; Individual-level estimates; Market segmentation (search for similar items in EconPapers)
Date: 2019
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S1755534518300836
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:eejocm:v:31:y:2019:i:c:p:1-21

DOI: 10.1016/j.jocm.2018.12.002

Access Statistics for this article

Journal of choice modelling is currently edited by S. Hess and J.M. Rose

More articles in Journal of choice modelling from Elsevier
Bibliographic data for series maintained by Catherine Liu ().