Correlation of coalescence times in a diploid Wright–Fisher model with recombination and selfing

David Kogan, Dimitrios Diamantidis, John Wakeley and Louis Wai-Tong Fan

Theoretical Population Biology, 2026, vol. 167, issue C, 40-68

Abstract: The correlation among the gene genealogies at different loci is crucial in biology, yet challenging to understand because such correlation depends on many factors including genetic linkage, recombination, natural selection and population structure. Based on a diploid Wright–Fisher model with partial selfing and a single mating type for a constant large population of size N, we quantify the combined effects of genetic drift and two competing factors, recombination and selfing, on the correlation of coalescence times at two linked loci for samples of size two. Recombination decouples the genealogies at different loci and decreases the correlation while selfing increases the correlation. We obtain explicit asymptotic formulas for the correlation under four different scaling scenarios depending on whether the selfing probability and the recombination probability are of order O(1/N) or O(1) as N tends to infinity. Our analytical results show that the asymptotic lower bound in King et al. (2018) is sharp when the loci are unlinked and when there is no selfing, and provide a number of new formulas for other scaling scenarios that have not been considered before. We present asymptotic results for the variance of Tajima’s estimator of the population mutation rate for infinitely many loci as N tends to infinity. When the selfing probability is of order O(1) and is equal to a positive constant s for all N and if the samples at both loci are in the same individual, then the variance of the Tajima’s estimator tends to s/2 (hence remains positive) even when the recombination rate, the number of loci and the population size all tend to infinity.

Keywords: Recombination; Selfing; Wright–Fisher model; Diploid population; Coalescent; Asymptotic analysis (search for similar items in EconPapers)
Date: 2026
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0040580925000681
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:thpobi:v:167:y:2026:i:c:p:40-68

DOI: 10.1016/j.tpb.2025.11.003

Access Statistics for this article

Theoretical Population Biology is currently edited by Jeremy Van Cleve

More articles in Theoretical Population Biology from Elsevier
Bibliographic data for series maintained by Catherine Liu ().