High-dimensional partial correlation coefficients: A survey study of estimation Methods

Jingying Yang, Guishu Bai and Xu Qin

Communications in Statistics - Theory and Methods, 2025, vol. 54, issue 6, 1637-1660

Abstract: The partial correlation coefficient (Pcor) measures the degree of association between two random variables after removing the effect of another set of variables, called the controlling variables. When the dimension of these controlling variables is high, estimating Pcor becomes exceedingly challenging, as conventional computational methods fail to provide efficient estimators. Although several methods have been proposed for estimating Pcor in high-dimensional data, they primarily focus on testing whether its value is zero rather than enhancing estimation efficiency. This article concentrates on improving estimation efficiency and surveys existing methods. Through extensive simulation studies on high-dimensional data, we observe that all current methods consistently underestimate the absolute values of Pcor, with the bias being more pronounced when Pcor is positive. By considering a combination of regression equations, X=Zα+ε and Y=Zβ+ζ, the method proposed in this article demonstrates a significant improvement over existing approaches. Stocks data in Hong Kong is employed to demonstrate the effectiveness of these methods.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/03610926.2024.2348075 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:lstaxx:v:54:y:2025:i:6:p:1637-1660

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/lsta20

DOI: 10.1080/03610926.2024.2348075

Access Statistics for this article

Communications in Statistics - Theory and Methods is currently edited by Debbie Iscoe

More articles in Communications in Statistics - Theory and Methods from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().