Are Random Forests Still ‘Good Enough’? Tabular Prior-Data Fitted Networks for Predictive and Causal Tasks

Jack T. Rametta and Sam Fuller

No g29xc_v1, SocArXiv from Center for Open Science

Abstract: Are random forests, the workhorse of supervised machine learning methods in the social sciences, still “good enough” versus new methods that tout dramatic performance benefits? In this article we present a large, diverse Monte Carlo study and existing real-world data benchmarks to compare tree-based methods with TabPFN, a new pretrained transformer foundation model that performs in-context learning over millions of synthetic datasets designed for tabular data. We compare tree-based methods with TabPFN in the popular R-learner framework for conditional average treatment effect estimation. This allows us to assess both predictive model performance and resulting gains for downstream inference. First, our simulations suggest that TabPFN does outperform random forest, achieving near-oracle results for conditional effect estimation. TabPFN’s improvements manifest in the most difficult simulation setups, where the data generating process is complex and there are fewer observations. Second, in real-world data analyses TabPFN performs well, outperforming random forest in some cases, especially as sample dwindles and the number of predictive covariates increases. Our results suggest that tree-based methods are still well suited for social science data, but TabPFN specifically, and the prior data fitted network approach generally, is a strong competitor worthy of consideration.

Date: 2026-07-30
References: Add references at CitEc
Citations:

Downloads: (external link)
https://osf.io/download/6a6b6b755faae2dae60e4dbc/

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:osf:socarx:g29xc_v1

DOI: 10.31219/osf.io/g29xc_v1

Access Statistics for this paper

More papers in SocArXiv from Center for Open Science
Bibliographic data for series maintained by OSF ().