Nonlinear Regression Modeling via Machine Learning Techniques with Applications in Business and Economics

Sunil K Sapra ()
Additional contact information
Sunil K Sapra: California State University, Los Angeles, CA, USA

RAIS Conference Proceedings 2022-2025 from Research Association for Interdisciplinary Studies

Abstract: The paper demonstrates applications of machine learning techniques to economic data. The techniques include nonlinear regression, generalized additive models (GAM), regression trees, bagging, random forest, boosting, and multivariate adaptive regression splines (MARS). Their relative model fitting and forecasting performance are studied. Common algorithms for implementing these techniques and their relative merits and shortcomings are discussed. Performance comparisons among these techniques are carried out via their application to the current population survey (CPS) data on wages and Boston housing data. Overfitting and post-selection inference issues associated with these techniques are also investigated. Our results suggest that the recently developed adaptive machine learning techniques of random forests, boosting, GAM and MARS outperform nonlinear regression model with Gaussian errors and can be scaled to bigger data sets by fitting a rich class of functions almost automatically.

Keywords: Generalized Additive Models; Multivariate Adaptive Regression Splines; Random Forests; Regression Trees; Semi-parametric Regression (search for similar items in EconPapers)
Pages: 7 pages
Date: 2025-11
References: Add references at CitEc
Citations:

Published in Proceedings of the 42nd International RAIS Conference on Social Sciences and Humanities, November 20-21, 2025, pages 73-94

Downloads: (external link)
https://rais.education/wp-content/uploads/0594.pdf Full text (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:smo:raiswp:0594

Access Statistics for this paper

More papers in RAIS Conference Proceedings 2022-2025 from Research Association for Interdisciplinary Studies
Bibliographic data for series maintained by Eduard David ().