Tree oblique for regression with weighted support vector machine

Andrea Carta () and Luca Frigau ()
Additional contact information
Andrea Carta: University of Cagliari
Luca Frigau: University of Cagliari

Computational Statistics, 2025, vol. 40, issue 9, No 14, 5257-5291

Abstract: Abstract This work presents a new approach to learning oblique decision trees for regression tasks. Oblique decision trees are a type of supervised statistical learning technique in which a linear combination of a set of predictors is used to find the hyperplane that partitions the features’ space at each node. Our novel algorithm, called Tree Oblique for Regression with weighted Support vector machine (TORS), at each node, first applies a feature selection method based on the predictors’ correlation with the dependent variable, and then dichotomizes the continuous dependent variable and applies a weighted support vector machine classifier with linear kernel to discover the oblique hyperplane that minimizes the deviance. We evaluate the performance of TORS on a set of different types of simulated data, and we find out that TORS performs well in any type of dataset. Moreover, we assess its performance by comparing the prediction power in terms of root mean squared error with respect to that obtained by other oblique tree models and standard decision tree, using both simulated and real data. Based on empirical evidence, TORS outperforms the other oblique decision trees and has the additional advantage of being easier to interpret.

Keywords: Oblique decision tree; Support vector machine; Regression; Statistical learning; Classification (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s00180-025-01647-w Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:compst:v:40:y:2025:i:9:d:10.1007_s00180-025-01647-w

Ordering information: This journal article can be ordered from
http://www.springer.com/statistics/journal/180/PS2

DOI: 10.1007/s00180-025-01647-w

Access Statistics for this article

Computational Statistics is currently edited by Wataru Sakamoto, Ricardo Cao and Jürgen Symanzik

More articles in Computational Statistics from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().