Estimating a Function and Its Derivatives Under a Smoothness Condition

Eunji Lim ()
Additional contact information
Eunji Lim: Decision Sciences and Marketing, Adelphi University, Garden City, New York 11530-0701

Mathematics of Operations Research, 2025, vol. 50, issue 2, 1112-1138

Abstract: We consider the problem of estimating an unknown function f * : R d → R and its partial derivatives from a noisy data set of n observations, where we make no assumptions about f * except that it is smooth in the sense that it has square integrable partial derivatives of order m . A natural candidate for the estimator of f * in such a case is the best fit to the data set that satisfies a certain smoothness condition. This estimator can be seen as a least squares estimator subject to an upper bound on some measure of smoothness. Another useful estimator is the one that minimizes the degree of smoothness subject to an upper bound on the average of squared errors. We prove that these two estimators are computable as solutions to quadratic programs, establish the consistency of these estimators and their partial derivatives, and study the convergence rate as n → ∞ . The effectiveness of the estimators is illustrated numerically in a setting where the value of a stock option and its second derivative are estimated as functions of the underlying stock price.

Keywords: Primary: 62G08; secondary: 62G20; nonparametric regression estimation; derivative estimation; spline regression; smoothing splines; penalized least squares; thin plate splines; penalized smoothing splines (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://dx.doi.org/10.1287/moor.2020.0161 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:inm:ormoor:v:50:y:2025:i:2:p:1112-1138

Access Statistics for this article

More articles in Mathematics of Operations Research from INFORMS Contact information at EDIRC.
Bibliographic data for series maintained by Chris Asher ().