An Inexact Semismooth Newton-Based Augmented Lagrangian Algorithm for Multi-Task Lasso Problems

Lanyu Lin () and Yong-Jin Liu
Additional contact information
Lanyu Lin: School of Mathematics and Statistics, Fuzhou University, Fuzhou 350108, P. R. China
Yong-Jin Liu: Center for Applied Mathematics of Fujian Province, School of Mathematics and Statistics, Fuzhou University, Fuzhou 350108, P. R. China

Asia-Pacific Journal of Operational Research (APJOR), 2024, vol. 41, issue 03, 1-26

Abstract: This paper is concerned with the ℓ1,∞-norm ball constrained multi-task learning problem, which has received extensive attention in many research areas such as machine learning, cognitive neuroscience, and signal processing. To address the challenges of solving large-scale multi-task Lasso problems, this paper develops an inexact semismooth Newton-based augmented Lagrangian (Ssnal) algorithm. When solving the inner problems in the Ssnal algorithm, the semismooth Newton (Ssn) algorithm with superlinear or even quadratic convergence is applied. Theoretically, this paper presents the global and asymptotically superlinear local convergence of the Ssnal algorithm under standard conditions. Computationally, we derive an efficient procedure to construct the generalized Jacobian of the projector onto ℓ1,∞-norm ball, which is an important component of the Ssnal algorithm, making the computational cost in the Ssn algorithm very cheap. Comprehensive numerical experiments on the multi-task Lasso problems demonstrate that the Ssnal algorithm is more efficient and robust than several existing state-of-the-art first-order algorithms.

Keywords: Multi-task Lasso problem; augmented Lagrangian algorithm; semismooth Newton algorithm; generalized Jacobian (search for similar items in EconPapers)
Date: 2024
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.worldscientific.com/doi/abs/10.1142/S0217595923500276
Access to full text is restricted to subscribers

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wsi:apjorx:v:41:y:2024:i:03:n:s0217595923500276

Ordering information: This journal article can be ordered from

DOI: 10.1142/S0217595923500276

Access Statistics for this article

Asia-Pacific Journal of Operational Research (APJOR) is currently edited by Gongyun Zhao

More articles in Asia-Pacific Journal of Operational Research (APJOR) from World Scientific Publishing Co. Pte. Ltd.
Bibliographic data for series maintained by Tai Tone Lim ().