Identifying Active Manifolds in Regularization Problems

W. L. Hare ()
Additional contact information
W. L. Hare: Department of Mathematics and Statistics

Chapter Chapter 13 in Fixed-Point Algorithms for Inverse Problems in Science and Engineering, 2011, pp 261-271 from Springer

Abstract: Abstract In 2009, Tseng and Yun [Math. Programming (Ser. B) 117, 387–423 (2009)], showed that the regularization problem of minimizing f(x) + | ​ | x | ​ | 1, where f is a $${\mathcal{C}}^{2}$$ function and | ​ | x | ​ | 1 is the l 1 norm of x, can be approached by minimizing the sum of a quadratic approximation of f and the l 1 norm. We consider a generalization of this problem, in which the l 1 norm is replaced by a more general nonsmooth function that contains an underlying smooth substructure. In particular, we consider the problem 13.1 $${ \min }_{x}\{f(x) + P(x)\},$$ where f is $${\mathcal{C}}^{2}$$ and P is prox-regular and partly smooth with respect to an active manifold $$\mathcal{M}$$ (the l 1 norm satisfies these conditions.) We reexamine Tseng and Yun’s algorithm in terms of active set identification, showing that their method will correctly identify the active manifold in a finite number of iterations. That is, after a finite number of iterations, all future iterates x k will satisfy $${x}^{k} \in \mathcal{M}$$ . Furthermore, we confirm a conjecture of Tseng that, regardless of what technique is used to solve the original problem, the subproblem $${p}^{k} =\mathrm{{ argmin}}_{p}\{\langle \nabla f({x}^{k}),p\rangle + \frac{r} {2}\vert {x}^{k} - p{\vert }^{2} + P(p)\}$$ will correctly identify the active manifold in a finite number of iterations.

Keywords: Nonconvex optimization; Active constraint identification; Prox-regular; Partly smooth (search for similar items in EconPapers)
Date: 2011
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:spochp:978-1-4419-9569-8_13

Ordering information: This item can be ordered from
http://www.springer.com/9781441995698

DOI: 10.1007/978-1-4419-9569-8_13

Access Statistics for this chapter

More chapters in Springer Optimization and Its Applications from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().