A Deflected Subgradient Method Using a General Augmented Lagrangian Duality with Implications on Penalty Methods

Regina S. Burachik () and C. Yalçın Kaya ()
Additional contact information
Regina S. Burachik: University of South Australia
C. Yalçın Kaya: University of South Australia

A chapter in Variational Analysis and Generalized Differentiation in Optimization and Control, 2010, pp 109-132 from Springer

Abstract: Abstract We propose a duality scheme for solving constrained nonsmooth and nonconvex optimization problems. Our approach is to use a new variant of the deflected subgradient method for solving the dual problem. Our augmented Lagrangian function induces a primal–dual method with strong duality, that is, with zero duality gap. We prove that our method converges to a dual solution if and only if a dual solution exists. We also prove that all accumulation points of an auxiliary primal sequence are primal solutions. Our results apply, in particular, to classical penalty methods, since the penalty functions associated with these methods can be recovered as a special case of our augmented Lagrangians. Besides the classical augmenting terms given by the ℓ 1- or ℓ 2-norm forms, terms of many other forms can be used in our Lagrangian function. Using a practical selection of the step-size parameters, as well as various choices of the augmenting term, we demonstrate the method on test problems. Our numerical experiments indicate that it is more favourable to use an augmenting term of an exponential form rather than the classical ℓ 1- or ℓ 2-norm forms.

Keywords: Penalty Function; Accumulation Point; Dual Solution; Strong Duality; Subgradient Method (search for similar items in EconPapers)
Date: 2010
References: Add references at CitEc
Citations: View citations in EconPapers (2)

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:spochp:978-1-4419-0437-9_5

Ordering information: This item can be ordered from
http://www.springer.com/9781441904379

DOI: 10.1007/978-1-4419-0437-9_5

Access Statistics for this chapter

More chapters in Springer Optimization and Its Applications from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().