Convergence of stochastic approximation coupled with perturbation analysis in a class of manufacturing flow control models

Christian van Delft (), A. Haurie and Pierre L'Ecuyer ()
Additional contact information
Christian van Delft: GREGH - Groupement de Recherche et d'Etudes en Gestion à HEC - HEC Paris - Ecole des Hautes Etudes Commerciales - CNRS - Centre National de la Recherche Scientifique
Pierre L'Ecuyer: DIRO - Département d'Informatique et de Recherche Opérationnelle [Montreal] - UdeM - Université de Montréal

Post-Print from HAL

Abstract: This paper deals with a class of piecewise determinstic control systems for which the optimal control can be approximated through the use of an optimization-by-simulation approach. The feedback control law is restricted to belong to an a priori fixed class of feedback control laws depending on a (small) finite set of parameters. Under some general conditions developed in this paper, infinitesimal perturbation analysis (IPA) can be used to estimate the gradient of the objective function with respect to these parameters for finite horizon simulation and the consistency of the IPA estimators, as the simulation length goes to infinity, is assured. Also, the parameters can be optimized through a stochastic approximation (SA) algorithm combined with IPA. We prove that in this context, under appropriate conditions, such an approach converges towards the optimum.

Keywords: Discrete event systems; piecewise deterministic control; manufacturing systems; simulation; stochastic approximation; gradient estimation; perturbation analysis (search for similar items in EconPapers)
Date: 1994-02-01
References: Add references at CitEc
Citations: View citations in EconPapers (5)

Published in Discrete Event Dynamic Systems, 1994, Vol.4,n°1, pp.87-111. ⟨10.1007/BF01516011⟩

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:hal:journl:hal-00471357

DOI: 10.1007/BF01516011

Access Statistics for this paper

More papers in Post-Print from HAL
Bibliographic data for series maintained by CCSD ().