Necessary and sufficient conditions for the Robbins-Monro method

Dean S. Clark

Stochastic Processes and their Applications, 1984, vol. 17, issue 2, 359-367

Abstract: This paper examines the relation between convergence of the Robbins-Monro iterates Xn+1= Xn-an[latin small letter f with hook](Xn)+an[xi]n, [latin small letter f with hook]([theta])=0, and the laws of large numbers Sn=an[Sigma]n-1j=0 [xi]j-->0 as n-->+[infinity]. If an is decreasing at least as rapidly as c/n, then Xn-->[theta] w.p. 1 (resp. in Lp, p[greater-or-equal, slanted]1) implies Sn-->0 w.p. 1 (resp. in Lp, p[greater-or-equal, slanted]1) as n-->+[infinity]. If an is decreasing at least as slowly as c[+45 degree rule]n and limn-->+[infinity]a n=0, then Sn-->0 w.p. 1 (resp. in Lp, p[greater-or-equal, slanted]2) implies Xn-->[theta] w.p. 1 (resp. in Lp, p[greater-or-equal, slanted]2) as n -->+[infinity]. Thus, there is equivalence in the frequently examined case an[reverse similar, equals]c[+45 degree rule]n. Counter examples show that the LLN must have the form of Sn, that the rate of decrease conditions are sharp, that the weak LLN is neither necessary nor sufficient for the convergence in probability of Xn to [theta] when an[reverse similar, equals]c[+45 degree rule]n.

Keywords: Robbins-Monro; method; differential; inequalities; stochastic; approximation; Liapunov; function; laws; of; large; numbers (search for similar items in EconPapers)
Date: 1984
References: Add references at CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/0304-4149(84)90011-5
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:spapps:v:17:y:1984:i:2:p:359-367

Ordering information: This journal article can be ordered from
http://http://www.elsevier.com/wps/find/supportfaq.cws_home/regional
https://shop.elsevie ... _01_ooc_1&version=01

Access Statistics for this article

Stochastic Processes and their Applications is currently edited by T. Mikosch

More articles in Stochastic Processes and their Applications from Elsevier
Bibliographic data for series maintained by Catherine Liu ().