This Title All WIREs
How to cite this WIREs title:
WIREs Comp Stat

Stochastic approximation: a survey

Full article on Wiley Online Library:   HTML PDF

Can't access this content? Tell your librarian.

Abstract Stochastic recursive algorithms, also known as stochastic approximation, take many forms and have numerous applications. It is the asymptotic properties that are of interest. The early history, starting with the work of Robbins and Monro, is discussed. An approach to proofs of convergence with probability one is illustrated by a stability‐type argument. For general noise processes and algorithms, the most powerful current approach is what is called the ordinary differential equations (ODE) method. The algorithm is interpolated into a continuous‐time process, which is shown to converge to the solution of an ODE, whose asymptotic properties are those of the algorithm. There are probability one and weak convergence methods, the latter being the easiest to use and the most powerful. After discussing the basic ideas and giving some standard proofs, extensions are outlined. These include multiple time scales, tracking of time changing systems, state‐dependent noise, rate of convergence, and random direction methods for high‐dimensional problems. Copyright © 2009 John Wiley & Sons, Inc. This article is categorized under: Algorithms and Computational Methods > Stochastic Optimization

Related Articles

Statistical Methods

Browse by Topic

Algorithms and Computational Methods > Stochastic Optimization

Access to this WIREs title is by subscription only.

Recommend to Your
Librarian Now!

The latest WIREs articles in your inbox

Sign Up for Article Alerts