Understanding Asynchronous Parallel Pattern Search


Asynchronous parallel pattern search (APPS) is a nonlinear optimization algorithm that dynamically initiates actions in response to events, rather than cycling through a fixed set of search directions, as is the case for synchronous pattern search. This gives us a versatile concurrent strategy that allows us to effectively balance the computational load across all available processors. However, the semi-autonomous nature of the search complicates the analysis. We concentrate on elucidating the concepts and notation required to track the iterates produced by APPS across all participating processes. To do so, we consider APPS and its synchronous counterpart (PPS) applied to a simple problem. This allows us both to introduce the bookkeeping we found necessary for the analysis and to highlight some of the fundamental differences between APPS and PPS.

In High Performance Algorithms and Software for Nonlinear Optimization
T. G. Kolda, V. Torczon. Understanding Asynchronous Parallel Pattern Search. In High Performance Algorithms and Software for Nonlinear Optimization, G. D. Pillo and A. Murli (eds.), Applied Optimization, Vol. 82, Springer US, pp. 323-342, 2003. https://doi.org/10.1007/978-1-4613-0241-4\_15


nonlinear optimization, asynchronous parallel optimization, pattern search, global convergence, distributed computing, cluster computing


author = {Tamara G. Kolda and Virginia Torczon}, 
title = {Understanding Asynchronous Parallel Pattern Search}, 
booktitle = {High Performance Algorithms and Software for Nonlinear Optimization}, 
editor = {G. Di Pillo and A. Murli}, 
series = {Applied Optimization}, 
volume = {82}, 
publisher = {Springer US}, 
pages = {323-342}, 
year = {2003},
doi = {10.1007/978-1-4613-0241-4_15},