Abstract
The method of alternating projections is a classical tool to solve feasibility problems. Here we prove local convergence of alternating projections between subanalytic sets \(A,B\) under a mild regularity hypothesis on one of the sets. We show that the speed of convergence is \({\mathcal {O}}(k^{-\rho })\) for some \(\rho \in (0,\infty )\).
Similar content being viewed by others
References
H. Attouch, J. Bolte, P. Redont, A. Soubeyran. Proximal alternating minimization and projection methods for nonconvex problems: an approach based on the Kurdyka-Łojasiewicz inequality. Mathematics of Operations Research 35(2) (2010), 438–457.
H. H. Bauschke, J. M. Borwein. On projection algorithms for solving convex feasibility problems. SIAM Review 38 (1996), 367–426.
H.H. Bauschke, P.L. Combettes, D.R. Luke. Phase retrieval, error reduction algorithm, and Fienup variants: a view from convex optimization. J. Opt. Soc. Am. Series A 19(7) (2002), 1334–1345.
H.H. Bauschke, D.R. Luke, H.M. Phan, X. Wang. Restricted normal cones and the method of alternating projections: theory. Set-Valued and Variational Analysis 21 (2013), 431–473.
H.H. Bauschke, D.R. Luke, H.M. Phan, X. Wang. Restricted normal cones and the method of alternating projections: applications. Set-Valued and Variational Analysis 21 (2013), 475–501.
H.H. Bauschke, D. Noll. On cluster points of alternating projections. Serdica Math. Journal 39 (2013), 355–364.
H.H. Bauschke, D. Noll. On the local convergence of the Douglas-Rachford algorithm. Archiv der Mathematik 102(6) (2014), 589–600.
E. Bierstone, P. Milman. Semianalytic and subanalytic sets. IHES Publ. Math. 67 (1988), 5–42.
J. Bolte, A. Daniilidis, A.S. Lewis. The Łojasiewicz inequality for nonsmooth subanalytic functions with applications to subgradient dynamical systems. SIAM J. Opt. 17(4) (2007), 1205–1223.
J.M. Borwein, G. Li, L. Yao. Analysis of the convergence rate for the cyclic projection algorithm applied to basic semialgebraic convex sets. SIAM Journal on Optimization 24(1) (2014), 498–527.
P.L. Combettes, H.J. Trussell. Method of successive projections for finding a common point of sets in metric space. Journal of Optimization Theory and Applications 67 (1990), 487–507.
D. Drusvyatskiy, A.D. Ioffe, A.S. Lewis. Alternating projections and coupling slope. arXiv:1401.7569v1 [math.OC] 29 Jan 2014.
V. Elser. Solution of the crystallographic phase problem by iterated projections. Acta Crystallographica Section A. 59 (2003), 201–209.
M. Fabian. Lipschitz smooth points of convex functions and isomorphic characterizations of Hilbert space. Proc. London Math. Soc. s3-51 (1985), 113–126.
H. Federer. Hausdorff measure and Lebesgue area. Proc. Nat. Acad. Sci. U.S.A. 37 (1951), 90–94.
R. W. Gerchberg and W. O. Saxton. A practical algorithm for the determination of the phase from image and diffraction plane pictures. Optik 35 (1972), 237–246.
R. Hesse, D. R. Luke. Nonconvex notions of regularity and convergence of fundamental algorithms for feasibility problems. SIAM J. Opt. 23(4) (2013), 2397–2419.
A.Y. Kruger. About regularity of collections of sets. Set-Valued Analysis 14(2) (2006), 187–206.
A.Y. Kruger. On Fréchet subdifferentials. Optimization and related topics, 3. Journal of Mathematical Sciences 116(3) (2003), 3325–3358.
A.S. Lewis, J. Malick. Alternating projections on manifolds. Math. Oper. Res. 33 (2008), 216–234.
A.S. Lewis, R. Luke, J. Malick. Local linear convergence for alternating and averaged non convex projections. Found. Comp. Math. 9 (2009), 485–513.
B.S. Mordukhovich. Variational Analysis and Generalized Differentiation. Springer, New York, 2006.
J. von Neumann. Functional Operators, vol. II. Princeton University Press, Princeton, 1950.
R.A. Poliquin, R.T. Rockafellar, L. Thibault. Local differentiability of distance functions. Trans. Amer. Math. Soc. 352 (2000), 5231–5249.
R.T. Rockafellar, R.J.B. Wets. Variational Analysis. Grundlehren der mathematischen Wissenschaften, Springer Verlag 317, 2009.
H.A. Schwarz. Über einige Abbildungsaufgaben. Gesammelte Mathematische Abhandlungen 11 (1869), 65–83.
M. Shiota. Geometry of Subanalytic and Semialgebraic Sets. Birkhäuser Verlag, 1997.
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by Michael Todd.
Rights and permissions
About this article
Cite this article
Noll, D., Rondepierre, A. On Local Convergence of the Method of Alternating Projections. Found Comput Math 16, 425–455 (2016). https://doi.org/10.1007/s10208-015-9253-0
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10208-015-9253-0
Keywords
- Alternating projections
- Local convergence
- Subanalytic set
- Separable intersection
- Tangential intersection
- Hölder regularity
- Gerchberg–Saxton error reduction