New Robust Principal Component Analysis for Joint Image Alignment and Recovery via Affine Transformations, Frobenius and <svg xmlns:xlink="http://www.w3.org/1999/xlink" xmlns="http://www.w3.org/2000/svg" style="vertical-align:-5.7429pt" id="M1" height="17.1423pt" version="1.1" viewBox="-0.0657574 -11.3994 26.3792 17.1423" width="26.3792pt"><g transform="matrix(.017,0,0,-0.017,0,0)"><path id="g113-77" d="M541 160L512 170C485 116 462 88 439 67C411 41 376 35 318 35C272 35 238 37 224 48C207 61 205 85 212 121L290 533C305 611 308 615 391 622L397 650H139L133 622C217 615 221 612 206 533L126 118C111 41 103 34 23 26L17 0H474C489 31 528 124 541 160Z"/></g><g transform="matrix(.012,0,0,-0.012,10.948,4.134)"><path id="g50-51" d="M414 144C384 79 371 75 317 75H135L276 221C367 316 408 376 408 465C408 570 327 635 237 635C179 635 131 609 100 575L42 494L67 471C94 510 138 565 205 565C277 565 321 517 321 435C321 348 258 270 195 195C146 137 88 81 33 26V0H411C423 44 433 88 446 135L414 144Z"/></g><g transform="matrix(.012,0,0,-0.012,16.798,4.134)"><path id="g50-45" d="M98 134C72 134 46 117 46 90C46 73 55 65 60 64C95 55 124 32 124 -4C124 -42 95 -68 44 -89L57 -123C122 -104 194 -60 194 22C194 94 136 134 98 134Z"/></g><g transform="matrix(.012,0,0,-0.012,19.644,4.134)"><path id="g50-50" d="M389 0V32C297 38 291 46 291 118V635C234 613 175 595 109 583V556L161 554C203 552 207 547 207 497V118C207 46 201 38 110 32V0H389Z"/></g></svg> Norms

Likassa, Habte Tadesse

doi:https://doi.org/10.1155/2020/8136384

International Journal of Mathematics and Mathematical Sciences

On this page

Abstract Introduction Related Works Conclusions Data Availability Conflicts of Interest References Copyright Related Articles

Research Article | Open Access

Volume 2020 | Article ID 8136384 | https://doi.org/10.1155/2020/8136384

New Robust Principal Component Analysis for Joint Image Alignment and Recovery via Affine Transformations, Frobenius and Norms

Habte Tadesse Likassa¹

Academic Editor: Niansheng Tang

Received29 Jan 2020

Revised06 Mar 2020

Accepted07 Mar 2020

Published10 Apr 2020

Abstract

This paper proposes an effective and robust method for image alignment and recovery on a set of linearly correlated data via Frobenius and norms. The most popular and successful approach is to model the robust PCA problem as a low-rank matrix recovery problem in the presence of sparse corruption. The existing algorithms still lack in dealing with the potential impact of outliers and heavy sparse noises for image alignment and recovery. Thus, the new algorithm tackles the potential impact of outliers and heavy sparse noises via using novel ideas of affine transformations and Frobenius and norms. To attain this, affine transformations and Frobenius and norms are incorporated in the decomposition process. As such, the new algorithm is more resilient to errors, outliers, and occlusions. To solve the convex optimization involved, an alternating iterative process is also considered to alleviate the complexity. Conducted simulations on the recovery of face images and handwritten digits demonstrate the effectiveness of the new approach compared with the main state-of-the-art works.

1. Introduction

Image alignment and recovery [1] has found applications in a variety of areas such as medical imaging, wireless sensor networks, surveillance, batch image denoising, and computational imaging. Image recovery can also be used in background extraction, where the low-rank component corresponds to the background and the sparse component captures the foreground. However, this problem faces some severe challenges such as illumination variation, occlusion, outliers, and heavy sparse noises. It is thus important to develop robust image recovery algorithms to tackle the abovementioned adverse effects.

A variety of algorithms have been reported for image alignment and recovery problem. For example, Peng et al. [2] considered a robust algorithm for sparse and low-rank decomposition (RASL) to remove the potential impact of outliers and sparse errors incurred by corruption and occlusion, but it still lacks to perform well when the potential impact of outliers and heavy sparse noise is large in a large number of images. To tackle this problem, Likassa et al. [3] addressed a modified RASL via incorporating affine transformation with rank prior information which boosted the performance of the algorithm. Ebadi and Izquierdo [4] proposed an efficient robust principal component analysis by using some approximation for image recovery. However, they do not have the potential to remove the impact of outliers in big data. A robust principal component analysis (RPCA) algorithm was addressed in [5] based on convex program, which is guaranteed to recover the low-rank matrix despite gross sparse errors; however, the existing RPCA method is known to be extremely fragile to the presence of gross corruptions. To tackle this dilemma, Chen et al. [6] proposed a nonconvex plus quadratic penalized low-rank and sparse decomposition (NQLSD) method to fit the low-rank model and then used a robust fitting function to reduce the influence of corruption and occlusion on image alignment, where it is still questionable due to large time complexity. Song et al. [7] addressed an online robust image alignment approach that incorporates geometric transformations which directly linearize the objective function by warping update and take the advantage of closed form solution and stochastic gradient descent updating scheme, which corresponds to an efficient inverse composition algorithm, beside tackling the performance problem of image alignment faced by Wu et al. [8]. Liu et al. [9] considered an amendment algorithm based on convex program to mitigate the subspace clustering problem which is guaranteed to exactly recover the row space of the original data and perform robust subspace clustering and error correction in an efficient and effective way. Oh et al. [10] proposed an effective algorithm which uses partial sum of singular values (PSSV) instead of the nuclear norm to recover the image. This new approach, inspired by modification of the objective function, guarantees for better low rank and convergence and is more robust to outliers even when the number of observations is small. This approach lacks to perform well when the total number of observations is large. He et al. [11] considered a similar convex relaxation algorithm with guaranteed efficiently. Though several RPCA algorithms exist to deal with the potential impact of outliers and heavy sparse noises, effective and efficient algorithms need to be developed. To mitigate this issue, the authors of [12, 13] developed robust algorithms, which can well handle the grossly corrupted data. However, in very high-dimensional cases such as image feature extraction, recovery, and alignment, it lacks better performance and low computational complexity.

In this paper, we propose a novel robust algorithm for image recovery and alignment via affine transformations, Frobenius norm, and norm. To be robust against miscellaneous adverse effects such as occlusions, outliers, and heavy sparse noises, the new algorithm integrates affine transformations with low-rank plus sparse decomposition, where the low-rank component lies in a union of disjoint subspaces, so the distorted or misaligned images can be rectified to render more faithful image representation. However, inspired by [2, 14], an extra concept of the Frobenius norm and the norm is now incorporated in the decomposition process so as to be more resilient to errors, outliers, and occlusions in recovery of images. As such, the parameters to be iteratively updated in our algorithm during the decomposition process are different from those in [2, 6, 10]. In addition, the norm and the Frobenius norm, which enjoy the advantages of the and norms, are employed to remove the correlated samples across the images, enabling the new approach to be more resilient to outliers and large variations in the images. The determination of the variables involved and the affine transformations are cast as a convex optimization problem. Consequently, the distorted or misaligned images can be rectified by affine transformations, Frobenius norm, and norms to render more accurate image decomposition.

The affine transformations are aggregated with the low-rank plus sparse representation, where the low-rank component lies in a union of subspaces instead of one single subspace. These transformations can fix the distortion or misalignment in a batch of corrupted images to render more faithful image decomposition, thereby being more robust against heavy sparse errors and outliers. Because large errors may happen in images, which will impact the accuracy of image recovery, the norm is utilized. This new norm when combined with the affine transformations can further enhance the performance. This is used to normalize the adverse effects of outliers and heavy sparse noises in big data. The search of the optimal parameters and affine transformations is first cast as a convex optimization programming. Afterwards, the alternating direction method (ADMM) approach is employed and the newly developed and modified set of equations is established to update the parameters involved and the affine transformations iteratively. Conducted simulations show that the new algorithm excels the state-of-the-art works in terms of accuracy of image alignment and recovery on some public datasets. The major contributions of this paper include the following:(1)The affine transformations are incorporated in the new model to fix the distorted or misaligned images so as to be robust with heavy sparse errors and outliers(2)The ADMM approach is employed to solve the new convex optimization problem, and a set of updating equations is developed to iteratively solve this problem(3)In the new method, a set of affine transformations and Frobenius and norms are considered to boost the performance of the new method(4)A novel modified RASL based on convex program is proposed for highly linearly correlated data which can prune out occlusions and illuminations utilizing the partial column low rank as a prior information through adding an extra term during the decomposition process(5)To the best of authors’ knowledge, it is the first time modified robust image alignment sparse low-rank decomposition is attempted in such a decomposition process to tackle the image alignment problem in the wider applications of face recognition, video surveillance, and health care(6)To solve the problem of convex optimization, an alternative iterative process is addressed to reduce the complexity and simultaneously enhance the recover performance in the image alignment problem

Several considerable research studies have been carried out in the areas of image alignment and image recovery with rank minimization. For instance, Waters et al. [15] proposed a new greedy algorithm via an affine rank minimization to prune out the potential impact of the sparse errors. Lia and Fang [16] suggested an image aligning method via explicitly considering the issue of the spatially varying illumination multiplication with the error biased factors with low-order polynomials. However, it does not work well when there are severe outliers and sparse errors in the data.

To relax the standard nuclear norm, Gu et al. [17] addressed the weight nuclear norm minimization problem, which adaptively assigns the weights on different singular values that can minimize the final ranks. Moreover, Kang et al. [18] proposed a nonconvex rank approximation so as to further reduce the ranks. To tackle the dilemma of overestimated ranks, the authors of [19, 20] suggested the RPCA algorithms, which consider the decomposition of the original images into two broad components. Likassa et al. [12, 13] considered a novel algorithm to tackle the misalignment dilemma, which is designed to find the low-rank component from the illuminated data. Oh et al. [21] presented a rank minimization algorithm which simultaneously aligns the low-input dynamic change images and detects the outliers. To improve the performance of [21, Erichson et al. 22] addressed a randomized algorithm for finding the low-rank part after decomposing via rank minimization. Podosinnikova et al. [23] developed a robust PCA to minimize the reconstruction error. Shahid et al. [24] involved the RPCA spectral graph through addition of some regularization terms. Shakeri and Zhang [25] proposed an online sequential framework to find the clean part via pruning out the sparse corruptions. Hu et al. [26] introduced an approximate of the low-rank assumption for the matrix via a low-rank regularization to solve the face image denoising problems. Wright et al. [5] proposed a RPCA for image decomposition as low-rank and sparse errors; however, it lacks scalability. Kang et al. [18] addressed a robust method via nonconvex rank approximation. Zhang and Lerman [27] and Rahmani and Atia [28] addressed a robust subspace recovery to tackle the influence of annoying effects. However, its complexity is jeopardized when the outliers and sparse noises are heavy in the data. The authors of [29, 30] addressed a robust subspace learning and RPCA with rank minimization to tackle the potential impact of occlusions, illuminations, outliers, and heavy sparse noises. Shang et al. [31] proposed a novel method for rank minimization using double nuclear norm with nuclear hybrid norm penalties to alleviate the adverse dilemmas.

Extensive approaches have also been proposed to solve the low-rank subspace decomposition problems. Zhang and Yang [32] addressed the linear subspace clustering method via the low-rank decomposition. Zhao et al. [33] addressed a robust discriminant low-rank representation to obtain the multiple subspace structures. Ma et al. [34] addressed a generalized algorithm from which the information lying in the high information data is taken from the low-dimensional subspaces. Lerman and Maunu [35] addressed the subspace recovering approach to get the low-rank part from the large data. Liu et al. [9] addressed the representation of images to pinpoint the low-rank structures from the illuminated data. Recently, Rao et al. [36] introduced a compressed sensing technique for subspace segmentation. Elhamifar and Vidal [37] considered sparse subspace slustering (SSC) which used the image sparse produced by reduction [5] to represent the weight and the matrix which is called as an affinity. The subspace segmentation is done via subspace clustering method for instance [38] and subspace clustering [39]. They, however, are not robust against occlusions and illuminations. To tackle these setbacks, Li et al. [40] proposed a transformation-dependent approach via joint alignment of corrupted samples and learning subspace representation. Shen et al. [41] addressed a subspace clustering approach via the dictionary pursuit to reduce the complexity yet with satisfactory performance. Wu et al. [42] suggested a decomposition relying on a new method to mitigate the potential impact of noises in motion segmentation. Li et al. [43] considered the original images into a 3-dimensiona-based tensor; however, there is a serious problem due to the distortion. It is, however, very time consuming. Ding and Fu [44] addressed a multiview via subspace information of methods via the low rank to get the clean low dimensional which are free of subspaces corrupted from high-dimensional data.

3. Problem Formulation

Given a set of well-aligned images of the same object which are linearly correlated, where and denote the weight and height of each image, respectively. More precisely, if we let vec: denote the operator that selects an pixel region of interest from an image and stacks it as a vector, then we can create a matrix which is a low-rank matrix. If the images are misaligned because of the partial corruption and occlusions, such errors usually occur in a small region of an image and have arbitrarily large magnitudes; these errors can be modelled as sparse errors and are denoted by . To tackle the problem of misalignment, we employ the domain transformations . The transformed images can be constructed in the form of the following matrix: , where , is a well-aligned version of image and the operator denotes transformation [2]. The solution of is intractable due to the nonlinearity and complicated dependence of on the transformation . This can be solved by linearizing about the current estimate of when the change in is small [2, 6, 45]. For number of parameters and , we can write , where denotes the Jacobian of the image with regard to the transformations and denotes the standard basis for that satisfies.

Each affine transformation can be represented by a vector of parameters, yielding . Specifically, if the initial transformations are known, we can change . This allows the problem to be relaxed to be the following convex optimization problem in which we seek , , and by incorporating a new term of affine transformations and the Frobenius and norms.

To make the new approach more resilient to outliers and heavy sparse noise, the norm, which combines the advantages of the L₁ and L₂ norm, is used here. The regularizer is considered as the rotational invariant of the L₁ norm and can effectively handle outliers [46]. Also, as observed in [13, 47], the regularizer can also achieve better sparsity promotion than the L₁ norm. The L₁ norm may yield a biased estimation as it ignores the extreme values and cannot handle the collinearity of features. In contrast, the norm is more stable and has the ability to better preserve the spatial information than the L₁ regularizer, as demonstrated in [13, 47]. Additionally, the norm is superior to the nonconvex norms when the signals are not sparse or when the matrix is not strictly low rank [48, 49]. The overall problem can thus be posted as an optimization problem given bywhere represents the original data matrix, is the low-rank component and is the sparse error matrix. The norm of is denoted by . To solve the problem of nonlinearity of the constraint arises due to the complicated dependence of on the transformations , a linearization procedure is summarized in Algorithm 1, [2].

	Input: images initial transformations, and
	0: while Not Converged do
(1)	Step 1: normalize the images

(2)	Step 2: solve the Linearized Convex Optimization


(3)	Step 3: compute the Jacobian matrices with respect to

4. Proposed Algorithm

To solve the constraint optimization problem in (1), we used the augmented Lagrangian multiplier [2, 50], which iteratively estimates both the Lagrange multiplier and the optimal solution by minimizing the augmented Lagrangian function. The basic idea of the ADMM method [51] is to search for a saddle point of the augmented Lagrangian function instead of directly solving the original constrained optimization problem.where, for simplicity, we denote , in which , is a Lagrangian multiplier matrix, is a positive penalty parameter, denotes the matrix inner product, and is the Frobenius norm. Directly solving (2) in the first iteration is difficult, so as in [2, 50], we solve the problem iteratively in an alternating manner. In the augmented Lagrangian multiplier method, the unknowns in the augmented Lagrangian function are iteratively minimized one by one.

First, to update in (3), we fix all , , and as constant. It is difficult to solve the above function directly, so we choose to minimize the augmented Lagrange function approximately by adopting an alternating strategy: minimize the function against only one of the four unknowns , , , and Z at a time:

We note that the problem in (3) is completely separable and involves solving a convex program. Thus, following [31, 52–54] and using the procedures of [55] and the concept of soft thresholding operator that can be solved efficiently using augmented Lagrangian multiplier, the update can be given as

So, can be determined by

Again, by ignoring all irrelevant terms of , it can be simplified as

By using lemma [56], the update of the column of , , is given bywhere denotes the Euclidean norm and .

Finally, we need to update , so we have to keep all other parameters in (8) as constant and employ the augmented Lagrangian multiplier to the following:

To update the parameter in (8), we keep all other parameters constant to obtain the optimal solution of the required parameters. By applying the augmented Lagrangian function and singular-value threshold, we can get the final update of as follows:where denotes Moore–Penrose pseudoinverse of .

The Lagrangian multiplier is updated by using the following equation:

For easy references about the updates of optimal parameters, Algorithm 2 is summarized.

Input: , , , , , , ,
	Maximum iteration and
	0: while Not Converged
(1)	Step 1: update L by (4) and (5)
(2)	Step 2: update S by (7)
(3)	Step 4: update by (9)
(4)	Step 5: update Z by (10)
(5)	=

5. Simulations and Discussions

This section conducts some simulations to demonstrate the effectiveness of our approach for the recovery of face images and handwritten digits. Four baselines are employed, including RASL [2], NQLSD [6], PSSV [10], and MRASL [3]. Firstly, we emphasized on examining the effectiveness of our newly proposed method both visually in removing occlusions and illuminations from highly linearly correlated data. Secondly, we further checked the image similarity quantitatively to describe the performance of our algorithm using the statistical measures of similarity, mainly the peak signal-to-noise ratio. This can be done using the peak signal-to-noise ratio () [57], which is defined aswhere both the original image and the recovered image are of size .

Datasets. To implement the new method, we considered two different public dataset handwritten digits taken from the MINST database [58] and dummy face images taken from the wild database [59].

5.1. Face Image Recovery Alignment

First, we consider the dataset which contains 30 face images of sizes taken from 100 images of a dummy head that are perturbed and occluded from the labeled faces in the wild database [59]. These are real-world face images with uncontrolled misalignment, under varying illuminations. Figure 1 shows the recovered image based on our algorithm and the other three baselines. Again, as an illustration, some recovered dummy images based on the proposed method and the aforementioned baselines are given in Figure 1, where the dummy face images with different corruptions are depicted in Figure 1(a). The recovered images by the aforementioned algorithms are shown in Figures 1(b)–1(e), from which we can see that the visual quality of the proposed method is better than all of the baselines. This is consistent with the numerical results in Table 1. We can see from Figure 1 that the new method provides more clear visual quality compared with the other three baselines. This justifies the effectiveness of our new algorithm in removing the perturbed, occluded, and illuminated data from a highly linearly correlated data.

(a)

(b)

(c)

(d)

(e)

(f)

5.2. Handwritten Digit Image Recovery Alignment

Next, we conduct simulations on the handwritten digits. 30 images of “3” taken from MINST database are used to verify the effectiveness of our algorithm. The simulation results based on the performance of our proposed method shown in Figure 2(f) along with the other baselines are given in Figures 2(b)–2(e). The results achieved by our method are better than those of the previous work to recover image because of including an extra term in the form of partial column low rank as a rank prior information. The low-rank component of four different approaches are depicted and compared with the original. Our method performs better than NQLSD, PSSV, and RASL, showing its effectiveness on the result of the recovered images shown in Figure 2. This can also be justified, and as an illustration, some visual images of the recovered handwritten digits based on the aforementioned methods are shown in Figure 2(f), from which we can see that the proposed method provides better alignment and recovers the corrupted handwritten images better compared with the other four baselines. As shown in Figure 2(e), the recovered handwritten images provide clearer visual quality by properly removing the adverse effects such as outliers and heavy sparse noise. This is in agreement with the results in Table 1 and further justifies that the proposed approach is more resilient to outliers and heavy sparse noise. To further validate the performance of our method, we also compare the PSNRs of the aforementioned methods, as shown in Table 1, from which we can find that the new algorithm indeed provides the largest PSNR compared with the other three baselines.

(a)

(b)

(c)

(d)

(e)

(f)

We can observe that, by adding an extra term in the form of affine transformations and Frobenius and L2,1 norms, our approach attained a larger mean PSNR compared with the approaches proposed in [2, 3, 6, 10], indicating better image recovery and having a capability to remove errors. Relatively speaking, adding a new term in the form of partial column low rank as a rank prior information to our model enhanced the performance of our newly proposed algorithm because the mean peak signal-to-noise ratio value obtained is better than the other three baselines. The advantage of our method is that it obtains more stable estimations of image recovery, which is more robust for errors, outliers, and occlusions.

6. Conclusions

In this work, we considered a new algorithm for robust image alignment and recovery with rank minimization via the Frobenius and the norms. The search of the affine transformations and the Frobenius and norms are considered in the optimization formulation as a convex constrained optimization problem. Then, this is used to alleviate the potential impact of annoying effects by correcting the distorted images. The ADMM approach is then employed, and a new set of equations is established to alternatively update the optimization parameter and the affine transformations. Moreover, the convergence of these new updating equations is scrutinized as well. Conducted simulations show that the new method performs better than other methods in terms of precision on five public databases.

Data Availability

The data used in this article are freely available for the user.

Conflicts of Interest

The author declares that there are no conflicts of interest.

References

T. Bouwmans, S. Javed, H. Zhang, Z. Lin, and R. Otazo, “On the applications of robust pca in image and video processing,” Proceedings of the IEEE, vol. 106, no. 8, pp. 1427–1457, 2018.
View at: Publisher Site | Google Scholar
Y. Peng, A. Ganesh, J. Wright, W. Xu, and Y. Ma, “RASL: robust alignment by sparse and low-rank decomposition for linearly correlated images,” in Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 34, no. 11, pp. 2233–2246, Providence, RI, USA, June 2012.
View at: Google Scholar
H. T. Likassa, W.-H. Fang, and Y.-A. Chuang, “Modified robust image alignment by sparse and low rank decomposition for highly linearly correlated data,” in Proceedings of the 2018 3rd International Conference on Intelligent Green Building and Smart Grid (IGBSG), Piscataway, NJ, USA, April 2018.
View at: Google Scholar
S. Ebadi and E. Izquierdo, “Approximated RPCA for fast and efficient recovery of corrupted and linearly correlated images and video frames,” in Proceedings of the 2015 International Conference on Systems, Signals and Image Processing (IWSSIP), pp. 49–52, IEEE, London, UK, September 2015.
View at: Google Scholar
J. Wright, A. Ganesh, S. Rao, Y. Peng, and Y. Ma, “Robust principal component analysis: exact recovery of corrupted low-rank matrices via convex optimization,” in Advances in Neural Information Processing Systems, pp. 2080–2088, MIT Press, Cambridge, MA, USA, 2009.
View at: Google Scholar
X. Chen, Z. Han, Y. Wang, Y. Tang, and H. Yu, “Nonconvex plus quadratic penalized low-rank and sparse decomposition for noisy image alignment,” Science China Information Sciences, vol. 59, no. 5, Article ID 052107, 2016.
View at: Publisher Site | Google Scholar
W. Song, J. Zhu, Y. Li, and C. Chen, “Image alignment by online robust PCA via stochastic gradient descent,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 26, no. 7, pp. 1241–1250, 2016.
View at: Publisher Site | Google Scholar
Y. Wu, B. Shen, and H. Ling, “Online robust image alignment via iterative convex optimization,” in Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1808–1814, IEEE, Providence, RI, USA, 2012.
View at: Google Scholar
G. Liu, Z. Lin, S. Yan, J. Sun, Y. Yu, and Y. Ma, “Robust recovery of subspace structures by low-rank representation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, no. 1, pp. 171–184, 2013.
View at: Publisher Site | Google Scholar
T.-H. Oh, Y.-W. Tai, J.-C. Bazin, H. Kim, and I. S. Kweon, “Partial sum minimization of singular values in robust pca: algorithm and applications,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 38, no. 4, pp. 744–758, 2016.
View at: Publisher Site | Google Scholar
J. He, D. Zhang, L. Balzano, and T. Tao, “Iterative Grassmannian optimization for robust image alignment,” Image and Vision Computing, vol. 32, no. 10, pp. 800–813, 2014.
View at: Publisher Site | Google Scholar
H. T. Likassa and W.-H. Fang, “Robust regression for image alignment via subspace recovery techniques,” in Proceedings of the 2018 VII International Conference on Network, Communication and Computing—ICNCC 2018, pp. 288–293, Taipei, Taiwan, December 2018.
View at: Google Scholar
H. T. Likassa, W.-H. Fang, and J.-S. Leu, “Robust image recovery via affine transformation and l_{2,1} norm,” IEEE Access, vol. 7, pp. 125011–125021, 2019.
View at: Publisher Site | Google Scholar
J. Zhan and N. Vaswani, “Robust PCA with partial subspace knowledge,” in Proceedings of the 2014 IEEE International Symposium on Information Theory, pp. 2192–2196, IEEE, Honolulu, HI, USA, June 2014.
View at: Google Scholar
A. E. Waters, A. C. Sankaranarayanan, and R. Baraniuk, “SpaRCS: Recovering low-rank and sparse matrices from compressive measurements,” in Advances in Neural Information Processing Systems, pp. 1089–1097, MIT Press, Cambridge, MA, USA, 2011.
View at: Google Scholar
S.-H. Lai and M. Fang, “Robust and efficient image alignment with spatially varying illumination models,” in Proceedings of the 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149), vol. 2, pp. 167–172, IEEE, Fort Collins, CO, USA, 1999.
View at: Google Scholar
S. Gu, Q. Xie, D. Meng, W. Zuo, X. Feng, and L. Zhang, “Weighted nuclear norm minimization and its applications to low level vision,” International Journal of Computer Vision, vol. 121, no. 2, pp. 183–208, 2017.
View at: Publisher Site | Google Scholar
Z. Kang, C. Peng, and Q. Cheng, “Robust PCA via nonconvex rank approximation,,” in Proceedings of the 2015 IEEE International Conference on Data Mining, pp. 211–220, IEEE, Atlantic City, NJ, USA, November 2015.
View at: Google Scholar
D. Hsu, S. M. Kakade, and T. Zhang, “Robust matrix decomposition with sparse corruptions,” IEEE Transactions on Information Theory, vol. 57, no. 11, pp. 7221–7234, 2011.
View at: Publisher Site | Google Scholar
M. Rahmani and G. K. Atia, “Randomized subspace learning approach for high dimensional low rank plus sparse matrix decomposition,” in Proceedings of the 2015 49th Asilomar Conference on Signals, Systems and Computers, pp. 1796–1800, IEEE, Pacific Grove, CA, USA, November 2015.
View at: Google Scholar
T.-H. Oh, J.-Y. Lee, Y.-W. Tai, and I. S. Kweon, “Robust high dynamic range imaging by rank minimization,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 37, no. 6, pp. 1219–1232, 2014.
View at: Google Scholar
N. B. Erichson, L. Mathelin, S. L. Brunton, and J. N. Kutz, “Randomized dynamic mode decomposition,” 2017, https://arxiv.org/abs/1702.02912.
View at: Google Scholar
A. Podosinnikova, S. Setzer, and M. Hein, “Robust pca: optimization of the robust reconstruction error over the stiefel manifold,” in Proceedings of the German Conference on Pattern Recognition, pp. 121–131, Springer, Munster, Germany, September 2014.
View at: Google Scholar
N. Shahid, N. Perraudin, V. Kalofolias, G. Puy, and P. Vandergheynst, “Fast robust PCA on graphs,” IEEE Journal of Selected Topics in Signal Processing, vol. 10, no. 4, pp. 740–756, 2016.
View at: Publisher Site | Google Scholar
M. Shakeri and H. Zhang, “Corola: a sequential solution to moving object detection using low-rank approximation,” Computer Vision and Image Understanding, vol. 146, pp. 27–39, 2016.
View at: Publisher Site | Google Scholar
Z. Hu, F. Nie, L. Tian, and X. Li, “A comprehensive survey for low rank regularization,” 2018, https://arxiv.org/abs/1808.04521.
View at: Google Scholar
T. Zhang and G. Lerman, “A novel m-estimator for robust PCA,” The Journal of Machine Learning Research, vol. 15, no. 1, pp. 749–808, 2014.
View at: Google Scholar
M. Rahmani and G. K. Atia, “A decentralized approach to robust subspace recovery,” in Proceedings of the 2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton), pp. 802–807, IEEE, Monticello, IL, USA, 2015.
View at: Google Scholar
N. Vaswani, T. Bouwmans, S. Javed, and P. Narayanamurthy, “Robust subspace learning: robust PCA, robust subspace tracking, and robust subspace recovery,” IEEE Signal Processing Magazine, vol. 35, no. 4, pp. 32–55, 2018.
View at: Publisher Site | Google Scholar
J. Lee and Y. Choe, “Robust PCA based on incoherence with geometrical interpretation,” IEEE Transactions on Image Processing, vol. 27, no. 4, pp. 1939–1950, 2018.
View at: Publisher Site | Google Scholar
F. Shang, J. Cheng, Y. Liu, Z.-Q. Luo, and Z. Lin, “Bilinear factor matrix norm minimization for robust PCA: algorithms and applications,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 40, no. 9, pp. 2066–2080, 2018.
View at: Publisher Site | Google Scholar
F. Zhang and J. Yang, “A linear subspace learning approach via low rank decomposition,” in Proceedings of the 2011 Second International Conference on Innovations in Bio-Inspired Computing and Applications, pp. 81–84, IEEE, Shenzhen, China, December 2011.
View at: Google Scholar
X. Zhao, G. An, Y. Cen, H. Wang, and R. Zhao, “Robust discriminant low-rank representation for subspace clustering,” Soft Computing, vol. 23, no. 16, pp. 7005–7013, 2018.
View at: Publisher Site | Google Scholar
Y. Ma, A. Y. Yang, H. Derksen, and R. Fossum, “Estimation of subspace arrangements with applications in modeling and segmenting mixed data,” SIAM Review, vol. 50, no. 3, pp. 413–458, 2008.
View at: Publisher Site | Google Scholar
G. Lerman and T. Maunu, “An overview of robust subspace recovery,” Proceedings of the IEEE, vol. 106, no. 8, pp. 1380–1410, 2018.
View at: Publisher Site | Google Scholar
S. Rao, R. Tron, R. Vidal, and Y. Yi Ma, “Motion segmentation in the presence of outlying, incomplete, or corrupted trajectories,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 32, no. 10, pp. 1832–1845, 2010.
View at: Publisher Site | Google Scholar
E. Elhamifar and R. Vidal, “Sparse subspace clustering,” in Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 2790–2797, IEEE, Miami, FL, USA, June 2009.
View at: Google Scholar
J. Shi and J. Malik, “Normalized cuts and image segmentation,” Departmental Papers (CIS), vol. 22, p. 107, 2000.
View at: Google Scholar
Y.-X. Wang and H. Xu, “Noisy sparse subspace clustering,” The Journal of Machine Learning Research, vol. 17, no. 1, pp. 320–360, 2016.
View at: Google Scholar
Q. Li, Z. Sun, Z. Lin, R. He, and T. Tan, “Transformation invariant subspace clustering,” Pattern Recognition, vol. 59, pp. 142–155, 2016.
View at: Publisher Site | Google Scholar
J. Shen, P. Li, and H. Xu, “Online low-rank subspace clustering by basis dictionary pursuit,” in Proceedings of the International Conference on Machine Learning, pp. 622–631, New York, NY, USA, June 2016.
View at: Google Scholar
Y. Wu, Z. Zhang, T. S. Huang, and J. Y. Lin, “Multibody grouping via orthogonal subspace decomposition,” in Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and PATTERN recognition, vol. 2, Kauai, HI, USA, December 2001.
View at: Google Scholar
Y. Li, C. Chen, F. Yang, and J. Huang, “Deep sparse representation for robust image registration,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4894–4901, Boston, MA, USA, 2015.
View at: Google Scholar
Z. Ding and Y. Fu, “Robust multi-view subspace learning through dual low-rank decompositions,” in Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, Phoenix, AZ, USA, February 2016.
View at: Google Scholar
Y. Ma, S. Soatto, J. Koseckaa, and S. S. Sastry, An Invitation to 3-d Vision: From Images to Geometric Models, vol. 26, Springer Science & Business Media, Berlin, Germany, 2012.
C. Ding, D. Zhou, X. He, and H. Zha, “R1-PCA: rotational invariant l 1-norm principal component analysis for robust subspace factorization,” in Proceedings of the 23rd International Conference on Machine Learning, pp. 281–288, ACM, Pittsburgh, PA, USA, 2006.
View at: Google Scholar
R. Li, X. Wang, L. Lei, and Y. Song, “.-norm based loss function and regularization extreme learning machine,” IEEE Access, vol. 7, pp. 6575–6586, 2018.
View at: Publisher Site | Google Scholar
F. Wen, L. Chu, P. Liu, and R. C. Qiu, “A survey on nonconvex regularization-based sparse and low-rank recovery in signal processing, statistics, and machine learning,” IEEE Access, vol. 6, pp. 69883–69906, 2018.
View at: Publisher Site | Google Scholar
Y. Li, Y. Lin, X. Cheng, Z. Xiao, F. Shu, and G. Gui, “Nonconvex penalized regularization for robust sparse recovery in the presence of,” IEEE Access, vol. 6, pp. 25474–25485, 2018.
View at: Publisher Site | Google Scholar
Z. Lin, M. Chen, and Y. Ma, “The augmented lagrange multiplier method for exact recovery of corrupted low-rank matrices,” 2010, https://arxiv.org/abs/1009.5055.
View at: Google Scholar
S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein, “Distributed optimization and statistical learning via the alternating direction method of multipliers,” Foundations and Trends® in Machine Learning, vol. 3, no. 1, pp. 1–122, 2010.
View at: Publisher Site | Google Scholar
S. M. Kahaki, S.-L. Wang, and A. Stepanyants, “Accurate registration of in vivo time-lapse images,” in Medical Imaging 2019: Image Processing, vol. 10949, International Society for Optics and Photonics, Bellingham, WA, USA, 2019.
View at: Google Scholar
Z. Zhang, Y. Xu, J. Yang, X. Li, and D. Zhang, “A survey of sparse representation: algorithms and applications,” IEEE Access, vol. 3, pp. 490–530, 2015.
View at: Publisher Site | Google Scholar
A. Dutta, F. Hanzely, and P. Richtárik, “A nonconvex projection method for robust pca,” Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, pp. 1468–1476, 2019.
View at: Publisher Site | Google Scholar
J.-F. Cai, E. J. Candès, and Z. Shen, “A singular value thresholding algorithm for matrix completion,” SIAM Journal on Optimization, vol. 20, no. 4, pp. 1956–1982, 2010.
View at: Google Scholar
J. Yang, W. Yin, Y. Zhang, and Y. Wang, “A fast algorithm for edge-preserving variational multichannel image restoration,” SIAM Journal on Imaging Sciences, vol. 2, no. 2, pp. 569–592, 2009.
View at: Publisher Site | Google Scholar
Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, “Image quality assessment: from error visibility to structural similarity,” IEEE Transactions on Image Processing, vol. 13, no. 4, pp. 600–612, 2004.
View at: Publisher Site | Google Scholar
J. J. Hull, “A database for handwritten text recognition research,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 16, no. 5, pp. 550–554, 1994.
View at: Publisher Site | Google Scholar
G. B. Huang, M. Ramesh, T. Berg, and E. Learned-Miller, “Labeled faces in the wild: a database for studying face recognition in unconstrained environments,” Tech. Rep., University of Massachusetts, Amherst, MA, USA, 2007, Technical Report 07-49.
View at: Google Scholar

Copyright

Copyright © 2020 Habte Tadesse Likassa. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

857

Downloads

1168

Citations