Video denoising using separable 4D nonlocal spatiotemporal transforms

Matteo Maggioni; Giacomo Boracchi; Alessandro Foi; Karen Egiazarian

doi:10.1117/12.872569

3 February 2011 Video denoising using separable 4D nonlocal spatiotemporal transforms

Matteo Maggioni, Giacomo Boracchi, Alessandro Foi, Karen Egiazarian

Proceedings Volume 7870, Image Processing: Algorithms and Systems IX; 787003 (2011) https://doi.org/10.1117/12.872569
Event: IS&T/SPIE Electronic Imaging, 2011, San Francisco Airport, California, United States

Abstract

We propose a powerful video denoising algorithm that exploits temporal and spatial redundancy characterizing natural video sequences. The algorithm implements the paradigm of nonlocal grouping and collaborative filtering, where a higher-dimensional transform-domain representation is leveraged to enforce sparsity and thus regularize the data. The proposed algorithm exploits the mutual similarity between 3-D spatiotemporal volumes constructed by tracking blocks along trajectories defined by the motion vectors. Mutually similar volumes are grouped together by stacking them along an additional fourth dimension, thus producing a 4-D structure, termed group, where different types of data correlation exist along the different dimensions: local correlation along the two dimensions of the blocks, temporal correlation along the motion trajectories, and nonlocal spatial correlation (i.e. self-similarity) along the fourth dimension. Collaborative filtering is realized by transforming each group through a decorrelating 4-D separable transform and then by shrinkage and inverse transformation. In this way, collaborative filtering provides estimates for each volume stacked in the group, which are then returned and adaptively aggregated to their original position in the video. Experimental results demonstrate the effectiveness of the proposed procedure which outperforms the state of the art.

Citation Download Citation

Matteo Maggioni, Giacomo Boracchi, Alessandro Foi, and Karen Egiazarian "Video denoising using separable 4D nonlocal spatiotemporal transforms", Proc. SPIE 7870, Image Processing: Algorithms and Systems IX, 787003 (3 February 2011); https://doi.org/10.1117/12.872569

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available