K-SVD and its non-negative variant for dictionary design

Michal Aharon; Michael Elad; Alfred M. Bruckstein

doi:10.1117/12.613878

17 September 2005 K-SVD and its non-negative variant for dictionary design

Michal Aharon, Michael Elad, Alfred M. Bruckstein

Proceedings Volume 5914, Wavelets XI; 591411 (2005) https://doi.org/10.1117/12.613878
Event: Optics and Photonics 2005, 2005, San Diego, California, United States

Abstract

In recent years there is a growing interest in the study of sparse representation for signals. Using an overcomplete dictionary that contains prototype signal-atoms, signals are described as sparse linear combinations of these atoms. Recent activity in this field concentrated mainly on the study of pursuit algorithms that decompose signals with respect to a given dictionary. Designing dictionaries to better fit the above model can be done by either selecting pre-specified transforms, or by adapting the dictionary to a set of training signals. Both these techniques have been considered in recent years, however this topic is largely still open. In this paper we address the latter problem of designing dictionaries, and introduce the K-SVD algorithm for this task. We show how this algorithm could be interpreted as a generalization of the K-Means clustering process, and demonstrate its behavior in both synthetic tests and in applications on real data. Finally, we turn to describe its generalization to nonnegative matrix factorization problem that suits signals generated under an additive model with positive atoms. We present a simple and yet efficient variation of the K-SVD that handles such extraction of non-negative dictionaries.

Citation Download Citation

Michal Aharon, Michael Elad, and Alfred M. Bruckstein "K-SVD and its non-negative variant for dictionary design", Proc. SPIE 5914, Wavelets XI, 591411 (17 September 2005); https://doi.org/10.1117/12.613878

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available