skip to main content
10.1145/1631272.1631356acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
short-paper

Perceptual quality assessment based on visual attention analysis

Authors Info & Claims
Published:19 October 2009Publication History

ABSTRACT

Most existing quality metrics do not take the human attention analysis into account. Attention to particular objects or regions is an important attribute of human vision and perception system in measuring perceived image and video qualities. This paper presents an approach for extracting visual attention regions based on a combination of a bottom-up saliency model and semantic image analysis. The use of PSNR (Peak Signal-to-Noise Ratio) and SSIM (Structural SIMilarity) in extracted attention regions is analyzed for image/video quality assessment, and a novel quality metric is proposed which can exploit the attributes of visual attention information adequately. The experimental results with respect to the subjective measurement demonstrate that the proposed metric outperforms the current methods.

References

  1. Winkler, S. 2005. Digital video quality: vision models and metrics, John Wiley&Sons Press.Google ScholarGoogle Scholar
  2. Pinson, M. and Wolf S. 2004. A new standardized method for objectively measuring video quality. IEEE Trans. Broadcasting, 50 (Sep. 2004), 312--322.Google ScholarGoogle ScholarCross RefCross Ref
  3. Wang, Z., Bovik, A. C., Sheikh, H. R., and Simoncelli, E. P. 2004. Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Processing, 13 (Apr. 2004), 600--612. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Itti L. and Koch C. 2001. Computational modeling of visual attention, Nat. Rev. Neurosci., 2 (Mar. 2001), 194--203.Google ScholarGoogle ScholarCross RefCross Ref
  5. Lu Z., Lin W., Yang X., et al. 2005. Modeling visual attention's modulatory aftereffects on visual sensitivity and quality evaluation. IEEE Trans. Image Processing, 14 (Nov. 2005), 1928--1942.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Feng X., Liu T., Yang D., and Wang Y. 2008. Saliency based objective quality assessment of decoded video affected by packet losses. In Proceedings of IEEE Int. Conf. Image Processing (California, USA, Oct. 12--15, 2008), 2560--2563.Google ScholarGoogle Scholar
  7. SaliencyToolbox 2.1, http://www.saliencytoolbox.net.Google ScholarGoogle Scholar
  8. Sheikh H. R., Wang, Z., Cormack L., and Bovik A. C. LIVE Image Quality Assessment Database. http://live.ece.utexas.edu/research/quality.Google ScholarGoogle Scholar
  9. VQEG Sequence, ftp://ftp.crc.ca/crc/vqeg/TestSequences/.Google ScholarGoogle Scholar
  10. Pinson, M. and Wolf, S. 2003. An Objective Method for Combining Multiple Subjective Data Sets. In Proc. SPIE Video Communication and Image Processing Conf. (Lugano, Switzerland, Jul. 2003), 583--592.Google ScholarGoogle Scholar

Index Terms

  1. Perceptual quality assessment based on visual attention analysis

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      MM '09: Proceedings of the 17th ACM international conference on Multimedia
      October 2009
      1202 pages
      ISBN:9781605586083
      DOI:10.1145/1631272

      Copyright © 2009 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 19 October 2009

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • short-paper

      Acceptance Rates

      Overall Acceptance Rate995of4,171submissions,24%

      Upcoming Conference

      MM '24
      MM '24: The 32nd ACM International Conference on Multimedia
      October 28 - November 1, 2024
      Melbourne , VIC , Australia

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader