Demóstenes Zegarra Rodríguez
ABSTRACT
There are several subjective test methodologies for assessing video quality, being that each of these methods was developed by considering specific degradation factors in video quality. Therefore, for video streaming services that use TCP as transport protocol different evaluation criteria should be considered as compared to current methods, because the impairment are only pauses. In this paper, the concepts of the mechanisms that integrate perceptual and cognitive processes are studied, relating them to a test environment for subjective evaluation of video, which is limited to streaming video service transmitted via HTTP / TCP. For this reason, some recommendations to perform subjective assessment of streaming video service are proposed, taking into account perceptual and cognitive criteria. In this work, subjective tests are conducted, evaluators with different content preferences assess 3 different video content. Results show that the assessors' QoE depends strongly on video content preferences. Thus, assessors who are interested in the video content are more drastic in the ratings. In the case of sport videos, the Mean Opinion Score (MOS) value of assesors with explicit preference in sports reachs only 54% of the MOS obtained by assessors without interest in sports. Furthermore, the roll of the instructor during the test is also evaluated.
- Cisco System, Visual Networking Index, White Paper. Jun. 2011.Google Scholar
- G. Nyman, J. Radun, T. Leisti, J. Oja, H. Ojanen, J. Olives, T. Vuori and J. Hikkinen, What do users really perceive - probing the subjective image quality experience. Proceedings of the IS-T/SPIE's: Imaging Quality and System Performance III, Vol. 6059, 2006Google ScholarCross Ref
- G. Nyman, J. Radun, T. Leisti, and T. Vouri, From image fidelity to subjective quality: a hybrid qualitative/quantitative methodology for measuring subjective image quality for different image contents, in Proc. of the International Display Workshops, Vol. 12, 1817--1820, 2007.Google Scholar
- Z. Wang, A. C. Bovik, H. Sheikh, Image Quality Assessment: From Error Visibility to Structural Similarity, IEEE Transactions on Image Processing, vol. 13, No. 4, Apr 2004. Google ScholarDigital Library
- M. Pinson and S. Wolf, A new standardized method for objectively measuring video quality, IEEE Trans. Broadcast., vol. 50, no. 3, pp. 312--322, Sep. 2004.Google ScholarCross Ref
- J. You, A. Perkis, M. Gabbouj, and M. M. Hannuksela, Perceptual quality assessment based on visual attention analysis, in Proc. ACM Int. Conf. Multimedia, pp. 561--564, Mar. 2009 Google ScholarDigital Library
- A. K. Noorthy and A. C. Bovik, Visual importance pooling for image quality assessment, IEEE J. Select. Topics Signal Process., Vol. 3, no. 2, pp. 193--201, Apr. 2009.Google ScholarCross Ref
- ITU, Methodology for the Subjective Assessment of the Quality of Television Pictures, ITU-R Recommendation BT.500--11, 2002.Google Scholar
- ITU, Subjective Video Quality Assessment Methods for Multimedia Applications, ITU-T Recommendation-P.910, Geneva, Abr. 2008.Google Scholar
- J. Redi, H. Liu, H. Alers, R. Zunino and I. Heynderickx. Comparing Subjective Image Quality Measurement Methods for the Creation of Public Databases, Electronic Imaging, SPIE Vol. 7529, pp 1--11, Apr. 2010.Google Scholar
- J. L. Blin, New quality evaluation method suited to multimedia context: Samviq, in Proceedings of the Second International Workshop on Video Processing and Quality Metrics, VPQM'06, Scottsdale, January 2006.Google Scholar
Index Terms
- Video quality subjective assessment considering cognitive criteria and user preferences on video content
Recommendations
3D video subjective quality: a new database and grade comparison study
This paper presents a research study on the subjective assessment of 3D video quality using a newly constructed 3D video database (3DVCL@FER). This database consists of 8 original 3D video sequences, each degraded with 22 different degradation types, ...
Subjective Multimedia Quality Assessment
The Video Quality Experts Group (VQEG) is preparing a programme of subjective multimedia quality tests. The results from these tests will be used to evaluate the performance of competing objective multimedia quality metrics. The reliability of the ...
Bandwidth Reduction of Omnidirectional Viewport-Dependent Video Streaming via Subjective Quality Assessment
AltMM '17: Proceedings of the 2nd International Workshop on Multimedia Alternate RealitiesOmnidirectional video is more and more widespread in consumer electronics and professional capture devices, as well over Internet via novel streaming services. Omnidirectional video requires a large streaming bandwidth. To date there is little knowledge ...
Comments