Skip to main content
SpringerLink
Log in

Gaming Quality of Experience

  • Chapter
  • First Online:
Quality of Experience Modeling for Cloud Gaming Services

Part of the book series: T-Labs Series in Telecommunication Services ((TLABS))

Abstract

The goal of this book is to develop a QoE model in the context of cloud gaming services. In this chapter, the background information that is necessary to understand the decisions that are made in each step of the model development is provided. Thus, this chapter starts with an introduction about the cloud gaming technology. Next, the concepts of quality and Quality of Experience are defined. The chapter continues with a short introduction to a gaming QoE taxonomy and relevant influencing factors on cloud gaming quality. Later, the methodology to conduct subjective experiments to assess gaming QoE is described. Finally, the section ends with a short overview of efforts towards the development of gaming quality models in the literature.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 129.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    OnLive was one of the most the popular cloud gaming service between 2012 to 2015 when it was shut down and most of the assets were sold to Sony Computer Entertainment.

References

  1. ITU-T Recommendation G.1032, Influence Factors on Gaming Quality of Experience. (International Telecommunication Union, Geneva, 2017)

    Google Scholar 

  2. Qualinet White Paper on Definitions of Quality of Experience, COST Action IC 1003 (2013)

    Google Scholar 

  3. ITU-T Recommendation P.910, Subjective Video Quality Assessment Methods for Multimedia Applications (International Telecommunication Union, Geneva, 2008)

    Google Scholar 

  4. J.M. Juran, F.M. Gryna, R.S. Bingham, Quality Control Handbook (McGraw Hill, New York, 1974). No. 658.562 Q-1q

    Google Scholar 

  5. K. Ishikawa, What Is Total Quality Control? The Japanese Way (Prentice Hall, Hoboken, 1985)

    Google Scholar 

  6. ISO 9000, Quality Management Systems-Fundamentals and Vocabulary (International Organization for Standardization, Geneva, 2015)

    Google Scholar 

  7. W. Robitza, A. Ahmad, P.A. Kara, L. Atzori, M.G. Martini, A. Raake, L. Sun, Challenges of future multimedia QoE monitoring for Internet Service providers, in Multimedia Tools and Applications, vol. 76(21) (2017), pp. 22243–22266.

    Google Scholar 

  8. ITU-T Recommendation Y.1540, Internet Protocol Data Communication Service - IP Packet Transfer and Availability Performance Parameters (International Telecommunication Union, Geneva, 2019)

    Google Scholar 

  9. ITU-T Recommendation Y.1541, Network Performance Objectives for IP-based Services (International Telecommunication Union, Geneva, 2011)

    Google Scholar 

  10. ITU-T Recommendation P.800, Methods for Subjective Determination of Transmission Quality (International Telecommunication Union, Geneva, 1996)

    Google Scholar 

  11. S. Möller, S. Schmidt, J. Beyer, Gaming taxonomy: an overview of concepts and evaluation methods for computer gaming qoe, in 2013 Fifth International Workshop on Quality of Multimedia Experience (QoMEX) (IEEE, New York, 2013), pp. 236–241.

    Google Scholar 

  12. K. Poels, Y.A. de Kort, W.A. IJsselsteijn, Game Experience Questionnaire: Development of a Self-Report Measure to Assess the Psychological Impact of Digital Games. Technische Universiteit Eindhoven, 2007

    Google Scholar 

  13. D. Pinelle, N. Wong, T. Stach, Heuristic evaluation for games: usability principles for video game design, in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2008), pp. 1453–1462

    Google Scholar 

  14. ITU-T Recommendation P.809, Subjective Evaluation Methods for Gaming Quality (International Telecommunication Union, Geneva, 2018)

    Google Scholar 

  15. B.G. Witmer, C.J. Jerome, M.J. Singer, The factor structure of the presence questionnaire. Presence: Teleoper. Virt. Environ. 14(3), 298–312 (2005)

    Article  Google Scholar 

  16. E. Brown, P. Cairns, A grounded investigation of game immersion, in CHI’04 Extended Abstracts on Human Factors in Computing Systems (2004), pp. 1297–1300

    Google Scholar 

  17. M. Hassenzahl, User experience (UX) towards an experiential perspective on product quality, in Proceedings of the 20th Conference on l’Interaction Homme-Machine (2008), pp. 11–15

    Google Scholar 

  18. C. Murphy, Why games work and the science of learning, in Interservice, Interagency Training, Simulations, and Education Conference, vol. 21. Citeseer, 2011. [Online]. Available: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.467.3543&rep=rep1&type=pdf

    Google Scholar 

  19. S. Zadtootaghaj, S. Schmidt, S. Möller, Influence factors on gaming quality of experience (QoE). Available at: https://www.itu.int/md/T17-SG12-C-0104/en, ITU-T Study Group 12, Geneva, ITU-T Contribution C.104, 2017

  20. S. Schmidt, S. Zadtootaghaj, S. Möller, Updates on the first draft of influence factors in gaming quality of experience (QoE). Available at: https://www.itu.int/md/T17-SG12-C-0041/en, ITU-T Study Group 12, Geneva, ITU-T Contribution C.41, 2017

  21. S. Möller, A. Raake, Quality of Experience: Advanced Concepts, Applications and Methods (Springer, New York, 2014)

    Book  Google Scholar 

  22. J. Davis, Y.-H. Hsieh, H.-C. Lee, Humans perceive Flicker artifacts at 500 Hz. Sci. Rep. 5, 7861 (2015)

    Article  Google Scholar 

  23. S. Jumisko-Pyykkö, T. Vainio, Framing the context of use for mobile HCI. Int. J. Mob. Hum. Comput. Interact. 2(4), 1–28 (2010)

    Article  Google Scholar 

  24. S. Jumisko-Pyykkö, User-Centered Quality of Experience and its Evaluation Methods for Mobile Television (Tampere University of Technology, Tampere, 2011), p. 12

    Google Scholar 

  25. H.-E. Yang, C.-C. Wu, K.-C. Wang, An empirical analysis of online game service satisfaction and Loyalty. Exp. Syst. Appl. 36(2), 1816–1825 (2009)

    Article  Google Scholar 

  26. T. Meline, A Research Primer for Communication Sciences and Disorders (Allyn & Bacon, Boston, 2009)

    Google Scholar 

  27. H. Robin, L. Marc, Z. Robert, A formal approach to game design and game research, in GDC, San Jose, 2004

    Google Scholar 

  28. S. Schmidt, S. Zadtootaghaj, S. Möller, Towards the delay sensitivity of games: there is more than genres, in Ninth International Workshop on Quality of Multimedia Experience (QoMEX) (IEEE, New York, 2017)

    Google Scholar 

  29. D. Djaouti, J. Alvarez, J.-P. Jessel, G. Methel, P. Molinier, A gameplay definition through videogame classification. Int. J. Comput. Games Technol. 2008, 1–7 [Online]. Available http://www.hindawi.com/journals/ijcgt/2008/470350/

  30. S. Zadtootaghaj, S. Schmidt, N. Barman, S. Möller, M.G. Martini, A classification of video games based on game characteristics linked to video coding complexity, in 2018 16th Annual Workshop on Network and Systems Support for Games (NetGames) (IEEE, New York, 2018), pp. 1–6.

    Google Scholar 

  31. N. Barman, M.G. Martini, S. Zadtootaghaj, S. Möller, S. Lee, A comparative quality assessment study for gaming and non-gaming videos, in 2018 Tenth International Conference on Quality of Multimedia Experience (QoMEX) (IEEE, New York, 2018), pp. 1–6.

    Google Scholar 

  32. M. Claypool, K. Claypool, Perspectives, frame rates and resolutions: it’s all in the game, in Proceedings of the 4th International Conference on Foundations of Digital Games (2009), pp. 42–49

    Google Scholar 

  33. I. Vilnai-Yavetz, A. Rafaeli, C.S. Yaacov, Instrumentality, aesthetics, and symbolism of office design. Environ. Behav. 37(4), 533–551 (2005)

    Article  Google Scholar 

  34. J. Beyer, V. Miruchna, S. Möller, Assessing the impact of display size, game type, and usage context on mobile gaming QOE, in 2014 Sixth International Workshop on Quality of Multimedia Experience (QoMEX) (IEEE, New York, 2014), pp. 69–70

    Google Scholar 

  35. I. Hupont, J. Gracia, L. Sanagustin, M.A. Gracia, How do new visual immersive systems influence gaming QoE? A use case of serious gaming with oculus rift, in 2015 Seventh International Workshop on Quality of Multimedia Experience (QoMEX) (IEEE, New York, 2015), pp. 1–6.

    Google Scholar 

  36. S. Winkler, Issues in vision modeling for perceptual video quality assessment. Signal Process. 78(2), 231–252 (1999)

    Article  Google Scholar 

  37. P. Quax, A. Beznosyk, W. Vanmontfort, R. Marx, W. Lamotte, An evaluation of the impact of game genre on user experience in cloud gaming, in 2013 IEEE International Games Innovation Conference (IGIC) (IEEE, New York, 2013), pp. 216–221

    Google Scholar 

  38. M. Ries, P. Svoboda, M. Rupp, Empirical study of subjective quality for massive multiplayer games, in 2008 15th International Conference on Systems, Signals and Image Processing (IEEE, New York, 2008), pp. 181–184

    Google Scholar 

  39. Z.-Y. Wen, H.-F. Hsiao, QoE-driven performance analysis of cloud gaming services, in 2014 IEEE 16th International Workshop on Multimedia Signal Processing (MMSP) (IEEE, New York, 2014), pp. 1–6

    Google Scholar 

  40. J. Beyer, R. Varbelow, J.-N. Antons, S. Möller, Using electroencephalography and subjective self-assessment to measure the influence of quality variations in cloud gaming, in 2015 Seventh International Workshop on Quality of Multimedia Experience (QoMEX) (IEEE, New York, 2015), pp. 1–6

    Google Scholar 

  41. K.-T. Chen, Y.-C. Chang, H.-J. Hsu, D.-Y. Chen, C.-Y. Huang, C.-H. Hsu, On the quality of service of cloud gaming systems. IEEE Trans. Multimedia 16(2), 480–495 (2013)

    Article  Google Scholar 

  42. N. Barman, M.G. Martini, H. 264/MPEG-AVC, H. 265/MPEG-HEVC and VP9 codec comparison for live gaming video streaming, in 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX) (IEEE, New York, 2017), pp. 1–6

    Google Scholar 

  43. M. Claypool, K. Claypool, F. Damaa, The effects of frame rate and resolution on users playing first person shooter games, in Multimedia Computing and Networking 2006, vol. 6071 (International Society for Optics and Photonics, Bellingham, 2006), p. 607101

    Google Scholar 

  44. ITU-T Recommendation P.911, Subjective Audiovisual Quality Assessment Methods for Multimedia Applications (International Telecommunication Union, Geneva, 1998)

    Google Scholar 

  45. S. Schmidt, S. Möller, S. Zadtootaghaj, A comparison of interactive and passive quality assessment for gaming research, in 2018 Tenth International Conference on Quality of Multimedia Experience (QoMEX) (IEEE, New York, 2018), pp. 1–6

    Google Scholar 

  46. M. Claypool, Motion and scene complexity for streaming video games, in Proceedings of the 4th International Conference on Foundations of Digital Games (2009), pp. 34–41

    Google Scholar 

  47. ITU-T Recommendation P.80, Methods for Subjective Determination of Transmission Quality (International Telecommunication Union, Geneva, 1993)

    Google Scholar 

  48. S. Schmidt, Assessing the Quality of Experience of Cloud Gaming Services. PhD Thesis, TU Berlin, 2021

    Google Scholar 

  49. ITU-T Recommendation P.918, Dimension-Based Subjective Quality Evaluation for Video Content (International Telecommunication Union, Geneva, 2020)

    Google Scholar 

  50. S. Zadtootaghaj, S. Schmidt, S.S. Sabet, S. Möller, C. Griwodz, Quality estimation models for gaming video streaming services using perceptual video quality dimensions, in Proceedings of the 11th ACM Multimedia Systems Conference (2020), pp. 213–224

    Google Scholar 

  51. ITU-T Recommendation G.1072, Opinion Model Predicting Gaming Quality of Experience for Cloud Gaming Services. (International Telecommunication Union, Geneva, 2020)

    Google Scholar 

  52. P.M. Fitts, The Information capacity of the human motor system in controlling the amplitude of movement. J. Exp. Psychol. 47(6), 381 (1954)

    Google Scholar 

  53. M. Claypool, Game input with delay—Moving target selection with a game controller thumbstick, in ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), vol. 14(3s) (2018), pp. 1–22

    Google Scholar 

  54. M. Claypool, R. Eg, K. Raaen, Modeling user performance for moving target selection with a delayed mouse, in International Conference on Multimedia Modeling (Springer, New York, 2017), pp. 226–237

    Google Scholar 

  55. M. Long, C. Gutwin, Characterizing and modeling the effects of local latency on game performance and experience, in Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play (2018), pp. 285–297

    Google Scholar 

  56. M. Claypool, D. Finkel, The effects of latency on player performance in cloud-based games, in 2014 13th Annual Workshop on Network and Systems Support for Games (IEEE, New York, 2014), pp. 1–6

    Book  Google Scholar 

  57. C.-Y. Huang, C.-H. Hsu, Y.-C. Chang, K.-T. Chen, GamingAnywhere: an Open cloud gaming system, in Proceedings of the 4th ACM Multimedia Systems Conference (2013), pp. 36–47

    Google Scholar 

  58. I. Slivar, L. Skorin-Kapov, M. Suznjevic, Cloud gaming QoE models for deriving video encoding adaptation strategies, in Proceedings of the 7th International Conference on Multimedia Systems (2016), pp. 1–12

    Google Scholar 

  59. S. Zadtootaghaj, S. Schmidt, S. Möller, Modeling gaming QoE: towards the impact of frame rate and bit rate on cloud gaming, in 2018 Tenth International Conference on Quality of Multimedia Experience (QoMEX) (IEEE, New York, 2018), pp. 1–6

    Google Scholar 

  60. N. Barman, S. Schmidt, S. Zadtootaghaj, M.G. Martini, S. Möller, An evaluation of video quality assessment metrics for passive gaming video streaming, in Proceedings of the 23rd Packet Video Workshop (ACM, New York, 2018), pp. 7–12

    Google Scholar 

  61. N. Barman, S. Zadtootaghaj, S. Schmidt, M.G. Martini, S. Möller, An objective and subjective quality assessment study of passive gaming video streaming. Int. J. Netw. Manage. 30, e2054 (2018)

    Google Scholar 

  62. S. Göring, R.R.R. Rao, A. Raake, Nofu—A lightweight no-reference pixel based video quality model for gaming content, in 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX), (IEEE, New York, 2019), pp. 1–6

    Book  Google Scholar 

  63. N. Barman, E. Jammeh, S.A. Ghorashi, M.G. Martini, No-reference video quality estimation based on machine learning for passive gaming video streaming applications. IEEE Access 7, 74511–74527 (2019)

    Article  Google Scholar 

  64. S. Van Damme, M.T. Vega, J. Heyse, F. De Backere, F. De Turck, A low-complexity psychometric curve-fitting approach for the objective quality assessment of streamed game videos. Signal Process. Image Commun. 88, 115954 (2020)

    Article  Google Scholar 

  65. S. Wang, S. Dey, Cloud mobile gaming: modeling and measuring user experience in mobile wireless networks. ACM SIGMOBILE Mobile Comput. Commun. Rev. 16(1), 10–21 (2012)

    Article  Google Scholar 

  66. ITU-T Recommendation G.107, The E-model: a Computational Model for Use in Transmission Planning (International Telecommunication Union, Geneva, 2015)

    Google Scholar 

  67. Y.-T. Lee, K.-T. Chen, H.-I. Su, C.-L. Lei, are all games equally cloud-gaming-friendly? An electromyographic approach, in 2012 11th Annual Workshop on Network and Systems Support for Games (NetGames) (IEEE, New York, 2012), pp. 1–6

    Google Scholar 

  68. I. Slivar, M. Suznjevic, L. Skorin-Kapov, M. Matijasevic, Empirical QoE study of in-home streaming of online games, in 2014 13th Annual Workshop on Network and Systems Support for Games (IEEE, New York, 2014), pp. 1–6

    Google Scholar 

  69. H.-J. Hong, C.-F. Hsu, T.-H. Tsai, C.-Y. Huang, K.-T. Chen, C.-H. Hsu, Enabling adaptive cloud gaming in an open-source cloud gaming platform. IEEE Trans. Circ. Syst. Video Technol. 25(12), 2078–2091 (2015)

    Article  Google Scholar 

  70. I. Slivar, M. Suznjevic, L. Skorin-Kapov, The impact of video encoding parameters and game type on qoe for cloud gaming: a case study using the steam platform, in 2015 Seventh International Workshop on Quality of Multimedia Experience (QoMEX) (IEEE, New York, 2015), pp. 1–6

    Google Scholar 

  71. A. Raake, M.-N. Garcia, S. Moller, J. Berger, F. Kling, P. List, J. Johann, C. Heidemann, TV-model: parameter-based prediction of IPTV quality, in 2008 IEEE International Conference on Acoustics, Speech and Signal Processing (IEEE, New York, 2008), pp. 1149–1152

    Google Scholar 

  72. Z. Wang, A.C. Bovik, H.R. Sheikh, E.P. Simoncelli, Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)

    Article  Google Scholar 

  73. H.R. Sheikh, A.C. Bovik, Image information and visual quality. IEEE Trans. Image Process. 15(2), 430–444 (2006)

    Article  Google Scholar 

  74. Netflix, VMAF - Video Multi-Method Assessment Fusion https://github.com/Netflix/vmaf [Online: Accessed 2-Oct-2018]

  75. R.R. Ramachandra Rao, S. Göring, R. Steger, S. Zadtootaghaj, N. Barman, S. Fremerey, S. Möller, A. Raake, A large-scale evaluation of the bitstream-based video-quality model ITU-T P. 1204.3 on gaming content, in 2020 IEEE 22nd International Workshop on Multimedia Signal Processing (MMSP), (IEEE, 2020), pp. 1–6

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Dolby Laboratories, Berlin, Germany

    Saman Zadtootaghaj

Authors
  1. Saman Zadtootaghaj
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Zadtootaghaj, S. (2022). Gaming Quality of Experience. In: Quality of Experience Modeling for Cloud Gaming Services. T-Labs Series in Telecommunication Services. Springer, Cham. https://doi.org/10.1007/978-3-030-98249-2_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-98249-2_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-98248-5

  • Online ISBN: 978-3-030-98249-2

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation