Enrico Bocchi
Luca De Cicco
ABSTRACT
Measuring quality of Web users experience (WebQoE) faces the following trade-off. On the one hand, current practice is to resort to metrics, such as the document completion time (onLoad), that are simple to measure though knowingly inaccurate. On the other hand, there are metrics, like Google’s SpeedIndex, that are better correlated with the actual user experience, but are quite complex to evaluate and, as such, relegated to lab experiments. In this paper, we first provide a comprehensive state of the art on the metrics and tools available for WebQoE assessment. We then apply these metrics to a representative dataset (the Alexa top-100 webpages) to better illustrate their similarities, differences, advantages and limitations. We next introduce novel metrics, inspired by Google’s SpeedIndex, that (i) offer significant advantage in terms of computational complexity, (ii) while maintaining a high correlation with the SpeedIndex at the same time. These properties makes our proposed metrics highly relevant and of practical use.
- 1.http://www.showslow.com.Google Scholar
- 2.Pagespeed insights. https://developers.google.com/speed/docs/insights/rules.Google Scholar
- 3.Yslow ruleset matrix. http://yslow.org/ruleset-matrix/.Google Scholar
- 4.Alexa Internet Inc. http://www.alexa.com.Google Scholar
- 5.J. Brutlag, Z. Abrams, and P. Meenan. Above the fold time: Measuring web page performance visually. http://conferences.oreilly.com/velocity/velocity-mar2011/public/schedule/detail/18692.Google Scholar
- 6.M. Butkiewicz, D. Wang, Z. Wu, H. V. Madhyastha, and V. Sekar. Klotski: Reprioritizing web content to improve user experience on mobile devices. In USENIX NSDI, pages 439–453, Oakland, CA, May 2015. USENIX Association. Google ScholarDigital Library
- 7.Dynatrace. dynatrace. http://dynatrace.com/.Google Scholar
- 8.J. Erman, V. Gopalakrishnan, R. Jana, and K. K. Ramakrishnan. Towards a spdy'ier mobile web? In ACM CoNEXT, pages 303–314, December 2013. Google ScholarDigital Library
- 9.Google Inc. https://sites.google.com/a/webpagetest.org/docs/using-webpagetest/metrics/speed-index.Google Scholar
- 10.Google Inc. https://googlewebmastercentral.blogspot.fr/2010/04/using-site-speed-in-web-search-ranking.html.Google Scholar
- 11.Google Inc. https://www.youtube.com/watch?v=muSIzHurn4U .Google Scholar
- 12.Google Inc. http://webpagetest.org.Google Scholar
- 13.International Telecommunication Union. Subjective testing methodology for web browsing. Technical report, Feb. 2014.Google Scholar
- 14.M. Varvello, K. Schomp, D. Naylor, J. Blackburn, A. Finamore, and K. Papagiannaki. Is The Web HTTP/2 Yet? In Passive and Active Measurement (PAM), Apr. 2016.Google ScholarCross Ref
- 15.R. B. Miller. Response time in man-computer conversational transactions. In Proc. AFIPS Fall Joint Computer Conference, pages 267–277. ACM, 1968. Google ScholarDigital Library
- 16.J. Nielsen. Response times: The 3 important limits. https://www.nngroup.com/articles/response-times-3-important-limits/.Google Scholar
- 17.F. Qian, V. Gopalakrishnan, E. Halepovic, S. Sen, and O. Spatscheck. Tm3: Flexible transport-layer multi-pipe multiplexing middlebox without head-of-line blocking. In ACM CoNEXT, December 2015.Google ScholarDigital Library
- 18.X. S. Wang, A. Balasubramanian, A. Krishnamurthy, and D. Wetherall. How speedy is spdy? In USENIX NSDI, pages 387–399, Seattle, WA, Apr. 2014. USENIX Association. Google ScholarDigital Library
- 19.X. S. Wang, A. Krishnamurthy, and D. Wetherall. Speeding up web page loads with shandian. In USENIX NSDI, 2016. Google ScholarDigital Library
- 20.World Wide Web Consortium. https://www.w3.org/TR/2012/REC-navigation-timing-20121217.Google Scholar
Index Terms
- Measuring the Quality of Experience of Web users
Recommendations
Perceived Performance of Top Retail Webpages In the Wild: Insights from Large-scale Crowdsourcing of Above-the-Fold QoE
Internet QoE '17: Proceedings of the Workshop on QoE-based Analysis and Management of Data Communication NetworksClearly, no one likes webpages with poor quality of experience (QoE). Being perceived as slow or fast is a key element in the overall perceived QoE of web applications. While extensive effort has been put into optimizing web applications (both in ...
Measuring the Quality of Experience of Web users
Measuring quality of Web users experience (WebQoE) faces the following trade-off. On the one hand, current practice is to resort to metrics, such as the document completion time (onLoad), that are simple to measure though knowingly inaccurate. On the ...
Perceived Performance of Top Retail Webpages In the Wild
Clearly, no one likes webpages with poor quality of experience (QoE). Being perceived as slow or fast is a key element in the overall perceived QoE of web applications. While extensive effort has been put into optimizing web applications (both in ...
Comments