skip to main content
10.1145/3204949.3204955acmconferencesArticle/Chapter ViewAbstractPublication PagesmmsysConference Proceedingsconference-collections
research-article

Classifying flows and buffer state for youtube's HTTP adaptive streaming service in mobile networks

Published:12 June 2018Publication History

ABSTRACT

Accurate cross-layer information is very useful to optimize mobile networks for specific applications. However, providing application-layer information to lower protocol layers has become very difficult due to the wide adoption of end-to-end encryption and due to the absence of cross-layer signaling standards. As an alternative, this paper presents a traffic profiling solution to passively estimate parameters of HTTP Adaptive Streaming (HAS) applications at the lower layers. By observing IP packet arrivals, our machine learning system identifies video flows and detects the state of an HAS client's play-back buffer in real time. Our experiments with YouTube's mobile client show that Random Forests achieve very high accuracy even with a strong variation of link quality. Since this high performance is achieved at IP level with a small, generic feature set, our approach requires no Deep Packet Inspection (DPI), comes at low complexity, and does not interfere with end-to-end encryption. Traffic profiling is, thus, a powerful new tool for monitoring and managing even encrypted HAS traffic in mobile networks.

References

  1. A. Molavi Kakhki et al. 2016. BingeOn Under the Microscope: Understanding T-Mobile's Zero-Rating Implementation. In Proc. ACM Internet-QoE. 43--48. Google ScholarGoogle ScholarCross RefCross Ref
  2. L. Breiman. 2001. Random Forests. Machine Learning 45, 1 (Oct. 2001), 5--32. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Cisco. 2017. Visual Networking Index: Global mobile data traffic forecast update, 2016-2021. White Paper (Feb. 2017).Google ScholarGoogle Scholar
  4. DASH Industry Forum. 2014. Guidelines for Implementation: DASH-AVC/264 Test cases and Vectors. Report (Jan. 2014).Google ScholarGoogle Scholar
  5. G. Dimopoulos, P. Barlet-Ros, and J. Sanjuàs-Cuxart. 2013. Analysis of YouTube user experience from passive measurements. In Proc. IEEE CNSM. 260--267.Google ScholarGoogle Scholar
  6. G. Dimopoulos, I. Leontiadis, P. Barlet-Ros, and K. Papagiannaki. 2016. Measuring Video QoE from Encrypted Traffic. In Proc. ACM IMC. 513--526. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Zweites Deutsches Fernsehen. 2017. Heute Show. Video. Retrieved May 21, 2018 from https://www.youtube.com/watch?v=N2sCbtodGMIGoogle ScholarGoogle Scholar
  8. Blender Foundation. 2013. Tears of steel. Video. Retrieved May 21, 2018 from https://www.youtube.com/watch?v=OHOpb2fS-cMGoogle ScholarGoogle Scholar
  9. C. Fraleigh et al. 2003. Packet-level traffic measurements from the Sprint IP backbone. IEEE Network 17, 6 (Nov. 2003), 6--16. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Y. Freund and R. E. Schapire. 1997. A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting. J. Comput. System Sci. 55, 1 (Aug. 1997), 119--139. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. S. Galetto et al. 2017. Detection of video/audio streaming packet flows for non-intrusive QoS/QoE monitoring. In Proc. IEEE MN. 1--6.Google ScholarGoogle ScholarCross RefCross Ref
  12. ISO/1EC. 2014. Dynamic adaptive streaming over HTTP (DASH). International Standard 23009-1:2014 (May 2014).Google ScholarGoogle Scholar
  13. T. Karagkioules, C. Concolato, D. Tsilimantos, and S. Valentin. 2017. A Comparative Case Study of HTTP Adaptive Streaming Algorithms in Mobile Networks. In Proc. ACM NOSSDAV. 1--6. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. M. Katsarakis, R. C. Teixeira, M. Papadopouli, and V. Christophides. 2016. Towards a Causal Analysis of Video QoE from Network and Application QoS. In Proc. ACM Internet-QoE. 31--36. Google ScholarGoogle ScholarCross RefCross Ref
  15. V. Krishnamoorthi, N. Carlsson, E. Halepovic, and E. Petajan. 2017. BUFFEST: Predicting Buffer Conditions and Real-time Requirements of HTTP(S) Adaptive Streaming Clients. In Proc. ACM MMSys. 76--87. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Y. Lin and Y. Jeon. 2006. Random Forests and Adaptive Nearest Neighbors. J. Amer. Statist. Assoc. 101, 474 (2006), 578--590.Google ScholarGoogle ScholarCross RefCross Ref
  17. A. Mondal et al. 2017. Candid with YouTube: Adaptive Streaming Behavior and Implications on Data Consumption. In Proc. ACM NOSSDAV. 19--24 Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. T. T. T. Nguyen and G. Armitage. 2008. A survey of techniques for Internet traffic classification using machine learning. IEEE Communications Surveys Tutorials 10, 4 (Fourth 2008), 56--76. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. National Institute of Fundamental Studies Sri Lanka. 2016. Science Copies Nature's Secrets. Video. Retrieved May 21, 2018 from https://www.youtube.com/watch?v=2d1VrCvdzbYGoogle ScholarGoogle Scholar
  20. I. Orsolic, D. Pevec, M. Suznjevic, and L. Skorin-Kapov. 2017. A machine learning approach to classifying YouTube QoE based on encrypted network traffic. Springer Multimedia Tools and Applications 76, 21 (Nov. 2017), 22267--22301. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. R. Pantos and W. May. 2011. HTTP live streaming. IETF, Informational Internet-Draft 2582 (Sept. 2011).Google ScholarGoogle Scholar
  22. J. Roskind. 2013. QUIC: Multiplexed Stream Transport over UDP. Design Document and Specification Rationale (Dec. 2013).Google ScholarGoogle Scholar
  23. J. Samain et al. 2017. Dynamic Adaptive Video Streaming: Towards a Systematic Comparison of ICN and TCP/IP. IEEE Transactions on Multimedia 19, 10 (Oct. 2017), 2166--2181.Google ScholarGoogle ScholarCross RefCross Ref
  24. Sandvine. 2016. Global Internet Phenomena: Latin America & North America. Report (June 2016).Google ScholarGoogle Scholar
  25. C. Seiffert, T. M. Khoshgoftaar, J. Van Hulse, and A. Napolitano. 2010. RUSBoost: A Hybrid Approach to Alleviating Class Imbalance. IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans 40, 1 (Jan. 2010), 185--197. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. tc. 2001. traffic configuration tool (tc). Retrieved May 21, 2018 from https://lartc.org/manpages/tc.htmlGoogle ScholarGoogle Scholar
  27. Tcpdump. 2015. tcpdump packet analyzer v. 4.7.4, (libpeap v. 1.7.4). Retrieved May 21, 2018 from https://www.tcpdump.orgGoogle ScholarGoogle Scholar
  28. The Math Works Inc. 2015. Statistics and Machine Learning Toolbox v10.1. Retrieved May 21, 2018 from https://mathworks.com/products/statistics.htmlGoogle ScholarGoogle Scholar
  29. D. Tsilimantos, T. Karagkioules, A. Nogales-Gómez, and S. Valentin. 2017. Traffic profiling for mobile video streaming. In Proc. IEEE ICC. 1--7.Google ScholarGoogle Scholar
  30. D. Tsilimantos, A. Nogales-Gómez, and S. Valentin. 2016. Anticipatory Radio Resource Management for Mobile Video Streaming with Linear Programming. In Proc. IEEE ICC. 1--6.Google ScholarGoogle Scholar
  31. T-Mobile USA. 2016. Content Provider Technical Requirements for Binge On. (March 2016). Retrieved May 21, 2018 from https://www.t-mobile.com/content/dam/tmo/en-g/pdf/BingeOn-Video-Technical-Criteria-March-2016.pdfGoogle ScholarGoogle Scholar
  32. D. De Vleeschauwer et al. 2013. Optimization of HTTP adaptive streaming over mobile cellular networks. In Proc. IEEE INFOCOM. 898--997.Google ScholarGoogle Scholar
  33. YouTube. 2015. YouTube RED. Retrieved May 21, 2018 from https://www.youtube.com/redGoogle ScholarGoogle Scholar

Index Terms

  1. Classifying flows and buffer state for youtube's HTTP adaptive streaming service in mobile networks

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        MMSys '18: Proceedings of the 9th ACM Multimedia Systems Conference
        June 2018
        604 pages
        ISBN:9781450351928
        DOI:10.1145/3204949
        • General Chair:
        • Pablo Cesar,
        • Program Chairs:
        • Michael Zink,
        • Niall Murray

        Copyright © 2018 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 12 June 2018

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        Overall Acceptance Rate176of530submissions,33%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader