Huahui Wu
Abstract
New TCP-friendly constraints require multimedia flows to reduce their data rates under packet loss to that of a conformant TCP flow. To reduce data rates while preserving real-time playout, temporal scaling can be used to discard the encoded multimedia frames that have the least impact on perceived video quality. To limit the impact of lost packets, Forward Error Correction (FEC) can be used to repair frames damaged by packet loss. However, adding FEC requires further reduction of multimedia data, making the decision of how much FEC to use of critical importance. Current approaches use either inflexible FEC patterns or adapt to packet loss on the network without regard to TCP-friendly data rate constraints. In this article, we analytically model the playable frame rate of a TCP-friendly MPEG stream with FEC and temporal scaling, capturing the impact of distributing FEC within MPEG frame types with interframe dependencies. For a given network condition and MPEG video encoding, we use our model to exhaustively search for the optimal combination of FEC and temporal scaling that yields the highest playable frame rate within TCP-friendly constraints. Analytic experiments over a range of network and application conditions indicate that adjustable FEC with temporal scaling can provide a significant performance improvement over current approaches. Extensive simulation experiments based on Internet traces show that our model can be effective as part of a streaming protocol that chooses FEC and temporal scaling patterns that meet dynamically-changing application and network conditions.
- Acharya, S. and Smith, B. 1998. An experiment to characterize videos stored on the Web. In Proceedings of the ACM/SPIE Multimedia Computing and Networking (MMCN). San Jose, CA, 166--178.]]Google Scholar
- Albanese, A., Bomer, J., Edmonds, J., Luby, M., and Sudan, M. 1996. Priority encoding transmission. IEEE Trans. Inform. Theory 42, 6 (Nov.), 1737--1744.]]Google Scholar
- Balakrishnan, H., Rahul, H., and Seshan, S. 1999. An integrated congestion management architecture for Internet hosts. In Proceedings of ACM SIGCOMM. Cambridge, MA.]] Google Scholar
- Bocheck, P., Campbell, A., Chang, S.-F., and Lio, R. 1999. Utility-based network adaptation for MPEG-4 systems. In Proceedings of International Workshop on Network and Operating System Support for Digital Audio and Video (NOSSDAV). Basking Ridge, NJ.]]Google Scholar
- Bolot, J.-C., Fosse-Parisis, S., and Towsley, D. 1999. Adaptive FEC-based error control for Internet telephony. In Proceedings of IEEE INFOCOM. New York, NY.]]Google Scholar
- Boutremans, C., Iannaccone, G., and Diot, C. 2002. Impact of link failures on VoIP performance. In Proceedings of the Network and Operating System Support for Digital Audio and Video (NOSSDAV). Miami Beach, FL.]] Google Scholar
- Boyce, J. and Gaglianello, R. 1998. Packet loss effects on MPEG video sent over the public Internet. In Proceedings of ACM Multimedia. Bristol, U.K., 181--190.]] Google Scholar
- Braden, B., Clark, D., Crowcroft, J., Davie, B., Deering, S., Estrin, D., Floyd, S., Jacobson, V., Minshall, G., Partridge, C., L. Peterson, K. R., Shenker, S., Wroclawski, J., and Zhang, L. 1998. Recommendations on queue management and congestion avoidance in the Internet. IETF Request for Comments (RFC) 2309.]] Google Scholar
- Chung, J., Claypool, M., and Zhu, Y. 2003. Measurement of the congestion responsiveness of RealPlayer streaming video over UDP. In Proceedings of the Packet Video Workshop (PV). Nantes, France.]]Google Scholar
- DeSantis, T. and Loose, D. 2003. TCP traffic analysis. Major Qualifying Project MQP-MLC-MT03 Worcester Polytechnic Institute. Advisors M. Claypool and R. Kinicki.]]Google Scholar
- Feamster, N. and Balakrishnan, H. 2002. Packet loss recovery for streaming video. In Proceedings of 12th International Packet Video (PV) Workshop. Pittsburgh, PA.]]Google Scholar
- Floyd, S. 1994. TCP and explicit congestion notification. Comput. Comm. Rev.]] Google Scholar
- Floyd, S. and Fall, K. 1999. Promoting the use of end-to-end congestion control in the internet. IEEE/ACM Trans. Netw.]] Google Scholar
- Floyd, S., Handley, M., Padhye, J., and Widmer, J. 2000. Equation-based congestion control for unicast applications. In Proceedings of ACM SIGCOMM Conference. Stockholm, Sweden, 43--56.]] Google Scholar
- Garret, M. W. and Willinger, W. 1994. Analysis, modeling and generation of self-similar VBR video traffic. In Proceedings of ACM SIGCOMM.]] Google Scholar
- Hardman, V., Sasse, M. A., Handley, M., and Watson, A. 1995. Reliable audio for use over the Internet. In Proceedings of Internet Society's International Networking Conference (INET).]]Google Scholar
- Hartanto, F. and Sirisena, H. R. 1999. Hybrid error control mechanism for video transmission in the wireless IP networks. In Proceedings of the 10th IEEE Workshop on Local and Metropolitan Area Networks (LANMAN).]]Google Scholar
- Hemy, M., Hangartner, U., Steenkiste, P., and Gross, T. 1999. MPEG system streams in best-effort networks. In Proceedings of Packet Video Workshop.]]Google Scholar
- International Telecommunications Union. 1996. One-way transmission time. Tech. Rep. G. 114, ITU-T Recommendation.]]Google Scholar
- Jaiswal, S., Iannaccone, G., Diot, C., Kurose, J., and Towsley, D. 2004. Inferring TCP connection characteristics through passive measurements. In Proceedings of IEEE Infocom. Hong Kong, China.]]Google Scholar
- Krunz, M., Sass, R., and Hughes, H. 1995. Statistical characteristics and multiplexing of MPEG streams. In Proceedings of IEEE Infocom. Boston, MA, 455--462.]] Google Scholar
- Liu, Y. and Claypool, M. 2000. Using redundancy to repair video damaged by network data loss. In Proceedings of IS&T/SPIE/ACM Multimedia Computing and Networking (MMCN).]]Google Scholar
- Loguinov, D. and Radha, H. 2001. Measurement study of low-bitrate internet video streaming. In Proceedings of the ACM SIGCOMM Internet Measurement Workshop.]] Google Scholar
- Mahajan, R., Floyd, S., and Wetherall, D. 2001. Controlling high-bandwidth flows at the congested router. In Proceedings of the 9th International Conference on Network Protocols (ICNP).]] Google Scholar
- Mayer-Patel, K., Le, L., and Carle, G. 2002. An MPEG performance model and its application to adaptive forward error correction. In Proceedings of ACM Multimedia.]] Google Scholar
- Mena, A. and Heidemann, J. 2000. An empirical study of real audio traffic. In Proceedings of IEEE Infocom. Tel-Aviv, Israel, 101--110.]]Google Scholar
- Mitchell, J. and Pennebaker, W. 1996. MPEG Video: Compression Standard. Chapman and Hall.]] Google Scholar
- Nguyen, T. and Zakhor, A. 2002. Distributed video streaming with forward error correction. In 12th International Packet Video Workshop.]]Google Scholar
- Padhye, C., Christensen, K., and Moreno, W. 2000. A new adaptive FEC loss control algorithm for voice over IP applications. In Proceedings of IEEE International Performance, Computing and Communication Conference. Phoenix, AZ.]]Google Scholar
- Padhye, J., Firoiu, V., Towsley, D., and Kurose, J. 1998. Modeling TCP throughput: A simple model and its empirical validation. In Proceedings of ACM SIGCOMM. Vancouver, Brisish Columbia, Canada.]] Google Scholar
- Park, K. and Wang, W. 1999. QoS-sensitive transport of real-time MPEG video using adaptive forward error correction. In Proceedings of IEEE Multimedia Systems. 426--432.]] Google Scholar
- Paxson, V. 1999. End-to-end internet packet dynamics. IEEE/ACM Trans. Networ.]] Google Scholar
- Pinson, M. and Wolf, S. 2004. A new standardized method for objectively measuring video quality. IEEE Trans. Broadcast. 50, 3 (Sept.), 312--322.]]Google Scholar
- Real Networks Incorporated. © 2000. RealProducer User's Guide. URL: http://www.service.real.com/help/library/guides/producerplus85/producer.htm.]]Google Scholar
- Reed, I. S. and Solomon, G. 1960. Polynomial codes over certain finite fields. J. SIAM Society Indust. Appl. Math. 8, 2 (June), 300--304.]]Google Scholar
- Rejaie, R., Handley, M., and Estrin, D. 1999. RAP: An end-to-end rate-based congestion control mechanism for realtime streams in the Internet. In Proceedings of IEEE Infocom. New York, NY, 1337--1345.]]Google Scholar
- Rhee, I. 1998. Error control techniques for interactive low-bit rate video transmission over the internet. In Proceedings of ACM SIGCOMM Conference.]] Google Scholar
- Rizzo, L. 1997. On the feasibility of software FEC. Tech. Rep. LR-970131, DEIT.]]Google Scholar
- Rose, O. 1995. Statistical properties of MPEG video traffic and their impact on traffic modeling in ATM systems. In Proceedings of 20th Conference of Local Computer Networks. 397--406.]] Google Scholar
- Tripathi, A. and Claypool, M. 2002. Improving multimedia streaming with content-aware video scaling. In Workshop on Intelligent Multimedia Computing and Networking (IMMCN). Durham, NC.]]Google Scholar
- van den Branden Lambrecht, C. J. and Verscheure, O. 1996. Quality measure using a spatio-temporal model of the human visual system. In Proceedings of SPIE.]]Google Scholar
- Wang, Y., Claypool, M., and Zuo, Z. 2001. An empirical study of RealVideo performance across the Internet. In Proceedings of the ACM SIGCOMM Internet Measurement Workshop (IMW). San Francisco, CA. 295--309.]] Google Scholar
- Wu, H., Claypool, M., and Kinicki, R. 2003a. A model for MPEG with forward error correction and TCP-friendly bandwidth. In Proceedings of Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV). Monterey, CA.]] Google Scholar
- Wu, H., Claypool, M., and Kinicki, R. 2003b. Adjusting forward error correction with temporal scaling for TCP-friendly streaming MPEG. Tech. Rep. WPI-CS-TR-03-10, CS Department, Worcester Polytechnic Institute.]]Google Scholar
- Wu, H., Claypool, M., and Kinicki, R. 2004. Practical group of pictures considerations. In Proceedings of the Packet Video Workshop (PV). Irvine, CA. Poster.]]Google Scholar
Index Terms
- Adjusting forward error correction with temporal scaling for TCP-friendly streaming MPEG
Recommendations
A model for MPEG with forward error correction and TCP-friendly bandwidth
NOSSDAV '03: Proceedings of the 13th international workshop on Network and operating systems support for digital audio and videoThe growing requirement of TCP-Friendly bandwidth use by streaming video plus the proven advantages of Forward Error Correction (FEC) to combat packet loss presents the opportunity to optimize the amount of FEC in a TCP-Friendly video stream. In this ...
Adjusting forward error correction with quality scaling for streaming MPEG
NOSSDAV '05: Proceedings of the international workshop on Network and operating systems support for digital audio and videoPacket loss can severely impact streaming video quality. Repair techniques protect streaming video from packet loss but at the price of a reduced effective transmission rate when streaming a flow in a capacity constrained situation. This paper proposes ...
Burst-Aware Adaptive Forward Error Correction in Video Streaming over Wireless Networks
HPCC '08: Proceedings of the 2008 10th IEEE International Conference on High Performance Computing and CommunicationsVideo streaming over wireless networks have many challenges due to the high error rate and burst packet error characteristic. Forward error correction (FEC) is a method commonly used to handle losses in real-time communication. Conventional FEC ...
Comments