Skip to main content
SpringerLink
Log in

Eliminating the effect of freezing frames on user perceptive by using a time interleaving technique

  • Regular Paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

Streaming video over a wireless network faces several challenges such as high packet error rates, bandwidth variations, and delays, which could have negative effects on the video streaming and the viewer will perceive a frozen picture for certain durations due to loss of frames. In this study, we propose a Time Interleaving Robust Streaming (TIRS) technique to significantly reduce the frozen video problem and provide a satisfactory quality for the mobile viewer. This is done by reordering the streaming video frames as groups of even and odd frames. The objective of streaming the video in this way is to avoid the losses of a sequence of neighbouring frames in case of a long sequence interruption. We evaluate our approach by using a user panel and mean opinion score (MOS) measurements; where the users observe three levels of frame losses. The results show that our technique significantly improves the smoothness of the video on the mobile device in the presence of frame losses, while the transmitted data are only increased by almost 9% (due to reduced time locality).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Apostolopoulos, J.: Reliable video communication over lossy packet networks using multiple state encoding and path diversity. In: Proceedings of Visual Communications and Image Processing, pp. 392–409 (2001)

  2. Argyriou, A., Madisetti, V.: Streaming H.264/AVC video over the internet. In: IEEE Consumer Communications and Networking Conference (CCNC’04), pp. 169–174 (2004)

  3. Aziz, H.M., Fiedler, M., Grahn H., Lundberg, L.: Streaming video as space-divided sub-frames over wireless networks. In: the Proceedings of the 3rd Joint IFIP Wireless and Mobile Networking Conference, (WMNC’10) (2010)

  4. Benslimane, A.: Multimedia multicast on the internet. Wiley-ISTE publisher (2007)

  5. Cai, J., Chen, C.W.: FEC-based video streaming over packet loss networks with pre-interleaving. In: Proceeding for the International Conference on Information Technology: Coding and Computing, pp. 10–14 (2001)

  6. Chen, L.-J., Sun, T., Sanadidi, M.Y., Gerla, M.: Improving wireless link throughput via interleaved FEC. In: Proceedings of the 9th IEEE Symposium on Computers and Communications, pp. 539–544 (2004)

  7. Claypool, M., Zhu, Y.: Using interleaving to ameliorate the effects of packet loss in a video stream. In: Proceedings of the International Workshop on Multimedia Network Systems and Applications (MNSA) (2003)

  8. Cranley, N., Davis, M.: Video frame differentiation for streamed multimedia over heavily loaded IEEE 802.11e WLAN using TXOP. In: Proceedings of 18th Annual IEEE International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC’07) (2007)

  9. Dapeng, W., Hou, Y.T., Zhu, W., Zhang, Y.-Q., Peha, J.M.: Streaming video over the internet: approaches and directions. IEEE. Tran. Circ. Syst. Video. Tech. 11(3), 282–300 (2001)

    Article  Google Scholar 

  10. International Telecommunication Union. Methodology for the subjective assessment of the quality of television pictures. ITU-R, Rec. BT.500-11, (2002)

  11. Jianhua, W., Jianfei, C.: Quality-smoothed encoding for real-time video streaming applications. In: Proceedings of the 9th International Symposium on Consumer Electronics (ISCE’05), pp. 445–449 (2005)

  12. Lo, A., Heijenk, G., Niemegeers, I.: Performance evaluation of MPEG-4 video streaming over UMTS networks using an integrated tool environment. In: Proceedings of the International Symposium on Performance Evaluation of Computer and Telecommunication Systems (SPECTS’05), pp. 676–682 (2005)

  13. Lei, H., Fan, C., Zhang, X., Yang, D.: QoS aware packet scheduling algorithm for OFDMA systems. In: IEEE 66th Vehicular Technology Conference, pp.1877–1881 (2007)

  14. Martinez-Rachm, M., Lopez, O., Pinol, P., Malumbres, M.P., Oliver, J., Calafate, C.T.: Quality assessment metrics vs. PSNR under packet loss scenarios in MANET wireless networks. In: Proceedings of the International Workshop on Mobile Video (MV ‘07), pp. 31–36 (2007)

  15. Martinez-Rach, M., Lopez, O., Pinol, P., Malumbres, M.P., Oliver, J., Calafate, C.T.: Behavior of quality assessment metrics under packet losses on wireless networks. XIX Jornadas de Paralelismov (2008)

  16. Mancuso, V., Gambardella, M., Bianchi, G.: Improved support for streaming services in vehicular networks. In: Proceedings of ICC 2004 Conference, pp. 4362–4366 (2004)

  17. Nafaa, A., Ahmed, T., Mehaoua, A.: Unequal and interleaved FEC protocol for robust MPEG-4 multicasting over wireless LANs. In: Proceedings of the IEEE International Conference on Communications (ICC’04), pp. 1431–1435 (2004)

  18. Nafaa, A., Taleb, T., Murphy, L.: Forward error correction strategies for media streaming over wireless networks. IEEE. Commun. Mag. Featur. Top. New. Trends. Mob. Internet. Tech. Appl. 46(1), 72–79 (2008)

    Google Scholar 

  19. Ong, E.P., We, S., Loke, M.H., Rahardja, S., Tay, J., Tan, C.K., Huang, L.: Video quality monitoring of streamed videos. In: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP `09), pp. 1153–1156 (2009)

  20. Peng, Y.-C., Chang, H.-A., Chen, C.-K., Kao, L., Kao, H. C.-J.: Integration of image stabilizer with video codec for digital video cameras. In: IEEE international symposium on circuits and systems (ISCAS’05), pp. 4871–4874 (2005)

  21. Quan, H.-T., Ghanbari, M.: Asymmetrical temporal masking near video scene change. In: Proceedings of the IEEE International Conference on Image Processing (ICIP’08), pp. 2568–2571 (2008)

  22. Richardson, I.E.G.R.: H.264 and MPEG-4 video compression video coding for next-generation multimedia. John Wiley & Sons Ltd (2003)

  23. Schierl T., Kampmann M., Wiegand T., 2005. H.264/AVC interleaving for 3G wireless video streaming. In: Proceedings of the IEEE International Conference on Multimedia and Expo (ICME ‘05), pp. 868-871

  24. Szymanski, H.T., Gilbert, D.: Internet multicasting of IPTV with essentially-zero delay jitter. IEEE transactions on broadcasting 55(1), 20–30 (2009)

    Article  Google Scholar 

  25. Tsai, M.-F., Ke, C.-H., Kuo, C.-I., Shieh, C.-K.: Path dependent adaptive forward error correction with multipath interleaving control scheme for video streaming over wireless networks. In: IEEE International Conference on Intelligent Information Hiding and Multimedia Signal Processing, pp. 1236–1239 (2009)

  26. http://trace.eas.asu.edu/yuv/index.html (visited, 1/11/2009)

  27. http://www.ffmpeg.org (visited, 4/03/2011)

Download references

Acknowledgments

We would like to thank the staff and students at Blekinge Institute of Technology, Sweden, for participating in the subjective experiments. We also would like to thank the Swedish Knowledge Foundation for sponsoring a part of this work through the project QoEMoS (21601420).

Author information

Authors and Affiliations

  1. School of Computing, Blekinge Institute of Technology, Karlskrona, Sweden

    Hussein Muzahim Aziz, Markus Fiedler, Håkan Grahn & Lars Lundberg

Authors
  1. Hussein Muzahim Aziz
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Markus Fiedler
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Håkan Grahn
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Lars Lundberg
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hussein Muzahim Aziz.

Additional information

Communicated by Thomas Haenselmann.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Aziz, H.M., Fiedler, M., Grahn, H. et al. Eliminating the effect of freezing frames on user perceptive by using a time interleaving technique. Multimedia Systems 18, 251–262 (2012). https://doi.org/10.1007/s00530-011-0235-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-011-0235-z

Keywords

Search

Navigation