Skip to main content
SpringerLink
Log in

Scene-level two-pass video rate controller for H.265/HEVC standard

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

A scene-level two-pass video rate controller for high efficiency video coding (HEVC) standard is proposed in this paper. The proposed rate controller is suitable for many pre-recorded applications in which encoded videos are transferred later on through a communication channel with limited bandwidth and buffering constraint. This rate controller operates in two passes. In the first pass, the video sequence is compressed and relevant information is collected. In the second pass, an optimal base quantization parameter (QP) for each video scene is calculated by simplifying the λ-domain rate-distortion model. Then, using the optimal base QP and the known QP cascading technique, a QP is computed for each picture in the scene. In this way, the quality of the compressed video is kept relatively constant during a scene and thus it provides a high-level perceptual quality for the compressed video. The base QP may be slightly modified during the second pass encoding by a fuzzy controller according to the second pass encoding results and the buffer status. The proposed rate controller has been implemented on H.265/HEVC standard reference software. Experimental results show that in comparison with the constant QP encoding and three known rate control algorithms the proposed algorithm provides a high-level quality for tested video sequences while the required buffering delay is low and the available bandwidth is fully used.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Choi H, Yoo J, Nam J, Sim D, Bajic IV (2013) Pixel-wise unified rate-quantization model for multi-level rate control. IEEE J Sel Top Signal Process 7(6):1112–1123

    Article  Google Scholar 

  2. Deng L, Pu F, Hu S, Kuo CCJ (2014) HEVC encoder optimization based on a new RD model and pre-enoding, in Proc. Picture Coding Symposium (PCS), pp 1–4

  3. Fani D, Rezaei M (2016) A GOP-level fuzzy rate control algorithm for high-delay applications of HEVC. Signal Image Video Process 10(7):1183–1191

    Article  Google Scholar 

  4. Fani D, Rezaei M (2017) A novel PID-fuzzy video rate controller for high-delay applications of HEVC standard. IEEE Trans Circ Syst Video Technol 28(1):1379–1389

    Google Scholar 

  5. Guo H, Ghao F, Zhu C, Gao Y, Song S (2017) A frame-level rate control scheme for low delay video coding in HEVC, in proc. Multimedia Signal Processing (MMSP) Luton, pp 2473–3628

  6. Guo H, Zhu C, Li S, Gau Y (2019) Optimal bit allocation at frame level for rate control in HEVC. IEEE Trans Broadcast 65(2):270–281

  7. He J, Yang F (2017) Efficient frame-level bit allocation algorithm for H.265/HEVC. IET Image Process 11(4):245–257

    Article  Google Scholar 

  8. ITU-T H.265 (V3) (04/2015) Recommendation –High efficiency video coding. [Online], Available: http://www.itu.int/itu-t/recommendations/rec.aspx?rec=H.265. Accessed 12 Oct 2020

  9. Si Junjun, Siwei Ma, Zhang Xinfeng, Gao Wen (2012) Adaptive rate control for high efficiency video coding. Proc IEEE International Conference on Visual Communications and Image Processing (VCIP), San Diego, pp 1–6

  10. Kamran R, Rezaei M, Fani D (2016) A frame level fuzzy video rate controller for variable bit rate applications of HEVC. J Intell Fuzzy Syst 30(3):1367–1375

    Article  Google Scholar 

  11. Lee B, Kim M, Nguyen TQ (2014) A frame-level rate control scheme based on texture and nontexture rate models for high efficiency video coding. IEEE Trans Circ Syst Video Technol 24(3):465–479

    Article  Google Scholar 

  12. Li X, Amon P, Hutter A, Kaup A (2010) Adaptive quantization parameter cascading for hierarchical video coding. Proc. IEEE International Symposium on Circuits and Systems (ISCAS), pp 4197–4200

  13. Li W, Ghao F, Zhang E, Ren P (2018) Optimal frame-level bit allocation in HEVC with distortion dependency model, in proc. IEEE Int Conf Big Data Smart Comp. (BigComp), Shanghai, pp 2375–9356

  14. Li L, Li B, Li H, Chen CW (2018) λ-Domain optimal bit allocation algorithm for high efficiency video coding. IEEE Trans Circ Syst Video Technol 28(1):130–142

  15. Li B, Li H, Li L, Zhang J (2014) λ-Domain rate control algorithm for high efficiency video coding. IEEE Trans Image Process 23(9):3841–3854

    Article  MathSciNet  Google Scholar 

  16. Li W, Ren P, Zhang E, Zhao F (2019) Rate control for HEVC intra-coding with a CTU-dependent distortion model. SIViP. 13(1):17–25

    Article  Google Scholar 

  17. Li S, Xu M, Wang Z (2015) “A novel method on optimal bit allocation at LCU level for rate control in HEVC”, in Proc. IEEE ICME, Turin, pp 1–6

  18. Li S, Xu M, Wang Z, Sun X (2016) Optimal bit allocation for CTU level rate control in HEVC. IEEE Trans Circ Syst Video Technol 27(11):2409–2424

    Article  Google Scholar 

  19. Liang X, Wang Q, Zhou Y, Luo B, Men A (2013) A novel RQ model based rate control scheme in HEVC. In Proc International Conference on Visual Communications and Image Processing (VCIP), Kuching, pp 1–6

  20. Liu M, Ren P, Xiang Z (2016) Frame-level bit allocation for hierarchical coding of H.265/HEVC considering dependent rate-distortion characteristics. Signal Image Video Process 10(8):1457–1463

    Article  Google Scholar 

  21. Nunes P, Pereira F (2001) Scene level rate control algorithm for MPEG-4 video coding, in Proc. Commun. SPIE 4310, Visual Communications and Image Processing, pp 94–205

  22. Rehman A, Wang Z (2012) “SSIM-inspired perceptual video coding for HEVC”, in Proc. Int. Conf. Multimedia Expo, Melbourne, pp 497–502

  23. Rezaei M, Hannuksela MM, Gabbouj M (2006) Low-complexity fuzzy video rate controller for streaming, in proc. IEEE Int. Conf. Acoustic Speech and Signal Processing (ICASSP) Toulouse, France, pp 897–900

  24. Rezaei M, Hannuksela MM, Gabbouj M (2008) Semi-fuzzy rate controller for variable bit rate video. IEEE Trans Circ Syst Video Technol 18(5):633–645

    Article  Google Scholar 

  25. Sanz-Rodríguez S, Schierl T (2013) A rate control algorithm for HEVC with hierarchical GOP structures, in Proc. International Conference on Acoustics, Speech, and Signal Processing (ICASSP), pp 1719–1723

  26. Seo C-W, Moon J-H, Han J-K (Jun. 2013) Rate control for consistent objective quality in high efficiency video coding. IEEE Trans Image Process 22(6):2442–2454

    Article  MathSciNet  Google Scholar 

  27. Si J, Ma S, Gao W (2013) Efficient bit allocation and CTU level rate control for high efficiency video coding, in Proc. Picture Coding Symposium. (PCS), San Jose, pp 89–92

  28. Si J, Ma S, Wang S, Gao W (2013) Laplace distribution based CTU level rate control for HEVC, in Proc. Visual Communications and Image Processing (VCIP), Kuching, pp 1–6

  29. Sullivan GJ, Ohm J, Han W (2012) Overview of the high efficiency video coding (HEVC) standard. IEEE Trans Circ Syst Video Technol 22(12):1649–1668

    Article  Google Scholar 

  30. Sun H, Zhang C, Gao S (2014) LCU-Level bit allocation for rate control in high efficiency video coding, in Proc. IEEE China Summit and International Conference on Signal and Information Processing (ChinaSIP), Xi’an, China, pp 354–358

  31. Varsa V, Karczewicz M (2001) Long window rate control for video streaming, 11th International Packet Video (PV) Workshop, pp 154–159

  32. Wang LX (1999) A course in fuzzy systems and control. Prentice-Hall press, USA

    Google Scholar 

  33. Wang S, Li J, Wang S (2018) A frame level rate control algorithm for screen content coding, IEEE International Symposium on Circuits and Systems (ISCAS), Florence, pp 2379–447X

  34. Wang S, Ma S, Wang S, Zhao D, Gao W (2013) Rate-GOP based rate control for high efficiency video coding. IEEE J Sel Top Signal Process 7(6):1101–1111

    Article  Google Scholar 

  35. Wang S, Ma S, Wang S, Zhao D, Gao W (2013) Quadratic ρ-domain based rate control algorithm for HEVC, in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Vancouver, pp 1695–1699

  36. Wang M, Ngan KN (2015) Optimal bit allocation in HEVC for realtime video communications. IEEE International Conference on Image Processing (ICIP), pp 2665–2669

  37. Wang P, Ni C, Li Z, Zhang G (2019) Optimal CTU-level bit allocation in HEVC for low bit-rate applications. Multimed. Tools Appl, 78:23733–23747

  38. Wang S, Rehman A, Zeng K, Wang J, Wang Z (2016) SSIM-motivated two-pass VBR coding for HEVC. IEEE Trans Circ Syst Video Technol 27(10):2189–2203

    Article  Google Scholar 

  39. Wen J, Fang M, Tang M, Wu K (2015) R-(lambda) model based improved rate control for HEVC with pre-encoding, in Proc. Data Compression Conference (DCC), Snowbird, pp 53–62

  40. Wu W, Liu J, Feng L (2016) A novel rate control scheme for low delay video coding of HEVC. ETRI J 38(1):185–194

  41. Xu S, Yu M, Fang S, Peng Z, Wang X, Jiang G (2015) New rate control optimization algorithm for HEVC aiming at discontinuous scene. WSEAS Trans Comput 14(1):598–606

    Google Scholar 

  42. Yang Z, Song L, Luo Z, Wang X (2014) Low delay rate control for HEVC, in proc. IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), Beijing, pp 1–5

  43. Yoon Y, Kim H, Jung S, Jun D, Kim Y, Soo Choi J, Ko S (2012) A new rate control method for hierarchical video coding in HEVC, in Proc. IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), pp 1–4

  44. Zhou M, Wei X, Wang S, Kwong S, Fong Ch, Wong P, Yuen W, Gao W (n.d.) SSIM-Based Global Optimization for CTU-level Rate Control in HEVC, IEEE Trans. Multimedia, to be published. https://doi.org/10.1109/TMM.2019.2895281

  45. Zupancic I, Naccari M, Mrak M, Izquierdo E (2017) Two-pass rate control for improved quality of experience in UHDTV delivery. IEEE Journal of Selected Topics in Signal Processing 11(1):167–179

Download references

Author information

Authors and Affiliations

  1. Faculty of Electrical and Computer Engineering, University of Sistan and Baluchestan, Zahedan, Iran

    A. Nakhaei & M. Rezaei

Authors
  1. A. Nakhaei
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. M. Rezaei
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to M. Rezaei.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nakhaei, A., Rezaei, M. Scene-level two-pass video rate controller for H.265/HEVC standard. Multimed Tools Appl 80, 7023–7038 (2021). https://doi.org/10.1007/s11042-020-09710-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09710-y

Keywords

Search

Navigation