H.264
From esoterum.org
Contents
Tutorials
Specification
Acronyms
- RBSP: Raw Byte Sequence Payload
H.264 Software
Hypothetical Reference Decoder
- J. Ribas-Corbera, P.A. Chou, S.L. Regunathan, A generalized hypothetical reference decoder for H.264/AVC, Circuits and Systems for Video Technology, IEEE Transactions on, Volume: 13, Issue: 7 pp.
- Hypothetical Reference Decoder
Final References
- M. Horowitz, A. Joch, F. Kossentini, A. Hallapuro,"H.264/AVC baseline profile decoder complexity analysis", IEEE Transactions on Circuits and Systems for Video Technology, Volume 13, Issue 7, July 2003 Page(s):704 - 716
- -The computational complexity of the coding algorithms directly affects the cost effectiveness of the development of a commercially viable H.264/AVC-based video solution.
- T. Wiegand, G.J. Sullivan, G. Bjntegaard, A. Luthra, "Overview of the H.264/AVC video coding standard" IEEE Transactions on Circuits and Systems for Video Technology, Volume 13, Issue 7, July 2003 Page(s):560 - 576
- -However, an increasing number of services and growing popularity of high definition TV are creating greater needs for higher coding efficiency. Moreover, other transmission media such as Cable Modem, xDSL, or UMTS offer much lower data rates than broadcast channels, and enhanced coding efficiency can enable the transmission of more video channels or higher quality video representations within existing digital transmission capacities.
- Y. Huang, A. V. Tran, Y. Wang, "A workload prediction model for decoding mpeg video and its application to workload-scalable transcoding", Proceedings of the 15th international conference on Multimedia, Augsburg, Germany, pp, 952 - 961, 2007
- -National University of Singapore
- J.S. Kim, J.G. Kim, K.O. Kang, J. Kim, "A distortion control scheme for allocating constant distortion in FD-CD video transcoder", IEEE International Conference on Multimedia and Expo, 2004. ICME '04. 2004 Volume 1, 27-30 June 2004 Page(s):161 - 164 Vol.1
- -In Fig. 3, it is shown that the CD error of each frame propagates to next frames in an exponential decreasing form. And “sum-of-indep-l5%CD indicates the sum of CD errors and all propagation errors caused by the independent cases. The accumulated errors at each codedframe can be approximated simply by the sum of propagation errors.
- > (7.2) Rui Zhang, Shankar L. Regunathan, Kenneth Rose, "Video Coding with Optimal Inter/Intra-Mode Switching for Packet Loss Resilience", IEEE Journal on Selected Areas in Communications, VOL. 18, NO. 6, JUNE 2000
- Jin-Gyeong Kim, JongWon Kim, and C.-C. Jay Ku, "Corruption Model of Loss Propagation for Relative Prioritized Packet Video", SPIE Proceeding of International Symposium on Optical Science, Engineering, and Instrumentation, Applications of Digital Image Processing XXIII, San Diego, CA, July, 2000.
- Yen-Kuang Chen, Eric Q. Li, Xiaosong Zhou1 and Steven Ge, Implementation of H.264 encoder and decoder on personal computers, Journal of Visual Communication and Image Representation Volume 17, Issue 2, April 2006, Pages 509-532
- -Profiling Pie Chart
- (7.3)Donghwan Son, Chansu Yu, Heung-Nam Kim, "Dynamic Voltage Scaling on MPEG Decoding", Proceedings of the Eighth International Conference on Parallel and Distributed Systems, pp.633-640, June, 2001
- -From Srini's paper
- R. Henning , C. Chakrabarti "A quality/energy tradeoff approach for IDCT computation in MPEG-2video decoding" IEEE Workshop on Signal Processing Systems, SiPS. 2000 Page(s):90 - 99
- -From Srini's paper
- Shaoxiong Hua; Gang Qu; Bhattacharyya, S.S.;, "An Energy Reduction Technique for Multimedia Application With Tolerance to Deadline Misses", Design Automation Conference, 2003. Proceedings 2-6 June 2003 Page(s):131 - 136
Tutorials
Parallelization
- Tom. R. Jacobs, Vassilios A. Chouliaras and David J. Mulvaney. Thread-Parallel MPEG-4 and H.264 Coders for System-on-Chip Multi-Processor Architectures. International Symposium on Parallel Computing in Electrical Engineering (PARELEC'06). pp. 363-368
- -Loughborough University, UK
- A. Rodriguez, A. Gonzalez, M. P. Malumbres. Hierarchical Parallelization of an H.264/AVC Video Encoder.
International Symposium on Parallel Computing in Electrical Engineering. PAR ELEC 2006. Page(s):363 - 368
- -Technical University of Valencia
Trading power for PSNR
Phase I
Modifying the Encoder
- In contrast to the original proposal, we would like to look at modifying the encoder in order to make decisions about which blocks to drop. In this case, the decoder need only decide how many blocks to drop. The encoder would categorize and arrange the blocks in the stream so that the "important" blocks are sent first, enabling the decoder to drop the last n blocks without even decoding them.
- One issue to be addressed in the encoder: how do we decide which blocks are more important? Currently the idea is to look at blocks with smaller motion vectors and consider those less important. An important issue which arises is that this might prevent large slow moving objects from moving at all in the image. This might be avoided if the encoder looks at the average vector size, or vector statistics in order to avoid this situation.
Modifying the Decoder
- Enabling energy reduction functionality in the decoder without the benefit of a specialized encoder to first analyze the data poses some problems in terms of energy conservation. We want to reduce the amount of computation in order to throttle the processor, but the overhead required to make block dropping decisions might alleviate the advantage.
Phase II
Benchmarks
- Media benchmarks including H.264, not yet for SimpleScalar
- SimpleScalar benchmarks, mpeg2 only
Players and PSNR calcualtors
- VideoMeter, command line tool developed at ASU with PSNR calculations for 3 simultaneous yuv steams
Applicability to Bistable Displays
Articles
Survey
- > (7.4) Nükhet Özbek, Turhan Tunali, "A Survey on the H.264/AVC Standard", International Computer Institute, Ege University, Turk J Elec Engin, VOL.13, NO.3 2005
- Charles Krasic, Jonathan Walpole, Wu-chi Feng, "Quality-Adaptive Media Streaming by Priority Drop", Proceedings of the 13th international workshop on Network and operating systems support for digital audio and video, pp. 112 - 121, 2003
- -OHSU, Beaverton, OR
- Y. Huang, A. V. Tran, Y. Wang, "A workload prediction model for decoding mpeg video and its application to workload-scalable transcoding", Proceedings of the 15th international conference on Multimedia, Augsburg, Germany, pp, 952 - 961, 2007
- -National University of Singapore
- K. Seo, S. Kwon, S. K. Hong, J. Kim, "Dynamic bit-rate reduction based on frame-skipping and requantization for MPEG-1 to MPEG-4 transcoder", International Symposium on Circuits and Systems, 2003. Volume 2, 25-28 May 2003 Page(s):II-372 - II-375
- T. Liu, T. Lin, S. Wang, C. Lee, "A low-power dual-mode video decoder for mobile applications", Communications Magazine, IEEE, Volume 44, Issue 8, Aug. 2006 Page(s):119 - 126
- -Good block diagram for h.264
- -Good workload breakdown for decoder (pie-chart)
DVFS
- Ku He, Yibo Chen, Rong Luo, "A System Level Fine-Grained Dynamic Voltage and Frequency Scaling for portable embedded systems with multiple frequency adjustable components", IEEE, 2007
- -Beijing
- >Hyekseong Kweon, Younggu Do, Jaejeong Lee, Byoungchul Ahn, "An Efficient Power-Aware Scheduling Algorithm in Real Time System", IEEE PACRIM, 2007
- -Seoul
- -Good discussion on dynamic and static leakage and dependence on operating voltage
Corruption Model
- Jin-Gyeong Kim, JongWon Kim, and C.-C. Jay Ku, "Corruption Model of Loss Propagation for Relative Prioritized Packet Video"
- > Rui Zhang, Shankar L. Regunathan, Kenneth Rose, "Video Coding with Optimal Inter/Intra-Mode Switching for Packet Loss Resilience", IEEE Journal on Selected Areas in Communications, VOL. 18, NO. 6, JUNE 2000
- (7.1) Hua Yang and Kenneth Rose, "Recursive End-to-End Distortion Estimation With Model-Based Crosscorrelation Approximation", IEEE 2003
Profiling/Component Breakdown
- Yen-Kuang Chen, Eric Q. Li, Xiaosong Zhou1 and Steven Ge, Implementation of H.264 encoder and decoder on personal computers, Journal of Visual Communication and Image Representation Volume 17, Issue 2, April 2006, Pages 509-532
- -Profiling Pie Chart
- Xiaosong Zhou†, Eric Q. Li†, and Yen-Kuang Chen, "Implementation of H.264 Decoder on General-Purpose Processors with Media Instructions"
- Szu-Wei Lee, C. C. Jay Kuo. Complexity modeling of H.264/AVC CAVLC/UVLC entropy decoders. ISCAS 2008: 1616-1619
General
- C. Lian, S. Chien, Chia-ping Lin, P. Tseng, L. Chen, "Power-Aware Multimedia: Concepts and Design Perspectives", Circuits and Systems Magazine, IEEE, 2007, Volume: 7, Issue: 2, page(s): 26-34
- T. Shih, C. Yang, and Y. Tung, "Workload Characterization of the H.264/AVC Decoder", Book Advances in Multimedia Information Processing pp. 957-966, PCM 2004.
- A. R. Iranpour and K. Kuchcinski, "Performance Improvement for H.264 Video Encoding using ILP Embedded Processor", Proceedings of the 9th EUROMICRO Conference on Digital System Design (DSD'06).
- Jin-soo Kim, Jae-Gon Kim, Kyeong-Ok Kang, Jinwoong Kim, "A Distortion Control Scheme for Allocating Constant Distortion in FD-CD Video Transcoder", IEEE International Conference on Multimedia and Expo (ICME), 2004.
- -Distortion Control and Estimation
- Sangwon Seo, Mark Woh, Scott Mahlke, Trevor Mudge, Sundaram Vijay, and Chaitali Chakrabarti. Customizing Wide-SIMD Architectures for H.264. Proc. 9th Intl. Symposium on Systems, Architectures, Modeling and Simulation (SAMOS). Jul. 2009.