One-pass Mode and Motion Decision for Multilayer Quality Scalable Video Coding

This paper presents a novel low-complexity motion estimation and mode decision algorithm for encoding multiple quality layers following the H.264/SVC standard, considering both coarse grain scalability (CGS) and medium grain scalability (MGS). The proposed algorithm conducts motion estimation and mode decision only at the base layer (BL), and enforces the higher layers to inherit the motion and mode decisions of the base layer. In order for the decision made at the BL to be nearly optimal for all layers, we use the highest layer reconstructed frame as the reference frame for motion estimation and set the Lagrangian multipliers according to the QP of the current and higher layers. We also propose a simple early Skip/Direct decision to further boost the encoding speed. Mode decision and motion estimation is conducted at a higher layer only if the layer below uses the Skip/Direct mode for a block. Significant complexity reduction can be achieved because mode and motion estimation is performed at most once for each macroblock. Because the mode and motion information only needs to be transmitted once, we also achieve slightly better rate-distortion (R-D) performance for typical videos. Experiments have shown more than 2 (up-to 5) speedup for a three-layer encoder against the conventional R-D optimized reference software JSVM on both CIF and HD sequences, and for both CGS and MGS scalability, with the trade-off of the coding efficiency measured by the Bjontegaard Delta Rate (BD-Rate).