User-Oriented Stereo Video Refocusing By Computational Cinematographic Model

Refocusing, as a most popular photographic technique, is widely welcomed in both photography and cinematography. Currently, most refocusing effects in movies are implemented manually using professional devices or computer graphics methods. Few solutions are designed for the videos captured by common users. In this paper, we propose a user-oriented method to facilitate the video refocusing for daily life, with an extra requirement for only stereo cameras which are quite popular today. Given a stereo video, one can select the desired focusing part in a single frame, and the user selected intention will be tracked along with the timeline. Then the depth-of-field (DoF) based blurring effect can be generated by scene depth estimation based on the stereo techniques and the proposed cinematographic models in computational photography. The performance of the refocused videos compares favourably with the ones generated by digital single lens reflex (DSLR). To evaluate the proposed method, we conduct the experiments on several challenging stereo video datasets. The quantitative and subjective evaluations both show that the proposed method can achieve attractive and highly aesthetic performance with few user interactions.