Saliency-Based Fidelity Adaptation Preprocessing for Video Coding

作     者：卢少平 张松海 

作者机构：Department of Computer Science and TechnologyTsinghua University Beijing Engineering Research Center for Intelligent Processing of Visual Media and Content Security 

出 版 物：《Journal of Computer Science & Technology》 (计算机科学技术学报（英文版）)

年 卷 期：2011年第26卷第1期

页      面：195-202页

核心收录：

学科分类：0810[工学-信息与通信工程] 08[工学] 081001[工学-通信与信息系统] 

基　　金：supported partially by the National High-Tech Research and Development 863 Program of China under Grant No. 2009AA01Z330 the National Natural Science Foundation of China under Grant Nos.61033012 and 60970100 

主　　题：visual saliency bilateral filter fidelity adjustment region-of-interest encoder 

摘      要：In this paper, we present a video coding scheme which applies the technique of visual saliency computation to adjust image fidelity before compression. To extract visually salient features, we construct a spatio-temporal saliency map by analyzing the video using a combined bottom-up and top-down visual saliency model. We then use an extended bilateral filter, in which the local intensity and spatial scales are adjusted according to visual saliency, to adaptively alter the image fidelity. Our implementation is based on the H.264 video encoder JM12.0. Besides evaluating our scheme with the H.264 reference software, we also compare it to a more traditional foreground-background segmentation-based method and a foveation-based approach which employs Gaussian blurring. Our results show that the proposed algorithm can improve the compression ratio significantly while effectively preserving perceptual visual quality.