Interactive free-viewpoint video generation

作     者：Yanru WANG Zhihao HUANG Hao ZHU Wei LI Xun CAO Ruigang YANG 

作者机构：School of Electronic Science and EngineeringNanjing UniversityNanjing 210023China Center on Frontiers of Computing StudiesPeking UniversityBeijing 100871China Department of Computer ScienceUniversity of KentuckyLexingtonKY 40506USA 

出 版 物：《Virtual Reality & Intelligent Hardware》 (虚拟现实与智能硬件（中英文）)

年 卷 期：2020年第2卷第3期

页      面：247-260页

核心收录：

学科分类：08[工学] 0835[工学-软件工程] 0811[工学-控制科学与工程] 0812[工学-计算机科学与技术（可授工学、理学学位）] 

基　　金：Supported by USDA 2018-67021-27416 NSFJS BK20190292. 

主　　题：Free-viewpoint video View interpolation Interactive interface 

摘      要：Background Free-viewpoint video(FVV)is processed video content in which viewers can freely select the viewing position and angle.FVV delivers an improved visual experience and can also help synthesize special effects and virtual reality content.In this paper,a complete FVV system is proposed to interactively control the viewpoints of video relay programs through multimedia terminals such as computers and tablets.Methods The hardware of the FVV generation system is a set of synchronously controlled cameras,and the software generates videos in novel viewpoints from the captured video using view interpolation.The interactive interface is designed to visualize the generated video in novel viewpoints and enable the viewpoint to be changed interactively.Results Experiments show that our system can synthesize plausible videos in intermediate viewpoints with a view range of up to 180°.