ARCosmetics:a real-time augmented reality cosmetics try-on system
作者机构:Tech.&Data Center*** Inc.Beijing 100176China State Key Lab of Software Development EnvironmentBeihang UniversityBeijing 100191China
出 版 物:《Frontiers of Computer Science》 (中国计算机科学前沿(英文版))
年 卷 期:2023年第17卷第4期
页 面:15-28页
核心收录:
学科分类:08[工学] 0835[工学-软件工程] 0812[工学-计算机科学与技术(可授工学、理学学位)] 081202[工学-计算机软件与理论]
基 金:supported in part by the National Key R&D Program of China(2021ZD0140407) in part by the National Natural Science Foundation of China(Grant No.U21A20523)
主 题:facial landmark localization face tracking stabilization augmented reality virtual try-on
摘 要:A virtual cosmetics try-on system provides a realistic try-on experience for consumers and helps them efficiently choose suitable *** this article,we propose a real-time augmented reality virtual cosmetics try-on system for smartphones(ARCosmetics),taking speed,accuracy,and stability into consideration at each step to ensure a better user experience.A novel and very fast face tracking method utilizes the face detection box and the average position of facial landmarks to estimate the faces in continuous frames.A dynamic weight Wing loss is introduced to assign a dynamic weight to every landmark by the estimated error during *** balances the attention between small,medium,and large range error and thus increases the accuracy and *** also designed a weighted average method to utilize the information of the adjacent frame for landmark refinement,guaranteeing the stability of the generated *** experiments conducted on a large 106-point facial landmark dataset and the 300-VW dataset demonstrate the superior performance of the proposed method compared to other state-of-the-art *** also conducted user satisfaction studies further to verify the efficiency and effectiveness of our ARCosmetics system.