检索结果-南通市图书馆

Interactive method research of dual mode information coordination integration for astronaut gesture and eye movement signals based on hybrid model

引用

Science China(Technological Sciences) 2023年第6期66卷 1717-1733页

作者： ZHUANG HongChao XIA YiLu WANG Ning LI WeiHua DONG Lei LI Bo School of Mechanical Engineering Tianjin University of Technology and EducationTianjin 300222China School of Information Technology Engineering Tianjin University of Technology and EducationTianjin 300222China School of Automotive Engineering Harbin Institute of Technology(Weihai)Weihai 264209China Tianjin Institute of Aerospace Mechanical and Electrical Equipment Tianjin 300458China School of Mechatronics Engineering Harbin Institute of TechnologyHarbin 150000China

The lightweight human-robot interaction model with high real-time,high accuracy,and strong anti-interference capability can be better applied to future lunar surface exploration and construction work.Based on the feature information inputted from the monocular camera,the signal acquisition and processing fusion of the astronaut gesture and eye-movement modal interaction can be performed.Compared with the single mode,the human-robot interaction model of bimodal collaboration can achieve the issuance of complex interactive commands more efficiently.The optimization of the target detection model is executed by inserting attention into YOLOv4 and filtering image motion blur.The central coordinates of pupils are identified by the neural network to realize the human-robot interaction in the eye movement mode.The fusion between the astronaut gesture signal and eye movement signal is performed at the end of the collaborative model to achieve complex command interactions based on a lightweight model.The dataset used in the network training is enhanced and extended to simulate the realistic lunar space interaction environment.The human-robot interaction effects of complex commands in the single mode are compared with those of complex commands in the bimodal collaboration.The experimental results show that the concatenated interaction model of the astronaut gesture and eye movement signals can excavate the bimodal interaction signal better,discriminate the complex interaction commands more quickly,and has stronger signal anti-interference capability based on its stronger feature information mining ability.Compared with the command interaction realized by using the single gesture modal signal and the single eye movement modal signal,the interaction model of bimodal collaboration is shorter about 79%to 91%of the time under the single mode interaction.Regardless of the influence of any image interference item,the overall judgment accuracy of the proposed model can be maintained at about 83%to 97%.The effectiveness of the propo

关键词： human-robot interaction gesture and eye movement hybrid model YOLOv4 CBAM

来源：

维普期刊数据库

同方期刊数据库评论

在线全文

学校读者我要写书评

暂无评论

欢迎您,

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

在线全文

请选择保存的检索档案：

请选择收藏分类：

通借通还

欢迎您,

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

在线全文

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：