检索结果-南通市图书馆

Neural Machine Translation Models with Attention-Based Dropout Layer

Computers, Materials & Continua 2023年第5期75卷 2981-3009页

作者： Huma Israr Safdar Abbas Khan Muhammad Ali Tahir Muhammad Khuram Shahzad Muneer Ahmad Jasni Mohamad Zain School of Electrical Engineering and Computer Science(SEECS) National University of Science and TechnologyIslamabadPakistan Institute for Big Data Analytics and Artificial Intelligence(IBDAAI) Kompleks Al-KhawarizmiUniversiti Teknologi MARA40450Shah AlamSelangorMalaysia

In bilingual translation,attention-based Neural Machine Translation(NMT)models are used to achieve synchrony between input and output sequences and the notion of *** model has obtained state-of-the-art performance for several language ***,there has been little work exploring useful architectures for urdu-to-English machine *** conducted extensive urdu-to-English translation experiments using Long short-term memory(LSTM)/Bidirectional recurrent neural networks(Bi-RNN)/Statistical recurrent unit(SRU)/Gated recurrent unit(GRU)/Convolutional neural network(CNN)and *** results show that Bi-RNN and LSTM with attention mechanism trained iteratively,with a scalable data set,make precise predictions on unseen *** trained models yielded competitive results by achieving 62.6%and 61%accuracy and 49.67 and 47.14 BLEU scores,*** a qualitative perspective,the translation of the test sets was examined manually,and it was observed that trained models tend to produce repetitive output more *** attention score produced by Bi-RNN and LSTM produced clear alignment,while GRU showed incorrect translation for words,poor alignment and lack of a clear ***,we considered refining the attention-based models by defining an additional attention-based dropout *** dropout fixes alignment errors and minimizes translation errors at the word *** empirical demonstration and comparison with their counterparts,we found improvement in the quality of the resulting translation system and a decrease in the perplexity and over-translation *** ability of the proposed model was evaluated using Arabic-English and Persian-English datasets as *** empirically concluded that adding an attention-based dropout layer helps improve GRU,SRU,and Transformer translation and is considerably more efficient in translation quality and speed.

关键词： Natural language processing neural machine translation word embedding attention perplexity selective dropout regularization urdu Persian Arabic BLEU

来源：

维普期刊数据库评论

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

欢迎您,

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

在线全文

请选择保存的检索档案：

请选择收藏分类：

通借通还

欢迎您,

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

在线全文

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：