检索结果-南通市图书馆

Performance Improvement through Novel Adaptive Node and Container Aware scheduler with Resource Availability Control in Hadoop YARN

引用

Computer Systems Science & Engineering 2023年第12期47卷 3083-3108页

作者： J.S.Manjaly T.Subbulakshmi School of Computer Science and Engineering Vellore Institute of TechnologyChennai600127India

The default scheduler of Apache Hadoop demonstrates operational inefficiencies when connecting external sources and processing transformation *** paper has proposed a novel scheduler for enhancement of the performance of the Hadoop Yet Another Resource Negotiator(YARN)scheduler,called the Adaptive Node and Container Aware scheduler(ANACRAC),that aligns cluster resources to the demands of the applications in the real *** approach performs to leverage the user-provided configurations as a unique design to apportion nodes,or containers within the nodes,to application ***,it provides the flexibility to the applications for selecting and choosing which node’s resources they want to manage and adds limits to prevent threshold breaches by adding additional jobs as *** or container awareness can be utilized individually or in combination to increase *** top of this,the resource availability within the node and containers can also be *** paper also focuses on the elasticity of the containers and self-adaptiveness depending on the job *** results proved that 15%–20%performance improvement was achieved compared with the node and container awareness feature of the *** has been validated that this ANACRAC scheduler demonstrates a 70%–90%performance improvement compared with the default fair *** results also demonstrated the success of the enhancement and a performance improvement in the range of 60%to 200%when applications were connected with external interfaces and high workloads.

关键词： Big data Hadoop YARN hadoop distributed file system(HDFS) MapReduce scheduling fair scheduler

来源：

维普期刊数据库评论

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

欢迎您,

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

在线全文

请选择保存的检索档案：

请选择收藏分类：

通借通还

欢迎您,

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

在线全文

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：