Improving the performance of query processing using proposed resilient distributed processing technique
作者机构:Department of Computer ScienceSri Padmavati Mahila VisvavidyalayamTirupatiIndia
出 版 物:《International Journal of Intelligent Computing and Cybernetics》 (智能计算与控制论国际期刊(英文))
年 卷 期:2021年第14卷第2期
页 面:158-169页
核心收录:
学科分类:08[工学] 0812[工学-计算机科学与技术(可授工学、理学学位)]
主 题:Query processing MapReduce Scalability Resilient distributed processing Spark
摘 要:Purpose-Resilient distributed processing technique(RDPT),in which mapper and reducer are simplified with the Spark contexts and support distributed parallel query ***/methodology/approach-The proposed work is implemented with Pig Latin with Spark contexts to develop query processing in a distributed ***-Query processing in Hadoop influences the distributed processing with the MapReduce *** caters to the works on different nodes with the implementation of complex mappers and *** results are valid for some extent size of the ***/value-Pig supports the required parallel processing framework with the following constructs during the processing of queries:FOREACH;FLATTEN;COGROUP.