详细信息
A novel improved data load balancing algorithm for Hadoop ( EI收录)
文献类型:期刊文献
英文题名:A novel improved data load balancing algorithm for Hadoop
作者:Liu, Kun[1,2]; Xu, Gaochao[1]; Wang, Tingmei[2]; Yuan, Jun'e[2]
第一作者:刘琨;Liu, Kun
通讯作者:Xu, G.
机构:[1] College of Computer Science and Technology, Jilin University, Jilin, Changchun, 130012, China; [2] College of Applied Science and Technology, Beijing Union University, Beijing, 102200, China
第一机构:College of Computer Science and Technology, Jilin University, Jilin, Changchun, 130012, China
通讯机构:[1]College of Computer Science and Technology, Jilin University, Jilin, Changchun, 130012, China
年份:2013
卷号:12
期号:23
起止页码:7260-7264
外文期刊名:Information Technology Journal
收录:EI(收录号:20142417805809);Scopus(收录号:2-s2.0-84901744869)
语种:英文
外文关键词:Bandwidth - Cloud computing - Resource allocation
摘要:This study is designed to solve the problem of Hadoop data load balancing algorithm. A big difference arises in response time for similar files as it balances the data according to the space usage of each node and doesn't handle the factors like processing power, bandwidth and files' access frequency. This study proposes a novel load balancing model based on the factors of files' size, files' concurrent access time, files' access frequency, nodes' processing power, bandwidth and nodes' available storage space. Experimental results reveal that the new model can not only guarantee the storage space load balancing, but also maintain similar response time for similar files. ? 2013 Asian Network for Scientific Information.
参考文献:
正在载入数据...