KJCKorea
Journal Central

@article{ART001929523},
author={김준상 and 김창현 and Won Joo Lee and Chang Ho Jeon},
title={A Block Relocation Algorithm for Reducing Network Consumption in Hadoop Cluster},
journal={Journal of The Korea Society of Computer and Information},
issn={1598-849X},
year={2014},
volume={19},
number={11},
pages={9-15}

TY - JOUR
AU - 김준상
AU - 김창현
AU - Won Joo Lee
AU - Chang Ho Jeon
TI - A Block Relocation Algorithm for Reducing Network Consumption in Hadoop Cluster
JO - Journal of The Korea Society of Computer and Information
PY - 2014
VL - 19
IS - 11
PB - The Korean Society Of Computer And Information
SP - 9
EP - 15
SN - 1598-849X
AB - In this paper, We propose a block reallocation algorithm for reducing network traffic in Hadoop cluster. The scheduler of Hadoop cluster receives a job from users. And the job is divided into multiple tasksassigned to nodes. At this time, the scheduler allocates the task to the node that satisfied data locality. Ifa task is assigned to the node that does not have the data(block) to be processed, the task is processedafter the data transmission from another node. There is difference of workload among nodes becauseblocks in cluster have different access frequency. Therefore, the proposed algorithm relocates blocks according to the task allocation pattern of Hadoop scheduler. Eventually, workload of nodes are leveled,and the case of the task processing in a node that does not have the block to be processing is reduced. Thus, the network traffic of the cluster is also reduced. We evaluate the proposed block reallocationalgorithm by a simulation. The simulation result shows maximum 23.3% reduction of network consumptionthan default delay scheduling for jobs processing.
KW - Hadoop Cluster;Hadoop Scheduler;Block Relocation
DO -
UR -
ER -

김준상, 김창현, Won Joo Lee and Chang Ho Jeon. (2014). A Block Relocation Algorithm for Reducing Network Consumption in Hadoop Cluster. Journal of The Korea Society of Computer and Information, 19(11), 9-15.

김준상, 김창현, Won Joo Lee and Chang Ho Jeon. 2014, "A Block Relocation Algorithm for Reducing Network Consumption in Hadoop Cluster", Journal of The Korea Society of Computer and Information, vol.19, no.11 pp.9-15.

김준상, 김창현, Won Joo Lee, Chang Ho Jeon "A Block Relocation Algorithm for Reducing Network Consumption in Hadoop Cluster" Journal of The Korea Society of Computer and Information 19.11 pp.9-15 (2014) : 9.

김준상, 김창현, Won Joo Lee, Chang Ho Jeon. A Block Relocation Algorithm for Reducing Network Consumption in Hadoop Cluster. 2014; 19(11), 9-15.

김준상, 김창현, Won Joo Lee and Chang Ho Jeon. "A Block Relocation Algorithm for Reducing Network Consumption in Hadoop Cluster" Journal of The Korea Society of Computer and Information 19, no.11 (2014) : 9-15.

김준상; 김창현; Won Joo Lee; Chang Ho Jeon. A Block Relocation Algorithm for Reducing Network Consumption in Hadoop Cluster. Journal of The Korea Society of Computer and Information, 19(11), 9-15.

김준상; 김창현; Won Joo Lee; Chang Ho Jeon. A Block Relocation Algorithm for Reducing Network Consumption in Hadoop Cluster. Journal of The Korea Society of Computer and Information. 2014; 19(11) 9-15.

김준상, 김창현, Won Joo Lee, Chang Ho Jeon. A Block Relocation Algorithm for Reducing Network Consumption in Hadoop Cluster. 2014; 19(11), 9-15.

김준상, 김창현, Won Joo Lee and Chang Ho Jeon. "A Block Relocation Algorithm for Reducing Network Consumption in Hadoop Cluster" Journal of The Korea Society of Computer and Information 19, no.11 (2014) : 9-15.