KJCKorea
Journal Central

@article{ART001820945},
author={박정효 and 김준상 and 김창현 and Won Joo Lee and Chang Ho Jeon},
title={Pre-arrangement Based Task Scheduling Scheme for Reducing MapReduce Job Processing Time},
journal={Journal of The Korea Society of Computer and Information},
issn={1598-849X},
year={2013},
volume={18},
number={11},
pages={23-30}

TY - JOUR
AU - 박정효
AU - 김준상
AU - 김창현
AU - Won Joo Lee
AU - Chang Ho Jeon
TI - Pre-arrangement Based Task Scheduling Scheme for Reducing MapReduce Job Processing Time
JO - Journal of The Korea Society of Computer and Information
PY - 2013
VL - 18
IS - 11
PB - The Korean Society Of Computer And Information
SP - 23
EP - 30
SN - 1598-849X
AB - In this paper, we propose pre-arrangement based task scheduling scheme to reduce MapReduce job processing time. If a task and data to be processed do not locate in same node, the data should be transmitted to node where the task is allocated on. In that case, a job processing time increases owing to data transmission time. To avoid that case, we schedule tasks into two steps. In the first step, tasks are sorted in the order of high data locality. In the second step, tasks are exchanged to improve their data localities based on a location information of data. In performance evaluation,we compare the proposed method based Hadoop with a default Hadoop on a small Hadoop cluster in term of the job processing time and the number of tasks sorted to node without data to be processed by them. The result shows that the proposed method lowers job processing time by around 18%. Also, we confirm that the number of tasks allocated to node without data to be processed by them decreases by around 25%.
KW - Hadoop;MapReduce;Data Locality
DO -
UR -
ER -

박정효, 김준상, 김창현, Won Joo Lee and Chang Ho Jeon. (2013). Pre-arrangement Based Task Scheduling Scheme for Reducing MapReduce Job Processing Time. Journal of The Korea Society of Computer and Information, 18(11), 23-30.

박정효, 김준상, 김창현, Won Joo Lee and Chang Ho Jeon. 2013, "Pre-arrangement Based Task Scheduling Scheme for Reducing MapReduce Job Processing Time", Journal of The Korea Society of Computer and Information, vol.18, no.11 pp.23-30.

박정효, 김준상, 김창현, Won Joo Lee, Chang Ho Jeon "Pre-arrangement Based Task Scheduling Scheme for Reducing MapReduce Job Processing Time" Journal of The Korea Society of Computer and Information 18.11 pp.23-30 (2013) : 23.

박정효, 김준상, 김창현, Won Joo Lee, Chang Ho Jeon. Pre-arrangement Based Task Scheduling Scheme for Reducing MapReduce Job Processing Time. 2013; 18(11), 23-30.

박정효, 김준상, 김창현, Won Joo Lee and Chang Ho Jeon. "Pre-arrangement Based Task Scheduling Scheme for Reducing MapReduce Job Processing Time" Journal of The Korea Society of Computer and Information 18, no.11 (2013) : 23-30.

박정효; 김준상; 김창현; Won Joo Lee; Chang Ho Jeon. Pre-arrangement Based Task Scheduling Scheme for Reducing MapReduce Job Processing Time. Journal of The Korea Society of Computer and Information, 18(11), 23-30.

박정효; 김준상; 김창현; Won Joo Lee; Chang Ho Jeon. Pre-arrangement Based Task Scheduling Scheme for Reducing MapReduce Job Processing Time. Journal of The Korea Society of Computer and Information. 2013; 18(11) 23-30.

박정효, 김준상, 김창현, Won Joo Lee, Chang Ho Jeon. Pre-arrangement Based Task Scheduling Scheme for Reducing MapReduce Job Processing Time. 2013; 18(11), 23-30.

박정효, 김준상, 김창현, Won Joo Lee and Chang Ho Jeon. "Pre-arrangement Based Task Scheduling Scheme for Reducing MapReduce Job Processing Time" Journal of The Korea Society of Computer and Information 18, no.11 (2013) : 23-30.