@article{ART002022485},
author={김종찬 and 안재훈 and 김영환 and Kiman Jeon},
title={A Novel Method of Improving Cache Hit-rate in Hadoop MapReduce using SSD Cache},
journal={Journal of The Korea Society of Computer and Information},
issn={1598-849X},
year={2015},
volume={20},
number={8},
pages={1-6}
TY - JOUR
AU - 김종찬
AU - 안재훈
AU - 김영환
AU - Kiman Jeon
TI - A Novel Method of Improving Cache Hit-rate in Hadoop MapReduce using SSD Cache
JO - Journal of The Korea Society of Computer and Information
PY - 2015
VL - 20
IS - 8
PB - The Korean Society Of Computer And Information
SP - 1
EP - 6
SN - 1598-849X
AB - The MapReduce Program of Hadoop Distributed File System operates on any unspecified nodes due to distributed-parallel process and block replicate for data stability. Since it is difficult to guarantee the cache locality when a Solid State Drive is used as a cache in hadoop, cache hit-rate is decreased. In this paper, we suggest a method to improve cache hit rate by pre-loading the input data of the MapReduce onto the SSD cache. To perform this method, we estimated the blocks that are used on each node by using capacity scheduler and block metadata. Eventually we could increase the performance of SSD cache by loading the blocks onto SSD cache before the Map Task run.
KW - Hadoop;SSD Cache;HDFS;Mapreduce;YARN
DO -
UR -
ER -
김종찬, 안재훈, 김영환 and Kiman Jeon. (2015). A Novel Method of Improving Cache Hit-rate in Hadoop MapReduce using SSD Cache. Journal of The Korea Society of Computer and Information, 20(8), 1-6.
김종찬, 안재훈, 김영환 and Kiman Jeon. 2015, "A Novel Method of Improving Cache Hit-rate in Hadoop MapReduce using SSD Cache", Journal of The Korea Society of Computer and Information, vol.20, no.8 pp.1-6.
김종찬, 안재훈, 김영환, Kiman Jeon "A Novel Method of Improving Cache Hit-rate in Hadoop MapReduce using SSD Cache" Journal of The Korea Society of Computer and Information 20.8 pp.1-6 (2015) : 1.
김종찬, 안재훈, 김영환, Kiman Jeon. A Novel Method of Improving Cache Hit-rate in Hadoop MapReduce using SSD Cache. 2015; 20(8), 1-6.
김종찬, 안재훈, 김영환 and Kiman Jeon. "A Novel Method of Improving Cache Hit-rate in Hadoop MapReduce using SSD Cache" Journal of The Korea Society of Computer and Information 20, no.8 (2015) : 1-6.
김종찬; 안재훈; 김영환; Kiman Jeon. A Novel Method of Improving Cache Hit-rate in Hadoop MapReduce using SSD Cache. Journal of The Korea Society of Computer and Information, 20(8), 1-6.
김종찬; 안재훈; 김영환; Kiman Jeon. A Novel Method of Improving Cache Hit-rate in Hadoop MapReduce using SSD Cache. Journal of The Korea Society of Computer and Information. 2015; 20(8) 1-6.
김종찬, 안재훈, 김영환, Kiman Jeon. A Novel Method of Improving Cache Hit-rate in Hadoop MapReduce using SSD Cache. 2015; 20(8), 1-6.
김종찬, 안재훈, 김영환 and Kiman Jeon. "A Novel Method of Improving Cache Hit-rate in Hadoop MapReduce using SSD Cache" Journal of The Korea Society of Computer and Information 20, no.8 (2015) : 1-6.
