@article{ART002517097},
author={Kim Kwang-il and Joo-sung, Kim},
title={Big Data Processing and Performance Improvement for Ship Trajectory using MapReduce Technique},
journal={Journal of The Korea Society of Computer and Information},
issn={1598-849X},
year={2019},
volume={24},
number={10},
pages={65-70},
doi={10.9708/jksci.2019.24.10.065}
TY - JOUR
AU - Kim Kwang-il
AU - Joo-sung, Kim
TI - Big Data Processing and Performance Improvement for Ship Trajectory using MapReduce Technique
JO - Journal of The Korea Society of Computer and Information
PY - 2019
VL - 24
IS - 10
PB - The Korean Society Of Computer And Information
SP - 65
EP - 70
SN - 1598-849X
AB - In recently, ship trajectory data consisting of ship position, speed, course, and so on can be obtained from the Automatic Identification System device with which all ships should be equipped. These data are gathered more than 2GB every day at a crowed sea port and used for analysis of ship traffic statistic and patterns. In this study, we propose a method to process ship trajectory data efficiently with distributed computing resources using MapReduce algorithm. In data preprocessing phase, ship dynamic and static data are integrated into target dataset and filtered out ship trajectory that is not of interest.
In mapping phase, we convert ship's position to Geohash code, and assign Geohash and ship MMSI to key and value. In reducing phase, key-value pairs are sorted according to the same key value and counted the ship traffic number in a grid cell. To evaluate the proposed method, we implemented it and compared it with IALA waterway risk assessment program(IWRAP) in their performance. The data processing performance improve 1 to 4 times that of the existing ship trajectory analysis program.
KW - Ship Trajectory;Automatic Identification System;Geohash;MapReduce;IWRAP
DO - 10.9708/jksci.2019.24.10.065
ER -
Kim Kwang-il and Joo-sung, Kim. (2019). Big Data Processing and Performance Improvement for Ship Trajectory using MapReduce Technique. Journal of The Korea Society of Computer and Information, 24(10), 65-70.
Kim Kwang-il and Joo-sung, Kim. 2019, "Big Data Processing and Performance Improvement for Ship Trajectory using MapReduce Technique", Journal of The Korea Society of Computer and Information, vol.24, no.10 pp.65-70. Available from: doi:10.9708/jksci.2019.24.10.065
Kim Kwang-il, Joo-sung, Kim "Big Data Processing and Performance Improvement for Ship Trajectory using MapReduce Technique" Journal of The Korea Society of Computer and Information 24.10 pp.65-70 (2019) : 65.
Kim Kwang-il, Joo-sung, Kim. Big Data Processing and Performance Improvement for Ship Trajectory using MapReduce Technique. 2019; 24(10), 65-70. Available from: doi:10.9708/jksci.2019.24.10.065
Kim Kwang-il and Joo-sung, Kim. "Big Data Processing and Performance Improvement for Ship Trajectory using MapReduce Technique" Journal of The Korea Society of Computer and Information 24, no.10 (2019) : 65-70.doi: 10.9708/jksci.2019.24.10.065
Kim Kwang-il; Joo-sung, Kim. Big Data Processing and Performance Improvement for Ship Trajectory using MapReduce Technique. Journal of The Korea Society of Computer and Information, 24(10), 65-70. doi: 10.9708/jksci.2019.24.10.065
Kim Kwang-il; Joo-sung, Kim. Big Data Processing and Performance Improvement for Ship Trajectory using MapReduce Technique. Journal of The Korea Society of Computer and Information. 2019; 24(10) 65-70. doi: 10.9708/jksci.2019.24.10.065
Kim Kwang-il, Joo-sung, Kim. Big Data Processing and Performance Improvement for Ship Trajectory using MapReduce Technique. 2019; 24(10), 65-70. Available from: doi:10.9708/jksci.2019.24.10.065
Kim Kwang-il and Joo-sung, Kim. "Big Data Processing and Performance Improvement for Ship Trajectory using MapReduce Technique" Journal of The Korea Society of Computer and Information 24, no.10 (2019) : 65-70.doi: 10.9708/jksci.2019.24.10.065