@article{ART003025767},
author={Okjoo Choi and Yukyong Kim},
title={A Survey of Data Quality Assessment Methods for Big Data},
journal={Journal of Software Assessment and Valuation},
issn={2092-8114},
year={2023},
volume={19},
number={4},
pages={89-97},
doi={10.29056/jsav.2023.12.09}
TY - JOUR
AU - Okjoo Choi
AU - Yukyong Kim
TI - A Survey of Data Quality Assessment Methods for Big Data
JO - Journal of Software Assessment and Valuation
PY - 2023
VL - 19
IS - 4
PB - Korea Software Assessment and Valuation Society
SP - 89
EP - 97
SN - 2092-8114
AB - Data quality is very important in data-based information technologies such as big data analysis or machine learning. Even if high-performance data analysis algorithms or machine learning models are used, if the quality of the input data is not guaranteed, the results cannot be trusted. Therefore, in order to utilize and analyze big data, it is necessary to be able to extract high-quality data from massive and complex data. In this paper, we consider quality evaluation methods for big data that guarantee high quality. We examine international standardization trends for data life cycle and data quality factors for big data and define data quality characteristics that should be considered according to the big data life cycle. In addition, we compare and analyze existing major studies on data quality evaluation related to big data, and based on the result, we examine the elements necessary for big data quality evaluation. Based on the defined elements, we propose a big data quality evaluation process using goal-driven data quality metric. In the future, we expect that the proposed process will be used to develop evaluation indicators that can evaluate big data quality and to develop an integrated evaluation framework.
KW - Big data;Data quality;Data quality assessment;Data quality metric;Data quality assessment framework
DO - 10.29056/jsav.2023.12.09
ER -
Okjoo Choi and Yukyong Kim. (2023). A Survey of Data Quality Assessment Methods for Big Data. Journal of Software Assessment and Valuation, 19(4), 89-97.
Okjoo Choi and Yukyong Kim. 2023, "A Survey of Data Quality Assessment Methods for Big Data", Journal of Software Assessment and Valuation, vol.19, no.4 pp.89-97. Available from: doi:10.29056/jsav.2023.12.09
Okjoo Choi, Yukyong Kim "A Survey of Data Quality Assessment Methods for Big Data" Journal of Software Assessment and Valuation 19.4 pp.89-97 (2023) : 89.
Okjoo Choi, Yukyong Kim. A Survey of Data Quality Assessment Methods for Big Data. 2023; 19(4), 89-97. Available from: doi:10.29056/jsav.2023.12.09
Okjoo Choi and Yukyong Kim. "A Survey of Data Quality Assessment Methods for Big Data" Journal of Software Assessment and Valuation 19, no.4 (2023) : 89-97.doi: 10.29056/jsav.2023.12.09
Okjoo Choi; Yukyong Kim. A Survey of Data Quality Assessment Methods for Big Data. Journal of Software Assessment and Valuation, 19(4), 89-97. doi: 10.29056/jsav.2023.12.09
Okjoo Choi; Yukyong Kim. A Survey of Data Quality Assessment Methods for Big Data. Journal of Software Assessment and Valuation. 2023; 19(4) 89-97. doi: 10.29056/jsav.2023.12.09
Okjoo Choi, Yukyong Kim. A Survey of Data Quality Assessment Methods for Big Data. 2023; 19(4), 89-97. Available from: doi:10.29056/jsav.2023.12.09
Okjoo Choi and Yukyong Kim. "A Survey of Data Quality Assessment Methods for Big Data" Journal of Software Assessment and Valuation 19, no.4 (2023) : 89-97.doi: 10.29056/jsav.2023.12.09