Selectivity Estimation Using Frequent Itemset Mining

엄보윤; Christopher Jermaine; 이춘화

In query processing, query optimization is an important function of a database management system since overall query execution time can be significantly affected by the quality of the plan chosen by the query optimizer. Under cost-based optimization, a query optimizer estimates the cost for every possible query plans based on the underlying data distribution in synopses of database relations. The most common synopses in commercial databases have been histograms. However, when there is correlation among datum, one-dimensional histograms can provide poor estimation quality. Motivated by this, we propose a new approach to perform more accurate selectivity estimation, even for correlated data. To deal with the correlation that may exist among datum, we adopt well-known techniques in data mining and extract attribute values that occur together frequently using frequent itemsets mining. Through experimentation, we found that our approach is effective in modeling correlations and that this method approximates intermediate relations more accurately. In fact, it gives precise estimates, particularly for the correlated data.

Citation status

KCI Citation Counts (0)
REFERENCES (19)
열림/닫힘 버튼
* 2022년 이후 발행 논문의 참고문헌은 현재 구축 중입니다.

[journal] G. Cormode / 2012 / Synopses for massive data:samples, histograms,wavelets,sketches / Foundations and Trends in Databases 4

[journal] R. Kaushik / 2005 / Synopses for query optimization:A space-complexity perspective / ACM Transactions on Database Systems 30(4) : 1102~1127

[confproc] V. Poosala / 1997 / Selectivity estimation without the attribute value independence assumption / The 23rd Conference on Very Large Data Bases : 486~495

[confproc] R. Agrawal / 1994 / Fast algorithms for mining association rules in large databases / The 20th International Conference on Very Large Data Bases : 487~499

[confproc] S. Brin / 1997 / Beyond market baskets: generalizing association rules to correlations / ACM SIGMOD International Conference on Management of Data : 265~276

[confproc] N. Bruno / 2002 / Exploiting statistics on query expressions for optimization / The ACM SIGMOD : 263~274

[journal] P. Haas / 2009 / Discovering and exploiting statistical properties for query optimization in relational databases:A survey / Statistical Analysis and Data Mining 1(4) : 223~250

[journal] Y. Matias / 2007 / Optimal workload-based weighted wavelet synopses / Theoretical Computer Science 371(3) : 227~246

[confproc] J. Gryz / 2004 / Query selectivity estimation via data mining / The international conference on intelligent information processing and web mining : 29~38

[journal] G. Cormode / 2009 / Probabilistic histograms for probabilistic data / PVLDB 2(1) : 526~537

[journal] D. Fuchs / 2007 / Compressed histograms with arbitrary bucket layouts for selectivity estimation / Information on Science 177(3) : 680~702

[confproc] K. Chakrabarti / 2000 / Approximate query processing using wavelets / The 26th International Conference on Very Large Data Bases : 111~

[journal] A. Deligiannakis / 2007 / Extended wavelets for multiple measures / ACM Transactions on Database Systems 32(2)

[journal] A. Deligiannakis / 2007 / Extended wavelets for multiple measures / ACM Transactions on Database Systems 32(2)

[confproc] P. Brown / 2003 / BHUNT: Automatic discovery of fuzzy algebraic constraints in relational data / The 29th International Conference on Very Large Data Bases : 668~

[book] C. Jermaine / 2003 / Playing hide-and-seek with correlations / KDD : 559~564

[book] J. Ullman / 2000 / Database system implementation / Prentice Hall

[web] / TPC benchmark R. Decision Support / http://www.tpc.org

[web] / Program for TPC-D Data Generation / ftp://ftp.rese

이 논문은 한국연구재단의 지원을 받아 작성되었습니다.

KJC Korea
Journal Central

Statistics

Tools

Sharing

Issue List

Citation status