An Automatic Setting Method of Data Constraints for Cleansing Data Errors between Business Services (비즈니스 서비스간의 오류 정제를 위한 데이터 제약조건 자동 설정 기법)

Jungwon Lee (이정원)

An Automatic Setting Method of Data Constraints for Cleansing Data Errors between Business Services

Journal of The Korea Society of Computer and Information
Abbr : JKSCI
2009, 14(3), pp.161-171
Publisher : The Korean Society Of Computer And Information
Research Area : Engineering > Computer Science

Jungwon Lee ¹

¹아주대학교

Accredited

ABSTRACT

In this paper, we propose an automatic method for setting data constraints of a data cleansing service, which is for managing the quality of data exchanged between composite services based on SOA(Service-Oriented Architecture) and enables to minimize human intervention during the process. Because it is impossible to deal with all kinds of real-world data, we focus on business data (i.e. customer order, order processing) which are frequently used in services such as CRM(Customer Relationship Management) and ERP(Enterprise Resource Planning). We first generate an extended-element vector by extending semantics of data exchanged between composite services and then build a rule-based system for setting data constraints automatically using the decision tree learning algorithm. We applied this rule-based system into the data cleansing service and showed the automation rate over 41% by learning data from multiple registered services in the field of business.

KEYWORDS

Service-Oriented Architecture, Data Cleansing, Data Quality, Data Constraints, Decision Tree

Citation status

* References for papers published after 2023 are currently being built.

[confproc] V. Kapoor / 2005 / Services and Automatic Computing: A Practical Approach for Designing Manageability / Proceedings of the 2005 IEEE International Conference on Service Computing (SCC’05) : 41~48

[book] T. Erl / 2005 / Service-Oriented Architecture: Concepts, Technology, and Design / Prentice Hall

[confproc] S. Choi / 2007 / QoS Metrics for Evaluating Services from the Perspective of Service Providers / In Proceedings of the IEEE International Conference on e-Business Engineering(ICEBE2007) : 622~625

[confproc] S. Kalasapur / 2006 / Evaluating Service Oriented Architectures (SOA) in Pervasive Computing / In Proceedings of the Fourth Annual IEEE International Conference on Pervasive Computing and Communications (PERCOM'06) : 276~285

[journal] J.W.Lee / 2005 / Data Cleansing for Service-Oriented Architecture / LNCS 3590 : 87~97

[journal] 지은미 / 2007 / Developing dirty data cleansing service between SOA-based services / 정보처리학회논문지D / 한국정보처리학회 14(7) : 829~840

[confproc] Theodore Johnson / 2004 / Data Quality and Data Cleaning / Tutorials of 10th SIGKDD : 181~191

[journal] M. Hernandez / 1998 / Real-World Data is Dirty: Data Cleansing and The Merge/Purge Problem / Data Mining and Knowledge Discovery 2(1) : 9~37

[confproc] M. Hernandez / 2000 / Schema Mappings as Query Discovery / In Proceedings of Intl. Conf. VLDB : 77~89

[journal] Erhard Rahm / 2000 / Data Cleaning: Problems and Current Approaches / IEEE Data Engineering Bulletin 23(4) : 3~13

[confproc] S.S.Yau / 2000 / Component Customization for Object-Oriented Distributed Real-Time Software Development / Proceedings of the 2000 IEEE international Symposium on Object-Oriented Real-Time Distributed Computing(ISORC ’00) : 156~163

[web] / Fiorano’s Prebuilt Service Guide / http://www.fiorano.com/downloads/fesb/prebuiltservices.pdf

[book] T. Mitchell / 1997 / Decision Tree Learning. in: Machine Learning / The McGraw-Hill Companies, Inc. : 52~78

[confproc] Rich Caruana / 2006 / An Empirical Comparison of Supervised Learning Algorithms / In Proc. of the 23rd International Conference on Machine Learning : 161~168

[journal] 김천식 / 2006 / Classification Techniques for XML Document Using Text Mining / 한국컴퓨터정보학회논문지 / 한국컴퓨터정보학회 11(2) : 15~24

[journal] 노창현 / 2008 / Grid Resource Selection System Using Decision Tree Method / 한국컴퓨터정보학회논문지 / 한국컴퓨터정보학회 13(1) : 1~10

[web] / JESS / http://herzberg.ca.sandia.gov/jess

KJCKorea
Journal Central

Journal of The Korea Society of Computer and Information 2023 KCI Impact Factor : 0.65