Extracting Evaluation Criteria for Evaluating Ontology Quality (온톨로지 품질평가를 위한 평가항목 추출에 관한 연구)

Kim Seonghun (김성훈); OH, SAM GYUN (오삼균)

doi:10.3743/KOSIM.2015.32.2.193

Extracting Evaluation Criteria for Evaluating Ontology Quality

Journal of the Korean Society for Information Management
Abbr : JKOSIM
2015, 32(2), pp.193~219
DOI : 10.3743/KOSIM.2015.32.2.193
Publisher : 한국정보관리학회
Research Area : Interdisciplinary Studies > Library and Information Science
Received : June 11, 2015
Accepted : June 21, 2015
Published : June 30, 2015

Kim Seonghun ¹, OH, SAM GYUN ¹

¹성균관대학교

Accredited

ABSTRACT

The focus of traditional evaluations of ontologies is largely performance-based. A comparison of a new ontology with well-established ones, testing of ontologies in different applications, as well as any judgment of an ontology’s appropriateness and relatedness to source data heavily rely on what results that ontology seems to manifest. This study, on the other hand, is an attempt to evaluate the quality of a particular ontology as manifested by its structure, representation, and interoperability. To that end, major categories of quality evaluations were first identified through an extensive survey of literature. Evaluation questions were formulated from these categories using the Delphi method and were validated by ontology experts. The entire process produced a set of 53 evaluation questions, which was then employed to test the quality of a newly-developed smartphone ontology.

KEYWORDS

ontology, ontology evaluation method, ontology evaluation items, delphi

Citation status

* References for papers published after 2023 are currently being built.

[journal] 고영만 / 2005 / A Studyon the Naming Rules of Metadata based on Ontology / 정보관리학회지 / 한국정보관리학회 22(4) : 97~109

[journal] 김수경 / 2007 / An Implementation of Inference-Based Web Ontology forIntelligent Image Retrieval System / 정보관리학회지 / 한국정보관리학회 24(3) : 119~147

[journal] 김수경 / 2008 / Web Ontology Modeling Based on Description Logic and SWRL / 정보관리학회지 / 한국정보관리학회 25(1) : 149~171

[thesis] 김은경 / 2004 / 시맨틱웹을 위한 온톨로지 구축방법에 관한 비교연구 / 석사 / 중앙대학교 대학원

[journal] 김정민 / 2005 / Implementation a Philosophy Ontology based on Knowledge of Text Contents / 정보과학회 컴퓨팅의 실제 논문지 / 한국정보과학회 11(3) : 275~283

[journal] 노영희 / 2011 / A Study on Constructing the Ontology of LIS Journal / 정보관리학회지 / 한국정보관리학회 28(2) : 177~193

[journal] 박진수 / 2008 / Measurement Criteria for Ontology Extraction Tools / 지능정보연구 / 한국지능정보시스템학회 14(4) : 69~87

[journal] 심재후 / 2013 / An Establishment of Entrepreneurship Ontology through Analysis of Intellectual Structure in Entrepreneurship Research / Journal of Information Technology Applications & Management / 한국데이타베이스학회 20(2) : 161~176

[journal] 유은지 / 2012 / Using Ontologies for Semantic Text Mining / 정보시스템연구 / 한국정보시스템학회 21(3) : 137~161

[journal] 이병길 / 2013 / Design and Evaluation of an Individual Instance-based Ontology Retrieval System for Archival Records of the “Saemaul Movement” / 한국기록관리학회지 / 한국기록관리학회 13(3) : 67~97

[journal] 이정연 / 2007 / Automatic Recommendation of Panel Pool using a Probabilistic Ontology and Researcher Networks / 정보관리학회지 / 한국정보관리학회 24(3) : 43~65

[journal] 이정희 / 2007 / A Design and Implementation of Ontology-based Retrieval System for the Electronic Records of Universities / 정보관리학회지 / 한국정보관리학회 24(3) : 343~362

[journal] 이해윤 / 2006 / A case study on building Verb-Ontology: Korean locomotion verbs / 언어와언어학 / 언어연구소 (38) : 89~108

[journal] 정태영 / 2011 / Study on a Methodology for Developing Shanghanlun Ontology / 동의생리병리학회지 / 한의병리학회 25(5) : 765~772

[journal] 조나혜 / 2013 / Implementation of Geo-Ontology for Geographical Concepts: A Case of Coastal Topology / 한국지도학회지 / 한국지도학회 13(3) : 75~87

[confproc] 함영균 / 2014 / 프레임넷을 통한디비피디아 온톨로지 인스턴스 생성의 커버리지 개선 / 제 26회 한글 및 한국어 정보처리 학술대회 논문집

[confproc] Brank, J. / 2006 / Gold standard based ontology evaluation using instance assignment / The 4th International Workshop on Evaluation of Ontologies for the Web(EON) at the 15th International World Wide Web Conference

[confproc] Brewster, C. / 2004 / Data driven ontology evaluation / International Conference on Language Resources and Evaluation

[journal] Burton-Jones, A. / 2005 / A semiotic metrics suite for assessing the quality of ontologies / Data &Knowledge Engineering 55 : 84~102

[book] Cimiano, P. / 2006 / Ontology learning and popuatioin from text: Algorithms, evaluation and application / Springer

[confproc] Fernandez, M. / 1997 / METHONTOLOGY: From ontological art towards ontological engineering / AAAI-97 Spring Symposium on Ontological Engineering, Stanford University

[confproc] Gomez-Perez, A. / 1996 / Towards a method to conceptualize domain ontologies / ECAI-96 Workshop on Ontological Engineering

[confproc] Grüninger, M. / 1994 / The design and evaluation of ontologies for enterprise engineering / Workshop on Implemented Ontologies, European Conference on Artificial Intelligence 1994

[confproc] Grüninger, M. / 1995 / Methodology for the design and evaluation of ontologies / IJCAI-95 Workshop on Basic Ontological Issues in Knowledge Sharing

[book] Grüninger, M. / 1995 / Benchmarking—Theory and Practice / Springer : 22~31

[journal] Lozano-Tello, A. / 2004 / Ontometric: A method to choose the appropriate ontology / Journal of Database Management 2(15) : 1~18

[other] Maedche, A. / 2002 / Measuring similarity between ontologies / Knowledge Engineering and Knowledge Management: Ontologies and the Semantic Web : 251~263

[web] Noy, N. F. / Ontology development 101: A guide to creating your first ontology / http://protege.stanford.edu/publications/ontology_development/ontology101-noy-mcguinness.html

[confproc] Porzel, R. / 2004 / A task-based approach for ontology evaluation / Proc. ECAI 2004 Workshop on Ontology Learning and Population : 9~16

[confproc] Prieto-Díaz, R. / 2003 / A faceted approach to building ontologies / In Information Reuse and Integration, 2003. IRI 2003. IEEE International Conference on / IEEE : 458~465

[confproc] Ra, M. / 2012 / The mixed ontology building methodology using database information / Proceedings of the International MultiConference of Engineers and Computer Scientists 1

[confproc] Uschold, M. / 1996 / Converting an informal ontology into ontolingua: Some experiences / ECAI-96 Workshop on Ontological Engineering

[confproc] Uschold, M. / 1996 / Building ontologies: Towards a unified methodology / Proc. Expert Systems 96

[confproc] Uschold, M. / 1995 / Towards a methodology for building ontologies / IJCAI-95 Workshop on Basic Ontological Issues in Knowledge Sharing

KJCKorea
Journal Central

Journal of the Korean Society for Information Management 2023 KCI Impact Factor : 1.31

Extracting Evaluation Criteria for Evaluating Ontology Quality

ABSTRACT

KEYWORDS

Citation status

* References for papers published after 2023 are currently being built.

Journal of the Korean Society for Information Management 2023 KCI Impact Factor : 1.31

Extracting Evaluation Criteria for Evaluating Ontology Quality

ABSTRACT

KEYWORDS

Statistics

Tools

Issue List

Citation status

KCI Citation Counts (0)

REFERENCES (34) * References for papers published after 2023 are currently being built.

Search PDF

Citation

* References for papers published after 2023 are currently being built.