A Review of Declarations on Appropriate Research Evaluation for Exploring Their Applications to Research Evaluation System of Korea (연구성과평가 지침 리뷰 및 국내 적용 제안을 위한 고찰)

So-Young Yu (유소영); Lee, Jae Yun (이재윤); Eunkyung Chung (정은경); Boram Lee (이보람)

doi:10.3743/KOSIM.2015.32.4.249

A Review of Declarations on Appropriate Research Evaluation for Exploring Their Applications to Research Evaluation System of Korea

Journal of the Korean Society for Information Management
Abbr : JKOSIM
2015, 32(4), pp.249~272
DOI : 10.3743/KOSIM.2015.32.4.249
Publisher : 한국정보관리학회
Research Area : Interdisciplinary Studies > Library and Information Science
Received : November 29, 2015
Accepted : December 14, 2015
Published : December 30, 2015

So-Young Yu ¹, Lee, Jae Yun ², Eunkyung Chung ³, Boram Lee ⁴

¹한남대학교
²명지대학교
³이화여자대학교
⁴이화여자대학교 대학원 문헌정보학과

Accredited

ABSTRACT

Inappropriate applications of bibliometric approach and misinterpretation on the analysis in research evaluation have been found and recognized nationally and internationally as the use of the approach has been rapidly adopted in various sectors in research evaluation systems and research funding agencies. The flood of misuse led to several numbers of declarations and statements on appropriate research evaluation, including Leiden Manifesto, DORA, IEEE Statement, etc. The similar recommendations from five different declarations, Leiden Manifest, IEEE Statement, DORA, Institut de France, and Thomson Reuters White paper were reviewed and meta-analyzed in this study and it is revealed that most of them emphasize evaluation on quality in various aspects with multiple indicators. Research evaluation with assessing multiple aspects of individual research based on the understandings of its purpose and pertinent subject area was revealed as being mostly advised in the declarations, and this recommendation can be regarded as being mostly requested in national research evaluation system. For future study, interviews with relevant stakeholders of national research evaluation system in order to explore its application are needed to confirm the findings of this review.

KEYWORDS

research evaluation, Leiden Manifest, DORA, citation analysis, research policy, science policy

Citation status

* References for papers published after 2023 are currently being built.

[journal] 고영만 / 2013 / A Study on the “Kor-hT”, a Modified Tapered h-index, by Applying the Ranking According to the Number of Citations of Journals in Evaluating Korean Journals / 정보관리학회지 / 한국정보관리학회 30(4) : 111~131

[journal] 김판준 / 2011 / A Study on Framework for Linkage of Research Performance Evaluation and Research Information Service / 정보관리학회지 / 한국정보관리학회 28(4) : 243~261

[journal] 김판준 / 2010 / A Study on Journal Impact Measurement with Hirsch-type Indices / 정보관리학회지 / 한국정보관리학회 27(1) : 269~287

[journal] 설혜심 / 2011 / 학문의 분화와 통섭 / 학림 32 : 91~124

[journal] 이재윤 / 2011 / Journal PageRank Calculation in the Korean Science Citation Database / 한국비블리아학회지 / 한국비블리아학회 22(4) : 361~379

[journal] 이재윤 / 2011 / A Study on Document Citation Indicators Based on Citation Network Analysis / 한국문헌정보학회지 / 한국문헌정보학회 45(2) : 119~143

[journal] 이종욱 / 2011 / A Bibliometric Analysis of Faculty Research Performance Assessment Methods / 정보관리학회지 / 한국정보관리학회 28(4) : 119~140

[journal] 조은성 / 2011 / The Influence of Korean and International Marketing Journals: Focused on the Problems of Kor-Factor and Impact Factor / 마케팅관리연구 / 한국마케팅관리학회 16(2) : 53~82

[web] / 2015 / 중앙일보 대학평가 / http://univ.joongang.co.kr/

[report] 한국정보과학회 / 2013 / 컴퓨터 분야 성과지표 개선(안) / 한국정보과학회

[journal] Åström, F. / 2013 / How implementation of bibliometric practice affects the role of academic libraries / Journal of Librarianship and Information Science 45(4) : 316~322

[journal] Ball, R. / 2006 / Bibliometric analysis: A new business area for information professionals in libraries? / Scientometrics 66(3) : 561~577

[journal] Bladek, M. / 2014 / DORA: San Francisco declaration on research assessment (May 2013) / College and Research Libraries News 75(4) : 191~196

[journal] Butler-Adam, J. / 2013 / DORA: The San Francisco declaration on research assessment / South African Journal of Science 109(7/8) : 1~1

[journal] Cagan, R. / 2013 / The San Francisco declaration on research assessment / Disease Models & Mechanisms 6(4) : 869~870

[web] Garfield, E. / 2009 / From information retrieval to scientometrics-is the dog still wagging its tail / Keynote Address at WIS & COLLNET / http://garfield.library.upenn.edu/papers/dalianchina2009.html

[journal] Gomez Marin, J. E. / 2015 / Why to disagree with the San Francisco declaration on research assessment / Infectio 19(3) : 99~100

[journal] Grant Steen, R. / 2013 / Journal impact factor: Baby and bathwater discarded? / European Science Editing 39(3) : 64~65

[journal] Hagen, N. T. / 2008 / Harmonic allocation of authorship credit: Source-level correction of bibliometric bias assures accurate publication and citation analysis / PLoS ONE 3(12) : e4021~

[journal] Hicks, D. / 2015 / Bibliometrics: The Leiden Manifesto for research metrics / Nature 520(7548) : 429~431

[journal] Hoppeler, H. / 2013 / The San Francisco declaration on research assessment / The Journal of Experimental Biology 216 : 2163~2164

[web] IEEE / 2013 / Appropriate use of bibliometric indicators for the assessment of journals, research proposals, and individuals / https://www.ieee.org/publications_standards/publications/rights/ieee_bibliometric_statement_sept_2013.pdf

[journal] King, J. / 1987 / A review of bibliometric and other science indicators and their role in research evaluation / Journal of Information Science 13(5) : 261~271

[journal] Jiménez-Contreras, E. / 2002 / Impactfactor rewards affect Spanish research / Nature 417 : 898~

[journal] 이재윤 / 2014 / A Comparative Analysis on Multiple Authorship Counting for Author Co-citation Analysis / 정보관리학회지 / 한국정보관리학회 31(2) : 57~77

[journal] Leydesdorff, L. / 2012 / Percentile ranks and the integrated impact indicator (I3) / Journal of the American Society for Information Science and Technology 63(9) : 1901~1902

[journal] Moed, H. F. / 2010 / Measuring contextual citation impact of scientific journals / Journal of Informetrics 4(3) : 256~277

[journal] Pourquié, O. / 2013 / The San Francisco declaration on research assessment / Development 140(13) : 2643~2644

[journal] Pendlebury, D. A. / 2009 / The use and misuse of journal metrics and other citation indicators / Archivum Immunologiae et Therapiae Experimentalis 57(1) : 1~11

[web] Pendlebury, D. A. / 2010 / Using bibliometrics in evaluating research / https://services.anu.edu.au/files/system/Pendlebury_White_Paper.pdf

[journal] Pugh, E. N. / 2013 / Embracing the principles of the san francisco declaration of research assessment: Robert Balaban’s editorial / The Journal of General Physiology 142(3) : 175~

[journal] Schekman, R. / 2013 / Reforming research assessment / eLife 2(2) : e00855~

[journal] Schubert, A. / 2009 / Using the h-index for assessing single publications / Scientometrics 78(3) : 559~565

[journal] Servaes, J. / 2014 / On impact factors and research assessment. At the start of volume 31 of telematics and informatics / Telematics and Informatics 31(1) : 1~2

[web] Thomson Reuters / 2008 / Using bibliometrics: A guide to evaluating research performance with citation data / http://ip-science.thomsonreuters.com/m/pdfs/325133_thomson.pdf

[journal] Way, M. / 2013 / The San Francisco declaration on research assessment / Journal of Cell Science 126 : 1903~1904

KJCKorea
Journal Central

Journal of the Korean Society for Information Management 2023 KCI Impact Factor : 1.31

A Review of Declarations on Appropriate Research Evaluation for Exploring Their Applications to Research Evaluation System of Korea

ABSTRACT

KEYWORDS

Citation status

* References for papers published after 2023 are currently being built.

Journal of the Korean Society for Information Management 2023 KCI Impact Factor : 1.31

A Review of Declarations on Appropriate Research Evaluation for Exploring Their Applications to Research Evaluation System of Korea

ABSTRACT

KEYWORDS

Statistics

Tools

Issue List

Citation status

KCI Citation Counts (9)

REFERENCES (36) * References for papers published after 2023 are currently being built.

Search PDF

Citation

* References for papers published after 2023 are currently being built.