Multi-faceted Citation Analysis for Quality Assessment of Scholarly Publications

Kiduk Yang (Yang, Kiduk); Lokman Meho

doi:10.3743/KOSIM.2011.28.2.079

Multi-faceted Citation Analysis for Quality Assessment of Scholarly Publications

Journal of the Korean Society for Information Management
Abbr : JKOSIM
2011, 28(2), pp.79~96
DOI : 10.3743/KOSIM.2011.28.2.079
Publisher : 한국정보관리학회
Research Area : Interdisciplinary Studies > Library and Information Science
Received : May 15, 2011
Accepted : June 3, 2011
Published : June 30, 2011

Kiduk Yang ¹, Lokman Meho ²

¹경북대학교
²American University of Beirut, Lebanon

Accredited

ABSTRACT

Despite the widespread use, critics claim that citation analysis has serious limitations in evaluating the research performance of scholars. First, conventional citation analysis methods yield one-dimensional and sometimes misleading evaluation as a result of not taking into account differences in citation quality, not filtering out citation noise such as self-citations, and not considering non-numeric aspects of citations such as language, culture, and time. Second, the citation database coverage of today is disjoint and incomplete, which can result in conflicting quality assessment outcomes across different data sources. This paper discuss the findings from a citation analysis study that measured the impact of scholarly publications based on the data mined from Web of Science, Scopus, and Google Scholar, and briefly describes a work-in-progress prototype system called CiteSearch, which is designed to overcome the weaknesses of existing citation analysis methods with a robust citation-based quality assessment approach.

KEYWORDS

citation analysis, quality assessment, scholarly publication, fusion method, citation database

Citation status

* References for papers published after 2023 are currently being built.

[journal] Aksnes, D. W / 2004 / Peer reviews and bibliometric indicators: A comparative study at a Norwegian university / Research Evaluation 13(1) : 33~41

[journal] Bakkalbasi, N / 2006 / Three options for citation tracking: Google Scholar, Scopus and Web of Science / Biomedical Digital Libraries 7

[journal] Bar-Ilan, J / 2008 / An ego-centric citation analysis of the works of Michael O. Rabin based on multiple citation indexes / Information Processing and Management 42(6) : 1553~1566

[journal] Bar-Ilan, J / 2008 / Which h-index? - A comparison of WoS, Scopus and Google Scholar / Scientometrics 74(2) : 257~271

[journal] Bar-Ilan, J / 2007 / Some measures for comparing citation databases / Journal of Informetrics 1(1) : 26~34

[journal] Bauer, K / 2005 / An examination of citation counts in a new scholarly communication environment / D-Lib Magazine 11(930)

[journal] Bergstrom, C. T / 2007 / Eigenfactor: Measuring the value and prestige of scholarly journals / College & Research Libraries News 68(5)

[book] Cronin, B / 1984 / The Citation Process: The Role and Significance of Citations in Scientific Communication / Taylor Graham

[journal] Egghe, L / 2006 / Theory and practise of the g-index / Scientometrics 69(1) : 131~152

[web] Giustini, D / 2006 / Blog posting at UBC Academic Search-Google Scholar Blog / http://weblogs.elearning.ubc.ca/googleschol ar/archives/025964.html

[journal] Hirsch, J. E / 2005 / An index to quantify an in dividual’'s scientific research output / Proceedings of the National Academy of Sciences of the United States of America 102(46) : 16569~16572

[journal] Holden, G / 2005 / Bibliometrics: A potential decision making aid in hiring, reappointment, tenure and promotion decisions / Social Work in Health Care 41(3) : 67~92

[journal] Holmes, A / 2001 / Use of citation analysis to predict the outcome of the 2001 Research Assessment Exercise for Unit of Assessment (UoA) 61: Library and Information Management / Information Research 6(2)

[journal] Jacsó, P / 2005 / As we may search-comparison of major features of the Web of Science, Scopus, and Google Scholar citation-based and citation- enhanced databases / Current Science 89(9) : 1537~1547

[confproc] Kleinberg, J / 1998 / Authoritative sources in a hyperlinked environment / Proceeding of the 9th ACM-SIAM Symposium on Discrete Algorithms : 668~677

[confproc] Kousha, K / 2006 / Sources of Google Scholar citations outside the Science Citation Index: A comparison between four science disciplines / Book of Abstracts, 9th International Science & Technology Indicators Conference, Leuven, Belgium : 72~73

[journal] Lewison, G / 2001 / Evaluation of books as research outputs in history of medicine / Research Evaluation 10(2) : 89~95

[journal] MacRoberts, M. H / 1996 / Problems of citation analysis / Scientometrics 36(3) : 435~444

[journal] Marchionini, G., P / 2006 / Information and library science MPACT: A preliminary analysis / Library & Information Science Research 28(4)

[journal] Martin, B. R / 1996 / The use of multiple indicators in the assessment of basic research / Scientometrics 36(3) : 343~362

[journal] Meho, L. I / 2007 / Impact of data sources on citation counts and rankings of LIS faculty: Web of Science vs. Scopus and Google Scholar / Journal of the American Society for Information Science and Technology 58(13) : 2105~2125

[book] Moed, H. F / 2005 / Citation Analysis in Research Evaluation / Springer

[journal] Nisonger, T. E / 2004 / Citation autobiography: An investigation of ISI database coverage in determining author citedness / College & Research Libraries 65(2) : 152~163

[journal] Norris, M / 2007 / Comparing alternatives to the Web of Science for coverage of the social sciences’' literature / Journal of Informetrics 1(2) : 161~169

[journal] Noruzi, A / 2005 / Google Scholar: The New Generation of Citation Indexes / Libri 55(4) : 170~180

[journal] Seglen, P. O / 1998 / Citation rates and journal impact factors are not suitable for evaluation of research / Acta Orthopaedica Scandinavica 69(3) : 224~229

[journal] van Raan, A. F. J / 1996 / Advanced bibliometric methods as quantitative core of peer-review based evaluation and foresight exercises / Scientometrics 36(3) : 397~420

[journal] Vaughan, L / 2008 / A new look at evidence of scholarly citation in citation indexes and from web sources / Scientometrics 74(2) : 317~330

[web] West, J. D. / 2010 / Big Macs and Eigenfactor Scores: Don't Let Correlation Coefficients Fool You / http://arxiv.org/abs/0911.1807

KJCKorea
Journal Central

Journal of the Korean Society for Information Management 2023 KCI Impact Factor : 1.31

Multi-faceted Citation Analysis for Quality Assessment of Scholarly Publications

ABSTRACT

KEYWORDS

Citation status

* References for papers published after 2023 are currently being built.

Journal of the Korean Society for Information Management 2023 KCI Impact Factor : 1.31

Multi-faceted Citation Analysis for Quality Assessment of Scholarly Publications

ABSTRACT

KEYWORDS

Statistics

Tools

Issue List

Citation status

KCI Citation Counts (2)

REFERENCES (29) * References for papers published after 2023 are currently being built.

Search PDF

Citation

* References for papers published after 2023 are currently being built.