오픈 피어 리뷰 환경에서 학술 논문 심사 결과와 영향력 지표 간의 관련성에 관한 연구 (A Study on the Relationship between the Review Results of Articles and Impact Metrics in an Open Peer Review Platform)

조재인 (CHO JANE); 박종도 (PARK JONG DO)

doi:10.4275/KSLIS.2023.57.2.079

A Study on the Relationship between the Review Results of Articles and Impact Metrics in an Open Peer Review Platform

Journal of the Korean Society for Library and Information Science
2023, 57(2), pp.79~96
DOI : 10.4275/KSLIS.2023.57.2.079
Publisher : 한국문헌정보학회
Research Area : Interdisciplinary Studies > Library and Information Science
Received : April 21, 2023
Accepted : May 9, 2023
Published : May 31, 2023

CHO JANE ¹, PARK JONG DO ¹

¹인천대학교

Excellent Accredited

ABSTRACT

This study analyzed the open peer review results for 585 papers in the field of social sciences in F1000Research, a representative OPR(Open Peer Review) platform, and checked the relationship between the number of cited-by, altmetrics and review score. In addition, by verifying whether the review score shows a moderating effect between the relationship between the utilization of the paper and the cited-by, it was confirmed whether the paper evaluated as high quality in the open review platform can promote the number of cited-by. As a result of the analysis, first, there was no significant difference in the number of cited-by between the approved and conditionally approved paper groups, but the converted review score and the number of cited-by showed a weak positive correlation (r = 0.40 - 0.60). Second, the review score showed a weak correlation with the altmetrics, and it was analyzed that review result could weakly predict the number of cited-by and social impact. Finally, it was verified that the review score performed a significant positive moderating effect (B=1.69, P < 0.01) in making the use of the paper lead to citation. As a result of the conditional effect test, it was verified that it showed the greatest effect(B=11.32, 95% CI [10.57, 12.08]) in the group of papers rated as the highest quality. Therefore, it was analyzed that the open review scores can help researchers select high quality papers and induce citations.

KEYWORDS

Open peer review, OPR, Altmetrics, Citation, Article

Journal Copyright Policy

This license enables reusers to copy and distribute the material in any medium or format in unadapted form only, for noncommercial purposes only, and only if attribution is given to the creator.

Citation status

* References for papers published after 2025 are currently being built.

[journal] 김지영 / 2020 / A Study on Open Peer Review Perception of Korean Authors in a Mega OA Journal / 정보관리학회지 / 한국정보관리학회 37(4) : 131~150

[confproc] 정용일 / 2022 / 학술연구정보의 오픈 액세스 관행에 대한 인식 연구: 과학기술분야학회의 개방형 동료심사 관행을 중심으로 / 정보통신학회 종합학술대회논문집 : 8~21

[journal] 허원무 / 2013 / 매개효과 분석 방법의 최근 트랜드 : 부트스트래핑을 이용한 단순, 다중, 이중매개효과분석 방법 / 한국비즈니스리뷰 6(3) : 43~59

[web] ASAPbio / Transparency, recognition, and innovation in peer review in the life sciences:peer review survey results / https://asapbio.org/peer-review/survey

[web] Belluz, J. / 2016 / The 7 biggest problems facing science, according to 270 scientists / Vox / https://www.vox.com/2016/7/14/12016710/science-challeges-research-funding-peer-review-process

[journal] Lutz Bornmann / 2013 / The validation of (advanced) bibliometric indicators through peer assessments: A comparative study using data from InCites and F1000 / Journal of Informetrics / Elsevier BV 7(2) : 286~291

[journal] Bornmann, L. / 2012 / Closed versus open reviewing of journal manuscripts : how far do comments differ in language use / Scientometrics 91 : 843~856

[web] European Commission / 2020 / European Commission awards contract for setting up an open access publishing platform / https://research-and-innovation.ec.europa.eu/news/all-research-and-innovation-news/european-commission-awards-contract-setting-open-access-publishing-platform-2020-03-20_en

[web] / 2023 / F1000Research / https://f1000research.com/

[book] Hayes, A. F / 2017 / Introduction to Mediation, Moderation, and Conditional Process Analysis:A Regression-Based Approach / Guilford Press

[journal] Huggett, S. / 2012 / F1000Research journal rankings: an alternative way to evaluate the scientific impact of scholarly communications / Research Trends 1(26)

[journal] Janowicz, K. / 2012 / Open and transparent : the review process of the semantic web journal / Learned Publishing 25(1) : 48~55

[journal] Khan, K. / 2010 / Is open peer review the fairest system? / BMJ 341 : c6425~

[journal] Merton, R. K. / 1968 / Matthew effect in science : reward and communication systems of science are considered / Science 159(3810) : 56~63

[journal] Mulligan, A. / 2013 / Peer review in a changing world : an international study measuring the attitudes of researchers / Journal of American Society for Information Science and Technology 64 : 132~161

[journal] Ross-Hellauer, T. / 2017 / What is open peer review? a systematic review / F1000Research Research 6 : 1~37

[journal] Smith, R. / 2006 / Peer review : a flawed process at the heart of science and journals / Journal of the Royal Society of Medicine 99 : 178~182

[journal] Thelwall, M. / 2021 / Does the use of open, non-anonymous peer review in scholarly publishing introduce bias? evidence from the F1000Research post-publication open peer review publishing model / Journal of Information Science 47(6) : 809~820

[journal] Tsakonas, G. / 2021 / Open science cannot succeed without open peer review / LIBER Quarterly : The Journal of the Association of European Research Libraries 31(1) : 1~6

[journal] van Rooyen, S. / 1999 / Effect of open peer review on quality of reviews and on reviewers' recommendations : a randomised trial / British Medical Journal 318(7175) : 23~

[web] Vines, T. / 2013 / How rigorous is the post-publication review process at F1000 research? / https://scholarlykitchen.sspnet.org/2013/03/27/how-rigorous-is-the-post-publication-review-process-at-f1000-research/

[journal] Walsh, E. / 2000 / Open peer review : a randomised controlled trial / The British Journal of Psychiatry 176(1) : 47~51

[journal] Waltman, L. / 2014 / F1000Research recommendations as a potential new data source for research evaluation : a comparison with citations / Journal of the Association for Information Science & Technology 65(3) : 433~445

[journal] Wang, P. / 2020 / F1000Research Prime recommended articles and their citations : an exploratory study of four journals / Scientometrics 122 : 933~955

[journal] Williams, A. E. / 2017 / F1000 : an overview and evaluation / Information and Learning Sciences 118(7-) : 1108~

[journal] Dietmar Wolfram / 2020 / Open peer review: promoting transparency in open science / Scientometrics / Springer Science and Business Media LLC 125(2) : 1033~1051

[journal] Zong, Q. / 2020 / The relationship of polarity of post-publication peer review to citation count : evidence from publons / Online Information Review 44(3) : 583~602

[journal] Zong, Q. / 2020 / Does open peer review improve citation count? evidence from a propensity score matching analysis of PeerJ / Scientometrics 125 : 607~623

KJCKorea
Journal Central

Journal of the Korean Society for Library and Information Science 2025 KCI Impact Factor : 1.37