Journal of the Korean Society for Library and Information Science 2023 KCI Impact Factor : 0.84
-
pISSN : 1225-598X / eISSN : 2982-6292
- https://journal.kci.go.kr/kslis
KJCKorea
Journal Central
Performance Evaluation of Re-ranking and Query Expansion for Citation Metrics: Based on Citation Index Databases
- Journal of the Korean Society for Library and Information Science
- 2023, 57(3), pp.249-277
- DOI : 10.4275/KSLIS.2023.57.3.249
- Publisher : 한국문헌정보학회
- Research Area : Interdisciplinary Studies > Library and Information Science
- Received : July 22, 2023
- Accepted : August 12, 2023
- Published : August 31, 2023
LeeHyekyung 1, LeeYong-Gu 2
1경북대학교 문헌정보학과
2경북대학교
Excellent Accredited
ABSTRACT
The purpose of this study is to explore the potential contribution of citation metrics to improving the search performance of citation index databases. To this end, the study generated ten queries in the field of library and information science and conducted experiments based on the relevance assessment using 3,467 documents retrieved from the Web of Science and 60,734 documents published in 85 SSCI journals in the field of library and information science from 2000 to 2021. The experiments included re-ranking of the top 100 search results using citation metrics and search methods, query expansion experiments using vector space model retrieval systems, and the construction of a citation-based re-ranking system. The results are as follows: 1) Re-ranking using citation metrics differed from Web of Science’s performance, acting as independent metrics. 2) Combining query term frequencies and citation counts positively affected performance. 3) Query expansion generally improved performance compared to the vector space model baseline. 4) User-based query expansion outperformed system-based. 5) Combining citation counts with suitability documents affected ranking within top suitability documents.
Statistics
-
316 Viewed
-
239 Downloaded
Tools
Issue List
Citation status
* References for papers published after 2023 are currently being built.
[journal]
김선욱
/ 2022
/
Topic Model Augmentation and Extension Method using LDA and BERTopic
/ 정보관리학회지
/ 한국정보관리학회
39(3)
: 99~132
[journal]
김한준
/ 2012
/
A New Re-ranking Technique based on Concept-Network Profiles for Personalized Web Search
/ 한국인터넷방송통신학회 논문지
/ 한국인터넷방송통신학회
12(2)
: 69~76
[confproc]
김홍렬
/ 1999
/ 연구진행정도에 따른 검색문헌의 적합평가기준 연구
/ 한국정보관리학회 학술대회 논문집
: 5~8
[journal]
박정아
/ 2009
/
User-centered relevance judgement model for information retrieval
/ 감성과학
/ 한국감성과학회
12(4)
: 489~500
[journal]
이승욱
/ 2008
/
An Opinionated Document Retrieval System based on Hybrid Method
/ 정보관리학회지
/ 한국정보관리학회
25(4)
: 115~129
[confproc]
장영진
/ 2020
/ 정보 검색 기반 기계독해 시스템을 위한 단락 재순위화 모델
/ 한국정보과학회 학술발표논문집
47(1)
: 410~412
[journal]
Anker, M. S.
/ 2019
/ The difference in referencing in Web of Science, Scopus, and Google Scholar
/ ESC Heart Failure
6(6)
: 1291~1312
[journal]
Bar-Ilan, J.
/ 2008
/ Which h-index?—a comparison of WoS, Scopus and Google Scholar
/ Scientometrics
74(2)
: 257~271
[journal]
Birkle, C.
/ 2020
/ Web of Science as a data source for research on scientific and scholarly activity
/ Quantitative Science Studies
1(1)
: 363~376
[confproc]
Buckley, C.
/ 1993
/ The smart information retrieval project
/ Proceedings of the workshop on Human Language Technology
: 392~392
[confproc]
Claveau, V.
/ 2021
/ Neural text generation for query expansion in information retrieval
/ IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology
: 202~209
[journal]
Cooper, W. S.
/ 1971
/ A definition of relevance for information retrieval
/ Information storage and retrieval
7(1)
: 19~37
[journal]
Cronin, B.
/ 1982
/ Norms and functions in citation-the view of journal editors and referees in psychology
/ Social Science Information Studies
2
: 65~78
[journal]
Gao, Q.
/ 2022
/ Semantic-enhanced topic evolution analysis : a combination of the dynamic topic model and word2vec
/ Scientometrics
127(3)
: 1543~1563
[journal]
Garfield, E.
/ 1964
/ "Science citation index"-a new dimension in indexing
/ Science
144(3619)
: 649~654
[confproc]
Gupta, V.
/ 2018
/ Retrieve and re-rank: a simple and effective IR approach to simple question answering over knowledge graphs
/ Proceedings of the First Workshop on Fact Extraction and VERification (FEVER)
: 22~27
[confproc]
Harman, D. (
/ 1988
/ Towards interactive query expansion
/ Proceedings of the 11th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval
: 321~331
[confproc]
Harman, D. (
/ 1992
/ Relevance feedback revisited
/ Proceedings of the 15th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval
: 1~10
[confproc]
Hirsch, J. E.
/ 2005
/ An index to quantify an individual's scientific research output
/ Proceedings of the National Academy of Sciences
102(46)
: 16569~16572
[journal]
Ioannakis, G.
/ 2017
/ RETRIEVAL—an online performance evaluation tool for information retrieval methods
/ IEEE Transactions on Multimedia
20(1)
: 119~127
[journal]
Jain, S.
/ 2021
/ A fuzzy ontology framework in information retrieval using semantic query expansion
/ International Journal of Information Management Data Insights
1(1)
: 100009~
[confproc]
Jiang, Z.
/ 2021
/ How does BERT rerank passages? an attribution analysis with information bottlenecks
/ Proceedings of the Fourth BlackboxNLP Workshop on Analyzing and InterpretingNeural Networks for NLP
: 496~509
[book]
Lancaster, F. W
/ 1979
/ Information Retrieval Systems; Characteristics, Testing, and Evaluation
/ Wiley
[confproc]
Lv, Y.
/ 2010
/ Positional relevance model for pseudo-relevance feedback
/ Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval
: 579~586
[journal]
Maglaughlin, K. L.
/ 2002
/ User perspectives on relevance criteria : a comparison among relevant, partially relevant, and not-relevant judgments
/ Journal of the American Society for Information Science and Technology
53(5)
: 327~342
[journal]
Martín-Martín, A.
/ 2021
/ Google Scholar, Microsoft Academic, Scopus, Dimensions, Web of Science, and OpenCitations’COCI : a multidisciplinary comparison of coverage via citations
/ Scientometrics
126(1)
: 871~906
[journal]
Mizzaro, S.
/ 1998
/ How many relevances in information retrieval
/ Interacting with computers
10(3)
: 303~320
[confproc]
Natsev, A.
/ 2007
/ Semantic concept-based query expansion and re-ranking for multimedia retrieval
/ Proceedings of the 15th ACM international conference on Multimedia
: 991~1000
[confproc]
Pereira, M.
/ 2020
/ Iterative learning to rank from explicit relevance feedback
/ Proceedings of the 35th Annual ACM Symposium on Applied Computing
: 698~705
[journal]
Rivas, A. R.
/ 2014
/ Study of query expansion techniques and their application in the biomedical information retrieval
/ The Scientific World Journal
[other]
Rocchio, J.
/ 1971
/ Relevance feedback in information retrieval
/ The Smart Retrieval System-experiments in Automatic Document Processing
: 313~323
[journal]
Rovira, C.
/ 2019
/ Ranking by relevance and citation counts, a comparative study : Google Scholar, Microsoft Academic, WoS and Scopus
/ Future Internet
11(9)
: 202~
[journal]
Salton, G.
/ 1965
/ The SMART automatic document retrieval systems—an illustration
/ Communications of the ACM
8(6)
: 391~398
[book]
Salton, G.
/ 1983
/ Introduction to Modern Information Retrieval
/ McGraw-Hill
[journal]
Salton, G.
/ 1975
/ A vector space model for automatic indexing
/ Communications of the ACM
18(11)
: 613~620
[journal]
Smith, L. C.
/ 1981
/ Citation Analysis
/ Library Trends
30(1)
: 83~106
[confproc]
Soboroff, I.
/ 2021
/ Overview of TREC 2021
/ 30th Text REtrieval Conference
[journal]
Spink, A.
/ 1998
/ From highly relevant to not relevant : examining different regions of relevance
/ Information processing & management
34(5)
: 599~621
[journal]
Taylor, A.
/ 2012
/ User relevance criteria choices and the information search process
/ Information Processing & Management
48(1)
: 136~153
[confproc]
Van Gysel, C.
/ 2018
/ Pytrec_eval: an extremely fast python interface to trec_eval
/ The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval
: 873~876
[journal]
Van Raan, A. F.
/ 2005
/ For your citations only? Hot topics in bibliometric analysis
/ Measurement : interdisciplinary research and perspectives
3(1)
: 50~62
[web]
Voorhees, E. M.
/ 2005
/ TREC: Experiment and evaluation in information retrieval (Vol. 63)
/ MITPress
[confproc]
Wang, X.
/ 2021
/ Refbert: Compressing bert by referencing to pre-computed representations
/ 2021 International Joint Conference on Neural Networks (IJCNN)
: 1~8
[confproc]
Wang, Y.
/ 2013
/ A theoretical analysis of NDCG ranking measures
/ Proceedings of the 26th Annual Conference on Learning Theory (COLT 2013)
: 25~54
[journal]
Xu, J.
/ 2017
/ Quary expansion using local and global document analysis
/ Acm Sigir Forum
51(2)
: 168~175
[confproc]
Zheng, Z.
/ 2020
/ BERT-QE : contextualized query expansion for document re-ranking
/ Findings of the Association for Computational Linguistics: EMNLP 2020
: 4718~4728