본문 바로가기
  • Home

Rutgers Information Retrieval Evaluation Project on IR Performance on Different Precision Levels

  • Journal of the Korean Society for Information Management
  • Abbr : JKOSIM
  • 2006, 23(2), pp.97~111
  • DOI : 10.3743/KOSIM.2006.23.2.097
  • Publisher : 한국정보관리학회
  • Research Area : Interdisciplinary Studies > Library and Information Science
  • Received : May 15, 2006
  • Accepted : June 22, 2006
  • Published : June 30, 2006

Hyuk-Jin Lee 1

1Texas Woman’s University

Accredited

ABSTRACT

The purpose of this study is to investigate what level of difference in precision would be significantly perceived by a human user of an information retrieval system. Not many researches have been conducted with regards to this issue in information retrieval field. Despite the non-significant results, there were several interesting findings in recognizing different levels of precision rates. The correctness of relevance task had little to do with the taken time for the task. In addition, the strong relationship between the subjects' topic familiarity and rate of correct judgments is one of the most interesting results in this study. It turned out that the subjects have more difficulty in a situation they have to judge between the two lists having more non-relevant documents than in a situation they do between the lists having more relevant documents. Finally, the serious influence from the first top N documents in a list for relevance judgment task has been confirmed.

Citation status

* References for papers published after 2023 are currently being built.