Digital Library Evaluation Criteria: What do Users Want?

Iris Xie; Soohyung Joo; Krystyna K. Matusiak

doi:10.14699/kbiblia.2014.25.1.005

Digital Library Evaluation Criteria: What do Users Want?

Journal of the Korean Biblia Society for Library and Information Science
2014, 25(1), pp.5-18
DOI : 10.14699/kbiblia.2014.25.1.005
Publisher : Journal Of The Korean Biblia Society For Library And Information Science
Research Area : Interdisciplinary Studies > Library and Information Science

Iris Xie ¹, Soohyung Joo ¹, Krystyna K. Matusiak ²

¹University of Wisconsin-Milwaukee
²Morgridge College of Education, University of Denver

Accredited

ABSTRACT

Criteria for evaluating digital libraries have been suggested in prior studies, but limited research has been done to understand users’ perceptions of evaluation criteria. This study investigates users’ opinions of the importance of digital library evaluation criteria. Thirty user participants, including 10 faculty members and 20 students, were recruited from five universities across the United States. They were asked to rate the importance of evaluation criteria in eight dimensions (e.g. collections, information organization, context, etc.). The results demonstrate that users care about evaluation criteria related to the use and quality of collection and services rather than the operation of digital libraries. The findings of this study are relevant to the development of user-centered digital libraries and associated evaluation frameworks through the incorporation of unique users’ needs and preferences.

KEYWORDS

digital libraries, digital library evaluation, evaluation criteria, user perspectives, evaluation dimensions

Citation status

* References for papers published after 2023 are currently being built.

[journal] Borgman, C. L. / 2000 / Evaluating Digital Libraries for Teaching and Learning in Undergraduate Education: A Case Study of the Alexandria Digital Earth Prototype (ADEPT) / Library Trends 49 : 228~250

[journal] Buttenfield, B. / 1999 / Usability Evaluation of Digital Libraries / Science & Technology Libraries 17(3/4) : 39~50

[journal] Candela, L. / 2007 / Setting the Foundations of Digital Libraries: The DELOS Manifesto / D-Lib Magazine 13(3/4)

[journal] Fox, E. A. / 1995 / Digital Libraries / Communications of the ACM 38(4) : 23~28

[journal] Fuhr, N. / 2001 / Digital Libraries: A Generic Classification and Evaluation Scheme / Lecture Notes in Computer Science 2163 : 187~199

[journal] Fuhr, N. / 2007 / Evaluation of Digital Libraries / International Journal on Digital Libraries 8(1) : 21~38

[book] Hill, L.L. / 1997 / User Evaluation: Summary of the Methodologies and Results for the Alexandria Digital Library, University of California at Santa Barbara / Information Today : 225~243

[journal] Hill, L. L. / 2000 / Alexandria Digital Library: User Evaluation Studies and System Design / Journal of the American Society for Information Science 51 : 246~259

[journal] Jeng, J. / 2005 / Usability Assessment of Academic Digital Libraries: Effectiveness, Efficiency, Satisfaction, and Learnability / Libri 55 : 96~121

[journal] Joo, S / 2011 / Measuring the Usability of Academic Digital Libraries: Instrument Development and Validation / The Electronic Library 29(4) : 523~537

[confproc] Marchionini, G. / 1998 / Interfaces and Tools for the Library of Congress National Digital Library Program / Information Processing & Management 34(5) : 535~555

[journal] Matusiak, K. K. / 2012 / Perceptions of Usability and Usefulness of Digital Libraries / The International Journal of Humanities and Arts Computing 6(1-2) : 133~147

[book] Nielson. J / 1993 / Usability Engineering / Academic Press

[journal] Noh, Y. / 2010 / A Study on Developing Evaluation Criteria for Electronic Resources in Evaluation Indicators of Libraries / Journal of Academic Librarianship 36(1) : 41~52

[confproc] Saracevic, T. / 2000 / Challenges for Digital Library Evaluation / Proceedings of the American Society for Information Science 37 : 341~350

[confproc] Saracevic, T. / 2004 / Evaluation of Digital Libraries: An Overview / Presented at the DELOS Workshop on the Evaluation of Digital Libraries

[confproc] Tsakonas, G. / 2004 / Evaluation of User Interaction in Digital Libraries. In M. Agosti, N. Fuhr(eds. )Notes of the DELOS WP7 Workshop on the Evaluation of Digital Libraries, Padua, Italy / Notes of the DELOS WP7 Workshop on the Evaluation of Digital Libraries

[journal] Van House, N. A. / 1996 / User-centered Iterative Design for Digital Libraries: The Cypress Experience / D-Lib Magazine 2

[journal] Xie, I. / 2006 / Evaluation of Digital Libraries: Criteria and Problems from Users’ Perspectives / Library & Information Science Research 28(3) : 433~452

[journal] Xie, I. / 2008 / Users' Evaluation of Digital Libraries: Their Uses, Their Criteria, and Their Assessment / Information Processing & Management 44(3) : 1346~1373

[journal] Ward, J.L. / 2005 / Usability Testing, Interface Design, and Portals / Journal of Library Administration 43(1) : 155~171

[journal] Zhang, Y. / 2010 / Developing a Holistic Model for Digital Library Evaluation / Journal of the American Society for Information Science and Technology 61(1) : 88~110

KJCKorea
Journal Central

Journal of the Korean Biblia Society for Library and Information Science 2023 KCI Impact Factor : 0.82

Digital Library Evaluation Criteria: What do Users Want?

ABSTRACT

KEYWORDS

Citation status

* References for papers published after 2023 are currently being built.

Journal of the Korean Biblia Society for Library and Information Science 2023 KCI Impact Factor : 0.82

Digital Library Evaluation Criteria: What do Users Want?

ABSTRACT

KEYWORDS

Statistics

Tools

Issue List

Citation status

KCI Citation Counts (0)

REFERENCES (22) * References for papers published after 2023 are currently being built.

Search PDF

Citation

* References for papers published after 2023 are currently being built.