본문 바로가기
  • Home

Permutation P-values for Inter-rater Agreement Measures

  • Journal of The Korea Society of Computer and Information
  • Abbr : JKSCI
  • 2015, 20(12), pp.169-174
  • Publisher : The Korean Society Of Computer And Information
  • Research Area : Engineering > Computer Science

Yonghwan Um 1

1성결대학교

Accredited

ABSTRACT

Permutation p-values are provided for the agreement measures for multivariate interval data among many raters. Three agreement measures, Berry and Mielke's measure, Janson and Olsson's measure, and Um's measure are described and compared. Exact and resampling permutation methods are utilized to compute p-values and empirical quantile limits for three measures. Comparisons of p-values demonstrate that resampling permutation methods provide close approximations to exact p-values, and Berry and Mielke's measure and Um's measure show similar performance in terms of measuring agreement.

Citation status

* References for papers published after 2023 are currently being built.