A Study on the Improvement of Inter-Rater Reliability and Agreement of K-MBI Based on Activity Analysis and Process Mapping (활동분석과 프로세스 맵핑을 기반으로 한 K-MBI의 평가자 간 신뢰도 및일치도 향상을 위한 연구)

Song, Young-Jin (송영진); choi min kyung (최민경); Kim， Jong-Sung (김종성); Lee Jeong-Hoon (이정훈); Jeong Byoung Lock (정병록)

doi:10.14519/kjot.2019.27.2.07

A Study on the Improvement of Inter-Rater Reliability and Agreement of K-MBI Based on Activity Analysis and Process Mapping

Korean Journal of Occupational Therapy
Abbr : Korean J of Occup Ther
2019, 27(2), pp.79-92
DOI : 10.14519/kjot.2019.27.2.07
Publisher : Korean Society Of Occupational Therapy
Research Area : Medicine and Pharmacy > Working Therapeutics
Received : October 30, 2018
Accepted : May 7, 2019
Published : June 30, 2019

Song, Young-Jin ¹, choi min kyung ², Kim， Jong-Sung ³, Lee Jeong-Hoon ⁴, Jeong Byoung Lock ⁵

¹서울아산병원 재활의학과 작업치료실
²파크사이드
³명지춘혜병원
⁴가톨릭대학교
⁵상지영서대학교

Accredited

ABSTRACT

Objective: The purpose of this study was to verify the content validity and inter-rater reliability by producing theKorean version of Modified Barthel Index(K-MBI) guidebook based on activity analysis and processing mapping. Methods: This study developed the K-MBI guidebook based on activity analysis and process mapping. Thedeveloped the K-MBI guidebook was also investigated and revised to produce the final version of K-MBIguidebook. To verify the content validity was measured in forty occupational therapy. The daily activities of fivepatients were recorded to investigate reliability and agreement. In order to examine reliability and agreement, 84occupational therapists evaluated five patients in the same video pre and post the K-MBI guidebook training. Results: The content validity results showed a high level of validity with a CVI score of .93 or higher in all theK-MBI items. ICCs showed high levels of confidence. The change in the correct rate was improved from 48.37%prior to education to 69.48% after education, and the agreement was improved in all categories except fordressing. Conclusions: The results of this study confirm that the K-MBI guidebook, based on activity analysis and processmapping, improves the reliability and agreement of inter-rater.

KEYWORDS

ADL, Inter-rater reliability, Inter-rater agreement, K-MBI, Activity analysis, Processing mapping

Citation status

* References for papers published after 2023 are currently being built.

[journal] Cha, J. S. / 1994 / An analytical review of interrater reliability & agreement / Korean Management Review 23 : 75~102

[other] / 2018 / Criteria for disability grade, §2018-151

[journal] Janet Fricke / 1997 / Inter-rater reliability of the original and modified Barthel Index, and a comparison with the Functional Independence Measure / Australian Occupational Therapy Journal / Wiley 44(1) : 22~29

[web] Han, Y. S. / 2017 / Development and application of Korean rehabilitation patient classification system / http://www.hira.or.kr/bbsDummy.do?pgmid=HIRAA030096000000

[journal] Clare Hocking / 2016 / Sensitivity of Shah, Vanclay and Cooper's modified Barthel Index / Clinical Rehabilitation / SAGE Publications 13(2) : 141~147

[journal] I-P Hsueh / 2002 / Comparison of the psychometric characteristics of the functional independence measure, 5 item Barthel index, and 10 item Barthel index in patients with stroke / Journal of Neurology, Neurosurgery & Psychiatry / BMJ 73(2) : 188~190

[journal] M. Itzkovich / 2009 / The Spinal Cord Independence Measure (SCIM) version III: Reliability and validity in a multi-center international study / Disability and Rehabilitation / Informa UK Limited 29(24) : 1926~1933

[journal] Lawrence R. James / 1993 / r-sub(wg): An assessment of within-group interrater agreement. / Journal of Applied Psychology / American Psychological Association (APA) 78(2) : 306~309

[journal] 정한영 / 2007 / Development of the Korean Version of Modified Barthel Index (K-MBI): Multi-center Study for Subjects with Stroke / Annals of Rehabilitation Medicine / 대한재활의학회 31(3) : 283~297

[journal] Steve W. Kozlowski / 1992 / A disagreement about within-group agreement: Disentangling issues of consistency versus consensus. / Journal of Applied Psychology / American Psychological Association (APA) 77(2) : 161~167

[journal] 이근호 / 2011 / An Inter-Rater Reliability Study of K-MBI Checklist / 대한작업치료학회지 / 대한작업치료학회 19(4) : 95~105

[journal] Mahoney, F. I. / 1965 / Functional evaluation: The Barthel Index / Maryland State Medical Journal 14 : 61~65

[web] Ministry of Health and Welfare / 2017 / Designated pilot project for rehabilitation medical institution / http://www.mohw.go.kr/react/search/search.jsp

[journal] 노동국 / 2007 / Utility of Korean Modified Barthel Index (K-MBI) to Predict the Length of Hospital Stay and the Discharge Destinations in People With Stroke / 한국전문물리치료학회지 / 한국전문물리치료학회 14(3) : 81~89

[journal] Tomoko Ohura / 2017 / Validity and reliability of a performance evaluation tool based on the modified Barthel Index for stroke patients / BMC Medical Research Methodology / Springer Science and Business Media LLC 17(1) : 131~139

[journal] Kenneth J. Ottenbacher / 1996 / The reliability of the functional independence measure: A quantitative review / Archives of Physical Medicine and Rehabilitation / Elsevier BV 77(12) : 1226~1232

[other] Owczarzak, J. / 2003 / Functional Independence Measurement(FIM) user manual, version 1.0 / United States Department of Veteran Affairs

[journal] Christina Palmer / 2016 / Using reliability of change analysis to evaluate post-acute neuro-rehabilitation / NeuroRehabilitation / IOS Press 38(1) : 93~98

[journal] Park, S. Y. / 2002 / The use of occupational therapy assessment tool by Korean occupational therapist / Journal of Korean Society of Occupational Therapy 10(2) : 99~108

[journal] Denise F. Polit / 2006 / The content validity index: Are you sure you know what's being reported? critique and recommendations / Research in Nursing & Health / Wiley 29(5) : 489~497

[journal] B Prodinger / 2017 / Establishing score equivalence of the Functional Independence Measure motor scale and the Barthel Index, utilising the International Classification of Functioning, Disability and Health and Rasch measurement theory / Journal of Rehabilitation Medicine / Acta Dermato-Venereologica 49(5) : 416~422

[journal] Terence J. Quinn / 2011 / Barthel Index for Stroke Trials / Stroke / Ovid Technologies (Wolters Kluwer Health) 42(4) : 1146~1151

[journal] Harpreet Sangha / 2005 / A comparison of the Barthel Index and the Functional Independence Measure as outcome measures in stroke rehabilitation: patterns of disability scale usage in clinical trials / International Journal of Rehabilitation Research / Ovid Technologies (Wolters Kluwer Health) 28(2) : 135~139

[journal] Surya Shah / 1989 / Improving the sensitivity of the Barthel Index for stroke rehabilitation / Journal of Clinical Epidemiology / Elsevier BV 42(8) : 703~709

[journal] 심현섭 / 2002 / A interjudge reliability study on the subtypes of SSI-3 / Communication Sciences and Disorders / 한국언어청각임상학회 7(1) : 130~154

[journal] Margaret G. Stineman / 2014 / Activity Limitation Stages Empirically Derived for Activities of Daily Living (ADL) and Instrumental ADL in the U.S. Adult Community-Dwelling Medicare Population / PM&R / Wiley 6(11) : 976~987

[journal] Geert Sulter / 1999 / Use of the Barthel Index and Modified Rankin Scale in Acute Stroke Trials / Stroke / Ovid Technologies (Wolters Kluwer Health) 30(8) : 1538~1541

This paper was written with support from the National Research Foundation of Korea.

KJCKorea
Journal Central

Korean Journal of Occupational Therapy 2023 KCI Impact Factor : 0.81

A Study on the Improvement of Inter-Rater Reliability and Agreement of K-MBI Based on Activity Analysis and Process Mapping

ABSTRACT

KEYWORDS

Citation status

* References for papers published after 2023 are currently being built.

Korean Journal of Occupational Therapy 2023 KCI Impact Factor : 0.81

A Study on the Improvement of Inter-Rater Reliability and Agreement of K-MBI Based on Activity Analysis and Process Mapping

ABSTRACT

KEYWORDS

Statistics

Tools

Issue List

Citation status

KCI Citation Counts (2)

REFERENCES (27) * References for papers published after 2023 are currently being built.

Search PDF

Citation

* References for papers published after 2023 are currently being built.