Health Communication Research 2023 KCI Impact Factor : 0.75
-
pISSN : 2093-2707 / eISSN : 2671-5856
- https://journal.kci.go.kr/hcr
KJCKorea
Journal Central
The Effects of Statistical Artifacts on Outcomes in Meta-Analysis: The Comparative Analysis of Hedges-Olkin and Hunter-Schmidt Meta-Analytic Approaches
- Health Communication Research
- 2016, (15), pp.47-97
- DOI : 10.24172/hcr.2016..15.47
- Publisher : Korea Health Communication Association
- Research Area : Social Science > Journalism and Broadcasting > Communication
Byoungkwan Lee 1, Sohn, Youngkon 1
1한양대학교
Candidate
ABSTRACT
This study attempted to review and compare two major meta-analytic approaches, the Hedges and Olkin approach and the Hunter and Schmidt approach, in the aspects of meta-analytic methodology. The basic methodological assumptions and characteristics between the two approaches were also discussed in terms of the analytic techniques, methodological procedures, and interpretations of the results. In addition, the two meta-analyses of the theory of planned behavior, one of the major social cognitive theories, were conducted. Based on the results, Fisher’s z-transformation, effect size estimation, heterogeneity assessment, correction for sampling error and measurement error, and confidence interval and creditability interval were discussed.
Statistics
-
962 Viewed
-
428 Downloaded
Tools
Issue List
Citation status
* References for papers published after 2023 are currently being built.
[journal]
김성태
/ 2005
/
A meta analysis of content analysis research in Korea: Focusing on methodological elements for better content analysis research
/ 커뮤니케이션 이론
/ 한국언론학회
1(2)
: 39~67
[journal]
김세경
/ 2015
/
Meta-Analysis on Variables Related to Self-Control: Focused on family environment and psychological factors
/ 한국심리학회지: 상담 및 심리치료
/ 한국상담심리학회
27(1)
: 85~107
[journal]
박형인
/ 2011
/
Relationships of Burnout with Job Attitudes and Turnover Intention among Koreans: A Meta-Analysis
/ 한국심리학회지: 산업 및 조직
/ 한국산업및조직심리학회
24(3)
: 457~491
[journal]
손영곤
/ 2014
/
A Study on the Advertising Effects of Celebrity Endorser in Korea: A Meta-analytic Review
/ 한국광고홍보학보
/ 한국광고홍보학회
16(2)
: 183~220
[journal]
손영곤
/ 2012
/
An Efficacy of Social Cognitive Behavior Model based on the Theory of Planned Behavior: A Meta-Analytic Review
/ 한국언론학보
/ 한국언론학회
56(6)
: 127~161
[journal]
신인수
/ 2011
/
Review of the Meta-Analysis Research in Special Education and Related Field
/ 지체.중복.건강장애연구
/ 한국지체.중복.건강장애교육학회
54(4)
: 157~176
[book]
오성삼
/ 2002
/ 메타분석의 이론과 실제
/ 건국대학교 출판부
[journal]
오인수
/ 2007
/
Relationships among Job Satisfaction, Organizational Commitment, Job Performance, and Turnover Intention: A Literature Review and Meta-Analysis with Korean Samples
/ 인사조직연구
/ 한국인사조직학회
15(4)
: 43~86
[journal]
우형진
/ 2005
/
A Productive Investigation of Korean Internet Studies: A Meta-Analysis of Internet Studies in Korean Communication Journals during 1995~2005
/ 커뮤니케이션 이론
/ 한국언론학회
1(1)
: 332~366
[journal]
유성경
/ 2014
/
Meta-Analytic Review on the relationship between Meaning in Life and Mental Health (Mainly of domestic studies between 1996-2013)
/ 한국심리학회지:일반
/ 한국심리학회
33(2)
: 441~465
[thesis]
류대열
/ 2009
/ 조직공정성과 직무만족간 관계 및 조절 변수에 관한 메타분석
/ 석사
/ 성균관대학교 대학원
[journal]
이병관
/ 2013
/
A Research Synthesis of Fear Appeal Studies over the Past 40 Years A Meta-Analysis of Fear Appeals in Korea
/ 한국광고홍보학보
/ 한국광고홍보학회
15(3)
: 126~155
[journal]
이병관
/ 2014
/
An Efficacy of Social Cognitive Theory to Predict Health Behavior A Meta-Analysis on the Health Belief Model Studies in Korea
/ 홍보학연구
/ 한국PR학회
18(2)
: 163~206
[journal]
이준영
/ 2008
/
Meta-analysis
/ Endocrinology and Metabolism
/ 대한내분비학회
23(6)
: 361~378
[journal]
전근영
/ 2015
/
A Meta-Analysis of Humor in Advertising in Korea
/ 한국언론학보
/ 한국언론학회
59(6)
: 477~504
[book]
정의철
/ 2013
/ 헬스커뮤니케이션
/ 커뮤니케이션북스
[journal]
조경호
/ 1998
/ Hunter의 메타방법론을 적용한 조직몰입과 직무만족간의 상관관계 분석
/ 한국행정학보
32(2)
: 147~164
[journal]
조용래
/ 2014
/
The Effect of Mindfulness-Based Intervention on Depression and Anxiety Symptoms: A Meta-Analysis
/ 한국심리학회지:일반
/ 한국심리학회
33(4)
: 903~928
[journal]
최한나
/ 2015
/
The Relationship between Working Alliance and Counseling Outcome: A Meta-Analytic Review(1990-2014)
/ 상담학연구
/ 한국상담학회
16(3)
: 85~99
[report]
한국보건사회연구원
/ 2013
/ 한국의 건강불평등 지표와 정책 과제
/ 한국보건사회연구원
[other]
한국보건의료연구원
/ 2011
/ NECA 체계적 문헌고찰 매뉴얼
/ 한국보건의료연구원
[journal]
허만용
/ 2008
/
The Correlation between Market Orientation and Organizational Performance applied Meta-Analysis of Hunter & Schmidt: The Moderating Effect of Goal and Culture
/ 한국정책과학학회보
/ 한국정책과학학회
12(1)
: 45~70
[journal]
홍세정
/ 2015
/
A Meta-Analysis on the Relationship between Intrinsic Motivation and Creativity
/ 한국심리학회지:일반
/ 한국심리학회
34(1)
: 57~86
[journal]
황상재
/ 2004
/
Meta analysis on internet research in the field of mass communication
/ 한국방송학보
/ 한국방송학회
18(2)
: 68~92
[journal]
황용석
/ 2006
/
Research Topics and Methodological Orientations in the Studies of Korean Online Journalism: A Meta-analysis
/ 커뮤니케이션 이론
/ 한국언론학회
2(1)
: 128~169
[journal]
Aguinis, H.
/ 2008
/ Comparison of three meta-analytic procedures for estimating moderating effects of categorical variables
/ Organizational Research Methods
11(1)
: 9~34
[book]
Ajzen, I.
/ 1985
/ From intentions to actions: A theory of planned behavior
/ Springer Berlin Heidelberg
: 11~39
[journal]
Ajzen, I.
/ 2002
/ Perceived behavioral control, self-efficacy, locus of control, and the theory of planned behavior
/ Journal of Applied Social Psychology
32
: 665~683
[web]
Ajzen, I.
/ 2006
/ Constructing a TpB questionnaire: Conceptual and methodological considerations
/ http://people.umass.edu/aizen/pdf/tpb.measurement.pdf
[book]
Ajzen, I.
/ 1980
/ Understanding attitudes and predicting social behavior
/ Prentice Hall
[journal]
Alexander, R. A.
/ 1984
/ Correcting for range restriction when the population variance is unknown
/ Applied psychological measurement
8(4)
: 431~437
[journal]
Aloe, A. M.
/ 2012
/ An effect size for regression predictors in meta-analysis
/ Journal of Educational and Behavioral Statistics
37(2)
: 278~297
[journal]
Armitage, C. J.
/ 2001
/ Efficacy of the theory of planned behavior: A meta-analytic review
/ British Journal of Social Psychology
40
: 471~499
[book]
Becker, B. J.
/ 2005
/ Publication bias in meta-analysis: Prevention, assessment and adjustments
/ John Wiley & Sons
[book]
Borenstein, M.
/ 2005
/ Publication bias in meta-analysis: Prevention, assessment and adjustment
/ John Wiley & Sons
: 194~220
[book]
Borenstein, M.
/ 2009
/ Introduction to meta-analysis
/ John Wiley & Sons
[journal]
Borenstein, M.
/ 2010
/ A basic introduction to fixed effect and random effects models for meta-analysis
/ Research Synthesis Methods
1
: 97~111
[journal]
Callender, J. C.
/ 1980
/ Development and test of a new model for validity generalization
/ Journal of Applied Psychology
65(5)
: 543~558
[journal]
Charles, E. P.
/ 2005
/ The correction for attenuation due to measurement error: Clarifying concepts and creating confidence sets
/ Psychological methods
10(2)
: 206~226
[book]
Cheung, M. W. L.
/ 2015
/ Meta-analysis: A Structural equation modeling approach
/ John Wiley & Sons, Ltd
[journal]
Cohen, A. C.
/ 1959
/ Simplified estimators for the normal distribution when samples are singly censored or truncated
/ Technometrics
1(3)
: 217~237
[book]
Cohen, J.
/ 1988
/ Statistical power analysis for the behavioral sciences
/ Lawrence Erlbaum Associates
[book]
Conner, M.
/ 2001
/ Predicting health behavior
/ Open University Press
: 1~22
[book]
Cooper, H.
/ 2010
/ Research synthesis and meta-analysis: A step-by-step approach
/ Sage
[book]
Cooper, H.
/ 2009
/ The handbook of research synthesis and meta-analysis
/ Russell Sage Foundation
[journal]
Duval, S.
/ 2000
/ Trim and fill: A simple funnel plot based method of testing and adjusting for publication bias in meta-analysis
/ Biometrics
56
: 455~463
[book]
Egger, M.
/ 2003
/ Systematic reviews in health care: Meta-analysis in context
/ BMJ Books
[journal]
Egger, M.
/ 1997
/ Meta-analysis: Principles and procedures
/ BMJ
315
: 1533~1537
[journal]
Egger, M.
/ 1997
/ Bias in meta-analysis detected by a simple, graphical test
/ BMJ
315
: 629~634
[journal]
Ferguson, C. J.
/ 2012
/ Publication bias in psychological science: Prevalence, methods for identifying and controlling, and implications for the use of meta-analyses
/ Psychological Methods
17(1)
: 120~128
[journal]
Field, A. P.
/ 2001
/ Meta-analysis of correlation coefficients: a Monte Carlo comparison of fixed-and random-effects methods
/ Psychological methods
6(2)
: 161~180
[journal]
Field, A. P.
/ 2010
/ How to do a meta-analysis
/ British Journal of Mathematical and Statistical Psychology
63
: 665~694
[web]
Fletcher, T. D.
/ 2010
/ Psychometric: Applied Psychometric Theory. R package. version 2.2
/ http://CAN.R-project.org/package=psychometric
[journal]
Glass, G. V.
/ 1976
/ Primary, secondary, and meta-analysis of research
/ Educational researcher
5(10)
: 3~8
[journal]
Hall, S. M.
/ 2002
/ Comparison of two random-effects methods of meta-analysis
/ Journal of Applied Psychology
87(2)
: 377~389
[journal]
Hausenblas, H. A.
/ 1997
/ Application of the theories of reasoned action and planned behaviour to exercise behaviour: A meta-analysis
/ Journal of Sport & Exercise Psychology
19
: 36~51
[book]
Hedges, L. V.
/ 1985
/ Statistical methods for meta analysis
/ Academic Press
[journal]
Hunter, J. E.
/ 2000
/ Fixed effects vs. random effects meta-analysis models: Implications for cumulative research knowledge
/ International Journal of Selection and Assessment
8(4)
: 275~292
[book]
Hunter, J. E.
/ 2004
/ Methods of Meta-Analysis: Correcting Error and Bias in Research Findings
/ Sage
[journal]
Hunter, J. E.
/ 2006
/ Implications of direct and indirect range restriction for meta-analysis methods and findings
/ Journal of Applied Psychology
91(3)
: 594~612
[journal]
Johnson, B. T.
/ 1995
/ Comparison of three major meta-analytic approaches
/ Journal of Applied Psychology
80(1)
: 94~106
[journal]
Law, K. S.
/ 1994
/ A test of two refinements in procedures for meta-analysis
/ Journal of Applied Psychology
79(6)
: 978~986
[journal]
Le, H.
/ 2006
/ Correcting for indirect range restriction in meta-analysis: Testing a new meta-analytic procedure
/ Psychological methods
11(4)
: 416~438
[book]
Lipsey, M. W.
/ 2001
/ Practical Meta-Analysis
/ Sage
[book]
Littell, J. H.
/ 2008
/ Systematic reviews and meta-analysis
/ Oxford University Press
[journal]
Muchinsky, P. M.
/ 1996
/ The correction for attenuation
/ Educational and psychological measurement
56(1)
: 63~75
[book]
Nunnally, J. C.
/ 1978
/ Psychometric theory
/ McGraw-Hill
[journal]
Osburn, H. G.
/ 1992
/ A note on the sampling variance of the mean uncorrected correlation in meta-analysis and validity generalization
/ Journal of Applied Psychology
77(2)
: 115~122
[journal]
Peterson, R. A.
/ 2005
/ On the use of beta coefficients in meta-analysis
/ Journal of Applied Psychology
90(1)
: 175~181
[book]
R Development Core Team
/ 2011
/ R: A language and environment for statistical computing
/ R foundation for statistical computing
[journal]
Raju, N. S.
/ 1993
/ What would be if what is wasn't? Rejoinder to Judiesch, Schmidt, and Hunter (1993)
/ Journal of Applied Psychology
78(6)
: 912~916
[journal]
Rosenthal, R.
/ 1979
/ The file drawer problem and tolerance for null results
/ Psychological Bulletin
86
: 638~641
[book]
Rosenthal, R.
/ 1991
/ Meta-analytic procedures for social research
/ Sage Press
[journal]
Rosenthal, R.
/ 2001
/ Meta-Analysis: Recent development in quantitative methods for literature reviews
/ Annual Review of Psychology
52
: 59~82
[book]
Rothstein, H. R.
/ 2005
/ Publication Bias in Meta-Analysis: Prevention, Assessment and Adjustment
/ John Wiley & Sons
: 1~7
[journal]
Saxton, M. L.
/ 2006
/ Meta-analysis in library and information science: Method, history, and recommendations for reporting research
/ Library Trends
55(1)
: 158~170
[journal]
Schmidt, F. L.
/ 1999
/ Comparison of three meta-analysis methods revisited: An analysis of Johnson, Mullen, and Salas (1995)
/ Journal of Applied Psychology
84(1)
: 144~148
[journal]
Schmidt, F. L.
/ 1999
/ Theory testing and measurement error
/ Intelligence
27(3)
: 183~198
[journal]
Schulze, R.
/ 2007
/ Current methods for meta-analysis: Approaches, issues, and developments
/ Journal of Psychology
215(2)
: 90~103
[journal]
Seymour, R. T.
/ 1988
/ Why plaintiffs' counsel challenge tests, and how they can successfully challenge the theory of “validity generalization”
/ Journal of Vocational Behavior
33(3)
: 331~364
[journal]
Spearman, C.
/ 1904
/ The proof and measurement of association between two things
/ The American journal of psychology
15(1)
: 72~101
[report]
Thorndike, R. L.
/ 1947
/ Research problems and techniques
/ U.S. Government Printing Office
[journal]
Vevea, J. L.
/ 2005
/ Publication bias in research synthesis: Sensitivity analysis using a priori weight functions
/ Psychological Methods
10
: 428~443
[journal]
Viechtbauer, W.
/ 2010
/ Conducting meta-analyses in R with the metafor package
/ Journal of Statistical Software
36(3)
: 1~48
[journal]
Viswanath, K.
/ 2006
/ Cancer knowledge and disparities in the information age
/ Journal of Health Communication
11
: 1~17
[journal]
Whitener, E. M.
/ 1990
/ Confusion of confidence intervals and credibility intervals in meta-analysis
/ Journal of Applied Psychology
75(3)
: 315~321
[book]
Wolf, F.
/ 1986
/ Meta-Analysis: Quantitative methods for research synthesis
/ Sage
[journal]
Zhu, C.
/ 2015
/ Longitudinal analysis of meta-analysis literatures in the database of ISI Web of Science
/ International journal of clinical and experimental medicine
8(3)
: 35~59
This paper was written with support from the National Research Foundation of Korea.