Journal of the Korean academy of pediatric dentistry 2025 KCI Impact Factor : 0.43
-
pISSN : 1226-8496 / eISSN : 2288-3819
- https://journal.kci.go.kr/jkapd
KJCKorea
Journal Central
Review on Problems with Null Hypothesis Significance Testing in Dental Research and Its Alternatives
- Journal of the Korean academy of pediatric dentistry
- Abbr : J Korean Acad Pediatr Dent
- 2013, 40(3), pp.223~232
- DOI : 10.5933/JKAPD.2013.40.3.223
- Publisher : The Korean Academy Of Pediatric Dentistry
- Research Area : Medicine and Pharmacy > Dentistry
1원광대학교
Accredited
ABSTRACT
There are many problems in evaluating study results by p value in null hypothesis testing for dental research.
It is a logical fallacy to conclude that the null hypothesis is true when the it is not rejected. There are much serious misunderstanding about p value, and researchers should be cautious about interpreting p value in writing papers. As alternatives to complement or replace the null hypothesis significance testing, effect size, confidence interval, and Bayesian statistics are introduced.
KEYWORDS
Journal Copyright Policy
This license enables reusers to distribute, remix, adapt, and build upon the material in any medium or format for noncommercial purposes only, and only so long as attribution is given to the creator.
Statistics
-
1,453 Viewed
-
865 Downloaded
Tools
Issue List
Citation status
* References for papers published after 2025 are currently being built.
[web]
Seaman JE
/ Not significant, but Important? Know the pitfalls of p-values and formal hypothesis tests
/ http://asq.org/quality-progress/2011/08/statistics-roundtable/not-significant-butimportant.html
[web]
Matrixx Initiatives
/ Siracusano
/ http://en.wikipedia.org/wiki/Matrixx_Initiatives,_Inc._v._Siracusano
[journal]
Meehl PE
/ 1967
/ Theory-testing in psychology and physics: a methodological paradox
/ Philosophy Sci
34
: 103~115
[journal]
Meehl PE
/ 1978
/ Theoretical risks and tabular asterisks: sir Karl, sir Ronald, and the slow progress of soft psychology
/ J Consult Clin Psychol
46
: 806~834
[journal]
Cohen J
/ 1994
/ The earth is round
/ Am Psychol
49
: 997~1003
[book]
Schmidt FL
/ 1997
/ Eight common but false objections to the discontinuation of significance testing in the analysis of research data, In What if there were no significance tests?
/ Lawrence Erlbaum Associates
: 37~64
[web]
NHST problems
/ NHST problems
/ URL:http://www.faculty.biol.ttu.edu/strauss/stats/LectureNotes/20_NHSTProblems.pdf
[web]
Fallacy of affirming the consequent
/ Fallacy of affirming the consequent
/ http://terms.naver.com/entry.nhn?cid=1137&docId=275047&mobile&categoryId=1137
[journal]
Pollard P
/ 1987
/ On the probability of making type I errors
/ Psychol Bull
102
: 159~163
[journal]
Reese HW
/ 1999
/ Problems of statistical inference
/ Mex J Behav Anal
25
: 39~68
[journal]
Goodman S
/ 2008
/ A dirty dozen: twelve p-value misconceptions
/ Semin Hematol
45
: 135~140
[journal]
Hubbard R
/ 2008
/ Why p values are not a useful measure of evidence in statistical significance sesting
/ Theory Psychol
18
: 69~88
[journal]
Sterne JAC
/ 2001
/ Sifting the evidence - what’s wrong with significance tests?
/ BMJ(Clin res)
322
: 226~231
[journal]
Johnson, DH
/ 1999
/ The insignificance of statistical significance testing
/ J Wildlife Manag
63
: 763~772
[journal]
Nurminen M
/ 1997
/ Statistical significance - a misconstrued notion in medical research
/ Scand J Work Environ Health
23
: 232~235
[journal]
Schervish MJ
/ 1996
/ P values: what they are and what they are not
/ Am Stat
50
: 203~206
[journal]
Carver RP
/ 1978
/ The case against statistical significance testing
/ Harvard Educat Review
48
: 378~399
[journal]
Nickerson RS
/ 2000
/ Null hypothesis statistical testing: a review of an old and continuing controversy
/ Psychol Methods
5
: 241~301
[journal]
Berger JO
/ 1987
/ Testing a point null hypothesis: the irreconcilability of p values and evidence (with comments)
/ J Am Stat Assoc
82
: 112~139
[journal]
Berger JO
/ 1987
/ Testing precise hypotheses (with comments)
/ Stat Science
2
: 317~352
[journal]
Nester MR
/ 1996
/ An applied statistician’s creed
/ Statistician
45
: 401~410
[journal]
Berger JO
/ 1988
/ Statistical analysis and the illusion of objectivity
/ Am Scientist
76
: 159~165
[journal]
Hubbard, R
/ 2004
/ Alphabet soup: blurring the distinctions between p’s and α’s in psychological research
/ Theory Psychol
14
: 295~327
[journal]
Sellke T
/ 2001
/ Calibration of p values for testing precise null hypotheses
/ Am Statistician
55
: 62~71
[journal]
Gelman A
/ 2006
/ The difference between ‘significant’and ‘not significant’is not itself statistically significant
/ Am Statistician
60
: 328~331
[web]
International committee of medical journal editors
/ Uniform requirements for manuscripts submitted to biomedical journals
/ http://www.icmje.org/manuscript_1prepare.html
[journal]
Royall RM
/ 1986
/ The effect of sample size on the meaning of significance tests
/ Am Statistician
40
: 313~315
[journal]
Hand DJ
/ 1998
/ Data mining: statistics and more?
/ Am Statistician
52
: 112~118
[book]
Fisher RA
/ 1966
/ The design of experiments
/ Oliver & Boyd
[book]
Fisher BJ
/ 1978
/ R.A. Fisher: The life of a scientist
/ Wiley
[web]
Denis DJ
/ Alternatives to null hypothesis significance testing. Theory & Science
/ http://theoryandscience.icaap.org/content/vol4.1/02_denis.html
[journal]
Rosenthal R
/ 1992
/ Effect size estimation, significance testing, and the file-drawer problem
/ J Parapsychol
56
: 57~58
[journal]
Vaughan GM
/ 1969
/ Beyond tests of significance: Estimating strength of effects in selected ANOVA designs
/ Psychol Bulletin
72
: 204~213
[journal]
Silva-Aycaguer LC
/ 2010
/ Null hypothesis significance test in health sciences research (1995-2006): statistical analysis and interpretation
/ BMC Med Res Methodol
10
: 44~
[journal]
Schmidt FL
/ 1996
/ Statistical significance testing and cumulative knowledge in psychology: implications for training of researchers
/ Psychol Methods
1
: 115~129
[journal]
Cumming G
/ 2005
/ Inference by eye: confidence intervals and how to read pictures of data
/ Am Psychol
60
: 170~180
[journal]
Schenker N
/ 2001
/ On judging the significance of differences by examining the overlap between confidence intervals
/ Am Statistician
55
: 182~186
[journal]
Wang S
/ 2013
/ Mr. Bayes goes to Washington
/ Science
339
: 758~759
[journal]
Efron B
/ 2013
/ Bayes’Theorem in the twenty-first century
/ Science
340
: 1177~1178
[web]
FDA
/ Guidance for the use of Bayesian statistics in medical device clinical trials
/ http://www.fda.gov/medicaldevices/deviceregulationandguidance/guidancedocuments/ucm071072.htm
[journal]
Lilford RJ
/ 1996
/ The statistical basis of public policy: a paradigm shift is overdue
/ Br Med J
313
: 603~607
[journal]
Efron B
/ 1986
/ Why isn’t everyone a Bayesian (with discussion)?
/ Am Statist
40
: 1~11
[journal]
Nurminen M
/ 1987
/ Exact Bayesian analysis of two proportions
/ Scand J Stat
14
: 67~77
[journal]
Diaconis P
/ 1986
/ On the consistency of Bayes estimate (with discussion)
/ Ann Math Stat
14
: 1~67
[journal]
Zhang Y
/ 2011
/ Bayesian latent variable models for spatially correlated toothlevel binary data in caries research
/ Stat Modelling
11
: 25~47
[journal]
Tu YK
/ 2012
/ A Bayesian network meta-analysis on comparisons of enamel matrix derivatives, guided tissue regeneration and their combination therapies
/ J Clin Periodontol
39
: 303~314
[journal]
Frosio I
/ 2013
/ Bayesian denoising in digital radiography: a comparison in the dental field
/ Comput Med Imaging Graph
37
: 28~39
[journal]
Freedman L
/ 1996
/ Bayesian statistical methods. A natural way to assess clinical evidence (editorial)
/ Br Med J
313
: 569~570