Journal of the Korean academy of pediatric dentistry 2023 KCI Impact Factor : 0.48
-
pISSN : 1226-8496 / eISSN : 2288-3819
- https://journal.kci.go.kr/jkapd
KJCKorea
Journal Central
Review on Problems with Null Hypothesis Significance Testing in Dental Research and Its Alternatives
- Journal of the Korean academy of pediatric dentistry
- Abbr : J Korean Acad Pediatr Dent
- 2013, 40(3), pp.223-232
- DOI : 10.5933/JKAPD.2013.40.3.223
- Publisher : The Korean Academy Of Pediatric Dentistry
- Research Area : Medicine and Pharmacy > Dentistry
1원광대학교
Accredited
ABSTRACT
There are many problems in evaluating study results by p value in null hypothesis testing for dental research.
It is a logical fallacy to conclude that the null hypothesis is true when the it is not rejected. There are much serious misunderstanding about p value, and researchers should be cautious about interpreting p value in writing papers. As alternatives to complement or replace the null hypothesis significance testing, effect size, confidence interval, and Bayesian statistics are introduced.
Statistics
-
798 Viewed
-
216 Downloaded
Tools
Issue List
Citation status
* References for papers published after 2023 are currently being built.
[web]
Seaman JE
/ Not significant, but Important? Know the pitfalls of p-values and formal hypothesis tests
/ http://asq.org/quality-progress/2011/08/statistics-roundtable/not-significant-butimportant.html
[web]
Matrixx Initiatives
/ Siracusano
/ http://en.wikipedia.org/wiki/Matrixx_Initiatives,_Inc._v._Siracusano
[journal]
Meehl PE
/ 1967
/ Theory-testing in psychology and physics: a methodological paradox
/ Philosophy Sci
34
: 103~115
[journal]
Meehl PE
/ 1978
/ Theoretical risks and tabular asterisks: sir Karl, sir Ronald, and the slow progress of soft psychology
/ J Consult Clin Psychol
46
: 806~834
[journal]
Cohen J
/ 1994
/ The earth is round
/ Am Psychol
49
: 997~1003
[book]
Schmidt FL
/ 1997
/ Eight common but false objections to the discontinuation of significance testing in the analysis of research data, In What if there were no significance tests?
/ Lawrence Erlbaum Associates
: 37~64
[web]
NHST problems
/ NHST problems
/ URL:http://www.faculty.biol.ttu.edu/strauss/stats/LectureNotes/20_NHSTProblems.pdf
[web]
Fallacy of affirming the consequent
/ Fallacy of affirming the consequent
/ http://terms.naver.com/entry.nhn?cid=1137&docId=275047&mobile&categoryId=1137
[journal]
Pollard P
/ 1987
/ On the probability of making type I errors
/ Psychol Bull
102
: 159~163
[journal]
Reese HW
/ 1999
/ Problems of statistical inference
/ Mex J Behav Anal
25
: 39~68
[journal]
Goodman S
/ 2008
/ A dirty dozen: twelve p-value misconceptions
/ Semin Hematol
45
: 135~140
[journal]
Hubbard R
/ 2008
/ Why p values are not a useful measure of evidence in statistical significance sesting
/ Theory Psychol
18
: 69~88
[journal]
Sterne JAC
/ 2001
/ Sifting the evidence - what’s wrong with significance tests?
/ BMJ(Clin res)
322
: 226~231
[journal]
Johnson, DH
/ 1999
/ The insignificance of statistical significance testing
/ J Wildlife Manag
63
: 763~772
[journal]
Nurminen M
/ 1997
/ Statistical significance - a misconstrued notion in medical research
/ Scand J Work Environ Health
23
: 232~235
[journal]
Schervish MJ
/ 1996
/ P values: what they are and what they are not
/ Am Stat
50
: 203~206
[journal]
Carver RP
/ 1978
/ The case against statistical significance testing
/ Harvard Educat Review
48
: 378~399
[journal]
Nickerson RS
/ 2000
/ Null hypothesis statistical testing: a review of an old and continuing controversy
/ Psychol Methods
5
: 241~301
[journal]
Berger JO
/ 1987
/ Testing a point null hypothesis: the irreconcilability of p values and evidence (with comments)
/ J Am Stat Assoc
82
: 112~139
[journal]
Berger JO
/ 1987
/ Testing precise hypotheses (with comments)
/ Stat Science
2
: 317~352
[journal]
Nester MR
/ 1996
/ An applied statistician’s creed
/ Statistician
45
: 401~410
[journal]
Berger JO
/ 1988
/ Statistical analysis and the illusion of objectivity
/ Am Scientist
76
: 159~165
[journal]
Hubbard, R
/ 2004
/ Alphabet soup: blurring the distinctions between p’s and α’s in psychological research
/ Theory Psychol
14
: 295~327
[journal]
Sellke T
/ 2001
/ Calibration of p values for testing precise null hypotheses
/ Am Statistician
55
: 62~71
[journal]
Gelman A
/ 2006
/ The difference between ‘significant’and ‘not significant’is not itself statistically significant
/ Am Statistician
60
: 328~331
[web]
International committee of medical journal editors
/ Uniform requirements for manuscripts submitted to biomedical journals
/ http://www.icmje.org/manuscript_1prepare.html
[journal]
Royall RM
/ 1986
/ The effect of sample size on the meaning of significance tests
/ Am Statistician
40
: 313~315
[journal]
Hand DJ
/ 1998
/ Data mining: statistics and more?
/ Am Statistician
52
: 112~118
[book]
Fisher RA
/ 1966
/ The design of experiments
/ Oliver & Boyd
[book]
Fisher BJ
/ 1978
/ R.A. Fisher: The life of a scientist
/ Wiley
[web]
Denis DJ
/ Alternatives to null hypothesis significance testing. Theory & Science
/ http://theoryandscience.icaap.org/content/vol4.1/02_denis.html
[journal]
Rosenthal R
/ 1992
/ Effect size estimation, significance testing, and the file-drawer problem
/ J Parapsychol
56
: 57~58
[journal]
Vaughan GM
/ 1969
/ Beyond tests of significance: Estimating strength of effects in selected ANOVA designs
/ Psychol Bulletin
72
: 204~213
[journal]
Silva-Aycaguer LC
/ 2010
/ Null hypothesis significance test in health sciences research (1995-2006): statistical analysis and interpretation
/ BMC Med Res Methodol
10
: 44~
[journal]
Schmidt FL
/ 1996
/ Statistical significance testing and cumulative knowledge in psychology: implications for training of researchers
/ Psychol Methods
1
: 115~129
[journal]
Cumming G
/ 2005
/ Inference by eye: confidence intervals and how to read pictures of data
/ Am Psychol
60
: 170~180
[journal]
Schenker N
/ 2001
/ On judging the significance of differences by examining the overlap between confidence intervals
/ Am Statistician
55
: 182~186
[journal]
Wang S
/ 2013
/ Mr. Bayes goes to Washington
/ Science
339
: 758~759
[journal]
Efron B
/ 2013
/ Bayes’Theorem in the twenty-first century
/ Science
340
: 1177~1178
[web]
FDA
/ Guidance for the use of Bayesian statistics in medical device clinical trials
/ http://www.fda.gov/medicaldevices/deviceregulationandguidance/guidancedocuments/ucm071072.htm
[journal]
Lilford RJ
/ 1996
/ The statistical basis of public policy: a paradigm shift is overdue
/ Br Med J
313
: 603~607
[journal]
Efron B
/ 1986
/ Why isn’t everyone a Bayesian (with discussion)?
/ Am Statist
40
: 1~11
[journal]
Nurminen M
/ 1987
/ Exact Bayesian analysis of two proportions
/ Scand J Stat
14
: 67~77
[journal]
Diaconis P
/ 1986
/ On the consistency of Bayes estimate (with discussion)
/ Ann Math Stat
14
: 1~67
[journal]
Zhang Y
/ 2011
/ Bayesian latent variable models for spatially correlated toothlevel binary data in caries research
/ Stat Modelling
11
: 25~47
[journal]
Tu YK
/ 2012
/ A Bayesian network meta-analysis on comparisons of enamel matrix derivatives, guided tissue regeneration and their combination therapies
/ J Clin Periodontol
39
: 303~314
[journal]
Frosio I
/ 2013
/ Bayesian denoising in digital radiography: a comparison in the dental field
/ Comput Med Imaging Graph
37
: 28~39
[journal]
Freedman L
/ 1996
/ Bayesian statistical methods. A natural way to assess clinical evidence (editorial)
/ Br Med J
313
: 569~570