This study aims to confirm the educational necessity and utilization of VR media. And it was conducted to prepare basic data necessary for the use of VR in various dental hygiene education in the future and the development of innovative practical training courses.
Methods:
Before and after using VR in oral radiology practice classes, learning interest (4 items), learning commitment (9 items), learning motivation (5 items), educational media preference (4 items), and satisfaction (10 items) were investigated and analyzed. Friedman two way ANOVA by ran a nonparametric analysis corresponding to repeated measures ANOVA was performed. The statistical significance level was 0.05.
Results :
It was found that there were statistically significant differences in learning interest, learning immersion, and learning motivation according to the type of oral radiology practice education medium (p<0.05).
Conclusions:
VR is expected that the use of learning media using VR will lead to students’ interest, immersion, and learning motivation in class, and that positive learning effects on VR education media can be sufficiently obtained.
연구목적:
연구에서는 치위생학과 학생들을 대상으로 구강영상학실습 수업에 VR교육 매체를 활용하여 구강영상학실습 수업에서의 VR활용에 대한 가능성과 VR활용을 통한 학생들의 학습흥미도, 학습몰입도, 학습동기 등을 중심으로 그 효과성을 확인해 보면서 향후 다양한 치위생 수업에서의 VR활용과 혁신적인 실습 교육과정 개발에 필요한 기초자료를 제공하고자 하였다.
연구방법:
2020년 2학년 2학기 동안 구강영상학 및 실습 교과목을 수강한 학생을 대상으로 연구의 목적과 방법을 기재한 설명문과 동의서를 안내하고 이에 동의하고 서명한 수강생만을 대상으로 연구를 진행하였다(SM-202010-070-2). 연구 참여에 비동의 하거나 불성실하게 응답한 학생을 제외한 39명을 대상으로 최종 분석하였다. 정규성 분포를 만족하지 못하고(p>0.05), 시간의 흐름에 따른 교육처치에 대한 상호간의 영향력을 배제할 수 없어 반복측정 분산분석(Repeated Measures ANOVA)에 상응하는 비모수 분석인 프리드만 검정 분석(Friedman two way ANOVA by ran)을 시행하였다. 통계적 유의수준은 p<0.05이었다.
연구결과:
구강영상학실습 교육매체 종류에 따라 학습흥미도, 학습몰입도, 학습동기 모두 통계적으로 유의한 차이가 있는 것으로 나타났다(p<0.05). 학습흥미도에서는 VR장비 1차사용에서, 학습몰입도와 학습동기에서는 X-ray 장비사용 후에 가장 높은 인식도를 보였다.
결론:
VR 교육매체의 활용은 구강영상학실습 수업과정에서 학생들의 수업의 흥미도, 몰입도, 학습동기 등을 이끌어 낼 수 있다고 판단되며, 비대면 실습수업, 대면 실습수업에서 전통적인 X-ray장비와 더불어 VR 교육매체를 함께 활용한다면 구강영상학실습 학습의 긍정적인 효과를 충분히 얻을 수 있을 것으로 기대한다
Virtual reality (VR) is a specific environment or scenario that is similar to reality or refers to the technology itself, created by humans using artificial technology and computers. The virtual environments and scenarios stimulate the user’s five senses and enable interaction [1]. Recently, the development and application of VR media for education have attracted significant interest of researchers [2]. During the COVID-19 pandemic, classrooms rapidly transitioned to the online environment. Consequently, pressure on educational institutions for online delivery has increased [3,4], leading to increased interest in VR technology [5]. Additionally, there was a significant demand for the development of educational platforms using VR that enable anyone to easily participate and work in the non-face-to-face environment [6]. VR media enables users to interact with other users in various forms [7], which is why it is used for various purposes [8,9]. In education, the visualization, interaction, and control characteristics of VR are used in many ways, enabling individualized learning, collaboration, and problem-solving learning [10,11]. Additionally, VR is increasingly used as educational media in dentistry and dental hygiene. In dentistry education, VR technology is used to support clinical practice education by developing various clinical situations and problems for indirect experience to overcome the limitations of existing practice education for tooth extraction [12]. Moreover, VR learning environments have been developed for non-face-to-face dental clinical practice [13], and VR is also used to create environments that allow users to communicate with patients as prospective dentists and simulate oral healthcare activities [14].
In dental hygiene, studies have used VR media for learning periodontal instruments used in state examination practical tests to assess the effects of self-practice in the non-face-to-face environment [15]. Additionally, as part of the professional University inovation support project, a total of eight professional colleges for dental hygiene are jointly developing VR-based oral anatomy contents for changes in the college education environment post-COVID-19 [16]. The education environment of dentistry and dental hygiene has undergone changes with time and circumstances, and studies have reported the benefits of VR in education [17,18]. However, there is still a lack of studies on VR for dental hygiene education. In particular, in dental hygiene, VR is mostly used for only basic academic topics such as anatomy [19].
Therefore, the purpose of this study was to use VR educational media in oral imaging practice class for dental hygiene students and evaluate the learning interest, learning commitment, and learning motivation of the students to provide basic data necessary for the potential use of VR in various dental hygiene classes and development of innovative practical training courses in the future.
Methods1. Participants
This study was approved by the Institutional Review Board (IRB) of 00 University (IRB No: SM-202010-070-2). The participants of this study were second-year students in the second semester of 2020 who registered for oral imaging and practical courses. The purpose and method of this study were explained to the students, and only those who provided a written consent were included in the study. A total of 42 second-year students registered for the class, and 39 students, excluding those who did not agree to participate or did not complete the consent form, were included in the final analysis.
2. Methods1) VR application in oral imaging practice class
The oral imaging practice class aimed to help students learn imaging techniques and understand the basic practice necessary for oral radiography as well as principles, imaging, and development of oral radiography. The class focused on student-centered activities to help the students develop photos and learn from mistakes during intra- and extra-oral radiography. The class was an elective major (3 credits) and comprised both online and offline lectures. Theory and practice were taught separately. VR educational media was only used in oral imaging practice class during weeks 11 and 12 after the midterm exams. <Table 1> shows the progress of the class at the time of this research.
VR equipment utilization plan and contents in oral radiology practice class
Week
Category
Content
Note
9
Localization techniques
Basic concepts of localization techniques
Basic concepts of localization techniques
10
Panoramic imaging, digital imaging
1. Basic concepts of panoramic imaging
Basic concepts of panoramic imaging & X-ray imaging practice
2. Describe the purpose and use of digital imaging
11
Extraoral imaging
Basic concepts of extraoral imaging
Extraoral imaging & 1st VR practice
12
Image interpretation basics
Image interpretation basics - interpretation of dental caries - interpretation of periodontal disease
mage interpretation basics & 2nd VR practice
2) VR educational media device
A dental radiography simulator (Rs_Dental) by VRAD was used for VR educational media in this study. The virtual reality-based radiography simulation provided an environment where the students could practice imaging in VR without being exposed to radiation <Fig. 1>.
VR device used in oral radiology practice class and its application
3) Research tools
A research tool with verified reliability and validity in a previous study [20] was modified and supplemented for use in this study. The questionnaire items evaluated general characteristics (6 items), learning interest (4 items), learning commitment (9 items), learning motivation (5 items), educational media preference (4 items), and learning satisfaction (10 items). The items were self-administered and evaluated on a 5-point Likert scale from 1 to 5. Cronbach’s α for learning interest, learning commitment, learning motivation, and learning satisfaction was 0.897, 0.872, 0.893, and 0.957 respectively.
4) Research questionnaire progress flow
The questionnaire was completed a total of four times by the participants: before the oral imaging practice class; after traditional X-ray device practice; and after practice using VR educational media device <Fig. 2>. The same items of the questionnaire were used every time.
Time of study survey
3. Data analysis
IBM SPSS program (ver. 25.0; IBM Corp., Armonk, NY, USA) was used for statistical analysis. Descriptive statistics were performed to calculate the frequency, percentage, mean, and standard deviation. The Kolmogorov–Smirnov analysis was performed for normality testing of the sample size. As normal distribution was not satisfied (p>0.05), a non-parametric analysis was conducted. As differences before practice and between the media were variables with a continuous flow of time, Friedman two-way ANOVA by ran was performed for non-parametric analysis of repeated measures ANOVA. Subsequently, the non-parametric post-hoc test was performed, and the Bonferroni correction was applied for analysis. Differences in learning interest, learning commitment, and learning motivation by general information of the participants between the two groups after the end of the final oral imaging practice were analyzed through the Mann–Whitney analysis. The Spearman correction test was conducted for the correlation between VR education satisfaction and learning interest, learning commitment, and learning motivation. A p-value less than 0.05 was considered statistically significant.
Results1. General characteristics of study participants
<Table 2> shows the general information of the study participants. Approximately 82.1% of the participants did not have experience of dental hygiene clinical practice, and 87.2% did not have experience of using dental radiology equipment. Approximately 57.9% of the participants had no experience of using VR media devices.
General characteristics of the study subjects
(N=39)
Characteristics
Division
N (%)
Gender
Female
39 (100.0)
Age (yrs)
19
9 ( 23.1)
20
21 ( 53.8)
21
7 ( 17.9)
22
2 ( 5.1)
Grade
2
37 ( 94.9)
3
2 ( 5.1)
Experience in dental hygiene clinical practice
Yes
7 ( 17.9)
No
32 ( 82.1)
Experience of using dental radiation equipment
Yes
5 ( 12.8)
No
34 ( 87.2)
Experience in using VR equipment in various situations
Yes
9 ( 23.1)
No
30 ( 57.9)
2. Differences in learning interest, learning commitment, and learning motivation by oral imaging practice educational medium
<Table 3> shows the results of analysis of the mean differences in learning interest, learning commitment, and learning motivation by oral imaging practice educational medium. There were significant differences in learning interest, learning commitment, and learning motivation by oral imaging practice educational media (p<0.05). Learning interest was the highest after the first use of VR device, and learning commitment and motivation were the highest after using X-ray equipment.
Differences in learning interest, learning immersion, and learning motivation by type of oral radiology practice education
Unit: Mean±SD (N=39)
Division
Types of practice education
p*
Before using the practice
After using X - ray equipment
After the first use of VR equipment
After the second use of VR equipment
Learning interest
4.12 ± 0.59
4.48 ± 0.46
4.50 ± 0.73
4.47 ± 0.59
< 0.001
Learning immersion
3.97 ± 0.56
4.38 ± 0.43
4.26 ± 0.69
4.25 ± 0.56
< 0.001
Learning motivation
4.40 ± 0.49
4.71 ± 0.39
4.43 ± 0.69
4.48 ± 0.61
0.015
*by Bonferroni’s test after Friedman’s test
3. Differences in learning interest, learning commitment, and learning motivation by general information
<Table 4> shows the results of analysis of differences in learning interest, learning commitment, and learning motivation by general information from the participants. The analysis was conducted using the scores at the end of the second VR practical training. For the experience of VR equipment used in various situations, learning interest (4.52 points), learning commitment (4.27 points), and learning motivation (4.52 points) were high in the inexperienced group; however, there was no statistical significance. Similarly, groups with clinical practice experience and experience using dental radiation equipment showed high learning commitment after VR learning, but the difference was not statistically significant.
Differences in learning interest, learning immersion, and learning motivation by type of oral radiology practice education
Unit: Mean±SD
Division
N (%)
Learning interest
p**
Learning immersion
p**
Learning motivation
p**
Experience in dental hygiene clinical practice*
Yes
7 (17.9)
4.32 ± 0.59
0.340
4.31 ± 0.40
0.900
4.34 ± 0.53
0.398
No
32 (82.1)
4.50 ± 0.60
4.23 ± 0.59
4.51 ± 0.63
Experience of using dental radiation equipment*
Yes
5 (12.8)
4.30 ± 0.67
0.500
4.48 ± 0.49
0.356
4.32 ± 0.64
0.554
No
34 (87.2)
4.50 ± 0.59
4.21 ± 0.56
4.51 ± 0.61
Experience in using VR equipment in various situations*
Yes
9 (23.1)
4.30 ± 0.48
0.149
4.18 ± 0.39
0.460
4.35 ± 0.54
0.366
No
30 (57.9)
4.52 ± 0.62
4.27 ± 0.60
4.52 ± 0.63
*Learning interest, learning immersion, and learning motivation were analyzed using the survey score after VR 2nd practice
**by Mann-Whitney test
4. Learning satisfaction with VR and educational media preference in oral imaging practice class
<Table 5> shows the results of learning satisfaction with VR practice after class. The item “I actively participated in VR practice” had the highest score (4.51 points), whereas “I recommend using and applying VR in other practical education” had the relatively lowest score (4.21 points). The score for overall learning satisfaction with VR use was 4.31 points.
Satisfaction with learning about VR use in oral radiation practice class
(N=39)
Division
Content
Mean ± SD
Learning satisfaction with VR utilization
I actively participated in VR practice.
4.51 ± 0.85
I am satisfied with the practice class operation method using VR.
4.31 ± 0.97
I recommend using and applying VR in other practical education.
4.21 ± 0.92
I gained confidence through practice using VR.
4.18 ± 0.83
I think the contents of practical training using VR were accurate.
4.33 ± 0.77
I am satisfied with the practice contents using VR.
4.33 ± 0.80
I think the learning goal to be achieved through VR practice has been achieved.
4.33 ± 0.77
I was able to acquire new skills and knowledge through VR practice.
4.46 ± 0.75
I have the ability to perform actual radiography through VR practice.
4.26 ± 0.78
I think VR practice has helped achieve the competency to achieve as a dental hygienist.
4.33 ± 0.73
Total
4.31 ± 0.67
<Table 6> shows the results of analysis of the correlation between learning satisfaction with VR use, learning interest, learning commitment, and learning motivation in an oral imaging practice class. The correlation coefficient for correlation between VR learning satisfaction and learning interest, learning commitment, and learning motivation was rs=0.611, rs=0.666, and rs=0.642, respectively, indicating positive correlations (p<0.01). This showed that learning interest, commitment, and motivation increased significantly as VR learning satisfaction increased.
Correlation between VR use learning satisfaction, learning interest, learning immersion, and learning motivation<sup>*</sup>
(N=39)
Division
VR Learning Satisfaction
Learning interest
Learning immersion
Learning motivation
VR learning satisfaction
1.000
0.611**
0.666**
0.642**
Learning interest
1.000
0.690**
0.757**
Learning immersion
1.000
0.606**
Learning motivation
1.000
*Learning interest, learning immersion, and learning motivation were analyzed using the survey score after VR 2nd practice
**p<0.01, by Spearman correlation coefficient test
<Table 7> shows the preference for oral imaging practice educational media. The participants showed a relatively low preference for theory classes alone, believing that learning satisfaction could be achieved when theory and practice were integrated. Moreover, the participants preferred using only X-ray equipment to using only VR devices. They showed the highest preference for using both X-ray equipment and VR devices as practical educational mediums with a score of 4.44 points.
Preference for practical education media in oral radiology practice classes
(N=39)
Division
Content
Mean ± SD
N (%)
Preference for practical education media
Oral radiology practice can sufficiently achieve learning satisfaction only with theoretical classes.
3.36 ± 1.15
1 ( 2.6)
Oral radiology practice is a practical educational medium that can sufficiently achieve learning satisfaction with practical classes using only X-ray radiography devices.
3.92 ± 0.83
11 (28.2)
Oral radiology practice is a practical educational medium that can sufficiently achieve learning satisfaction through radiography practice classes using only VR devices.
3.62 ± 1.04
1 ( 2.6)
Oral radiography practice is a practical education medium that can sufficiently achieve learning satisfaction through a practical class in which an X-ray radiograph and a VR device are mixed together.
4.44 ± 0.68
26 (66.7)
Discussion
Following the 4th industrial evolution and the COVID-19 pandemic, VR is actively used for various purposes. In particular, there is increasing interest in the use of VR in education. In the context of such social and historical changes, VR is expected to be used even more in dental hygiene education [6-9]. Therefore, this study aimed to use VR in dental imaging practice classes to evaluate students’ perceptions and VR’s educational effects to provide basic data for the possible diverse uses of VR in dental hygiene education.
Herein, we analyzed differences in learning interest, learning commitment, and learning motivation of participants by oral imaging practice educational media and observed positive improvements in learning perception after using practical educational media. Additionally, post-hoc analysis showed significant improvement in learning perception after X-ray device use and second use of VR device compared to that before practical training. This implied that VR could derive educational effects when used in practical training involving the direct participation of students using educational medium and devices suitable for the subject of interest. VR use also led to significant improvements after use. These results show that effective learning can be achieved in learners when an educational media suitable for periodical changes is adequately combined with the learning topic’s characteristics [20]. Shin et al.[21] previously reported that dental hygiene practice often only involves observation despite having many practical contents, and argued that more effective practice methods are needed for improvement. Therefore, VR devices and similar media that enable virtual experiences to supplement the physical practice environment and lack of face-to-face practice may be suitable alternatives.
Virtual spaces and VR are convenient and efficient tools to induce and control learners’ interest by using various educational contents through immediate interaction with instructors and allowing learners to freely experience the learning environment [22]. As shown in <Table 4>, although the difference was insignificant, learners with no experience of clinical practice, X-ray equipment use, and VR device use showed higher overall scores for learning effect perception than those who had the experience. Therefore, learners may have higher learning effects when they have no prior experiences. New VR education content integrating conventional practice methods and the unique characteristics of each subject would enable learners to gain greater learning effects.
Our findings also showed significant correlations between VR learning satisfaction and learning interest, learning commitment, and learning motivation. In a previous study, Gu and Lee [23] analyzed learning interest, learning commitment, and practice satisfaction to verify the development and effectiveness of augmented reality dental radiography simulation. In the group that used the augmented reality simulator, learning interest, learning commitment, and practice satisfaction were higher than in the group that did not use the augmented reality simulator. These results imply that augmented reality-based learning medium promote learning interest [24], inducing learning motivation for active participation in learning activities. In other studies, augmented reality was reported to not only simulate the senses of learners, but also provide an adequate learning environment for learners, significantly increasing learning commitment [25]. Furthermore, Cho and Chung [26] reported an association between learning satisfaction and learning commitment in students to suggest that new teaching designs that can improve learner satisfaction are needed for instructors. As such, previous studies reported findings that were in agreement with our results on learning satisfaction, learning interest, learning commitment, and learning motivation.
Therefore, in using educational media such as VR, instructors need to consider the virtuous cycle of learning and implement new teaching strategies based on a clear understanding of the new medium that can improve learning satisfaction. However, new technologies and devices such as the VR media may also only elicit spontaneous curiosity and preference and fail to promote continuous and in-depth learning interest, commitment, and motivation in learners [20]. Thus, instructors must focus on using VR devices that can enhance learning interest, commitment, and motivation in the learners rather than focusing on conveying the concept of VR. Professional teaching strategies and detailed teaching designs that can reflect the physical characteristics of VR devices as well as the uniqueness of the subject, adequacy of contents, and effectiveness would be necessary. This is consistent with the results in Table 7, which showed that the item “oral imaging practice can achieve sufficient learning satisfaction through practical classes that use a combination of X-ray and VR devices as the educational medium” had the highest response rate. In oral imaging practice class, learners were interested in using new technology such as VR devices, but also showed significantly improved learning interest, learning commitment, and learning motivation after hands-on experiences with traditional X-ray devices such as inserting the films in the oral cavity and controlling the devices for practice. This suggests that VR devices may have more significant outcomes on learning interest, learning commitment, and learning motivation when VR is combined with traditional practice media for complementary effects.
Several limitations must be considered in the interpretation of this study’s findings. As this case study targeted dental hygiene students of certain regions, the findings cannot be generalized. Moreover, this study did not provide evidence for the validity and effectiveness of the VR device. During the study, interactions over the study period could not be excluded, and thus, the mutual interaction between the results cannot be differentiated. Additionally, the VR device was not applied with a systematic teaching design during the entire semester. Instead, VR was only used for a short-term of two weeks. Therefore, it is difficult to predict changes in the reaction and perception of students after long-term use. The learning effects were also not based on objective academic achievement, but rather focused on subjective changes in perception. In future studies, such limitations must be complemented. However, this study is meaningful as it observed the potential use of VR devices in oral imaging practice classes when there is a lack of studies on VR device used in dental hygiene education. This study also provided basic data for the implementation of VR content in future dental hygiene education.
Conclusions
This study used VR educational media in oral imaging practice classes for dental hygiene students and evaluated changes in learning interest, learning commitment, and learning motivation. Additionally, it aimed to provide basic data for the application of VR educational media in dental hygiene education and obtained the following results.
1. VR media use in oral imaging practice class induced positive changes in learning interest, learning commitment, and learning motivation of students. There were significant improvements in the scores of learning interest, learning commitment, and learning motivation after using VR educational media (p>0.05).
2. In oral imaging practice class, the correlation coefficients between VR learning satisfaction and learning interest, learning commitment, and learning motivation were rs=0.611, rs=0.666, and rs=0.642, respectively. As VR learning satisfaction increased, learning interest, learning commitment, and learning motivation also significantly increased (p<0.01).
3. The students’ preference for oral imaging practice educational media was as follows: they did not prefer theory classes alone. Instead, they showed the highest level of preference for integrating X-ray and VR devices for practical educational media with a score of 4.44 points.
Based on these findings, VR educational media can promote learning interest, commitment, and motivation in students in oral imaging practice classes. VR educational media integrated with X-ray devices in mixed face-to-face and non-face-to-face settings would help to achieve positive effects of oral imaging practice learning.
Conflicts of Interest The authors declared no conflicts of interest.
Authorship Conceptualization: YK Choi, KO Lim; Data collection: KO Lim; Formal analysis: YK Choi; Writing - original draft: YK Choi, KO Lim; Writing - review & editing: YK Choi, KO Lim
ShinJMChoiDSKimSYJinKBA study on efficiency of the experience oriented self - directed learning in the VR vocational training contentsJ Knowledge Info Tech & Sys2019141718010.34163/jkits.2019.14.1.008LeeHSJungYHKimSYAn analysis on domestic research trends of VR and its educational utilization through text mining techniquesJ Learner-Centered Curr & Inst2019191831133810.22251/jlcci.2019.19.18.311ShinGHMinKHKimYHDevelopment of realistic contents for singing learning based on VRJ Music Educ Sci202147213810.30832/JMES.2021.47.21ChoiYKKimEJSonJHCase study of online learning class caused by COVID-19 - clinical dental hygiene practice, focusing on periodontal instrumentationJ Next-generation Conv Tech Assoc20204663965210.33097/JNCTA.2020.04.06.639NohYHKangPSKimYJStudy on the activation measures of library’s online services to overcome COVID - 19J Korean Lib & Info Sci Soc202051418521010.16981/kliss.51.4.202012.185LeeTEA study on the development of online VR experience contents in the post - corona era - focusing on 3D asset basis using the traditional cultural resources -JCD202177553562ParkSBYoonSHA study on the user evaluation for media form of virtual environmentKorean Inst Inte Desi J2008175166174KangYSLeeGYThe effect of a virtual reality based exercise program utilizing video game on health - related physical activity and physical activity level in adults with developmental disabilityJ Adap Physical Activity & Exercise2015234152910.17006/kjapa.2015.23.4.15YangNYParkHSYoonTHMoonJHEffectiveness of motion - based virtual reality training on cognitive function and activities of daily living in patients with strokeJ RWEAT2018121101910.21288/resko.2018.12.1.10HahnJSLeeKSA theoretical review on designing virtual reality in the teaching - learning processJ Educ Tech200117313316310.17232/KSET.17.3.133KimJKYuHYLeeYSA convergence research for development of VR education contents for core fundamental nursing skillsJour. of KoCon.a202121971472210.5392/JKCA.2021.21.09.714ParkJTKimJHLeeJHDevelopment of educational content for dental extraction skill training using virtual reality technologyJour. of KoCon.a2018181221822810.5392/JKCA.2018.18.12.218HuangTKYangCHHsiehYHWangJCHungCCAugmented reality (AR) and virtual reality (VR) applied in dentistryKaohsiung J Med Sci201834424324810.1016/j.kjms.2018.01.009KimCYKimKHRyuJHThe effect of experience level on user perception in the VR based simulation for communication training with virtual patientKAEIM202026345547510.15833/KAFEIAM.26.3.455TakNYLimHJLimDSHwangYSJungIHEffect of self - learning media based on 360° virtual reality for learning periodontal instrument skillsEur J Dent Educ20221610.1111/eje.12769Korea Dental Hygienists associationDevelopment of VR - based oral anatomy content spursDentalkInternet, Available from: http://news.kdha.or.kr/news/articleView.html?idxno=10002cited 2022 Jan 01LeeMYA study on the satisfaction of basic medical class applying virtual reality (VR)Journal of KOEN201913753153710.21184/jkeia.2019.10.13.7.531KwonSMShimJGChonKSImplementation of radiotherapy educational contents using virtual realityJ Korean Soc Radiol201812340941510.7742/jksr.2018.12.3.409ChoHEAttitude and satisfaction of head and neck anatomy class using virtual reality (VR) in dental hygiene studentsJ Korea Soc Dent Hyg202121681382010.13065/jksdh.20210080LeeHJChaSAKwonHNStudy on the effect of augmented reality contents - based instruction for adult learners on academic achievement, interest and flowJour. of KoCon.a201616142443710.5392/JKCA.2016.16.01.424ShinMSKimCHAhnESHwangJMPractice method and performance according to clinical practice contents of dental hygiene studentJCCT20195212313810.17703/JCCT.2019.5.2.123ChoiSKimHBApplication and effects of VR - based biology class reflecting characteristics of virtual reality202040220321610.14697/jkase.2020.40.2.203GuJYLeeJGEffects of a new clinical training simulator for dental radiography using augmented reality on self - efficacy, interest in learning, flow, and practice satisfactionJ Digit Contents Soc20181991811181710.9728/dcs.2018.19.9.1811LeeHJChaSAKwonHNStudy on the effect of augmented reality contents - based instruction for adult learners on academic achievement, interest and flowJour. of KoCon.a201616142443710.5392/JKCA.2016.16.01.424LeeJSKimKYLee, KSSimHAEffects of reality based science learning program on learning motivation and achievement: development and implementation of elementary school level’s science learning program applied the Keller’s ARCS modelTPE201015199121ChoHEChungKYFactors influencing class flow of dental hygiene students in dental hygiene care processJ Korea Soc Dent Hyg2020201637110.13065/jksdh.20200007