The Global Trend of Augmented Reality-Based Learning and  Its Impact on Students' Academic Ability: A Meta-Analysis

Maximus Tamur; Tommy Tanu Wijaya; Alberta P Makur; Yudi Wibisono; Kristianus Viktor Pantaleon

doi:10.18326/hipotenusa.v6i2.2454

Authors

Maximus Tamur Universitas Katolik Indonesia Santu Paulus Ruteng https://orcid.org/0000-0002-2185-8415
Tommy Tanu Wijaya School of mathematical Sciences, Beijing Normal University, Beijing, China
Alberta P Makur Universitas Katolik Indonesia Santu Paulus Ruteng
Yudi Wibisono Universitas Pendidikan Indonesia
Kristianus Viktor Pantaleon Universitas Katolik Indonesia Santu Paulus Ruteng

DOI:

https://doi.org/10.18326/hipotenusa.v6i2.2454

Keywords:

augmented reality, students' academic ability, meta-analysis, moderator variables, effect size

Abstract

Today, there are many studies available in the literature that test the effectiveness of using augmented reality (AR). However, these studies provide varying results. In this regard, a meta-analysis is needed to examine the overall effect of all studies that question the influence of Augmented Reality-Based Learning (ARBL) on students' academic ability. Then, moderator variables need to be investigated to consider their implications. Data were examined from the Scopus and Google Scholar databases using the Publish or Perish application between 2016 and 2023. Data screening resulted in 69 independent groups of 32 eligible primary studies with 2659 subjects. Population estimation was based on a random effects model, and Comprehensive Meta-Analysis (CMA) was used as a calculation tool. The study's results provided an overall effect size of 0.81 (large effect). This shows that ARBL greatly affects students' academic ability, so its application must be considered. Of all the moderator variables analyzed, year of study, educational level differences, and subject matter were associated with differences in effect sizes in the main study. Thus, these three variables need to be considered in educational settings related to the development and implementation of ARBL in the future. Several new findings and research gaps are discussed and will help teachers, lecturers, and practitioners fill them in the future.

References

Altinpulluk, H. (2019). Determining the trends of using augmented reality in education between 2006-2016. Education and Information Technologies, 24(2), 1089–1114. https://doi.org/10.1007/s10639-018-9806-3

Arik, S., & Yilmaz, M. (2020). The effect of constructivist learning approach and active learning on environmental education: A meta-analysis study. International Electronic Journal of Environmental Education, 10(1), 44–84. https://files.eric.ed.gov/fulltext/EJ1239355.pdf

Balian, S., McGovern, S. K., Abella, B. S., Blewer, A. L., & Leary, M. (2019). Feasibility of an augmented reality cardiopulmonary resuscitation training system for health care providers. Heliyon, 5(8), e02205. https://doi.org/10.1016/j.heliyon.2019.e02205

Borenstein, M., Hedges, L. V, & Rothstein, H. R. (2009). Introduction Meta-Analysis (Issue January). John Wiley & Sons.

Buchner, J., & Kerres, M. (2023). Media comparison studies dominate comparative research on augmented reality in education. Computers and Education, 195(August 2022), 104711. https://doi.org/10.1016/j.compedu.2022.104711

Bursali, H., & Yilmaz, R. M. (2019). Effect of augmented reality applications on secondary school students’ reading comprehension and learning permanency. Computers in Human Behavior, 95(June 2018), 126–135. https://doi.org/10.1016/j.chb.2019.01.035

Cabero-Almenara, J., Fernández-Batanero, J. M., & Barroso-Osuna, J. (2019). Adoption of augmented reality technology by university students. Heliyon, 5(5). https://doi.org/10.1016/j.heliyon.2019.e01597

Cahyana, U., Roland, L., Lestari, I., Irwanto, I., & Suroso, J. S. (2023). Improving Students’ Literacy and Numeracy Using Mobile Game-Based Learning with Augmented Reality in Chemistry and Biology. International Journal of Interactive Mobile Technologies (IJIM), 17(16), 4–15. https://doi.org/10.3991/ijim.v17i16.42377

Cardenas-Valdivia, J., Flores-Alvines, J., Iparraguirre-Villanueva, O., & Cabanillas-Carbonell, M. (2023). Augmented Reality for Quechua Language Teaching-Learning: A Systematic Review. International Journal of Interactive Mobile Technologies, 17(6), 116–138. https://doi.org/10.3991/ijim.v17i06.37793

Chang, K. E., Zhang, J., Huang, Y. S., Liu, T. C., & Sung, Y. T. (2019). Applying augmented reality in physical education on motor skills learning. Interactive Learning Environments, 28(6), 685–697. https://doi.org/10.1080/10494820.2019.1636073

Chien, Y. C., Su, Y. N., Wu, T. T., & Huang, Y. M. (2017). Enhancing students’ botanical learning by using augmented reality. Universal Access in the Information Society, 18(2), 231–241. https://doi.org/10.1007/s10209-017-0590-4

Cohen, L., Manion, L., & Morrison, K. (2018). Research Methods in Education (8th ed.). Routledge Taylor & Francis Group.

Cooper, H. M. (2017). Research Synthesis and Meta-Analysis : A Step-by-Step Approach (Fifth). SAGE Publications. https://doi.org/10.4135/9781071878644

Demitriadou, E., Stavroulia, K. E., & Lanitis, A. (2020). Comparative evaluation of virtual and augmented reality for teaching mathematics in primary education. Education and Information Technologies, 25(1), 381–401. https://doi.org/10.1007/s10639-019-09973-5

Franzen, M. (2020). Meta-analysis. In H. V. Zeigler & T. . Shackelford (Eds.), Encyclopedia of Personality and Individual Differences (p. 5925). Springer, Cham. https://doi.org/10.1007/978-3-319-24612-3_1326

Garzón, J. (2021). An overview of twenty-five years of augmented reality in education. Multimodal Technologies and Interaction, 5(7). https://doi.org/10.3390/mti5070037

Giannopulu, I., Brotto, G., Lee, T. J., Frangos, A., & To, D. (2022). Synchronised neural signature of creative mental imagery in reality and augmented reality. Heliyon, 8(3). https://doi.org/10.1016/j.heliyon.2022.e09017

Grodotzki, J., Müller, B. T., & Tekkaya, A. E. (2023). Enhancing manufacturing education based on controller-free augmented reality learning. Manufacturing Letters, 35, 1246–1254. https://doi.org/10.1016/j.mfglet.2023.08.068

Hamzah, M. L., Ambiyar, Rizal, F., Simatupang, W., Irfan, D., & Refdinal. (2021). Development of Augmented Reality Application for Learning Computer Network Device. International Journal of Interactive Mobile Technologies, 15(12), 47–64. https://doi.org/10.3991/ijim.v15i12.21993

Hedberg, H., Nouri, J., Hansen, P., & Rahmani, R. (2018). A systematic review of learning through mobile augmented reality. International Journal of Interactive Mobile Technologies, 12(3), 75–85. https://doi.org/10.3991/ijim.v12i3.8404

Huda, A., Azhar, N., Almasri, A., Wulansari, R. E., Mubai, A., Sakti, R. H., Firdaus, F., & Hartanto, S. (2021). Augmented Reality Technology as a Complement on Graphic Design to Face Revolution Industry 4.0 Learning and Competence: The Development and Validity. International Journal of Interactive Mobile Technologies, 15(5), 116–126. https://doi.org/10.3991/ijim.v15i05.20905

Jeffri, N. F. S., & Awang Rambli, D. R. (2021). A review of augmented reality systems and their effects on mental workload and task performance. Heliyon, 7(3), e06277. https://doi.org/10.1016/j.heliyon.2021.e06277

Juandi, D. (2021). A meta-analysis of Geogebra software decade of assisted mathematics learning: what to learn and where to go? Heliyon, 7(5). https://doi.org/10.1016/j.heliyon.2021.e06953

Juandi, D., Kusumah, Y. S., & Tamur, M. (2022). A Meta-Analysis of the Last Two Decades of Realistic Mathematics Education Approaches. International Journal of Instruction, 15(1), 381–400. https://doi.org/10.29333/iji.2022.15122a

Juandi, D., Tamur, M., Martadiputra, B. A. P., Suparman, & Kurnila, V. S. (2022). A meta-analysis of a year of virtual-based learning amidst the COVID-19 crisis : Possible solutions or problems ? AIP Conference Proceedings, 2468(1), 1–6.

Kan, A. Ü. (2021). The effect of using augmented reality based teaching material on students’ academic success and opinions. African Educational Research Journal, 9(1), 273–289. https://doi.org/10.30918/aerj.91.21.035

Kim, S. J., Jeong, Y., Park, S., & Ryu, K. (2018). A Survey of Drone use for Entertainment and AVR ( Augmented and Virtual Reality ). In Augmented Reality and Virtual Reality (pp. 339–352). Springer International Publishing. https://doi.org/10.1007/978-3-319-64027-3

Leitão, R., Rodrigues, J. M. F., & Marcos, A. F. (2014). Game-Based Learning: Augmented Reality in the Teaching of Geometric Solids. International Journal of Art, Culture and Design Technologies, 4(1), 63–75. https://doi.org/10.4018/ijacdt.2014010105

Li, W. C., Zhang, J., Court, S., Kearney, P., & Braithwaite, G. (2022). The influence of augmented reality interaction design on Pilot’s perceived workload and situation awareness. International Journal of Industrial Ergonomics, 92(November), 103382. https://doi.org/10.1016/j.ergon.2022.103382

Lin, Y., & Yu, Z. (2023). A meta-analysis of the effects of augmented reality technologies in interactive learning environments (2012–2022). Computer Applications in Engineering Education, 31(4), 1111–1131. https://doi.org/10.1002/cae.22628

Mailizar, & Johar, R. (2021). Examining students’ intention to use augmented reality in a project-based geometry learning environment. International Journal of Instruction, 14(2), 773–790. https://doi.org/10.29333/iji.2021.14243a

Masmuzidin, M. Z., Aziz, N. A. A., & Suhaimi, S. (2022). A Systematic Review of Augmented Reality Design for Young Children. International Journal of Interactive Mobile Technologies, 16(17), 60–71. https://doi.org/10.3991/ijim.v16i17.31837

McHugh, M. L. (2012). Lessons in biostatistics interrater reliability : the kappa statistic. Biochemica Medica, 22(3), 276–282. https://doi.org/10.11613/BM.2012.031

Mingsiritham, K., Chanyawudhiwan, G., & Paiwithayasiritham, C. (2020). Factor Analysis of Smart Social Media Technology to Promote Professional Learning Communities for Teachers. International Journal of Interactive Mobile Technologies, 14(20), 165–173. https://doi.org/10.3991/IJIM.V14I20.17253

Ozdemir, M., Sahin, C., Arcagok, S., & Demir, M. K. (2018). The effect of augmented reality applications in the learning process: A meta-analysis study. Eurasian Journal of Educational Research, 2018(74), 165–186. https://doi.org/10.14689/ejer.2018.74.9

Park, S., & Hong, S. (2016). The empirical review of meta-analysis published in Korea. Asia Pacific Education Review, 17(2), 313–324. https://doi.org/10.1007/s12564-016-9433-x

Pigott, T. D., & Polanin, J. R. (2020). Methodological Guidance Paper: High-Quality Meta-Analysis in a Systematic Review. Review of Educational Research, 90(1), 24–46. https://doi.org/10.3102/0034654319877153

Pradibta, H. (2018). Augmented reality: Daily prayers for preschooler student. International Journal of Interactive Mobile Technologies, 12(1), 151–159. https://doi.org/10.3991/ijim.v12i1.7269

Putra, A. B. N. R., Mukhadis, A., Ulfatin, N., Tuwoso, Subandi, M. S., Hardika, & Muhammad, A. K. (2021). The Innovation of Disruptive Learning Media with Augmented Reality Based 3D Object Concept with Drill Machine Design to Improve Quality of Distance Learning in The Era of Education 4.0. International Journal of Interactive Mobile Technologies, 15(12), 193–200. https://doi.org/10.3991/ijim.v15i12.21579

Qiao, X., Ren, P., Dustdar, S., Liu, L., Ma, H., & Chen, J. (2019). Web AR: A Promising Future for Mobile Augmented Reality-State of the Art, Challenges, and Insights. Proceedings of the IEEE, 107(4), 651–666. https://doi.org/10.1109/JPROC.2019.2895105

Ratnawati, N., Wahyuningtyas, N., Habibi, M. M., Bashofi, F., & Shaharom, M. S. N. (2022). Development of Augmented Reality Practicum Modules to Grow Independent Learning in Cultural Anthropology Courses. International Journal of Interactive Mobile Technologies, 16(22), 59–74. https://doi.org/10.3991/ijim.v16i22.36161

Ronaghi, M. H., & Ronaghi, M. (2022). A contextualized study of the usage of the augmented reality technology in the tourism industry. Decision Analytics Journal, 5(September), 100136. https://doi.org/10.1016/j.dajour.2022.100136

Saidin, N. F., Halim, N. D. A., & Yahaya, N. (2019). Framework for developing a Mobile Augmented Reality for learning chemical bonds. International Journal of Interactive Mobile Technologies, 13(7), 54–68. https://doi.org/10.3991/ijim.v13i07.10750

Saleem, M., Kamarudin, S., Shoaib, H. M., & Nasar, A. (2021). Influence of augmented reality app on intention towards e-learning amidst COVID-19 pandemic. Interactive Learning Environments, 31(5), 1–15. https://doi.org/10.1080/10494820.2021.1919147

Samala, A. D., & Amanda, M. (2023). Immersive Learning Experience Design (ILXD): Augmented Reality Mobile Application for Placing and Interacting with 3D Learning Objects in Engineering Education. International Journal of Interactive Mobile Technologies, 17(5), 22–35. https://doi.org/10.3991/ijim.v17i05.37067

Savela, N., Oksanen, A., Kaakinen, M., Noreikis, M., & Xiao, Y. (2020). Does Augmented Reality A ff ect Sociability , Entertainment , and Learning ? A Field Experiment. Applied Sciences, 10(4), 1392. https://doi.org/10.3390/app10041392

Schmidt, F. L., & Hunter, J. E. (2015). Methods of Meta-Analysis: Correcting Error and Bias in Research Findings (Third). 55 City Road, London: SAGE Publications, Ltd. https://doi.org/10.4135/9781483398105

Siddaway, A. P., Wood, A. M., & Hedges, L. V. (2019). How to Do a Systematic Review: A Best Practice Guide for Conducting and Reporting Narrative Reviews, Meta-Analyses, and Meta-Syntheses. Annual Review of Psychology, 70(1), 747–770. https://doi.org/10.1146/annurev-psych-010418-102803

Silva, A. C., Calderon, A. R., Retuerto, M. G., & Andrade-Arenas, L. (2022). Application of Augmented Reality in Teaching and Learning in Engineering Programs. International Journal of Interactive Mobile Technologies, 16(15), 112–124. https://doi.org/10.3991/ijim.v16i15.31695

Silva, M., Bermúdez, K., & Caro, K. (2023). Effect of an augmented reality app on academic achievement, motivation, and technology acceptance of university students of a chemistry course. Computers & Education: X Reality, 2(August 2022), 100022. https://doi.org/10.1016/j.cexr.2023.100022

Sudirman, Mellawaty, Yaniwati, R. P., & Indrawan, R. (2020). Integrating local wisdom forms in augmented reality application: Impact attitudes, motivations and understanding of geometry of pre-service mathematics teachers’. International Journal of Interactive Mobile Technologies, 14(11), 91–106. https://doi.org/10.3991/ijim.v14i11.12183

Sural, I. (2018). Augmented Reality Experience: Initial Perceptions of Higher Education Students,. International Journal of Instruction, 11(4), 565–576. https://doi.org/10.12973/iji.2018.11435a

Tamur, M., Kusumah, Y. S., Juandi, D., Kurnila, V. S., Jehadus, E., & Samura, A. O. (2021). A Meta-Analysis of the Past Decade of Mathematics Learning Based on the Computer Algebra System (CAS). Journal of Physics: Conference Series, 1882(1), 012060. https://doi.org/10.1088/1742-6596/1882/1/012060

Tamur, M., Ndiung, S., Weinhandl, R., Wijaya, T. T., Jehadus, E., & Sennen, E. (2023). Meta-Analysis of Computer-Based Mathematics Learning in the Last Decade Scopus Database: Trends and Implications. Infinity Journal, 12(1), 101. https://doi.org/10.22460/infinity.v12i1.p101-116

Tao, B., Fan, X., Wang, F., Chen, X., Shen, Y., & Wu, Y. (2023). Comparison of the accuracy of dental implant placement using dynamic and augmented reality-based dynamic navigation: An in vitro study. Journal of Dental Sciences, xxxx. https://doi.org/10.1016/j.jds.2023.05.006

Tuwoso, Putra, A. B. N. R., & Muhammad, A. K. Bin. (2021). The Innovation of Augmented Reality Learning Media with Interactive Component Model to Improve Special Ability of Vocational Education Knowledge in the Digital Era. International Journal of Interactive Mobile Technologies, 15(21), 188–198. https://doi.org/10.3991/ijim.v15i21.24833

Wan, X., Shen, L., Fang, Z., Dong, S., Zhang, S., & Lin, C. (2022). A novel motionless calibration method for augmented reality surgery navigation system based on optical tracker. Heliyon, 8(12), e12115. https://doi.org/10.1016/j.heliyon.2022.e12115

Whang, J. Bin, Song, J. H., Choi, B., & Lee, J. H. (2021). The effect of Augmented Reality on purchase intention of beauty products: The roles of consumers’ control. Journal of Business Research, 133(November 2019), 275–284. https://doi.org/10.1016/j.jbusres.2021.04.057

Wijaya, T. T., Cao, Y., Weinhandl, R., & Tamur, M. (2022). A meta-analysis of the effects of E-books on students’ mathematics achievement. Heliyon, 8(6), e09432. https://doi.org/10.1016/j.heliyon.2022.e09432

Yilmaz, R. M., & Goktas, Y. (2017). Using augmented reality technology in storytelling activities: examining elementary students’ narrative skill and creativity. Virtual Reality, 21(2), 75–89. https://doi.org/10.1007/s10055-016-0300-1

Yilmaz, Z. A., & Batdi, V. (2021). Meta-Analysis of the Use of Augmented Reality Applications in Science Teaching. Journal of Science Learning, 4(3), 267–274. https://doi.org/10.17509/jsl.v4i3.30570