Effects of a Structured Media Literacy Intervention on Digital Misinformation Susceptibility Among Undergraduate Students: A Quasi-Experimental Study

Authors

  • Edison Bonar Tua Hutapea Universitas Paramadina
  • Asep Soegiarto Universitas Negeri Jakarta
  • Totok Ony Wijanarko Universitas Paramadina

DOI:

https://doi.org/10.18326/inject.v11i1.6708

Keywords:

Digital Misinformation, Media Literacy, Fake News, Undergraduate Students, Inoculation Theory

Abstract

Digital misinformation poses a significant and growing challenge to university students. They are among the most active consumers of online information, yet frequently struggle to distinguish credible content from fabrications. Despite widespread digital fluency, approximately 38% of students incorrectly evaluate the veracity of news headlines under controlled conditions. This study examined the prevalence of misinformation susceptibility among university students and evaluated the effectiveness of a structured, inoculation-grounded media literacy intervention. Using a quasi-experimental mixed-methods design, 200 undergraduate students were assigned through quota sampling to an intervention group (n = 100) and a waitlist control group (n = 100). No random assignment was employed; groups were matched on key demographic variables. Instruments included the Critical Media Literacy Self-Perception Instrument (CMLSPI; Neira et al., 2024) and the Misinformation Susceptibility Test (MIST-16; Maertens et al., 2024), both adapted into Bahasa Indonesia via forward-backward translation. Cronbach's alpha was .86 (CMLSPI) and .79 (MIST-16). Quantitative results demonstrated statistically significant gains in fake news detection accuracy (30% improvement; Cohen's d = 1.44, 95% CI [1.18, 1.70], p < .001) and self-perceived media literacy (eta2 = .18, p < .001) relative to the control group. Qualitative thematic analysis identified four themes: increased metacognitive awareness, adoption of verification strategies, recognition of cognitive and emotional manipulation, and structural barriers to sustained practice. These findings support the integration of inoculation-based prebunking with MIL competency training as an effective and theoretically grounded approach to building digital resilience among undergraduate students in Indonesia.

References

Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa

Del Vicario, M., Bessi, A., Zollo, F., Petroni, F., Scala, A., Caldarelli, G., Stanley, H. E., & Quattrociocchi, W. (2016). The spreading of misinformation online. Proceedings of the National Academy of Sciences, 113(3), 554-559. https://doi.org/10.1073/pnas.1517441113

Fazio, L. K., Brashier, N. M., Payne, B. K., & Marsh, E. J. (2015). Knowledge does not protect against illusory truth. Journal of Experimental Psychology: General, 144(5), 993–1002. https://doi.org/10.1037/xge0000098

Friggeri, A., Adamic, L. A., Eckles, D., & Cheng, J. (2014). Rumor cascades. Proceedings of the Eighth International AAAI Conference on Weblogs and Social Media, 101–110.

Guess, A., Nagler, J., & Tucker, J. (2020). Less than you think: Prevalence and predictors of fake news dissemination on Facebook. Science Advances, 5(1). https://doi.org/10.1126/sciadv.aau4586

Hobbs, R., & Coiro, J. (2019). Design features of a professional development program in digital literacy. Journal of Media Literacy Education, 11(2), 1–17. https://doi.org/10.23860/JMLE-2019-11-2-1

Ismail, S. A., Ali, M. H., Zakaria, W. N. W., Hasim, M. H., & Alias, N. (2024). Online health misinformation and its impact: A scoping review. BMC Public Health, 24, 723.

Jeong, S. H., Cho, H., & Hwang, Y. (2012). Media literacy interventions: A meta-analytic review. Journal of Communication, 62(3), 454–472. https://doi.org/10.1111/j.1460-2466.2012.01643.x

Kahne, J., & Bowyer, B. (2017). Educating for democracy in a partisan age. American Educational Research Journal, 54(1), 3–34. https://doi.org/10.3102/0002831216679817

Kahneman, D. (2011). Thinking, fast and slow. Farrar, Straus and Giroux.

Lazer, D. M. J., Baum, M. A., Benkler, Y., Berinsky, A. J., Greenhill, K. M., Menczer, F., Metzger, M. J., Nyhan, B., Pennycook, G., Rothschild, D., Schudson, M., Sloman, S. A., Sunstein, C. R., Thorson, E. A., Watts, D. J., & Zittrain, J. L. (2018). The science of fake news. Science, 359(6380), 1094–1096. https://doi.org/10.1126/science.aao2998

Leeder, C. (2019). How college students evaluate and share 'fake news' stories. Library and Information Science Research, 41(3). https://doi.org/10.1016/j.lisr.2019.100967

Livingstone, S. (2004). Media literacy and the challenge of new information and communication technologies. The Communication Review, 7(1), 3–14.

Maertens, R., Gotz, F. M., Golino, H. F., Roozenbeek, J., Schneider, C. R., Kyrychenko, Y., Kerr, J. R., Stieger, S., McClanahan, W. P., Drabot, K., He, J., & van der Linden, S. (2024). The Misinformation Susceptibility Test (MIST). Behavior Research Methods, 56(3), 1863-1899. https://doi.org/10.3758/s13428-023-02124-2

Maxmudova, S., Yusupova, D., Toshmatova, M., & Nazarova, G. (2025). Vitagenic information and media literacy among higher education students. Journal of Media Education, 16(2), 45–59.

McGrew, S., Breakstone, J., Ortega, T., Smith, M., & Wineburg, S. (2018). Can students evaluate online sources? Theory & Research in Social Education, 46(2), 165–193.

McGuire, W. J. (1964). Inducing resistance to persuasion. In Advances in Experimental Social Psychology (Vol. 1, pp. 191–229).

Neira, A., Fuentes-Riffo, K., Vine, A., García, F., & Naranjo, G. (2024). Development and validation of a self-perception instrument for critical media literacy. Frontiers in Education, 9, 1476500.

Pennycook, G., Bear, A., Collins, E. T., & Rand, D. G. (2020). The implied truth effect. Management Science, 66(11), 4944–4957.

Pennycook, G., & Rand, D. G. (2018). Lazy, not biased. Cognition, 188, 39–50.

Qu, Y., & Chen, L. (2022). Sampling methods in educational research: A critical review. Educational Research Review, 37.

Regula. (2024). The state of deepfake fraud in business. https://regulaforensics.com/blog/deepfake-fraud-2024/

Rosenbusch, H., Soldier, P., & Gerstenberg, F. X. R. (2022). Problematic social media use and belief in fake news. Journal of Media Psychology, 34(2), 62-72.

Suarez-Lledo, V., & Alvarez-Galvez, J. (2021). Prevalence of health misinformation on social media. Journal of Medical Internet Research, 23(1). https://doi.org/10.2196/17187

Sumsub. (2024). Deepfake fraud report: 2023-2024. https://sumsub.com/reports/deepfake-fraud-report-2024/

Tandoc, E. C., Lim, Z. W., & Ling, R. (2018). Defining fake news. Digital Journalism, 6(2), 137-153.

UNESCO. (2013). Global media and information literacy assessment framework. https://unesdoc.unesco.org/ark:/48223/pf0000224655

van der Linden, S., Leiserowitz, A., Rosenthal, S., & Maibach, E. (2017). Inoculating the public against misinformation about climate change. Global Challenges, 1(2). https://doi.org/10.1002/gch2.201600008

Vosoughi, S., Roy, D., & Aral, S. (2018). The spread of true and false news online. Science, 359(6380), 1146-1151.

Vraga, E. K., & Tully, M. (2016). Effectiveness of a non-classroom media literacy intervention. Journal of Media Literacy Education, 8(2), 1-13.

Wardle, C. (2017). Fake news. It's complicated. https://firstdraftnews.org/latest/fake-news-complicated/

Wineburg, S., & McGrew, S. (2017). Lateral reading and the nature of expertise. Teachers College Record, 119(13), 1-40.

Downloads

Published

2026-04-24

How to Cite

Hutapea, E. B. T., Soegiarto, A., & Wijanarko, T. O. (2026). Effects of a Structured Media Literacy Intervention on Digital Misinformation Susceptibility Among Undergraduate Students: A Quasi-Experimental Study. INJECT (Interdisciplinary Journal of Communication), 11(1), 871–890. https://doi.org/10.18326/inject.v11i1.6708

Issue

Section

Articles