Multimodal Learning Module Based on Augmented Reality Technology to Enhance Students’ Information and Digital Literacy

https://doi.org/10.5614/sostek.itbj.2025.24.3.5

Authors

  • Stella Talitha Universitas Pendidikan Indonesia
  • Yeti Mulyati Universitas Pendidikan Indonesia
  • Yulianeta Universitas Pendidikan Indonesia
  • Khaerudin Kurniawan Universitas Pendidikan Indonesia

Keywords:

multimodality, modal integration, textbook analysis, content analysis

Abstract

This study investigates the multimodal representation in the Grade 10 Bahasa Indonesia textbook published under the Kurikulum Merdeka, focusing on how various semiotic modes verbal, visual, typographic, layout, and color are functionally integrated to support meaning-making and student comprehension. Employing a qualitative content analysis method, data were collected through document analysis and analyzed using a multimodal categorization instrument. This instrument classified modes by type, communicative function, and modal integration. The analysis involved identifying modes on selected pages, evaluating the communicative function of each mode, and interpreting the relationships among modes, categorized as complementary, redundant, dominant, or incoherent, to assess cohesion and pedagogical relevance. The results show that visual modes are the most dominant, with typographic and layout features providing emphasis and structural clarity. Complementary relations were most frequent, demonstrating a high degree of synergy between modes in conveying meaning. Instances of redundancy, dominance, or incoherence were minimal but signal areas for improvement. The study concludes that the textbook reflects a pedagogical shift toward multimodal literacy aligned with 21st-century competencies. Practically, the findings inform educators and textbook designers on how to optimize visual-verbal coordination, design layout more coherently, and utilize typography and color meaningfully to foster more inclusive, engaging, and effective language instruction.

References

Adami, E., & Jewitt, C. (2021). Multimodal literacy: From theories to practices. Visual Communication, 20(4), 453–468. https://doi.org/10.1177/14703572211021369

Ayu, M. (2020). Evaluation of cultural content on English textbook used by EFL students in Indonesia. Journal of English Teaching, 6(3), 183-192. https://doi.org/10.33541/jet.v6i3.1925

Bezemer, J., & Kress, G. (2010). Multimodality, learning and communication: A social semiotic frame. Routledge.

Bezemer, J., & Kress, G. (2020). Social semiotics and multimodal texts in education. Discourse, Context & Media, 35, 100391. https://doi.org/10.1016/j.dcm.2020.100391

Choi, Y., & Yi, Y. (2019). Teacher support of multimodal composition in multilingual classrooms. Journal of Adolescent & Adult Literacy, 62(6), 663–672. https://doi.org/10.1002/jaal.935

Cichocka, A. (2016). Multimodal analysis of educational materials: Images in a history textbook. Journal of Language and Education, 2(2), 6–16.

Cope, B., & Mayer, K. (2009). Multiliteracies: New literacies, new learning. Pedagogies: An International Journal, 4(3), 164–195. https://doi.org/10.1080/15544800903076044

Elmiana, D. S. (2019). Pedagogical representation of visual images in EFL textbooks: a multimodal perspective. Pedagogy, Culture & Society, 27(4), 613–628. https://doi.org/10.1080/14681366.2019.1569550

Hartati, S., Sukenti, D., & Nazirun. (2024). Penguatan literasi dalam Kurikulum Merdeka: Telaah buku teks Bahasa Indonesia. Jurnal Pendidikan Bahasa dan Sastra Indonesia, 13(1), 45–58.

Hermawan, B. (2013). Multimodality in English language teaching textbooks: A case study of a textbook for junior high school students in Indonesia. Indonesian Journal of Applied Linguistics, 2(2), 65–72. https://doi.org/10.17509/ijal.v2i2.70

Jewitt, C. (2008). Multimodality and literacy in school classrooms. Review of Research in Education, 32(1), 241–267. https://doi.org/10.3102/0091732X07310586

Kress, G. (2010). Multimodality: A social semiotic approach to contemporary communication. Routledge.

Kress, G., & van Leeuwen, T. (2006). Reading images: The grammar of visual design (2nd ed.). Routledge.

Husain, N. F., Zuhri, M. D., & Musfirah, M. (2021). Semiotic analysis to the cultural content in the EFL textbook. International Journal of Research on English Teaching and Applied Linguistics, 1(2), 67-82. https://doi.org/10.30863/ijretal.v1i2.1230

Landa, R., Galvis, H., & Gutierrez, C. (2023). Integrating multimodal learning strategies in textbook design: A Latin American perspective. International Journal of Educational Research Open, 4, 100234. https://doi.org/10.1016/j.ijedro.2023.100234

Lee, J. F. K., & Li, X. (2020). Cultural representation in English language textbooks: A comparison of textbooks used in mainland China and Hong Kong. Pedagogy, Culture & Society, 28(4), 605-623. https://doi.org/10.1080/14681366.2019.1681495

Lim, F. V., & Tan, K. H. (2021). Multimodal literacy: The case of the Singapore English curriculum. Curriculum Perspectives, 41(2), 123–135. https://doi.org/10.1007/s41297-021-00145-w

Liu, Y., & Xu, B. (2020). Multimodal representation in EFL textbooks: A systemic functional perspective. System, 89, 102200. https://doi.org/10.1016/j.system.2019.102200

Madjid, A. (2002). Kontekstualisasi kurikulum bahasa Indonesia berbasis kompetensi. Jurnal Bahasa dan Seni, 30(2), 133–144.

Mei, Y. (2022). The visual grammar of textbooks: Multimodal strategies in Chinese high school English books. Linguistics and Education, 69, 101009. https://doi.org/10.1016/j.linged.2022.101009

Mills, K. A., & Exley, B. (2021). Multiliteracies and multimodal texts in classrooms. The Reading Teacher, 75(2), 209–217. https://doi.org/10.1002/trtr.2003

Moleong, L. J. (2018). Metodologi penelitian kualitatif (Edisi revisi). PT Remaja Rosdakarya.

Ningsih, D. A. (2019). Keterpaduan visual dan teks dalam buku pelajaran Bahasa Indonesia SMA. Jurnal Kajian Linguistik dan Sastra, 4(1), 73–84.

Nuryani, D., & Setiawan, A. (2022). Exploring multimodality in Bahasa Indonesia textbooks: A case of Kurikulum Merdeka. Journal of Language and Literacy Education, 18(3), 55–68.

Prihatiningsih, F., Petrus, I., & Silvhiany, S. . (2021). Cultural Representation in EFL Textbooks for the Seventh Graders: A Multimodal Analysis. Lingua Cultura, 15(1), 121–133. https://doi.org/10.21512/lc.v15i1.7319

Rowsell, J., & Walsh, M. (2011). Rethinking literacy education in new times: Multimodality, multiliteracies, and new literacies. Brock Education Journal, 21(1), 53–62.

Sari, R. P., & Pratama, F. D. (2021). Peran ilustrasi dalam pembelajaran literasi: Studi terhadap buku teks SMA. Jurnal Pendidikan dan Kebudayaan, 26(3), 352–365.

Serafini, F. (2012). Reading multimodal texts in the 21st century. Research in the Schools, 19(1), 26–32.

Ting, Y. L., Tan, C. L., & Liew, W. L. (2020). Visual literacy and textbook evaluation: A multimodal perspective. Asian Journal of English Language Studies, 8(1), 87–104.

Weninger, C. (2020). Multimodality in critical language textbook analysis. Language, Culture and Curriculum, 34(2), 133–146. https://doi.org/10.1080/07908318.2020.1797083

Wijayanti, R. (2020). Analisis visual dalam buku teks Bahasa Indonesia kelas X. Jurnal Ilmu Pendidikan, 26(2), 180–191.

Published

2025-11-30