Current studies in local-culture based ELT materials development evaluation instruments: Systematic review
Abstract
This systematic literature review was completed to investigate the status quo of evaluation instruments utilized in the development of local-culture based ELT materials in Indonesia. The main concern in this review is the validity of the evaluation instrument. This research used the PRISMA 2020 model to review the existing studies in the intended area. The data were collected from the Garuda database an official database to index articles published in Indonesia. There are 2.394 studies obtained and only 76 of them fulfil all criteria for analysis. Out of 76 studies reviewed, the results show that there are no studies that have validated their evaluation instruments. In addition, 56 studies prefer to use self-made evaluation instruments in the materials development process. Only 10 studies chose to adapt the available evaluation instrument from other sources in their development process. This review found that there is a gap that lies between the available local culture-based ELT materials evaluation instruments and the need of validity to be applied to materials development. It suggested the need of more studies in instrument development and validation to support Indonesian local-culture based ELT materials development. In the long run, the local culture will be globally well-known and accepted if the materials are available and accessible world-wide.
Full text article
References
Agustina, P., Askurny, N. R., & Pujiastuti, I. (2023). Applying Jangoi folklore from Penyengat Island on ELT. Language and Education Journal Undiksha, Vol. 6 No. 1 (2023): February, 20–33.
Astawa, N. L. P. N. S. P., & Dewi, I. G. A. A. I. S. (2021). Gamifikasi cerita rakyat Bali sebagai media pembelajaran siswa generasi-z. JIIP - Jurnal Ilmiah Ilmu Pendidikan, Vol. 4 No. 6 (2021): JIIP (Jurnal Ilmiah Ilmu Pendidikan), 383–389.
Bilanti, E., Susilawati, E., Suhartono, L., Salam, U., & Rezeki, Y. S. (2022). Developing a Minecraft Adventure Map to Support Eleventh Grade Senior High School Students’ Vocabulary Learning. IDEAS: Journal on English Language Teaching and Learning, Linguistics and Literature, 10(2), 1379–1393. https://doi.org/10.24256/ideas.v10i2.3000
Branch, R. M. (2009). Instructional Design: The ADDIE Approach. Springer US. https://doi.org/10.1007/978-0-387-09506-6
Cornelia, C., Ikhsanudin, I., Surmiyati, S., Apriliaswati, R., & Rezeki, Y. S. (2023). Designing supplementary materials for teaching-learning of writing explanatory text based on a genre-based approach. Premise: Journal of English Education, 12(1), 235. https://doi.org/10.24127/pj.v12i1.6141
Dianti, E. N., Rezeki, Y. S., & Rosnija, E. (2023). Designing supplementary materials entitled “Learning Recount Texts through Local Photograph” for reading recount text. Acitya: Journal of Teaching and Education, 5(1), 134–155. https://doi.org/10.30650/ajte.v5i1.3502
Dwiputra, D. F. K., & Sundawa, D. (2023). Analysis of Potentials and Challenges of Culture-based Learning in Indonesia: A Systematic Literature Review. Jurnal Kependidikan: Jurnal Hasil Penelitian Dan Kajian Kepustakaan Di Bidang Pendidikan, Pengajaran Dan Pembelajaran, 9(1), 213. https://doi.org/10.33394/jk.v9i1.6556
Fahik, T. (2020). English textbook: A culture-based analysis. Lingua Scientia, Vol 27, No 1 (2020), 55–64.
Faizin, H. A., Permatasari, I., & Aziz, M. (2022). The Value of Local Content in ELT Materials in Indonesia. Journal of English Language and Education, 7(2), 19–26. https://doi.org/10.31004/jele.v7i2.243
Fraseda, E., Susilawati, E., Ikhsanudin, I., Bunau, E., & Surmiyati. (2022). Developing a picture book of local folktales to facilitate reading literacy for the 8th grade students of SMP Anak Negeri Sanggau. Journal of English Educational Study (JEES), Vol 5, No 2 (2022): November Edition, 172–179.
Haddina, E., & Marpaung, F. D. N. (2022). Development of learning media through traditional Rimau Langkat games based on macromedia flash to improve cultural literacy. JIIP - Jurnal Ilmiah Ilmu Pendidikan, Vol. 5 No. 10 (2022): JIIP (Jurnal Ilmiah Ilmu Pendidikan), 3968–3973.
Inderawati, R., Susanti, S., Nurhayati, N., & Sitinjak, M. D. (2022). Developing instructional reading materials with local culture-based narrative texts for the tenth grade students. English Review: Journal of English Education, 10(2), 749–760. https://doi.org/10.25134/erjee.v10i2.6431
Koeswiryono, D. P., Suadnyana, I. W., & Supartini, N. L. (2023). Designing English module for guides of Museum Pustaka Lontar, Karangasem, Bali. Jurnal Kajian Bali (Journal of Bali Studies), 13(1), 216–216. https://doi.org/10.24843/JKB.2023.v13.i01.p11
Kubai, E. (2019, September 15). Reliability and Validity of Research Instruments.
Leung, L. (2015). Validity, reliability, and generalizability in qualitative research. Journal of Family Medicine and Primary Care, 4(3), 324. https://doi.org/10.4103/2249-4863.161306
Maftuhah, U., Astuti, I., & Suratman, D. (2022). Development of descriptive text animation videos about local wisdom based on QR code. Jurnal Scientia, Vol. 10 No. 2 (2022): Education, Sosial science and Planning technique, March, 349–355.
Marpaung, F. D. N., & Rosmen, R. (2022). Developing reading e-module based on Langkat Sultanate history for English department study of STKIP Al-Maksum Langkat. JIIP - Jurnal Ilmiah Ilmu Pendidikan, Vol. 5 No. 10 (2022): JIIP (Jurnal Ilmiah Ilmu Pendidikan), 4295–4301.
Miekley, J. (2005). ESL textbook evaluation checklist. The Reading Matrix, 5(2), 9–17.
Ordóñez Procel, G. J., Poma Tacuri, M. A., López López, K. A., & Correa Criollo, P. I. (2023). The Influence of Cultural Context on English Teaching. Ciencia Latina Revista Científica Multidisciplinar, 7(4), 784–800. https://doi.org/10.37811/cl_rcm.v7i4.6920
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., … Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. Systematic Reviews, 10(1), 89. https://doi.org/10.1186/s13643-021-01626-4
Safitri, N. T., Hidayati, Kurniawan, D., & Tersta, F. W. (2023). Exploring an entrepreneurial prospective of English language to promote Muaro Jambi temple. Indonesian Journal Of Educational Research and Review, 6(1), 111–119. https://doi.org/10.23887/ijerr.v6i1.53887
Saraswati, I. G. A. D. G., Suwastini, N. K. A., & Suarcaya, P. (2023). Glocal balancing: Inserting Indonesian cultural content into English textbook for grade X. PRASI, Vol. 18 No. 01 (2023), 60–80. https://doi.org/10.23887/18i01.60486
Setyoningrum, T. Y. (2022). Pengembangan aplikasi THERA untuk meningkatakan keterampilan membaca dan karakter cinta budaya lokal. Jurnal Guru Dikmen Dan Diksus, Vol 5 No 1 (2022): Januari-Juni 2022, 104–116.
Sullivan, G. M. (2011). A Primer on the Validity of Assessment Instruments. Journal of Graduate Medical Education, 3(2), 119–120. https://doi.org/10.4300/JGME-D-11-00075.1
Tomlinson, B. (2012). Materials development for language learning and teaching. Language Teaching, 45(2), 143–179. https://doi.org/10.1017/S0261444811000528
Wafiroh, N., Nurliana, A., & Firdia, D. (2021). VR Paradise: Virtual reality based English language training concept for Banyuwangi tourism awareness group as an effort to create superior HR towards era society 5.0. Pancaran Pendidikan, Vol 10, No 2 (2021). https://doi.org/10.25037/pancaran.v10i2.307