Arab World English Journal (AWEJ) Volume 17. Number 2, June 2026 Pp.78-93

Toward Methodological Coherence in C-Test Studies: A Systematic Review of Scoring, Validation, and Measurement Practices

Faculty of Education, The National University of Malaysia.

Faculty of Education, The National University of Malaysia.

Faculty of Education, The National University of Malaysia.

Abstract:

The C-Test is an integrative language assessment technique in which test takers restore systematically deleted parts of words in short texts, and it has been widely used to measure overall language proficiency across different languages and educational contexts. The main question guiding this review is how methodological approaches in C-Test research have been designed, analysed, and validated across different educational and linguistic contexts. The primary aim of the study is to synthesise existing empirical evidence on the construction, scoring, and psychometric evaluation of the C-Test, with particular attention to issues of reliability, validity, and analytical rigor. The review is important because clearer methodological guidance is needed to strengthen the credibility and interpretability of C-Test findings in language assessment research. Guided by established reporting standards, this review identified and screened empirical quantitative studies and applied a structured quality appraisal process. It then employed thematic synthesis to extract and analyse recurring methodological patterns and trends. The findings indicate that most studies report strong reliability and construct validity of the C-Test, supported by both classical and modern measurement approaches. However, studies vary considerably in scoring methods, model selection, and reporting practices. The review concludes by recommending clearer methodological guidelines and more transparent reporting standards to support the consistent and effective use of the C-Test in future language assessment research.

Cite as:

Shamshir, S. S. M., Yusoff, N. M. R. N. & Baharudin, H. (2026). Toward Methodological Coherence in C-Test Studies: A Systematic Review of Scoring, Validation, and Measurement Practices. Arab World English Journal, 17(2): 78-93

References:

Ågren, M., Bardel, C., & Sayehli, S. (2025). Developing measures of beginner language proficiency in French, German, and Spanish in the Swedish school context. Language Learning Journal, 1-15. https://doi.org/10.1080/09571736.2025.2564704

Alpizar, D., Li, T., Norris, J. M., & Gu, L. (2022). Psychometric approaches to analyzing C-tests. Language Testing, 40(1), 107-132. https://doi.org/10.1177/02655322211062138

Alzahrani, A. (2025). The predictive processing of number information in L1 and L2 Arabic speakers. Languages, 10(2), 25. https://doi.org/10.3390/languages10020025

Dhyaaldian, S. M. A., Kadhim, Q. K., Mutlak, D. A., Neamah, N. R., Kareem, Z. H., Hamad, D. A., … Qasim, M. S. (2022). A Comparison of Polytomous Rasch Models for the Analysis of C-Tests. International Journal of Language Testing, 12(2), 107-117. https://doi.org/10.22034/IJLT.2022.157128

Drackert, A., & Timukova, A. (2019). What does the analysis of C-test gaps tell us about the construct of a C-test? A comparison of foreign and heritage language learners’ performance. Language Testing, 37(1), 107-132. https://doi.org/10.1177/0265532219861042

Eckes, T., & Baghaei, P. (2015). Using testlet response theory to examine local dependence in C-Tests. Applied Measurement in Education, 28(2), 85–98. https://doi.org/10.1080/08957347.2014.1002919

Eckes, T. (2011). Item banking for C-tests: A polytomous Rasch modeling approach. Psychological Test and Assessment Modeling, 53(4), 414–439. https://www.researchgate.net/publication/264847679_Item_banking_for_C-tests_A_polytomous_Rasch_modeling_approach/citations

Eckes, T., & Grotjahn, R. (2006). A closer look at the construct validity of C-tests. Language Testing, 23(3), 290-325. https://doi.org/10.1191/0265532206lt330oa

Effatpanah, F., Baghaei, P., Tabatabaee-Yazdi, M., & Babaii, E. (2025). A new scoring method for item response theory analysis of C-Tests. Language Testing, 42(2), 167-192. https://doi.org/10.1177/02655322241265350

Forthmann, B., Grotjahn, R., Doebler, P., & Baghaei, P. (2020). A comparison of different Item Response Theory Models for scaling speeded C-tests. Journal of Psychoeducational Assessment, 38(6), 692-705. https://doi.org/10.1177/0734282919889262

Hamzah, H., Hamzah, M. I., & Zulkifli, H. (2022). Systematic literature review on the elements of metacognition-based higher order thinking skills (HOTS) teaching and learning modules. Sustainability (Switzerland), 14(2), 813. https://doi.org/10.3390/su14020813

Hassan, A. Y., Jaafar, E. A., Al-Rawe, M. F. A., & Abdullah, S. S. (2024). Validation of C-test among Iraqi EFL University students. International Journal of Language Testing, 14(2),151-161. https://doi.org/10.22034/IJLT.2024.446036.1329

Khodadady, E. (2014). Construct validity of c-tests: A factorial approach. Journal of Language Teaching and Research, 5(6), 1353-1362. https://doi.org/10.4304/jltr.5.6.1353-1362

Kianinezhad, N., & Kianinezhad, M. (2025). Comparative evaluation of C-test reliability using classical and modern psychometric methods. Language Education and Assessment, 8, 2279. https://doi.org/10.29140/lea.v8n1.2279

Klein-Braley, C. (1997). C-tests in the context of reduced redundancy testing: An appraisal. Language Testing, 14(1), 47-84. https://doi.org/10.1177/026553229701400104

Klein-Braley, C., & Raatz, U. (1984). A survey of research on the C-test. Language Testing, 1(2), 134-146. https://doi.org/10.1177/026553228400100202

Raish, M. (2021). Issues in Arabic Language Testing and Assessment. In K. Ryding & D. Wilmsen (Eds.), The Cambridge Handbook of Arabic Linguistics (pp. 83–105). chapter, Cambridge: Cambridge University Press

Sapawi, M. S. M., & Yusoff, N. M. R. N. (2025). Global trends in language for specific purposes curriculum development: A systematic review. Arab World English Journal,16(3),188-210. https://doi.org/10.24093/awej/vol16no3.11

Sapuan, W. N. M., Sulaiman, N. A., & Mohamad, M. (2025). The trends in the integration of AI technologies in English language teaching: Systematic literature review. Arab World English Journal, 16(3), 259-269. https://doi.org/10.24093/awej/vol16no3.15

Schnoor, B, Hartig, J., Klinger, T., Naumann, A., & Usanova, I. (2023). Measuring the development of general language skills in English as a foreign language—Longitudinal invariance of the C-test. Language Testing, 40(3), 796–819. https://doi.org/10.1177/02655322231159829

Shoahosseini, R, Baghaei, P., Khodabakhshzadeh, H., & Ashraf, H. (2024). C-Test construct validity: Evidence from nonparametric item response theory. Language Testing in Asia, 14(1). https://doi.org/10.1186/s40468-024-00279-z

Facebook
Twitter
LinkedIn
Tumblr
Reddit
Email
StumbleUpon
Digg

Siti Samihah Mohd Shamshir is a PhD candidate in Arabic Language Education at National University of Malaysia (UKM). Her research interests include syntactic complexity, T-unit analysis, Arabic textbook evaluation, and language assessment.
ORCHID ID: https://orcid.org/0009-0001-7340-0916

Prof. Dr. Nik Rahimi Nik Yusoff is a Professor at the Faculty of Education, National University of Malaysia (UKM). His academic expertise and research interests include Arabic language education, curriculum development, language pedagogy, and educational assessment. He has been extensively involved in research and supervision related to the teaching and learning of Arabic in Malaysian educational contexts.ORCHID ID: https://orcid.org/0000-0003-0605-4010

 Assoc. Prof. Dr. Harun Baharudin is an Associate Professor at the Faculty of Education, National University of Malaysia (UKM). His research interests focus on Arabic language pedagogy, applied linguistics, instructional strategies, and the evaluation of Arabic language teaching materials. His scholarly work contributes to improving Arabic language education in Malaysia.
ORCHID ID: https://orcid.org/0000-0002-6729-0044