Cognitive Diagnostic Assessment for IELTS Speaking Skills: A Chinese High School Case Study

References:

Abdulaal, M.A.AD., Alenazi, M.H., Tajuddin, A.J.A. et al. Dynamic vs. diagnostic assessment: impacts on EFL learners’ speaking fluency and accuracy, learning anxiety, and cognitive load. Language Testing in Asia 12, 32 (2022). https://doi.org/10.1186/s40468-022-00179-0

Ahmadi, D. M. R. (2018). The use of technology in English language learning: A literature review. IJREE, 3(2). Retrieved from http://ijreeonline.com/article-1-120-en.html

Bachman, L. F. (1990). Fundamental considerations in language testing. Oxford University Press.

Barghi, B., Afshinfar, J., Alavi, S. M., Jafarigohar, M., & Soleimani, H. (2025). An Exploratory Mixed Methods Study of Grammatical Range and Accuracy in IELTS: A True Diagnostic Approach to Cognitive Diagnostic Assessment. International Journal of Language Testing, (3), 19-42. http://10.22034/ijlt.2024.481434.1374

Bogachevska, L. O. (2022). Passing of IELTS and preparation for its speaking section as an initial stage of students’ integration in the global higher education area. Transcarpathian Philological Studies, 1(26), 87–92. Retrieved from http://zfs-journal.uzhnu.uz.ua/archive/26/part_1/17.pdf

Borger, L. (2019). Evaluating a high-stakes EFL speaking test: Teachers’ practices and views. Moderna Språk, 113(1), 25–57. https://doi.org/10.58221/mosp.v113i1.7621

Bowen, G. A. (2009). Document analysis as a qualitative research method. Qualitative Research Journal, 9(2), 27–40. https://doi.org/10.3316/QRJ0902027

Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa

Brown, A. (2006a). Candidate discourse in the revised IELTS Speaking Test. IELTS Research Reports (Vol. 6, pp. 1–19). IELTS Australia and British Council. Retrieved from https://www.ielts.org/pdf/Volume%206,%20Report%203.pdf

Brown, A. (2006b). An examination of the rating process in the revised IELTS Speaking Test. IELTS Research Reports (Vol. 6, pp. 1–30). IELTS Australia and British Council. Retrieved from http://www.ielts.org/PDF/Vol6_Report2.pdf

Bui, H. P. (2024). Contextualizing synchronous online EFL classroom assessment: A face-saving perspective. Education and Information Technologies, 29, 24941–24961. https://doi.org/10.1007/s10639-024-12849-y

Cheng, L., & Curtis, A. (Eds.). (2010). English language assessment and the Chinese learner (1st ed.). Routledge. https://doi.org/10.4324/9780203873045

Chen, Y., & Wu, X. (2022). Validation of the results of linking the speaking test of IELTS to China\u2019s Standards of English Language Ability. English Language Teaching, 15(7), 75–85. https://doi.org/10.5539/elt.v15n7p75

Cheng, X., Zhang, L. J., & Yan, Q. (2021). Exploring teacher written feedback in EFL writing classrooms: Beliefs and practices in interaction. Language Teaching Research, 29(1), 136216882110576. https://doi.org/10.1177/13621688211057665

Claramita, M., Nurokhmanti, H., Qomariyah, N., Budiastuti, V. I., Utomo, P. S., & Findyartini, A. (2022). Facilitating student-centered learning: In the context of social hierarchies and collectivistic culture. In M. Claramita, A. Findyartini, D. D. Samarasekera, & H. Nishigori (Eds.), Challenges and opportunities in health professions education. Springer. https://doi.org/10.1007/978-981-16-7232-3_2

Council of Europe. (2001). Common European Framework of Reference for Languages: Learning, teaching, assessment. Cambridge University Press. https://www.coe.int/en/web/common-european-framework-reference-languages

Creswell, J. W. (2013). Qualitative inquiry and research design: Choosing among five approaches (3rd ed.). SAGE Publications.

Creswell, J. W., & Miller, D. L. (2000). Determining validity in qualitative inquiry. Theory Into Practice, 39(3), 124–130. https://doi.org/10.1207/s15430421tip3903_2

Creswell, J. W., & Poth, C. N. (2018). Qualitative inquiry and research design: Choosing among five approaches (4th ed.). SAGE Publications.

Csapó, B., & Molnár, G. (2019). Online diagnostic assessment in support of personalized teaching and learning: The eDia system. Frontiers in Psychology, 10, 1522. https://doi.org/10.3389/fpsyg.2019.01522

Dashti, L., & Razmjoo, S. A. (2020). An examination of IELTS candidates’ performances at different band scores of the speaking test: A quantitative and qualitative analysis. Cogent Education, 7(1). https://doi.org/10.1080/2331186X.2020.1770936

Ellis, R. (2003). Task-based language learning and teaching. Oxford University Press.

Etikan, I., Musa, S. A., & Alkassim, R. S. (2016). Comparison of convenience sampling and purposive sampling. American Journal of Theoretical and Applied Statistics, 5(1), 1–4. https://doi.org/10.11648/j.ajtas.20160501.11

Fleming, K., & Shinjee, B. (2024). English high-stakes testing and constructing the ‘international’ in Kazakhstan and Mongolia. Applied Linguistics Review, 15(4), 1253–1275. https://doi.org/10.1515/applirev-2022-0067

Gagen, T., & Faez, F. (2024). The predictive validity of IELTS scores: a meta-analysis. Higher Education Research & Development, 43(4), 873-888. https://doi.org/10.1080/07294360.2023.2280700

Gao, L. (2021). A review of multidimensional studies on the causes of classroom reticence. IRA-International Journal of Education & Multidisciplinary Studies, 17(2), 45–53. https://dx.doi.org/10.21013/jems.v17.n2.p1

Gebril, A. (Ed.). (2022). Learning-oriented language assessment: Putting theory into practice. Studies in Language Assessment. https://doi.org/10.58379/PBMV5990

Ginting, R. S., Dalimunthe, A., Dalimunthe, M. R., & Adelita, D. (2023). A critical review of IELTS speaking test. Journal of Linguistics, Literature and Language Teaching, 9(2), 138–155. https://doi.org/10.32505/jl3t.v9i2.7161

Hajiabdorrasouli, L., & Ahmadi, A. (2023). “Others have scored the same as me; do you want to change it”? Exploring rater dominance in negotiation rating sessions of EFL writing. Iranian Journal of English for Academic Purposes, 12(2), 87-106. https://doi.org/20.1001.1.24763187.2023.12.3.6.8

He, L., Xiong, L., & Min, S. (2022). Diagnosing listening and reading skills in the Chinese EFL context: Performance stability and variability across modalities and performance levels. System, 106, 102787. https://doi.org/10.1016/j.system.2022.102787

Heidari Vincheh, M., Mirzaei, A., & Roohani, A. (2024). A cognitive diagnostic approach to the IELTS speaking test: Unveiling the subskills and test-takers’ perceptions. Language Testing in Asia, 14, 42. https://doi.org/10.1186/s40468-024-00311-2

Hofstede, G. (1986). Cultural differences in teaching and learning. International Journal of Intercultural Relations, 10(3), 301–320. https://doi.org/10.1016/0147-1767(86)90015-5

Hu, M. (2019). The relationship between English phonological awareness of Chinese English learners and their English skills. Theory and Practice in Language Studies, 9(1), 45-51. https://doi.org/10.17507/tpls.0901.07

Huang, M. (2024). Empowering oral proficiency in a large-scale class: Video-recorded oral presentations and mobile-assisted peer assessment in a Chinese middle school. Computer Assisted Language Learning, 1(1), 1–21. https://doi.org/10.1080/09588221.2024.2382851

Huang, J., Li, J., Shu, T. and Zhang, Y. (2022) A mixed-methods national study investigating key challenges in learning English as a foreign language:A Chinese college student perspective. Frontier Psychology,13:1035819. https://doi.org/10.3389/fpsyg.2022.1035819

Ismail, S. M., Rahul, D. R., Patra, I., & Rezvani, E. (2022). Formative vs. summative assessment: Impacts on academic motivation, attitude toward learning, test anxiety, and self-regulation skill. Language Testing in Asia, 12(1), 40. https://doi.org/10.1186/s40468-022-00191-4

Jang, E. E. (2008). A framework for cognitive diagnostic assessment. In C. A. Chapelle, Y.-R. Chung, & J. Xu (Eds.), Towards adaptive CALL: Natural language processing for diagnostic language assessment (pp. 117–131). Ames, IA: Iowa State University.

Javidanmehr, Z., & Anani Sarab, M. R. (2017). Cognitive diagnostic assessment: Issues and considerations. International Journal of Language Testing, 7(2), 73–98.

Jin, C. (2023). The future is in the making: A review of literature on dynamic assessment in second language education. Cambridge Educational Research e-Journal, 10, 1–13. https://doi.org/10.17863/CAM.104605

Jin, C., & Liu, Y. (2024). Diagnosing and promoting learners’ L2 inferential reading development through hybrid computerized dynamic assessment in the Chinese EFL classroom. Computer Assisted Language Learning, 41(1), 1–24. https://doi.org/10.1080/09588221.2024.2421521

Kafipour, R., & Khoshnood, A. (2023). Effect of feedback through dynamic assessment on EFL field-dependent and field-independent learners’ speaking skill development. Frontiers in Education, 8,  https://doi.org/10.3389/feduc.2023.1049680

Karim, S., & Haq, N. (2014). An assessment of IELTS speaking test. International Journal of Evaluation and Research in Education, 3(3), 152–157.

Kuo, B. C., Chen, C. H., Yang, C. W., & Mok, M. M. C. (2016). Cognitive diagnostic models for tests with multiple-choice and constructed-response items. Educational Psychology, 36(6), 1115–1133. https://doi.org/10.1080/01443410.2016.1166176

Kvale, S., & Brinkmann, S. (2015). Interviews: Learning the craft of qualitative research interviewing (3rd ed.). Sage Publications.

Lam, D. M. K., Galaczi, E., Nakatsuhara, F., & May, L. (2023). Assessing interactional competence: Exploring ratability challenges. Applied Pragmatics, 5(2), 208-233. https://doi.org/10.1075/ap.00014.lam

Leighton, J. P., & Gierl, M. J. (Eds.). (2007). Cognitive diagnostic assessment for education: Theory and applications. Cambridge University Press. https://doi.org/10.1017/CBO9780511611186

Leighton, J. P., Gokiert, R. J., Cor, M. K., & Heffernan, C. (2010). Teacher beliefs about the cognitive diagnostic information of classroom- versus large-scale tests: Implications for assessment literacy. Assessment in Education: Principles, Policy & Practice, 17(1), 7–21. https://doi.org/10.1080/09695940903565362

Li, J. (2019). An evaluation of IELTS speaking test. Open Access Library Journal, 6, 1–17. https://doi.org/10.4236/oalib.1105935

Li, Y., Zhen, M. and Liu, J. (2021) Validating a Reading Assessment Within the Cognitive Diagnostic Assessment Framework: Q-Matrix Construction and Model Comparisons for Different Primary Grades. Frontier Psychology 12:786612. https://10.3389/fpsyg.2021.786612

Liu, J., & Xu, Y. (2017). Assessment for learning in English language classrooms in China: Contexts, problems, and solutions. In H. Reinders, D. Nunan, & B. Zou (Eds.), Innovation in language learning and teaching: New language learning and teaching environments (pp. 125–145). Palgrave Macmillan. https://doi.org/10.1057/978-1-137-60092-9_2

Liu, Z. (2024). Effects of nonlinear dynamic online assessment model on language learners’ learning outcomes and cognitive load. Education and Information Technologies, 29, 24255–24284. https://doi.org/10.1007/s10639-024-11592-7

Ma, H., & Chong, S. W. (2022). Predictability of IELTS in a high-stakes context: A mixed methods study of Chinese students’ perspectives on test preparation. Language Testing in Asia, 12, 2. https://doi.org/10.1186/s40468-021-00152-3

Mayer, R. E. (Ed.). (2014). The Cambridge handbook of multimedia learning (2nd ed.). Cambridge University Press. https://doi.org/10.1017/CBO9781139547369

Mehraban, B. (2022). Assessing English Proficiency in the Age of Globalization : The Case of IELTS (Dissertation). Retrieved from https://urn.kb.se/resolve?urn=urn:nbn:se:lnu:diva-113738

Mei, H., & Chen, H. (2024). Cognitive diagnosis in language assessment: A thematic review. RELC Journal, 55(2), 529–537. https://doi.org/10.1177/00336882221122357

Merriam, S. B., & Tisdell, E. J. (2016). Qualitative research: A guide to design and implementation (4th ed.). Jossey-Bass.

Minakova, V. (2020). Dynamic assessment of IELTS speaking: A learning-oriented approach to test preparation. Language and Sociocultural Theory, 6(2), 184-212.

Min, S., & He, L. (2021). Developing individualized feedback for listening assessment: Combining standard setting and cognitive diagnostic assessment approaches. Language Testing, 39(1), 90-116. https://doi.org/10.1177/0265532221995475 (Original work published 2022)

Nakatsuhara, F., Inoue, C., Berry, V., & Galaczi, E. (2017). Exploring the use of video-conferencing technology in the assessment of spoken language: A mixed-methods study. Language Assessment Quarterly, 14(1), 1–18. https://doi.org/10.1080/15434303.2016.1263637

Panahi, A., & Mohebbi, H. (2022). Cognitive diagnostic assessment of IELTS listening: Providing feedback from its internal structure. Language Teaching Research Quarterly, 28, 147-165. https://doi.org/10.32038/ltrq.2022.29.10

Palinkas, L. A., Horwitz, S. M., Green, C. A., Wisdom, J. P., Duan, N., & Hoagwood, K. (2015). Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Administration and Policy in Mental Health, 42(5), 533–544. https://doi.org/10.1007/s10488-013-0528-y

Poehner, M. E., & Lantolf, J. P. (2022). Advancing L2 Dynamic Assessment: Innovations in Chinese Contexts. Language Assessment Quarterly, 20(1), 1–19. https://doi.org/10.1080/15434303.2022.2158465

Poehner, M. E., & Wang, Z. (2020). Dynamic assessment and second language development. Language Teaching, 54(4), 1–19. https://doi.org/10.1017/S0261444820000555

Quaid, E. D. (2018). Reviewing the IELTS speaking test in East Asia: theoretical and practice-based insights. Language Testing in Asia, 8(2). https://doi.org/10.1186/s40468-018-0056-5

Ramalingam, S., Yunus, M. M., & Hashim, H. (2021). Exploring ESL learners’ blended learning experiences and its’ effectiveness through web-based technologies. International Journal of Evaluation and Research in Education (IJERE), 10(4), 1436-1445. https://doi.org/10.11591/ijere.v10i4.21465

Ravand, H., & Robitzsch, A. (2018). Cognitive diagnostic model of best choice: A study of reading comprehension. Educational Psychology, 38(10), 1255–1277. https://doi.org/10.1080/01443410.2018.1489524

Read, J. (2022). Test review: The International English Language Testing System (IELTS). Language Testing, 39(4), 679–694. https://doi.org/10.1177/02655322221086211

Shi, X., Ma, X., Du, W., & Gao, X. (2024). Diagnosing Chinese EFL learners’ writing ability using polytomous cognitive diagnostic models. Language Testing, 41(1), 109–134. https://doi.org/10.1177/02655322231162840

Shiny, K. G., & Karthikeyan, J. (2022). Outlining international English language proficiency tests: A survey-based study on its need, purpose, and scope in the backdrop of migration. Journal for Educators, Teachers and Trainers, 13(4), 198–206. https://doi.org/10.47750/jett.2022.13.04.029

Silva Moreira J, Costa Ferreira P, Veiga Simão AM (2024) Fostering self-regulated learning in preschool through dynamic assessment methodologies. PLoS ONE 19(3): e0298759. https://doi.org/10.1371/journal.pone.0298759

Souzandehfar, M. (2024). New perspectives on IELTS authenticity: An evaluation of the speaking module. International Journal of Language Testing, 14(1), 34–55. https://doi.org/10.22034/ijlt.2023.409599.1272

Suss, M. (2023). Examining the reliability of the International English Language Testing System design. Bulletin of Advanced English Studies, 8(2), 72–92. https://doi.org/10.31559/BAES2023.8.2.4

Tang, F., & Zhan, P. (2021). Does diagnostic feedback promote learning? Evidence from a longitudinal cognitive diagnostic assessment. AERA Open, 7, 1–10. https://doi.org/10.1177/23328584211060804

Templin, J. L., & Henson, R. A. (2009). Measurement of psychological disorders using cognitive diagnosis models. Psychological Methods, 11(3), 287–305.

Tiu, J. S., Groenewald, E. S., Kilag, O. K. T., Balicoco, R. D., Wenceslao, S. B., & Asentado, D. E. (2023). Enhancing oral proficiency: Effective strategies for teaching speaking skills in communication classrooms. Excellencia International Multi-disciplinary Journal of Education, 1(6), 343-354.

Zhang, Z. (2021). Promoting student engagement with feedback: Insights from collaborative pedagogy and teacher feedback. Assessment & Evaluation in Higher Education, 47(4), 540–555. https://doi.org/10.1080/02602938.2021.1933900

Wang, J., An, N., & Wright, C. (2018). Enhancing beginner learners’ oral proficiency in a flipped Chinese foreign language classroom. Computer Assisted Language Learning, 31(5–6), 490–521. https://doi.org/10.1080/09588221.2017.1417872

Woolridge, L. R., Leach, A.-M., Blake, C., & Elliott, E. (2023). Do Accents Speak Louder Than Words? Perceptions of Linguistic Speech Characteristics on Deception Detection. Journal of Language and Social Psychology, 43(2), 195-223. https://doi.org/10.1177/0261927X231209428

Xin, S., & Luxmon, H. (2023). Developing individualized feedback for listening assessment: Combining standard setting and cognitive diagnostic assessment approaches. Educational Psychology, 29(1). https://doi.org/10.1177/02655322199547

Pang, Y., Hashim, H., & Said, N. E. M. (2024). Learning Strategies for Chinese as Foreign Language Learners in College: A Qualitative Study. Forum for Linguistic Studies, 6(4), 463–473. https://doi.org/10.30564/fls.v6i4.6795

Zhai, X., Haudek, K.C. & Ma, W. Assessing Argumentation Using Machine Learning and Cognitive Diagnostic Modeling. Research Science in Education, 53, 405–424 (2023). https://doi.org/10.1007/s11165-022-10062-w

Zhang, X. (2024). English language assessment practices in Chinese universities: A critical examination of testing methods and their implications for student learning. SHS Web of Conferences, 199, Article 01005. https://doi.org/10.1051/shsconf/202419901005

Zhorova, I. Y., Kokhanovska, O. V., Khudenko, O. M., Osypova, N. V., & Kuzminska, O. H. (2022). Teachers’ training for the use of digital tools of the formative assessment in the implementation of the concept of the New Ukrainian School. Educational Technology Quarterly, 2022(1), 56-72. https://doi.org/10.55056/etq.11

Zimmerman, B. J. (2002). Becoming a self-regulated learner: An overview. Theory Into Practice, 41(2), 64–70. https://doi.org/10.1207/s15430421tip4102_2