Views: 1,214
Arab World English Journal (AWEJ) Special Issue on Artificial Intelligence, No 3. 2026. Pp.118-131
Department of English Language and Literature
College of Languages and Humanities
Qassim University, Buraydah, Saudi Arabia
This study investigated the differences between Artificial Intelligence (AI) and traditional assessment techniques in evaluating university students’ writing assignments, focusing on grammar, spelling, vocabulary, article usage, and writing mechanics. The research aimed to assess the accuracy of both methods, save instructors’ time, and address a gap in the literature. Fifty freshmen university students enrolled in a writing class (AHEE 101) at Qassim University participated. A mixed-methods comparative design was employed, where students’ writing was evaluated using both traditional grading and the AI tool QuillBot. Statistical analysis, specifically t-tests, showed no statistically significant difference in the overall writing scores between the two assessment methods (p > 0.05). However, a detailed comparative analysis of individual writing components (grammar, spelling, vocabulary, article use, punctuation, and capitalization) revealed that the AI tool demonstrated a notable advantage in error detection accuracy. These findings suggest that AI can be a valid and effective supplementary tool for evaluating student writing. The study recommends that educators consider integrating AI into their assessment processes to enhance accuracy and effectiveness. Future research should include longitudinal studies to assess the long-term impact of AI-based feedback on students’ writing development.
Alolaywi, Y. (2026). Assessing Writing Outcomes: A Comparative Study of Artificial Intelligence Versus Traditional Assessment Techniques. Arab World English Journal, Special Issue on Artificial Intelligence, (3): 118-131
Ali, O., Murray, P., Momin, M., Dwivedi, Y., & Malik, T. (2024). The effects of artificial intelligence applications in educational settings: Challenges and strategies. Technological Forecasting and Social Change, 199, https://doi.org/10.1016/j.techfore.2023.123076
Aljohani, M. (2017). Principles of constructivism in foreign language teaching. Journal of Literature and Art Studies, 7(1), 97–107. DOI:10.17265/2159-5836/2017.01.013
Alshehri, M. (2025). Integrating automated writing evaluation into Saudi EFL students’ writing practice. Arab World English Journal, 16(1), 70-87. DOI: https://dx.doi.org/10.24093/awej/vol16no1.5
Amyatun, R. L., & Kholis, A. (2023). Can artificial intelligence (AI) like QuillBot AI assist students’ writing skills? Assisting learning to write texts using AI. ELE Reviews: English Language Education Reviews, 3(2), 135–154. https://doi.org/10.22515/elereviews.v3i2.7533
Bucol, J. L., & Sangkawong, N. (2024). Exploring ChatGPT as a writing assessment tool. Innovations in Education and Teaching International, 62(3), 867–882. https://doi.org/10.1080/14703297.2024.2363901
Darwin, W., Rusdin, D., Mukminatien, N., Suryati, N., Laksmi, E. D., & Marzuki. (2023). Critical thinking in the AI era: An exploration of EFL students’ perceptions, benefits, and limitations. Cogent Education, 11(1). https://doi.org/10.1080/2331186X.2023.2290342
Duffy, T. M., & Jonassen, D. H. (1992). Constructivism and the technology of instruction: A conversation. New Jersey: Lawrence Erlbaum Associates.
Elmotri, B., Harizi, R., Boujlida, A., Elyasa, Y. M., Garrouri, S., Amri, F., Malik, F. H., & Al-humari, M.A. (2025). The Impact of AI-Generated Feedback Explicitness. Arab World English Journal, 16(1):384-402. DOI: https://dx.doi.org/10.24093/awej/vol16no1.24
Fombona, J., Sáez, J., Sánchez, S. (2025). Artificial intelligence and robotics in education: Advances, challenges, and future perspectives. Social Sciences & Humanities Open, 11, https://doi.org/10.1016/j.ssaho.2025.101533
Fosnot, C., & Perry, R. (2005). Constructivism: A psychological theory of learning. Retrieved from http://beyondbitsandatoms.org/readings/fosnot_constructivism_1996.pdf
González-Calatayud, V., Prendes-Espinosa, P., & Roig-Vila, R. (2021). Artificial intelligence for student assessment: A systematic review. Applied Sciences, 11(12), 5467. https://doi.org/10.3390/app11125467
Gruber, H. E., & Vonèche, J. J. (1995). The essential Piaget. An interpretive reference and guide. New Jersey: Aronson.
Jiang, Z., Xu, Z., Pan, Z., He, J., & Xie, K. (2023). Exploring the role of artificial intelligence in facilitating assessment of writing performance in second language learning. Languages, 8, 247. https://doi.org/10.3390/languages8040247
Johns, P. (2022). An evaluation of traditional and AI-based writing assessments. Journal of Educational Measurement, 58(3), 145-162. https://doi.org/10.1177/00205770221100900
Kaharuddin, K. (2021). Assessing the effect of using artificial intelligence on the writing skill of Indonesian learners of English. Linguistics and Culture Review, 5(1), 288-304. https://doi.org/10.37028/lingcure.v5n1.1555
Khalifa, M., & Albadawy, M. (2024). Using artificial intelligence in academic writing and research: An essential productivity tool. Computer Methods and Programs in Biomedicine Update, 5. https://doi.org/10.1016/j.cmpbup.2024.100145
Li, J., Jangamreddy, N. K., Hisamoto, R. , Bhansali, R., Dyda, A., Zaphir, L ., & Glencross, M. (2024). AI-assisted marking: Functionality and limitations of ChatGPT in written assessment evaluation. Australasian Journal of Educational Technology, 40(4), 56–72. https://doi.org/10.14742/ajet.9463
Made, I., Antara, A. R., Putu, N., & Anggreni, Y. (2024). Utilizing artificial intelligence to evaluate students’ competency in writing simple past tense. Stilistika: Jurnal Pendidikan Bahasa dan Seni, 12(2), 126-140. https://doi.org/10.59672/stilistika.v12i2.3691
Mekheimer, M. (2025). Generative AI‑assisted feedback and EFL writing: A study on proficiency, revision frequency and writing quality. Discover Education 4(170), https://doi.org/10.1007/s44217-025-00602-7
Rad, H. S., Alipour, R., & Jafarpour, A. (2023). Using artificial intelligence to foster students’ writing feedback literacy, engagement, and outcome: A case of Wordtune application. Interactive Learning Environments, 32(9), 5020-5040. https://doi.org/10.1080/10494820.2023.2208170
Teng, M. F. (2024). A Systematic review of ChatGPT for English as a foreign language writing: Opportunities, challenges, and recommendations. International Journal of TESOL Studies, 6(3) 36-57. https://doi.org/10.58304/ijts.20240304
Tran, T. T. T. (2025). Enhancing EFL writing revision practices: the impact of AI-and teacher-generated feedback and their sequences. Education Sciences, 15(2), 232. https://doi.org/10.3390/ educsci15020232
Wang, Z. (2022). Computer-assisted EFL writing and evaluations based on artificial intelligence: A case from a college reading and writing course. Library Hi Tech, 40(1), 80-97. https://doi.org/10.1108/LHT-05-2020-0113
Dr. Yasamiyan Alolaywi is an Associate Professor of Applied Linguistics at Qassim University, Saudi Arabia. Her research focuses on applied linguistics and pedagogy. Dr. Alolaywi has published her work in prestigious journals and has actively participated in various linguistics conferences. ORCID ID: https://orcid.org/0000-0003-2749-7558