Arab World English Journal (AWEJ) Special Issue on Artificial Intelligence, No.3. 2026. Pp.73-87

Tracing Artificial Intelligence in EFL Student Writing: A Linguistic Approach to Identifying Machine-Assisted Text in Undergraduate Writing

English Department, Faculty of Letters and Humanities
Mohamed V University, Rabat, Morocco

Corresponding Author: anass_moussa@um5.ac.ma

English Department, Faculty of Languages, letters and Arts
Ibn Tofail University, Kenitra, Morocco

Foundation unit, University of Doha for Science and Technology Qatar

Abstract:

As AI-assisted writing tools become more present in university classrooms, the nature of students’ written work in EFL contexts is quietly shifting. These developments raise new questions about who is responsible for the final text, how students build their writing abilities, and how they develop a sense of voice in their academic work. Although interest in the ethical and pedagogical implications of AI is increasing, we still know little about how and where AI-shaped textual patterns actually appear in student writing. This study investigates the linguistic and stylistic traces of AI assistance in undergraduate academic work and highlights the need for fair, transparent assessment practices and informed pedagogical support in AI-integrated learning environments. Using a qualitative corpus of 557 undergraduate texts, the study applied a three-cycle coding process supported by descriptive linguistic measures. This approach offers a detailed view of textual patterns by focusing on the features found in students’ actual writing, moving beyond the self-report surveys and tool-detection methods commonly used in earlier research. The findings reveal recurring tendencies, including reduced sentence-length variation, over-explicit cohesion, generic macro-structural framing, and a polished yet impersonal tone. These tendencies point to a mixed effect: AI tools seem to improve cohesion and linguistic accuracy, yet they can also blur students’ individual voice and weaken the texture of their arguments. The study offers evidence that can help educators and institutions make sense of AI’s growing role in student writing and develop assessment and teaching practices that fit their pedagogical and institutional realities.

Cite as:

Moussa, A., Elkhetabi, S., & Eddahmani, H. (2026). Tracing Artificial Intelligence in EFL Student Writing: A Linguistic Approach to Identifying Machine-Assisted Text in Undergraduate Writing. Arab World English Journal, Special Issue on Artificial Intelligence, (3): 73-87

References:

Alawad, E. A. (2025). Transformative assessment in academic writing: AI-based feedback systems with adaptive rubrics. Journal of Teaching English for Specific and Academic Purposes, 14(1), 141–149. https://doi.org/10.22190/JTESAP250113012A

Ali, S. (2024). Locating the intersection of generative artificial intelligence and human English writing skills: A comparative study. Arab World English Journal, 1(1), 112–123. https://doi.org/10.24093/awej/ChatGPT.7

Alsharefeen, R., & Al Sayari, N. (2025). Examining academic integrity policy and practice in the era of AI: A case study of faculty perspectives. Frontiers in Education, 10, 1621743. https://doi.org/10.3389/feduc.2025.1621743

Balalle, H., & Pannilage, S. (2025). Reassessing academic integrity in the age of AI: A systematic literature review on AI and academic integrity. Social Sciences & Humanities Open, 11, 101299. https://doi.org/10.1016/j.ssaho.2025.101299

Barrot, J. S. (2024). Leveraging ChatGPT in the writing classrooms: Theoretical and practical insights. Language Teaching Research Quarterly, 43, 43–?? (check page range). https://doi.org/10.32038/ltrq.2024.43.03
(⚠ Page range incomplete in source.)

Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa

Chan, C. K. Y. (2023). A comprehensive AI policy education framework for university teaching and learning. International Journal of Educational Technology in Higher Education, 20(1), 38. https://doi.org/10.1186/s41239-023-00408-3

Committee on Publication Ethics. (2024). Authorship and AI tools. https://doi.org/10.24318/cCVRZBms

Cowls, J., Tsamados, A., Taddeo, M., & Floridi, L. (2023). The AI gambit: Leveraging artificial intelligence to combat climate change—Opportunities, challenges, and recommendations. AI & Society, 38(1), 283–307. https://doi.org/10.1007/s00146-021-01294-x

Crosthwaite, P. (2025). Research methods in L2 writing: Interdisciplinary approaches, cutting-edge methods, and practical applications. Research Methods in Applied Linguistics, 4(2), 100211. https://doi.org/10.1016/j.rmal.2025.100211

Denzin, N. K. (2018). The qualitative manifesto: A call to arms (1st ed.). Routledge. https://doi.org/10.4324/9780429449987

Desaire, H., Chua, A. E., Isom, M., Jarosova, R., & Hua, D. (2023). Distinguishing academic science writing from humans or ChatGPT with over 99% accuracy using off-the-shelf machine learning tools. Cell Reports Physical Science, 4(6), 101426. https://doi.org/10.1016/j.xcrp.2023.101426

Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., Baabdullah, A. M., Koohang, A., Raghavan, V., Ahuja, M., Albanna, H., Albashrawi, M. A., Al-Busaidi, A. S., Balakrishnan, J., Barlette, Y., Basu, S., Bose, I., Brooks, L., Buhalis, D., … Wright, R. (2023). Opinion paper: “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management, 71, 102642. https://doi.org/10.1016/j.ijinfomgt.2023.102642

Elkhatat, A. M., Elsaid, K., & Almeer, S. (2023). Evaluating the efficacy of AI content detection tools in differentiating between human and AI-generated text. International Journal for Educational Integrity, 19(1), 17. https://doi.org/10.1007/s40979-023-00140-5

Emara, I. F. (2025). A linguistic comparison between ChatGPT-generated and nonnative student-generated short story adaptations: A stylometric approach. Smart Learning Environments, 12(1), 36. https://doi.org/10.1186/s40561-025-00388-z

Fodrey, C. N., & Girdharry, K. (Eds.); Basgier, C. R., Cole, K., Gardner, T., Helwig, M., Kim, S., Laughlin, M., Markert, N., & Rosinski, P. (Primary Authors). (2025). AWAC statement on AI and writing across the curriculum (Version 2.0). Association for Writing Across the Curriculum. https://wacassociation.org/ai-statement/

Fredrick, D. R., & Craven, L. (2025). Lexical diversity, syntactic complexity, and readability: A corpus-based analysis of ChatGPT and L2 student essays. Frontiers in Education, 10, 1616935. https://doi.org/10.3389/feduc.2025.1616935

Gosar, P., Pardasani, S., & Das, S. (2025). Stylometric fingerprinting with contextual anomaly detection for sentence-level AI authorship detection. Computer Science and Mathematics. https://doi.org/10.20944/preprints202503.1770.v1

Gotoman, J. E. J., Luna, H. L. T., Sangria, J. C. S., Santiago Jr., C. S., & Barbuco, D. D. (2025). Accuracy and reliability of AI-generated text detection tools: A literature review. American Journal of IR 4.0 and Beyond, 4(1), 1–9. https://doi.org/10.54536/ajirb.v4i1.3795

Humble, N. (2025). Higher education AI policies—A document analysis of university guidelines. European Journal of Education, 60(3), e70214. https://doi.org/10.1111/ejed.70214

Ibrahim Mugableh, A. (2024). The impact of ChatGPT on the development of vocabulary knowledge of Saudi EFL students. Arab World English Journal, 1(1), 265–281. https://doi.org/10.24093/awej/ChatGPT.18

International Center for Academic Integrity. (2024). Statement on academic integrity and artificial intelligence. https://www.academicintegrity.org/aws/ICAI/asset_manager/get_file/911250

Ji, J., Li, R., Li, S., Guo, J., Qiu, W., Huang, Z., Chen, C., Jiang, X., & Lu, X. (2024). Detecting machine-generated texts: Not just “AI vs humans” and explainability is complicated (Version 2). arXiv. https://doi.org/10.48550/ARXIV.2406.18259

Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., … Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274. https://doi.org/10.1016/j.lindif.2023.102274

Khan, H. U., Naz, A., Alarfaj, F. K., & Almusallam, N. (2025). Identifying artificial intelligence-generated content using the DistilBERT transformer and NLP techniques. Scientific Reports, 15(1), 20366. https://doi.org/10.1038/s41598-025-08208-7

Knox, J. (2025). Impact, inequality, and imagination: Envisioning a more ambitious education in the era of AI [Working paper]. University of Oxford. https://ora.ox.ac.uk/objects/uuid:bb03f5ee-1a2c-4ce1-a393-cc43163efafa/files/rwh246v216

Lee, A. V. Y. (2025). The double-edged sword of generative AI for assessment: Efficiency versus homogenization. In S. Sabbaghan (Ed.), Navigating generative AI in higher education (pp. 128–143). Edward Elgar Publishing. https://doi.org/10.4337/9781035337873.00012

Li, A. W. (2024). Bilingual returnee scholars’ identity in academic writing. Journal of Second Language Writing, 64, 101112. https://doi.org/10.1016/j.jslw.2024.101112

Liu, J., Sihes, A. J. B., & Lu, Y. (2025). How do generative artificial intelligence tools and large language models influence language learners’ critical thinking in EFL education? A systematic review. Smart Learning Environments, 12(1), 48. https://doi.org/10.1186/s40561-025-00406-0

Mahapatra, S. (2024). Impact of ChatGPT on ESL students’ academic writing skills: A mixed methods intervention study. Smart Learning Environments, 11(1), 9. https://doi.org/10.1186/s40561-024-00295-9

Malik, M., Jiang, J., & Chai, K. M. A. (2024). An empirical analysis of the writing styles of persona-assigned LLMs. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing (pp. 19369–19388). https://doi.org/10.18653/v1/2024.emnlp-main.1079

Md. Sadiq Iqbal, & Mohammod Abul Kashem. (2025). A machine learning framework for identifying sources of AI-generated text. Statistics, Optimization & Information Computing, 13(5), 2186–2204. https://doi.org/10.19139/soic-2310-5070-2225

Mekheimer, M. (2025). Generative AI-assisted feedback and EFL writing: A study on proficiency, revision frequency and writing quality. Discover Education, 4(1), 170. https://doi.org/10.1007/s44217-025-00602-7

Milička, J., Marklová, A., & Cvrček, V. (2025). Benchmark of stylistic variation in LLM-generated texts (Version 2). arXiv. https://doi.org/10.48550/ARXIV.2509.10179

Moussa, A., & Belhiah, H. (2024). Beyond syntax: Exploring Moroccan undergraduate EFL learners with AI-assisted writing. Arab World English Journal, 1(1), 138–155. https://doi.org/10.24093/awej/ChatGPT.9

Muñoz-Ortiz, A., Gómez-Rodríguez, C., & Vilares, D. (2024). Contrasting linguistic patterns in human and LLM-generated news text. Artificial Intelligence Review, 57(10), 265. https://doi.org/10.1007/s10462-024-10903-2

Opara, C. (2024). StyloAI: Distinguishing AI-generated content with stylometric analysis. In A. M. Olney, I.-A. Chounta, Z. Liu, O. C. Santos, & I. I. Bittencourt (Eds.), Artificial intelligence in education: Posters and late breaking results… (Vol. 2151, pp. 105–114). Springer Nature. https://doi.org/10.1007/978-3-031-64312-5_13

Opara, C. (2025). Distinguishing AI-generated and human-written text through psycholinguistic analysis (Version 1). arXiv. https://doi.org/10.48550/ARXIV.2505.01800

Patton, M. Q. (2014). Qualitative research & evaluation methods: Integrating theory and practice. Sage.

Perkins, M., Roe, J., Vu, B. H., Postma, D., Hickerson, D., McGaughran, J., & Khuat, H. Q. (2024). Simple techniques to bypass GenAI text detectors: Implications for inclusive education. International Journal of Educational Technology in Higher Education, 21(1), 53. https://doi.org/10.1186/s41239-024-00487-w

Polakova, P., & Ivenz, P. (2024). The impact of ChatGPT feedback on the development of EFL students’ writing skills. Cogent Education, 11(1), 2410101. https://doi.org/10.1080/2331186X.2024.2410101

Pratama, A. R. (2025). The accuracy–bias trade-offs in AI text detection tools and their impact on fairness in scholarly publication. PeerJ Computer Science, 11, e2953. https://doi.org/10.7717/peerj-cs.2953

Rahman, M. A., Handrianto, C., Kenedi, A. K., Ilhami, A., & Ghafar, Z. N. (2024). Exploring the interplay between writing practices and identity formation in academic contexts. Journal of Digital Learning and Distance Education, 2(12), 838–848. https://doi.org/10.56778/jdlde.v2i12.238

Reinhart, A., Markey, B., Laudenbach, M., Pantusen, K., Yurko, R., Weinberg, G., & Brown, D. W. (2025). Do LLMs write like humans? Variation in grammatical and rhetorical styles. Proceedings of the National Academy of Sciences, 122(8), e2422455122. https://doi.org/10.1073/pnas.2422455122

Reviriego, P., Conde, J., Merino-Gómez, E., Martínez, G., & Hernández, J. A. (2024). Playing with words: Comparing the vocabulary and lexical diversity of ChatGPT and humans. Machine Learning with Applications, 18, 100602. https://doi.org/10.1016/j.mlwa.2024.100602

Saldaña, J. (2021). Coding techniques for quantitative and mixed data. In The Routledge reviewer’s guide to mixed methods analysis (p. 151).

Seo, J.-Y. (2024). Exploring the educational potential of ChatGPT: AI-assisted narrative writing for EFL college students. Language Teaching Research Quarterly, 43, 1–21. https://doi.org/10.32038/ltrq.2024.43.01

Söğüt, S. (2024). Generative artificial intelligence in EFL writing: A pedagogical stance of pre-service teachers and teacher trainers. Focus on ELT Journal, 58–73. https://doi.org/10.14744/felt.6.1.5

Song, C., & Song, Y. (2023). Enhancing academic writing skills and motivation: Assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students. Frontiers in Psychology, 14, 1260843. https://doi.org/10.3389/fpsyg.2023.1260843

Waked, A. N., Abdelsalam, H., Ashraf, M. W., Pilotti, M., & El Alaoui, K. (2024). The impact of falsely detecting AI-generated text on academic assessment. In M. Shelley & O. T. Ozturk (Eds.), Proceedings of ICRES 2024—International Conference on Research in Education and Science (pp. 573–586). ISTES.

Wang, H., & Dang, A. (2024). Enhancing L2 writing with generative AI: A systematic review of pedagogical integration and outcomes. https://doi.org/10.13140/RG.2.2.19572.16005

Watson, S., Brezovec, E., & Romic, J. (2025). The role of generative AI in academic and scientific authorship: An autopoietic perspective. AI & Society, 40(5), 3225–3235. https://doi.org/10.1007/s00146-024-02174-w

Weber-Wulff, D., Anohina-Naumeca, A., Bjelobaba, S., Foltýnek, T., Guerrero-Dib, J., Popoola, O., Šigut, P., & Waddington, L. (2023). Testing of detection tools for AI-generated text. International Journal for Educational Integrity, 19(1), 26. https://doi.org/10.1007/s40979-023-00146-z

Wu, H., Li, D., & Mo, X. (2025). Understanding GAI risk awareness among higher vocational education students: An AI literacy perspective. Education and Information Technologies, 30(10), 14273–14304. https://doi.org/10.1007/s10639-024-13312-8

Facebook
Twitter
LinkedIn
Tumblr
Reddit
Email
StumbleUpon
Digg

Anass Moussa is a currently the director of the center for Languages, Academic and Soft Skills at the International University of Rabat, Morocco. Dr. Anass has previously taught in the Kingdom of Saudi Arabia, The UAE and Morocco. His research interests include foreign language teaching/learning, assessment, feedback, and quality assurance in higher education.
ORCID : https://orcid.org/0009-0000-3609-668X

 Sarra Elkhetabi is a high school English teacher and a PhD candidate in Applied Linguistics at Ibn Tofail University, Kenitra. She holds a Master’s degree in Linguistics and Advanced English Studies from Cadi Ayyad University. Her research interests include language development, soft skills enhancement, and the integration of AI in education. https://orcid.org/0009-0001-3047-1749

Elhassan Eddahmani is an Assistant Professor at the University of Doha for Science and Technology, specializing in applied linguistics and English language pedagogy. His research explores AI influence on learner writing, discourse analysis, and academic literacy. Dr. Elhassan has authored and vetted numerous curriculum materials in higher education. His current scholarship focuses on tracing AI in EFL student writing. https://orcid.org/0000-0001-7730-4756