Arab World English Journal (AWEJ) Special Issue on CALL Number 10. July 2024 Pp.3- 14

Challenges and Strategies for Using ChatGPT in Written Communication Assignments: A Study of University Students in Malaysia

School of Arts, Department of English Language and Literature/Translation
Jadara University , Jordan

Faculty of Languages and Communication
Universiti Sultan Zainal Abidin, Malaysia

Department of Mass Communication
Federal University Lapia, Nigeria

Faculty of Language Studies and Human Development
Universiti Malaysia Kelantan, Malaysia

Ahmad Taufik Hidayah Abdullah

Faculty of Languages and Communication
Universiti Sultan Zainal Abidin, Malaysia

Faculty of Languages and Communication
Universiti Sultan Zainal Abidin, Malaysia

Abstract:

The development of generative Artificial Intelligence (AI) models, particularly ChatGPT, has gained considerable attention among academics and researchers in recent years. Research shows that ChatGPT can be a vital means of increasing students’ writing performance. However, students may face difficulties in developing effective strategies to incorporate ChatGPT-generated content into written tasks. Therefore, this study sought to examine the challenges and strategies employed by students to use ChatGPT-generated responses for written communication assignments. The study utilized a quantitative method, using a descriptive survey technique. A self-developed questionnaire was used to gather data from a sample of 59 communication students at a Malaysian public university. The data were examined through descriptive statistics and Pearson correlation analysis. According to the findings, students face various challenges in using ChatGPT-generated responses, such as the inability to express unique writing skills, dealing with inaccurate citation formats, as well as difficulty revising ChatGPT-generated responses. The students also employ certain relevant strategies for using ChatGPT-generated responses, such as adding ideas to already generated ChatGPT content, using ChatGPT as a means of idea generation, paraphrasing ChatGPT-generated responses, and replacing ChatGPT-generated words with synonyms. Accordingly, the analysis showed a significant association between students’ challenges and the strategies they employ to utilize ChatGPT-generated responses. This study provides valuable information that can help educators and relevant authorities review and reinforce institutional policies for quality higher education, particularly in the Malaysian context.

Cite as:

Younes, Z. B. B., Hassan, I.,  Umar, M.M., Mustafa, N. H., Abdullah, A.T.h., & Azmi, M. N.L. (2024). Challenges and Strategies for Using ChatGPT in Written Communication Assignments: A Study of University Students in Malaysia. Arab World English Journal (AWEJ) Special Issue on CALL (10). 3- 14.

References:

Adeshola, I., & Adepoju, A. P. (2023). The opportunities and challenges of ChatGPT in education. Interactive Learning Environments, 22(1), 1-14.
doi: 10.1080/10494820.2023.2253858

Alexander, K., Savvidou, C., & Alexander, C. (2023). Who Wrote This Essay? Detecting AI-Generated Writing in Second Language Education in Higher Education. Teaching English with Technology, 23(2), 25-43.

Ali, J. (2023). Benefits and challenges of using ChatGPT: An exploratory study on English language program. University of Bisha Journal for Humanities, 2(2), 629-641.

Al-Zubaidi, K., Jaafari, M., & Touzani, F. Z. (2024). Impact of ChatGPT on Academic Writing at Moroccan Universities. Arab World English Journal (AWEJ) Special Issue on ChatGPT, 2-25. Doi: 10.24093/awej/ChatGPT.1

Annamalai, N., Ab Rashid, R., Hashmi, U. M., Mohamed, M., Alqaryouti, M. H., & Sadeq, A. E. (2023). Using chatbots for English language learning in higher education. Computers and Education: Artificial Intelligence, 5(1), 1-9.doi:10.1016/j.caeai.2023.100153

Annamalai, N., Kabilan, M. K., Ab Rashid, R., Valūnaitė-Oleškevičienė, G., & Vaičiūnienė, V. (2021). English language learning through non-technology games: A case study of international students at a Lithuanian university. Qualitative report, 26(10), 3261-3278.

Avsheniuk, N., Lutsenko, O., Svyrydiuk, T., & Seminikhyna, N. (2024). Empowering Language Learners’ Critical Thinking: Evaluating ChatGPT’s Role in English Course Implementation. Arab World English Journal (AWEJ) Special Issue on ChatGPT,  210-224, Doi:10.24093/awej/ChatGPT.14

Barrot, J. S. (2023). Using ChatGPT for second language writing: Pitfalls and potentials. Assessing Writing, 57, 100745.doi: 10.1016/j.asw.2023.100745

Baskara, F. R. (2023). Integrating ChatGPT into EFL writing instruction: Benefits and challenges. International Journal of Education and Learning, 5(1), 44-55.doi: 10.31763/ijele.v5i1.858

Bernius, J. P., Krusche, S., & Bruegge, B. (2022). Machine learning-based feedback on textual student answers in large courses. Computers and Education: Artificial Intelligence, 3, 100081. https://doi.org/10.1016/j.caeai.2022.100081

Biswas, S. S. (2023). Role of ChatGPT in public health. Annals of Biomedical Engineering, 51(5), 868-869.doi: 10.1007/s10439-023-03172-7

Cascella, M., Montomoli, J., Bellini, V., & Bignami, E. (2023). Evaluating the feasibility of ChatGPT in healthcare: An analysis of multiple clinical and research scenarios. Journal of Medical Systems, 47(1), 1-5. https://doi.org/10.1007/s10916-023-01925-4

Creswell, J. W., & Creswell, J. D. (2017). Research design: Qualitative, quantitative, and mixed methods approaches. London: Sage publications.

Dash, B., & Sharma, P. (2023). Are ChatGPT and deepfake algorithms endangering the cybersecurity industry? A review. International Journal of Engineering and Applied Sciences, 10(1). 1-5.

Dijkstra, R., Genç, Z., Kayal, S., & Kamps, J. (2022, July 27-31). Reading comprehension quiz generation using generative pre-trained transformers [Paper presentation]. The 23th International Conference on Artificial Intelligence in Education (AIED’ 2022).

Fadel, C., Holmes, W., & Bialik, M. (2019). Artificial intelligence in education: Promises and implications for teaching and learning. The Center for Curriculum Redesign.

Farrokhnia, M., Banihashem, S. K., Noroozi, O., & Wals, A. (2023). A SWOT analysis of ChatGPT: Implications for educational practice and research. Innovations in Education and Teaching International, 1-15. https://doi.org/10.1080/14703297.2023.2195846

Fitria, T. N. (2023, March). Artificial intelligence (AI) technology in OpenAI ChatGPT application: A review of ChatGPT in writing English essay. In ELT Forum: Journal of English Language Teaching 12, (1), 44-58. DOI: https://doi.org/10.15294/elt.v12i1.64069

Flanagin, A., Bibbins-Domingo, K., Berkwits, M., & Christiansen, S. L. (2023). Nonhuman “authors” and implications for the integrity of scientific publication and medical knowledge. JAMA, 329(8), 637-639. https://doi.org/10.1001/jama.2023.1344

Gabajiwala, E., Mehta, P., Singh, R., & Koshy, R. (2022). Quiz maker: Automatic quiz generation from text using NLP. In P. K. Singh, S. T. Wierzchon, K. K. Chhabra, & S. Tanwar (Eds.), Futuristic trends in networks and computing technologies: Proceedings of fourth international conference on FTNCT 2021 (pp. 523-533). Springer Nature.

Gill, S. S., & Kaur, R. (2023). ChatGPT: Vision and challenges. Internet of Things and Cyber-Physical Systems, 3, 262-271.doi:10.1016/j.iotcps.2023.05.004

Gredler, M. E. (2001). Learning and instruction: Theory into practice (4th ed.). New Jersey: Prentice Hall, Inc.

Harunasari, S. Y. (2022). Examining the Effectiveness of AI-integrated Approach in EFL Writing: A Case of ChatGPT. International Journal of Progressive Sciences and Technologies, 39(2), 357-368.

Henderson, M., Ryan, T., & Phillips, M. (2019). The challenges of feedback in higher education. Assessment & Evaluation in Higher Education, 44(8), 1237-1252.doi: 10.1080/02602938.2019.1599815

Huang, J., & Li, S. (2023). Opportunities and Challenges in the Application of ChatGPT in Foreign Language Teaching. International Journal of Education and Social Science Research, 6(04), 75-89. DOI: https://doi.org/10.37500/IJESSR.2023.6406

Ibrahim, M. S., & Hassan, N. M. (2023). From Chatbots to Mind-Bots: Navigating Assessments in the Advent of ChatGPT. Education in Medicine Journal, (Special Issue), 1-8.

Krejcie, R.V, & Morgan, D. W. (1970). Determining sample size for research activities. Educational and Psychological Measurement, 30(3):607-610. doi: 10.1177/001316447003000308

Lund, B. D., & Wang, T. (2023). Chatting about ChatGPT: How may AI and GPT impact academia and libraries? Library Hi Tech News. https://doi.org/10.1108/LHTN-01-2023-0009

MacNeil, S., Tran, A., Mogil, D., Bernstein, S., Ross, E., & Huang, Z. (2022). Generating diverse code explanations using the GPT-3 large language model. In J. Vahrenhold, K. Fisler, M. Hauswirth, & D. Franklin (Eds.), Proceedings of the 2022 ACM conference on international computing education research (pp. 37-39). https://doi.org/10.1145/3501709.3544280

Mondal, H., & Mondal, S. (2023). ChatGPT in academic writing: Maximizing its benefits and minimizing the risks. Indian Journal of Ophthalmology, 71(12), 3600-3606.

Mugableh, A. I. (2024). The impact of ChatGPT on the development of vocabulary knowledge of Saudi EFL students. Arab World English Journal (AWEJ) Special Issue on ChatGPT, 265- 281. doi:10.24093/awej/ChatGPT.18

Ningrum, S. (2023). ChatGPT’s Impact: The AI Revolution in EFL Writing. Borneo Engineering & Advanced Multidisciplinary International Journal, 2(Special Issue), 32-37.

Packer, M. J., & Goicoechea, J. (2000). Sociocultural and constructivist theories of learning: Ontology, not just epistemology. Educational psychologist, 35(4), 227-241.

Pérez, J. Q., Daradoumis, T., & Puig, J. M. M. (2020). Rediscovering the use of chatbots in education: A systematic literature review. Computer Applications in Engineering Education, 28(6), 1549-1565. https://doi.org/10.1002/cae.22326

Piaget, J. (2005). The psychology of intelligence. London: Routledge.

Polak, S., Schiavo, G., & Zancanaro, M. (2022). Teachers’ perspective on artificial intelligence education: An initial investigation. In S. Barbosa, C. Lampe, C. Appert, & D. A. Shamma (Eds.), CHI EA ’22: Extended abstracts of the 2022 CHI conference on human factors in computing systems (pp. 1-7). Association for Computing Machinery. https://doi.org/10.1145/3491101.3519866

Rasul, T., Nair, S., Kalendra, D., Robin, M., de Oliveira Santini, F., Ladeira, W. J., … & Heathcote, L. (2023). The role of ChatGPT in higher education: Benefits, challenges, and future research directions. Journal of Applied Learning and Teaching, 6(1), 41-56.doi: 10.37074/jalt.2023.6.1.29

Shidiq, M. (2023, May). The use of artificial intelligence-based chat-gpt and its challenges for the world of education; from the viewpoint of the development of creative writing skills. In Proceeding of International Conference on Education, Society and Humanity 1(1), 353-357. https://ejournal.unuja.ac.id/index.php/icesh/article/view/5614

Stepanechko, O., & Kozub, L. (2023). English Teachers’concerns About The Ethical Use Of Chatgpt By University Students. Grail of Science, (25), 297-302.doi: 10.36074/grail-of-science.17.03.2023.051

Taecharungroj, V. (2023). “What Can ChatGPT Do?” Analyzing Early Reactions to the Innovative AI Chatbot on Twitter. Big Data and Cognitive Computing, 7(1), 35-44. 10.3390/bdcc7010035

Thorp, H. H. (2023). ChatGPT is fun, but not an author. Science, 379(6630), 313. doi:10.1126/science.adg7879

Van Dis, E. A., Bollen, J., Zuidema, W., van Rooij, R., & Bockting, C. L. (2023). ChatGPT: Five priorities for research. Nature, 614(7947), 224-226.

Facebook
Twitter
LinkedIn
Tumblr
Reddit
Email
StumbleUpon
Digg

Dr. Zein Bassam Bani Younes is an Assistant Professor School of Arts, Department of English Language and Literature/Translation, Jadara University, Jordan. She specializes in applied linguistics. Her areas of research interest include English linguistics, media linguistics, and language learning. Email: z.baniyounes@jadara.edu.jo
ORCID: https://orcid.org/0009-0001-0150-8426.

Dr. Isyaku Hassan is a Senior Lecturer in the Faculty of Languages and Communication at Universiti Sultan Zainal Abidin (UniSZA), Malaysia. He is an active researcher with a keen interest in the areas of media linguistics, media and technology, health communication, marketing communication, and language studies. Email: isyakuhassan@unisza.edu.my
ORCID:  https://orcid.org/0000-0002-8260-2894

Musa Umar Muhammad is a lecturer in the Department of Mass Communication at the Federal University of Lafia (FULAFIA), Nigeria. His areas of research interest include print media, new media, and film studies. Email: musaumarmuhammad@gmail.com
ORCID:   https://orcid.org/0000-0002-4694-5021

Nor Hanim Mustafa serves as a Language Instructor at the Faculty of Language Studies and Human Development, Universiti Malaysia Kelantan (UMK), Malaysia. Her research focuses on discourse analysis, linguistics, intercultural communication, and language learning. Email: norhanim@umk.edu.my ORCID:  https://orcid.org/0000-0001-8544-5380.

Dr. Ahmad Taufik Hidayah Abdullah is a Senior Lecturer in the Faculty of Languages and Communication, Universiti Sultan Zainal Abidin (UniSZA), Malaysia. His areas of research interest include public speaking, English linguistics, error analysis, and language learning. Email: taufikhidayah@unisza.edu.my   ORCID: https://orcid.org/0000-0001-9898-0980

 Dr. Mohd Nazri Latiff Azmi is an Associate Professor of English Language in the Faculty of Languages and Communication, Universiti Sultan Zainal Abidin (UniSZA), Malaysia. Dr. Nazri specializes in literacy and comparative literature studies. Email: mohdnazri@unisza.edu.my
ORCID: https://orcid.org/0000-0002-4712-5332