Arab World English Journal (AWEJ) Volume 12. Number. 4   December 2021                                         Pp. 3-18
DOI:https://dx.doi.org/10.24093/awej/vol12no4.1

Full Paper PDF

 

Applying Assessment Principles during Emergency Remote Teaching: Challenges and
Considerations
 

Wid Hasen Allehaiby
Department of English, College of Science and Health Professions
King Saud bin Abdulaziz University for Health Sciences
Jeddah, Saudi Arabia
Corresponding Author: lehaibyw@ksau-hs.edu.sa

 Sara Al-Bahlani
English Department, University of Technology and Applied Sciences
Nizwa, Oman

 

Received:   4/8/2021               Accepted:  10/4/2021             Published: 12/15/2021

 

Abstract:
One of the main challenges higher educational institutions encounter amid the recent COVID-19 crisis is transferring assessment approaches from the traditional face-to-face form to the online Emergency Remote Teaching approach. A set of language assessment principles, practicality, reliability, validity, authenticity, and washback, which can be applied to any academic subject, are critical within the design of any task that aims to assess learning. This review paper discusses how assessment approaches need to be modified in a time of crisis. It determines the position assessment should adopt within emergency remote teaching methods and analyzes the fundamental characteristics of five principles of assessment and how they can be accomplished with emergency remote teaching approaches. Furthermore, this paper evaluates the vulnerability and viability of the five assessment principles, examines the application of online assessment on a holistic level, and puts forward a set of recommendations to ensure the assessment principles are achieved within emergency remote learning contexts. The paper concludes with the notion that the construct of time, which is inherent within the principle of practicality, is the most significant when developing online assessments as it is this characteristic that is the most at risk. In addition, we suggest that the assessments that are implemented during emergency remote learning involve open-ended, as opposed to close-ended, questions and highlight the importance of educators demonstrating flexibility and understanding toward their students.
Keywords: assessment principles, COVID-19 crisis, emergency remote teaching, formative assessment, summative assessment

 

Cite as:  Allehaiby, W. H. , & Al-Bahlani, S. (2021). Applying Assessment Principles during Emergency Remote Teaching: Challenges and Considerations.  Arab World English Journal, 12 (4) 3-18.
DOI: https://dx.doi.org/10.24093/awej/vol12no4.1

References

Arnold, I. J. M. (2016). Cheating at online formative tests: does it pay off? The Internet and Higher Education, 29, 98–106.

Alkhazim, M. A. (2020). Distance education is more than Blackboard. Al-Jazirah, 5 May.    Available at: http://www.al-jazirah.com/2020/20200405/ln22.htm

Alqabbani, S., Almuwais, A., Benajiba, N., & Almoayad, F. (2020). Readiness towards emergency   shifting to remote learning
during COVID-19 pandemic among university instructors. E-  Learning and Digital Media, 18(5), 460–479 https://doi.org/10.1177/2042753020981651.

Al-Salman, S., & Haider, A. S. (2021). Jordanian university students’ views on emergency   online learning during COVID-19. Online Learning, 25(1), 286–302. https://doi.org/10.24059/olj.v25i1.2470

Black, P., & Wiliam, D. (2009). Developing the theory of formative assessment. Educational   Assessment, Evaluation and Accountability, 21(1), 5-31.

Bellini, M. I., Pengel, L., Potena, L., Segantini, L., & ESOT COVID19 Working Group. (2021).  COVID19 and education: Restructuring after the pandemic. Transplant International34(2), 220-223. https://doi.org/10.1111/tri.13788

Boitshwarelo, B., Reedy, A. K., & Billany, T. (2017). Envisioning the use of online tests in   assessing twenty-first century learning:
a literature review. Research and Practice in        Technology Enhanced Learning, 12, 1-16.

Brown, H. D., & Abeywickrama, P. (2010). Language assessment: Principles and classroom   practices (2nd ed.). White Plains, NY:
Pearson Longman

Burrus, R. T., McGoldrick, K., & Schuhmann, P. W. (2007). Self-reports of student cheating: Does a definition of cheating matter?. The Journal of Economic Education, 38(1), 3-16.

Cahapay, M. B. (2020). Rethinking education in the new normal post-COVID-19 era: A  curriculum studies perspective.
Aquademia, 4(2), 1-5. https://doi.org/10.29333/aquademia/8315

Chalhoub–Deville, M., & Deville, C. (1999). Computer adaptive testing in second language contexts.
Annual Review of Applied Linguistics, 19, 273-299.

Crawford, J. et al. (2020). COVID-19: 20 countries’ higher education intraperiod digital pedagogy responses.
Journal of Applied Learning & Teaching, 3(1), 1–20.

Gipps, C. V. (2005). What is the role for ICT based assessment in universities? Studies in Higher  Education, 30(2), 171–180. http://dx.doi.org/10.1080/03075070500043176

Goh, P. S., & Sandars, J. (2020). A vision of the use of technology in medical education after the  COVID-19 pandemic. MedEdPublish9. https://doi.org/10.15694/mep.2020.000049.1

Grijalva, T., Nowell, C., & Kerkvliet, J. (2006). Academic honesty and online courses. College  Student Journal, 40(1), 180-185.
Available at http://www.projectinnovation.com/college-student-journal.html

Guangul, F. M., Suhail, A. H., Khalit, M. I., & Khidhir, B. A. (2020). Challenges of remote assessment in higher education in the context of COVID-19: A case study of Middle East   College. Educational Assessment, Evaluation and Accountability, 32, 1-17. doi: 10.1007/s11092-020-09340-w.

Gupta, A., & Ndahi, H. (2002). Meeting the digital literacy needs of growing workforce. Reading Matrix: An International Online Journal, 2(1), 1-10.

Harmon, O., Lambrinos, J., & Buffolino, J. (2010). Assessment design and cheating risk in online   instruction. Online Journal of Distance Learning Administration, 13(3). Available at http://www.westga.edu/~distance/ojdla/Fall133/harmon_lambrinos_buffolino133.html

Hodges, C., Moore, S., Lockee, B., Trust, T., & Bond, A. (2020). The difference between  emergency remote teaching and online learning. Educause Review, 27. Available at https://er.educause.edu/articles/2020/3/the-difference-between-emergency-remote-teaching-and-online-learning

Huang, R. et al. (2020). Disrupted classes, undisrupted learning during COVID-19 outbreak in China: Application of open educational practices and resources. Smart Learning Environments, 7(1), 1-15. https://doi.org/10.1186/s40561-020-00125-8

Huber, S. G., & Helm, C. (2020). COVID-19 and schooling: evaluation, assessment and  accountability in times of crises—reacting quickly to explore key issues for policy, practice       and research with the school barometer. Educational Assessment, Evaluation and       Accountability, 32(2), 237-270. https://doi.org/10.1007/s11092-020-09322-y

Ilgaz, H., & Adanır, G. A. (2020). Providing online exams for online learners: Does it really matter for them?. Education and Information Technologies25(2), 1255-1269. https://doi.org/10.1007/s10639-019-10020-6

Jerald, C. D. (2009). Defining a 21st century education. Retrieved from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.460.8011&rep=rep1&type=pdf

Kereluik, K., Mishra, P., Fahnoe, C., & Terry, L. (2013). What knowledge is of most worth: Teacher knowledge for 21st century learning. Journal of digital learning in teacher     education, 29(4), 127-140.

Kim, N., Smith, M. J., & Maeng, K. (2008). Assessment in online distance education: a comparison   of three online program at a university. Online Journal of Distance Learning   Administration, 11(1). Available at
https://www.westga.edu/~distance/ojdla/spring111/kim111.html

Kinash, S., Knight, D., & McLean, M. (2015). Does digital scholarship through online lectures affect student learning?
Journal of Educational Technology and Society, 18(2), 129-139.

Masters, J. et al. (2001). Assessment of multiple-choice questions in selected test banks accompanying test books used in nursing education. Journal of Nursing Education, 40(1), 25–32.

McAllister, D., & Guidice, R. M. (2012). This is only a test: A machine-graded improvement to  the multiple-choice and true-false examination. Teaching in Higher Education, 17(2), 193-207. https://doi.org/10.1080/13562517.2011.611868

McAlpine, M. (2002). Principles of assessment. Luton: CAA Centre, University of Luton.

McMillan, J. H. (2000). Fundamental assessment principles for teachers and school administrators. Practical Assessment, Research, and Evaluation, 7(1). Available at https://scholarworks.umass.edu/pare/vol7/iss1/8

Means, B., Toyama, Y., Murphy, R., Bakia, M., & Jones, K. (2010). Evaluation of evidence-based  practices in online learning: A meta-analysis and review of online learning studies. Washington, DC: U.S. Department of Education, Office of Planning,
Evaluation, and Policy Development.

Meyen, E. L., Aust, R. J., Bui, Y. N., & Isaacson, R. (2002). Assessing and monitoring student      progress in an e-learning personnel preparation environment. Teacher education and  special education, 25(2), 187-198. Retrieved from https://www.learntechlib.org/primary/p/24323/.

MOE. (2020). (rep.). The Saudi MOE Leading Efforts to Combat Coronavirus Pandemic COVID- 19. Retrieved from https://iite.unesco.org/wp-content/uploads/2020/10/The-Saudi-MOE-
Leading-Efforts-to-Combat-Coronavirus-Pandemic-COVID-19.pdf

Parnther, C. (2020, March 24). Emergency Driven Remote Learning. ICAI.  Available at
https://academicintegrity.org/blog/146-emergency-driven-remote-  learning?highlight=WyJwYXJudGhlciJd.

Pifia, A.A. (2013). Learning management systems: A look at the big picture. In Y. Kats (Ed.), Learning management systems and instructional design: Best practices in online education(pp. 1-19). Hershey: Idea Group Inc (IGI).

Reedy, A., Pfitzner, D., Rook, L., & Ellis, L. (2021). Responding to the COVID-19 emergency: Student and academic staff perceptions of academic integrity in the transition to online exams at three Australian universities.
International Journal for Educational  Integrity17(1), 1-32.

Rogers, C. F. (2006). Faculty perceptions about e-cheating during online testing. Journal of  Computing Sciences in Colleges,
22(2), 206-212. Available at https://dl.acm.org/citation.cfm?id=1181936

Sankey, M. (2020). COVID-19 Exam Software Survey – 2020. Acode, 1–9. Retrieved from https://www.acode.edu.au/pluginfile.php/8244/mod_resource/content/2/eE xamsWhitepaper.pdf

Sewell, J. P., Frith, K. H., & Colvin, M. M. (2010). Online assessment strategies: A primer.  MERLOT journal of online learning and teaching, 6(1), 297-305.

SPA. (2020, April 16). The Minister of Education directs schools and universities to progress their students to the next grade.
Available at https://www.spa.gov.sa/2075525.

Stockwell, S. (2020, June 24). Tech experts want online exam monitoring canned. Triple J Hack. https://www.abc.net.au/triplej/programs/hack/online-exam-monitoring/12388630.

Stupans, I. (2006). Multiple choice questions: can they examine application of knowledge?  Pharmacy Education, 6(1), 59–63.

  1. (2020). (issue brief). Policy Brief: Education during COVID-19 and beyond. United Nations. Retrieved from https://www.un.org/development/desa/dspd/wp- content/uploads/sites/22/2020/08/sg_policy_brief_covid-19_and_education_august_2020.pdf

Varble, D. (2014). Reducing cheating opportunities in online test. Atlantic Marketing Journal,  3(3), 131-149.

Watson, G., & Sottile, J. (2010). Cheating in the digital age: Do students cheat more in online  courses?
Online Journal of Distance Learning Administration, 13(1). Retrieved from http://www.westga.edu/~distance/ojdla/spring131/watson131.html

Zhang, W., Wang, Y., Yang, L., & Wang, C. (2020). Suspending classes without   stopping learning: China’s education emergency management policy in the COVID-19    outbreak. Journal of Risk and Financial Management, 13(55), 1-6.

Zhu, X., & Liu, J. (2020). Education in and after Covid-19: Immediate responses and long-term   visions. Postdigital Science and
Education
, 2(3), 695–699.

 

Facebook
Twitter
LinkedIn
Tumblr
Reddit
Email
StumbleUpon
Digg
Received: 4/8/2021  
Accepted: 10/4/2021 
Published: 12/15/2021
https://dx.doi.org/10.24093/awej/vol12no4.1 

Dr. Wid Allehaiby is an Assistant Professor in the Department of English at King Saud bin Abdulaziz University for Health Sciences, Saudi Arabia. Her research merges the fields of applied linguistics and educational technology and focuses on the implementation of language instruction, pedagogical practices, and facilitation of learners’ engagement using non-conventional learning tools, such as social networking sites. ORCID: https://orcid.org/ 0000-0002-4320-7429

Dr. Sara Al-Bahlani is an Assistant Professor and Head of the English Department at the University of Technology and Applied Sciences-Nizwa in Oman. Her research focused on language assessment and teacher assessment literacy, digital assessment literacy and integrating technology in the language classroom. She worked as an English, sociolinguistics and academic skills lecturer and course coordinator. ORCID: https://orcid.org/0000-0002-9136-4576