Arab World English Journal (AWEJ) Volume 12. Number. 4 December 2021 Pp. 3-18
DOI:https://dx.doi.org/10.24093/awej/vol12no4.1
Applying Assessment Principles during Emergency Remote Teaching: Challenges and
Considerations
Wid Hasen Allehaiby
Department of English, College of Science and Health Professions
King Saud bin Abdulaziz University for Health Sciences
Jeddah, Saudi Arabia
Corresponding Author: lehaibyw@ksau-hs.edu.sa
Sara Al-Bahlani
English Department, University of Technology and Applied Sciences
Nizwa, Oman
Received: 4/8/2021 Accepted: 10/4/2021 Published: 12/15/2021
Abstract:
One of the main challenges higher educational institutions encounter amid the recent COVID-19 crisis is transferring assessment approaches from the traditional face-to-face form to the online Emergency Remote Teaching approach. A set of language assessment principles, practicality, reliability, validity, authenticity, and washback, which can be applied to any academic subject, are critical within the design of any task that aims to assess learning. This review paper discusses how assessment approaches need to be modified in a time of crisis. It determines the position assessment should adopt within emergency remote teaching methods and analyzes the fundamental characteristics of five principles of assessment and how they can be accomplished with emergency remote teaching approaches. Furthermore, this paper evaluates the vulnerability and viability of the five assessment principles, examines the application of online assessment on a holistic level, and puts forward a set of recommendations to ensure the assessment principles are achieved within emergency remote learning contexts. The paper concludes with the notion that the construct of time, which is inherent within the principle of practicality, is the most significant when developing online assessments as it is this characteristic that is the most at risk. In addition, we suggest that the assessments that are implemented during emergency remote learning involve open-ended, as opposed to close-ended, questions and highlight the importance of educators demonstrating flexibility and understanding toward their students.
Keywords: assessment principles, COVID-19 crisis, emergency remote teaching, formative assessment, summative assessment
Cite as: Allehaiby, W. H. , & Al-Bahlani, S. (2021). Applying Assessment Principles during Emergency Remote Teaching: Challenges and Considerations. Arab World English Journal, 12 (4) 3-18.
DOI: https://dx.doi.org/10.24093/awej/vol12no4.1
References
Arnold, I. J. M. (2016). Cheating at online formative tests: does it pay off? The Internet and Higher Education, 29, 98–106.
Alkhazim, M. A. (2020). Distance education is more than Blackboard. Al-Jazirah, 5 May. Available at: http://www.al-jazirah.com/2020/20200405/ln22.htm
Alqabbani, S., Almuwais, A., Benajiba, N., & Almoayad, F. (2020). Readiness towards emergency shifting to remote learning
during COVID-19 pandemic among university instructors. E- Learning and Digital Media, 18(5), 460–479 https://doi.org/10.1177/2042753020981651.
Al-Salman, S., & Haider, A. S. (2021). Jordanian university students’ views on emergency online learning during COVID-19. Online Learning, 25(1), 286–302. https://doi.org/10.24059/olj.v25i1.2470
Black, P., & Wiliam, D. (2009). Developing the theory of formative assessment. Educational Assessment, Evaluation and Accountability, 21(1), 5-31.
Bellini, M. I., Pengel, L., Potena, L., Segantini, L., & ESOT COVID19 Working Group. (2021). COVID19 and education: Restructuring after the pandemic. Transplant International, 34(2), 220-223. https://doi.org/10.1111/tri.13788
Boitshwarelo, B., Reedy, A. K., & Billany, T. (2017). Envisioning the use of online tests in assessing twenty-first century learning:
a literature review. Research and Practice in Technology Enhanced Learning, 12, 1-16.
Brown, H. D., & Abeywickrama, P. (2010). Language assessment: Principles and classroom practices (2nd ed.). White Plains, NY:
Pearson Longman
Burrus, R. T., McGoldrick, K., & Schuhmann, P. W. (2007). Self-reports of student cheating: Does a definition of cheating matter?. The Journal of Economic Education, 38(1), 3-16.
Cahapay, M. B. (2020). Rethinking education in the new normal post-COVID-19 era: A curriculum studies perspective.
Aquademia, 4(2), 1-5. https://doi.org/10.29333/aquademia/8315
Chalhoub–Deville, M., & Deville, C. (1999). Computer adaptive testing in second language contexts.
Annual Review of Applied Linguistics, 19, 273-299.
Crawford, J. et al. (2020). COVID-19: 20 countries’ higher education intraperiod digital pedagogy responses.
Journal of Applied Learning & Teaching, 3(1), 1–20.
Gipps, C. V. (2005). What is the role for ICT based assessment in universities? Studies in Higher Education, 30(2), 171–180. http://dx.doi.org/10.1080/03075070500043176
Goh, P. S., & Sandars, J. (2020). A vision of the use of technology in medical education after the COVID-19 pandemic. MedEdPublish, 9. https://doi.org/10.15694/mep.2020.000049.1
Grijalva, T., Nowell, C., & Kerkvliet, J. (2006). Academic honesty and online courses. College Student Journal, 40(1), 180-185.
Available at http://www.projectinnovation.com/college-student-journal.html
Guangul, F. M., Suhail, A. H., Khalit, M. I., & Khidhir, B. A. (2020). Challenges of remote assessment in higher education in the context of COVID-19: A case study of Middle East College. Educational Assessment, Evaluation and Accountability, 32, 1-17. doi: 10.1007/s11092-020-09340-w.
Gupta, A., & Ndahi, H. (2002). Meeting the digital literacy needs of growing workforce. Reading Matrix: An International Online Journal, 2(1), 1-10.
Harmon, O., Lambrinos, J., & Buffolino, J. (2010). Assessment design and cheating risk in online instruction. Online Journal of Distance Learning Administration, 13(3). Available at http://www.westga.edu/~distance/ojdla/Fall133/harmon_lambrinos_buffolino133.html
Hodges, C., Moore, S., Lockee, B., Trust, T., & Bond, A. (2020). The difference between emergency remote teaching and online learning. Educause Review, 27. Available at https://er.educause.edu/articles/2020/3/the-difference-between-emergency-remote-teaching-and-online-learning
Huang, R. et al. (2020). Disrupted classes, undisrupted learning during COVID-19 outbreak in China: Application of open educational practices and resources. Smart Learning Environments, 7(1), 1-15. https://doi.org/10.1186/s40561-020-00125-8
Huber, S. G., & Helm, C. (2020). COVID-19 and schooling: evaluation, assessment and accountability in times of crises—reacting quickly to explore key issues for policy, practice and research with the school barometer. Educational Assessment, Evaluation and Accountability, 32(2), 237-270. https://doi.org/10.1007/s11092-020-09322-y
Ilgaz, H., & Adanır, G. A. (2020). Providing online exams for online learners: Does it really matter for them?. Education and Information Technologies, 25(2), 1255-1269. https://doi.org/10.1007/s10639-019-10020-6
Jerald, C. D. (2009). Defining a 21st century education. Retrieved from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.460.8011&rep=rep1&type=pdf
Kereluik, K., Mishra, P., Fahnoe, C., & Terry, L. (2013). What knowledge is of most worth: Teacher knowledge for 21st century learning. Journal of digital learning in teacher education, 29(4), 127-140.
Kim, N., Smith, M. J., & Maeng, K. (2008). Assessment in online distance education: a comparison of three online program at a university. Online Journal of Distance Learning Administration, 11(1). Available at
https://www.westga.edu/~distance/ojdla/spring111/kim111.html
Kinash, S., Knight, D., & McLean, M. (2015). Does digital scholarship through online lectures affect student learning?
Journal of Educational Technology and Society, 18(2), 129-139.
Masters, J. et al. (2001). Assessment of multiple-choice questions in selected test banks accompanying test books used in nursing education. Journal of Nursing Education, 40(1), 25–32.
McAllister, D., & Guidice, R. M. (2012). This is only a test: A machine-graded improvement to the multiple-choice and true-false examination. Teaching in Higher Education, 17(2), 193-207. https://doi.org/10.1080/13562517.2011.611868
McAlpine, M. (2002). Principles of assessment. Luton: CAA Centre, University of Luton.
McMillan, J. H. (2000). Fundamental assessment principles for teachers and school administrators. Practical Assessment, Research, and Evaluation, 7(1). Available at https://scholarworks.umass.edu/pare/vol7/iss1/8
Means, B., Toyama, Y., Murphy, R., Bakia, M., & Jones, K. (2010). Evaluation of evidence-based practices in online learning: A meta-analysis and review of online learning studies. Washington, DC: U.S. Department of Education, Office of Planning,
Evaluation, and Policy Development.
Meyen, E. L., Aust, R. J., Bui, Y. N., & Isaacson, R. (2002). Assessing and monitoring student progress in an e-learning personnel preparation environment. Teacher education and special education, 25(2), 187-198. Retrieved from https://www.learntechlib.org/primary/p/24323/.
MOE. (2020). (rep.). The Saudi MOE Leading Efforts to Combat Coronavirus Pandemic COVID- 19. Retrieved from https://iite.unesco.org/wp-content/uploads/2020/10/The-Saudi-MOE-
Leading-Efforts-to-Combat-Coronavirus-Pandemic-COVID-19.pdf
Parnther, C. (2020, March 24). Emergency Driven Remote Learning. ICAI. Available at
https://academicintegrity.org/blog/146-emergency-driven-remote- learning?highlight=WyJwYXJudGhlciJd.
Pifia, A.A. (2013). Learning management systems: A look at the big picture. In Y. Kats (Ed.), Learning management systems and instructional design: Best practices in online education(pp. 1-19). Hershey: Idea Group Inc (IGI).
Reedy, A., Pfitzner, D., Rook, L., & Ellis, L. (2021). Responding to the COVID-19 emergency: Student and academic staff perceptions of academic integrity in the transition to online exams at three Australian universities.
International Journal for Educational Integrity, 17(1), 1-32.
Rogers, C. F. (2006). Faculty perceptions about e-cheating during online testing. Journal of Computing Sciences in Colleges,
22(2), 206-212. Available at https://dl.acm.org/citation.cfm?id=1181936
Sankey, M. (2020). COVID-19 Exam Software Survey – 2020. Acode, 1–9. Retrieved from https://www.acode.edu.au/pluginfile.php/8244/mod_resource/content/2/eE xamsWhitepaper.pdf
Sewell, J. P., Frith, K. H., & Colvin, M. M. (2010). Online assessment strategies: A primer. MERLOT journal of online learning and teaching, 6(1), 297-305.
SPA. (2020, April 16). The Minister of Education directs schools and universities to progress their students to the next grade.
Available at https://www.spa.gov.sa/2075525.
Stockwell, S. (2020, June 24). Tech experts want online exam monitoring canned. Triple J Hack. https://www.abc.net.au/triplej/programs/hack/online-exam-monitoring/12388630.
Stupans, I. (2006). Multiple choice questions: can they examine application of knowledge? Pharmacy Education, 6(1), 59–63.
- (2020). (issue brief). Policy Brief: Education during COVID-19 and beyond. United Nations. Retrieved from https://www.un.org/development/desa/dspd/wp- content/uploads/sites/22/2020/08/sg_policy_brief_covid-19_and_education_august_2020.pdf
Varble, D. (2014). Reducing cheating opportunities in online test. Atlantic Marketing Journal, 3(3), 131-149.
Watson, G., & Sottile, J. (2010). Cheating in the digital age: Do students cheat more in online courses?
Online Journal of Distance Learning Administration, 13(1). Retrieved from http://www.westga.edu/~distance/ojdla/spring131/watson131.html
Zhang, W., Wang, Y., Yang, L., & Wang, C. (2020). Suspending classes without stopping learning: China’s education emergency management policy in the COVID-19 outbreak. Journal of Risk and Financial Management, 13(55), 1-6.
Zhu, X., & Liu, J. (2020). Education in and after Covid-19: Immediate responses and long-term visions. Postdigital Science and
Education, 2(3), 695–699.