The Validity and Reliability of Online Examinations in the State Universities of Sri Lanka: An Empirical Study

Main Article Content

Rohan Abeywickrama
Thilini Dissanayake

Abstract

The aim of the current study is to examine the validity and reliability of online examinations through undergraduates’ and lecturers’ perceptions and identify the ways in which online examinations can be more focused and effective. To this end, a questionnaire including both qualitative and quantitative inquiries were administered among forty-five undergraduates and fifteen lecturers of three state universities in Sri Lanka. Thematic Analysis and SPSS software were used to analyze qualitative and quantitative data respectively. Findings of the study indicate that 80% of the undergraduates and lecturers preferred traditional examinations to online assessments given its flexibility, validity, and fairness. Majority of the lecturers encountered issues during online examinations, thus they reported the need of improving the methods and strategies of online assessments in a way they measure undergraduates’ performance accurately. Moreover, undergraduates’ social, economic, technological, and psychological issues also hindered the effectiveness of online examination to a considerable extent. The results of online examinations cannot be regarded as valid and reliable because they were unable to evaluate undergraduates’ learning outcomes as accurately as onsite examinations. The study has implications for the undergraduates, test administrators, lecturers, and the university management.

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...

Article Details

How to Cite
Abeywickrama, R., & Dissanayake, T. (2022). The Validity and Reliability of Online Examinations in the State Universities of Sri Lanka: An Empirical Study. Andalas International Journal of Socio-Humanities, 4(1), 25–36. https://doi.org/10.25077/aijosh.v4i1.31
Section
Articles

References

Abeywickrama, K. R., & Hewa, K. (2019). Teacher Engagement and Professional Development Initiatives: A Case Study of University ESL Teachers in Sri Lanka. Deakin University.

Adnan, M., & Anwar, K. (2020). Online Learning Amid the COVID-19 Pandemic: Students’ Perspectives. Journal of Pedagogical Sociology and Psychology, 2(1), 45–51.

Ahmaidi, S., Masse-Biron, J., Adam, B., Choquet, D., Freville, M., Libert, J.-P., & Prefaut, C. (1998). Effects of Interval Training at the Ventilatory Threshold on Clinical and Cardiorespiratory Responses in Elderly Humans. European Journal of Applied Physiology, 78(2), 170–176. https://doi.org/10.1007/s004210050403

Anderson, B., & Simpson, M. (2012). History and Heritage in Distance Education. Journal of Open, Flexible and Distance Learning, 16(2), 1–10.

Anusha, S., Soujanya, S., & Vasavi, D. (2012). Study on Techniques for Providing Enhanced Security During Online Exams. International Journal of Engineering Inventions, 1(1), 32–37.

Bartley, S. J., & Golek, J. H. (2004). Evaluating the Cost Effectiveness of Online and Face-to-Face Instruction. J. Educ. Technol. Soc., 7(4), 167–175.

Bayley, G., & Nancarrow, C. (1998). Impulse Purchasing: a Qualitative Exploration of the Phenomenon. Qualitative Market Research: An International Journal, 1(2), 99–114. https://doi.org/10.1108/13522759810214271

Berg, B. L., & Lune, H. (2016). Qualitative Research Methods for the Social Sciences (9th Editio). California: Pearson.

Boud, D., & Falchikov, N. (2006). Aligning Assessment with Long‐term Learning. Assessment & Evaluation in Higher Education, 31(4), 399–413. https://doi.org/10.1080/02602930600679050

Boyatzis, R. E. (1998). Transforming Qualitative Information Thematic Analysis and Code Development. California: Sage Publication.

Braun, V., & Clarke, V. (2006). Using Thematic Analysis in Psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa

Brown, A. (1990). Domain-Specific Principles Affect Learning and Transfer in Children. Cognitive Science, 14(1), 107–133. https://doi.org/10.1016/0364-0213(90)90028-U

Brown, H. D. (2003). Language Assessment: Principles and Classroom Practices. New York: Longman Dictionary.

Bryman, A. (2001). Social Research Methods (4th Edition). New York: Oxford University Press.

Cohen, L., Manion, L., & Morrison, K. (2018). Research Methods in Education (8 th Editi). London: Routledge.

Collier, D., Burkholder, K., & Branum, T. (2013). Digital Learning: Meeting the Challenges and Embracing the Opportunities for Teachers Issue Brief. Texas.

Gogoi, P. (2020). Application of SPSS Programme in the Field of Social Science Research. International Journal of Recent Technology and Engineering (IJRTE), 8(5).

Gorard, S. (2001). Quantitative Methods in Educational Research: The Role of Numbers Made Easy First Edition. London: Continuum.

Gorman, G. E., & Clayton, P. (2005). Qualitative Research for the Information Professional: A Practical Handbook (2nd Edition). London: Facet Publishing.

Gunawardena, Charlotte N., & McIsaac, M. S. (2004). Distance Education. In Handbook of Research on Educational Communications and Technology (2nd Edition). London: Routledge.

Harmon, O., & Lambrinos, J. (2006). Online Format vs. Live Mode of Instruction: Do Human Capital Differences or Differences in Returns to Human Capital Explain the Differences in Outcomes?

Hodges, C., Moore, S., Lockee, B., Trust, T., & Bond, A. (2020). The Difference Between Emergency Remote Teaching and Online

Learning.

Holmberg, B. (1994). Theory and Practice of Distance Education (2 nd Editi). London: Routledge.

Holroyd, C., & Harlen, W. (1996). Primary Teachers’ Confidence About Teaching Science and Technology. Research Papers in Education, 11(3), 323–335. https://doi.org/10.1080/0267152960110308

Johnson, R., & Christensen, L. (2014). Educational Research Quantitative, Qualitative, and Mixed Approaches Fifth Edition (7th Edition). New York: Sage Publication.

Kealey, D., & Haines, P. J. (2002). BIOS Instant Notes in Analytical Chemistry (1st Edition). London: Routledge.

Kelter, P. (2018). Assessment in Academia: The good, the bad and the ugly. Educación Química, 15(2), 113. https://doi.org/10.22201/fq.18708404e.2004.2.66197

Miller, K. (2009). Organizational Communication: Approaches and Processes (6th Edition). California: Wadsworth Publishing Company.

Navarro, P., & Shoemaker, J. (2000). Performance and Perceptions of Distance Learners in Cyberspace. American Journal of Distance Education, 14(2), 15–35. https://doi.org/10.1080/08923640009527052

Neuhauser, C. (2002). Learning Style and Effectiveness of Online and Face-to-Face Instruction. American Journal of Distance Education, 16(2), 99–113. https://doi.org/10.1207/S15389286AJDE1602_4

Ni, A. Y. (2018). Comparing the Effectiveness of Classroom and Online Learning: Teaching Research Methods. Journal of Public Affairs Education, 19(2), 199–215. https://doi.org/10.1080/15236803.2013.12001730

Osborne, D., & Plastrik, P. (1997). Banishing Bureaucracy: The Five Strategies for Reliventing Government. California: Addison Wesley Publishing Company, Inc.

Pape, L. (2010). Blended Teaching and Learning. American Association of School Administrators, 76(2), 22–27.

Picciano, A. G. (2002). Beyond Student Perceptions: Issues of Interaction, Presence, and Performance in an Online Course. Online Learning, 6(1). https://doi.org/10.24059/olj.v6i1.1870

Rovai, A. P., & Jordan, H. (2004). Blended Learning and Sense of Community: A Comparative Analysis with Traditional and Fully Online Graduate Courses. The International Review of Research in Open and Distributed Learning, 5(2). https://doi.org/10.19173/irrodl.v5i2.192

Scriven, M., & Paul, R. (1987). Defining Critical Thinking.

Smaldino, S. E., Lowther, D. L., Mims, C., & Russell, J. D. (2021). Instructional Technology and Media for Learning (12th Editi). London: Pearson.

Unger, T., Borghi, C., Charchar, F., Khan, N. A., Poulter, N. R., Prabhakaran, D., … Schutte, A. E. (2020). 2020 International Society of Hypertension Global Hypertension Practice Guidelines. Journal of Hypertension, 38(6), 982–1004. https://doi.org/10.1097/HJH.0000000000002453

Webster, J., & Watson, R. T. (2002). Analyzing the Past to Prepare for the Future: Writing a Literature Review. MIS Quarterly, 26(2).

Weir, C. J. (2005). Language Testing and Validation: An Evidence-Based Approach. Hampshire: Palgrave-Macmillan.

Zadrozny, J., McClure, C., Lee, J., & Jo, I. (2016). Designs, Techniques, and Reporting Strategies in Geography Education: A Review of Research Methods. International Geographical Education Online, 6(3).