Blogs (3) >>
Fri 22 Mar 2024 15:45 - 16:10 at Meeting Rooms B110-112 - Testing and Academic Integrity Chair(s): Kim Titus

We compare the exam security of three proctoring regimens of Bring-Your-Own-Device, synchronous, computer-based exams in a computer science class: online un-proctored, online proctored via Zoom, and in-person proctored. We performed two randomized crossover experiments to compare these proctoring regimens. The first study measured the score advantage students receive while taking un-proctored online exams over Zoom-proctored online exams. The second study measured the score advantage of students taking Zoom-proctored online exams over in-person proctored exams. In both studies, students took six 50-minute exams using their own devices, which included two coding questions and 8-10 non-coding questions.

We find that students score 2.3% higher on non-coding questions when taking exams in the un-proctored format compared to Zoom proctoring; no statistically significant advantage was found for the coding questions. While most of the non-coding questions had randomization such that students got different versions, for the few questions where all students received the same exact version, the score advantage escalated to 5.4%, indicating that randomization can mitigate some of the cheating associated with running un-proctored online exams. From the second study, we find no statistically significant difference between students’ performance on Zoom proctored versus in-person proctored exams.

Fri 22 Mar

Displayed time zone: Pacific Time (US & Canada) change

15:45 - 17:00
Testing and Academic IntegrityPapers at Meeting Rooms B110-112
Chair(s): Kim Titus North Carolina State University
15:45
25m
Talk
Comparing the Security of Three Proctoring Regimens for Bring-Your-Own-Device Exams
Papers
Rishi Gulati University of Illinois at Urbana-Champaign, Matthew West University of Illinois at Urbana-Champaign , Craig Zilles University of Illinois at Urbana-Champaign, Mariana Silva University of Illinois at Urbana Champaign
DOI
16:10
25m
Talk
"I didn't know": Examining Student Understanding of Academic Dishonesty in Computer ScienceGlobal
Papers
Michael Liut University of Toronto Mississauga, Anna Ly University of Toronto Mississauga, Jessica Jia-Ni Xu University of Toronto, Justice Banson Western Washington University, Paul Vrbik The University of Queensland, Caroline Hardin Western Washington University
DOI
16:35
25m
Talk
One Solution to Addressing Assessment Logistical Problems: An experience setting up and operating an in-person testing center
Papers
Kelly Downey UC Riverside, Kris Miller University of California, Riverside, Mariana Silva University of Illinois at Urbana Champaign, Craig Zilles University of Illinois at Urbana-Champaign
DOI