Blogs (3) >>
Fri 22 Mar 2024 16:10 - 16:35 at Meeting Rooms B117-119 - Automating Assessment Chair(s): Jack Sun

Parsons Problems and Faded Parsons Problems have been shown to be effective in helping students in programming courses transition from passive learning, such as lectures or textbooks, to active learning in the form of writing code. We present FPPgen, an authoring system that largely automates the conversion of existing open-ended code-writing exercises to Faded Parsons Problems (FPPs). FPP solutions can be machine-checked using either spec-based autograding, in which student solutions are evaluated against instructor-provided test cases, or mutation-based autograding, in which the student work product consists of one or more test cases evaluated using mutation testing. Our system allows creating exercises that rely on complex libraries and auxiliary functions, such as student code intended to be run as part of a complex framework-based application. Our system also gracefully supports cumulative multi-part problems, in which later parts build on earlier parts. Python and Ruby exercises are currently supported, but FPPgen is language-agnostic and adding autograders for other languages is straightforward. In our experience so far, instructors can draft simple questions in less than an hour and mutation-based questions in about two hours as open-ended coding questions, and student helpers can use our tools to convert these to FPPs in less than an hour. FPPgen is in active use in both beginning and advanced large-enrollment programming courses in a computer science undergraduate program at a large US university.

Fri 22 Mar

Displayed time zone: Pacific Time (US & Canada) change

15:45 - 17:00
Automating AssessmentPapers at Meeting Rooms B117-119
Chair(s): Jack Sun University of Toronto
15:45
25m
Talk
Advancing Automated Assessment Tools — Opportunities for Innovations in Upper-level Computing Courses: A Position PaperGlobal
Papers
Steffan Hooper University of Auckland, Burkhard Wünsche University of Auckland, Andrew Luxton-Reilly The University of Auckland, Paul Denny The University of Auckland, Haoran Feng University of Auckland
DOI
16:10
25m
Talk
Generating Multi-Part Autogradable Faded Parsons Problems From Code-Writing Exercises
Papers
Serena Caraco University of California, Berkeley, Nelson Lojo University of California, Berkeley, Michael Verdicchio The Citadel, Armando Fox UC Berkeley
DOI
16:35
25m
Talk
Learning with Style: Improving Student Code-Style Through Better Automated FeedbackGlobal
Papers
Liam Saliba The University of Melbourne, Elisa Shioji The University of Melbourne, Eduardo Araujo Oliveira The University of Melbourne, Shaanan Cohney University of Melbourne, Jianzhong Qi The University of Melbourne
DOI