Toward AI grading of student problem solutions in introductory physics: A feasibility study
Open access
Author
Date
2023-07Type
- Journal Article
Abstract
Solving problems is crucial for learning physics, and not only final solutions but also their derivations are important. Grading these derivations is labor intensive, as it generally involves human evaluation of handwritten work. AI tools have not been an alternative, since even for short answers, they needed specific training for each problem or set of problems. Extensively pretrained AI systems offer a potentially universal grading solution without this specific training. This feasibility study explores an AI-assisted workflow to grade handwritten physics derivations using MathPix and GPT-4. We were able to successfully scan handwritten solution paths and achieved an R-squared of 0.84 compared to human graders on a synthetic dataset. The proposed workflow appears promising for formative feedback, but for final evaluations, it would best be used to assist human graders. Show more
Permanent link
https://doi.org/10.3929/ethz-b-000647846Publication status
publishedExternal links
Journal / series
Physical Review Physics Education ResearchVolume
Pages / Article No.
Publisher
American Physical SocietyMore
Show all metadata