extended · article · 2024

Using Rasch Wright Map on Web RaschOnline to Assess ChatGPT-Math-Solver’s Proficiency in Mathematics College Entrance Examinations: A Comparative Study (Preprint)

Julie Chi Chow; Yu-Tsen Yeh; Willy Chou; Benjamin D. Wright

<sec> <title>BACKGROUND</title> <p>The ChatGPT-Math-Solver (CGMS) is a specialized tool developed to assist students in solving mathematical problems using the capabilities of the ChatGPT language model. Despite the efficacy of artificial intelligence (AI), there is a lack of comprehensive research assessing CGMS’s competence on Mathematics tests for college entrance examinations using the Wright Map based on Rasch analysis.</p> </sec> <sec> <title>OBJECTIVE</title> <p>This study aims to (1) showcase the utility of Rasch Wright Map on RaschOnline, and (2) determine the grade achieved by CGMS when compared to a typical sample</p> </sec> <sec> <title>METHODS</title> ...