PROOF POINTS: Asian American students lose more points in an AI essay grading study — but researchers don't know why
The testing organization that administers the SAT analyzed more than 13,000 essays
ETS’s researchers had asked GPT-4o to score the essays cold, without showing the chatbot any graded examples to calibrate its scores. It’s possible that a few sample essays or small tweaks to the grading instructions, or prompts, given to ChatGPT could reduce or eliminate the bias against Asian Americans. Perhaps the robot would be fairer to Asian Americans if it were explicitly prompted to “give out more perfect 6s.”