The Widening Gap: The Benefits and Harms of Generative AI for Novice Programmers

no code implementations • 28 May 2024 • James Prather, Brent Reeves, Juho Leinonen, Stephen MacNeil, Arisoa S. Randrianasolo, Brett Becker, Bailey Kimmel, Jared Wright, Ben Briggs

Here we replicate a previous study that examined novice programming problem solving behavior and extend it by incorporating GenAI tools.

Enhancing Programming Error Messages in Real Time with Generative AI

no code implementations • 12 Feb 2024 • Bailey Kimmel, Austin Geisert, Lily Yaro, Brendan Gipson, Taylor Hotchkiss, Sidney Osae-Asante, Hunter Vaught, Grant Wininger, Chase Yamaguchi

Our results indicate that adding generative AI to an automated assessment tool does not necessarily make it better and that design of the interface matters greatly to the usability of the feedback that GPT-4 provided.

Interactions with Prompt Problems: A New Way to Teach Programming with Large Language Models

no code implementations • 19 Jan 2024 • James Prather, Paul Denny, Juho Leinonen, David H. Smith IV, Brent N. Reeves, Stephen MacNeil, Brett A. Becker, Andrew Luxton-Reilly, Thezyrie Amarouche, Bailey Kimmel

In this paper, we propose a new way to teach programming with Prompt Problems.

Code Generation