Search Results for author:
Found 3 papers, 2 papers with code
Open Source Language Models Can Provide Feedback: Evaluating LLMs' Ability to Help Students Using GPT-4-As-A-Judge
Inspired by recent work that has utilised very powerful LLMs, such as GPT-4, to evaluate the outputs produced by less powerful models, we conduct an automated analysis of the quality of the feedback produced by several open source models using a dataset from an introductory programming course.
Benchmarking Educational Program Repair
The emergence of large language models (LLMs) has sparked enormous interest due to their potential application across a range of educational tasks.
Exploring the Responses of Large Language Models to Beginner Programmers' Help Requests
At the same time, the results highlight the unreliability of LLMs: LLMs make some of the same mistakes that students do, perhaps especially when formatting output as required by automated assessment systems.
