AI Teaches the Art of Elegant Coding: Timely, Fair, and Helpful Style Feedback in a Global Course
Proceedings of the 55th ACM Technical Symposium on Computer Science Education V. 1(2024)
摘要
Teaching students how to write code that is elegant, reusable, and
comprehensible is a fundamental part of CS1 education. However, providing this
"style feedback" in a timely manner has proven difficult to scale. In this
paper, we present our experience deploying a novel, real-time style feedback
tool in Code in Place, a large-scale online CS1 course. Our tool is based on
the latest breakthroughs in large-language models (LLMs) and was carefully
designed to be safe and helpful for students. We used our Real-Time Style
Feedback tool (RTSF) in a class with over 8,000 diverse students from across
the globe and ran a randomized control trial to understand its benefits. We
show that students who received style feedback in real-time were five times
more likely to view and engage with their feedback compared to students who
received delayed feedback. Moreover, those who viewed feedback were more likely
to make significant style-related edits to their code, with over 79
edits directly incorporating their feedback. We also discuss the practicality
and dangers of LLM-based tools for feedback, investigating the quality of the
feedback generated, LLM limitations, and techniques for consistency,
standardization, and safeguarding against demographic bias, all of which are
crucial for a tool utilized by students.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要