How Far Are We? The Triumphs and Trials of Generative AI in Learning Software Engineering
arxiv(2023)
摘要
Conversational Generative AI (convo-genAI) is revolutionizing Software
Engineering (SE) as engineers and academics embrace this technology in their
work. However, there is a gap in understanding the current potential and
pitfalls of this technology, specifically in supporting students in SE tasks.
In this work, we evaluate through a between-subjects study (N=22) the
effectiveness of ChatGPT, a convo-genAI platform, in assisting students in SE
tasks. Our study did not find statistical differences in participants'
productivity or self-efficacy when using ChatGPT as compared to traditional
resources, but we found significantly increased frustration levels. Our study
also revealed 5 distinct faults arising from violations of Human-AI interaction
guidelines, which led to 7 different (negative) consequences on participants.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要