Examining shifts in conceptual knowledge, procedural knowledge and procedural flexibility in the context of two game-based technologies

BackgroundPrior work has shown that middle school students struggle with algebra and that game-based educational technologies, such as DragonBox and From Here to There!, are effective at improving students' algebraic performance. However, it remains unclear which aspects of algebraic knowledge shift as a result of playing these games and what game design features support algebraic learning. ObjectiveUsing the data from a randomized controlled trial conducted in the 2020-2021 academic year, we (a) examined students' relative performance on assessment items measuring conceptual knowledge, procedural knowledge and procedural flexibility in algebraic equation solving, and (b) identified changes in these aspects of algebraic knowledge after playing DragonBox or From Here to There!. MethodsEight hundred eighty-seven seventh-graders were randomly assigned to playing DragonBox or From Here to There! for nine 30-min sessions throughout the school year. Students also completed a pretest, midtest and posttest measuring their algebraic knowledge. Results and ConclusionFirst, prior to the intervention, students scored the highest on procedural knowledge and lowest on conceptual knowledge. Second, students significantly improved and maintained learning gains on conceptual knowledge throughout the intervention. Their performance on procedural knowledge and procedural flexibility items increased at midtest but decreased at posttest. Third, the pattern of results was consistent for students in the DragonBox and From Here to There! conditions, suggesting that both games may support students' conceptual understanding of algebra. The findings have implications for research and practice on supporting algebraic learning through game-based technologies during and beyond educational disruptions.