Methodological integrity assessment in the mobile paradigm literature: A lesson for understanding opportunistic use of researcher degrees of freedom in psychology

The mobile paradigm has played a fundamental role in memory development research. One key characteristic of the mobile paradigm literature is that across decades, researchers have faithfully followed a particular methodological protocol with its own unique definitions of learning and memory. To investigate the extent to which these methodological choices affected the results, the literature (77 publications and 505 statistical tests) was evaluated for four frequently encountered research biases. The results suggested that research using the paradigm was conducted with scientific rigor. However, methodological choices along with unique operational definitions of learning and memory accounted for more than half of the findings. Thus, the literature has been contaminated by methodological artifacts due to the opportunistic use of researcher degrees of freedom.