Using Data-Prompted Interviews in Interactive Information Retrieval Research: A Reflection on The Study of Self-Efficacy When Learning Using Search

Capturing authentic information behaviors, feelings, and attitudes in natural settings is a challenge in interactive information retrieval research (IIR). Quantitative data collection is useful for understanding IIR at scale. Yet common data collection techniques, such as surveys, lack participants’ reasoning behind their choices. Qualitative data collection, such as think aloud and after protocols, support understanding how people behave, think, and feel immediately following an experience, but may be subject to cognitive biases and are challenging to deliver longitudinally. IIR studies have an opportunity to enhance ecological validity by using mixed and multi-method studies. This paper applies learnings from a longitudinal mixed method study that combines the 'in-situ' benefits of collecting real-time data over time with the benefits of retrospectives. This approach has potential to advance SAL research by providing a contextualised approach to longitudinal data collection and can be used to gain deeper insights into subjective experiences.