Study protocol for the Evaluation of the Movember and Distinguished Gentleman’s Ride Veterans and First Responders Mental Health Grant Program

Abstract Background In the course of their work, first responders (police, firefighters, paramedics/ambulance personnel, emergency services), and military personnel are regularly exposed to challenging events involving life-threatening situations, serious injury and fatalities. Cumulative exposure to critical incidents and often life-threatening events leads to a significant risk for Veterans and First Responders (VFRs) developing mental ill health and disorders. Two philanthropic organisations, Movember and Distinguished Gentleman’s Ride, funded 15 organisations to conduct 25 preventative and early intervention Projects through a Grant Program, across seven countries (2021 – 2024). The Projects aim to improve the mental health and wellbeing of VFRs, their families/significant others. This paper describes the methods to be used for the external evaluation of the Projects and Grant Program. The evaluation aims to: identify which Projects and their strategies are effective and have a positive impact on VFRs and their families, provide value for money; and assess the return on investment for the Grant Program funders. Methods The evaluation will take an ecosystem real-world approach, which recognises the context and manages the complexities involved. The evaluation will use multi-step mixed methods and novel approaches across three perspectives: the Projects; comparisons across Projects; and the grant program overall. Embedded in the evaluation design are methods, knowledge sharing and organisational learning activities for all stakeholders during and beyond the evaluation. Data will be collected by the Projects (de-identified for evaluators) and the evaluation team on input, throughputs, and output indicators. The analysis tools include: the Global Impact Analytics Framework, statistical analysis for sustained improvements for individuals and organisational outcomes, performance evaluation using an efficient decision support approach, social return on investment or similar cost analysis and return on investment for the overall grant program, use of a Co-op platform which visually links Projects’ connected data to other open source information to gain new insights, and finally the assessment of the project’s use of a gendered lens. Discussion The complexity and heterogeneity of Projects implemented in the real world presents significant evaluation challenges and limitations. However, the formative and summative learning gained through the evaluation will be highly relevant to all stakeholders involved. Study Registration: The impact analysis of the Movember Veterans and First Responders Grant Program was registered on the Open Science Framework (OSF) Registration doi.org/10.17605/OSF.IOVNK89