Background

This study investigated the evaluation and decision-making needs of stakeholders for the Oxford Emerging Leaders Programme (ELP) and aimed to redesign its evaluation approach. Drawing from Michael Quinn Patton’s utilisation-focused evaluation approach, semi-structured interviews were conducted with 12 key programme stakeholders. Interviews were thematically analysed to identify key areas for useful and impactful evaluation.

Results

This study provided insights into outcome measures we should endeavour to capture in order to conduct a successful evaluation of the impact of a healthcare leadership development programme. The key domains for evaluation generated from this thematic analysis related to patient outcomes, organisational outcomes, and individual outcomes. Individual outcomes were further classified into those relating to skills or knowledge, those relating to qualities or attitudes, and those relating to the experience of the programme itself. Interviewees also highlighted the perceived value of a mixed methods evaluation, alongside incorporation of pre- and post-measures, 360 feedback, and a longitudinal evaluation.

Our interviewees highlighted several factors that had not been fully addressed in our previous evaluation approach, particularly outcomes related to organisational culture and personal qualities, which they viewed as more critical than we had initially anticipated.

The study underscores the importance of aligning evaluation methods with stakeholder needs. Tailoring evaluations to specific programme aims and incorporating both qualitative and quantitative measures can enhance their utility. These insights contribute to the broader literature on healthcare leadership development and programme evaluation. Thrum has integrated these findings into subsequent programme evaluations for the ELP. 

Read the paper at: https://bmjleader.bmj.com/content/early/2025/03/23/leader-2024-001129