Plan complexity metrics for head and neck VMAT competition plans

Previous plan competitions have largely focused on dose metric assessments. However, whether the submitted plans were realistic and reasonable from a quality assurance (QA) perspective remains unclear. This study aimed to investigate the relationship between aperture-based plan complexity metrics (PCM) in volumetric modulated arc therapy (VMAT) competition plans and clinical treatment plans verified through patient-specific QA (PSQA). In addition, the association of PCMs with plan quality was examined. A head and neck (HN) plan competition was held for Japanese institutions from June 2019 to July 2019, in which 210 competition plans were submitted. Dose distribution quality was quantified based on dose-volume histogram (DVH) metrics by calculating the dose distribution plan score (DDPS). Differences in PCMs between the two VMAT treatment plan groups (HN plan competitions held in Japan and clinically accepted HN VMAT plans through PSQA) were investigated. The mean (± standard deviation) DDPS for the 98 HN competition plans was 158.5 ± 20.6 (maximum DDPS: 200). DDPS showed a weak correlation with PCMs with a maximum r of 0.45 for monitor unit (MU); its correlation with some PCMs was “very weak.” Significant differences were found in some PCMs between plans with the highest 20% DDPSs and the remaining plans. The clinical VMAT and competition plans revealed similar distributions for some PCMs. Deviations in PCMs for the two groups were comparable, indicating considerable variability among planners regarding planning skills. The plan complexity for HN VMAT competition plans increased for high-quality plans, as shown by the dose distribution. Direct comparison of PCMs between competition plans and clinically accepted plans showed that the submitted HN VMAT competition plans were realistic and reasonable from the QA perspective. This evaluation may provide a set of criteria for evaluating plan quality in plan competitions.