Global Health Security Preparedness and Response: An Analysis of the Relationship between Joint External Evaluation Scores and COVID-19 Response Performance

Objectives The COVID-19 pandemic has highlighted the importance and complexity of a country's ability to effectively respond. The Joint External Evaluation (JEE) assessment was launched in 2016 to assess a country's ability to prevent, detect and respond to public health emergencies. We examined whether JEE indicators could be used to predict a country's COVID-19 response performance to tailor a country's support more effectively. Design From April to August 2020, we conducted interviews with Centers for Disease Control and Prevention country offices that requested COVID-19 support and previously completed the JEE (version 1.0). We used an assessment tool, the 'Emergency Response Capacity Tool' (ERCT), to assess COVID-19 response performance. We analysed 28 ERCT indicators aligned with eight JEE indicators to assess concordance and discordance using strict agreement and weighted kappa statistics. Generalised estimating equation (GEE) models were used to generate predicted probabilities for ERCT scores using JEE scores as the independent model variable. Results Twenty-three countries met inclusion criteria. Of the 163 indicators analysed, 42.3% of JEE and ERCT scores were in agreement (p value=0.02). The JEE indicator with the highest agreement (62%) was 'Emergency Operations Center (EOC) operating procedures and plans', while the lowest (16%) was 'capacity to activate emergency operations'. Findings were consistent with weighted kappa statistics. In the GEE model, EOC operating procedures and plans had the highest predicted probability (0.86), while indicators concerning response strategy and coordination had the lowest (<= 0.5). Conclusions Overall, there was low agreement between JEE scores and COVID-19 response performance, with JEE scores often trending higher. JEE indicators concerning coordination and operations were least predictive of COVID-19 response performance, underscoring the importance of not inferring country response readiness from JEE scores alone. More in-depth country-specific investigations are likely needed to accurately estimate response capacity and tailor countries' global health security activities.