Response to Statistical Issues on Agreement Analysis

Thank you very much for your comment regarding the use of Cohens kappa statistics for assessing the agreement. We agree with you that for ordinally scaled variables, the modified Cohens Kappa with linear or quadratic weights can be used. However, the choice of weights is arbitrary. Alternatively, an intraclass correlation coefficient could also be used. There are also other measures of agreement, all of which have their advantages and disadvantages ( 1 Gwet K.L. Handbook of Inter-Rater ReLiability: the definitive guide to measuring the extent of agreement among raters. Advanced Analytics, LLC, 2014 Google Scholar , 2 de Raadt A. Warrens M.J. Bosker R.J. et al. A comparison of reliability coefficients for ordinal rating scales. J Classif. 2021; 38: 519-543https://doi.org/10.1007/s00357-021-09386-5 Crossref Scopus (16) Google Scholar ).