Automation of clinical assessments via machine learning and paired comparisons (P4.205)

Objectives: To develop a method for automated clinical assessment of motor dysfunction by training machine learning algorithms with fine-grained clinical judgment derived from pairwise comparisons of video recordings of patients.Background: Many clinical assessment scales in neurology suffer from reliability and sensitivity issues, since they require absolute, qualitative judgments from clinicians. Conversely, quantitative surrogate measures may not convey the same clinically relevant information. Supervised machine learning algorithms allow to map automated surrogate measurements onto the clinical assessment scale, and thus automatically create a clinical rating. However, patient numbers are often too limited for standard machine learning approaches, and it is not possible to validate finer-grained output of the algorithm with a coarse-grained clinical assessment scale. Here, we focus on the expanded disability scale (EDSS) for assessment of motor dysfunction in multiple sclerosis (MS).Methods: EDSS sub-scores are predicted by applying a bespoke supervised machine learning algorithm to motion patterns extracted from video recordings of patients performing pre-defined movements. For fine-grained capture of clinical judgment, we use paired comparisons of patient videos by neurologists. To avoid having to compare all possible pairs of videos, we use a variant of the TrueSkill™ algorithm to present only the most informative pairs of videos to neurologists for comparison.Results: Our novel ensemble-based machine learning algorithm provides robust prediction performance of the EDSS sub-scores from the Finger-to-Nose Test. The paired comparisons of recorded movement videos by expert neurologists show a finer-grained clinical judgment than provided by the EDSS sub-scores, providing a new potential validation standard.Conclusions: Our generic approach to automate clinical assessment by combining depth sensor recordings with video analysis and supervised machine learning to produce clinically relevant information validated against fine-grained capture of neurological judgment from pairwise comparisons can overcome the limitations of current clinical ratings in reliably capturing subtle changes in disability. Disclosure: Dr. Dorn has received personal compensation for activities with Novartis Pharma AG as an employee. Dr. D9Souza has received personal compensation for activities with Bayer AG, Teva, and Genzyme. Dr. D9Souza has received research support from the University of Basel. Dr. Morrison has received personal compensation for activities with Microsoft Research as an employee. Dr. Morrison has received personal compensation for activities with Microsoft Research as an employee. Dr. Burggraaff has received personal compensation for activities with Novartis. Dr. Kamm has received personal compensation for activities with Biogen Idec, Novartis, Bayer Pharmaceuticals, Merck Serono, Genzyme, and Pfizer Inc. Dr. Tewarie has received personal compensation for activities with Novartis. Dr. Vogel has received personal compensation for activities with Novartis as an employee. Dr. Sellen has received personal compensation for activities with Microsoft Research as an employee. Dr. Criminisi has received personal compensation for activities with Microsoft as an employee. Dr. Dahlke has received personal compensation for activities with Novartis as an employee. Dr. Uitdehaag has received personal compensation for activities with Biogen Idec, Novartis, EMD Serono, Teva Neuroscience, Genzyme Corporation, and Roche Diagnostics Corporation. Dr. Kappos has received personal compensation for activities with Actelion Pharmaceuticals. Dr. Chin has received personal compensation for activities with Genentech, Inc. as an employee.