Comparing gingivitis diagnoses by bleeding on probing (BOP) exclusively versus BOP combined with visual signs using large electronic dental records

The major significance of the 2018 gingivitis classification criteria is utilizing a simple, objective, and reliable clinical sign, bleeding on probing score (BOP%), to diagnose gingivitis. However, studies report variations in gingivitis diagnoses with the potential to under- or over-estimating disease occurrence. This study determined the agreement between gingivitis diagnoses generated using the 2018 criteria (BOP%) versus diagnoses using BOP% and other gingival visual assessments. We conducted a retrospective study of 28,908 patients' electronic dental records (EDR) from January-2009 to December-2014, at the Indiana University School of Dentistry. Computational and natural language processing (NLP) approaches were developed to diagnose gingivitis cases from BOP% and retrieve diagnoses from clinical notes. Subsequently, we determined the agreement between BOP%-generated diagnoses and clinician-recorded diagnoses. A thirty-four percent agreement was present between BOP%-generated diagnoses and clinician-recorded diagnoses for disease status (no gingivitis/gingivitis) and a 9% agreement for the disease extent (localized/generalized gingivitis). The computational program and NLP performed excellently with 99.5% and 98% f-1 measures, respectively. Sixty-six percent of patients diagnosed with gingivitis were reclassified as having healthy gingiva based on the 2018 diagnostic classification. The results indicate potential challenges with clinicians adopting the new diagnostic criterion as they transition to using the BOP% alone and not considering the visual signs of inflammation. Periodic training and calibration could facilitate clinicians' and researchers' adoption of the 2018 diagnostic system. The informatics approaches developed could be utilized to automate diagnostic findings from EDR charting and clinical notes.