A Study of Examiner Accuracy in Cartridge Case Comparisons Part 2: Examiner Use of the AFTE Range of Conclusions

This report describes an analysis of how examiners used the Association of Firearm and Toolmark Examiners (AFTE) Range of Conclusions in a controlled study undertaken to estimate examiner error rates in comparing cartridge cases. Results of the error rate analysis are reported in [1]; this paper focuses on a broader analysis of how the entire collection of classification categories, especially those in the Inconclusive range, were used by the participating examiners. Volunteer active examiners with AFTE membership or working in laboratories that participate in Association of Crime Laboratory Directors (ASCLD) were provided with 15 sets of three known and one questioned cartridge cases fired from a collection of 25 new Ruger SR9 handguns. Remington 9-mm Luger (manufacturer designation L9MM3) ammunition was used and comparison sets were made up of cartridge cases fired within 100 cartridges of each other for each gun. Examiners were provided with a background survey, an answer sheet allowing for the AFTE Range of Conclusions, and return shipping materials. The participating examiners were provided with both same-source and different-source comparison sets allowing the study to assess both error rates.