Calibration of additional computational tools expands ClinGen recommendation options for variant classification with PP3/BP4 criteria

Abstract

Purpose: We previously developed an approach to calibrate computational tools for clinical variant classification, updating recommendations for the reliable use of variant impact predictors to provide evidence strength up to Strong. A new generation of tools using distinctive approaches has since been released, and these methods must be independently calibrated for clinical application.

Methods: Using our local posterior probability-based calibration and our established data set of ClinVar pathogenic and benign variants, we determined the strength of evidence provided by 3 new tools (AlphaMissense, ESM1b, and VARITY) and calibrated scores meeting each evidence strength.

Results: All 3 tools reached the Strong level of evidence for variant pathogenicity and Moderate for benignity, although sometimes for few variants. Compared with previously recommended tools, these yielded at best only modest improvements in the trade-offs between evidence strength and false-positive predictions.

Conclusion: At calibrated thresholds, 3 new computational predictors provided evidence for variant pathogenicity at similar strength to the 4 previously recommended predictors (and comparable with functional assays for some variants). This calibration broadens the scope of computational tools for application in clinical variant classification. Their new approaches offer promise for future advancement of the field.

Keywords: ACMG/AMP classification; AlphaMissense; Calibration; ESM1b; VARITY.