Multicenter Validation of an AI-Based Cholangioscopy System for Biliary Disease Evaluation

The multicenter validation study focused on assessing the performance of an artificial intelligence (AI)-based system for evaluating biliary tract disease using cholangioscopy video footage. Accurate differentiation between benign and malignant biliary strictures is a major clinical challenge, as traditional diagnostic methods, such as endoscopic retrograde cholangiopancreatography (ERCP)-based brush cytology and forceps biopsy, are limited by their low sensitivity. Cholangioscopy offers direct visualization and targeted sampling of biliary pathology, but its reliance on human interpretation introduces diagnostic errors.

Key Objectives:

1. Evaluate AI System Performance: The study aimed to validate the ability of the AI system to analyze unedited cholangioscopy recordings and accurately classify biliary strictures as benign or malignant.

2. Compare Diagnostic Accuracy: The AI system's predictions were compared to traditional ERCP-based sampling techniques (brush cytology, forceps biopsy, and their combined use).

3. Assess Generalizability: The study examined the system's robustness across multiple institutions and diverse patient populations.

Methods:

• Data Collection: Cholangioscopy videos were gathered from multiple academic centers.
• AI Analysis: The AI system processed the videos without retraining and independently generated diagnostic predictions.
• Comparison: AI predictions were compared to diagnostic results obtained from conventional ERCP sampling methods.

Results:

• Superior Diagnostic Accuracy: The AI system consistently outperformed traditional ERCP-based techniques in classifying biliary strictures as benign or malignant.
• Generalizability: The system demonstrated strong performance across different institutions and patient populations, confirming its robustness and applicability.
• Enhanced Clinical Utility: The AI system showed potential as an adjunctive tool, improving early detection of malignancies and reducing reliance on less sensitive methods.

Implications:

1. Improved Diagnostic Accuracy: AI-assisted cholangioscopy analysis significantly enhances the ability to differentiate between benign and malignant biliary strictures, addressing a critical clinical challenge.

2. Streamlined Workflow: The system integrates seamlessly into existing procedural workflows without requiring additional retraining or modifications.

3. Potential for Early Detection: By improving malignancy detection rates, the AI system could lead to earlier interventions and better patient outcomes.

4. Reduced Diagnostic Errors: The AI system minimizes reliance on subjective visual interpretation by clinicians, enhancing reliability.

Conclusion:

This multicenter validation study confirms that AI-based analysis of cholangioscopy footage is a powerful tool for biliary disease evaluation. Its high diagnostic accuracy, generalizability, and ability to integrate into current clinical workflows suggest that AI systems could play a transformative role in the diagnosis and management of biliary tract diseases.