Automated Identification of Optimal Portal Venous Phase Timing with Convolutional Neural Networks

Abstract

Objectives: To develop a deep learning-based algorithm to automatically identify optimal portal venous phase timing (PVP-timing) so that image analysis techniques can be accurately performed on post contrast studies.

Methods: 681 CT-scans (training: 479 CT-scans; validation: 202 CT-scans) from a multicenter clinical trial in patients with liver metastases from colorectal cancer were retrospectively analyzed for algorithm development and validation. An additional external validation was performed on a cohort of 228 CT-scans from gastroenteropancreatic neuroendocrine cancer patients. Image acquisition was performed according to each centers' standard CT protocol for single portal venous phase, portal venous acquisition. The reference gold standard for the classification of PVP-timing as either optimal or nonoptimal was based on experienced radiologists' consensus opinion. The algorithm performed automated localization (on axial slices) of the portal vein and aorta upon which a novel dual input Convolutional Neural Network calculated a probability of the optimal PVP-timing.

Results: The algorithm automatically computed a PVP-timing score in 3 seconds and reached area under the curve of 0.837 (95% CI: 0.765, 0.890) in validation set and 0.844 (95% CI: 0.786, 0.889) in external validation set.

Conclusion: A fully automated, deep-learning derived PVP-timing algorithm was developed to classify scans' contrast-enhancement timing and identify scans with optimal PVP-timing. The rapid identification of such scans will aid in the analysis of quantitative (radiomics) features used to characterize tumors and changes in enhancement with treatment in a multitude of settings including quantitative response criteria such as Choi and MASS which rely on reproducible measurement of enhancement.

Keywords: Abdominal; Artificial intelligence; Quality control; Radiography; Tomography; X-ray computed.