Robust reconstruction of fluorescence molecular tomography based on adaptive adversarial learning strategy

Phys Med Biol. 2023 Feb 10;68(4). doi: 10.1088/1361-6560/acb638.

Abstract

Objective.Fluorescence molecular tomography (FMT) is a promising molecular imaging modality for quantifying the three-dimensional (3D) distribution of tumor probes in small animals. However, traditional deep learning reconstruction methods that aim to minimize the mean squared error (MSE) and iterative regularization algorithms that rely on optimal parameters are typically influenced by strong noise, resulting in poor FMT reconstruction robustness.Approach.In this letter, we propose an adaptive adversarial learning strategy (3D-UR-WGAN) to achieve robust FMT reconstructions. Unlike the pixel-based MSE criterion in traditional CNNs or the regularization strategy in iterative solving schemes, the reconstruction strategy can greatly facilitate the performance of the network models through alternating loop training of the generator and the discriminator. Second, the reconstruction strategy combines the adversarial loss in GANs with the L1 loss to significantly enhance the robustness and preserve image details and textual information.Main results.Both numerical simulations and physical phantom experiments demonstrate that the 3D-UR-WGAN method can adaptively eliminate the effects of different noise levels on the reconstruction results, resulting in robust reconstructed images with reduced artifacts and enhanced image contrast. Compared with the state-of-the-art methods, the proposed method achieves better reconstruction performance in terms of target shape recovery and localization accuracy.Significance.This adaptive adversarial learning reconstruction strategy can provide a possible paradigm for robust reconstruction in complex environments, and also has great potential to provide an alternative solution for solving the problem of poor robustness encountered in other optical imaging modalities such as diffuse optical tomography, bioluminescence imaging, and Cherenkov luminescence imaging.

Keywords: adversarial learning; fluorescence tomography; robust reconstruction.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Algorithms
  • Animals
  • Artifacts
  • Image Processing, Computer-Assisted* / methods
  • Phantoms, Imaging
  • Tomography, Optical*