Volume-based response evaluation with consensual lesion selection: a pilot study by using cloud solutions and comparison to RECIST 1.1

Acad Radiol. 2015 Feb;22(2):217-25. doi: 10.1016/j.acra.2014.09.008. Epub 2014 Dec 2.

Abstract

Rationale and objectives: Lesion volume is considered as a promising alternative to Response Evaluation Criteria in Solid Tumors (RECIST) to make tumor measurements more accurate and consistent, which would enable an earlier detection of temporal changes. In this article, we report the results of a pilot study aiming at evaluating the effects of a consensual lesion selection on volume-based response (VBR) assessments.

Materials and methods: Eleven patients with lung computed tomography scans acquired at three time points were selected from Reference Image Database to Evaluate Response to therapy in lung cancer (RIDER) and proprietary databases. Images were analyzed according to RECIST 1.1 and VBR criteria by three readers working in different geographic locations. Cloud solutions were used to connect readers and carry out a consensus process on the selection of lesions used for computing response. Because there are not currently accepted thresholds for computing VBR, we have applied a set of thresholds based on measurement variability (-35% and +55%). The benefit of this consensus was measured in terms of multiobserver agreement by using Fleiss kappa (κfleiss) and corresponding standard errors (SE).

Results: VBR after consensual selection of target lesions allowed to obtain κfleiss = 0.85 (SE = 0.091), which increases up to 0.95 (SE = 0.092), if an extra consensus on new lesions is added. As a reference, the agreement when applying RECIST without consensus was κfleiss = 0.72 (SE = 0.088). These differences were found to be statistically significant according to a z-test.

Conclusions: An agreement on the selection of lesions allows reducing the inter-reader variability when computing VBR. Cloud solutions showed to be an interesting and feasible strategy for standardizing response evaluations, reducing variability, and increasing consistency of results in multicenter clinical trials.

Keywords: Clinical trials; RECIST; biomarkers; cloud computing; consensus; lesion volume; volume thresholds.

Publication types

  • Comparative Study

MeSH terms

  • Algorithms*
  • Female
  • Humans
  • Imaging, Three-Dimensional / methods*
  • Internet
  • Lung Neoplasms / diagnostic imaging*
  • Male
  • Middle Aged
  • Observer Variation
  • Pattern Recognition, Automated / methods
  • Pilot Projects
  • Radiographic Image Enhancement / methods
  • Radiographic Image Interpretation, Computer-Assisted / methods*
  • Reproducibility of Results
  • Response Evaluation Criteria in Solid Tumors*
  • Sensitivity and Specificity
  • Software
  • Tomography, X-Ray Computed / methods*
  • Treatment Outcome
  • Tumor Burden