- Original research article
- Open Access
Image analysis in posttreatment non-small cell lung cancer surveillance: specialists’ interpretations reviewed by the thoracic multidisciplinary tumor board
Multidisciplinary Respiratory Medicine volume 14, Article number: 34 (2019)
Data show that the initial specialist’s image interpretation and final multidisciplinary tumor board (MTB) assessment can vary substantially in the pretherapeutic cancer setting. The aim of this post hoc analysis was to investigate the concordance of the specialist’s and MTB’s image interpretations in patients undergoing systematic posttreatment lung cancer image surveillance.
In the initial prospective study, lung cancer patients who had received curative-intent treatment were randomly assigned to undergo either contrast-enhanced computed tomography (CE-CT) or integrated 18F-fluorodeoxyglucose positron emission tomography-computed tomography (PET-CT). Imaging was performed every 6 months for 2 years, and all imaging studies were finally assessed by our MTB. This post hoc analysis assessed differences between the initial specialist’s image interpretation and the final MTB’s image interpretation.
In 89 patients, 266 imaging studies (129 PET-CT, 137 CE-CT) were analyzed. In 87.2% (88.4, 86.1%) of the studies, complete concordance was found. Out of the 12.8% (11.6, 13.9%) with discordant results, 7.5% (6.9, 8.0%) had implications for alterations in patient management (major disagreements).
Twenty major disagreements were detected in 17 study patients. Retrospectively, in eight out of these 17 (47%) patients, in contrast to the MTB’s view, the specialist’s interpretation was more appropriate, whereas in nine out of 17 patients (53%), the MTB’s interpretation was more accurate.
In an experienced MTB, the agreement between imaging specialists and the rest of the MTB with regard to the interpretation of images is high in a setting of posttreatment lung cancer image surveillance. It seems that in cases of disagreements, the rates of more accurate interpretation are well balanced between imaging specialists and the MTB.
ISRCTN16281786, Date 23. February 2017.
There is increasing evidence that the pretherapeutic presentation of cancer patients to multidisciplinary tumor boards (MTBs) frequently impacts patient management not only with regard to the adherence to guidelines [1, 2] but also with regard to changing cancer staging [3, 4] and therapeutic procedures [1, 5,6,7,8,9]. Particularly for patients with non-small cell lung cancer (NSCLC), evaluation by a MTB even seems to improve patient survival [10,11,12]. With regard to image interpretation, disagreements have been identified between the original radiologist report and the MTB consensus on the results of the image analysis in up to 30% of cases .
Systematic surveillance after curative-intent treatment of NSCLC is widely recommended, though the modality and length of cancer surveillance is neither well studied nor uniformly agreed on in guidelines . Posttherapeutic image analysis in NSCLC patients is challenging in several ways. First, in most cases after therapeutic interventions, there are residual findings such as scars or effusions. Second, in contrast to the pretherapeutic state, the majority of images do not show any signs of cancer (low pretest probability). Finally, in the case of cancer recurrence, the particular image findings can be discrete and difficult to see.
In contrast to pretherapeutic image analysis, data on the rate of concurrence between specialists’ and MTBs’ interpretations of posttherapeutic images from NSCLC patients are lacking.
The aim of the current study was to compare specialists’ and an MTB’s interpretations of contrast-enhanced computed tomography (CE-CT) and integrated F-fluorodeoxyglucose positron emission tomography-computed tomography (PET-CT) images in the context of posttherapeutic cancer surveillance of NSCLC patients.
This study was a post hoc analysis of a randomized pilot study that has recently been published . The study protocol of this prospective study was approved by our Ethics Committee (Kantonale Ethikkommission Aargau, Switzerland, Protocol No 2011/045). Written informed consent was obtained from all participants. This clinical trial was registered (ISRCTN16281786).
In brief, NSCLC patients after curative-intent treatment were 1:1 randomized to structured CE-CT or PET-CT surveillance between October 11, 2011, and August 29, 2014. The surveillance examinations were performed at 6-month intervals during the two-year follow up period. CE-CT and PET-CT images were interpreted by senior specialists. The particular specialists were consistently members of the MTB. All surveillance examinations were discussed at our weekly MTB meeting. By definition, the study surveillance was finished as soon as the MTB deemed an image finding suspicious, and further diagnostic or therapeutic steps were considered necessary.
Our institution serves Canton Aargau, which includes approximately 600,000 people. Our weekly thoracic MTB meetings started on August 6, 2010, and included members from thoracic surgery, pulmonology, medical oncology, nuclear medicine, radiology, pathology and radiation oncology departments. The participating health care professionals have been members of the MTB for many years. After the weekly meeting, an online summary of findings and recommendations is sent to all members of the MTB for approval. Fifteen to 25 cases are discussed at our thoracic MTB meeting each week. The MTB adheres to the “all cases” concept . This means that without exception all patients of our institution suffering from non-small cell lung cancer are discussed at our MTB to define the initial therapy, the changes in therapy or to discuss surveillance studies.
In the current study, reports from surveillance examinations from radiologists and nuclear medicine specialists were compared with the results of the MTB protocol. All surveillance imaging studies are reviewed by the MTB. The particular definitions of agreement and disagreement, respectively, were predefined (see Table 1). Patients who showed symptomatic recurrence before the first surveillance study was scheduled were not considered.
In a second step, it was retrospectively considered whether the interpretation of the specialist or the MTB was ultimately more appropriate.
Statistica 10.0 software (StatSoft, Inc., Tulsa, OK) was used for the statistical analyses. Absolute numbers (percentages) and medians (interquartile ranges, IQRs) were used to describe the study population and the rates of agreement and disagreement, respectively. Due to the descriptive nature of the current study and the lack of a power analysis, a comparison of study results between imaging procedures was not pursued. To identify differences between groups of patients, Mann-Whitney U-test for independent samples or the Chi-square test was used where appropriate. A p less than 0.05 was considered statistically significant.
Due to symptomatic recurrence before the first surveillance study, out of 96 patients included in the original prospective study, seven did not have any surveillance studies. Therefore, the images of a total of 89 patients, including 130 PET-CTs of 45 patients and 138 CE-CTs of 44 patients, respectively, were analyzed. One PET-CT and one CE-CT were excluded from further analysis because the written final imaging report was dated after the corresponding MTB meeting took place so a final number of 266 scans were analyzed. The baseline characteristics of the study population are summarized in Table 2.
The results of the analyses by the specialists and the MTB and the agreement between the two regarding the 266 images are summarized in Table 3.
Additional details about the disagreements are summarized in Table 4.
Twenty major disagreements were detected in 17 different patients. Retrospectively, in eight out of these 17 (47%) patients, in contrast to MTB’s view, the specialist’s interpretation turned out to be more appropriate. In none of these cases there was a potentially curable cancer manifestation missed. On the other hand, in nine out of 17 patients (53%), the analysis MTB was retrospectively determined to have been more accurate (data not shown). With regard to age, sex, the number of surveillance studies, cancer stage and neoadjuvant pretreatment, we did not find significant differences between these 17 patients and the 72 patients of the entire group (p = 0.754, 0.279, 0.261, 0.201 and 0.735, respectively).
In the current study we found complete concordance between the initial specialist’s image interpretation and the final MTB’s image interpretation in 87.2% of the studies. Out of the discordant studies, 7.5% had implications for alterations in patient management. Retrospectively, in cases of disagreements, the rates of more accurate interpretation were well balanced between imaging specialists and the MTB.
Discussion by the MTB can change the therapeutic management plan of cancer patients in up to 52% of cases . In approximately 10 [6, 7, 17] to 45%  of cases, changes are made due to review of the images by the MTB. In the case of lung cancer, several studies observed a cancer survival benefit when treatment plans came from the MTB rather than from individual physicians [18, 19]. However, few data exist regarding the impact of image interpretation revision by the MTB on patient outcomes. Recently, Schmidt et al.  have shown in a cohort of patients with lung and esophageal cancer that the MTB recommends changing therapeutic plans in a substantial proportion of patients (24%) due to a change in staging. In most cases, this was achieved by reviewing diagnostic images.
Data regarding image interpretation agreement in the surveillance setting are limited. Li et al.  found excellent agreement between two radiologists who evaluated CT scans after stereotactic body radiotherapy (Kappa values 0.68 to 1). In contrast, Gierada et al.  found moderate interobserver agreement regarding the interpretation of low-dose lung cancer screening CT scans (Kappa 0.58 to 0.64).
Posttreatment imaging surveillance after lung cancer therapy is costly in terms of resources , and efforts should be made to improve the evidence provided by this procedure. This includes determining the interrater agreement regarding the interpretation of the images. In our lung cancer treatment program, we therefore systematically review all images at our MTB meetings in both the pre- and posttreatment settings. The overall disagreement rate of 12.8% in our current study is less than the 30% reported by Masch et al. . In that study, pretherapeutic radiological reports were reviewed by the hepatobiliary tumor board. Nevertheless, in only 8% of their caseschanges in the subsequent patient management occurred due to the findings of the MTB, which is quite similar to the 7.5% observed in our study. In a study of a pediatric MTB,  changes in the management of the patients were made in 7.6% of cases based on a review of pretherapeutic radiology images. Lee et al.  reported in a study of a gynecologic MTB that the review of images resulted in a change in interpretation in 10.6% of cases, 3.5% of these changes resulted in a change in the treatment plan. The 7.5% we observed in our study is higher probably because we considered all types of management changes rather than only treatment plan changes.
We were not able to identify differences between patients involved and not involved in disagreements between the specialists and the MTB. This might be the consequence of the relatively small number of patients. The fact that in most cases in the posttherapeutic setting no cancer is visible and treatment residues are comparable between patients potentially contributes to this observation.
In our population, the further follow up of the 17 patients regarding whose imaging studies major disagreements occurred revealed the interesting finding that the accuracy of the specialist’s and MTB’s interpretations were well balanced. In approximately 50% of cases in which major disagreements occurred, the initial interpretation of the specialist was retrospectively determined to be more accurate than interpretation of the MTB and vice versa. It is important to stress that no curable cancer was missed in any retrospective view. Although the observed disagreements led to changes in management, no severe management errors occurred, particularly in those cases in which the interpretation of the MTB was retrospectively determined to be less accurate. This indicates that, most likely in cases of ambiguous images, the safer procedure is preferred by the MTB so as not to miss a potentially curable cancer recurrence.
The limitations of our current study include the relatively small number of cases. In particular the low numbers of factors such as radiotherapy that potentially interfere in a relevant way with image interpretation make a more detailed analysis impossible. The strengths include the initial prospective inclusion of patients and the homogenous management of all patients in our structured surveillance program, which is part of the MTB. Furthermore, we believe that the competence of the MTB of our institution is high particularly due to our “all case” concept. This concept ensures both an ideal initial therapy conception and adequate therapy alterations in patients suffering from non-small cell lung cancer.
In conclusion, it seems that the rate of disagreements in the interpretation of images in the context of structured posttherapeutic lung cancer surveillance is low. Disagreements occur in roughly 10 % of examinations, a rate that is comparable to those published in the pretherapeutic cancer context. In addition, we believe that both imaging specialists and the MTB can learn from each other in the context of surveillance. For this reason, we strongly believe that interpretation of lung cancer imaging surveillance should be part of the role of the MTB.
Availability of data and materials
The datasets analysed during the current study are available from the corresponding author on request.
Contrast-enhanced computed tomography
Multidisciplinary tumor board
Non-small cell lung cancer
Integrated 18F-fluorodeoxyglucose positron emission tomography-computed tomography
AlFarhan HA, Algwaiz GF, Alzahrani HA, Alsuhaibani RS, Alolayan A, Abdelhafiz N, et al. Impact of GI tumor board on patient management and adherence to guidelines. J Glob Oncol. 2018:1–8. https://doi.org/10.1200/jgo.17.00164.
Rosell L, Alexandersson N, Hagberg O, Nilbert M. Benefits, barriers and opinions on multidisciplinary team meetings: a survey in Swedish cancer care. BMC Health Serv Res. 2018;18:249.
Thenappan A, Halaweish I, Mody RJ, Smith EA, Geiger JD, Ehrlich PF, et al. Review at a multidisciplinary tumor board impacts critical management decisions of pediatric patients with cancer. Pediatr Blood Cancer. 2017;64:254–8.
Wheless SA, McKinney KA, Zanation AM. A prospective study of the clinical impact of a multidisciplinary head and neck tumor board. Otolaryngol Head Neck Surg. 2010;143:650–4.
Ioannidis A, Konstantinidis M, Apostolakis S, Koutserimpas C, Machairas N, Konstantinidis KM. Impact of multidisciplinary tumor boards on patients with rectal cancer. Mol Clin Oncol. 2018;9:135–7.
Greer HO, Frederick PJ, Falls NM, Tapley EB, Samples KL, Kimball KJ, et al. Impact of a weekly multidisciplinary tumor board conference on the management of women with gynecologic malignancies. Int J Gynecol Cancer. 2010;20:1321–5.
Cohen P, Tan AL, Penman A. The multidisciplinary tumor conference in gynecologic oncology--does it alter management? Int J Gynecol Cancer. 2009;19:1470–2.
Newman EA, Guest AB, Helvie MA, Roubidoux MA, Chang AE, Kleer CG, et al. Changes in surgical management resulting from case review at a breast cancer multidisciplinary tumor board. Cancer. 2006;107:2346–51.
Schmidt HM, Roberts JM, Bodnar AM, Kunz S, Kirtland SH, Koehler RP, et al. Thoracic multidisciplinary tumor board routinely impacts therapeutic plans in patients with lung and esophageal cancer: a prospective cohort study. Ann Thorac Surg. 2015;99:1719–24.
Tamburini N, Maniscalco P, Mazzara S, Maietti E, Santini A, Calia N, et al. Multidisciplinary management improves survival at 1 year after surgical treatment for non-small-cell lung cancer: a propensity score-matched study. Eur J Cardiothorac Surg. 2018;53:1199–204.
Stone E, Rankin N, Kerr S, Fong K, Currow DC, Phillips J, et al. Does presentation at multidisciplinary team meetings improve lung cancer survival? Findings from a consecutive cohort study. Lung Cancer. 2018;124:199–204.
Bilfinger TV, Albano D, Perwaiz M, Keresztes R, Nemesure B. Survival outcomes among lung cancer patients treated using a multidisciplinary team approach. Clin Lung Cancer. 2018;19:346–51.
Masch WR, Parikh ND, Licari TL, Mendiratta-Lala M, Davenport MS. Radiologist quality assurance by nonradiologists at tumor board. J Am Coll Radiol. 2018;15:1259–65.
Colt HG, Murgu SD, Korst RJ, Slatore CG, Unger M, Quadrelli S. Follow-up and surveillance of the patient with lung cancer after curative-intent therapy: diagnosis and management of lung cancer, 3rd ed: American College of Chest Physicians evidence-based clinical practice guidelines. Chest. 2013;143:e437S–54S.
Gambazzi F, Frey LD, Bruehlmeier M, Janthur WD, Graber SM, Heuberger J, et al. Comparing two imaging methods for follow-up of lung cancer treatment: a randomized pilot study. Ann Thorac Surg. 2019;107:430–5.
Vetto JT, Richert-Boe K, Desler M, DuFrain L, Hagen H. Tumor board formats: “fascinating case” versus “working conference”. J Cancer Educ. 1996;11:84–8.
Lee B, Kim K, Choi JY, Suh DH, No JH, Lee HY, et al. Efficacy of the multidisciplinary tumor board conference in gynecologic oncology: a prospective study. Medicine (Baltimore). 2017;96:e8089.
Bydder S, Nowak A, Marion K, Phillips M, Atun R. The impact of case discussion at a multidisciplinary team meeting on the treatment and survival of patients with inoperable non-small cell lung cancer. Intern Med J. 2009;39:838–41.
Forrest LM, McMillan DC, McArdle CS, Dunlop DJ. An evaluation of the impact of a multidisciplinary team, in a single centre, on treatment and survival in patients with inoperable non-small-cell lung cancer. Br J Cancer. 2005;93:977–8.
Li Q, Kim J, Balagurunathan Y, Qi J, Liu Y, Latifi K, et al. CT imaging features associated with recurrence in non-small cell lung cancer patients after stereotactic body radiotherapy. Radiat Oncol. 2017;12:158.
Gierada DS, Pilgram TK, Ford M, Fagerstrom RM, Church TR, Nath H, et al. Lung cancer: interobserver agreement on interpretation of pulmonary findings at low-dose CT screening. Radiology. 2008;246:265–72.
Dyer BA, Daly ME. Surveillance imaging following definitive radiotherapy for non-small cell lung cancer: what is the clinical impact? Semin Oncol. 2017;44:303–9.
The current study was supported by Research Funding from the Research Council of the Cantonal Hospital Aarau, Switzerland (Grant 14100.000.007).
Ethics approval and consent to participate
The study protocol of this prospective study was approved by our Ethics Committee (Kantonale Ethikkommission Aargau, Switzerland, Protocol No 2011/045). Written informed consent was obtained from all participants. This clinical trial was registered (ISRCTN16281786).
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Gambazzi, F., Frey, L.D., Bruehlmeier, M. et al. Image analysis in posttreatment non-small cell lung cancer surveillance: specialists’ interpretations reviewed by the thoracic multidisciplinary tumor board. Multidiscip Respir Med 14, 34 (2019). https://doi.org/10.1186/s40248-019-0198-z
- Posttreatment lung cancer surveillance
- Agreement on imaging
- Multidisciplinary tumor board