You are currently on the new version of our website. Access the old version .
DiagnosticsDiagnostics
  • Reply
  • Open Access

9 January 2026

Reply to Ismayilli et al. Comment on “Megat Ramli et al. A Systematic Review: The Role of Artificial Intelligence in Lung Cancer Screening in Detecting Lung Nodules on Chest X-Rays. Diagnostics 2025, 15, 246”

and
1
Institut Kanser Negara, Ministry of Health, Putrajaya 62250, Malaysia
2
Department of Public Health Medicine, Faculty of Medicine, Universiti Kebangsaan Malaysia, Bangi 43600, Malaysia
*
Author to whom correspondence should be addressed.
This article belongs to the Section Machine Learning and Artificial Intelligence in Diagnostics
We would like to sincerely thank you for your thoughtful and very helpful comments on our systematic review titled “A Systematic Review: The Role of Artificial Intelligence in Lung Cancer Screening in Detecting Lung Nodules on Chest X-Rays” [1]. Your remarks point out an important issue in the use of AI for screening, which is that the performance of an algorithm cannot be viewed alone. It must also be considered together with what happens afterwards in the clinical pathway, especially when false-positive cases increase. This point was also mentioned in the recent work by Geppert et al. 2024, who noted that even a small rise in false-positive rate may cause quite heavy burden in settings where disease prevalence is low [2].
In our review, we focused mainly on diagnostic accuracy findings from 34 studies, which were quite different from each other. Because of this, we found a wide range of values for specificity and positive predictive value (PPV). Some studies, especially those in real-world screening cohorts, showed PPV as low as 1.3% [3], while others using more controlled datasets reported PPV above 70% [4]. As you highlighted, this kind of variation is not a small matter in low-prevalence environments. Even a modest increase in false positives can mean more CT scans, additional clinic appointments, and also more anxiety for patients. This pattern is in line with the findings by Maiter and Hocking [5], who only observed PPV of 5.5% in their screening cohort, suggesting the possibility of over-investigation.
Although our review did mention these issues in a more indirect way—such as discussing threshold optimisation and the role of AI as a supplementary tool—we admit that the broader system implications of false positives should be discussed more clearly. Like you pointed out, any improvement in sensitivity must be balanced with how resources are used in real practice, how the workflow is affected, and also how patients actually feel the impact.
We also appreciate your comment regarding study designs such as stepped-wedge cluster randomised trials. These approaches offer something beyond the usual diagnostic accuracy metrics because they can capture real-world workflow changes, imaging utilisation, and patient outcomes after AI is introduced. Such pragmatic designs are needed if we want to connect technical performance with actual clinical value.
Your practical recommendations for implementing AI in screening pathways are also important, and they match well with what we summarised in the manuscript:
  • Using AI as a second reader, especially in difficult anatomical areas where nodules are commonly missed, is consistent with the sensitivity improvements seen particularly among less experienced readers.
  • AI performance needs to be assessed across different clinical settings, since inconsistency between environments can disturb the balance between sensitivity and false positives.
  • Continuous monitoring and user-focused system design are necessary so that the AI tool can function properly in various practice situations.
We agree that bringing in these governance elements will help provide a more complete understanding of AI’s role in lung cancer screening, not only from the technical aspect but also its clinical value.
Once again, we truly appreciate your thoughtful and constructive feedback. Your insights help to strengthen the field of AI research and also the safe and meaningful adoption of AI systems in clinical services. We believe that combining diagnostic accuracy evidence with real-world implementation research, as you suggested, will further support the development of AI-assisted lung cancer screening.

Acknowledgments

Clause AI was used to assist with language clarity and proofreading of this reply. All scientific content and arguments were authored and verified by the research team.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Ismayilli, A.; Hansel, J.; Erhieyovwe, E. Comment on Megat Ramli et al. A Systematic Review: The Role of Artificial Intelligence in Lung Cancer Screening in Detecting Lung Nodules on Chest X-Rays. Diagnostics 2025, 15, 246. Diagnostics 2026, 16, 109. [Google Scholar] [CrossRef]
  2. Geppert, J.; Asgharzadeh, A.; Brown, A.; Stinton, C.; Helm, E.J.; Jayakody, S.; Todkill, D.; Gallacher, D.; Ghiasvand, H.; Patel, M.; et al. Software using artificial intelligence for nodule and cancer detection in CT lung cancer screening: Systematic review of test accuracy studies. Thorax 2024, 79, 1040–1049. [Google Scholar] [CrossRef] [PubMed]
  3. Lee, J.H.; Sun, H.Y.; Park, S.; Kim, H.; Hwang, E.J.; Goo, J.M.; Park, C.M. Performance of a deep learning algorithm compared with radiologic interpretation for lung cancer detection on chest radiographs in a health screening population. Radiology 2020, 297, 687–696. [Google Scholar] [CrossRef] [PubMed]
  4. Majkowska, A.; Mittal, S.; Steiner, D.F.; Reicher, J.J.; McKinney, S.M.; Duggan, G.E.; Eswaran, K.; Chen, P.-H.C.; Liu, Y.; Kalidindi, S.R.; et al. Chest radiograph interpretation with deep learning models: Assessment with radiologist-adjudicated reference standards and population-adjusted evaluation. Radiology 2020, 294, 421–431. [Google Scholar] [CrossRef] [PubMed]
  5. Maiter, A.; Hocking, K.; Matthews, S.; Taylor, J.; Sharkey, M.; Metherall, P.; Alabed, S.; Dwivedi, K.; Shahin, Y.; Anderson, E.; et al. Evaluating the performance of artificial intelligence software for lung nodule detection on chest radiographs in a retrospective real-world UK population. BMJ Open 2023, 13, e077348. [Google Scholar] [CrossRef] [PubMed]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.