Ir para o conteúdo principal

Um artigo com a tag "Skin cancer"

Ver todas as tags

Clinical validation study of artificial intelligence algorithms for early noninvasive detection of in vivo cutaneous melanoma

· 5 minutos de leitura
Hospital de Basurto
Hospital de Basurto
University Hospital
Hospital Universitario Cruces
Hospital Universitario Cruces
University Hospital

Conclusions​

The device has demonstrated an excellent performance in terms of malignancy prediction, which turns it into a valuable tool to prioritize patients according to their risk of presenting malignancy.

The AUC metric for the malignancy prediction was 0.8983, which is comparable to that of expert healthcare professionals (HCP) and speaks to the potential of using the device to improve clinical workflows.

Regarding skin lesion recognition in general terms, the Top-5 accuracy was 84.22%, which supports the device's intended use as a clinical decision-support tool. Specifically in melanoma, the AUC metric was 84.82% which is considerably high and means the consecution of the goals set out in the hypotheses of the study. On the downside, the Top-1 accuracy was 55.01% in the multiple ICD classification task, but the Top-3 accuracy increased to 75.69%. However, it's important to keep in mind that the Top-1 accuracy metric was not a relevant metric to this study, nor the performance of the device, because the device is designed to always output at least the top five predicted classes. This is aligned with its intended purpose as a clinical decision-support tool.

Given the results of the image dataset collected in this study, it is clear that images of better quality would have improved the functioning of the device and provided more valuable insights. Also, as the raw images were usually taken far away from the skin lesion, the cropping resulted in images of suboptimal resolution, which would have also been corrected by higher quality images - or by actually taking the image closer to the lesion.

Summary​

About the study
  • Code: LEGIT_MC_EVCDAO_2019
  • Status: Finished
  • Start date: November 22nd, 2019
  • Finish date: April 10th, 2024
  • Acceptance criteria:
    • AUC greater than 0.8
    • sensitivity of at least 80% or higher
    • specificity of at least 70% or higher