Effective deep learning training for single-image super-resolution in endomicroscopy exploiting video-registration-based reconstruction

Daniele Ravì, Agnieszka Barbara Szczotka, Dzhoshkun Ismail Shakir, Stephen P. Pereira, Tom Vercauteren

Research output: Contribution to journalArticlepeer-review

16 Citations (Scopus)


Purpose: Probe-based confocal laser endomicroscopy (pCLE) is a recent imaging modality that allows performing in vivo optical biopsies. The design of pCLE hardware, and its reliance on an optical fibre bundle, fundamentally limits the image quality with a few tens of thousands fibres, each acting as the equivalent of a single-pixel detector, assembled into a single fibre bundle. Video registration techniques can be used to estimate high-resolution (HR) images by exploiting the temporal information contained in a sequence of low-resolution (LR) images. However, the alignment of LR frames, required for the fusion, is computationally demanding and prone to artefacts. Methods: In this work, we propose a novel synthetic data generation approach to train exemplar-based Deep Neural Networks (DNNs). HR pCLE images with enhanced quality are recovered by the models trained on pairs of estimated HR images (generated by the video registration algorithm) and realistic synthetic LR images. Performance of three different state-of-the-art DNNs techniques were analysed on a Smart Atlas database of 8806 images from 238 pCLE video sequences. The results were validated through an extensive image quality assessment that takes into account different quality scores, including a Mean Opinion Score (MOS). Results: Results indicate that the proposed solution produces an effective improvement in the quality of the obtained reconstructed image. Conclusion: The proposed training strategy and associated DNNs allows us to perform convincing super-resolution of pCLE images.

Original languageEnglish
Pages (from-to)917-924
Number of pages8
JournalInternational Journal of Computer Assisted Radiology and Surgery (IJCARS)
Issue number6
Publication statusPublished - 1 Jun 2018


  • Deep learning
  • Example-based super-resolution
  • Mosaicking
  • Probe-based confocal laser endomicroscopy


Dive into the research topics of 'Effective deep learning training for single-image super-resolution in endomicroscopy exploiting video-registration-based reconstruction'. Together they form a unique fingerprint.

Cite this