Improving Automatic Endoscopic Stone Recognition Using a Multi-view Fusion Approach Enhanced with Two-Step Transfer Learning

Francisco Lopez-Tiro, Elias Villalvazo-Avila, Juan Pablo Betancur-Rengifo, Ivan Reyes-Amezcua, Jacques Hubert, Gilberto Ochoa-Ruiz, Christian Daul; Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) Workshops, 2023, pp. 4165-4172

Abstract

This contribution presents a deep-learning method for extracting and fusing image information acquired from different viewpoints, with the aim to produce more discriminant object features for the identification of the type of kidney stones seen in endoscopic images. The approach was specifically designed to mimic the morpho-constitutional analysis to visually classify kidney stones by jointly using surface and section images of kidney stone fragments. The model was further improved with a two-step transfer learning approach and by attention blocks to refine the learned feature maps. Deep feature fusion strategies improved the results of single view extraction backbone models by more than 6% in terms of accuracy of the kidney stones classification.

Related Material

[pdf] [arXiv]
[bibtex]
@InProceedings{Lopez-Tiro_2023_ICCV, author = {Lopez-Tiro, Francisco and Villalvazo-Avila, Elias and Betancur-Rengifo, Juan Pablo and Reyes-Amezcua, Ivan and Hubert, Jacques and Ochoa-Ruiz, Gilberto and Daul, Christian}, title = {Improving Automatic Endoscopic Stone Recognition Using a Multi-view Fusion Approach Enhanced with Two-Step Transfer Learning}, booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) Workshops}, month = {October}, year = {2023}, pages = {4165-4172} }