Kernel Self-Attention for Weakly-Supervised Image Classification Using Deep Multiple Instance Learning

Dawid Rymarczyk, Adriana Borowa, Jacek Tabor, Bartosz Zielinski; Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2021, pp. 1721-1730

Abstract


Not all supervised learning problems are described by a pair of a fixed-size input tensor and a label. In some cases, especially in medical image analysis, a label corresponds to a bag of instances (e.g. image patches), and to classify such bag, aggregation of information from all of the instances is needed. There have been several attempts to create a model working with a bag of instances, however, they are assuming that there are no dependencies within the bag and the label is connected to at least one instance. In this work, we introduce Self-Attention Attention-based MIL Pooling (SA-AbMILP) aggregation operation to account for the dependencies between instances. We conduct several experiments on MNIST, histological, microbiological, and retinal databases to show that SA-AbMILP performs better than other models. Additionally, we investigate kernel variations of Self-Attention and their influence on the results.

Related Material


[pdf]
[bibtex]
@InProceedings{Rymarczyk_2021_WACV, author = {Rymarczyk, Dawid and Borowa, Adriana and Tabor, Jacek and Zielinski, Bartosz}, title = {Kernel Self-Attention for Weakly-Supervised Image Classification Using Deep Multiple Instance Learning}, booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)}, month = {January}, year = {2021}, pages = {1721-1730} }