Detecting Persuasive Atypicality by Modeling Contextual Compatibility

Meiqi Guo, Rebecca Hwa, Adriana Kovashka; Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021, pp. 972-982

We propose a new approach to detect atypicality in persuasive imagery. Unlike atypicality which has been studied in prior work, persuasive atypicality has a particular purpose to convey meaning, and relies on understanding the common-sense spatial relations of objects. We propose a self-supervised attention-based technique which captures contextual compatibility, and models spatial relations in a precise manner. We further experiment with capturing common sense through the semantics of co-occurring object classes. We verify our approach on a dataset of atypicality in visual advertisements, as well as a second dataset capturing atypicality that has no persuasive intent.