Towards Robust Fine-grained Recognition by Maximal Separation of Discriminative Features

Krishna Kanth Nakka, Mathieu Salzmann; Proceedings of the Asian Conference on Computer Vision (ACCV), 2020

Adversarial attacks have been widely studied for general classification tasks, but remain unexplored in the context of fine-grained recognition, where the inter-class similarities facilitate the attacker's task.In this paper, we identify the proximity of the latent representations of local regions of different classes in fine-grained recognition networks as a key factor to the success of adversarial attacks. We, therefore, introduce an attention-based regularization mechanism that maximally separates the latent features of discriminative regions of different classes while minimizing the contribution of the non-discriminative regions to the final class prediction. As evidenced by our experiments, this allows us to significantly improve robustness to adversarial attacks, to the point of matching or even surpassing that of adversarial training, but without requiring access to adversarial samples. Further, our formulation also improves the detection AUROC score of adversarial samples over baselines on adversarially trained models.