FX-MAD: Frequency-domain Explainability and Explainability-driven Unsupervised Detection of Face Morphing Attacks

Marco Huber, Pedro C. Neto, Ana F. Sequeira, Naser Damer; Proceedings of the Winter Conference on Applications of Computer Vision (WACV) Workshops, 2025, pp. 766-776

Face recognition (FR) systems are vulnerable to morphing attacks which refer to face images created by morphing the facial features of two different identities into one face image to create an image that can match both identities allowing serious security breaches. In this work we apply a frequency-based explanation method from the area of explainable face recognition to shine a light on how FR models behave when processing a bona fide or attack pair from a frequency perspective. In extensive experiments we used two different state-of-the-art FR models and six different morphing attacks to investigate possible differences in behavior. Our results show that FR models rely differently on different frequency bands when making decisions for bona fide pairs and morphing attacks. In the following step we show that this behavioral difference can be used to detect morphing attacks in an unsupervised setup solely based on the observed frequency-importance differences in a generalizable manner.