On Isometry Robustness of Deep 3D Point Cloud Models Under Adversarial Attacks

Yue Zhao, Yuwei Wu, Caihua Chen, Andrew Lim; The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp. 1201-1210

Abstract


While deep learning in 3D domain has achieved revolutionary performance in many tasks, the robustness of these models has not been sufficiently studied or explored. Regarding the 3D adversarial samples, most existing works focus on manipulation of local points, which may fail to invoke the global geometry properties, like robustness under linear projection that preserves the Euclidean distance, i.e., isometry. In this work, we show that existing state-of-the-art deep 3D models are extremely vulnerable to isometry transformations. Armed with the Thompson Sampling, we develop a black-box attack with success rate over 95% on ModelNet40 data set. Incorporating with the Restricted Isometry Property, we propose a novel framework of white-box attack on top of spectral norm based perturbation. In contrast to previous works, our adversarial samples are experimentally shown to be strongly transferable. Evaluated on a sequence of prevailing 3D models, our white-box attack achieves success rates from 98.88% to 100%. It maintains a successful attack rate over 95% even within an imperceptible rotation range [+-2.81*].

Related Material


[pdf] [supp]
[bibtex]
@InProceedings{Zhao_2020_CVPR,
author = {Zhao, Yue and Wu, Yuwei and Chen, Caihua and Lim, Andrew},
title = {On Isometry Robustness of Deep 3D Point Cloud Models Under Adversarial Attacks},
booktitle = {The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2020}
}