Selective Multi-View Deep Model for 3D Object Classification

Mona Alzahrani, Muhammad Usman, Saeed Anwar, Tarek Helmy; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2024, pp. 728-736

3D object classification has emerged as a practical technology with applications in various domains such as medical image analysis automated driving intelligent robots and crowd surveillance. Among the different approaches multi-view representations for 3D object classification have shown the most promising results achieving state-of-the-art performance. However there are certain limitations in current view-based 3D object classification methods. One observation is that using all captured views for classification can confuse the classifier and lead to misleading results for certain classes. Additionally some views may contain more discriminative information for object classification than others. These observations motivate the development of smarter and more efficient selective multi-view classification models. In this work we propose a Selective Multi-View Deep Model that extracts multi-view images from 3D data representations and selects the most influential view by assigning importance scores using the cosine similarity method based on visual features detected by a pre-trained CNN. The proposed method is evaluated on the ModelNet40 dataset for the task of 3D classification. The results demonstrate that the proposed model achieves an overall accuracy of 88.13% using only a single view when employing a shading technique for rendering the views pre-trained ResNet-152 as the backbone CNN for feature extraction and a Fully Connected Network (FCN) as the classifier.