MLIFeat: Multi-level information fusion based deep local features

Yuyang Zhang, Jinge Wang, Shibiao Xu, Xiao Liu, Xiaopeng Zhang; Proceedings of the Asian Conference on Computer Vision (ACCV), 2020

Abstract


Accurate image keypoints detection and description are of central importance in a wide range of applications. Although there are various studies proposed to address these challenging tasks, they are far from optimal. In this paper, we devise a model named MLIFeat with two novel light-weight modules for multi-level information fusion based deep local features learning, to cope with both the image keypoints detection and description. On the one hand, the image keypoints are robustly detected by our Feature Shuffle Module (FSM), which can efficiently utilize the multi-level convolutional feature maps with marginal computing cost. On the other hand, the corresponding feature descriptors are generated by our well-designed Feature Blend Module (FBM), which can collect and extract the most useful information from the multi-level convolutional feature vectors. To study in-depth about our MLIFeat and other state-of-the-art methods, we have conducted thorough experiments, including image matching on HPatches and FM-Bench, and visual localization on Aachen-Day-Night, which verifies the robustness and effectiveness of our proposed model. Code at:https://github.com/yyangzh/MLIFeat

Related Material


[pdf] [supp] [code]
[bibtex]
@InProceedings{Zhang_2020_ACCV, author = {Zhang, Yuyang and Wang, Jinge and Xu, Shibiao and Liu, Xiao and Zhang, Xiaopeng}, title = {MLIFeat: Multi-level information fusion based deep local features}, booktitle = {Proceedings of the Asian Conference on Computer Vision (ACCV)}, month = {November}, year = {2020} }