A Late Fusion CNN for Digital Matting

Yunke Zhang, Lixue Gong, Lubin Fan, Peiran Ren, Qixing Huang, Hujun Bao, Weiwei Xu; The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019, pp. 7469-7478


This paper studies the structure of a deep convolutional neural network to predict the foreground alpha matte by taking a single RGB image as input. Our network is fully convolutional with two decoder branches for the foreground and background classification respectively. Then a fusion branch is used to integrate the two classification results which gives rise to alpha values as the soft segmentation result. This design provides more degrees of freedom than a single decoder branch for the network to obtain better alpha values during training. The network can implicitly produce trimaps without user interaction, which is easy to use for novices without expertise in digital matting. Experimental results demonstrate that our network can achieve high-quality alpha mattes for various types of objects and outperform the state-of-the-art CNN-based image matting methods on the human image matting task.

Related Material

[pdf] [supp]
author = {Zhang, Yunke and Gong, Lixue and Fan, Lubin and Ren, Peiran and Huang, Qixing and Bao, Hujun and Xu, Weiwei},
title = {A Late Fusion CNN for Digital Matting},
booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2019}