TSRFormer: Transformer Based Two-Stage Refinement for Single Image Shadow Removal

Hua-En Chang, Chia-Hsuan Hsieh, Hao-Hsiang Yang, I-Hsiang Chen, Yi-Chung Chen, Yuan-Chun Chiang, Zhi-Kai Huang, Wei-Ting Chen, Sy-Yen Kuo; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2023, pp. 1436-1446

Abstract

Single-image shadow removal aims to remove undesired shadow information from captured images. With the development of the deep convolutional neural networks, several methods have been proposed to achieve promising performance in shadow removal. However, they still struggle with limited performance due to the non-homogeneous intensity distribution of the shadow. To address this issue, we propose a two-stage shadow removal architecture based on the transformer called TSRFormer. The proposed architecture is divided into shadow removal and content refinement networks. These two stages adopt different transformer architectures and remove the shadow based on different information to achieve effective shadow removal. Experiments performed on challenging benchmark show that the proposed model achieves the 2 nd highest SSIM in the NTIRE 2023 Image Shadow Removal Challenge. The source code will be public after the acceptance of this paper.

Related Material

[pdf]
[bibtex]
@InProceedings{Chang_2023_CVPR, author = {Chang, Hua-En and Hsieh, Chia-Hsuan and Yang, Hao-Hsiang and Chen, I-Hsiang and Chen, Yi-Chung and Chiang, Yuan-Chun and Huang, Zhi-Kai and Chen, Wei-Ting and Kuo, Sy-Yen}, title = {TSRFormer: Transformer Based Two-Stage Refinement for Single Image Shadow Removal}, booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops}, month = {June}, year = {2023}, pages = {1436-1446} }