CoroNetGAN: Controlled Pruning of GANs via Hypernetworks

Aman Kumar, Khushboo Anand, Shubham Mandloi, Ashutosh Mishra, Avinash Thakur, Neeraj Kasera, Prathosh A P; Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) Workshops, 2023, pp. 1262-1271

Abstract


Generative Adversarial Networks (GANs) have proven to exhibit remarkable performance and are widely used across many generative computer vision applications. However, the unprecedented demand for the deployment of GANs on resource-constrained edge devices still poses a challenge due to huge number of parameters involved in the generation process. This has led to focused attention on the area of compressing GANs. Most of the existing works use knowledge distillation with the overhead of teacher dependency. Moreover, there is no ability to control the degree of compression in these methods. Hence, we propose CoroNet-GAN for compressing GAN using the combined strength of differentiable pruning method via hypernetworks. The pro-posed method provides the advantage of performing controllable compression while training along with reducing training time by a substantial factor. Experiments have been done on various conditional GAN architectures (Pix2Pix and CycleGAN) to signify the effectiveness of our approach on multiple benchmark datasets such as Edges ? Shoes, Horse ? Zebra and Summer ? Winter. The results obtained illustrate that our approach succeeds to outperform the baselines on Zebra ? Horse and Summer ? Winter achieving the best FID score of 32.3 and 72.3 respectively, yielding high-fidelity images across all the datasets. Additionally, our approach also outperforms the state-of-the-art methods in achieving better inference time on various smart-phone chipsets and data-types making it a feasible solution for deployment on edge devices.

Related Material


[pdf]
[bibtex]
@InProceedings{Kumar_2023_ICCV, author = {Kumar, Aman and Anand, Khushboo and Mandloi, Shubham and Mishra, Ashutosh and Thakur, Avinash and Kasera, Neeraj and A P, Prathosh}, title = {CoroNetGAN: Controlled Pruning of GANs via Hypernetworks}, booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) Workshops}, month = {October}, year = {2023}, pages = {1262-1271} }