Do Not Think About Pink Elephant!

Kyomin Hwang, Suyoung Kim, Junhoo Lee, Nojun Kwak; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2024, pp. 8296-8303

Abstract

Large Models (LMs) have heightened expectations for the potential of general AI as they are akin to human intelligence. This paper shows that recent large models such as Stable Diffusion and DALL-E3 also share the vulnerability of human intelligence namely the "white bear phenomenon". We investigate the causes of the white bear phenomenon by analyzing their representation space. Based on this analysis we propose a simple prompt-based attack method which generates figures prohibited by the LM provider's policy. To counter these attacks we introduce prompt-based defense strategies inspired by cognitive therapy techniques successfully mitigating attacks by up to 48.22%.

Related Material

[pdf]
[bibtex]
@InProceedings{Hwang_2024_CVPR, author = {Hwang, Kyomin and Kim, Suyoung and Lee, Junhoo and Kwak, Nojun}, title = {Do Not Think About Pink Elephant!}, booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops}, month = {June}, year = {2024}, pages = {8296-8303} }