CRAFT: Designing Creative and Functional 3D Objects

Michelle Guo, Mia Tang, Hannah Cha, Ruohan Zhang, C. Karen Liu, Jiajun Wu; Proceedings of the Winter Conference on Applications of Computer Vision (WACV), 2025, pp. 7215-7224

For designing a wide range of everyday objects the design process should be aware of both the human body and the underlying semantics of the design specification. However these two objectives present significant challenges to the current AI-based designing tools. In this work we present a method to synthesize body-aware 3D objects from a base mesh given an input body geometry and either text or image as guidance. The generated objects can be simulated on virtual characters or fabricated for real-world use. We propose to use a mesh deformation procedure that optimizes for both semantic alignment as well as contact and penetration losses. Using our method users can generate both virtual or real-world objects from text image or sketch without the need for manual artist intervention. We present both qualitative and quantitative results on various object categories demonstrating the effectiveness of our approach.