MatFuse: Controllable Material Generation with Diffusion Models


Material Editing Results



Diffuse color Editing

Condition Diffuse Normal Roughness Specular Render
(Masked)
Input Diffuse Map Normal Map Roughness Specular Render
Edit 1 Palette Diffuse Map Normal Map Roughness Map Specular Map Render
Edit 2 Palette Diffuse Map Normal Map Roughness Map Specular Map Render


Input Diffuse Map Normal Map Roughness Map Specular Map Render
Edit 1 Palette Diffuse Map Normal Map Roughness Map Specular Map Render
Edit 2 Palette Diffuse Map Normal Map Roughness Map Specular Map Render


Geometry (Normal Map) Editing

Condition Diffuse Normal Roughness Specular Render
(Masked)
Input Diffuse Map Normal Map Roughness Specular Render
Edit Condition Diffuse Map Normal Map Roughness Map Specular Map Render


Input Diffuse Map Normal Map Roughness Map Specular Map Render
Edit Diffuse Map Diffuse Map Normal Map Roughness Map Specular Map Render


Input Diffuse Map Normal Map Roughness Map Specular Map Render
Edit Flat surface Diffuse Map Normal Map Roughness Map Specular Map Render


Input Diffuse Map Normal Map Roughness Map Specular Map Render
Edit Bumpy, irregular surface Diffuse Map Normal Map Roughness Map Specular Map Render


Reflectivity (Roughness, Specular) Editing

Condition Diffuse Normal Roughness Specular Render
(Masked) (Masked)
Input Diffuse Map Normal Map Roughness Specular Render
Edit Shiny surface Diffuse Map Normal Map Roughness Map Specular Map Render


Input Diffuse Map Normal Map Roughness Map Specular Map Render
Edit Rough surface, opaque Diffuse Map Normal Map Roughness Map Specular Map Render


Input Diffuse Map Normal Map Roughness Map Specular Map Render
Edit Rough surface, opaque Diffuse Map Normal Map Roughness Map Specular Map Render


Input Diffuse Map Normal Map Roughness Map Specular Map Render
Edit Rough surface, low reflectance Diffuse Map Normal Map Roughness Map Specular Map Render


Map Inpainting

Diffuse Normal Roughness Specular Render
Input Diffuse Map Normal Map Roughness Specular Render
Edit Diffuse Map Normal Map Roughness Map Specular Map Render


Input Diffuse Map Normal Map Roughness Map Specular Map Render
Edit Diffuse Map Normal Map Roughness Map Specular Map Render


Input Diffuse Map Normal Map Roughness Map Specular Map Render
Edit Diffuse Map Normal Map Roughness Map Specular Map Render