MatFuse: Controllable Material Generation with Diffusion Models


Material Editing Results



Diffuse color Editing

Condition Diffuse Normal Roughness Specular Render
(Masked)
Input Diffuse Map Normal Map Roughness Specular Render
↓
Edit 1 Palette Diffuse Map Normal Map Roughness Map Specular Map Render
Edit 2 Palette Diffuse Map Normal Map Roughness Map Specular Map Render


Input Diffuse Map Normal Map Roughness Map Specular Map Render
↓
Edit 1 Palette Diffuse Map Normal Map Roughness Map Specular Map Render
Edit 2 Palette Diffuse Map Normal Map Roughness Map Specular Map Render


Geometry (Normal Map) Editing

Condition Diffuse Normal Roughness Specular Render
(Masked)
Input Diffuse Map Normal Map Roughness Specular Render
↓
Edit Condition Diffuse Map Normal Map Roughness Map Specular Map Render


Input Diffuse Map Normal Map Roughness Map Specular Map Render
↓
Edit Diffuse Map Diffuse Map Normal Map Roughness Map Specular Map Render


Input Diffuse Map Normal Map Roughness Map Specular Map Render
↓
Edit Flat surface Diffuse Map Normal Map Roughness Map Specular Map Render


Input Diffuse Map Normal Map Roughness Map Specular Map Render
↓
Edit Bumpy, irregular surface Diffuse Map Normal Map Roughness Map Specular Map Render


Reflectivity (Roughness, Specular) Editing

Condition Diffuse Normal Roughness Specular Render
(Masked) (Masked)
Input Diffuse Map Normal Map Roughness Specular Render
↓ ↓
Edit Shiny surface Diffuse Map Normal Map Roughness Map Specular Map Render


Input Diffuse Map Normal Map Roughness Map Specular Map Render
↓ ↓
Edit Rough surface, opaque Diffuse Map Normal Map Roughness Map Specular Map Render


Input Diffuse Map Normal Map Roughness Map Specular Map Render
↓ ↓
Edit Rough surface, opaque Diffuse Map Normal Map Roughness Map Specular Map Render


Input Diffuse Map Normal Map Roughness Map Specular Map Render
↓ ↓
Edit Rough surface, low reflectance Diffuse Map Normal Map Roughness Map Specular Map Render


Map Inpainting

Diffuse Normal Roughness Specular Render
Input Diffuse Map Normal Map Roughness Specular Render
Edit Diffuse Map Normal Map Roughness Map Specular Map Render


Input Diffuse Map Normal Map Roughness Map Specular Map Render
Edit Diffuse Map Normal Map Roughness Map Specular Map Render


Input Diffuse Map Normal Map Roughness Map Specular Map Render
Edit Diffuse Map Normal Map Roughness Map Specular Map Render