SketchDeco: Decorating B W Sketches with Colour
CoRR(2024)
摘要
This paper introduces a novel approach to sketch colourisation, inspired by
the universal childhood activity of colouring and its professional applications
in design and story-boarding. Striking a balance between precision and
convenience, our method utilises region masks and colour palettes to allow
intuitive user control, steering clear of the meticulousness of manual colour
assignments or the limitations of textual prompts. By strategically combining
ControlNet and staged generation, incorporating Stable Diffusion v1.5, and
leveraging BLIP-2 text prompts, our methodology facilitates faithful image
generation and user-directed colourisation. Addressing challenges of local and
global consistency, we employ inventive solutions such as an inversion scheme,
guided sampling, and a self-attention mechanism with a scaling factor. The
resulting tool is not only fast and training-free but also compatible with
consumer-grade Nvidia RTX 4090 Super GPUs, making it a valuable asset for both
creative professionals and enthusiasts in various fields. Project Page:
更多查看译文
AI 理解论文
溯源树
样例
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要