Publication Type
Journal Article
Version
publishedVersion
Publication Date
4-2023
Abstract
Adding screentone to initial line drawings is a crucial step for manga generation, but is a tedious and human-laborious task. In this work, we propose a novel data-driven method aiming to transfer the screentone pattern from a reference manga image. This not only ensures the quality, but also adds controllability to the generated manga results. The reference-based screentone translation task imposes several unique challenges. Since manga image often contains multiple screentone patterns interweaved with line drawing, as an abstract art, this makes it even more difficult to extract disentangled style code from the reference. Also, finding correspondence for mapping between the reference and the input line drawing without any screentone is hard. As screentone contains many subtle details, how to guarantee the style consistency to the reference remains challenging. To suit our purpose and resolve the above difficulties, we propose a novel Reference-based Screentone Transfer Network (RSTN). We encode the screentone style through a 1D stylegram. A patch correspondence loss is designed to build a similarity mapping function for guiding the translation. To mitigate the generated artefacts, a pattern regularization loss is introduced in the patch-level. Through extensive experiments and a user study, we have demonstrated the effectiveness of our proposed model.
Keywords
manga, screentone, Reference-based, patch correspondence, pattern regularization
Discipline
Computational Engineering
Research Areas
Data Science and Engineering
Publication
Computer Graphics Forum
Volume
42
Issue
6
ISSN
0167-7055
Identifier
10.1111/cgf.14800
Publisher
Wiley
Citation
LI, Zhansheng; ZHAO, Nanxuan; WU, Zongwei; DAI, Yihua; WANG, Junle; JING, Yanqing; and HE, Shengfeng.
Reference-based screentone transfer via pattern correspondence and regularization. (2023). Computer Graphics Forum. 42, (6),.
Available at: https://ink.library.smu.edu.sg/sis_research/8370
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.
Additional URL
https://doi.org/10.1111/cgf.14800