logo

SCIENTIA SINICA Informationis, Volume 49, Issue 2: 216-228(2019) https://doi.org/10.1360/N112018-00198

Generation of Thangka relief from line drawings

More info
  • ReceivedJul 29, 2018
  • AcceptedOct 18, 2018
  • PublishedFeb 15, 2019

Abstract

Line drawings lack the three-dimensional (3D) information of the depicted objects, which is present in 3D models and photographs based on relief-generation techniques. Therefore, creating relief surfaces from line drawings presents special research challenges. This paper creates a 3D relief model of Thangka, the Intangible Cultural Heritage of China and UNESCO, from line drawings. To obtain the relief surfaces, our approach solves Poisson equations under the constraints of gray-scale control pictures and boundary seeds of the object regions. The Thangka relief is divided into low-frequency, mid-frequency and high-frequency components. The low- and mid-frequency components respectively correspond to the height of the human body and the limbs in the relief model, and are obtained by solving the Poisson equations constrained by distance transformations. The high-frequency components correspond to the heights of local details such as eyebrows, flowers, clouds, and mountains in the relief model, and are obtained by solving the Poisson equations with boundary constraints. Finally we add the height maps of the three components and transform the resultant height map into a mesh model of the relief. The effectiveness of our approach is demonstrated in several examples.


Funded by

国家自然科学基金(61772463)


References

[1] Kerber J, Wang M, Chang J. Computer Assisted Relief Generation-A Survey. Comput Graphics Forum, 2012, 31: 2363-2377 CrossRef Google Scholar

[2] Cignoni P, Montani C, Scopigno R. Computer-Assisted Generation of Bas-and High-Reliefs. J Graphics Tools, 1997, 2: 15-28 CrossRef Google Scholar

[3] Fattal R, Lischinski D and Werman M. Gradient domain high dynamic range compression. ACM Transactions on Graphics, 2002, 21: 249-256, doi: 10.1145/566570.566573. Google Scholar

[4] Weyrich T, Deng J, Barnes C, et al. Digital bas-relief from 3D scenes. In: Proceedings of ACM SIGGRAPH, San Diego, 2007. Google Scholar

[5] Xianfang Sun , Rosin P L, Martin R R. Bas-relief generation using adaptive histogram equalization.. IEEE Trans Visual Comput Graphics, 2009, 15: 642-653 CrossRef PubMed Google Scholar

[6] Zhao P, Bian Z. The bas-relief on curved surface from 3D meshes. J Comput-Aid Des Comput Graph, 2010, 22: 1126--1131. Google Scholar

[7] He H Z, Yang X N. Relief generation on surfaces. J Comput-Aid Des Comput Graph, 2010, 22: 1132--1137. Google Scholar

[8] Zhou S Z, Liu L G. Realtime digital bas-relief modeling. J Comput-Aid Des Comput Graph, 2010, 22: 434--439. Google Scholar

[9] Zhang L S, Tong J. Real-time interaction based modeling method for 3D objects with relief-texture. J Comput Appl, 2017, 37: 2302--2306. Google Scholar

[10] Song W, Belyaev A, Seidel H P. Automatic generation of bas reliefs from 3D shapes. In: Proceedings of IEEE International Conference on Shape Modeling and Applications, Washington, 2007. 211--214. Google Scholar

[11] Kerber J. Digital art of bas-relief sculpting. Dissertation for Master Degree. Saarbrücken: Univeristy of Saarland, 2007. Google Scholar

[12] Kerber J, Tevs A, Belyaev A, et al. Feature sensitive bas relief generation. In: Proceedings of IEEE International Conference on Shape Modeling and Applications, Beijing, 2009. 148--154. Google Scholar

[13] Bian Z, Hu S M. Preserving detailed features in digital bas-relief making. Comput Aided Geometric Des, 2011, 28: 245-256 CrossRef Google Scholar

[14] Wang M, Kerber J, Chang J, et al. Relief stylization from 3D models using featured lines. In: Proceedings of the 27th Spring Conference on Computer Graphics, Viničné, 2011. 63--68. Google Scholar

[15] Miao Y W, Chen M Y, Fang X D, et al. 3D model sculpturing technique bades on drawing lines. J Comput-Aid Des Comput Graph, 2016, 28: 50--56. Google Scholar

[16] Zhang Y W, Zhang C, Wang W. Adaptive Bas-relief Generation from 3D Object under Illumination. Comput Graphics Forum, 2016, 35: 311-321 CrossRef Google Scholar

[17] Li B, Liu S L, Zhang L Y. Bas-relief generation using manifold harmonics analysis. J Comput-Aid Des Comput Graph, 2012, 24: 252--261. Google Scholar

[18] Hu J Q, He S, Lyu L. Placement optimization for generating bas-reliefs based on visual saliency. J Comput-Aid Des Comput Graph, 2016, 28: 2128--2133. Google Scholar

[19] Wu M J, Wang S W, Shi L, et al. Effective representation and 3D printing for bas-relief. J Comput-Aid Des Comput Graph, 2017, 29: 1816--1823. Google Scholar

[20] Alexa M, Matusik W. Reliefs as images. ACM Trans Graph, 2010, 29: 1 CrossRef Google Scholar

[21] Zhuwen Li , Song Wang , Jinhui Yu . Restoration of brick and stone relief from single rubbing images.. IEEE Trans Visual Comput Graphics, 2012, 18: 177-187 CrossRef PubMed Google Scholar

[22] Meng Y, Zhou M Q, Shui W Y, et al. Three-dimensional relief generation on freedom surface based on monocular image. J Syst Simul, 2015, 27: 3012--3017. Google Scholar

[23] Wu T P, Tang C, Brown M S, et al. ShapePalettes: interactive normal transfer via sketching. In: Proceedings of ACM SIGGRAPH, San Diego, 2007. Google Scholar

[24] Sykora D, Kavan L, ?adík M. Ink-and-ray. ACM Trans Graph, 2014, 33: 1-15 CrossRef Google Scholar

[25] Zeng Q, Martin R R, Wang L. Region-based bas-relief generation from a single image. Graphical Model, 2014, 76: 140-151 CrossRef Google Scholar

[26] Wu W M, Liu L G. Course-to-fine bas-relief generation algorithm from images. Coll Math, 2016, 32: 1--7. Google Scholar

[27] Yeh C K, Huang S Y, Jayaraman P K. Interactive High-Relief Reconstruction for Organic and Double-Sided Objects from a Photo.. IEEE Trans Visual Comput Graphics, 2017, 23: 1796-1808 CrossRef PubMed Google Scholar

[28] Ji Z, Ma W, Sun X. Bas-Relief Modeling from Normal Images with Intuitive Styles.. IEEE Trans Visual Comput Graphics, 2014, 20: 675-685 CrossRef PubMed Google Scholar

[29] Liu Y J, Ji Z P, Liu Z, et al. Stylized design of bas-relief based on normal field. J Comput-Aid Des Comput Graph, 2016, 28: 2120--2127. Google Scholar

[30] Wu J, Martin R R, Rosin P L. Making bas-reliefs from photographs of human faces. Comput-Aided Des, 2013, 45: 671-682 CrossRef Google Scholar

[31] Lu Q, Wang L, Meng X X, et al. The bas-relief generation method of human faces from 3D depth images and 2d intensity images. J Comput-Aid Des Comput Graph, 2015, 27: 1172--1181. Google Scholar

[32] Zhang T, Zhang L L, Yu J H. Computer generation of 3D inscriptions from 2D images of chinese calligraphy. Chinese J Comput, 2014, 37: 2380--2388. Google Scholar

[33] Zhang Y W, Chen Y, Liu H. Modeling Chinese calligraphy reliefs from one image. Comput Graphics, 2018, 70: 300-306 CrossRef Google Scholar

[34] Ding X Q, Hu T C, Peng R, et al. Computer-aided rendering of chinese meticulous figure paintings. J Comput-Aid Des Comput Graph, 2015, 27: 1189--1195. Google Scholar

  • Figure 1

    System overview

  • Figure 2

    (Color online) Shadakshari Avalokiteshvara. (a) Line drawing; (b) color labeling

  • Figure 3

    (Color online) Low frequency component processing of the relief model. (a) Human figure region in Thangka; (b) distance transform of human figure region; (c) low frequency component of the relief model

  • Figure 4

    (Color online) Limb regions processing. (a) Drawing arm and leg shapes; (b) arm and leg masks; (c) arm and leg control pictures; (d) result of Poisson diffusion

  • Figure 5

    (Color online) Improved limb regions processing. (a) Body figure mask; (b) distance transform of limbs; (c) result of Poisson diffusion

  • Figure 6

    (Color online) Fingers and toes enhanced processing. (a) Positions to be enhanced; (b) result of Poisson diffusion; (c) enhanced relief

  • Figure 7

    Gray-scale control pictures of local face regions and generated relief. (a) Eyelid; (b) nose; (c) ala nasi; (d) left and right sides of bridge; (e) left and right sides of philtrum; (f) philtrum; (g) upper lip; (h) relief generated

  • Figure 8

    (Color online) Adding black and white seeds in cloth regions. (a) Mask of region of interest; (b) drawing lines interactively; (c) adding black and white seeds; (d) relief generated

  • Figure 9

    (Color online) Jewel ornaments processing. (a) Jewel ornaments mask; (b) gray scale control picture; (c) relief generated

  • Figure 10

    Shadakshari Avalokiteshvara. (a) and (b) Two views of generated relief

  • Figure 11

    Sakyamuni Buddha. (a) Line drawing; (b) relief generated

  • Figure 12

    Green Tara. (a) Line drawing; (b) relief generated

  • Figure 13

    Greek goddess Athena. (a) Line drawing; (b) relief generated

  • Table 1   Computational time and interaction time spent on different regions
    Region size (pixel) Solving Poisson Interactive operations Interaction
    equations (s) time (min)
    Body region 1030$\times$1194 48.8 Delete lines inside body region $<5$
    Limbs 1030$\times$1194 42.73 Add lines of arms and legs $<10$
    as well as control picture
    Face 241$\times$276 16.05 Select eyes and mouth interactively $<1$
    Left side 502$\times$1135 1.78 Assign white and $<1$
    background light black seeds interactively
    Light around head 762$\times$723 2.33 Assign white and black $<1$
    seeds interactively
    Hair and 694$\times$819 2.42 Select hair and $<3$
    jewel ornaments jewel ornaments
    Clouds, mountains 2008$\times$2799 46.12 Add boundary $<3$
    and water waves constraints interactively

Copyright 2019 Science China Press Co., Ltd. 《中国科学》杂志社有限责任公司 版权所有

京ICP备18024590号-1