logo

SCIENTIA SINICA Informationis, Volume 49, Issue 2: 143-158(2019) https://doi.org/10.1360/N112018-00202

A survey of digital calligraphy

More info
  • ReceivedNov 21, 2018
  • AcceptedJan 9, 2019
  • PublishedFeb 18, 2019

Abstract

Unlike its traditional counterpart, digital Chinese calligraphy is created and presented using digital technology in human-computer interaction environments. Here, we provide a state of the art introduction to digital calligraphy research. After analyzing the research background and goal of digital calligraphy, we present the most important topics of digital calligraphy: calligraphic tool modeling, calligraphic image analyzing and processing, and calligraphic shape analysis and synthesis. Each research topic is accompanied by a state-of-the-art introduction and current trends of the topic. Finally, we discuss important issues concerning the further development of digital calligraphy.


Funded by

国家自然科学基金(61772440)

航空科学基金(20165168007)


References

[1] Qiu Z Z. Calligraphic Skills. Shanghai: Shanghai Publishing House for Calligraphy and Painting, 2003. Google Scholar

[2] Lin Y T. My Country and My People. Xi'an: Shanxi Normal University Publishing House, 2006. Google Scholar

[3] Shen Y M. The Interpretation of Experience From Famous Calligraphers in the History. Shanghai: Shanghai Education Publishing House, 1963. Google Scholar

[4] Mao G H, Zhang J S, He X H. A survey of virtual hairy brush. J Syst Simul, 2006, 18: 669--674. Google Scholar

[5] Wang Y G, Pang Y J. CCC--Chinese Calligraphy System of Computer. Inform Control, 1986, 2: 40--45. Google Scholar

[6] Strassmann S. Hairy brushes. In: Proceedings of Conference on Computer Graphics and Interactive Techniques, New York, 1986. 225--232. Google Scholar

[7] Ma Z, Su J. Aesthetics Evaluation for Robotic Chinese Calligraphy. IEEE Trans Cogn Dev Syst, 2017, 9: 80-90 CrossRef Google Scholar

[8] Li R, Qin R, Zhang J. The esthetic preference of Chinese typefaces--an event-related potential study.. Brain Res, 2015, 1598: 57-65 CrossRef PubMed Google Scholar

[9] Yu J H, Zhang J D. A physically-based brush-pen model. J Comput-aided Design Comput Graph, 1996, 8: 241--245. Google Scholar

[10] Xu S, Tang M, Lau F. A Solid Model Based Virtual Hairy Brush. Comput Graphics Forum, 2002, 21: 299-308 CrossRef Google Scholar

[11] Mi X, Xu J, Tang M, et al. The droplet virtual brush for Chinese calligraphic character modeling. In: Proceedings of Applications of Computer Vision, Orlando, 2002. 330--334. Google Scholar

[12] Zhang H J, Wang X J, Sun J Z, et al. Fractal-based simulation of the diffusion effect of Chinese ink wash drawing. J Comput-aided Design Comput Graph, 2004, 16: 555--558. Google Scholar

[13] Tang D, Zang C. A new simulation method for Chinese ink wash drawing by GA. J Image Graph, 2009, 14: 537--542. Google Scholar

[14] Zhang J S, Yu J H, Mao G H, et al. Generating brush texture for cursive style calligraphy with autoregressive and stratified sampling. J Comput-aided Design Comput Graph, 2007, 19: 1399--1403. Google Scholar

[15] Guo Q, Kunii T. Modeling the diffuse paintings of `Sumie'. In: Proceedings of IFIP Series on Computer Graphics, Tokyo, 1991. 329--330. Google Scholar

[16] Wong H T F, Ip H H S. Virtual brush: a model-based synthesis of Chinese calligraphy. Comput Graphics, 2000, 24: 99-113 CrossRef Google Scholar

[17] Mi X F, Tang M, Lin J Z, et al. Experience based virtual brush modeling. Comput Res Develop, 2003, 40: 1244--1251. Google Scholar

[18] Girshick R. Simulating Chinese brush painting: the parametric hairy brush. In: Proceedings of ACM SIGGRAPH, Gonzalez, 2004. 22. Google Scholar

[19] Lu J, Barnes C, DiVerdi S, et al. RealBrush: painting with examples of physical media. ACM Trans Graph, 2013, 32: 1--12. Google Scholar

[20] Lee J. Simulating Oriental Black-Ink Painting. IEEE Comput Graph Appl, 1999, 19: 74--81. Google Scholar

[21] Saito S, Nakajima M. 3D physics-based brush model for painting. In: Proceedings of SIGGRAPH, 1999. 226. Google Scholar

[22] Baxter B, Scheib V, Lin M, et al. DAB: interactive haptic painting with 3D virtual brushes. In: Proceedings of Acm Siggraph, 2001. 104: 10. Google Scholar

[23] Yeh J, Lien T, Ouhyoung M. On the effects of haptic display in brush and ink simulation for Chinese painting and calligraphy. In: Proceedings of Pacific Conference on Computer Graphics and Applications, 2003. 439--441. Google Scholar

[24] Chu N S H, Chiew-Lan Tai N S H. Real-Time Painting with an Expressive Virtual Chinese Brush. IEEE Comput Grap Appl, 2004, 24: 76-85 CrossRef Google Scholar

[25] Chu S, Tai C. MoXi: real-time ink dispersion in absorbent paper. In: Proceedings of ACM SIGGRAPH, 2005. 504--511. Google Scholar

[26] Chen H Q, Luo J F, Wen G H, et al. Simulation of Chinese calligraphy based on physical properties of pen, paper and ink. J Comput-aided Design Comput Graph, 2012, 24: 1134--1138. Google Scholar

[27] Zhen S Z, Hou Z X, Guo C, et al. Simulation of half-dry stroke based on force feedback technology. J Comput-aided Design Comput Graph, 2016, 28: 1016--1024. Google Scholar

[28] Leung H, Wong S, Ip H. In the name of art. IEEE Signal Process Mag, 2008, 25: 49-54 CrossRef ADS Google Scholar

[29] Wang S, Lee H. Dual-binarization and anisotropic diffusion of Chinese characters in calligraphy documents. In: Proceedings of International Conference on Document Analysis and Recognition, 2001. 271--275. Google Scholar

[30] Zhang J, Yu J, Mao G. Denoising of Chinese calligraphy tablet images based on run-length statistics and structure characteristic of character strokes. J Zhejiang Univ - Sci A, 2006, 7: 1178-1186 CrossRef Google Scholar

[31] Shi Z, Xu B, Zheng X. An integrated method for ancient Chinese tablet images de-noising based on assemble of multiple image smoothing filters. Multimed Tools Appl, 2016, 75: 12245-12261 CrossRef Google Scholar

[32] Huang Z K, Li Z H, Huang H. Comparison of different image denoising algorithms for Chinese calligraphy images. Neurocomputing, 2016, 188: 102-112 CrossRef Google Scholar

[33] Zhuang Y, Zhang X, Wu J, et al. Retrieval of Chinese Calligraphic Character Image, In: Proceedings of Pacific Rim Conference on Multimedia, Tokyo, 2004. 17--24. Google Scholar

[34] Lu W, Wu J, Wei B. Efficient shape matching for Chinese calligraphic character retrieval. J Zhejiang Univ - Sci C, 2011, 12: 873-884 CrossRef Google Scholar

[35] Zhang X, Zhuang Y. Dynamic Time Warping for Chinese calligraphic character matching and recognizing. Pattern Recognition Lett, 2012, 33: 2262-2269 CrossRef Google Scholar

[36] Pengcheng G, Jiangqin W, Yuan L. Fast Chinese calligraphic character recognition with large-scale data. Multimed Tools Appl, 2015, 74: 7221-7238 CrossRef Google Scholar

[37] Zhang J, Yu J, Lin H. Capturing Character Contours from Images of Ancient Chinese Calligraphy. In: Proceedings of the Workshop on Digital Media & ITS Application in Museum & Heritage/digital Media & ITS Application in Museum & Heritage, Suzhou, 2007. 36--41. Google Scholar

[38] Yu J, Peng Q. Realistic synthesis of cao shu of Chinese calligraphy. Comput Graphics, 2005, 29: 145-153 CrossRef Google Scholar

[39] Lu W M, Wu J Q, Zhuang Y T. Computer aided calligraphy tablet design. J Comput-aided Design Comput Graph, 2008, 20: 469--475. Google Scholar

[40] Zhang T, Zhang L L, Yu J H, et al. Computer generation of 3D inscriptions from 2D images of Chinese calligraphy. Chin J Comput, 2014, 37: 2380--2388. Google Scholar

[41] Zhang X F, Liu J Y. Extracting Chinese calligraphy strokes using stroke crawler. J Comput-aided Design Comput Graph, 2016, 28: 301--309. Google Scholar

[42] Zhang J S, Zhang Y M, Zhou C L. Simulating the writing process from Chinese calligraphy image. J Comput-Aided Design Comput Graph, 2014, 26: 963--972. Google Scholar

[43] Pan X B, Brady M, Bowman A K. Enhancement and feature extraction for images of incised and ink texts. Image Vision Computing, 2004, 22: 443-451 CrossRef Google Scholar

[44] Molton N, Pan X, Brady M. Visual enhancement of incised text. Pattern Recognition, 2003, 36: 1031-1043 CrossRef Google Scholar

[45] Ma X H, Yang Y M, Huang W F, et al. Oracle typeface and database generation. Appl Linguist, 2004, (3): 105--111. Google Scholar

[46] Yang H, Lu J, Lee H. A Bezier curve-based approach to shape description for Chinese calligraphy characters. In: Proceedings of International Conference on Document Analysis and Recognition, 2001. 276. Google Scholar

[47] Wong S T S, Leung H, Ip H H S. Model-based analysis of Chinese calligraphy images. Comput Vision Image Understanding, 2008, 109: 69-85 CrossRef Google Scholar

[48] Cheng J, Tong R, Tang M, et al. An approach to extract the Chinese calligraphy's approximate skeleton. In: Proceedings of International Conference on Computer Supported Cooperative Work in Design, 2004. 2: 727--732. Google Scholar

[49] Yao F, Shao G, Yi J. Extracting the trajectory of writing brush in Chinese character calligraphy. Eng Appl Artificial Intelligence, 2004, 17: 631-644 CrossRef Google Scholar

[50] Songhua Xu , Hao Jiang , Tao Jin . IEEE Intell Syst, 2009, 24: 44-53 CrossRef Google Scholar

[51] Shi C, Xiao J, Xu C, et al. Automatic generation of Chinese character using features fusion from calligraphy and font. In: Proceedings of Engineering Reality of Virtual Reality, 2014. 90120N. Google Scholar

[52] Xu S, Jiang H, Jin T. Automatic Facsimile of Chinese Calligraphic Writings. Comput Graphics Forum, 2008, 27: 1879-1886 CrossRef Google Scholar

[53] Shi C, Xiao J, Jia W, et al. Automatic generation of Chinese character based on human vision and prior knowledge of calligraphy. In: Proceedings of Natural Language Processing and Chinese Computing, Beijing, 2012. 23--33. Google Scholar

[54] Lin J, Hong C, Chang R, et al. Complete font generation of Chinese characters in personal handwriting style. In: Proceedings of Computing and Communications Conference, 2016. 1--5. Google Scholar

[55] Pan W, Lian Z, Sun R, et al. FlexiFont:a flexible system to generate personal font libraries. In: Proceedings of ACM Symposium on Document Engineering, 2014. 17--20. Google Scholar

[56] Li H, Liu P, Xu S, et al. Calligraphy Beautification Method for Chinese Handwritings. In: Proceedings of the 4th International Conference on Digital Home, 2012. 122--127. Google Scholar

[57] Zitnick C L. Handwriting beautification using token means. ACM Trans Graph, 2013, 32: 1 CrossRef Google Scholar

[58] Yi T, Lian Z, Tang Y, et al. A Data-Driven Personalized Digital Ink for Chinese Characters. In: Proceedings of International Conference on Multimedia Modeling, 2014. 254--265. Google Scholar

[59] Hou S, Xu P. An algorithm of calligraphy beautification based on improved velocity and width model. In: Proceedings of International Conference on Computer Science, 2015. 124--127. Google Scholar

[60] Lukai C. A contour-based real time handwriting beautification method and applications. Dissertation for Ph.D. Degree. Guangzhou: South China University of Technology, 2014. Google Scholar

[61] Shi C, Xiao J, Xu C, et al. Nonlinear and non-gaussian bayesian based handwriting beautification. In: Proceedings of IS&T/SPIE Electronic Imaging, 2014. 902012. Google Scholar

[62] Shi C, Xiao J, Xu C, et al. Visual improvement for bad handwriting based on Monte-Carlo method. In: Proceedings of IS&T/SPIE Electronic Imaging, 2014. 902708. Google Scholar

[63] Chen J, Zhu F X. Novel Chinese calligraphy style generation based on curve analogy with FSVM. J Image Graph, 2010, 15: 340--345. Google Scholar

[64] Xu M, Dong J. Generating New Style of Chinese Stroke Based on Statistic Model. In: Proceedings of 1st International Symposium Advances in Artificial Intelligence and Applications (AAIA'06), Wisla, 2006. 215--222. Google Scholar

[65] Dong J, Xu M, Pan Y H. Statistic model-based simulation on calligraphy creation. Chin J Comput, 2008, 31: 1276--1282. Google Scholar

[66] Dong J, Xu M, Zhang X. The Creation Process of Chinese Calligraphy and Emulation of Imagery Thinking. IEEE Intell Syst, 2008, 23: 56-62 CrossRef Google Scholar

[67] Orbay G, Kara L B. Beautification of Design Sketches Using Trainable Stroke Clustering and Curve Fitting.. IEEE Trans Visual Comput Graphics, 2011, 17: 694-708 CrossRef PubMed Google Scholar

[68] Chang B, Zhang Q, Pan S, et al. Generating handwritten Chinese characters using CycleGAN. In: Proceedings of IEEE Winter Conference on Applications of Computer Vision (WACV), 2018. doi: 10.1109/WACV.2018.00028. Google Scholar

[69] Lyu P, Bai X, Yao C, et al. Auto-Encoder Guided GAN for Chinese Calligraphy Synthesis. In: Proceedings of the 14th IAPR International Conference on Document Analysis and Recognition (ICDAR), 2018. 1095--1100. Google Scholar

[70] Sun D, Ren T, Li C, et al. Learning to write stylized Chinese characters by reading a handful of examples. In: Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI), 2018. 920--927. Google Scholar

[71] Xu P, Wang L, Guan Z, et al. Evaluating brush movements for Chinese calligraphy: a computer vision based approach. In: Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI), 2018. 1050--1056. Google Scholar

[72] Jin L W, Zhong Z Y, Yang Z, et al. Applications of deep learning for handwritten Chinese character recognition: a review. Acta Autom Sin, 2016, 42: 1125--1141. Google Scholar

[73] Dai Q, Zhang J. Beautifying handwriting characters based on the optimization of strokes and structure. SSI, 2017, 47: 468-481 CrossRef Google Scholar

[74] Wang P J, Wang M. Research on the implementation form and interaction model of calligraphy in digital terminals. Art Sci Tech, 2013, 12: 414--415. Google Scholar

[75] Srihari S N, Yang X, Ball G R. Offline Chinese handwriting recognition: an assessment of current technology. Front Comput Sc China, 2007, 1: 137-155 CrossRef Google Scholar

[76] Bianco S, Ciocca G. User Preferences Modeling and Learning for Pleasing Photo Collage Generation. ACM Trans Multimedia Comput Commun Appl, 2015, 12: 1-23 CrossRef Google Scholar

[77] Denzler J, Rodner E, Simon M. Convolutional neural networks as a computational model for the underlying processes of aesthetics perception. In: Proceedings of ECCV 2016 Workshops, 2016. 871--887. Google Scholar

[78] Brachmann A, Redies C. Computational and Experimental Approaches to Visual Aesthetics.. Front Comput Neurosci, 2017, 11: 102 CrossRef PubMed Google Scholar

[79] Ding X J, Zhou C L. A neurological study on aesthetic process and its significance to aesthetics. Psychol Sci, 2006, 29: 1247--1249. Google Scholar

[80] Huang Z L, Zhang W D. Neuroaesthetics: exploring aesthetics and the brain. Adv Psychol Sci, 2012, 20: 672--681. Google Scholar

[81] Liao J, Yao Y, Yuan L. Visual attribute transfer through deep image analogy. ACM Trans Graph, 2017, 36: 1-15 CrossRef Google Scholar

Copyright 2020 Science China Press Co., Ltd. 《中国科学》杂志社有限责任公司 版权所有

京ICP备18024590号-1