Animating Chinese Paintings through Stroke-Based Decomposition

Songhua Xu, Yingqing Xu, Sing Bing Kang, David Salesin, Yunhe Pan, and Heung-Yeung Shum

This work proposes a technique to animate a "Chinese style" painting given its image. We first extract descriptions of the brush strokes that hypothetically produced it. The key to the extraction process is the use of a brush stroke library, which is obtained by digitizing single brush strokes drawn by an experienced artist. The steps in our extraction technique are first to segment the input image, then to find the best set of brush strokes that fit the regions, and finally to refine these strokes to account for local appearance. We model a single brush stroke using its skeleton and contour, and we characterize texture variation within each stroke by sampling perpendicularly along its skeleton. Once these brush descriptions have been obtained, the painting can be animated at the brush stroke level. In this paper, we focus on Chinese paintings with relatively sparse strokes. The animation is produced using a graphical application we developed. We present several animations of real paintings using our technique.

Keywords: Animating paintings, non-photorealistic rendering, segmentation

Publications:

·         S. Xu, Y. Xu, S.B. Kang, D.H. Salesin, Y. Pan, and H.-Y. Shum. Animating Chinese paintings through stroke-based decomposition, Technical Report, MSR-TR-2006-33, Microsoft Research, 2006.

·         S. Xu, Y. Xu, S.B. Kang, D.H. Salesin, Y. Pan, and H.-Y. Shum. Animating Chinese paintings through stroke-based decomposition, ACM Transactions on Graphics, 25(2):239-267, April 2006. [Bitex]

Videos:

·         "Animating Paintings through Stroke-Based Decomposition"--A Video on the Algorithm: 5:09     [AVI 29M] [ZIP 21M]

·         "Making a Painting Come to Life"--A Video on the System:  2:33     [VOB (MPEG DVD) 160M] [ZIP 60M]

Notes: Copyright © 2006 by the Association for Computing Machinery, Inc. Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, to republish, to post on servers, or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from Publications Dept, ACM Inc., fax +1 (212) 869-0481, or permissions@acm.org.

Contact: songhua dot xu at yale dot edu 

 

基于笔划的绘画分解与动画技术

本文提出了一种面向静态绘画图像生成动画的新技术。为了生成一幅绘画作品的动画,首先需要提取构成该静态画面的笔划。笔划提取过程的关键技术是利用一个样本笔划库进行笔划分解。该样本库是对一位专业画家遴选的绘画常用典型笔划进行数字化而得到的。笔划提取过程的主要算法步骤包括:首先对输入的静态图像进行分割,然后通过找到最佳匹配分割图像区域的样本笔划来提取原画的初始笔划分解方案,之后优化初始笔划提取结果,最后对笔划所携带的纹理进行矢量化表达。在该方法中,一条笔划的形状通过其骨架和边缘轮廓来表示。对于笔划所携带的纹理,则通过沿其骨架进行周期性采样的方法进行参数化。一旦构成原画的笔划被计算提取出来,该绘画就可以在笔划级进行动画的编辑和生成。根据上述算法,开发了一个基于笔划的动画编辑、创作环境。本文的实验结果包括对几幅绘画作品笔划分解及动画生成的实例。这些实验结果证明了本文提出的“基于笔划的绘画分解与动画技术”的可行性与有效性。

 

Back to Songhua Xu's Homepage