CN102819856A - Method for generating coherent mouth shape cartoon according to Chinese dialogues - Google Patents
Method for generating coherent mouth shape cartoon according to Chinese dialogues Download PDFInfo
- Publication number
- CN102819856A CN102819856A CN2012102378909A CN201210237890A CN102819856A CN 102819856 A CN102819856 A CN 102819856A CN 2012102378909 A CN2012102378909 A CN 2012102378909A CN 201210237890 A CN201210237890 A CN 201210237890A CN 102819856 A CN102819856 A CN 102819856A
- Authority
- CN
- China
- Prior art keywords
- mouth
- chinese
- mouth type
- crucial
- animation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Document Processing Apparatus (AREA)
Abstract
The invention discloses a method for generating a coherent mouth shape cartoon according to Chinese dialogues, which belongs to the technical field of computer programme, and particularly relates to a cartoon design generating the coherent mouth shape cartoon according to the Chinese dialogues. The method provided by the invention comprises the steps of analyzing the Chinese dialogues, modeling key phoneme mouth shapes and generating the coherent mouth shape cartoon in Maya and is characterized in that analysis for the Chinese dialogues can generate a spelling sequence and key phonemes can be screened out. In the molding of the key phoneme mouth shapes, different key phonemes are designed to correspond to different mouth shape parameters, and molding data is stored in a data base. In the mean time, during the generation of the coherent mouth shape, the mouth shape parameters corresponding to the key phonemes in the data base are lead into the Maya to generate the coherent cartoon so as to structure a generating system frame which can rapidly and simply generate the mouth shape cartoon according to the Chinese dialogues. The method provided by the invention can generate coherent mouth shape cartoon based on any input Chinese sentence, so that tedious mouth shape manufacturing process is simplified, and expressions of cartoon characters are enriched.
Description
Technical field
The invention belongs to technical field of computer programs, especially relate to a kind of skill animation design that generates the mouth type animation that links up according to Chinese dialogue.
Background technology
Animation has far-reaching Cultural Significance, and it is propagating cultural knowledge information with the mode of " teaching through lively activities " in masses.Good animation works can be advocated humanistic spirit and praise the Nature, more can inherit and develop national culture.Therefore, in order to pass on this excellent cultural form, this paper will reach the effect of easy making mouth type synchronizing animation, thereby enrich the expression of Chinese animation through the research to Chinese pinyin and mouth type relation.
At present, American-European animation your writing is in noontide.2 D animation such as the Disney; With original; Characteristics vivid and that combine closely with commercial operation are generalized to the whole world and liked by masses, and the classical animation of " lion king " this begins to let animation circle recognize the effect that the mouth type brings synchronously.Such as three-dimensional animation " automobile general mobilization ", " Ice Age " is to push to the fluorescent screen with the form of film mostly, three-dimensional animation even directly applied in the making of demonstration film " A Fanda ".American-European animation lively, true to nature lets spectators enjoy endless aftertastes; The scene of science fiction formula in the animation under the support of technological means, lets spectators that sensation on the spot in person is arranged especially.
Japan's animation is the synthetic of Japanese animation and Japanese animation.Wherein, the status of absolute first is enjoyed in Japanese animation.And Japanese animation makes the multi-section works so dazzling not as the special efficacy of American-European only a few animated film because produce in batches too fast with factor such as huge market demand too.But, still have absolute position in the whole world with the factors such as innovation, entertaining and glamour of art, personage, the story of a play or opera, makings etc.
Compare with American-European, Japanese animation, the relative merits of Chinese animation are apparent in view.Wherein also is no lack of the slower cause of Chinese animation starting.Very good domestic animation prospect be not! At first, it all is the software with oneself that other countries make animation, and China still uses popular software; Secondly, the thought of Chinese animation circle is animation to be orientated as child's animation, so animation has lost the tagger of many other age brackets generally towards becoming younger." full of joy with ash too youth " can be described as the masterpiece of Chinese animation in recent years, and the unified distinguishing feature of Chinese animation is arranged: moulding is lovely, bright in luster etc.Along with science and technology and national development, the animation of China also begins to have moved towards technology path, has also begun to attempt the making of three-dimensional animation; Such as China's first large-scale 3D swordsman animation " the bright moon during Qin " in 2007, under the edifying of China's time culture of extensive knowledge and profound scholarship, accomplished the dazzling people's of taking by force effect really; Yet its emphasis still is to be to dazzle cruel action scene; Express one's feelings singlely and ignored the trickle expression of personage, particularly personage, the ratio of appearance is also very low.And to this problem, the mouth type of Chinese animation exists very big defective, even can be described as and do not accomplish that fully the mouth type is synchronous.
Language is the bridge that the people exchanges, and can directly tell people's story.Can let cartoon role move through language and abundant mouth that to show emotion be trend of the times.
This paper, designs and can import the prototype system that any Chinese sentence just can produce the mouth type animation that links up through the corresponding relation of research Chinese pinyin and mouth type in order to remedy the single defective of homemade animation expression.
Summary of the invention
Development purpose of the present invention is to overcome the defective that above-mentioned prior art exists; And a kind of technology that generates the mouth type animation that links up according to Chinese dialogue is provided; Also as the blank of mouth type animation in the animation design process; This technology is simple and practical, can generate the mouth type animation that links up according to Chinese dialogue fast.
The invention discloses a kind of according to the coherent mouth type cartoon method of Chinese dialogue generation; Comprise that Chinese dialogue analysis, crucial phoneme mouth type modeling and coherent mouth type animation generate in Maya; Described Chinese dialogue analysis can generate pinyin sequence, from sequence, filters out crucial phoneme; The design of the corresponding different mouth shape parameters of different crucial phonemes is accomplished in described crucial phoneme mouth type modeling simultaneously, and modeling data is deposited into database; Simultaneously described coherent mouth type animation generates, and can the corresponding mouth shape parameter of crucial phoneme in the database be imported to and generate the animation that links up among the Maya, has made up one fast, generates mouth type cartoon generation system framework according to Chinese dialogue easily.
Describedly filter out crucial phoneme: between the Chinese phonetic alphabet and the sounding mouth type, relate to 6 kinds of pronunciation combinations altogether, 35 crucial phonemes.Its role is to sum up the rule between the Chinese phonetic alphabet and the sounding mouth type, simplified the design of mouth shape parameter, the convenient analysis of phonetic later on.
The modeling of described crucial phoneme mouth type is carried out modeling to the mouth pronunciation shape of 35 crucial phonemes, mouth type action message input database.Its role is to design according to crucial phoneme the parameter value of mouth type, the parameter setting of corresponding mouth type is that place mat has been made in the relevant research of analysis of later mouth type.
Described coherent mouth type animation generates, and the mouth shape parameter value that crucial phoneme is corresponding is written to the .ainm file and imports Maya, forms the mouth type animation that links up.Its role is to generate coherent mouth type animation fast, make things convenient for the design of animation, enrich animation people's expression.
Beneficial effect of the present invention is:
1, the present invention has studied the rule between the Chinese phonetic alphabet and the sounding mouth type, and the phonetic sounding has been told 6 types, and convenient mouth shape parameter value is later on set.
2, crucial phoneme mouth type modeling among the present invention, the basis for the modeling of crucial phoneme mouth type is established makes things convenient for the modeling of mouth type.
3, the mouth type animation that links up of the present invention's design generates, and has made up the coherent mouth type cartoon generation system framework based on JAVA platform and Maya platform.
Through the technology that we provided, may be used on being applied in the manufacturing process of animation, the animation role's that the generation of aspect is required mouth type animation enriches the cartoon character expression.
Description of drawings
Fig. 1 is the Java system flowchart;
Fig. 2 is a system flow;
Fig. 3 be phonetic bai sounding three mouth types---type+a+i shuts up;
Fig. 4 is all phonetics that meet rule 1;
Fig. 5 is all phonetics that meet rule 2.1;
Fig. 6 is all phonetics that meet rule 2.2;
Fig. 7 is all phonetics that meet rule 3;
Fig. 8 is all phonetics that meet rule 4;
Fig. 9 is all phonetics that meet rule 5.
Embodiment
Embodiment:
The invention discloses a kind of technology that generates the mouth type animation that links up according to Chinese dialogue; Comprise that Chinese dialogue analysis, crucial phoneme mouth type modeling and coherent mouth type animation generate in Maya; It is characterized in that: described Chinese dialogue analysis; Can generate pinyin sequence, from sequence, filter out crucial phoneme.The design of the corresponding different mouth shape parameters of different crucial phonemes is accomplished in described crucial phoneme mouth type modeling simultaneously, and modeling data is deposited into database.Simultaneously described coherent mouth type animation generates, and can the corresponding mouth shape parameter of crucial phoneme in the database be imported to and generate the animation that links up among the Maya, has made up one fast, generates mouth type cartoon generation system framework according to Chinese dialogue easily.
Rule between the described Chinese phonetic alphabet and the sounding mouth type: relate to 6 kinds of pronunciation combinations altogether, 35 crucial phonemes.Sounding rule classification situation is following:
Class1---such pinyin combinations has the plain simple or compound vowel of a Chinese syllable of a single-tone, and initial consonant and simple or compound vowel of a Chinese syllable creating a great impression to pronunciation mouth type.So first crucial mouth shape is an initial consonant mouth shape, second mouth shape is simple or compound vowel of a Chinese syllable mouth shape, and meeting this regular pinyin combinations has: bo, po, mo etc., all pinyin combinations that meet this type of rule see Fig. 4 for details.
(1) pronunciation mouth shape influenced by simple or compound vowel of a Chinese syllable bigger, like lv, lin, wu etc., all pinyin combinations that meet this type of rule see Fig. 5 for details;
(2) pronunciation mouth shape influenced by initial consonant bigger, like ying, ji, shi etc., all pinyin combinations that meet this type of rule see Fig. 6 for details;
Type 3---this pinyin combinations has the plain simple or compound vowel of a Chinese syllable of two single-tones, and two simple or compound vowel of a Chinese syllable mouth shapes can not ignore and initial consonant mouth shape can be ignored.Meeting this regular pinyin combinations has: zhua, chuang, juan etc., all pinyin combinations that meet this type of rule see Fig. 7 for details.
Type 4---such pinyin combinations has a diphones simple or compound vowel of a Chinese syllable, and the pronunciation mouth shape of initial consonant is very little to the influence of combination pronunciation.The pinyin combinations that meets this rule-like has: chai, hei, hui etc., all pinyin combinations that meet this type of rule see Fig. 8 for details.
Type 5---such pinyin combinations has a diphones simple or compound vowel of a Chinese syllable, and the generation mouth shape of two phonemes of simple or compound vowel of a Chinese syllable all cannot be ignored together with initial consonant sounding mouth type.Meeting this regular pinyin combinations has bai, pei, kao etc., and all pinyin combinations that meet this type of rule see Fig. 9 for details.
Type 6---such pinyin combinations has two simple or compound vowel of a Chinese syllable, and one is the plain simple or compound vowel of a Chinese syllable of single-tone, and one is the diphones simple or compound vowel of a Chinese syllable, and the sounding mouth type of two simple or compound vowel of a Chinese syllable cannot be ignored, but initial consonant mouth shape can.Meet six of the total guai of this regular pinyin combinations, kuai, huai, zhuai, chuai, shuai.
The modeling of described crucial phoneme mouth type is carried out modeling to the mouth pronunciation shape of 35 crucial phonemes, mouth type action message input database.The major database table has:
1. Pinyin information:
The phonetic sequence number, phonetic alphabet,
Classification number
2. the plain mouth type of single-tone information:
Classification numberLeft side corners of the mouth X movement value; Left side corners of the mouth Y movement value; Right corners of the mouth X movement value; Right corners of the mouth Y movement value; Chin moves the X value; Chin moves the Y value; Chin moves the Z value; Chin rotation X value; Chin rotation Y value; Chin rotation Z value; Left side upper lip value of moving up and down; Middle upper lip value of moving up and down; The right upper lip value of moving up and down; Left side lower lip value of moving up and down; Middle lower lip value of moving up and down; The right lower lip value of moving up and down; Left side corners of the mouth degree of pinching; Right corners of the mouth degree of pinching; Upper lip turns over and sticks up; Lower lip turns over and sticks up the upper-lower position of face in face; Face is in the position, the left and right sides of face; The upper-lower position of last tooth; The upper-lower position of lower tooth; The last tooth size of exposing; The lower tooth size of exposing
3. diphones mouth type information:
Classification number,
The phoneme sequence numberLeft side corners of the mouth X movement value; Left side corners of the mouth Y movement value; Right corners of the mouth X movement value; Right corners of the mouth Y movement value; Chin moves the X value; Chin moves the Y value; Chin moves the Z value; Chin rotation X value; Chin rotation Y value; Chin rotation Z value; Left side upper lip value of moving up and down; Middle upper lip value of moving up and down; The right upper lip value of moving up and down; Left side lower lip value of moving up and down; Middle lower lip value of moving up and down; The right lower lip value of moving up and down; Left side corners of the mouth degree of pinching; Right corners of the mouth degree of pinching; Upper lip turns over and sticks up; Lower lip turns over and sticks up the upper-lower position of face in face; Face is in the position, the left and right sides of face; The upper-lower position of last tooth; The upper-lower position of lower tooth; The last tooth size of exposing; The lower tooth size of exposing
Described coherent mouth type animation generates, and the mouth shape parameter value that crucial phoneme is corresponding is written to the .ainm file and imports Maya, forms the mouth type animation that links up.In native system; Java is as the GUI that input is provided for the user, and it need convert the input of user's Chinese character to pinyin sequence automatically, filters unessential phoneme then; Then obtain desired data and write the .anim file through the connection database, ready for importing Maya.Animation effect such as Fig. 3.System flowchart such as Fig. 2 that JAVA realizes, and total system flow graph such as Fig. 1.
Claims (4)
1. one kind generates the mouth type cartoon method that links up according to Chinese dialogue; Comprise that Chinese dialogue analysis, crucial phoneme mouth type modeling and coherent mouth type animation generate in Maya; It is characterized in that: described Chinese dialogue analysis, can generate pinyin sequence, from sequence, filter out crucial phoneme; The design of the corresponding different mouth shape parameters of different crucial phonemes is accomplished in described crucial phoneme mouth type modeling simultaneously, and modeling data is deposited into database; Simultaneously described coherent mouth type animation generates, and can the corresponding mouth shape parameter of crucial phoneme in the database be imported to and generate the animation that links up among the Maya, has made up one fast, generates mouth type cartoon generation system framework according to Chinese dialogue easily.
2. according to claim 1ly generate the mouth type cartoon method that links up, it is characterized in that filtering out crucial phoneme, relate to 6 kinds of pronunciations between the Chinese phonetic alphabet and the sounding mouth type altogether and make up 35 crucial phonemes according to Chinese dialogue.
3. according to claim 1 according to the coherent mouth type cartoon method of Chinese dialogue generation, it is characterized in that: the modeling of described crucial phoneme mouth type, the mouth pronunciation shape of 35 crucial phonemes is carried out modeling, mouth type action message input database.
4. according to claim 1 according to the coherent mouth type cartoon method of Chinese dialogue generation; It is characterized in that: described coherent mouth type animation generates; The mouth shape parameter value that crucial phoneme is corresponding is written to the .ainm file and imports Maya, forms the mouth type animation that links up.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012102378909A CN102819856A (en) | 2012-07-10 | 2012-07-10 | Method for generating coherent mouth shape cartoon according to Chinese dialogues |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012102378909A CN102819856A (en) | 2012-07-10 | 2012-07-10 | Method for generating coherent mouth shape cartoon according to Chinese dialogues |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102819856A true CN102819856A (en) | 2012-12-12 |
Family
ID=47303959
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2012102378909A Pending CN102819856A (en) | 2012-07-10 | 2012-07-10 | Method for generating coherent mouth shape cartoon according to Chinese dialogues |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102819856A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108447474A (en) * | 2018-03-12 | 2018-08-24 | 北京灵伴未来科技有限公司 | A kind of modeling and the control method of virtual portrait voice and Hp-synchronization |
| CN109830236A (en) * | 2019-03-27 | 2019-05-31 | 广东工业大学 | A kind of double vision position shape of the mouth as one speaks synthetic method |
| CN112001323A (en) * | 2020-08-25 | 2020-11-27 | 成都威爱新经济技术研究院有限公司 | Digital virtual human mouth shape driving method based on pinyin or English phonetic symbol reading method |
| WO2022033206A1 (en) * | 2020-08-14 | 2022-02-17 | 腾讯科技（深圳）有限公司 | Expression generation method and apparatus for animation object, storage medium, and electronic device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002108382A (en) * | 2000-09-27 | 2002-04-10 | Sony Corp | Animation method and device for performing lip sinchronization |
| CN101364309A (en) * | 2008-10-09 | 2009-02-11 | 中国科学院计算技术研究所 | Cartoon generating method for mouth shape of source virtual characters |
| CN101826216A (en) * | 2010-03-31 | 2010-09-08 | 中国科学院自动化研究所 | Automatic generating system for role Chinese mouth shape cartoon |
| CN101968894A (en) * | 2009-07-28 | 2011-02-09 | 上海冰动信息技术有限公司 | Method for automatically realizing sound and lip synchronization through Chinese characters |
-
2012
- 2012-07-10 CN CN2012102378909A patent/CN102819856A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002108382A (en) * | 2000-09-27 | 2002-04-10 | Sony Corp | Animation method and device for performing lip sinchronization |
| CN101364309A (en) * | 2008-10-09 | 2009-02-11 | 中国科学院计算技术研究所 | Cartoon generating method for mouth shape of source virtual characters |
| CN101968894A (en) * | 2009-07-28 | 2011-02-09 | 上海冰动信息技术有限公司 | Method for automatically realizing sound and lip synchronization through Chinese characters |
| CN101826216A (en) * | 2010-03-31 | 2010-09-08 | 中国科学院自动化研究所 | Automatic generating system for role Chinese mouth shape cartoon |
Non-Patent Citations (1)
| Title |
|---|
| 陈盈科: "真实感三维人脸表情动画的设计与实现", 《中国优秀硕士学位论文全文数据库（电子期刊）－信息科技辑》, 15 November 2009 (2009-11-15), pages 1 - 73 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108447474A (en) * | 2018-03-12 | 2018-08-24 | 北京灵伴未来科技有限公司 | A kind of modeling and the control method of virtual portrait voice and Hp-synchronization |
| CN108447474B (en) * | 2018-03-12 | 2020-10-16 | 北京灵伴未来科技有限公司 | Modeling and control method for synchronizing virtual character voice and mouth shape |
| CN109830236A (en) * | 2019-03-27 | 2019-05-31 | 广东工业大学 | A kind of double vision position shape of the mouth as one speaks synthetic method |
| WO2022033206A1 (en) * | 2020-08-14 | 2022-02-17 | 腾讯科技（深圳）有限公司 | Expression generation method and apparatus for animation object, storage medium, and electronic device |
| US11978145B2 (en) | 2020-08-14 | 2024-05-07 | Tencent America LLC | Expression generation for animation object |
| CN112001323A (en) * | 2020-08-25 | 2020-11-27 | 成都威爱新经济技术研究院有限公司 | Digital virtual human mouth shape driving method based on pinyin or English phonetic symbol reading method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105447896A (en) | Animation creation system for young children | |
| Russell | ToonTastic: a global storytelling network for kids, by kids | |
| CN104361620A (en) | Mouth shape animation synthesis method based on comprehensive weighted algorithm | |
| CN108492817A (en) | A kind of song data processing method and performance interactive system based on virtual idol | |
| CN102819856A (en) | Method for generating coherent mouth shape cartoon according to Chinese dialogues | |
| Ackerman et al. | Co-creative conceptual art | |
| Shiyuan et al. | Animation modeling with chu art characteristics based on flash technical design and production | |
| Wang | A Study of Visual Poem" in Just-" from the Perspective of Multimodal Discourse Analysis. | |
| Evans | The emerging role of the director in Chinese xiqu | |
| Wang | Analysis on setting of animated characters modeling in accordance with national traditional culture | |
| Sarita | Pictures that Speak: A Compendious Study of the Poly-Semiotic Visual Language of Comics | |
| Araki | Embrace the Copy: Plaster Casts and Modernity in Art Education in Japan | |
| Choi et al. | A Study on application of Limited Animation for Education of Animation Production | |
| Gremmler | Creative education and dynamic media | |
| Choi | Lineage of Eccentrics: The Popularization of Art History, or Rewriting Japanese Art History | |
| Gu | On Key Animation and Key Animator | |
| Gu et al. | What Makes Robot Xiaobing’s Works Poetic? | |
| Cai et al. | The Importance of Design Sketch for Art Design | |
| Hasirci et al. | FOSTERING CREATIVITY IN EDUCATION WITH THE DESIGN OF ANIMATED SHOWS FOR CHILDREN | |
| Xu et al. | Inheriting Anhui red culture is committed to digital animation creation research | |
| Dong | A Study of the Relationship between the Expressions of Folk Dance Language Art and Culture | |
| Wenyan et al. | Design of Mobile Internet Platform and Information Visualization Based on Furniture Display and 3Dmax | |
| Liu et al. | Discussion on the Characteristic Teaching Ideas and Methods of Male Preschool Teachers Reciting Traditional Chinese Preschool Poetry | |
| Zhang et al. | “Shen Si” and Artistic Medium | |
| Melchiondo | The Synthetic Uncanny: Grotesque Aesthetics in Artificial Intelligence Art |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20121212 |