KR101743764B1 - Method for providing ultra light-weight data animation type based on sensitivity avatar emoticon - Google Patents

Abstract

The present invention relates to a method for providing an ultralight data animation method based on emotional avatar emoticons, and a terminal device for providing emotional avatar emoticons for implementing the method. A first step of parsing a face area of a 2D frontal face photograph image extracted by the template animation content information previously stored in the database (20) by the emotional avatar emoticone providing terminal device (10). A second step of determining whether the emotional avatar emoticone providing terminal device 10 is suitable for the self-image animation implemented according to the template animation content information of the face component of the parsed face area; As a result of the determination, if the emotional avatar emoticon providing terminal device 10 is suitable for its own image animation, the face component constituting the face area of the 2D frontal facial photograph image is changed, and the 2D facial emoticon The emotion avatar emoticon providing terminal 10 implements the 'emotional avatar face character normalization information' in accordance with the template animation content information stored in the database 20 in the case where it is not suitable for the self image animation as a result of the determination A third step of selecting the face component template in the self-image animation as the third step; A fourth step of extracting the skin color and state of the user for the facial component implementation corresponding to the selected face component template by the emotional avatar emoticone providing terminal device 10; A fifth step of extracting a size and a color attribute of a face area to be applied as a face character icon in an animation object from the 2D frontal face photograph image by the emotional avatar emoticone providing terminal device 10; The emotional avatar emoticon providing terminal device 10 changes the color and size of the selected face component template in accordance with the size and color property of the extracted face area so as to apply the selected face component template to the animation target icon, A sixth step of completing generation of the avatar emoticons; The emotional avatar emoticone providing terminal device 10 generates a 2D-based 3D face image to automatically generate an upper, lower, left, and right images of the face region of the 2D emotional avatar emoticon generated as a 2D front face photograph image, A seventh step of generating a 3D emotion avatar emoticon expressed in an animation format by performing 3D face modeling based on 2D; And the emotional avatar emoticon providing terminal device 10 extracts the template animation content information for the 2D emotion avatar emoticon or the 3D emotion avatar emotion from the database 20 and outputs the 2D avatar emotion or the 3D emotion avatar emotion to the video input / And outputs the 2D emotional avatar emoticon or the 3D emotional avatar emoticon, which receives the voice signal input to the voice input / output unit 17 and receives the voice signal, after displaying the area where the facial expression according to the animation occurs, An eighth step of converting the 3D emotion avatar emoticon including the 2D emotion avatar emotion including voice expression and the 3D emotion avatar emotion including voice expression to the database 20 and completing generation of the emotion avatar emotion including voice; And a control unit.
Accordingly, it is possible to provide an emoticon corresponding to an avatar of an user easily and quickly by applying an algorithm for automatically extracting detailed features of each face element. That is, the present invention can provide an emotional animation expression that animates as if it is alive by applying a blending animation automation technology, and can provide an ultra light character utilizing only one frontal picture.
In addition, the present invention provides an advantage that a emotional avatar emoticon including a voice is generated as a lip-syncing animation type after parsing a string corresponding to a similarity transformation matrix, and emotion animation can be combined in real time.
In addition, the present invention can provide a realistic emoticon animation expression with a 3D facial animation effect expression that characterizes a user of a 2D structure as a 3D face animation effect expression, at a level of one-hundredth (0.01 times) Lt; / RTI >
In addition, the present invention can be applied not only to messenger chatting with my emoticons but also to a smart sticker that uses an SNS based on emotional avatar emoticons as an ultralight character, a photo sticker generated as my character, and a realistic smart running participant as my character There is a possible effect.

Description

TECHNICAL FIELD The present invention relates to a method for providing an ultralight data animation method based on emotional avatar emoticons and a terminal for providing emotional avatar emoticons for implementing the method.

The present invention relates to a method for providing an ultralight data animation method based on a emotional avatar emoticon and a terminal device for providing emotional avatar emoticons for implementing the method. More particularly, the present invention relates to a method for automatically generating an avatar animation having an extremely small data size, Emotional avatar emoticons to automatically generate shapes and colors of eyes, nose, and mouth according to various facial expressions that are automatically extracted by automatically extracting shapes and colors of eyes, nose, and mouth of each photo The present invention relates to a method of providing an ultralight data animation method of an avatar emoticon and a terminal device for providing emotional avatar emoticons for implementing the method.

Various types of emoticons are provided according to the expansion of domestic and foreign emoticons market. Meanwhile, a system and a method for providing a social network emoticons using a 3D character according to the related art (Patent Application No. 10-2014-0091063), a user terminal receives 3D character data selected from an emoticon providing server, However, there is a limitation in using the emoticon as a large data capacity and a realistic feeling of realism unique to the 3D character, which is instantly recognized as a face of the user and automatically generated.

A system and method for changing an emoticon or a character according to a message transmission history (Patent Application No. 10-2012-0057285) detects a positive word or a negative word contained in the contents of a message sent to a counterpart by users, A technique of changing an emoticon or a character according to a message transmission history for growing or reducing an emoticon selected in a user terminal according to a detected positive word or negative word may not directly recognize the face of the user and provide emoticons of the 3D character There is a point where there is a drop in the actual feeling.

In order to overcome these limitations, an image loading unit for loading image data including a face of an emoticon generating apparatus and an emoticon generating method (Patent Application No. 10-2012-0115473) according to a data format, An outline detection unit for detecting an outline of a face part and a predetermined part of the face part from the image data, an outline detection part for detecting an outline from the outline to the outline, And emoticon generation unit for generating an emoticon from the facial region image data. The user can recognize the facial region by loading the actual photograph of the user, generate an emoticon of the desired facial expression, and reflect the user's personality beyond the limited emoticon character The user can freely express the desired expression Mo dimethicone has been suggested to create available technology.

However, the emoticon generation apparatus and the emoticon generation method (Patent Application No. 10-2012-0115473) can roughly estimate that the user is roughly based on the detection of the outline of the predetermined region and the face region of the face region There is a limit in that the interest inducing effect of the user is remarkably deteriorated as compared with the emoticons of various animation types currently provided by simply providing the line of the predetermined part and the face part of the face part. Furthermore, although the emoticon generation apparatus and the emoticon generation method (Patent Application No. 10-2012-0115473) are advantageous in that the data size is small and the soft and comfortable feeling is expressed by the 2D emoticon, There is a problem.

[Related Technical Literature]

1. Method and Apparatus for Generating Emotional Characters and Animations (Patent Application No. 10-2008-0107676)

2. System and method for providing social network emoticons using 3D characters (Patent Application No. 10-2014-0091063)

3. System and method for changing the emoticon or character according to the message transmission history (Patent Application No. 10-2012-0057285)

4. Emoticon generating device and emoticon generating method (Patent Application No. 10-2012-0115473)

In order to solve the above problems, the present invention provides an advantage of providing an emoticon corresponding to an avatar of an user easily and quickly by applying an algorithm for automatically extracting features, sizes and color characteristics of each face element.

In addition, when the facial animation is generated, the program judges the state of each facial element of the user picture to generate a facial expression by transforming the photographic image itself, or extracts the size and color characteristics of the facial elements of the user using the facial template element provided in advance, To generate a facial expression

That is, a method of providing an ultralight data animation method based on an emotional avatar emoticon for providing an ultralight character utilizing only one frontal image, capable of expressing an emotional animation moving like a living by implementing a blending animation automation algorithm, And a terminal device for providing emotional avatar emoticons.

In addition, the present invention provides an ultralight data animation method based on emotional avatar emoticons for generating emotional avatar emoticons including voice after lip string parsing, lip synch animation type, and providing various advantages of facial expression animation in real time combination with lipsync And a terminal device for emotional avatar emoticons for implementing the method.

In addition, the present invention relates to an emotion-based emoticon-based ultralight data processing method for enabling a realistic emoticon animation expression to be performed at a level of one-hundredth (0.01 times) that of existing 3D characters, An animation method providing method, and a terminal device providing emotional avatar emoticons for implementing the method.

In addition, the present invention can solve the problem of SNS utilization that gives a heavy load to a server with a large data size of an existing 3D avatar using emotional avatar emoticons which are ultralight characters as well as messenger chat with my emoticons, The present invention provides a method of providing an ultralight data animation method based on emotional avatar emoticons for enabling a realistic smart learning to participate as a character participating as a character and a terminal device for providing emotional avatar emoticons for implementing the method.

In order to achieve the above object, a method of providing an emotional avatar emoticon-based ultralight data animation method according to an exemplary embodiment of the present invention is characterized in that the emotional avatar emoticon providing terminal device 10 transmits template animation content information previously stored in the database 20 A first step of parsing a face area of the extracted 2D frontal face photograph image; A second step of determining whether the emotional avatar emoticone providing terminal device 10 is suitable for the self-image animation implemented according to the template animation content information of the face component of the parsed face area; As a result of the determination, if the emotional avatar emoticon providing terminal device 10 is suitable for its own image animation, the face component constituting the face area of the 2D frontal facial photograph image is changed, and the 2D facial emoticon The emotion avatar emoticon providing terminal 10 implements the 'emotional avatar face character normalization information' in accordance with the template animation content information stored in the database 20 in the case where it is not suitable for the self image animation as a result of the determination A third step of selecting the face component template in the self-image animation as the third step; A fourth step of extracting the skin color and state of the user for the facial component implementation corresponding to the selected face component template by the emotional avatar emoticone providing terminal device 10; A fifth step of extracting a size and a color attribute of a face area to be applied as a face character icon in an animation object from the 2D frontal face photograph image by the emotional avatar emoticone providing terminal device 10; The emotional avatar emoticon providing terminal device 10 changes the color and size of the selected face component template in accordance with the size and color property of the extracted face area so as to apply the selected face component template to the animation target icon, A sixth step of completing generation of the avatar emoticons; The emotional avatar emoticone providing terminal device 10 generates a 2D-based 3D face image to automatically generate an upper, lower, left, and right images of the face region of the 2D emotional avatar emoticon generated as a 2D front face photograph image, A seventh step of generating a 3D emotion avatar emoticon expressed in an animation format by performing 3D face modeling based on 2D; And the emotional avatar emoticon providing terminal device 10 extracts the template animation content information for the 2D emotion avatar emoticon or the 3D emotion avatar emotion from the database 20 and outputs the 2D avatar emotion or the 3D emotion avatar emotion to the video input / And outputs the 2D emotional avatar emoticon or the 3D emotional avatar emoticon, which receives the voice signal input to the voice input / output unit 17 and receives the voice signal, after displaying the area where the facial expression according to the animation occurs, An eighth step of converting the 3D emotion avatar emoticon including the 2D emotion avatar emotion including voice expression and the 3D emotion avatar emotion including voice expression to the database 20 and completing generation of the emotion avatar emotion including voice; . ≪ / RTI >

delete

delete

delete

delete

The method for providing the ultimate light data animation method based on the emotional avatar emoticons according to the embodiment of the present invention and the terminal for providing the emotional avatar emoticons for implementing the method can be applied to the avatar of the user, Provides the advantage of providing corresponding emoticons. That is, the present invention can provide an emotional animation expression that animates as if it is alive by applying a blending animation automation technology, and can provide an ultra light character utilizing only one frontal picture.

In addition, a method for providing an ultralight data animation method based on emotional avatar emoticons according to another embodiment of the present invention, and a terminal for providing emotional avatar emoticons for implementing the method, after parsing the string corresponding to the similarity transformation matrix, Emoticons can be created as a lip sync animation type, and emotion animation can be combined in real time.

In addition, a method for providing an ultralight data animation method based on emotional avatar emoticons according to another embodiment of the present invention, and a terminal for providing emotional avatar emoticons for realizing the method, includes a 3D avatar emoticon providing terminal device, It is possible to express real emoticon animation with one-hundredth level (0.01 times) of existing 3D character which is extremely small data in expression.

In addition, a method of providing an ultralight data animation method based on emotional avatar emoticons according to another embodiment of the present invention and a terminal for providing emotional avatar emoticons for implementing the method can not only be used for messenger chatting with my emoticons, There are effects that can be applied to SNS based avatar emoticons, photo stickers generated by my characters, and realistic smart learning involving my characters.

FIG. 1 is a diagram showing a terminal device (hereinafter referred to as emotional avatar emoticone providing terminal device) 10 for implementing a method of providing an ultra light data animation method based on emotional avatar emoticons according to an embodiment of the present invention.
FIG. 2 is a block diagram of the SNS server 30, the mobile messenger server 40 (FIG. 2), the emotional avatar emoticons including the 2D emotional avatar emoticon, the 3D emotional avatar emoticon, and the voice generated by the emotional avatar emoticons providing terminal 10 of FIG. ), A photo sticker kiosk 50, a smarter-running server 60, a mobile data sharing server 70, and other systems.
3 to 7 are views showing a user interface screen (hereinafter, UI screen) implemented by the video input / output unit 15 of the emotional avatar emotichene providing terminal device 10 according to the embodiment of the present invention.
8 to 10 are flowcharts illustrating a method of providing an ultralight data animation method based on emotional avatar emoticons according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a detailed description of preferred embodiments of the present invention will be given with reference to the accompanying drawings. In the following description of the present invention, detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

In the present specification, when any one element 'transmits' data or signals to another element, the element can transmit the data or signal directly to the other element, and through at least one other element Data or signal can be transmitted to another component.

FIG. 1 is a diagram showing a terminal device (hereinafter referred to as emotional avatar emoticone providing terminal device) 10 for implementing a method of providing an ultra light data animation method based on emotional avatar emoticons according to an embodiment of the present invention.

FIG. 2 is a block diagram of the SNS server 30, the mobile messenger server 30, and the mobile messenger server 30 via the network. The emotion avatar emoticons including the 2D emotion avatar emoticon, the 3D emotion avatar emotion, and the voice are generated by the emotional avatar emoticone providing terminal 10 of FIG. A mobile communication terminal 40, a photo sticker kiosk 50, a smarter-running server 60, a mobile data sharing server 70, and other systems.

3 to 7 are views showing a user interface screen (hereinafter, UI screen) implemented by the video input / output unit 15 of the emotional avatar emotichene providing terminal device 10 according to the embodiment of the present invention.

Hereinafter, the configuration of the emotional avatar emoticon providing terminal 10 will be described in detail with reference to FIG. 1 with reference to FIG. 2 to FIG.

1, the emotional avatar emoticon providing terminal 10 includes a photographing unit 11, a feature point detecting module 12, a character generating module 13, an animation generating module 14, a video input / output unit 15 And a storage unit 16, and performs data transmission / reception with the database (DB) 20.

The animation generation module 14 includes a self image generation unit 14a, a template resource image generation unit 14b, a 3D face application unit 14c, and a voice parsing unit 14d.

The feature point detection module 12 receives a selection signal for one of the front face photographs of at least one user previously stored in the storage unit 16 via the video input and output unit 15, Receives the front face image and receives the user's front face photograph image in the 2D state. That is, the feature point detection module 12 receives the 2D front face photograph image shown in FIG.

The feature point detection module 12 obtains a similarity transformation matrix with the user's face based on the template character information pre-stored in the database 20.

More specifically, in order to obtain a similarity transformation matrix using template character information, which is standard data for representing a user character of the feature point detection module 12, a 2D front face photograph image is analyzed, a face region is extracted, The position of the eye, nose, and mouth (including the ear, jaw, and the like), which are facial components, is automatically grasped. That is, as shown in FIGS. 3A and 4A and 4B, the feature point detection module 12 detects a position of a face component and performs a process of automatically generating a character using a vector structure. Template character information for creating such a character is stored in advance as standard data to generate animations including emotional avatar face characters included in the face area and emotional avatar face characters as the final product, , And group information for each face component. Here, the template character information described above is group icon information for each part of the emotional avatar face character, and is generated in advance centering on each part. For example, if the template character information is the eye region group icon information, it may have a group icon such as a line of eyes, a lip gloss, a lip of a wrinkle, have.

That is, the feature point detection module 12 extracts standard data matched with the eyes, nose, mouth, ear, and jaw using the group information of each face component from the template character information, stores the extracted standard data, A similarity transformation matrix selected from the group of each site is generated using reference points selected from the outlines of the eyes, nose, mouth, ears, and jaw of each part of the 2D front face photograph image and pre-stored standard data.

The character generation module 13 generates a character 'emoticon' in order to generate an animation 'emotional avatar emoticon' using the emotional avatar face character of the format shown in FIGS. 5C and 6A to 6D, And the face area of the 2D frontal face photograph image of the format shown in FIG. 4A is automatically extracted in the format shown in FIG. 5A.

The character generation module 13 generates 'emotional avatar face character normalization information' by normalizing the user's face database by matching the template character information previously stored in the database 20 according to the similarity transformation matrix, . The template character information means standard data for expressing the change of the lip as shown in FIG. 3B, the change of the eye to the wink expression as shown in FIG. 3C, the change to the sloping expression of the lip as shown in FIG. 5B, and the like.

That is, the character generation module 13 extracts 'emotional avatar face character normalization information' obtained by extracting one of group icons of each part of the emotional avatar face character using the similarity transformation matrix generated by the feature point detection module 12 .

In addition, the character generation module 13 can generate the 'emotion avatar face character normalization information' that performs the shadow effect and gamma correction and shading for eye and eyebrow replacement as shown in FIGS. 3B and 3C.

The animation generation module 14 parses the face area among the 2D front face photograph images extracted by the character generation module 13 as the template animation content information. That is, as shown in FIG. 5C, FIG. 6A to FIG. 6D and FIG. 7, the process of generating the 2D emotion avatar emoticon is performed by parsing the face area of the 2D front face photograph image with the template animation content information that can be expressed in an animation form.

The animation generation module 14 determines whether or not it is suitable for the self image animation implemented according to the template animation content information in the state that the face component is parsed in the parsed face area. That is, the animation generation module 14 determines whether or not the parsed face area corresponds to the standard face part information in the animation realized according to the template animation content information and the percentage of the fitness that is the matching information of eyes, nose, and mouth in the extracted face area It is judgment.

Here, the animation generation module 14 determines that the animation generation module 14 is appropriate when it is greater than or equal to a predetermined threshold percentage, and conversely, it determines that the animation generation module 14 is not suitable if it is less than the preset threshold percentage.

If it is determined that the image is suitable for its own image animation, the self image generation means 14a changes the face component of the animation with the face component constituting the face region of the 2D front face photograph image, Complete the creation of the avatar emoticons.

On the contrary, if the determination result is not suitable for the self image animation, the template resource image generation means 14b adds the 'emotion avatar face character normalization information' generated by the character generation module 13 to the database 20 The template template is selected as the face component template in the self image animation implemented according to the template animation content information.

More specifically, the template resource image generation means 14b determines whether the face component of the user photograph corresponding to the animation information is an animation suitable by changing the element of the 2D front face image, The 2D emotional avatar remote control is expressed in an animation format utilizing the 'emotional avatar face character normalization information' corresponding to the resource.

To this end, the template resource image generation means 14b stores the emotion avatar face character normalization information, which is a set of the face component template information generated for face normalization, in the database 20, and stores the animation template The template animation content information corresponding to the information is also stored in advance.

Accordingly, the template resource image generation unit 14b performs face area cropping on at least one of the face component template information constituting the 'emotion avatar face character normalization information', which is the normalization information of the similarity transformation matrix Thereby changing the facial component of the emotional avatar that implements the animation and storing it in the storage unit 16. [

Then, the template resource image generating means 14b extracts the skin color and state of the user for the face component implementation corresponding to the selected face component template.

More specifically, the template resource image generating unit 14b generates skin corresponding to the selected face component template as the first partial process for applying to the 2D emotion avatar emoticon. That is, each skin color attribute of the user's face is extracted according to the animation application part, and the face skin is removed and automatically generated according to the animation effect according to the skin attribute of the user.

In addition, the template resource image generation unit 14b performs facial component change as a second partial process for applying to the 2D emotion avatar emoticon. That is, the animation generation module 14 changes the shape of the eyebrows, eyes, lips, and jaws of the face according to the animation effect. The shape of the eyebrows, the eyes, the lips, The template facial component generated by the first partial process is automatically adjusted to the face of the user's face element color and shape and applied to the user's face.

Next, the template resource image generating means 14b extracts the size and color attribute of the face region to be applied as the face character icon in the 2D front face photograph image.

The template resource image generating means 14b completes the generation of the 2D emotion avatar emoticon by changing the selected face component template to the color and size in accordance with the size and color property of the extracted face region to be applied as the animation target icon.

The 3D face applying means 14c is a 3D face modeling based on 2D to automatically generate an up, down, left, and right views of a face region of a 2D emotion avatar emoticon generated as a 2D front face photograph image on 2D) to generate a 3D emotion avatar emoticon displayed in an animation format. The face region for the 3D emotion avatar emoticon generated here can be expressed as shown in FIG. 4C.

More specifically, the 3D face application unit 14c applies a 3D face animation effect expression for generating a rotation effect by distorting the upper, lower, left, and right sides of the user's 2D front face photograph image according to the animation designation , It is possible to express a real sense emoticon animation at a level of one hundredth (0.01 times) of the existing 3D character which is very small data. To this end, the 3D face applying means 14c performs 2D face-based 3D face modeling on 2D.

3D face modeling based on 2D will be described. The 3D face applying means 14c decodes the face region of the 2D emotion avatar emoticon generated as a 2D front face photograph image to generate a decoded image And stores it in the storage unit 16. After that, the 3D face applying means 14c generates a polygon which is the smallest unit used to express the three-dimensional shape in the three-dimensional graphic, converts a plurality of polygons into polygons, (16). Then, the 3D face applying unit 14c performs texture mapping to attach the decoded image stored in the storage unit 16 onto the generated polygon set, thereby generating 3D face area data which is texture-mapped data. Finally, the 3D face applying means 14c scales down the 3D emotion avatar emoticon to which the 3D face region data is applied to a level of one hundredth (0.01 times) and stores it in the database 20, (15).

Accordingly, the 3D face application means 14c has the advantage of automatically generating a user character that is similar to a photograph by analyzing a single front photograph, and generating realistic emotional animation.

On the other hand, the 3D face applying unit 14c is a preprocessing image process for 3D face modeling based on 2D. The 3D face applying unit 14c applies the 3D face modeling based on 2D image from the image information of the face region of the 2D emotion avatar emoticon, And performs binarization or special processing on the image of the photograph in order to detect the outline of the image. Binarization is the process of lowering the color values of several steps (usually 256) to values of 0 and 1, and the edge information of the image can be made clearer by binarization. The special processing is processing for changing the color image to a gray level or performing outline detection. When special processing is performed, the outline is extracted and the user can easily select the reference point on the outline. In the present invention, by using the template character information pre-stored in the database 20 corresponding to the reference point selected in the outline and the standard data, it is possible to perform the preprocessing process for more accurate outline extraction.

On the other hand, the voice parsing means 14d extracts the 3D emotion avatar emoticons generated by the self image generating means 14a and the template resource image generating means 14b, the 3D emotion avatar emoticons generated by the 3D face applying means 14d And extracts the emoticon template contents from the database 20.

After that, the voice parsing unit 14d outputs the 2D emotion avatar emoticon or the 3D emotion avatar emoticon to the video input / output unit 15 in an animation format based on the template animation content information, To the 3D emotion avatar emoticon including the 2D emotion avatar emotion and the 3D emotion avatar emotion having the voice emotion and the 3D emotion avatar emotion including the voice emotion for the 3D emotion avatar emotion that received the voice signal and store them in the database 20, Completes the creation of emoticon emoticon including emoticon.

8 to 10 are flowcharts illustrating a method of providing an ultralight data animation method based on emotional avatar emoticons according to an embodiment of the present invention. 8 to 10, the emotional avatar emoticon providing terminal device 10 transmits a selection signal for one of front face photographs of at least one user previously stored in the storage unit 16 through the video input / output unit 15 Receives the user's front face image through the photographing unit 11, and receives the user's front face photograph image in the 2D state (S11).

After step S11, the emotional avatar emoticon providing terminal device 10 obtains a similarity transformation matrix with the user's face based on the template character information previously stored in the database 20 (S12).

After step S12, the emotional avatar emoticone providing terminal device 10 transmits the 2D (3D) input image data to the emoticon character input terminal 10 in order to generate the 'emotional avatar emoticon' in the animation form using the emotional avatar face character embodying the face area of the user. The face area is automatically extracted from the front face photograph image (S13).

After step S13, the emotional avatar emoticon providing terminal device 10 normalizes the user's face database by matching the template character information previously stored in the database 20 according to the similarity transformation matrix obtained in step S12, Quot; emotional avatar face character normalization information " is generated and stored in the database 20 (S14).

After step S14, the emotional avatar emoticone providing terminal device 10 parses the face area of the 2D frontal face photograph image extracted in step S13 with the template animation content information previously stored in the database 20 (step S13) S15).

After step S15, the emotional avatar emoticon providing terminal 10 judges whether it is suitable for the self-image animation implemented according to the template animation content information of the facial component of the parsed face area (S21).

As a result of the determination in step S21, if the emotional avatar emoticon providing terminal device 10 is suitable for its own image animation, the facial component constituting the face area of the 2D frontal facial photograph image is changed, (S22). ≪ / RTI >

On the other hand, if the determination result of step S21 is not suitable for the self image animation, the emotional avatar emoticon providing terminal device 10 transmits the 'emotional avatar face character normalization information' generated in step S14 to the database 20 As the face component template in the self-image animation implemented according to the stored template animation content information (S23).

After step S23, the emotional avatar emoticon providing terminal device 10 extracts the user's skin color and state for implementing the face component corresponding to the selected face component template (S24).

After step S24, the emotional avatar emoticon providing terminal 10 extracts the size and color attributes of the face area to be applied as a face character icon in the 2D front face photograph image (S25).

After the step S25, the emotional avatar emoticon providing terminal device 10 transmits the face component template selected in the step S23 to the animation target icon so that the size and color attribute of the face area extracted in the step S25 The 2D emotion avatar emoticon creation is completed by changing the color and size of the selected face component template (S26).

After step S26, the emotional avatar emoticone providing terminal device 10 automatically generates the upper, lower, left, and right images of the face area of the 2D emotional avatar emoticons created with the 2D frontal face photograph image, which is a front photograph of the user (3D face modeling based on 2D) to generate a 3D emotion avatar emoticon expressed in an animation format (S31).

After the step S26 or after the step S31, the emotional avatar emoticon providing terminal device 10 extracts the template animation content information for the 2D emotion avatar emoticon or the 3D emotion avatar emoticon from the database 20, The 3D emotion avatar emoticon is displayed on the template animation content information by the video input / output unit 15, and then the voice signal inputted to the voice input / output unit 17 is received and the voice signal is received 2D emotional avatar emoticon including 2D emotional avatar emoticon or 3D emotional avatar emoticon respectively, and 3D emotional avatar emoticon including voice emotions, and storing them in the database 20, thereby generating emotional avatar emoticons including voice (S32).

The present invention can also be embodied as computer-readable codes on a computer-readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored.

Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) .

The computer readable recording medium may also be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner. And functional programs, codes, and code segments for implementing the present invention can be easily inferred by programmers skilled in the art to which the present invention pertains.

As described above, preferred embodiments of the present invention have been disclosed in the present specification and drawings, and although specific terms have been used, they have been used only in a general sense to easily describe the technical contents of the present invention and to facilitate understanding of the invention , And are not intended to limit the scope of the present invention. It is to be understood by those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein.

10: emotional avatar emoticons provided terminal
11:
12: Feature point detection module
13: Character Creation Module
13: animation generation module
14a: Self-image generating means
14b: Template resource image generation means
14c: 3D face application means
14d: voice parsing means
15: Video I /
16:
17: Voice input / output unit
20: Database (DB)

Claims (5)

delete A first step of parsing the face area among the 2D front face photograph images extracted by the template animation content information pre-stored in the database 20 by the emotional avatar emoticone providing terminal device 10;
A second step of determining whether the emotional avatar emoticone providing terminal device 10 is suitable for the self-image animation implemented according to the template animation content information of the face component of the parsed face area;
As a result of the determination, if the emotional avatar emoticon providing terminal device 10 is suitable for its own image animation, the face component constituting the face area of the 2D frontal facial photograph image is changed, and the 2D facial emoticon The emotion avatar emoticon providing terminal 10 implements the 'emotional avatar face character normalization information' in accordance with the template animation content information stored in the database 20 in the case where it is not suitable for the self image animation as a result of the determination A third step of selecting the face component template in the self-image animation as the third step;
A fourth step of extracting the skin color and state of the user for the facial component implementation corresponding to the selected face component template by the emotional avatar emoticone providing terminal device 10;
A fifth step of extracting a size and a color attribute of a face area to be applied as a face character icon in an animation object from the 2D frontal face photograph image by the emotional avatar emoticone providing terminal device 10;
The emotional avatar emoticon providing terminal device 10 changes the color and size of the selected face component template in accordance with the size and color property of the extracted face area so as to apply the selected face component template to the animation target icon, A sixth step of completing generation of the avatar emoticons;
The emotional avatar emoticone providing terminal device 10 generates a 2D-based 3D face image to automatically generate an upper, lower, left, and right images of the face region of the 2D emotional avatar emoticon generated as a 2D front face photograph image, A seventh step of generating a 3D emotion avatar emoticon expressed in an animation format by performing 3D face modeling based on 2D; And
After the emotional avatar emoticone providing terminal device 10 extracts the template animation content information for the 2D emotion avatar emoticon or the 3D emotion avatar emotion from the database 20, the 2D avatar emotion or the 3D emotion avatar emotion is sent to the video input / output unit 15 After displaying the area where the facial expressions according to the animation are generated in the template animation content information, the control unit 15 receives the voice signal input to the voice input / output unit 17 and outputs the 2D emotion avatar emotion or the 3D emotion emotion emotion An eighth step of converting the 3D emotion avatar emoticon including the 2D emotion avatar emoticon including voice expression and the voice emotion to the database 20 and completing generation of the emotion avatar emotion including voice; The method of claim 1, further comprising:
delete delete delete

Images