KR100629382B1 - Method for generating 3d avatar from 2d image on mobile communication terminal - Google Patents

Abstract

The present invention relates to a 3D avatar generation method, and more particularly, to a method of generating an avatar of a 3D image by converting an input 2D face image into a 3D image on a mobile communication terminal.

To this end, when the feature point coordinates of the input two-dimensional face image are set, the present invention transforms the three-dimensional standard avatar mesh through affine transform to form a three-dimensional avatar mesh corresponding to the two-dimensional face image. A first step; A second step of mapping the three-dimensional avatar mesh formed in the step to a two-dimensional face image; A third step of generating a three-dimensional face image when the three-dimensional avatar mesh mapped in the step and the two-dimensional face image match, and normalizing the three-dimensional face image to a predetermined size; And a fourth step of generating a three-dimensional avatar by combining the normalized three-dimensional face image and the avatar item selected by the user.

3d avatar, affine, feature point

Description

How to create a 3D avatar {METHOD FOR GENERATING 3D AVATAR FROM 2D IMAGE ON MOBILE COMMUNICATION TERMINAL}

1 is a block diagram schematically showing the configuration of a mobile communication terminal to which the present invention is applied;

2 is a flowchart illustrating a three-dimensional avatar generation method according to the present invention.

3 illustrates a three-dimensional standard avatar mesh model used in the present invention.

4 is a view showing a feature point input method of the face.

5a to 5c are views illustrating a three-dimensional image generation process according to the present invention.

6 illustrates a three-dimensional avatar created in accordance with the present invention.

Explanation of symbols for main parts of the drawings

10: voice processing circuit

20: wireless communication unit

20: shooting unit

40: control unit

     41: 3D image generating unit

     42: 3D avatar generation unit

50: control panel

60: memory

70: display unit

The present invention relates to a 3D avatar generation method, and more particularly, to a method of generating an avatar of a 3D image by converting a 2D face image thereof into a 3D image on a mobile communication terminal.

Avatar means a character of self-defeated meaning in place of cyberspace, and has recently been widely used as a means of expressing itself not only on the Internet but also in mobile communication.

Conventional avatars are two-dimensional avatars on a plane, and are produced by combining only the faces, clothes, and items prepared by the avatar service provider in advance. .

In order to overcome this problem, there is provided a method of producing an avatar three-dimensionally, but since the avatar service provider selects and manufactures a face and a body part or a structure previously prepared by the avatar service provider, the avatar has a uniform body shape and a user's personality. There was also a limit to the expression.

In other words, the characters, pictures, etc. of pre-made characters, famous celebrities, or cartoon characters are not their own images, so they are less attractive, and even if you send an avatar to others, you cannot send your own images. Therefore, there was a problem that it is difficult to expect an association with the parties.

Accordingly, the present invention has been invented to solve the above problems, by converting its two-dimensional face image into a three-dimensional image on the mobile communication terminal, using this to create an avatar of the three-dimensional image can feel a more friendly An object of the present invention is to provide a 3D avatar generation method capable of providing an avatar.

In order to achieve the above object, the present invention provides a method for generating a three-dimensional avatar on a mobile communication terminal: if the feature point coordinates for the input two-dimensional face image is set through a three-dimensional standard (affine transform) Modifying the avatar mesh to form a three-dimensional avatar mesh corresponding to the two-dimensional face image; A second step of mapping the three-dimensional avatar mesh formed in the step to a two-dimensional face image; A third step of generating a three-dimensional face image when the three-dimensional avatar mesh mapped in the step and the two-dimensional face image match, and normalizing the three-dimensional face image to a predetermined size; And a fourth step of generating a three-dimensional avatar by combining the normalized three-dimensional face image and the avatar item selected by the user.

In addition, if the mapped 3D avatar mesh and the 2D face image do not match and the correction coordinates of the feature point are input, the 3D avatar mesh corresponding to the 2D face image is transformed by transforming the 3D standard avatar mesh through affine transformation. The method may further include repeating the process of mapping the same to the two-dimensional face image.

In addition, the two-dimensional face image is characterized in that the image is captured by the photographing unit of the mobile communication terminal or downloaded through the wireless communication unit.

The avatar item may be selected from items stored in a memory unit of the mobile communication terminal.

The avatar item may be an item downloaded from a shopping mall through a wireless communication unit of the mobile communication terminal.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram schematically showing the configuration of a mobile communication terminal to which the present invention is applied. The mobile communication terminal is a wireless communication unit 20 for extracting a voice and data signal from a wireless signal transmitted and received through an antenna ANT, and And a voice processing circuit unit 10 for inputting and outputting a voice call signal through the wireless communication unit 20 through a microphone MIC and a speaker SPK, and a memory unit 60 in which programs and data are stored.

The wireless communication unit 20 includes an antenna (ANT) and an RF circuit for communication with a base station. Existing mobile communication schemes such as cellular, GSM, W-CDMA schemes as well as various versions of the CDMA scheme may be applied. It is configured to.

In addition, the mobile communication terminal includes a photographing unit 30, an operation unit 50, and a display unit 70. Although the photographing unit 30 may be configured as a camera module of various pixels, it is preferable that the photographing unit 30 is configured as a camera module of appropriate pixels for capturing a clear image necessary for generating an avatar.

The operation unit 50 is a means for inputting a user's operation command, and may be composed of a keypad, a side key, a touch panel, a handwriting input unit, a voice recognition unit, and the like including a numeric key and a function key. 70 indicates an operation state of a menu and a terminal, and is preferably implemented as a liquid crystal display device.

The memory unit 60 stores data and various program data. A single chip includes a static random access memory (SRAM) having a capacity of several megabits and a flash memory having a capacity of several tens of megabits. Can be.

The memory unit 60 stores personal information such as voice / text messages, address books, schedules, pictures, ringtones, videos, MP3 files, games, pictures, and the like, in addition to information necessary for basic operations of the terminal. In addition, the 3D standard avatar mesh model data of FIG. 3 including vertices and links is stored, and an avatar item including accessories, a background, a body part or a structure to be used for decoration of the generated avatar is further stored.

On the other hand, the control unit 40 for controlling the overall operation of the mobile communication terminal includes a three-dimensional image generation unit 41 and a three-dimensional avatar generation unit 42.

The 3D image generating unit 41 converts the user's 2D face image captured by the photographing unit 30 into a 3D image, and the 3D avatar generating unit 42 is connected to the 3D image generating unit 41. The 3D facial image is generated by synthesizing the generated 3D face image and the avatar item selected from the memory unit 60.

The blocks in the figures are generally logical blocks and do not necessarily correspond to physical blocks. For example, a part of the voice processing circuit unit 10, a part of the wireless communication unit 20, and a microprocessor constituting the control unit 40 may be packaged into a single chip and commercially available.

In addition, in the present exemplary embodiment, the two-dimensional face image necessary for generating the avatar is described as being captured by the photographing unit 30, but the present invention is not limited thereto. The pre-photographed image may be downloaded and used through the wireless communication unit 20. .

In addition, in the present exemplary embodiment, an avatar item necessary for generating an avatar is stored in the memory unit 60. However, the present invention is not limited thereto, and an avatar item downloaded from a shopping mall through the wireless communication unit 20 may be used.

Next, a method of generating a 3D avatar using the mobile communication terminal configured as described above will be described with reference to FIGS. 2 to 6.

2 is a flowchart illustrating a three-dimensional avatar generation method according to the present invention. After the operation mode of the terminal is set to the three-dimensional avatar generation mode through the operation unit 50 of the mobile communication terminal, the avatar is generated through the photographing unit 30. When the user's two-dimensional face image data required for input is input, the control unit 40 displays the input face image on the display unit 70 of the terminal as shown in FIG. 4 (S100).

In this case, it is preferable to use a front photograph in which all of the user's faces appear so that the feature points of the face required for the production of the avatar can be extracted.

When the two-dimensional face image is displayed on the display unit 70 of the terminal, the coordinates of the feature points of the face may be set using the manipulation unit 50. For example, by pressing No. 1 of the keypad, the left eye is selected, the guide image is positioned at the left eye position of the image with the direction keys, and the feature key coordinates for the left eye can be input by pressing the completion key. In the same manner, feature coordinates for the right eye, nose, and mouth may be input (S200).

In the present exemplary embodiment, coordinates of the left eye, the right eye, the nose, and the mouth are used as feature points of the face, but are not necessarily limited thereto.

When the feature point coordinates of the face are input as described above, the 3D image generating unit 41 of the controller 40 deforms the 3D standard avatar mesh through the affine transformation using the input feature point coordinates to correspond to the face of the user. A dimensional avatar mesh is formed and mapped to the two-dimensional face image as shown in FIG. 5A (ST300 to ST400).

If the modified coordinates of the feature point are input because the 3D avatar mesh deformed according to the feature point coordinates and the 2D face image do not match, the 3D image generator 41 converts the affine using the modified feature point coordinates as described above. The 3D standard avatar mesh is deformed to form a 3D avatar mesh corresponding to the user's face, and is then mapped to the 2D face image as illustrated in FIG. 5B (ST500).

When the three-dimensional avatar mesh and the two-dimensional face image matched through a series of feature point coordinate input, affine transformation, mapping, and modification of the feature point coordinates, the three-dimensional image generator 41 is illustrated in FIG. 5C. As shown in the figure, a 3D face image of a user is generated and normalized by reducing and enlarging it to a size that can be used as an avatar (ST600 to ST700).

Meanwhile, the 3D avatar generator 42 may select an item selected by the user from among the 3D face image generated through the above-described method and the avatar items stored in the memory unit 60, that is, an accessory, a background, a body part or a structure. The final three-dimensional avatar is generated and displayed on the display unit 70 by combining the items of FIG. 6 (ST800).

Therefore, the user can use the generated three-dimensional avatar as his alter ego in the mobile communication.

As described above, the present invention, by converting his two-dimensional face image taken through the camera to a three-dimensional image on the mobile communication terminal, by using this to create an avatar of the three-dimensional image provides an avatar that can feel more friendly This is possible, and also has the effect of creating a three-dimensional avatar without using expensive avatar sticker vending machine, computer, scanner equipment.

Although the present invention has been described with reference to one embodiment shown in the drawings, this is merely exemplary, and it will be understood by those skilled in the art that various modifications and equivalent other embodiments are possible. Therefore, the true technical protection scope of the present invention should be defined only by the appended claims.

Claims (7)

In the 3D avatar generation method on a mobile terminal: A first step of forming a three-dimensional avatar mesh corresponding to the two-dimensional face image by deforming the three-dimensional standard avatar mesh through affine transformation when the feature point coordinates of the input two-dimensional face image are set; A second step of mapping the three-dimensional avatar mesh formed in the step to a two-dimensional face image; A third step of generating a three-dimensional face image when the three-dimensional avatar mesh mapped in the step and the two-dimensional face image match, and normalizing the three-dimensional face image to a predetermined size; And And a fourth step of generating the three-dimensional avatar by combining the normalized three-dimensional face image and the avatar item selected by the user. The method of claim 1, If the mapped 3D avatar mesh and the 2D face image do not match, and the correction coordinates of the feature points are input, the 3D standard avatar mesh is transformed through affine transformation to form a 3D avatar mesh corresponding to the 2D face image. And repeating the process of mapping it back to the two-dimensional face image. delete delete The method of claim 1, The avatar item is a three-dimensional avatar generation method, characterized in that the item downloaded from the shopping mall through the wireless communication unit of the mobile communication terminal. delete A three-dimensional avatar generation method comprising a three-dimensional avatar generated by using the generated three-dimensional avatar in conjunction with a terminal IDLE (standby screen) and a wired / wireless communication service.

Images