KR20080059865A - Face modification of game character in game system - Google Patents

Abstract

A face modification method of a game character in a game system is provided to change the face of a game character based on the face image that is selected by a user to increase the interests of a game. A face modification method of a game character in a game system includes the steps of: extracting the face area and features of the face from the selected face image; producing 2D caricature by characterizing the extracted 2D face information and face feature information; and mapping the produced 2D caricature on the face of the game character that is selected by a game user to change the 2D face of the game character selected by the game user.

Description

Face Modification of Game Character in Game System

1 is a flowchart illustrating a method of changing a game character face in a game system according to the present invention.

Figure 2 is an embodiment showing a process of applying a game character face change method in the game system according to the present invention.

3 is a first embodiment illustrating a process of game characterizing a 2D face image according to a method of changing a game character face in a game system according to the present invention;

4 is a second embodiment showing a process of characterizing a 2D face image according to a method of changing a game character face in a game system according to the present invention;

The present invention relates to a game system, and more particularly to a method of changing the game character face in the game system.

A variety of 2D or 3D gamers in game systems that can enjoy a variety of genres of games such as conventional online games, video games and arcade games, or first (or third) first person shooting games, racing games, strategy simulation games, and dance games. Studies on face detection, facial feature point extraction, 2D characterization, and 3D face generation from 2D face information applicable to character production are well described in the following data.

First, the face detection method proposed by Rein-Lien Hsu et al. (Rein-Lien Hsu, Abdel-Mottaleb, M. Jain, AK, "Face detection in color images", Pattern Analysis and Machine Intelligence , IEEE Transactions on Volume 24, Issue 5, Page (s): 696-706, 2002), is a method of detecting the face area using color.In the conventional RGB color coordinate system, the distribution of skin color defines the face area. The difficulty is due to the conversion to other coordinate systems such as YCbCr for detection, but this method is difficult to detect sophisticated face areas.

Second, the facial feature extraction method proposed by Rikert, TD et al. (Rikert, TD, Jones, MJ, Viola, P., "A cluster-based statistical model for object detection", Computer Vision , 1999. The Proceedings of the Seventh IEEE International Conference on Volume 2, Page (s): 1046-1053, 1999) generate face-to-face statistical data using Gaussian blending of multiscale and multiresolution filters. The feature points are extracted, but this method tends to depend on the learning images, and the processing time and calculation formulas are complicated.

Third, the 2D characterization method proposed by J. Liu et al. (J. Liu, Y. Chen, W. Gao, R. Fu, and R. Zhou, "Craetive cartoon face synthesis system for mobile entertainment , " LNCS 3768 , Page (s): 1027-1038, 2005) is less interesting to users because the caricature image is represented only as a simple binary image of the live action.

Fourth, V. Blancs and T. V. Blanz and T. Vetter, "A Morphable model for the synthesis of 3D faces," Computer proposed by V. Blanz and T. Vetter Graphics Proc . SIGGRAPH , Page (s): 187-194, 1999) relates to a method of generating a 3D face image using a 3D Morphable model when 2D face information is input, and detecting the position of initial feature points in the face image. Since it is not possible to decide at the stage, a separate manual work is required, and a lot of time is required to fit a 2D image into a 3D face, which makes it difficult to apply to a real-time game system.

Meanwhile, in the conventional game system to which the above-described face detection method, facial feature point extraction method, 2D characterization method, and 3D face generation method from 2D face information are applied, a game user plays his or her own 2D or 3D game character. According to the intention of the producer, select from among the game characters that have been created in advance.

In this case, since the number of game characters that can be selected by the game user is fundamentally limited, it is easy for the user to lose interest in the game and the immersion is lowered. May result.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-described problems, and an object of the present invention is to extract a face region and a facial feature point from a selected face image acquired through a camera or a photograph, and extract the extracted 2D face (and facial feature point). Mapping the information directly to the 2D face of the game character, further characterizing and mapping to the face of the game character, or generating 3D face information from the extracted 2D face (and facial feature points) information to create a 3D game. The present invention provides a method of changing a game character face in a game system that changes a 2D or 3D face of a game character used in a game system by mapping the character's face.

In order to achieve the object of the present invention as described above, the game character face change method in the game system according to the first embodiment of the present invention, extracting a face region and facial feature points from the selected face image; And mapping the extracted 2D face information and facial feature point information directly to the 2D face of the specific game character selected by the game user to change the 2D face of the game character selected by the game user.

In order to achieve the object of the present invention as described above, the game character face change method in the game system according to the second embodiment of the present invention, the method comprising the steps of extracting the face region and facial feature points from the selected face image; Characterizing the extracted 2D face information and facial feature point information to generate a 2D caricature; And mapping the generated 2D caricature to the 2D face of the specific game character selected by the game user to change the 2D face of the game character selected by the game user.

In order to achieve the object of the present invention as described above, the game character face change method in the game system according to the third embodiment of the present invention, the method comprising the steps of extracting the face region and facial feature points from the selected face image; Generating a 3D face from the extracted 2D face information and facial feature point information; And changing the 3D face of the game character selected by the game user by mapping the generated 3D face to the 3D face of the specific game character selected by the game user.

In order to achieve the object of the present invention as described above, the game character face change method in the game system according to the fourth embodiment of the present invention comprises the steps of: extracting the face region and facial feature points from the selected face image; Generating a 2D face adapted to the standard 3D model from the extracted 2D face information and facial feature point information; And changing the 3D face of the game character selected by the game user by texture mapping the generated 2D face to the 3D face of the specific game character selected by the game user.

Hereinafter, a first embodiment, a second embodiment, a third embodiment, and a fourth embodiment of the present invention will be described in more detail with reference to the accompanying drawings.

1 is a flowchart showing a method of changing a game character face in a game system according to the present invention, and shows all of the first, second, third, and fourth embodiments of the present invention. , S10, S20, and S30 processes are commonly performed in all four embodiments.

2 is a view illustrating a process of applying a game character face changing method in a game system according to the present invention to a game system, wherein a 2D or 3D face of a game character used in the game system is acquired through a camera or a photograph. The process of changing using the selected face image (eg, a face image of a game user, a face image of another person, etc.) is shown.

Referring to FIG. 1, the first, second, third, and fourth embodiments of the present invention all acquire face images for changing the face of a game character through a camera or a photograph. In step S10, the face region and the facial feature points are extracted from the selected face image (S20 and S30).

In this case, a general CCD or CMOS PC camera, a surveillance CCTV camera, a digital camera and a mobile phone camera may be used as the camera.

In addition, in order to detect a face region from the face image, an AdaBoost Face Detection method, a PCA (Principal Component Analysis) method for quickly and precisely detecting a face by generating a template through learning using contrast of each region of the face Based face detection method, independent component analysis (ICA) based face detection method, etc. may be used, and face illumination normalization (eg, homomorphic filtering, etc.) may be performed to improve the sophistication of face area detection.

In addition, it is a learning-based facial feature extraction method using AAM (Active Appearance Model) that extracts facial feature points quickly and precisely from detected face areas. Can be extracted as a facial feature point.

According to the first embodiment, the second embodiment, the third embodiment, and the fourth embodiment of the present invention in the state in which the face region and the facial feature points are extracted from the selected face image acquired through a camera or a photograph as described above A process of performing a game character face change method in each game system will be described in detail as follows.

First, in the first embodiment of the present invention, after extracting a face region and facial feature points from a face image acquired through a camera or a photograph as described above (S10 to S30), from the face image selected for game character change, The extracted 2D face information and facial feature point information are directly mapped to the 2D face of the specific game character selected by the game user to change the 2D face of the game character selected by the game user (S40.S42).

Secondly, in the second embodiment of the present invention, after extracting a face region and facial feature points from a face image acquired through a camera or a photograph as described above (S10 to S30), from the face image selected for changing the game character, The 2D caricature is generated by characterizing the extracted 2D face information and facial feature point information (S50).

In this case, as shown in FIG. 3, the similarity between the 2D face feature points extracted from the face image selected for the game character change by DB of the face feature information of the game character by the game character design expert in advance (eg, Euclid). 2D caricature may be generated through matching and fusion with facial feature information of pre-stored game characters based on dianclinic distance, etc.) and shape information.

In addition, as shown in FIG. 4, the facial feature region is obtained by the game character design expert in advance, and the game user's 2D facial feature point information extracted from the face image selected for the game character change is made into the DB. After conversion to, the matching and fusion with the face feature region information of the previously stored game character is performed based on the similarity (for example, Euclidian distance, etc.) information among the transformation coefficients of the face feature region. This allows you to create 2D caricatures. In particular, in this case, the facial feature region may be modified using a principal component analysis (PCA) based facial feature region transformation method, an independent component analysis (ICA) based facial feature region transformation method, or a local feature analysis (LFA) based facial feature region transformation method. Can be extracted.

Subsequently, the generated 2D caricature is mapped to the 2D face of the specific game character selected by the game user to change the 2D face of the game character selected by the game user (S52.S54).

Third, in the third embodiment of the present invention, after extracting the face region and the facial feature points from the face image acquired through the camera or the photograph as described above (S10 to S30), from the face image selected for changing the game character, A 3D face is generated from the extracted 2D face information and facial feature point information (S60).

In this case, a 3D face may be generated using an AAM (Active Appearance Model) or an image-based 3D face modeling technology.

Subsequently, the generated 3D face is mapped to the 3D face of the specific game character selected by the game user to change the 3D face of the game character selected by the game user (S62.S64).

Fourth, the fourth embodiment of the present invention is a method of replacing the face of the 3D game character with a 2D face in order to further improve the processing speed of the game system as compared with the above-described third embodiment. After the face region and the facial feature points are extracted from the face image acquired through the photograph or the like (S10 to S30), the 2D face is fitted to the standard 3D model from the 2D face information and the facial feature point information extracted from the face image selected for the game character change. To generate (S70).

Subsequently, the generated 2D face is texture mapped to the 3D face of the specific game character selected by the game user to change the 3D face of the game character selected by the game user (S72.S74).

The method of changing the game character face in the game system according to the present invention described above is not limited to the above-described embodiments, and is common in the field of the present invention without departing from the gist of the present invention as claimed in the following claims. Anyone with knowledge has the technical spirit to the extent that various changes can be made.

As described above, the present invention can increase the interest of the game by changing the face of the game character based on the face image selected by the game user (for example, the face image of the game user, the face image of others), In particular, the game user gives an immersive feeling as if they are directly operating in a virtual space, thereby increasing the game user's game use time and thereby increasing the sales of the game system.

Claims (10)

Extracting face regions and facial feature points from the selected face image; And Mapping the extracted 2D face information and facial feature point information to a 2D face of a specific game character selected by the game user to change the 2D face of the game character selected by the game user; Game character face change method in the game system, characterized in that consisting of. Extracting face regions and facial feature points from the selected face image; Characterizing the extracted 2D face information and facial feature point information to generate a 2D caricature; And Mapping the generated 2D caricature to the 2D face of the specific game character selected by the game user to change the 2D face of the game character selected by the game user; Game character face change method in the game system, characterized in that consisting of. The method of claim 2, wherein in the step of characterizing the extracted 2D face information and facial feature point information to generate a 2D caricature, Based on the DB of the feature data of the game character in advance and matching and fusion with the face feature information of the game character previously stored based on the similarity and shape information between the 2D face feature points extracted from the selected face image. A method of changing a game character face in a game system, characterized by generating a 2D caricature. The method of claim 2, wherein in the step of characterizing the extracted 2D face information and facial feature point information to generate a 2D caricature, After converting the facial feature area information of the game character into a DB in advance, converting the 2D facial feature point information extracted from the selected face image into the facial feature area, and then pre-stored the game based on the similarity information between the conversion coefficients of the facial feature area. A method of changing a game character face in a game system, characterized by generating a 2D caricature through matching and fusion with character feature information of a face. The method according to claim 4, wherein when converting the extracted 2D facial feature point information into a facial feature region by preforming a DB of the facial feature region information of the game character in advance, Extracting a facial feature region by using any one of a principal component analysis (PCA) based facial feature region transformation method, an independent component analysis (ICA) based facial feature region transformation method, and a local feature analysis (LFA) based facial feature region transformation method A method of changing a game character face in a game system, characterized in that. Extracting face regions and facial feature points from the selected face image; Generating a 3D face from the extracted 2D face information and facial feature point information; And Mapping the generated 3D face to the 3D face of the specific game character selected by the game user to change the 3D face of the game character selected by the game user; Game character face change method in the game system, characterized in that consisting of. The method of claim 6, wherein the generating of the 3D face from the extracted 2D face information and facial feature point information comprises: A method of changing a game character face in a game system, wherein the 3D face is generated using an AAM (Active Appearance Model) or an image-based 3D face modeling technique. Extracting face regions and facial feature points from the selected face image; Generating a 2D face adapted to the standard 3D model from the extracted 2D face information and facial feature point information; And Changing the 3D face of the game character selected by the game user by texture mapping the generated 2D face to the 3D face of the specific game character selected by the game user; Game character face change method in the game system, characterized in that consisting of. The method of claim 1, 2, 6, or 8, wherein in the step of extracting a facial region and facial feature points from the selected face image, In a game system, the facial region is extracted using any one of an AdaBoost Face Detection method, a Principal Component Analysis (PCA) based face detection method, and an Independent Component Analysis (ICA) based face detection method. To change your game character face. The method of claim 1, 2, 6, or 8, wherein in the step of extracting a facial region and facial feature points from the selected face image, Learning-based facial feature point extraction method using AAM How to change face.

Images