JP5620743B2 - Facial image editing program, recording medium recording the facial image editing program, and facial image editing system - Google Patents

Description

  According to the present invention, a plurality of operation points called “bones” provided in a three-dimensional image of a face are moved to form a plurality of lattice points (for example, a face shape represented by a polygon model) constituting the face surface shape. The present invention relates to a face image editing program for performing face shape editing by interlocking movement of polygon vertices, a recording medium storing the face image editing program, and a face image editing system.

  Conventionally, in the game software in which a plurality of images of human-type characters controlled by the player are prepared in advance, the player selects a desired character, and the character appears in the game space and the game progresses, the player selects There is known game software provided with a function of editing the shape of the face of the character that has been made into a desired shape.

  In such a game software, by deforming the face contour of the standard character face image (surface model 3D shape image by polygon modeling) and the shape of each part such as eyes, nose, ears, mouth, hairstyle, etc. The face shape can be edited.

  As a basic technique for editing a face shape, conventionally, a plurality of types of standard face images having different shapes for each part are prepared in advance, and a user can obtain a desired standard face image for each part. By selecting and combining the image of each part by adjusting the size of the image, by providing a plurality of markers called “bones” at predetermined positions in each part of the face image and moving the bones of each part A method of changing the shape of a face by interlockingly moving a plurality of polygons associated with the bone is known.

  The former method is a method generally called monf target (hereinafter, editing of this method is referred to as “monf target edit”), and the player selects a desired part and sets a desired shape and size for the selected part. Since it is only necessary to specify an operation, the face shape editing operation is easy. On the other hand, the latter method (hereinafter referred to as “marker editing”) is characterized in that the face shape can be finely edited by adjusting the movement amount of each bone for each part.

JP 2001-229400 A

  Monf target editing requires the preparation of a plurality of types of standard face images having different shapes for each part, and thus has a drawback in that the work burden of creating image data for face image editing is large. Also, if you want to make various facial expressions through animations such as laughing facial expressions, you must prepare not only a standard facial image of the character but also an animated image (a predetermined number of frame images) that makes the character laugh. However, if a large number of faces are created by combination of parts, an animation image must be prepared for each representative face to be combined, which greatly increases the work load of the animator. In addition, there is a drawback that the image data becomes enormous due to a plurality of types of standard face images having different shapes for each part and animation image data for making various expressions.

  On the other hand, marker editing has an advantage that fine editing of the face shape can be performed, but there is a disadvantage that editing contents are limited in relation to the user interface and it is difficult to make full use of the advantage. In marker editing, generally, more than 100 bones are set in a face image. However, it is not easy for an editing expert to move a bone one by one to transform the shape of the face into a desired shape. It is not preferable that the interface for editing is directly operated on all bones.

  Accordingly, when operating the bone directly to the player, the bone that can be operated and the operation range of the bone are limited to some extent, or the deformation content of the part shape (for example, “increase”, “decrease”, “ The movement contents of a plurality of bones corresponding to “moving”, “rotating”, etc.) are set in advance, and when the user selects desired deformation contents for each part, the bones of each part are changed to the selected deformation contents. It is necessary to limit the bone that can be operated and the operation range of the bone by changing the movement according to the movement content.

  However, if the bones that can be manipulated and the range of bone operations are restricted excessively, the range of facial deformation that can be customized by the player will be narrowed. Since the number of choices of the shape of the part that is not selected increases, such as the size in which the balance is extremely lacking, the editing work becomes difficult, so it is not easy to make the restriction content appropriate.

  In addition, the conventional editing method has a disadvantage that animation images for making various facial expressions cannot be created for the face shape of the character arbitrarily edited by the player. That is, in the game software, various animation images such as a laughing face and an angry face are prepared for a standard face image. For example, when the player enlarges the size of the eyes and mouth, the face image If you apply an animation image created with a standard face image to an eye, you may have a state where your eyes and mouth are not completely closed with an animated image that closes your eyes and sleeps or an angry animated image that connects your mouth to the letter `` he ''. An unpleasant or angry facial expression becomes unnatural. When closing the eyes, if the amount of moving the upper eyelid up and down in the standard face image is applied to the upper eyelid with larger eyes, the amount of movement is not enough and the upper eyelid moves to the position where it overlaps the lower eyelid It is because it does not do. The same applies when closing the mouth.

  In order to solve this, it is necessary to reflect the edited content of the face image edited by the player in the animation image created for the standard face image. However, the conventional marker editing has such a function. There is nothing.

  The present invention has been conceived in view of the above circumstances, and in a face image editing program that causes a computer to perform face shape editing processing by a bone editing method, the entire movement of the part is performed for each part. Set multiple markers (operation points) to perform rotation, enlargement / reduction, etc., and operate each marker (operation point) to move the bones associated with each marker (operation point) in conjunction with each other It is an object of the present invention to provide a face image editing program capable of easily editing a face shape, a recording medium storing the face image editing program, and a face image editing system.

  In order to solve the above problems, the present invention takes the following technical means.

  According to the first aspect of the present invention, the computer is configured such that the face shape of the face is expressed by a set of a large number of polygons from the storage unit, and the position of the vertex of the polygon is controlled at each part of the face. A first face image in which a standard face image in which one or two or more first operation points for moving the control point and the control point directly or indirectly are set is read and displayed on the display unit When operation information regarding the movement of the first operation point is input to the display control means and the first operation point of the face image displayed on the display unit from the operation unit, the operation information is input based on the operation information. First movement information calculation means for calculating first movement information including a movement position of the first operation point, and the first face information displayed on the display unit, the operation information being input. To the movement position included in the first movement information. When the first operation point moving means to be moved and the first operation point are moved, one or more control points set in advance as control points interlocked with the movement of the first operation point are Based on the first movement information calculated for the first operation point and the interlocking condition set in advance for each control point, second movement information including the movement position of each control point is calculated. When moving the control point with the second movement information calculation means, with respect to one or more polygon vertices preset as polygon vertices linked to the movement of the control point, the control point The third movement information including the movement position of the vertex of each polygon is calculated based on the second movement information calculated in advance and the interlocking condition set in advance at the vertex of each polygon. Movement information calculation means and the display unit In the displayed standard face image, the face image is deformed by moving the vertex of one or more polygons for which the third movement information is calculated to a movement position included in the third movement information. And functioning as first face image deforming means.

  According to a second aspect of the present invention, in the face image editing program according to the first aspect, when one of the plurality of first operation points set in the standard face image moves, the movement is changed. First operation points associated with each other so that the other is linked are included, and the first movement information calculation means is linked to the first operation point to be moved based on the operation information from the operation unit. The first operation point is also determined based on the first movement information calculated for the first operation point and the interlocking conditions set in advance for the other first operation point. First movement information including a movement position of the first operation point is calculated, and the first operation point moving means includes the first movement information in the standard face image displayed on the display unit. The calculated first other operation point is included in the first movement information. Wherein the moving the moving position.

  According to a third aspect of the present invention, in the face image editing program according to the first or second aspect, the face image includes one or two or more for moving the first operation point for each part. A second operation point is further set, and when the operation information for the second operation point is input from the operation unit, the first movement information calculation means moves according to the second operation point. For the one or more first operation points to be controlled, the first movement information is calculated based on the operation information and movement conditions set in advance at each first operation point, The first operation point moving means sets the first operation point whose movement is controlled by the second operation point to which the operation information is input in the standard face image displayed on the display unit. The first movement calculated by the first movement information calculation means. Wherein the moving the moving position included in the information.

  According to a fourth aspect of the present invention, in the face shape editing program according to the third aspect, the second operation point is a part movement operation point for moving a part where the second operation point is set. When the operation information for moving the part movement operation point with respect to the part movement operation point is input from the operation unit, the first movement information calculation unit is set to the part. For one or more of the first operation points, the first operation points are the same in the same direction as the part movement operation points from the standard position based on the movement direction and movement amount of the part movement operation points. Each of the movement positions moved by the movement amount is calculated.

  According to a fifth aspect of the present invention, in the face shape editing program according to the third aspect, the second operation point is a part enlargement / reduction for changing the size of the part where the second operation point is set. And the first movement information calculation means has operation information of a magnification for enlarging or reducing the region where the region enlargement / reduction operation point is set with respect to the region enlargement / reduction operation point from the operation unit. When input, for one or more of the first operation points set in the part, the first operation point of the first operation point on a line connecting the first operation point and the part expansion / contraction operation point A moving position at a distance obtained by changing a standard distance from the region enlargement / reduction operation point by the magnification is calculated.

  According to a sixth aspect of the present invention, in the face shape editing program according to the third aspect, the second operation point is a part rotation operation point for rotating the part where the second operation point is set. When the operation information for rotating the part rotation operation point with respect to the part rotation operation point is input from the operation unit, the first movement position calculation unit is set to the part 1 or The moving position is calculated for each of the two or more first operating points based on the rotation direction and the rotation amount of the part rotation operating point and the moving condition set in advance at each first operating point. To do.

  According to a seventh aspect of the present invention, in the face image editing program according to any one of the third to sixth aspects, the storage unit further includes a plurality of frames obtained by changing a predetermined part of the standard face image. A face image for animation editing that causes the standard face to have a predetermined expression is stored, and the computer is positioned by the control point and the control point with respect to the standard face image. An image changing means for changing the face image after editing to the face image for animation editing when the editing is performed by moving the vertex of the polygon to be controlled to deform the surface shape of the face. It is characterized by making it.

  According to an eighth aspect of the present invention, in the face image editing program according to the seventh aspect, the face image of each frame for animation editing performs the same function as the first operation point. A second control point that performs the same function as the operation point and the control point is set, and the computer is connected to the frame specified by the operation unit from the storage unit. Second face image display control means for reading a face image and displaying it on the display unit; and the third operation point with respect to the third operation point of the face image displayed on the display unit from the operation unit. When the operation information related to the movement is input, fourth movement information calculation means for calculating fourth movement information including the movement position of the third operation point based on the operation information is displayed on the display unit. In the face image When moving the third operation point, the second operation point moving means for moving the third operation point to which the operation information is input to the movement position included in the third movement information, For one or more second control points preset as control points to be linked to the movement of the operation point, the fourth movement information calculated for the third operation point and each second A fifth movement information calculating means for calculating fifth movement information including a movement position of each second control point based on an interlocking condition set in advance for the control point; and In the case of moving, the fifth calculated for the second control point with respect to one or more polygon vertices preset as polygon vertices linked to the movement of the second control point. Pre-set linkage to the movement information of each polygon and the vertex of each polygon And a sixth movement information calculating means for calculating sixth movement information including the movement position of the vertex of each polygon based on the condition, and the sixth movement information in the face image displayed on the display unit. And further functioning as second face image deformation means for deforming the face image by moving the vertexes of one or more polygons for which is calculated to a movement position included in the sixth movement information. It is characterized by.

  The invention according to claim 9 is the face image editing program according to claim 8, wherein the face image of each frame for animation editing has the same function as the second operation point for each part. One or two or more fourth operation points are set, and the number of the fourth operation points is larger than the number of the second operation points set in the face image for face image editing. It is characterized by being set less.

  A tenth aspect of the present invention is a computer-readable recording medium on which the face image editing program according to any one of the first to ninth aspects is recorded.

  The invention according to claim 11 is a program storage unit that records the face image editing program according to any one of claims 1 to 9 and a computer that executes the face image editing program stored in the program storage unit. And a face image editing system.

  According to the present invention, when an operator edits a face image, a standard face image (for example, a face image represented by a polygon model) in which the surface shape of the face is represented by a set of many polygons on the display unit. ) Is displayed, and for each part such as eyes, nose, mouth of the face, one or two or more control points (for example, “bone”) set in each part are controlled. One or two or more first operation points for moving the control point) are displayed. When the operator who edits the face image operates the operation unit to designate the first operation point and performs an operation of moving the first operation point, the first operation point is based on the operation information. First movement information including the movement direction and the movement position is calculated.

  In addition, with respect to one or more control points that are linked to the movement of the first operation point designated by the operation unit, the first movement information calculated for the first operation point and each control point are set in advance. Based on the set interlocking conditions, second movement information including the movement position of each control point is calculated. Further, for one or more polygon vertices preset as polygon vertices linked to the movement of the control points, the second movement information calculated for the control points and the vertices of each polygon Based on the set interlocking condition, third movement information including the movement position of the vertex of each polygon is calculated.

  Then, in the standard face image displayed on the display unit, the first operation point designated by the operation unit is moved to the movement position included in the first movement information, and the third movement information is calculated. Further, the vertex of one or more polygons is moved to the movement position included in the third movement information, thereby changing the standard face image.

  As described above, according to the present invention, the operator can link one or more control points by moving the first operation point, so that compared with the conventional method of moving the control points. The efficiency of the face image editing work can be improved, and the editing time can be shortened.

  In addition, since the first operation point is linked to the other first operation points, for example, the first operation point provided on the eye and the first operation point provided on the eyebrows When the operation point is set in an interlocking relationship, when the operator moves the first operation point of the eye to change the shape of the eye, the first operation point of the eyebrows is changed to the first eye point of the eye. The shape of the eyebrows changes in conjunction with the operating point. Thereby, the shape of eyes and eyebrows can be changed with good balance.

  Further, in order to enlarge, reduce, move, or rotate the shape of each part as a whole, the first operation point for moving one or more first operation points set in each part is provided. 2 operation points are displayed. When an operator operates the operation unit to designate a second operation point and performs a predetermined operation on the second operation point, the second operation point is set to the set part 1 or For the two or more first operation points, the first movement information is calculated based on the movement conditions set at the first operation point and the operation information input from the operation unit, and the first operation point is calculated. The second movement information is calculated based on the first movement information and the movement condition set for the control point for a plurality of control points linked to the operation point. In addition, with respect to the vertex of the polygon that is interlocked with the movement of the control point, the third movement is performed based on the second movement information calculated for the control point and the interlocking condition that is preset for each vertex of the polygon. Information is calculated.

  Then, in the standard face image displayed on the display unit, the first operation point linked to the second operation point specified by the operation unit is moved to the movement position included in the first movement information, The vertex of one or two or more polygons for which the third movement information is calculated is moved to the movement position included in the third movement information, thereby changing the standard face image.

  For example, when a part movement operation point is displayed as the second operation point in the eye, if the operator designates the part movement operation point and moves the part movement operation point, the part movement operation point is set to the eye. For each of the plurality of first operating points, the first operating point is moved from the standard position by the same moving amount in the same direction as the operating point for moving the part based on the moving direction and moving amount of the moving part for moving the part. The moved position is calculated. In addition, the movement position is calculated for each of the control points linked to the first operation point and the vertices of the polygon linked to the control points.

  Then, in the standard face image displayed on the display unit, the first and second operation points move, and the polygonal vertex moves in conjunction with the movement, and the position of the eyes changes. Therefore, the operator can easily edit the eye into a desired shape without causing unbalance by simply operating the operation point for moving the part.

  In addition, when an operation point for part enlargement / reduction is displayed as the second operation point in the eye, when the operator designates the operation point for part enlargement / reduction and inputs an enlargement / reduction ratio, a plurality of points set for the eye For the first operation point, the standard distance from the operation point for part enlargement / reduction of each first operation point on the line connecting each first operation point and the operation point for part enlargement / reduction is changed by the input magnification. Each moving position at a distance is calculated. In addition, the movement position is calculated for each of the control points linked to the first operation point and the vertices of the polygon linked to the control points.

  Then, in the standard face image displayed on the display unit, the first operation point is moved, and the vertex of the polygon is moved in conjunction therewith, so that the entire eye is enlarged or reduced. Therefore, the operator can easily edit the eyes with large eyes and small eyes only by operating the operation points for part enlargement / reduction.

  Further, when a part rotation operation point is displayed as the second operation point in the eye, when the operator designates the part rotation operation point and rotates the part rotation operation point, it is set to the eye. For the plurality of first operation points, the movement direction and the movement position are calculated based on the rotation direction and rotation amount of the part rotation operation point and the movement condition set in advance for each first operation point. In addition, the movement position is calculated for each of the control points linked to the first operation point and the vertices of the polygon linked to the control points.

  Then, in the standard face image displayed on the display unit, the first operation point moves and the polygonal vertex moves in conjunction with the movement of the first operation point, thereby rotating the entire eye. Therefore, the operator can easily edit the shape so that the eyes are lifted or hung down simply by operating the operation point for rotating the part.

  In addition to the standard face image for editing the face image, the storage unit includes an animation including a face image for a plurality of frames for changing a predetermined part of the standard face image and causing the standard face to have a predetermined expression. When a face image for editing is included and a standard face image is edited, the face image after editing is automatically changed to a face image for animation editing. Therefore, when a face image for animation editing is reproduced, a predetermined expression can be given to the face image after editing, so that an operator can edit a standard face image for a face image for animation editing. It is not necessary to perform similar editing again, and the animation editing work can be reduced and the editing efficiency can be improved.

  In addition, even when editing the face image of that part of the multiple face images of animation editing, if the movement of the animation to the face image edited by face image editing is unnatural or uncomfortable, The face image for animation editing is provided with the third operation point and the fourth operation point that perform the same functions as the first operation point and the second operation point for face image editing, so that animation editing is easy. Can be done.

It is a block diagram which shows the basic composition of the face image editing apparatus with which the program for face image editing which concerns on this invention is performed. It is a figure which shows an example of the face image displayed on a display apparatus, when an operator selects the standard face image of a desired game character and instruct | indicates the edit process with respect to the face image. It is a figure for demonstrating the parameter for the interlock | linkage set to the polygon vertex linked | related with the bone, (a) is a figure which shows the angle and the movement ratio of the moving direction set as a parameter for a link to a polygon vertex. (B) is a figure which shows an example of the state which moved four polygon vertices in connection with the movement of a bone. An example of the part deformation | transformation marker provided in the site | part of eyes and eyebrows is shown, (a) is a figure which shows the state of the eye and eyebrows before moving the eye part deformation | transformation marker, (b) is for the same part deformation | transformation It is a figure which shows the state of the eye and eyebrows after moving a marker. It is a figure which shows an example of the data structure relationship between the part deformation | transformation marker provided in the face image, the bone | frame linked | related with the part deformation | transformation marker, and the polygon vertex linked | related with the bone. An example of the part movement marker provided in the eye part is shown, (a) is a diagram showing a state before the eye is moved by the eye part movement marker, and (b) is the eye by the part movement marker M. It is a figure which shows the state which moved the whole to the nose muscle side. It is a figure for demonstrating the moving direction and moving ratio which are set as a parameter for a link | linkage to the six site | part deformation | transformation markers linked | related with the eye region movement marker. It is a figure which shows an example of the magnification line displayed on a display screen as an input interface when designating a site | part expansion / contraction marker and enlarging or reducing the size of a site | part. An example of the part enlargement / reduction marker provided in the eye part is shown, (a) is a diagram showing a state before the eyes are enlarged by the eye part enlargement / reduction marker, and (b) is an eye view of the part enlargement / reduction marker. It is a figure which shows the state expanded. It is a figure for demonstrating the moving direction and moving ratio which are set as a parameter for a link | linkage to the six site | part deformation | transformation markers linked | related with the eye region expansion / contraction marker. An example of the part rotation marker provided in the eye part is shown, (a) is a diagram showing the state before the eye is rotated by the eye part rotation marker, (b) is the eye rotated by the part rotation marker It is a figure which shows the state which carried out. It is a figure for demonstrating the moving direction and moving ratio which are set as a parameter for a link | linkage to the six part deformation | transformation markers linked | related with the eye part rotation marker. It is a figure which shows an example of the part deformation | transformation marker for animation edit provided in the site | part of eyes and eyebrows. It is a flowchart which shows the process sequence of the face surface shape edit in face image editing.

  Hereinafter, a preferred embodiment of the present invention will be described in detail with reference to the drawings, taking as an example the case of editing the face shape of a humanoid character (hereinafter referred to as “game character”) to appear in a game. To do.

  FIG. 1 is a block diagram showing a basic configuration of a face image editing apparatus in which a face image editing program according to the present invention is executed.

  The face image editing apparatus 1 is configured by a computer system including a CPU (Central Processing Unit) 2, a ROM (Read Only Memory) 3, a RAM (Random Access Memory) 4, an external storage device 5, an input device 6, and a display device 7. The The ROM 3 stores an operation program and a face image editing program according to the present invention. The face image editing program includes a standard face editing program for editing a standard face surface shape into a desired shape, and an animation editing program for editing facial expressions for game character animation into desired expressions. A program is included.

  In the external storage device 5, data representing the standard face shape of the game character to be edited by the CPU 2 executing the standard face editing program (hereinafter referred to as “standard face image data”). ”) And animation data to be subjected to editing processing performed by the CPU 2 executing the animation editing program (“ laughing ”by changing the parts such as eyes and mouth of the standard face image of the game character) Data composed of images of surface shapes for a plurality of frames that cause various specific facial expressions such as “get angry” and “cry”. The external storage device 5 is provided with a storage area for storing a predetermined number of face image data and animation data after editing. When face image data or animation data is edited, Are stored in the external storage device 5.

  The standard face image data is not data of the face image itself displayed on the display device 7, but the surface shape of the face is expressed by a surface model by polygon modeling, and the surface model is placed in the XYZ coordinate system to display each polygon ( A polygon (a portion indicated by a triangle in FIG. 2) is composed of a set of position data of a large number of polygon vertices obtained from position coordinates of vertices (hereinafter referred to as “polygon vertices”). In the present embodiment, as described later, as a face image editing function, a plurality of bones are set for each part of the face, and a plurality of polygon vertices are moved in conjunction with the movement of each bone. Since the operator sets a plurality of markers as operation points for moving the bones and polygon vertices and moves one or more bones according to the operation contents for each marker, standard face image data is provided. Includes the position data of a plurality of bones and a plurality of markers.

  Therefore, when displaying the standard face image of the game character on the display device 7, a three-dimensional shape image representing the surface shape of the face is generated based on the standard face image data and the plain texture attached to each polygon. Processing is performed, and a three-dimensional shape image as a result of the processing is displayed on the display device 7.

  The same applies to animation data. The face image of each frame is a set of position data of a large number of polygon vertices, a plurality of bones, and a plurality of markers. Since the animation image is an image representing the movement of a specific part of the face image, the face image data of each frame is the first of the polygon vertices constituting the specific part and the positions of bones and markers provided in the part. The data is moved with respect to the position in the face image of the frame. Therefore, when displaying an animation image on the display device 7, the face three-dimensional shape image is based on the face image data of each frame and the plain texture pasted on each polygon in a predetermined cycle (for example, 1/30 second). Is generated (animation data reproduction processing), and the three-dimensional shape image of each frame, which is the processing result, is sequentially displayed on the display device 7.

  Since the animation image prepared in advance is created based on the standard face image, when the standard face is modified by editing, the face image data of the first frame of the animation image is converted to the face image data after deformation. By changing to, it is possible to make the movements similar to the movements set in advance for the parts such as the eyes and the mouth of the deformed face image by the reproduction process of the animation data.

  Therefore, in the present embodiment, when editing is performed to deform a standard face image, the face image data of the first frame of the animation data is automatically changed to the face image data after the deformation, or a moving part. The editing contents of the standard face image can be reflected in the animation image only by changing the movement amount of each marker or bone in accordance with the editing contents of the standard face image.

  On the other hand, an animation image reflecting the edited content of a standard face image is not always appropriate, and sometimes an unnatural movement is caused. In such a case, it is necessary to edit the face image of the frame that is unnatural. The animation editing program is for editing such animation data, and is provided mainly for animation creators.

  The input device 6 is a device for inputting information necessary for processing performed by the operator to the CPU 2, and includes, for example, a keyboard and a mouse. The display device 7 is a device for displaying information related to processing executed by the CPU 2, and is configured by a CRT, a liquid crystal display, or the like. In addition, you may comprise the input device 6 and the display apparatus 7 with a touch panel.

  When the editing operation of the face of the game character is instructed from the input device 6 by the operator's operation, the CPU 2 reads the standard face editing program from the ROM 3 into the RAM 4 and reads out the standard face image data of the game character from the external storage device 5. Is read into the RAM 4. Further, the CPU 2 generates a three-dimensional shape image representing the surface shape of the face based on the standard face image data read out to the RAM 4 and the texture attached to the polygon, and causes the display device 7 to display the three-dimensional shape image. Thereafter, the CPU 2 performs a process of deforming the face surface shape according to the standard face editing program based on the operation information input from the input device 6 by the operator's operation, and outputs the processing result to the display device 7 for display. The surface shape of the face of the game character displayed on the device 7 is changed. Then, the CPU 2 stores the processing result of the editing process stored in the RAM 4 in the external storage device 5 when an instruction to end the editing process of the face of the game character is given from the input device 6 by the operator's operation.

  When an input of the animation device is instructed from the input device 6 by the operator's operation, the CPU 2 reads the animation editing program from the ROM 3 to the RAM 4 and reads the animation data from the external storage device 5 to the RAM 4. In addition, the CPU 2 determines the surface of the face of the frame based on the surface shape data of the face of the frame input from the input device 6 by the operator's operation and the texture attached to the polygon from the animation data read out to the RAM 4. A three-dimensional shape image representing the shape is generated, and the three-dimensional shape image is displayed on the display device 7. Thereafter, the CPU 2 performs a process of deforming the surface shape of the face according to the animation editing program based on the operation information input from the input device 6 by the operator's operation, and outputs the processing result to the display device 7. 7 changes the surface shape of the face of the game character displayed on the screen. The CPU 2 saves the processing result of the editing process stored in the RAM 4 in the external storage device 5 when the input operation is instructed by the operator to end the editing process of the face for animation editing of the game character. To do.

  Next, a game character face image editing method executed by the face image editing program according to the present invention will be described.

  The face shape editing according to the present invention includes a mode for editing the face shape of the standard model of the game character (face image editing mode) and a mode for editing the face shape of the face of the designated frame of the animation image (animation). Edit mode). The face image editing mode is an editing mode performed using the standard face image data of the game character stored in the external storage device 5, and the animation editing mode is an editing performed using animation data stored in the external storage device 5. Mode.

  As described above, in this embodiment, when a standard face image is edited in the face image editing mode, the edited content is automatically reflected in the animation data created with the standard face image. Can be displayed on the display device 7 as an animation image for the edited face image. Therefore, if there is no particular problem with the animation image for the edited face image, it is not necessary to perform the same editing operation as that performed in the face image editing mode on the animation data. For example, the size of the part is changed. Thus, when the movement is unnatural or the shape of the moving part is uncomfortable, the frame of that part is edited again. The editing operation for the face image of each frame in this case is basically the same as the editing operation performed in the face image editing mode.

  FIG. 2 shows that an operator operates the input device 6 to select a desired face image from standard face images of a plurality of types of game characters stored in the external storage device 5, and edits the face image. It is a figure which shows an example of the face image displayed on the display apparatus 7 when commanding.

  First, the contents of the editing process in the face image editing mode will be described.

  As shown in FIG. 2, the face image of the game character for face image editing is represented by a three-dimensional shape image of a surface model by polygon modeling. The face surface shape is changed by moving the polygon vertex. For this reason, an XYZ orthogonal coordinate system is set in the editing space of the face shape of the face as shown in the lower left of the figure. The XYZ coordinate system is a coordinate system in which the left and right direction is the X axis, the vertical direction is the Y axis, and the front and rear direction is the Z axis when the game character's face is viewed from the front. The X axis, the Y axis, and the Z axis are the + direction in the right direction, the upward direction, and the backward direction, respectively. When a face image in front view is displayed on the display screen 7a of the display device 7, the horizontal direction of the display screen 7a is the X axis, the vertical direction is the Y axis, and the direction perpendicular to the screen is the Z axis.

A polygon number for identification and coordinates in the XYZ coordinate system are set for a large number of polygon vertices constituting the surface shape of the face. In the following description, the symbol of the polygon vertex is “P”, and when a plurality of polygon vertices P are identified by the polygon number j, “P (j)” is described. The position coordinates in the XYZ coordinate system are represented by (X, Y, Z), and each coordinate is described with a suffix indicating what position coordinate it is. Therefore, the position coordinates of the polygon vertex P are expressed as “(X _p , Y _p , Z _p )” (subscript “p” indicates the polygon vertex P), and the position coordinates of the plurality of polygon vertices P are represented by the polygon number j. Is identified by “(X _pj , Y _pj , Z _pj )” (subscript “j” indicates a polygon number). This notation method is the same for the position coordinates of bones and markers described later.

In face image editing, it is difficult to individually move a large number of polygon vertices P and transform the surface shape of the face image into a desired shape. Therefore, as shown in FIG. A control point called “bone” for controlling the position of the polygon vertex P is provided. FIG. 4A is an enlarged view of the left eye part of the face image shown in FIG. 2. In FIG. 4B, the bone code is “B” and the bone B with the bone number i is “B ( i) ". Each bone B (i) (i = 1, 2,..., 8) is linked to one or more polygon vertices P (j) associated with the bone B (i) in conjunction with the movement of the bone B (i). It performs the function of moving. Position coordinates (X _bi , Y _bi , Z _bi ) of the XYZ coordinate system are also set for each bone B (i). Note that the subscript “b” of each position coordinate indicates the position coordinate of the bone B, and “i” indicates the bone number.

As shown in FIG. 3A, the polygon vertex P (j) associated with the bone B (i) has a moving direction N _bi of the bone B (i) when the bone B (i) moves. The reference moving direction θ _pjbi (angle) and the magnification K _pjbi of the moving amount of the polygon vertex P (j) with respect to the moving amount D _bi of the bone B (i) are set as parameters for interlocking.

The subscripts “b” and “i” of the symbols “N _bi ” and “D _bi ” indicate “bone” and “bone number”, respectively, and “bi” relates to the bone B having the bone number i. Is shown. The subscripts “p”, “j”, “b”, and “i” of the symbols “θ _pjbi ” and “K _pjbi ” are “polygon vertex”, “polygon number”, “bone”, and “bone number”, respectively. , Indicating that the parameter is related to the polygon vertex P (j) of the polygon number j associated with the bone B (i) of the bone number i. This notation method for subscripts is the same for the movement direction and the magnification of the movement amount (hereinafter referred to as “movement magnification”) of the part deformation marker described later.

Therefore, as shown in FIG. 3B, four polygon vertices P (j), P (j + 1), P (j + 2), and P (j + 3) are surrounded by bone B ( i), for example, if the bone B (i) is moved in the N _bi direction (right direction in FIG. 3B) by the distance D _bi , the polygon vertex P (j) becomes the N _bi direction. On the other hand, for example, the distance D _pjbi = D _bi × K _{pjbi is} moved in the direction opened by the angle θ _pjbi on the left side. The same applies to the other polygon vertices P (j + 1), P (j + 2), and P (j + 3). For example, the polygon vertex P (j + 1) has an angle to the left with respect to the N _bi direction. A distance D _{p (j + 1) bi} = D _bi (i) × K _{p (j + 1) bi is} moved in the direction opened by θ _{p (j + 1) bi} , and the polygon vertex P (j + 2) is , _Move to the right side with respect to the N _bi direction by an angle θ _{p (j + 2) bi and} move by a distance D _{p (j + 2) bi} = D _bi × K _{p (j + 2) bi} P (j + 3) is a distance D _{p (j + 3) bi} = D _bi × K _{p (j + 3) in} a direction opened by an angle θ _{p (j + 3) bi} on the right side with respect to the N _bi direction. Move by _bi . In FIG. 3B, P (j) ′, P (j + 1) ′, P (j + 2) ′, and P (j + 3) ′ are polygon vertices P (j) and P (j + 1). , P (j + 2), P (j + 3) are moved positions.

The moving directions θ _pjbi and θ _{p (j} of the four polygon vertices P (j), P (j + 1), P (j + 2), and P (j + 3) accompanying the movement of the bone B (i). _{+1) bi, θ p (j} + 2) bi, θ p (j + 3) bi and the mobile magnification _{K pjbi, K p (j +} 1) bi, K p (j + 2) bi, K p (j _{+3) bi} is set in advance by a programmer who creates standard face image data so as not to unnaturally change the shape of the entire region including the bone B (i). Further, in the calculation of the movement positions of the polygon vertices P (j), P (j + 1), P (j + 2), and P (j + 3), the calculation is performed separately for the X, Y, and Z coordinate axis components. Done. Accordingly, _assuming that the position coordinates of the polygon vertex P (j) before the movement are (X _pj , Y _pj , Z _pj ) and the position coordinates after the movement are (X _pj ′, Y _pj ′, Z _pj ′), D _pjbi = D _bi × K _pjbi = √ {(X _pj '-X _pj ) ² + (Y _pj ' -Y _pj ) ² + (Z _pj '-Z _pj ) ² }. The same applies to the other polygon vertices P (j + 1), P (j + 2), and P (j + 3).

Each bone B (i) includes the coordinate data (X _bi , Y _bi , Z _bi ), the polygon number j of the associated polygon vertex P (j), and the parameters for linking the polygon vertex P (j). (Θ _pjbi , K _pjbi ) data. Accordingly, in the data storage area of the bone B of the external storage device 5 or the RAM 4, the position coordinates (X _bi , Y _bi , Z _bi ), (X _bi ′, Y _bi ′, Z _bi ′) of each bone B (i) are stored. ) And the polygon number j of the associated polygon vertex P (j) and the parameters (θ _pjbi , K _pjbi ) for linking the polygon vertex P (j) are stored.

  The data structure of the face image in which a number of bones B are set in the face image described above is the same as the basic data structure of the face image editing method by conventional bone editing. Conventionally, each bone B is set as an operation point for moving a plurality of polygon vertices P together. However, in face image editing according to the present invention, a plurality of types of markers are provided above the bone B, and It is configured to function as an operating point for moving one or more bones B.

  Therefore, in the face image editing according to the present invention, when the operator inputs predetermined operation information regarding the movement of the bone B to the marker (corresponding to the first and second operation points according to the present invention) from the input device 6. And automatically moving one or more bones B (corresponding to “control points” according to the present invention) associated with the marker based on the operation information, and a plurality of polygon vertices associated with each bone B The basic configuration is a configuration that automatically controls the position of P (corresponding to “polygonal vertex” according to the present invention).

  The marker is associated with another marker provided in an adjacent part, and when the other marker moves, there is a marker that moves in conjunction with the movement. This is because, for example, when the shape of an eye changes due to the movement of a marker provided on the eye, the shape of the eyebrow over the eye does not change according to the change in the shape of the eye. Since the shape becomes unbalanced and it is not easy to move the eyebrow marker alone to match the shape of the eyebrow with the eye shape change, the eye marker is associated with the marker provided on the eye, The eyebrow marker is moved in conjunction with the movement.

  The same situation applies to, for example, a marker provided on the lower lip of the mouth and a marker provided on the chin, a marker provided on the upper lip of the mouth and a marker provided on the nose, and the like. Therefore, in the face image editing according to the present invention, when the shape of one part changes in an adjacent part, the shape of the other part also changes in conjunction with the change, and the part of each part is deformed. There is also a configuration in which the markers for movement are linked to each other and the marker for deformation of the part of the other part is moved in conjunction with the movement of the marker for deformation of the part of one part.

  In this embodiment, four types of markers for face image editing are set for each part. In the following description, the signs of the four types of markers are “H”, “M”, “E”, and “R”. For example, for marker H, marker H with marker number i is represented as “H (i)”. To do. The same applies to the markers M, E, and R, and the markers M, E, and R of the marker number i are expressed as “M (i)”, “E (i)”, and “R (i)”. The four types of markers H, M, E, and R are displayed with marks having different shapes and sizes so that the types can be identified. For example, the marker H is a circle, the marker M is a circle of a different size and color from the marker H, the marker E is a quadrangle, the marker R is a triangle, and the like.

Among the four types of markers H, M, E, and R, the marker H is an edit that moves a part of one or two or more bones B in an arbitrary direction in order to partially deform the shape of the part. This is a marker for operation (corresponding to a “first operation point” according to the present invention, hereinafter referred to as “part deformation marker”). The part deformation marker H changes the shape of a part of the part by moving one or more bones B associated with the part deformation marker H in conjunction with the movement of the part deformation marker H. Perform functions. Position coordinates (X _hi , Y _hi , Z _hi ) of the XYZ coordinate system are also set for the part deformation marker H (i). Note that the suffix “h” of each coordinate indicates the part deformation marker H, and “i” indicates the marker number of the part deformation marker H.

  FIG. 4 shows an example of a part deformation marker H provided at the eye and eyebrows, and FIG. 4A is a diagram showing the state of the eye and eyebrows before the eye part deformation marker H is moved. (A) is a figure which shows the state of the eye and eyebrows after moving the same part deformation | transformation marker H. FIG. In order to avoid complexity of the drawing, the polygon is omitted in FIG. 4 and only the bone B and the part deformation marker H are drawn.

  In the example of FIG. 4, the circular part deforming markers H (1), H (2), H ( 3), H (4), H (5), and H (6) are provided. The part deforming markers H (2) and H (3) are provided at positions that divide the upper deformed part deforming marker H (1) and the part deforming marker H (4) into approximately three equal parts. The markers H (5) and H (6) are provided at positions that divide the lower eyelid part deformation marker H (1) and the part deformation marker H (4) into approximately three equal parts. The six part deforming markers H (i) (i = 1, 2,..., 6) are respectively the six bones B (i) (i = 1, 2,..., 6) shown in FIG. It is provided at the same position as the position.

Further, each bone B (i) (i = 1, 2,..., 6) is associated only with the part deformation marker H (i) provided at the same position, and each bone B (i) has a part. The interlocking parameters are set so as to move to the same position in accordance with the movement of the deformation marker H (i). That is, _assuming that the movement direction with respect to the part deformation marker H (i) set to the bone B (j) of the bone number j is θ _bjhi and the movement magnification is K _bjhi , the bone B (i) has parameters for interlocking. The moving direction θ _bihi = 0 ° and the magnification K _bihi = 1.0 are set. The subscripts “b”, “i”, “h”, and “i” of “θ _bjhi ” and “K _bjhi ” are “bone”, “bone number”, “part deformation marker”, and “marker number”, respectively. Is shown.

Two part deformation markers H (7) and H (8) are provided on the eyebrows. The eyebrows are provided with a bone H (7) at the portion of the eyebrow head and a bone H (8) at a position substantially above the eye part deformation marker H (3). H (7) is provided at the same position as bone B (7), and the part deformation marker H (8) is provided at the same position as bone B (8). The bone B (7) is associated only with the part deformation marker H (7), and the bone B (8) is associated only with the part deformation marker H (8). Therefore, the movement directions θ _b7h7 and θ _b8h8 of “0 °” and the movement magnifications K _b7h7 and K _{b8h8 of} “1.0” are set as parameters for interlocking in the bones B (7) and B (8). .

In the data storage area of the part deformation marker H (i) (i = 1, 2,... 8) associated with the bone B (i) (i = 1, 2,... 8) of the external storage device 5 or RAM 4. , Position coordinates (X _hi , Y _hi , Z _hi ), (X _hi ', Y _hi ', Z _hi ') before and after the movement of each part deformation marker H (i) and the associated bone B The data of the bone number i of (i) and the parameters (θ _bihi , K _bihi ) for linking the bone B (i) are stored.

The contents of the moving direction theta _Bjhi the mobile magnification K _Bjhi set in bone B (j) as a parameter for interlocking for site variant marker H (i) is the moving direction theta _Pjbi shown in FIGS 3 and magnification Since it is the same as K _pjbi , detailed description is omitted here.

  In the example of the eyes and eyebrows shown in FIG. 4, when the part deformation marker H (i) (i = 1, 2,..., 8) is moved, only the bone B (i) is combined with the part deformation marker H (i). Since it moves, the operation for moving the part deformation marker H (i) is substantially the same as the operation for directly moving the conventional bone B (i). It is also possible to reduce the number, associate a plurality of bones B with some of the part deformation markers H, and simultaneously move the plurality of bones B according to the movement of the part deformation markers H.

For example, a part deformation marker H (9) provided with two part deformation markers H (2), H (3) on the upper eyelid at the approximate center of the upper eyelid (marker H indicated by a dotted line in FIG. 4A) (Refer to (9)) and two part deformation markers H (4), H (5) of the lower eyelid are provided at the approximate center of the lower eyelid H (10) (FIG. 4 (a )), Replace bones B (2) and B (3) with the part deformation marker H (9), and convert bones B (5) and B (6) to part deformation. It may be related to the marker H (10) for use. In this case, the bones B (2) and B (3) have the movement direction θ _b2h9 , the movement magnification K _b2h9 , the movement direction θ _b3h9 , and the movement magnification, respectively, as parameters for linking the associated part deformation marker H (9). K _b3h9 is set, and the bones B (5) and B (6) have the movement direction θ _b5h10 , the magnification K _b5h10 , the movement direction θ _b6h10 , and the magnification, respectively, as interlocking parameters for the associated part deformation marker H (10). K _b6h10 is set. The moving directions θ _b2h9 , θ _b3h9 , θ _b5h10 , θ _b6h10 are all set to appropriate values other than “0 °”, and the moving magnifications K _b2h9 , K _b3h9 , K _b5h10 , K _b6h10 are all “1.0”. An appropriate value that is not "" is set.

  In this case, since bone B (1) and bone B (4) are associated only with the part deformation marker H (1) and the part deformation marker H (4), respectively, the part deformation marker H (1). Or, when the part deformation marker H (4) is moved, only the bone B (1) of the eye or the bone B (4) of the corner of the eye moves, but if the part deformation marker H (9) is moved, the upper eyelid When the bone B (2) and bone B (3) provided in FIG. 2 move in conjunction with each other and the part deformation marker H (10) is moved, the bone B (5) and bone B ( 6) will move in conjunction.

  Returning to FIG. 4, when editing the shape of the eye with the part deformation markers H (1) to H (6), if the shape of the eyebrows on the eye does not change as the eye changes, The face becomes unnatural. When editing the eye with the part deformation markers H (1) to H (6) and editing the eyebrows with the part deformation markers H (7) and H (8) independently, the eyes and the eyebrows are unnatural. Therefore, in this embodiment, for example, two part deformation markers H (7) and H (8) set on the eyebrows are respectively replaced with the eye part deformation markers H ( 2) When the eye part deformation markers H (2) and H (3) move in association with H (3), the eyebrow part deformation markers H (7) and H (8) are linked to the movement. To move.

Accordingly, the movement direction θ _h7h2 and the movement magnification K _h7h2 are set in the part deformation marker H (7) as parameters for interlocking with the part deformation marker H (2), and the part deformation marker H (8) has a part. The movement direction θ _h8h3 and the movement magnification K _h8h3 are set as parameters for interlocking with the deformation marker H (3). The subscripts “h”, “7”, “h”, and “2” of “θ _h7h2 ” and “K _h7h2 ” are “part deforming markers provided on the eyebrows” and “parts provided on the eyebrows, respectively. “Marker number of deformation marker”, “Partial deformation marker provided in eye”, and “Marker number of partial deformation marker provided in eye” are shown. _"Θ h8h3", _"K h8h3" subscript "h", "8", "h", "3" is also _"θ h7h2", subscript of _"K h7h2", "h", "7", "h ”And“ 2 ”.

In the data storage area of the part deformation markers H (2) and H (3) of the external storage device 5 and the RAM 4, the position coordinates (X _h2 ) before the movement of each part deformation marker H (2) and H (3) are stored. , Y _h2 , Z _h2 ), (X _h3 , Y _h3 , Z _h3 ) and position coordinates after movement (X _h2 ′, Y _h2 ′, Z _h2 ′), (X _h3 ′, Y _h3 ′, Z _h3 '), And the associated part modification markers H (7) and H (8), the marker numbers 7 and 8 and the parameters for interlocking the part modification markers H (7) and H (8) (θ _h7h2 , K _h7h2 ), (θ _h8h3 , K _h8h3 ) are stored.

Moving direction theta _H7h2 the mobile magnification K _H7h2 or site modifications marker H (8) in a portion deformed marker H is set as a parameter for the interlocking for site variant marker H (7) in a portion deformed marker H (2) The contents of the movement direction θ _h8h3 and the movement magnification K _h8h3 set as parameters for linking to (2) are also the same as the movement direction θ _pjbi and magnification K _pjbi shown in FIG. Is omitted.

  The part deformation marker H (7) is associated with both the eye part deformation markers H (1) and H (2), and the part deformation marker H (8) is associated with the eye part deformation marker H (3). , H (4) may be associated with each other.

  FIG. 5 is a diagram illustrating an example of a data structure relationship between a part deformation marker H provided in a face image, a bone B associated with the part deformation marker H, and a polygon vertex P associated with the bone B. is there. This figure shows the part deformation marker H (3) and the part deformation marker H (3) among the part deformation markers H (1) to H (8) provided on the eyes and eyebrows shown in FIG. The data structure relationship between the bone B (3) and the part deformation marker H (8) associated with the polygon vertex P associated with the bone B (3) and the part deformation marker H (8), respectively. Show.

  As shown in FIG. 5, the bone B (3) and the part deformation marker H (8) associated with the part deformation marker H (3) are arranged in a tree structure below the part deformation marker H (3). A plurality of polygon vertices P (t), P (t + 1),..., P (t + n) (t, t + 1,... T + n are polygon numbers) associated with the bone B (3) are bone B ( It is arranged in a tree structure under 3). Also, since bone B (8) is associated with the part deformation marker H (8), the bone B (8) is arranged in a tree structure below the part deformation marker H (3) and below it. A plurality of polygon vertices P (s), P (s + 1),..., P (s + m) (s, s + 1,... S + m are polygon numbers) associated with the bone B (8) are arranged in a tree structure. ing.

  Part deformation markers H (3), H (8), bones B (3), B (8), polygon vertices P (s), P (s + 1), ..., P (s + m) and polygon vertices P (t), P (t + 1),..., P (t + n) each have position coordinates indicating the current position. When the operator operates the input device 6 to move the position of the part deformation marker H (3) displayed on the display device 7, the position coordinate of the part deformation marker H (3) changes, and the change is caused. In conjunction with this, the position coordinates of the part deformation marker H (8) and the bones B (3), B (8) change.

For example, the current position coordinate of the part deformation marker H (3) is (X _h3 , Y _h3 , Z _h3 ), and the current position coordinate of the part deformation marker H (8) is (X _h8 , Y _h8 , Z _h8 ), bone B (3) is at the same position as the part deformation marker H (3), and bone B (8) is at the same position as the part deformation marker H (8). ) And B (8) are (X _h3 , Y _h3 , Z _h3 ) and (X _h8 , Y _h8 , Z _h8 ), respectively.

When the operator operates the input device 6 to move the part deformation marker H (3) downward from the current position on the Y axis, the CPU 2 operates information (for example, the input device 6 is input from the input device 6). In the case of a mouse, the amount of movement D _h3 on the display screen 7a is calculated based on the information on the amount of movement of the mouse, and the position coordinates of the part deformation markers H (3) and H (8) are (X _h3 , Y _h3− D _h3 , Z _h3 ) and (X _h8 , Y _h8 −D _h3 , Z _h8 ). Further, CPU 2 is bone B (3), to change the position coordinates of B (8), respectively _{(X b3, Y b3 -D h3} , Z b3) and _{(X b8, Y b8 -D h3} , Z b8). As a result, the display positions of the part deformation markers H (3) and H (8) and the bones B (3) and B (8) on the display device 7 are changed. The subscript “h” of the movement amount D _h3 indicates the part deformation marker H, and the subscript “3” indicates the marker number of the part deformation marker H.

Further, the CPU 2 links each polygon vertex P (t + k) with respect to a plurality of polygon vertices P (t + k) (k = 0, 1,..., N) associated with the bone B (3). The movement position of each polygon vertex P (t + k) is calculated using the parameters for use, the movement direction N _b3 and the movement amount D _b3 of the bone B (3), and the position coordinates are changed using the calculation result. Similarly, for interlocking each polygon vertex P (s + k) with respect to a plurality of polygon vertices P (s + k) (k = 0, 1,..., M) associated with the bone B (8). The movement position of each polygon vertex P (s + k) is calculated using the parameter, the movement direction N _b8 and the movement amount D _b8 of the bone B (8), and the position coordinates are changed using the calculation result. As a result, the display positions of the polygon vertex P (t + k) and the polygon vertex P (s + k) on the display device 7 change, and the shapes of the eyes and eyebrows change.

  Returning to FIG. 4, the eye editing operation using the part deformation marker H will be described.

  Although not shown in FIG. 4, a cursor is displayed on the display screen 7 a of the display device 7, and the operator operates the input device 6 to move the cursor to the position of the desired part deformation marker H (i). When the predetermined operation is performed, the part deformation marker H (i) can be moved to a desired position by the cursor. For example, when the input device 6 is a mouse, the operator moves the cursor to the position of the desired part deformation marker H (i), then performs a left click, maintains the clicked state, and moves the mouse in the desired direction. It is possible to move the part deformation marker H (i) together with the cursor in a desired direction. When the operator cancels the left click operation at a desired position, the part deformation marker H (i) can be fixed at that position.

Alternatively, the part deformation marker H (i) may be designated by the input device 6 and the movement direction N _hi and the movement amount D _hi of the part deformation marker H (i) may be input by key operation.

FIG. 4B shows that the operator moves the eye part deformation markers H (3), H (4), and H (5) from the state of FIG. When moved (the movement directions N _h3 , N _h4 , N _h5 of the part deformation markers H (3), H (4), H (5) are the downward directions of the Y axis, and the movement amounts D _h3 , D _h4 , ( _Dh5 is _Dh3 = _Dh4 = _Dh5 = Dh), and changes in the shape of the eyes and eyebrows are shown. 3 bones B (3), B (4), B (5) as the position of the 3 part deformation markers H (3), H (4), H (5) moves down Since the position of the polygon apex P associated with each of the bones B (3), B (4), and B (5) is changed, the position of the eye corner is lowered. It has changed to a shape that hangs to the side.

  Further, the part deformation marker H (8) set on the eyebrows is associated with the part deformation marker H (3) set on the eyes, so the part deformation marker H (3) moves downward. Then, the part deformation marker H (8) set on the eyebrows is moved downward in conjunction therewith. When the part deformation marker H (8) moves downward, the bone B (8) associated with the part deformation marker H (8) also moves to the same position as the part deformation marker H (8). As a result, the positions of the plurality of polygon vertices P associated with the bone B (8) are changed, and the eyebrows are also changed to a shape in which the corners of the eyes hang down.

In the example of FIG. 4B, the movement magnification K _h8h3 of the part deformation marker H (8) associated with the part deformation marker H (3) is set to “0.5”. The marker H (8) moves downward by a movement amount Dh × 0.5 with respect to the movement amount Dh of the part deformation marker H (3). In the example of FIG. 4B, since only the part deformation marker H (8) is linked to the part deformation marker H (3), the shape of the eyes becomes excessively triangular, giving an unnatural feeling. However, the part deformation marker H (7) is linked to the part deformation marker H (3), and the movement magnifications K _h7h3 and K _h8h3 of both the part deformation markers H (7) and H (8) are adjusted. Thus, an unnatural shape change can be alleviated.

  As described above, when any one of the six part deformation markers H (i) (i = 1, 2,..., 6) is moved, 1 or 1 associated with the part deformation marker H (i) Since two or more bones B (j) can be moved in conjunction with the movement of the part deformation marker H (i), the shape of the eye can be easily deformed.

  In addition, the part deformation markers H (7) and H (8) set on the eyebrows are associated with the eye part deformation markers H (2) and H (3), respectively, and the eye part deformation markers H (2). , H (3) is moved in conjunction with the movement of the eyebrow part deformation marker H (7), H (8), so the eyebrow position closely related to the eye position is moved in a balanced manner. Can be made.

The marker M is a marker for performing an editing operation for moving the entire part (corresponding to a “second operation point” according to the present invention, hereinafter referred to as “part movement marker”). The part movement marker M fulfills a function of moving the whole part by moving a plurality of part deformation markers H set in the part at once. Position coordinates (X _mi , Y _mi , Z _mi ) in the XYZ coordinate system are also set for each part movement marker M (i). The subscript “m” of each coordinate indicates the part movement marker M, and “i” indicates the marker number of the part movement marker M.

  Only one part movement marker M is provided at a position representing the part (usually the center position of the part image), and a plurality of part deformation markers H provided in the part are associated with the part movement marker M. It has been. When the position of the part moving marker M is moved, the plurality of part deforming markers H set in the part are moved in the moving direction of the part moving marker M, thereby moving the whole part.

  FIG. 6 shows an example of the part movement marker M provided in the eye part. FIG. 6A shows a state before the entire eye is moved by the eye part movement marker M, and FIG. It is a figure which shows the state which moved the whole eye to the nose muscle side with the part movement marker M. FIG. In the same figure, polygons are omitted, and only the bone B and the part moving marker M are drawn.

  In the example of FIG. 6, since the eye is moved as a whole, only one part moving marker M is provided at the position of the pupil of the eye. In the example of FIG. 6, the part movement marker M (1) is also displayed as a circular mark in the same manner as the part deformation markers H (1) to H (6). It is larger than the part deformation markers H (1) to H (6) and has a different color. The six part deformation markers H (1) to H (6) are associated with the part movement marker M (1).

Since the part moving marker M (1) functions to move the entire eye, the part moving marker M (1) is added to the six part deforming markers H (i) (i = 1, 2,... 6). As shown in FIG. 7, the movement direction θ _him1 (i = 1, 2,... 6) provided as a parameter for interlocking with is set to a value close to “0 °” or “0 °”, respectively. A value close to “1.0” or “1.0” is set for each magnification K _him1 (i = 1, 2,... 6). That is, the six part deformation markers H (1) to H (6) move in substantially the same direction by the same amount by the movement direction θ _m1 and the movement amount D _m1 of the part movement marker M (1). Parameters for interlocking the respective part deformation markers H (1) to H (6) are set. In FIG. 7, M (1) ′ and H (1) ′ to H (6) ′ are positions where the part movement marker M (1) and the part deformation markers H (1) to H (6) have moved. is there.

The subscripts “m” and “1” of “θ _m1 ” and “D _m1 ” indicate “part movement marker M” and “marker number of part movement marker M”, respectively. The subscripts “h”, “i”, “m”, and “1” of “θ _him1 ” and “K _him1 ” are “part modification marker H”, “part modification marker H marker number”, “Part movement marker M” and “marker number of part movement marker M” are shown.

In the data storage area of the part movement marker M (1) in the external storage device 5 or the RAM 4, the position coordinates (X _m1 , Y _m1 , Z _m1 ) before the movement of the part movement marker M (1) and after the movement are stored. Position coordinate (X _m1 ′, Y _m1 ′, Z _m1 ′) and the associated parameter (θ _him1 ) of the marker number i of the part modification marker H (i) and the part modification marker H (i) , K _him1 ) (i = 1, 2,... 6) is stored.

  The relationship between the data structure of the part movement marker M (1) and the six part deformation markers H (1) to H (6) is the same as the data structure shown in FIG. Since it is the same as the relationship of the tree structure of the marker H (8), its description is omitted.

In the state shown in FIG. 6A, the operator operates the input operation 6 to move the part movement marker M (1) rightward (in the direction approaching the nose of the face along the X axis) by the movement amount D _m1. Then, the six part deforming markers H (1) to H (6) are moved in the right direction substantially by the movement amount D _m1 from the standard position (the position of FIG. _6A ). As the six part deformation markers H (1) to H (6) move, the bones B (1) to B (6) associated with the respective part deformation markers H (1) to H (6) respectively. Along with the movement, the plurality of polygon vertices P associated with the bones B (1) to B (6) also move in conjunction with each other. As a result, as shown in FIG. 6B, the eyes approach the nose muscles as a whole.

In the example of FIG. 6, the part deformation marker H (7) and the part deformation marker H (8) provided on the eyebrows are respectively replaced with the eye part deformation marker H (2) and the part deformation marker H (3 ), The movement directions θ _h7h2 and θ _h8h3 of the parameters for linking the part deformation marker H (7) and the part deformation marker H (8) are “0 °”, and the magnifications K _h7h2 and K _h8h3 are “1”. .0 ”, the eyebrow part deforming marker H (7) and the part deforming marker are linked to the rightward movement of the part deforming marker H (2) and the part deforming marker H (3). Marker H (8) has also moved to the right by the same amount of movement.

Therefore, the operator easily moves the eyes of the face image closer to the nose muscles by shortening the distance between the eyes by performing an operation of moving the region movement marker M toward the nose muscles with respect to the eyes on the right side of the nose muscles. be able to. Note that the information (position coordinate information) of the standard position of the part movement marker M (1) (position of FIG. 6 (a)) and the position after movement (position of FIG. 6 (b)) is saved. The operator can confirm the operation information (information on the moving direction θ _m1 and the moving amount D _m1 ) of the part moving marker M (1) from the coordinates of both positions.

The marker E is a marker for performing an editing operation for enlarging or reducing the entire region (corresponding to a “second operation point” according to the present invention; hereinafter referred to as a “region expansion / contraction marker”). The part expansion / contraction marker E fulfills the function of expanding or reducing the shape of the part by moving a plurality of part deformation markers H set in the part radially with respect to the part expansion / contraction marker E. Position coordinates (X _ei , Y _ei , Z _ei ) of the XYZ coordinate system are also set for each part enlargement / reduction marker E (i). The subscript “e” of each coordinate indicates the part enlargement / reduction marker E, and “i” indicates the marker number of the part enlargement / reduction marker E.

  Only one part enlargement / reduction marker E is provided inside a plurality of part deformation markers H set for the part, and the plurality of part deformation markers H are associated with the part enlargement / reduction marker E. In the part enlargement / reduction marker E, a ratio (enlargement / reduction ratio) to be changed with respect to the part size (standard size) in the standard image can be set, and “1.0” is set by default. In the present embodiment, a plurality of enlargement / reduction ratios (for example, 0.3, 0.5, 0.7, 1.0, 1.3, 1.5, 1.7, 2.0) are applied to the part enlargement / reduction marker E in advance. If the operator places a cursor on the part enlargement / reduction marker E and performs a click operation, the enlargement / reduction ratio set for the part enlargement / reduction marker E is cyclically set for each click operation. Thus, the enlargement / reduction ratio set in the region enlargement / reduction marker E can be changed to a desired value. When the operator operates the part enlargement / reduction marker E to change the enlargement / reduction ratio, the distance from the part enlargement / reduction marker E of each part deformation marker H changes according to the change of the enlargement / reduction ratio and is displayed on the display device 7. The size of the portion to be processed is enlarged or reduced.

  As an operation to change the enlargement / reduction ratio set for the part enlargement / reduction marker E, the operator does not prepare a plurality of enlargement / reduction ratios for the part enlargement / reduction marker E, and the operator moves the cursor to the part enlargement / reduction marker E and performs a click operation. By doing so, the part enlargement / reduction marker E may be designated, and a desired enlargement / reduction ratio may be input by a numeric key. This method has an advantage that an arbitrary enlargement / reduction ratio can be set for the part enlargement / reduction marker E.

  Further, when the operator designates the part enlargement / reduction marker E with a cursor as an input interface for an arbitrary enlargement / reduction ratio, for example, as shown in FIG. 8, the three enlargement / reduction ratios extending in the respective axis directions of the XYZ coordinates are large. An input interface that displays magnification lines Qx, Qy, and Qz indicating the length, designates any magnification line Qq (q = x, y, z) with a cursor, and expands / contracts the length of the magnification line Qq Can be provided. In this input interface, the numerical value displayed on each magnification line Qx, Qy, Qz indicates the enlargement / reduction magnification, and the default value is “1.0”. When the operator designates any magnification line Qq (q = x, y, z) with the cursor and performs an operation to expand or contract the length, the displayed numerical value changes in conjunction with the expansion or contraction of the length. To do.

  Therefore, for example, when the operator designates the magnification line Qx in the X direction with the cursor and performs an operation of extending the length until the displayed numerical value changes to “1.3”, it is displayed on the display screen 7a. The size (dimension) in the X direction of the eyes can be set to 1.3 times the standard size. On the display screen 7a, the eye shape change processing is performed in conjunction with the change in the length of the magnification line Qx in the X direction (the value of the enlargement / reduction magnification in the X direction). When it is desired to change the eye, it is possible to visually confirm the input of the desired size and the shape of the eye after the change. The same applies to the operation of changing the size of the eyes in the Y direction or the Z direction. According to this input interface, the operator can easily change the shape of each part of the face to a desired size, and work efficiency can be improved.

  FIG. 9 shows an example of a part enlargement / reduction marker E provided in the eye part, (a) shows a state before the eye is enlarged by the eye part enlargement / reduction marker E, and (b) shows the same part. It is a figure which shows the state which expanded the eyes with the marker E for expansion / contraction. In this figure, polygons are omitted, and only the bone B and the part expansion / contraction marker E are drawn.

  In the example of FIG. 9, the six bones B (1) to B (6) set in the eye are radially moved to enlarge or reduce the entire eye. Only one part enlargement / reduction marker E is provided at a reference position. In the example of FIG. 9, a part expansion / contraction marker E (1) is set at the position of the pupil of the eye. This set position is the same as the set position of the part movement marker M (1), but it can be distinguished from the part movement marker M (1) by making the mark of the part expansion / contraction marker E (1) square. I have to.

  The part deformation markers H (1) to H (6) directly connected to the six bones B (1) to B (6) are also associated with the part expansion / contraction marker E (1). Further, when the size of the eye changes, the position and size of the eyebrows are also affected accordingly. Therefore, in order to deform the shape of the eyebrows according to the change in the shape of the eyes, the part deformation marker H provided on the eyebrows (7) and H (8) are associated with the eye part deformation markers H (2) and H (3), respectively.

For each part deformation marker H (i) (i = 1, 2,... 6), a moving direction φ _hie1 and an _{enlargement / reduction} ratio K _hie1 are set as parameters for interlocking with the part _{enlargement / reduction} marker E (1). The suffixes “h”, “i”, “e”, and “1” of the symbols “φ _hie1 ” and “K _hie1 ” are “part deformation marker H”, “marker number of part deformation marker H”, “ The part expansion / contraction marker E "and the" part number expansion / contraction marker E marker number "are shown. As shown in FIG. 10, the movement direction φ _hie1 is a line connecting the position of the part expansion / contraction marker E (1) and the standard position of the part deformation marker H (i) (position of FIG. 9A). Direction. Since the position of the part expansion / contraction marker E (1) and the standard position of each part deformation marker H (i) do not change, the moving direction φ _hie1 of each part deformation marker H (i) is a fixed value. .

On the other hand, the _{enlargement / reduction} ratio K _hie1 is a part _{enlargement / reduction} marker with _respect to the distance from the position of the part _{enlargement / reduction} marker E (1) to the standard position of the part deformation marker H (i) (hereinafter referred to as “standard distance”). This is the ratio of the distance from the position of E (1) to the position where the part deformation marker H (i) has moved. That is, the _{enlargement / reduction} ratio K _hie1 indicates the position where the part deformation marker H (i) moves on the straight line in the movement direction φ _hie1 as a percentage of the standard distance.

For example, in the case of the part deformation marker H (1), as shown in FIG. 10, the standard distance is L (1), and the part expansion / contraction marker E (1) at the position where the part deformation marker H (1) is moved. When the distance is L (1) ′, the scaling factor K _h1e1 is K _h1e1 = L (1) ′ / L (1). The same applies to the other region deformation markers H (2) to H (6). Note that the default value of the scaling factor K _hie1 is “1.0”. Further, L (1) = √ {(X _h1 −X _e1 ) ² + (Y _h1 −Y _e1 ) ² + (Z _h1 −Z _e1 ) ² }, L (1) ′ = √ {(X _h1 '− it is ^{_{X e1) 2 + (Y h1}} '-Y e1) 2 + (Z h1' -Z e1) 2}.

In the data storage area of the part enlargement / reduction marker E (1) of the external storage device 5 or RAM 4, the position coordinates (X _e1 , Y _e1 , Z _e1 ) of the part enlargement / reduction marker E (1) and the position coordinates after movement are stored. (X _e1 ′, Y _e1 ′, Z _e1 ′) and the associated parameter (φ _hie1 , K _hie1 ) of the marker number i of the part deformation marker H (i) and the part deformation marker H (i) ) (I = 1, 2,... 6) is stored.

  The relationship between the data structure of the part expansion / contraction marker E (1) and each part deformation marker H (i) is as follows. The data structure of the part movement marker M (1) and part deformation marker H (i) shown in FIG. Is basically the same as the relation of the tree structure, and the description thereof is omitted.

FIG. 9B shows an example in which the size of the eye is increased by about 1.3 times by the region enlargement / reduction marker E (1) set to the eye. Setting the scaling factor K _e1 by operating the operator set eyes are sites scaling marker E (1) the site scaling marker E (1) to "1.3", each part variant marker H scaling factor K _Hie1 of (i) is changed to "1.3", the eye region variant marker H (1) ~H (6) is moved in the direction of the moving direction _φ h1e1 ~φ h6e1 respectively. Further, along with the movement of the part deformation markers H (2), H (3), the eyebrow part deformation markers H (7), H (8) associated therewith also move based on the interlocking parameters. .

The distance L (i) ′ (i = 1, 2,... 6) from the part expansion / contraction marker E (1) at the movement position of each part deformation marker H (i) (i = 1, 2,... 6) is If the standard distance from the part expansion / contraction marker M (1) to the standard position of each part deformation marker H (1) to H (6) (position in FIG. 9A) is L (i), L (i) ′ = K _hie1 × L (i) = K _hie1 × √ {(X _hi '−X _e1 ) ² + (Y _hi ' −Y _e1 ) ² + (Z _hi '−Z _e1 ) ² } ing.

  In the region of the eye, the six part deformation markers H (1) to H (6) move away from the part expansion / contraction markers E (1), whereby the respective part deformation markers H (1) to H (6 ) Bones B (1) to B (6) associated with each other are moved in conjunction with each other, and the positions of a plurality of polygon vertices P associated with each bone (1) to B (6) are associated with each other. To do. As a result, the overall shape of the eye becomes large as shown in FIG. In addition, the part of the eyebrows is also moved by the part deformation markers H (7), H (8) in conjunction with the part deformation markers H (2), H (3). ) And B (8) associated with bones B (7) and B (8) move in conjunction with each other, and accordingly, a plurality of polygon vertices P respectively associated with the bones B (7) and B (8). Since the positions of the eyebrows move in conjunction with each other, the shape of the eyebrows also increases as a whole as shown in FIG.

Therefore, the operator can easily enlarge both eyes and both eyebrows of the face image by performing an eye enlargement operation on the eyes on the right side of the nose muscles using the region enlargement / reduction marker E. It should be _noted that information on the _{enlargement / reduction} ratio K _e1 set in the part _{enlargement / reduction} marker E (1) and the _{enlargement / reduction} ratio K _hie1 (i = 1, 2,..., 6) set in each part deformation marker H (i) is stored. Therefore, the operator can confirm the operation information (information on the rate of enlargement or reduction of the part) and the parameters for interlocking with each part deformation marker H (i). .

The marker R is a marker for performing an editing operation for rotating the entire part (corresponding to a “second operation point” according to the present invention, hereinafter referred to as “part rotation marker”). In the part rotation marker R, for example, a plurality of part deformation markers H set for the part are divided into a left side and a right side, and the left part deformation marker H is moved upward in conjunction with the rotation of the part rotation marker R. On the other hand, by moving the right part deforming marker H downward, the part is apparently changed into a rotated shape. Position coordinates “(X _ri , Y _ri , Z _ri )” are also set for each part rotation marker R (i). Note that the subscript “r” of each coordinate indicates the part rotation marker R, and “i” indicates the marker number of the part rotation marker R.

  Similarly to the part expansion / contraction marker E, the part rotation marker R is provided only at one position representing the part (usually the center position of the part image), and a plurality of part deformation markers H provided at the part. Is associated with the part rotation marker R. By rotating the part rotation marker R, a part and the rest of the plurality of part deformation markers H associated with the part rotation marker R are moved in the opposite direction to each other. It changes to an overall rotated shape.

  FIG. 11 shows an example of a part rotation marker R provided in the eye part, (a) shows a state before the eye is rotated by the eye part rotation marker R, and (b) shows the part. It is a figure which shows the state which rotated eyes with the marker R for rotation. In the same figure, polygons are omitted, and only the bone B and the part rotation marker R are drawn.

  In the example of FIG. 11, only one part rotation marker R (1) is provided at the position of the pupil of the eye. This setting position is the same as the setting position of the part enlargement / reduction marker E (1). However, by setting the mark of the part rotation marker R (1) to a triangle, the part enlargement / reduction marker E (1) or the part movement marker is used. It can be distinguished from the marker M (1) or the like.

  When the part rotation marker R (1) rotates the part rotation marker R (1) clockwise, the three part deformation markers on the left side of the part rotation marker R (1) are linked to this. Move H (3), H (4), and H (5) upward, and move the three right part deformation markers H (1), H (2), and H (6) downward. Conversely, when the part rotation marker R (1) is rotated counterclockwise, the left three part deformation markers H (3), H (4), H (5) are moved downward. And move the three right part deformation markers H (1), H (2), H (6) to the upper side to change the shape of the eyes to the right or left side as a whole. Perform functions.

  For this reason, the six part deformation markers H (1) to H (6) are also associated with the part rotation marker R (1). Further, when the shape of the eye changes, the shape of the eyebrows is affected accordingly, so the part deformation markers H (7), H (8) provided on the eyebrows are also associated with the part rotation marker R (1). ing.

  As shown in FIG. 12, the six part deformation markers H (1) to H (6) include a movement amount Dy (1) in the Y-axis direction based on the rotation amount ψ of the part rotation marker R (1). Functions F1 (ψ) to F6 (ψ) for calculating ~ Dy (6) are set as interlocking parameters. The function Fi (ψ) (i = 1, 2,... 6) for calculating the movement amount Dy (i) (i is the marker number of the part deformation marker H. i = 1, 2,... 6) is used for the part rotation. In order to make the entire eye rotate in the direction of rotation of the marker R (1), when the part rotation marker R (1) rotates clockwise, the three left part deformation markers H (3), H (4), H (5) travel distances Dy (3), Dy (4), Dy (5) are calculated with “positive” values (corresponding to the upward movement of the Y axis), The amount of movement Dy (1), Dy (2), Dy (6) of the part deformation markers H (1), H (2), H (6) is a negative value (corresponding to the downward movement of the Y axis) ).

Conversely, when the part rotation marker R (1) rotates counterclockwise, the movement amount Dy (i) of the three left part deformation markers H (i) (i = 3, 4, 5) is “negative”. And the movement amount Dy (i) of the three right side region deformation markers H (i) (i = 1, 2, 6) is set to be calculated as a “positive” value. ing. Since only the Y-axis direction moves the part deformation markers H (1) to H (6) in conjunction with the rotation of the part rotation marker R (1), each part deformation marker H (1 ) To H (6) are not set in the moving direction parameter. In the data storage area of the part rotation marker R (1) of the external storage device 5 or RAM 4, the position coordinates (X _r1 , Y _r1 , Z _r1 ) before the movement of the part expansion / contraction marker R (1) and after the movement are stored. Position coordinates (X _r1 ′, Y _r1 ′, Z _r1 ′) and the associated parameter (Dy ( i)) (i = 1, 2,... 6) is stored.

  The relationship between the data structure of the part rotation marker R (1) and the six part deformation markers H (1) to H (6) is the same as the part movement marker M (1) and the part deformation marker H shown in FIG. Since the data structure of (i) is basically the same as the tree structure, description thereof is omitted.

  FIG. 11B shows the change in the shape of the eye when the operator designates the part rotation marker R (1) set for the eye and rotates it clockwise on the screen.

  When the operator performs an operation of rotating the part rotation marker R (1) clockwise by the input device 6, the part rotation marker R (1) rotates according to the operation, and the rotation amount ψ is calculated. Using the calculation results and the functions F1 (ψ) to F6 (ψ) set as parameters for interlocking with the portion deformation markers H (1) to H (6), the portion deformation markers H (1) to Movement amounts Dy (1) to Dy (6) are set in H (6). As for the operation for the part rotation marker R (1), like the part expansion / contraction marker E (1), the operator designates the part rotation marker R (1) with the cursor and sets the rotation angle with the numerical keys. You may make it input.

  In the example of FIG. 11B, Dy (1) = − 0.1 × ψ and Dy (2) = − 0.01 × for the six part deformation markers H (1) to H (6), respectively. ψ, Dy (3) = + 0.01 × ψ, Dy (4) = + 0.1 × ψ, Dy (5) = + 0.01 × ψ, Dy (6) = − 0.01 × ψ The calculated three region deformation markers H (3), H (4), and H (5) on the left side of the region rotation marker R (1) are “+ 0.01 × ψ” and “+ 0.1 ×”, respectively. ψ ”and“ + 0.01 × ψ ”move upward, and the three part deformation markers H (2), H (1), and H (6) on the right side of the part rotation marker R (1) A state in which “−0.01 × ψ”, “−0.1 × ψ”, and “−0.01 × ψ” are moved downward is shown.

  As the six part deformation markers H (1) to H (6) move as described above, the bones B (1) to B (B) associated with the respective part deformation markers H (1) to H (6), respectively. (6) also moves, and the movement of the bones B (1) to B (6) causes the plurality of polygon vertices P respectively associated with the bones B (1) to B (6) to move together. In 11 (b), the shape changes to a shape in which the corners of the eyes are hung and the heads of the eyes are hanging down.

  Further, along with the movement of the part deformation markers H (2), H (3), the eyebrow part deformation markers H (7), H (8) associated therewith also move based on the interlocking parameters. . As a result, the bones B (7) and B (8) associated with the respective part deformation markers H (7) and H (8) move in conjunction with each other, and accordingly the bones B (7) and B (8) ) Move in conjunction with each other, the shape of the eyebrows changes to a shape in which the buttocks rise and the eyebrows hang as shown in FIG. .

  When the part rotation marker R (1) is rotated counterclockwise in the same manner, the part deformation markers H (3), H (4), and H (5) are “−0.01 × ψ”. The region deformation markers H (2), H (1), and H (6) are moved upward by “+ 0.01 × ψ”, respectively. Contrary to 11 (b), the eyes and eyebrows display a face image that has been changed to a shape in which the eyes and eyebrows are lifted and the corners of the eyes and eyebrows hang down.

  Therefore, the operator can easily rotate the shape of both eyes and both eyebrows of the face image by performing an eye rotation operation on the eyes on the right side of the nose muscles using the part rotation marker R. Information on the rotation amount ψ set in the part rotation marker R (1) and the movement amounts Dy (1) through Dy (6) set in the six part deformation markers H (1) through H (6). Is stored, the operator can operate the operation information of the part rotation marker R (1) and the parameters for interlocking the parts deformation markers H (1) to H (6) (movement amounts Dy (1) to Dy ( 6)) can be confirmed.

  Next, animation editing will be described.

  The animation image is a plurality of frames in which the position of the polygon vertex P constituting the specific part of the face and the bones B and markers H, M, E, and R provided in the part are moved little by little with respect to the standard face image. Is a set of face images. Therefore, the animation data is composed of data representing the surface shape of the face created for each frame. The data representing the surface shape of the face of each frame is composed of the position coordinates of a large number of polygon vertices P, bones B and markers H, M, E, and R, but each polygon constituting the face image in the second frame and thereafter. Since the position coordinates of the vertex P, each bone B, and each marker H, M, E, R can be calculated when a movement condition of the movement direction and movement amount is given to the position coordinates in the face image of the first frame, The data representing the surface shape of the face of the frame after the eye is the moving position from the initial position (position in the face image of the first frame) of each polygon vertex P, each bone B, and each marker H, M, E, R. It is composed of program data calculated based on preset movement conditions. Therefore, only the data representing the surface shape of the face of the first frame is composed of the position coordinates (coordinates of the initial position) of a large number of polygon vertices P, bones B and markers H, M, E, R of the standard face image. Yes.

  With animation data, when the animation image is played back, the first frame generates a 3D shape image representing the surface shape of the face based on the standard image data and the texture attached to each polygon, and the 3D shape image is displayed. Although displayed on the apparatus 7, the second and subsequent frames are calculated from the initial positions of the polygon vertices P, the bones B, and the markers H, M, E, and R included in the face image. A three-dimensional shape image representing the surface shape of the face is generated based on the calculation result and the texture attached to each polygon, and is displayed on the display device 7.

  In the present embodiment, when editing is performed to change the surface shape of the standard face of the game character in the standard image editing mode, the editing result is reflected in the animation data. That is, when an instruction to end the editing process is input from the input device 6 to the standard face editing program by the operator's operation, the processing result of the editing process temporarily stored in the RAM 4 (the polygon vertex changed by the editing process) (Face image data including position coordinates of P, bone B, and markers H, M, E, and R) in the storage area of the edited face image data in the external storage device 5 and the external storage device 5 And processing for changing the standard face image data and movement condition data included in the standard animation data to the face image data and movement conditions changed in the face image editing mode.

  Specifically, in the latter process, the position of any part deformation marker H in the standard face image is changed in the face image editing process, and the bone B associated with the part displacement marker H or the bone B When the position of the polygon vertex P associated with is changed, the part deformation marker H, the bone B, and the polygon vertex P in the face image of the first frame of the animation data respectively correspond to the part deformation marker AH. The bone AB and the polygon vertex AP are changed to the same position. Note that “A” in the symbols “AH”, “AB”, and “AP” indicates that they are animation data.

  By automatically changing the positions of the part deformation marker AH, bone AB, and polygon vertex AP in the face image of the first frame, the part provided with the part deformation marker AH does not change the size. If the shape is simply deformed, the positions of the polygon vertices AP constituting the part change in the second and subsequent frames under the same movement conditions as in the case of a standard face image. Thus, when the animation data is reproduced, it is possible to perform the same movement as the standard face image with respect to the shape of the changed part.

  For example, if the animation data is image data that includes the action of closing the eyes (the action of moving the upper eyelid up and down), the animation data is reproduced when the face image editing process is performed to lower the eye corners as shown in FIG. Then, the upper eyelid moves up and down with the same amount of movement as in the case of a standard face image with respect to the eye with the lower corner of the eye corner shown in FIG. The same applies to the case where the face image editing process is performed to move the entire eye shown in FIG. 6 to the nasal muscle side, or the case where the edit to lift the corner of the eye shown in FIG. 11 is performed.

  On the other hand, when the editing for enlarging the entire eye shown in FIG. 9 is performed in the face image editing process, the positions of the eye part deformation markers AH, bone AB, and polygon vertex AP in the face image of the first frame are determined. In addition to the change, the scaling factor is reflected in the movement amounts from the initial positions of the part deformation markers AH, the bone AB, and the polygon vertex AP of each frame.

For example, in the example of FIG. 9, the part deformation marker AH (3) of the animation data corresponding to the part deformation marker H (3) is the first in the standard face image (the eye size in FIG. 9A). If it is set to move by a movement amount Dny downward from the top frame to the nth frame, the Y component of the position coordinates of the part deformation marker AH (3) of the nth frame is determining the formula is set to multiplied by a scaling factor K _H3e1 site variant marker AH (3) to the moving amount Dny (Dny × _K h3e1). The expression for determining the Y component of the position coordinate in the n-th frame of the bone vertex B associated with the part deformation marker AH (3) and the polygon vertex P associated with the bone B (j) is the same. , An expression _obtained by multiplying a preset movement amount by an _{enlargement / reduction} ratio K _h3e1 is set.

_Since the default value of the scaling factor K _h3e1 is set to “1.0”, the animation image for the standard face image is associated with the part deformation marker AH (3) and the part deformation marker AH (3). The bone B (j) and the polygon vertex P associated with the bone B (j) move downward in the Y-axis by a preset standard movement amount. _Is enlarged at a scaling factor K _h3e1 = 1.3 with respect to the standard size, for example, the part deformation marker AH (3) and the part deformation marker AH (3 ) Bone B (j) associated with) and polygon vertex P associated with bone B (j) move downward in the Y axis by a movement amount that is 1.3 times the standard movement amount. become. That is, the movement amount from the initial position of the polygon vertex P of each frame is also enlarged or reduced in accordance with the enlargement / reduction magnification K _h3e1 of the eye size.

  Therefore, in this embodiment, when editing is performed to deform the standard face image of the game character in the standard image editing mode, the editing result is automatically reflected in the animation data. It is basically not necessary to perform the same editing as the standard image editing using the animation data created using the face image, and create the animation data for the deformed face image. However, when animation data that reflects the edit result of the standard face image is played back, the amount of deformation of the part is too large, the movement of the part becomes unnatural, or the expression of the entire face is uncomfortable In this case, it is necessary to correct the animation data reflecting the editing result of the standard face image.

  The animation editing mode in the present embodiment is a mode for mainly correcting such animation data. The face image editing program according to the present embodiment is used when an animator creates a standard image or an animation image of a game character in game software. By installing the game image in the game software, the player can display the standard face of the game character. It can also be used when editing your favorite face. In this case, the unnatural feeling or the uncomfortable feeling of the animation image caused by the editing of the face image can be alleviated by the editing method of the face image. Therefore, the ease and simplicity of the editing operation of the player, the data capacity of the game software In consideration of the above, it is better to install only the standard face editing program in the game software.

  Face image editing is an edit that changes the surface shape of one standard model face image, but animation editing changes the part of the standard model's face image such as mouth and eyes by frame-by-frame and “laughs”. The editing is to change the surface shape of a face image for each frame for a group of frame images showing a specific facial expression such as “get angry”. Therefore, the face image editing is an editing operation for one face image, whereas the animation editing is an editing operation for many identical face images.

  Animation editing is an edit that repeats the process of creating a surface shape of the face of each frame by slightly changing a predetermined part of the face of the previous frame, so if you look at editing the face shape of the face for each frame, The editing work is basically the same as the face image editing. Therefore, the four types of part deformation markers H, part movement markers M, part enlargement / reduction markers E, and part rotation markers R provided for face image editing described above can also be applied to animation editing.

  However, in face image editing, a relatively large number of each type of markers H, M, E, and R are set in each part in order to enable fine-grained editing work. Therefore, it is rare that all markers H, M, E, and R set for face image editing are necessary. Therefore, in this embodiment, in order to reduce the burden of work in animation editing and management of editing data, four types of part modification markers H, part movement markers M, part expansion / contraction markers E, and parts for animation editing The number of rotation markers R is smaller than that for face image editing.

  FIG. 13 is a diagram illustrating an example of a part deformation marker for animation editing provided on the part of the eyes and eyebrows.

  For example, in the eyes and eyebrows, as shown in FIG. 4 (a), there are a total of six parts as the part deformation markers H for face image editing in two places, the top of the eye, the corner of the eye, the upper eyelid, and the lower eyelid. Although the deformation markers H (1) to H (6) were set, in animation editing, as shown in FIG. Markers AH (2), AH (3), and AH (5) are provided, and no site deformation marker AH is provided at the other three locations of the head of the eye, the corner of the eye, and the lower eyelid. That is, the part deformation markers AH corresponding to the part deformation markers H (1), H (4), and H (6) for editing the face image are not provided.

  Note that the symbol “A” of the part deformation marker AH indicates that it is for animation editing. The same applies to the movement amount AD of the part deformation marker AH, which will be described later, the bone AB associated with the part deformation marker AH, and the sign “A” of the magnification AK set to the bone AB.

  For facial image editing, the part deformation markers H (1) to H (6) are provided at the same positions as the bones B (1) to B (6), and the bones B (1) and B ( 4) could be moved by the eye part deforming marker H (1) and the eye part deforming marker H (4), but for animation editing, the eye part deforming marker H (1) And the part deforming marker AH corresponding to the part deforming marker H (4) of the eyelid and the part deforming marker H (6) of the lower eyelid are not provided, so that the bones AB (1), AB (4), AB ( 6) needs to be moved by the site deformation markers AH (2), AH (3) and AH (5), respectively.

Therefore, in this embodiment, the bones AB (4) of the corners of the eyes are associated with the part deformation marker AH (3) and the part deformation marker AH (5), and the part deformation marker AH (3) or the part deformation marker AH. When (5) moves, bone AB (4) is moved in conjunction with it. The bone AB (4) has predetermined magnifications AK _b4h3 , as movement parameters, AD _h3 of the part deformation marker AH (3) and movement amount AD _{h5 of the} part deformation marker AH (5), respectively. A function is set in which the amount of movement multiplied by AK _b4h5 (for example, 0.25 for both) is set.

The symbols “b”, “4”, “h”, and “3” of the subscript “AK _b4h3 ” are “bone number for animation editing”, “bone number of bone for animation editing”, “ “Partial deformation marker for animation editing” and “Marker number of partial deformation marker for animation editing” are shown. The same _{applies to} the subscript “AK _b4h5 ”.

When the part deformation marker AH (3) and the part deformation marker AH (5) move, the bone AB (4) moves the movement vector of the part deformation marker AH (3) and the part deformation marker AH (5). Move in the direction of the vector composition. The position coordinates before movement of the part deformation markers AH (3) and AH (5) are (AX _h3 , AY _h3 , AZ _h3 ) and (AX _h5 , AY _h5 , AZ _h5 ), respectively. If (AX _h3 ′, AY _h3 ′, AZ _h3 ′) and (AX _h5 ′, AY _h5 ′, AZ _h5 ′) respectively, X of each movement vector of the part deformation markers AH (3) and AH (5) , Y, Z components (ΔX _h3 , ΔY _h3 , ΔZ _h3 ), (ΔX _h5 , ΔY _h5 , ΔZ _h5 ) are
_{(ΔX h3, ΔY h3, ΔZ} h3) = (AX h3 '-AX h3, AY h3' -AY h3, AZ h3 '-AZ h3)
_{(ΔX h5, ΔY h3, ΔZ} h3) = (AX h5 '-AX h5, AY h5' -AY h5, AZ h5 '-AZ h5)
It is.

If the position coordinates before and after the movement of the bone AB (4) are (AX _b4 , AY _b4 , AZ _b4 ) and (AX _b4 ′, AY _b4 ′, AZ _b4 ′), respectively, the movement vector X of the bone AB (4) , Y, Z component _{(ΔX b4, ΔY b4, ΔZ} b4) _{is, (ΔX b4, ΔY b4,} ΔZ b4) = (AX b4 '-AX b4, AY b4' -AY b4, AZ b4 '-AZ b4) It is. Since the movement vector of the bone AB (4) is a combination of the movement vector of the part deformation marker AH (3) and the movement vector of the part deformation marker AH (5), the movement vector of the bone AB (4) X, Y, Z components, that is, movement amounts (ΔX _b4 , ΔY _b4 , ΔZ _b4 ) in the respective X, Y, and Z directions are ΔX _b4 = ΔX _h3 × AK _b4 + ΔX _h5 × AK _b5 , ΔY _b4 = ΔY _h3 × AK _b4 + ΔY _h5 × AK _b5 , ΔZ _b4 = ΔZ _h3 × AK _b4 + ΔZ _h5 × AK _b5 . In the example of FIG. 13, when AK _b4 = AK _b5 = 0.25 is set, if the part deformation marker AH (3) and the part deformation marker AH (5) move, the bone AB (4) , X, Y, and Z are moved by (ΔX _h3 + ΔX _h5 ) × 0.25, (ΔY _h3 + ΔY _h5 ) × 0.25, and (ΔZ _h3 + ΔZ _h5 ) × 0.25, respectively.

Also, the lower bone B (6) is associated with the part deformation marker AH (2) and the part deformation marker AH (5), and the part deformation marker AH (2) or the part deformation marker AH (5) When it moves, the bone AB (6) is moved in conjunction with it. In this case, since the bone AB (6) is aligned with the part deformation marker AH (5) in the lateral direction, the bone AB (6) is not affected by the movement of the part deformation marker AH (5) in the Y-axis direction. Is moved with the same movement amount as the part deformation marker AH (5), and the movement amount of the part deformation marker H (5) is changed with respect to the movement of the part deformation marker H (5) in the X-axis direction or the Z-axis direction. On the other hand, the moving amount is multiplied by _b6h5 (for example, 0.25) of a predetermined magnification AK.

  Since the number of eyebrows is small, two part deformation markers AH (7) and AH (8) for the eyebrow head and the eyebrow butt are also set for animation editing. For facial image editing, the eyebrow part deformation markers H (7) and H (8) are linked to the eye part deformation markers H (2) and H (3), respectively, and the part is deformed by editing the eyes. When the markers H (2) and H (3) are moved, the eyebrow part deforming markers H (7) and H (8) are linked in conjunction therewith. The same applies, and the eyebrow part deformation markers AH (7) and AH (8) are associated with the eye part deformation markers AH (2) and AH (3), respectively. Therefore, even in animation editing, eyebrows can be moved in a well-balanced manner in conjunction with eye deformation, similar to face image editing.

  On the other hand, the part movement marker M, the part enlargement / reduction marker E, and the part rotation marker R set in the face shape for face image editing are similarly set in the face shape of each frame for animation. Has been. That is, only one part movement marker AM (1), part expansion / contraction marker AE (1), and part rotation marker AR (1) is provided at the position of the pupil of the eye. Using the markers for part movement marker AM (1), part enlargement / reduction marker AE (1) and part rotation marker AR (1), the part is moved as a whole, or the part is enlarged or reduced as a whole. Since the editing operation for rotating the entire part is the same as that in the face image editing described above, the description thereof is omitted here.

  Next, the face surface shape editing process in face image editing will be described with reference to the flowchart of FIG. In the following description, an editing operation of a part of a face eye will be described as an example.

  When the operator operates the input device 6 to select the face image editing mode, the CPU 2 reads the standard face editing program and standard face image data stored in the ROM 3 into the RAM 4 and executes the standard face editing program. . The flowchart shown in FIG. 14 shows an algorithm of processing contents when the CPU 2 executes the standard face editing program.

  First, the CPU 2 displays a list of face images of the face image editing character read out to the RAM 4 on the display device 7, and allows the operator to select a face image to be edited (S1). The face image to be edited includes a standard face surface shape (default surface shape) and a surface shape image that has already been edited with respect to the standard face surface shape.

  When a face image to be edited is selected from the input device 6 by the operator's operation, the CPU 2 generates a three-dimensional shape image shown in FIG. 2 using the face image data and texture data (S2). In this case, if the surface shape of the standard face is selected, the CPU 2 generates a three-dimensional shape image using the standard face image data and the texture data, and displays the standard face three-dimensional shape image on the display device 7. This is displayed on the display screen 7a (see S3, FIG. 2, and FIG. 4A).

  On the other hand, if the edited face image is selected, the CPU 2 generates the three-dimensional shape image shown in FIG. 2 using the edited face image data and texture data (S2), and the edited face image is displayed. The three-dimensional shape image is displayed on the display screen 7a of the display device 7 (S3).

  The face image is displayed as a polygon model on the display screen 7a, and a part deformation marker H is displayed as an operation point for deforming the part shape on the surface shape (see FIG. 4A). In this embodiment, a part movement marker M, a part expansion / contraction marker E, and a part rotation marker R are prepared as operation points for deforming the part shape. However, these markers are displayed on the standard editing screen. It is displayed by the operator's selection operation (see S9 and S10). In this case, the part movement marker M, the part enlargement / reduction marker E, and the part rotation marker R may be displayed in duplicate in the same position (FIG. 6A, FIG. 9A, FIG. 11). This is because if all the markers are displayed, the operation point display becomes complicated and the operation becomes difficult.

The operator operates the input device 6 to designate a desired part deformation marker H (i) (i is the marker number of the part deformation marker H), and places the part deformation marker H (i) at a desired position. When the movement operation is performed (S4: YES), the CPU 2 calculates the position coordinates before movement and the position coordinates after movement of the part deformation marker H (i) in the XYZ coordinate system, and the movement direction from the calculation result. N _hi and movement amount D _hi are calculated (S5). Further, the CPU 2 searches for one or more bones B (j) (j is a bone number) associated with the part deformation marker H (i) where the movement operation has been performed, and searches for the part deformation marker. Based on the movement contents of H (i) and the interlocking parameters (θ _bjhi , K _bjhi ) set for the bone B (j), the position coordinates after movement of each bone B (j) are calculated ( S6). Further, the CPU 2 calculates the position coordinates after the movement of a plurality of polygon vertices P (t) (t is a polygon number) associated with each bone B (j) as an interlocking target (S7). The position coordinates after movement of the polygon vertex P (t) are set to the movement contents of the bone B (j) and each polygon vertex P (t), similarly to the calculation of the position coordinates after movement of the bone B (j). It is calculated based on the interlocking parameters (θ _ptbj , K _bjhi ).

  Then, the CPU 2 stores position coordinate data of the part deformation marker H (i), one or more bones B (j) linked to the part deformation marker H (i), and a plurality of polygon vertices P (t). To the calculated position coordinate data after movement, and the display position in the face image displayed on the display screen 7a is changed to the position after movement (see the example of FIG. 4B).

  Subsequently, the CPU 2 determines whether or not an editing operation end operation has been input from the input device 6 (S16). If there is no editing operation end operation (S16: NO), the CPU 2 returns to step S4 and ends the editing operation. If there is an operation (S16: YES), the CPU 2 moves the operation performed on the part deformation marker H (i) and the movement of the bone B (j) and the polygon vertex P (t) based on the operation content. After the content calculation result is stored in the external storage device 5 together with the face image data (S17), the editing process is terminated.

  In step S4, the operator does not operate the part deformation marker H (S4: NO), and operates the input device 6 to select one of the part movement marker M, the part expansion / contraction marker E, and the part rotation marker R. When the designation is made and the display of the marker is designated (S9: YES), the CPU 2 displays the designated marker on the face image displayed on the display screen 7a (S10, FIG. 6 (a), FIG. 9 (a). ), See the example of FIG.

  When the operator operates the input device 6 to specify a desired part movement marker M, part expansion / contraction marker E, or part rotation marker R, and inputs predetermined operation information to the marker (S11: YES). The CPU 2 applies the operation information input from the input device 6 to each of the part deformation markers H (i) provided in the part where the designated marker is set and each part deformation marker H ( Based on the interlocking parameters set in i), the movement position in the XYZ coordinate system is calculated, and the movement direction and movement amount are calculated from the calculation result (S12).

For example, when the operator displays the part movement marker M and moves the eye part movement marker M (1), the CPU 2 moves the part movement marker M (1) in the XYZ coordinate system. The position before movement ((X _m1 , Y _m1 , Z _m1 ) and the position after movement (X _m1 ′, Y _m1 ′, Z _m1 ′) are calculated, and the movement direction θ _m1 and the movement amount D _m1 are calculated from the calculation results. Then, the CPU 2 calculates the movement positions (X _hi ', Y _hi ', Z _hi ') of the six part deformation markers H (i) (i = 1 to 6) set in the eyes and these The movement position (X _bi ′, Y _bi ′, Z _bi ′) of the bone B (i) directly connected to is calculated (see the examples of FIGS. 6 and 7).

Further, when the operator displays the part enlargement / reduction marker E and, for example, inputs an enlargement or reduction magnification x to the eye part enlargement / reduction marker E (1), the CPU 2 displays the six items set for the eyes. The movement direction φ _hie1 and the movement distance L (i) ′ = K _hie1 × L (i) are calculated for the part deformation markers H (i) (i = 1 to 6), respectively (FIGS. 9 and 10). See example).

  Further, when the operator displays the part rotation marker R and, for example, performs a rotation operation on the eye part enlargement / reduction marker R (1), the CPU 2 displays the six part deformation markers set for the eyes. Movement amounts Dy (i) = Fi (ψ) (i = 1 to 6) are calculated for H (i) (i = 1 to 6), respectively (see the examples in FIGS. 11 and 12).

Further, the CPU 2 searches for one or more bones B (j) (j is the bone number) associated with the moved part deformation marker H, and the movement contents of the part deformation marker H and the bone B Based on the interlocking parameters set in (j), the position coordinates (X _bj ', Y _bj ', Z _bj ') after movement of each bone B (j) are calculated (S13). Further, the CPU 2 moves the position coordinates (X _pk ′, Y _pk ′, Z _pk ′) after movement of a plurality of polygon vertices P (k) (k is the number of the polygon vertices) associated with each bone B (j). ) Is calculated (S14).

  Then, the CPU 2 calculates the position coordinate data of the part deformation marker H, one or more bones B (j) and a plurality of polygon vertices P (k) linked to the part deformation marker H after the calculated movement. And the display position in the face image displayed on the display screen 7a is changed to the moved position coordinates (S15, FIG. 6B, FIG. 9B, FIG. 11B). ) Example).

  Subsequently, the CPU 2 determines whether or not an editing operation end operation has been input from the input device 6 (S16). If there is no editing operation end operation (S16: NO), the CPU 2 returns to step S4 and performs the editing described above. If there is an operation for finishing the editing operation (S16: YES), the CPU 2 calculates the operation content performed on each marker and the calculation result of the movement content of the bone B and the polygon vertex P based on the operation content. After storing the facial surface shape data in the external storage device 5 (S17), the editing process is terminated.

  In animation editing, the face image of the frame specified by the movement part that the operator wants to correct is subjected to the editing processing in the face image editing described above. In particular, it is the same as the editing operation for the face image in the face image editing.

  Therefore, in the flowchart shown in FIG. 14, when the editing operation of the face image of the frame designated by the movement portion that the operator wants to correct is completed, the editing content is stored in the external storage device 5 (S16). If there is another frame to be corrected, if the content is returned to step S1 in order to edit the face image of the frame, a flowchart showing editing processing in animation editing can be obtained.

  As described above, according to the present embodiment, apart from the bone B provided in the conventional face image, the markers H, M, E, and R for moving one or more bones B are provided. Since one or two or more bones B are moved based on the operations on the markers H, M, E, and R, the editing work for changing the surface shape of the face by displacing the bones B is facilitated.

  In particular, for each part, a part moving marker M for collectively moving a plurality of bones B set in each part in the same direction, a part expanding / contracting marker E for collectively moving a plurality of bones B, Since the part rotation marker R that rotates and moves the plurality of bones B in the same direction is provided, by operating these markers M, E, R, the position, size, direction, etc. of the part on the face can be easily determined. Can be changed.

  Further, a part deformation marker H set in a part adjacent to or adjacent to a part deformation marker H set in each part (for example, a part deformation marker H set in eyes and a part set in eyebrows) Deformation marker H, etc.) are linked together, and when one part deformation marker H is operated to deform one part, the other part deformation marker H is also moved in conjunction with it. The influence of the deformation of the part can be suitably reflected in the deformation of other parts.

  In addition, when editing is performed to deform the game character's standard face image in the standard image editing mode, the editing result is automatically reflected in the animation data. When the animation data is played back, the edited face image is predetermined. Can be operated. Therefore, animation data that is basically created using standard face images, except for cases where the movement of the edited face image is unnatural or uncomfortable and requires partial correction. However, since it is not necessary to perform editing similar to the standard image editing, the editing efficiency for animation data is improved.

  Even in the case of partially editing the animation of the face image after editing, the operation of the part deformation marker AH, the part movement marker AM, the part expansion / contraction marker AE, and the part rotation marker AR is performed in the same manner as in the standard image editing. Since the surface shape of the face of a desired frame can be easily deformed, the work of editing animation data can be greatly reduced.

  In the above-described embodiment, the face shape editing method according to the present invention has been described by taking the part of the face eye as an example. It goes without saying that the method is applicable. Further, it can be applied not only to the surface shape of a human face but also to the surface shape of an animal or other creature.

  In the above-described embodiment, the face image editing apparatus for editing a standard face image or an animation image mainly when creating a face image of a game character has been described. If the program is installed in the game software, the player can edit the standard face image of the character provided in the game software into a favorite face. That is, the game software can have a function of editing the face image of the character by the player.

  In the standard face editing program according to the present invention, apart from the conventional bone, a part deformation marker H and a part movement marker M for moving the bones individually or collectively to move them in a certain group. Since the part enlargement / reduction marker E and the part rotation marker R are provided, the face image of the character can be edited to a desired shape relatively easily even by a player having little experience in editing the face image.

  In addition, when the player makes a desired correction to the standard face image of the character, the corrected face image data (such as the position coordinates of the moved bone B and polygon vertex P) is reflected in the animation data. When the animation data is reproduced, the corrected face image can be moved in a predetermined manner, so that the player can make the character with the corrected face image appear in the game space without correcting the animation data. Can enjoy.

  In other words, on the game screen, images of each frame created as animation data from the RAM in the game device are read out to the VRAM at a predetermined cycle and a moving image of the character is reproduced. Since it is created based on an image, for example, when animation data in which a character blinks is reproduced, the face image is an image obtained by moving the upper face of a standard face image up and down.

  However, for example, when the player edits by enlarging the eye size of the standard face image of the character with the magnification M using the part enlargement / reduction marker E, as described above, the edited face image is one frame of animation. Since the magnification M input to the part enlargement / reduction marker E set to the eye is set to be multiplied by the amount of movement of the bone B between frames, the face blinks the character. When the process of reading out the face image of each frame created as animation data to the VRAM is performed, the amount of movement of the upper eyelid of the character between frames is M times the amount of movement of the standard movement amount. The reproduced animation image is an image obtained by moving the upper face of the face image after editing up and down.

  In this way, when the face image of each frame of animation data is read into the VRAM, the amount by which the upper eyelid moves is changed by the magnification M input to the part enlargement / reduction marker E set for the eyes, An animation image obtained by blinking the face image of the character edited by the player can be displayed on the game screen. Therefore, for example, if the face image of the edited character is moved in the same manner as the face image before editing, there may be a problem that the upper eyelid does not completely close to the lower eyelid. As described above, when the animation data is reproduced, the magnification M input to the part enlargement / reduction marker E in the face image editing is reflected, so that the player can enjoy the game with the character whose face image is corrected without feeling the inconvenience described above. it can.

  In the above example, the eye part has been described, but the same applies to other parts such as the mouth and nose. Further, not only the part enlargement / reduction marker E but also the part movement marker M and the part rotation marker R reflect the operation information input in the face image editing when reproducing the animation data, and change the face image of each frame. Thus, the above effects can be achieved.

  In the above embodiment, the case where the surface shape of the face is represented by the polygon model has been described. However, the present invention expresses the surface shape of the face by a large number of points, and moves the positions of these points to the surface. The present invention can be widely applied to editing methods for deforming shapes. For example, the present invention can be applied to shape editing of a surface shape expressed by a NURBS (Non-Uniform Rational B-Spline) curve.

  Moreover, although the said embodiment demonstrated the edit method of the surface shape of the face of the humanoid character which appears in game software, it cannot be overemphasized that this invention is not limited to the edit of the face image of the character which appears in game software. .

1 face image editing device 2 CPU
3 ROM
4 RAM
5 External storage device 6 Input device 7 Display device 7a Display screen P Polygon vertex (vertex of polygon)
B bone (control point)
AB Bone in animation image (second control point)
H Marker for deforming part in standard face image (first operation point)
Marker for part deformation in AH animation image (third operation point)
M Marker for moving part in standard face image (second operation point)
E Marker for part enlargement / reduction in standard face image (second operation point)
R Marker for part rotation in standard face image (second operation point)

Claims (11)

Computer
From the storage unit, the surface shape of the face is expressed as a set of a large number of polygons, and one or more control points for controlling the positions of the vertices of the polygons in each part of the face and the control points directly or First face image display control means for reading a standard face image in which one or more first operation points for indirect movement are set and displaying them on a display unit;
When operation information related to movement of the first operation point is input from the operation unit to the first operation point of the face image displayed on the display unit, the first operation point is based on the operation information. First movement information calculation means for calculating first movement information including the movement position of
A first operation point moving means for moving the first operation point input with the operation information to a movement position included in the first movement information in the standard face image displayed on the display unit;
When the first operation point is moved, one or more control points set in advance as control points to be interlocked with the movement of the first operation point are calculated with respect to the first operation point. Second movement information calculation means for calculating second movement information including the movement position of each control point based on the first movement information and the interlocking condition preset for each control point;
When moving the control point, the second movement calculated for the control point with respect to one or more polygon vertices preset as polygon vertices linked to the movement of the control point Third movement information calculation means for calculating third movement information including the movement position of the vertex of each polygon based on the information and the interlocking condition set in advance at the vertex of each polygon;
In the standard face image displayed on the display unit, the vertex of one or more polygons for which the third movement information is calculated is moved to a movement position included in the third movement information, and the First face image deformation means for deforming the face image;
A program for editing a face image, characterized in that the program is made to function. The plurality of first operation points set in the standard face image include first operation points associated with each other so that when one moves, the other moves in conjunction with the movement,
The first movement information calculation means also calculates another first operation point linked to the first operation point to be moved based on the operation information from the operation unit, with respect to the first operation point. Calculating the first movement information including the movement position of the other first operation point based on the first movement information to be performed and the interlocking condition set in advance for the other first operation point;
The first operation point moving means uses the other first operation point for which the first movement information is calculated as the first movement information in the standard face image displayed on the display unit. The face image editing program according to claim 1, wherein the program is moved to an included movement position. In the face image, one or more second operation points for moving the first operation point are further set for each part,
When the operation information for the second operation point is input from the operation unit, the first movement information calculation unit is configured to control the movement by the second operation point. For the operation point, the first movement information is calculated based on the operation information and the movement condition set in advance for each first operation point,
The first operation point moving means is configured to select the first operation point whose movement is controlled by the second operation point to which the operation information is input in the standard face image displayed on the display unit. Moving to a movement position included in the first movement information calculated by the first movement information calculation means;
The face image editing program according to claim 1 or 2. The second operation point is a part moving operation point for moving the part where the second operation point is set,
The first movement information calculation means includes:
When operation information for moving the part movement operation point with respect to the part movement operation point is input from the operation unit, the one or more first operation points set in the part are: Based on the moving direction and moving amount of the part moving operation point, each moving position is calculated by moving the first operating point from the standard position in the same direction as the part moving operating point by the same moving amount. ,
The face image editing program according to claim 3. The second operation point is a part expansion / contraction operation point for changing the size of the part where the second operation point is set,
The first movement information calculation means includes:
When operation information of a magnification for enlarging or reducing a part where the part enlargement / reduction operation point is set with respect to the part enlargement / reduction operation point is input from the operation unit, one or more set for the part With respect to the first operation point, a standard distance from the part expansion / contraction operation point of each first operation point on the line connecting each first operation point and the part expansion / contraction operation point is changed by the magnification. Each moving position at a certain distance is calculated,
The face image editing program according to claim 3. The second operation point is a part rotation operation point for rotating the part where the second operation point is set,
The first movement position calculation means includes:
When operation information for rotating the part rotation operation point with respect to the part rotation operation point is input from the operation unit, the one or more first operation points set in the part are: Based on the rotation direction and rotation amount of the operation point for part rotation and the movement condition set in advance for each first operation point, the movement position is calculated respectively.
The face image editing program according to claim 3. The storage unit further includes a face image for animation editing including a face image for a plurality of frames obtained by changing a predetermined part of the standard face image, and causing the standard face to have a predetermined expression. ,
The computer,
When editing is performed to move the control point and the vertex of the polygon whose position is controlled by the control point with respect to the standard face image to deform the surface shape of the face, the edited face image is Image changing means for changing to a face image for animation editing;
The face image editing program according to any one of claims 3 to 6, wherein the program is further functioned. In the face image of each frame for animation editing, a third operation point that performs the same function as the first operation point and a second control point that performs the same function as the control point are set. ,
The computer,
Second face image display control means for reading out the face image of the frame designated by the operation unit from the storage unit and displaying it on the display unit from the storage unit;
When operation information related to the movement of the third operation point is input from the operation unit to the third operation point of the face image displayed on the display unit, the third operation is performed based on the operation information. Fourth movement information calculation means for calculating fourth movement information including the movement position of the point;
A second operation point moving means for moving a third operation point to which the operation information is input to a movement position included in the third movement information in the face image displayed on the display unit;
When moving the third operation point, with respect to the third operation point, one or more second control points set in advance as control points to be interlocked with the movement of the third operation point. The fifth movement information including the movement position of each second control point is calculated based on the fourth movement information calculated in this way and the interlocking condition set in advance for each second control point. 5 movement information calculation means;
When moving the second control point, for one or more polygon vertices preset as polygon vertices linked to the movement of the second control point, with respect to the second control point The sixth movement information including the movement positions of the vertices of each polygon is calculated based on the fifth movement information calculated in the above and the interlocking conditions set in advance at the vertices of each polygon. Movement information calculation means;
In the face image displayed on the display unit, the vertex image of one or more polygons for which the sixth movement information is calculated is moved to a movement position included in the sixth movement information, and the face image is moved. Second face image deformation means for deforming;
The face image editing program according to claim 7, further causing the program to further function. In the face image of each frame for animation editing, one or more fourth operation points that perform the same function as the second operation point are set for each part,
9. The face image editing program according to claim 8, wherein the number of the fourth operation points is set to be smaller than the number of the second operation points set in the face image editing face image. .   A computer-readable recording medium on which the face image editing program according to claim 1 is recorded. A program storage unit that records the face image editing program according to any one of claims 1 to 9,
A computer for executing a face image editing program stored in the program storage unit;
A face image editing system.