JP2000293710A - Method and device for drawing three-dimensional portrait - Google Patents

Abstract

PROBLEM TO BE SOLVED: To draw a three-dimensional portrait in parallel by drawing the portrait consciously of two-dimensional images only. SOLUTION: A selecting section 3 selects two-dimensional parts images from a parts storing section 1 following an instruction given from a selection instructing section 2, synthesizes parts by arranging the parts to appropriate positions, and supplies the synthesized parts to a displaying section 5. In a three-dimensional parts storing section 6, three-dimensional data of the portions of a face are stored and correlated with the two-dimensional images stored in the parts storing section 1 by using IDs. At the time of selecting the two-dimensional parts, the selecting section 3 selects the three-dimensional data corresponding to the two-dimensional parts images by simultaneously obtaining the IDs from the selecting section 3. A three-dimension synthesizing section 8 synthesizes the three-dimensional data into one portrait and displays the synthesized picture. A visual point change instructing section 10 gives the instruction on the synthesized three-dimensional portrait to display the oblique view or side view of the face.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method and an apparatus for creating a three-dimensional portrait, which can generate a three-dimensional portrait by creating a portrait with only two-dimensional images in mind.

[0002]

2. Description of the Related Art Generally, a portrait drawing apparatus is provided with a GUI.
(Graphical User Interface) A portrait is created by selecting and combining parts of a face, such as a human hairstyle, contour, eyes, nose, and mouth, which are registered in advance, as parts. However, since the parts of each part are drawn in two dimensions, it is not possible to obtain a face or a side view of the person as viewed obliquely. This kind of portrait drawing apparatus is disclosed, for example, in JP-A-8-44898 (Cited Example 1). In cited example 1, individual parts drawn in two dimensions are stored in advance, and a portrait is created by arranging these parts.
A device for expressing a three-dimensional face is disclosed in, for example,
No. 0-74271 (Cited Example 2).
In the cited example 2, three-dimensional standard face data is stored in a storage device in advance, and the three-dimensional lattice data of the face is deformed according to a user's instruction to express a desired three-dimensional portrait.

[0003]

However, in the above cited reference 1, although it was possible to create a face facing the front, it was not possible to obtain an oblique face or a profile for that person. In addition, in the cited example 2, the feature points of the face are extracted with reference to the original picture to determine the deformed portion. However, in order to obtain these feature points, the original picture drawn from a plurality of directions is required. There was a drawback. The present invention has been made in view of the above-described drawbacks, and a two-dimensional portrait and a three-dimensional shape model are associated with each other, and a three-dimensional face corresponding only by combining two-dimensional face parts is provided. By generating, even if a caricature is created by thinking only of a face in one direction, it is possible to obtain as a face of a target person when viewed from multiple directions, and to provide a three-dimensional caricature creation method and apparatus. I do. In addition, when a deformation operation such as movement or rotation is performed on individual parts constituting a two-dimensional portrait, a three-dimensional portrait creation method that can simultaneously reflect three-dimensional individual data in the same deformation operation Another object is to provide a device. Furthermore,
Another object of the present invention is to provide a method and an apparatus for creating a three-dimensional portrait that can be individually selected by separately managing the three-dimensional coordinate data and the texture for the individual three-dimensional data described above.

[0004]

According to a first aspect of the present invention, there is provided a three-dimensional portrait creating method for creating a portrait by combining a face part as a part. Three-dimensional data is stored in association with the two-dimensional part images prepared for each, and the types of parts to be selected from outside and the respective I
By obtaining D as information, the prepared two-dimensional part image is selected, the selected two-dimensional part image is arranged at an appropriate position, and synthesized as a portrait, and the two-dimensional part image corresponding to the two-dimensional part image is obtained. Selecting three-dimensional data, arranging the obtained three-dimensional data at an appropriate position for each part, and synthesizing and displaying as a portrait viewed from that viewpoint by referring to viewpoint change information specified externally; I do.

According to a third aspect of the present invention, a three-dimensional portrait drawing apparatus is divided for each part of a face, and stores a part ID indicating each type and a two-dimensional part image prepared corresponding to each of the IDs. By obtaining information on the type and ID of the parts to be selected from the parts storage unit and the outside,
A selection unit for selecting a two-dimensional part image from the parts storage unit and sending the selected two-dimensional part image to a combining unit; a combining unit for arranging the selected two-dimensional part image at an appropriate position and combining it as a portrait; A three-dimensional part storage unit in which three-dimensional data is stored in correspondence with each of the two-dimensional part images stored in the three-dimensional part storage unit;
A three-dimensional selection unit that obtains ID information from the selection unit and selects three-dimensional data corresponding to the two-dimensional part image from the three-dimensional part storage unit, and stores the obtained three-dimensional data at an appropriate position for each part. And a three-dimensional synthesizing unit for synthesizing a caricature viewed from the viewpoint with reference to viewpoint change information instructed from the outside and outputting to the three-dimensional display unit.

A three-dimensional portrait drawing apparatus according to a third aspect of the present invention is the three-dimensional portrait drawing apparatus according to the second aspect, wherein the two-dimensional part image stored in the two-dimensional part storage unit and the three-dimensional part storage unit are stored in the two-dimensional part storage unit. The stored three-dimensional data is allocated to the same table. A three-dimensional portrait drawing apparatus according to a fourth aspect of the present invention is the three-dimensional portrait drawing apparatus according to the second aspect, wherein the two-dimensional part image stored in the parts storage unit has a viewpoint with respect to a part constituting a face. By changing each image as viewed and instructing information indicating the viewpoint as attribute information in addition to the type and ID of the part supplied from the selection instruction unit,
It is characterized by obtaining a desired image. Further, in the three-dimensional portrait drawing apparatus according to the fifth aspect, the three-dimensional portrait drawing apparatus according to the second aspect further includes a deformation instruction unit that specifies deformation information for each type of each part, and The unit performs an operation for the deformation on the data obtained from the three-dimensional parts storage unit based on the deformation instruction, thereby combining and outputting the data to the three-dimensional display unit while moving and deforming the data. . The three-dimensional portrait drawing apparatus according to claim 6 is the three-dimensional portrait drawing apparatus according to claim 2, wherein a list display of two-dimensional part images stored in the parts storage unit or the three-dimensional parts as needed. A list display unit for displaying a list of three-dimensional data stored in the storage unit is further added, and a desired image is obtained through the selection instruction unit while referring to the image displayed here. A three-dimensional portrait drawing apparatus according to a seventh aspect of the present invention is the three-dimensional portrait drawing apparatus according to the second aspect, wherein a type and an ID of a selected part are input from the outside and a three-dimensional selection instruction unit supplied to the selection unit. Is further added, and three-dimensional data having an ID different from the two-dimensional part image is directly selected.

[0008] A three-dimensional portrait drawing apparatus according to claim 8 is the three-dimensional portrait drawing apparatus according to claim 2, wherein a three-dimensional data input unit that inputs three-dimensional data from outside and generates the three-dimensional data as a three-dimensional part. A two-dimensional image generation unit that converts three-dimensional data obtained through the three-dimensional data input unit into a two-dimensional image by image processing and stores the two-dimensional image in the parts storage unit. The three-dimensional portrait drawing apparatus according to claim 9 is the three-dimensional portrait drawing apparatus according to claim 8, wherein the input three-dimensional data is:
It is characterized by being generated by a result obtained by measuring with photographing equipment or by computer graphic. Furthermore, the three-dimensional portrait drawing apparatus according to claim 10 is the three-dimensional portrait drawing apparatus according to claim 2, wherein the three-dimensional parts storage unit is stored in the three-dimensional parts storage unit in association with the ID for each type of face part. 3D coordinate data and texture data obtained by linking the 3D coordinate data are allocated, and the attribute, type, and I
The texture data is selected from the three-dimensional part storage unit by obtaining each information of D as input, and the selected texture is pasted on the three-dimensional coordinate data obtained from the three-dimensional selection unit, and the three-dimensional display is performed. Output to the unit. In the three-dimensional portrait drawing apparatus according to the eleventh aspect, in the three-dimensional portrait drawing apparatus according to the tenth aspect, the texture data stored in the three-dimensional parts storage unit includes at least one texture data for one ID. It is stored correspondingly.

With the above-described configuration, the two-dimensional part image and the three-dimensional data associated with each other are stored, and the portrait is created with only the two-dimensional part image in mind. Is generated, the person can be obtained as a portrait viewed from another direction only by creating a portrait based on the two-dimensional part image. Further, when a deformation operation such as movement or rotation is performed on individual parts constituting a two-dimensional portrait, the three-dimensional individual data can be simultaneously reflected in the same deformation operation.

[0009]

FIG. 1 is a block diagram showing an embodiment of the present invention. The three-dimensional portrait creation device shown in FIG.
Parts storage unit 1, selection instruction unit 2, selection unit 3, combination unit 4, display unit 5, three-dimensional parts storage unit 6, three-dimensional selection unit 7, three-dimensional combination unit 8, tertiary unit An original display unit 9 and a viewpoint change instruction unit 10 are provided. Parts storage unit 1
Stores a part ID for each type of face part and an image of the part corresponding to the ID. The images of these parts may be hand-drawn illustrations, cartoons, or photographs as long as they are divided for each part of the face. The selection instruction unit 2 inputs the type and ID of the part to be selected as a user operation, and outputs the type and ID of the part to the selection unit 3. The selection unit 3 acquires the image of the part corresponding to the type and ID of the part obtained from the selection instruction unit 2 from the part storage unit 1 and sends the acquired image to the synthesizing unit 4. The type and ID of the part are also output to the three-dimensional selection unit 7. The synthesizing unit 4 arranges the images of the parts obtained from the selecting unit 3 at appropriate positions for each part and outputs the images to the display unit 5 as one portrait. The display unit 5 displays the portrait obtained from the synthesizing unit 4. The three-dimensional part storage unit 6 stores, for each type of face part, the part ID and the three-dimensional data of the part corresponding to the ID. At this time, the same ID is assigned to the three-dimensional data and the image stored in the parts storage unit 1 that correspond to each other. When these three-dimensional data are based on the measurement data, the two-dimensional image may be a picture depicting each of these parts,
It may be generated automatically by image processing. The three-dimensional selection unit 7 stores the three-dimensional data of the part corresponding to the type and ID of the part obtained from the selection unit 3 into the three-dimensional part storage unit 6.
And sends it to the three-dimensional synthesizing unit 8. 3D synthesis unit 8
Arranges the three-dimensional data of the parts obtained from the three-dimensional selecting unit 7 at appropriate positions for each part and outputs the three-dimensional data to the three-dimensional display unit 9 as one piece of three-dimensional face data. Viewpoint change instruction unit 1
0 inputs a viewpoint when referring to three-dimensional data as a user operation, and outputs viewpoint information to the three-dimensional synthesizing unit 8. The three-dimensional synthesizing unit 8 changes the viewpoint such as rotation and zoom of the synthesized three-dimensional face data according to the instruction of the viewpoint change instructing unit 10 and displays the same on the three-dimensional display unit 9.

The operation of the three-dimensional portrait drawing apparatus having the above configuration will be described. First, information on the type and ID of a part given from the selection instruction unit 2 is output to the selection unit 3. At this time, I
If D is limited, it can be easily given.
For example, the type, ID, and image of a part may be recorded in a ledger of a list, and the ID may be specified while referring to the ledger. Further, a function of displaying the ID and image of the parts stored in the parts storage unit 1 may be separately added.
The selection unit 3 acquires an image of a part corresponding to the type and ID of the part from the parts stored in the part storage unit 1. The image may be stored, for example, on a memory configuring the selection unit 3. At the same time, the selection unit 3 also outputs the type and ID of the part to the three-dimensional selection unit 7. Each image is arranged at an appropriate position in the synthesizing unit 4 according to the type. The placement position is hair, outline, eyes, nose, mouth,
It may be determined in advance for each part such as an ear. Further, not only the position but also the size may be determined, and the image may be arranged so as to be enlarged or reduced to the size. The picture in which various parts are combined into one face is sent to the display unit 5 and displayed. At this time, if the user looks at the portrait displayed on the display unit 5 and does not like it, he or she designates the type and ID of the part from the selection instruction unit 2 as many times as possible, and creates a portrait while changing individual parts. It is possible. At the same time these two-dimensional portraits are selected, synthesized and displayed, a three-dimensional face that can be referred to from any direction is created by the operation described below. The three-dimensional part storage unit 6 stores, for each type of face part, the part ID and the three-dimensional data of the part corresponding to the ID. At this time, the three-dimensional data has a correspondence with the image stored in the parts storage unit 1. For example, as for the “outline”, a picture obtained by copying the three-dimensional shape data of the chin from the front is an image of the part. The IDs are also associated with each other. For example, “the image of the contour ID No. 3” corresponds to “the three-dimensional shape data of the contour ID No. 3”. Similarly, when a copy of the shape data of the “nose” is stored in the parts storage unit 1 as an image of the “nose” part, the “nose ID No. 5 three-dimensional shape data” is included in the “nose”. ID No. 5 image ". The image and the three-dimensional data thus associated with each other are given the same ID, and can be identified by the ID. The three-dimensional selection unit 7 acquires from the three-dimensional parts storage unit 6 three-dimensional data of parts corresponding to the type and ID of the part obtained from the selection unit 3. ID obtained from the selection unit 3
Is the same as the ID obtained from the selection instruction unit 2. Therefore, "image of ID3 of outline and ID5 of nose"
Is selected from the parts storage 1, the "three-dimensional data of the contour ID No. 3 and the nose ID No. 5" is selected. The three-dimensional data selected by the three-dimensional selecting unit 7 is output to the three-dimensional synthesizing unit 8. The three-dimensional synthesis unit 8
The three-dimensional data of the parts obtained from the three-dimensional selecting unit 7 is arranged at an appropriate position according to the type. At this time, the data may be arranged at a predetermined position, or each data may be arranged so as to be in contact with a predetermined three-dimensional model. At this time, if gaps or overlaps occur between the data, the data may be complemented by numerical calculation or averaged. When one face is synthesized by the three-dimensional data, it is displayed on the three-dimensional display unit 9. Viewpoint change instruction unit 1
0 gives parameters for changing the viewpoint, such as rotation, tilt, zoom, and pan, to the three-dimensional face synthesized by the three-dimensional synthesis unit 8. In accordance with these viewpoint change instructions, a three-dimensional face is displayed on the three-dimensional display unit 9, so that three-dimensional shape data can be displayed from various positions and angles. According to the embodiment shown in FIG. 1, it is possible to obtain a portrait in which the person is viewed from another direction only by creating a portrait based on the two-dimensional image. The reason for this is that the image parts and the three-dimensional data associated with each other are stored, and the three-dimensional face data is generated in parallel with creating the portrait with only the two-dimensional image in mind. Because.

In the embodiment shown in FIG. 1, the parts storage unit 1
And the three-dimensional data stored in the three-dimensional parts storage unit 6 are stored in different locations on the same memory or in separate memories, respectively, and are associated only by the ID. I have. However, when a product is specifically mounted, as shown in FIG. 2, image data (two-dimensional parts) and three-dimensional data (three-dimensional parts) can be stored in the same memory table. The same ID is assigned to the image and the three-dimensional data associated with each other, and the image and the three-dimensional data can be identified by the ID as in the embodiment shown in FIG. 1. For example, as for the “outline”, a picture obtained by copying the three-dimensional shape data of the chin from the front is an image of the part. The IDs are also associated with each other. For example, “the image of the contour ID No. 3” corresponds to “the three-dimensional shape data of the contour ID No. 3”. Similarly, when a copy of the shape data of the “nose” is stored as an image of the “nose” part, “the three-dimensional shape data of the nose ID No. 5” is replaced with “the image of the nose ID No. 5”. Is supported. In this case,
The configurations of the selection unit 3 and the three-dimensional selection unit 7, the synthesis unit 4 and the three-dimensional synthesis unit 8, and the display unit 5 and the three-dimensional display unit 9 have the respective functions described in the embodiment illustrated in FIG. They may be combined into one configuration.

Further, in the embodiment shown in FIG. 1, the image data of each part is described as a picture viewed from one direction. For example, the image of each part viewed from the front of the face, specifically, the front image of the hair, the front image of the contour, the front image of the eyes, the front image of the nose, and the front image of the mouth are stored in the parts storage unit 1. They were memorized and selected and combined to create a portrait. The image created and obtained and displayed on the display unit 5 is nothing less than a portrait of a face viewed from the front.
Here, as an image stored in the parts storage unit 1, for example, as shown in FIG.
Images viewed from various directions, such as an image viewed from 5 degrees, an image viewed from an oblique angle of 30 degrees, and a profile image, are stored as parts. At this time, in addition to the type and ID of the part described in the first embodiment, the selection instructing unit 2 also instructs attribute information of parts such as “15 ° diagonal” and “30 ° diagonal”. At this time, the selection unit 3
Has a function of selecting a part stored in the parts storage unit 1 based on the type, ID, and attribute information of the part. Thus, for example, by creating a two-dimensional portrait while recalling a face at an angle of 15 degrees, three-dimensional face data can be obtained at the same time. For example, if the user selects an outline, a hair, an eye, a mouth, and a nose at an angle of 15 degrees, a portrait at an angle of 15 degrees is created on the display unit 5. At this time, the three-dimensional data corresponding to these images is selected from the three-dimensional parts storage unit 6, as in the embodiment shown in FIG.
The images are synthesized and displayed on the three-dimensional display unit 9 as a three-dimensional face. In addition, it is possible to obtain a frontal face by giving an instruction from the viewpoint change instructing unit 10 to face the front. Similarly, when a two-dimensional caricature is created while thinking of a face at an angle of 30 degrees, a three-dimensional face is synthesized, so that a face at an angle of 15 degrees or a front face can be obtained.
Here, since parts viewed from a plurality of angles are associated with each other, it is possible to select an image viewed from the front for a certain part and an image viewed from an oblique angle of 30 degrees for a certain part. For example, even when a part is selected in which the hair and eyes are viewed from the front and the outline and the ear are viewed obliquely, three-dimensional data corresponding to each part is selected, so that three-dimensional face data can be synthesized. Furthermore, if a front portrait is created using the fact that parts viewed from a plurality of angles are associated with each other, it is possible to obtain a portrait at an angle of 15 degrees or a portrait at an angle of 30 degrees. For this purpose, the selection unit 3 adds a function of selecting a part having an attribute different from the attribute instructed to be selected. For example, it is assumed that a portrait is created by selecting a part having a front attribute. At this time, the selecting unit 3 determines that the type and the ID are the same,
If a part having an attribute of 5 degrees is selected, a portrait at an angle of 15 degrees is synthesized by the synthesizing unit 4 and displayed on the display unit 5.

FIG. 4 is a block diagram showing another embodiment of the present invention. Here, in addition to the configuration of the embodiment shown in FIG.
1 is different from the embodiment shown in FIG. The image of the face part stored in the parts storage unit 1 is selected by the selection unit 3 according to the instruction of the selection instruction unit 2 and synthesized by the synthesizing unit 4 in the same manner as in the embodiment shown in FIG. It is. The deformation instruction unit 11 inputs deformation information such as movement, rotation, enlargement / reduction, and inversion as a user operation for each type of each part, and outputs the instruction information to the synthesis unit 4. The combining unit 4 combines the parts of each part while moving and deforming them based on the instruction information. As a result, it is possible to perform a deformation indicating a facial feature such as "large mouth", "narrow outline", and "drop eyes". These deformations are possible by being represented by operations on two-dimensional images. At this time, the synthesizing unit 4 outputs these pieces of instruction information to the three-dimensional synthesizing unit 8 at the same time. As in the first embodiment, the three-dimensional data having the corresponding ID is selected by the three-dimensional selecting unit 7 and synthesized by the three-dimensional synthesizing unit 8. The three-dimensional synthesizing unit 8, based on the instruction information obtained from the synthesizing unit 4,
Deformation that shows facial features such as "enlarge mouth", "narrow outline", and "drop eyes" is performed. These deformation operations are possible by being expressed by operations on three-dimensional data. The synthesized face of the deformed three-dimensional data is displayed on the three-dimensional display unit 9. This makes it possible to generate three-dimensional face data that can be referred to from other directions in a manner similar to that of the two-dimensional portrait drawing operation.

FIG. 5 is a block diagram showing still another embodiment of the present invention. Here, the difference from the embodiment shown in FIG. 1 is that the list display unit 12 is added as an element in addition to the components of the embodiment shown in FIG. The only difference is that information is output to T.12. The list display unit 12 displays images of parts stored in the parts storage unit 1 in a list. At this time, a list of parts of the type specified by the selection instruction unit 2 may be displayed, or the ID of the parts may be displayed together. The user can determine the ID of the part considered appropriate while referring to the image of the part displayed on the list display unit 12. Also, the three-dimensional data of the parts stored in the three-dimensional parts storage unit 6 is displayed in a list. They may be displayed side by side in association with a two-dimensional image. The user can determine a part for which selection cannot be determined only by referring to the image while referring to the displayed three-dimensional data. Furthermore, the list display unit 12 and the selection instruction unit 2 may be linked to each other, so that the image displayed on the list display unit 12 is clicked to indicate that the selection has been made.

FIG. 6 is a block diagram showing still another embodiment of the present invention. The difference from the embodiment shown in FIG.
1 in addition to the configuration of the embodiment shown in FIG. Three-dimensional selection instruction unit 13
Has a function of inputting the type and ID of the selected part as a user operation and outputting the operation to the three-dimensional selection unit 7.
At this time, the three-dimensional selection unit 7 selects a part from the three-dimensional part storage unit 6 based on the type and ID of the part given from the three-dimensional selection instruction unit 13. In the embodiment illustrated in FIG. 1, the three-dimensional selection unit 7 selects a three-dimensional part associated with the two-dimensional part provided by the selection unit 3. However, when a three-dimensional face is obtained and a face different from the impression intended for drawing is displayed, a request to correct the three-dimensional face is generated. In such a case, the type and ID of the three-dimensional part to be directly selected may be indicated from the three-dimensional selection instruction unit 13. This makes it possible to select a three-dimensional part having an ID different from that of the two-dimensional part.

FIG. 7 is a block diagram showing still another embodiment of the present invention. The difference from the embodiment shown in FIG.
In addition to the configuration of the embodiment shown in FIG.
4 and that the texture selection unit 15 is provided as an element. In each of the embodiments described above, the description has been made such that the three-dimensional data is, for example, a combination of three-dimensional coordinate data and a texture indicating color or density. Also,
It has been assumed that if three-dimensional data for each type is selected, a three-dimensional face is synthesized and displayed. However, the actual three-dimensional data may be considered as a texture that is mapped onto three-dimensional coordinate data and a concave and convex surface obtained by connecting the coordinate data. Here, the three-dimensional parts storage unit 6 stores, for each type of face part, three-dimensional parts associated with an ID and texture data. As shown in FIG. 8, for example, a plurality of pieces of texture data may correspond to one ID. For example, a difference between makeups can be stored as a texture. The texture selection instructing unit 14 inputs the attribute, type, and ID of the texture to be selected as a user operation, and outputs it to the texture selecting unit 15. Here, the attribute of the texture indicates a distinction between a plurality of textures associated with one ID. The texture selecting unit 15 selects texture data from the three-dimensional parts storage unit 6 based on the attribute, type, and ID of the texture, and outputs the selected texture data to the three-dimensional synthesizing unit 8. The three-dimensional synthesizing unit 8 pastes the texture obtained from the texture selecting unit 15 on the three-dimensional data obtained from the three-dimensional selecting unit 7, and outputs the resultant to the three-dimensional display unit 9. Thus, different textures can be pasted on one piece of three-dimensional data, and it is possible to express a difference in face due to makeup. If the expression matches the impression of the object to be drawn, the three-dimensional data and the texture do not necessarily have to correspond.

FIG. 9 is a block diagram showing still another embodiment of the present invention. 1 in that it has a three-dimensional data input unit 17 and a two-dimensional image generation unit 16 as elements in addition to the configuration of the embodiment shown in FIG. 3D data input unit 17
The two-dimensional image generation unit 16 has a function of generating parts stored in the parts storage unit 1 and the three-dimensional parts storage unit 6. The three-dimensional data input unit 17 receives three-dimensional data of a face measured by a stereo camera or a range finder,
The three-dimensional data of the face generated in G is input, and a three-dimensional coordinate sequence and a solid model representing the surface of the face are generated as three-dimensional parts and stored in the three-dimensional parts storage unit 6. The two-dimensional image generation unit 16 converts the three-dimensional data obtained from the three-dimensional data input unit 17 into a two-dimensional image by image processing such as density conversion and contour extraction, and stores the two-dimensional image in the parts storage unit 1. At this time, if image processing is performed in different directions of the three-dimensional data, two-dimensional images in different directions can be generated and stored. This allows
Parts of three-dimensional data and two-dimensional images can be automatically created from three-dimensional measurement data.

As described above, according to the present invention, three-dimensional data is stored in association with two-dimensional part images prepared for each face part, and the types of parts to be selected from outside and their respective IDs are obtained. By selecting the prepared two-dimensional parts, arranging the selected parts at appropriate positions and synthesizing them as a portrait, selecting the three-dimensional parts corresponding to the two-dimensional parts, and obtaining the three-dimensional parts obtained Is placed at an appropriate position for each part, and by referring to the viewpoint change information instructed from the outside, it is synthesized and displayed as a portrait viewed from that viewpoint, and as a result, a portrait based on a two-dimensional part image By simply creating, a face image of the person viewed from another direction can be obtained.

[0019]

As described above, according to the present invention, image parts and three-dimensional data associated with each other are stored, and a portrait is created in consideration of only a two-dimensional image. Because a three-dimensional face image is generated,
Just by creating a portrait based on a two-dimensional image, you can get a portrait that looks at the person from other directions,
The following effects can also be obtained. (1) By storing three-dimensional data in association with two-dimensional image parts, a three-dimensional face can be obtained simultaneously when a two-dimensional portrait is created. (2) The three-dimensional face obtained in the above (1) can be referred to by arbitrarily changing the viewpoint. (3) By associating and storing two-dimensional part images viewed from a plurality of different directions, a three-dimensional face can be obtained at the same time even if parts in different directions are selected for each part of the face. (4) For individual parts in a two-dimensional caricature,
When a deformation operation such as movement or rotation is performed, the same deformation operation is simultaneously reflected on individual three-dimensional data. (5) By displaying a list of two-dimensional images and three-dimensional data side by side, it is possible to select an intended part while comparing both. (6) For two-dimensional images and three-dimensional data,
A selection can be made regardless of the correspondence between the two. (7) Regarding the three-dimensional data, the three-dimensional coordinate data and the texture can be managed separately and individually selected. (8) Generate two-dimensional images from three-dimensional data and automatically
Parts of 2D images and 3D data can be registered.

[Brief description of the drawings]

FIG. 1 is a block diagram showing one embodiment of the present invention.

FIG. 2 is a diagram illustrating an example of a data structure of parts stored in a parts storage unit and a three-dimensional parts storage unit in FIG. 1;

FIG. 3 is a diagram illustrating another example of the data structure of parts stored in the parts storage unit and the three-dimensional parts storage unit in FIG. 1;

FIG. 4 is a block diagram showing another embodiment of the present invention.

FIG. 5 is a block diagram showing still another embodiment of the present invention.

FIG. 6 is a block diagram showing still another embodiment of the present invention.

FIG. 7 is a block diagram showing still another embodiment of the present invention.

8 is a diagram illustrating an example of a data structure of a part stored in a three-dimensional part storage unit in FIG. 7;

FIG. 9 is a block diagram showing still another embodiment of the present invention.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Part storage part, 2 ... Selection instruction part, 3 ... Selection part, 4 ...
Synthesizing unit, 5: display unit, 6: three-dimensional parts storage unit, 7: three-dimensional selecting unit, 8: three-dimensional synthesizing unit, 9: three-dimensional display unit, 1
0: viewpoint change instruction unit, 11: deformation instruction unit, 12: list display unit, 13: three-dimensional selection instruction unit, 14: texture selection instruction unit, 15: texture selection unit, 16: two-dimensional image generation unit, 17 ... 3D data input section

Claims (11)

[Claims] 1. A caricature creation apparatus for creating a caricature by combining a face part as a part, storing three-dimensional data in association with a two-dimensional part image prepared for each of the face parts, and selecting from outside. By obtaining the type of power part and each ID as information, the prepared two-dimensional part image is selected, the selected two-dimensional part image is arranged at an appropriate position, and synthesized as a portrait, Select the 3D data corresponding to the 2D part image, place the obtained 3D data at an appropriate position for each part, and refer to the viewpoint change information specified from the outside as a caricature viewed from that viewpoint A method for creating a three-dimensional portrait, which is characterized by being displayed in a composite manner. 2. A part storage unit that stores a part ID that is divided for each part of the face and indicates each type and a two-dimensional part image prepared corresponding to each of the IDs.
A selection unit that selects a two-dimensional part image from the parts storage unit and sends it to the synthesizing unit by obtaining information on the type and ID of the part to be selected from the outside, and an appropriate position of the selected two-dimensional part image. A three-dimensional part storage unit in which three-dimensional data is stored, which is associated with each of the two-dimensional part images stored in the two-dimensional part storage unit by the ID information, A three-dimensional selection unit that obtains ID information from the selection unit and selects three-dimensional data corresponding to the two-dimensional part image from the three-dimensional part storage unit, and stores the obtained three-dimensional data at an appropriate position for each part. And a three-dimensional compositing unit that refers to viewpoint change information instructed from the outside, synthesizes the portrait as viewed from that viewpoint, and outputs the result to the three-dimensional display unit. Three-dimensional portrait creation device to. 3. The three-dimensional caricature according to claim 2, wherein the two-dimensional part image stored in the part storage unit and the three-dimensional data stored in the three-dimensional part storage unit are allocated to the same table. Creating device. 4. A two-dimensional part stored in the parts storage unit is an image of a part constituting a face as viewed from a different viewpoint, and information of the type and ID of the part supplied from outside is provided. 3. The three-dimensional portrait drawing apparatus according to claim 2, wherein the desired three-dimensional data is obtained by designating the information indicating the viewpoint as attribute information. 5. A deformation instructing unit for instructing deformation information for each type of each part of the face is further added, and the three-dimensional synthesizing unit, based on the deformation information, obtains a three-dimensional part obtained from the three-dimensional parts storage unit. 3. The three-dimensional portrait drawing apparatus according to claim 2, wherein the data is subjected to the operation for the deformation to be combined while being deformed and output to the three-dimensional display unit. 4. 6. A list display unit for displaying a list of two-dimensional part images stored in the parts storage unit, or displaying a list of three-dimensional data stored in the three-dimensional parts storage unit as needed. The method according to claim 2, further comprising obtaining the desired two-dimensional part image or three-dimensional data via the selection instruction unit while referring to the two-dimensional part image or three-dimensional data displayed here. 3D caricature creation device. 7. A face part type and I to be selected from outside
A three-dimensional selection instructing unit that obtains each information of D and supplies the information to the selecting unit is further added.
3. The three-dimensional portrait drawing apparatus according to claim 2, wherein the three-dimensional data having D is directly selected. 8. A three-dimensional data input unit for generating three-dimensional parts by inputting three-dimensional data from the outside, and converting the three-dimensional data obtained through the three-dimensional data input unit into a two-dimensional part image by image processing. The three-dimensional caricature creation device according to claim 2, further comprising a two-dimensional image generation unit for performing the two-dimensional image creation. 9. The three-dimensional portrait drawing apparatus according to claim 8, wherein the input three-dimensional data is generated based on a result obtained by measuring with photographing equipment or computer graphics. 10. The three-dimensional part storage unit is assigned with three-dimensional coordinate data stored in association with the ID for each type of face part and texture data obtained by linking the three-dimensional coordinate data, and is selected. By obtaining as input the attribute, type, and ID information of the texture to be obtained,
The texture data is selected from the three-dimensional part storage unit, the selected texture is pasted on three-dimensional coordinate data obtained from the three-dimensional selection unit, and output to the three-dimensional display unit. Item 3. The three-dimensional portrait drawing apparatus according to Item 2. 11. The texture data stored in the three-dimensional parts storage unit includes at least one texture data for one ID.
The three-dimensional caricature creation device according to claim 10, wherein the three-dimensional caricature creation device is stored correspondingly.