JP2005258537A - Three-dimensional model generating method and device and program and recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To mount a plurality of equipment on a basic shape model by preventing any equipment mounted on the lower part from being forced out of any equipment mounted on the upper part. <P>SOLUTION: A mannequin 102 being a basic shape model is divided into a plurality of sites. An area dividing part 30 divides the image of each site into the internal region of equipment overlapped with first equipment mounted on the upper part of the basic shape model and the external region of equipment by every site, and divides a background image into the internal neighboring background of equipment and the external neighboring background of equipment. Then, a plotting processing part 40 compounds the image of the first equipment on the image of the second equipment, and operates mask processing to the internal neighboring background of equipment set to the first equipment as a mask image. Thus, it is possible to carry out processing to erase the image of the second equipment forced out of the first equipment. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a three-dimensional model generation apparatus and method for generating a three-dimensional model in which a plurality of equipments are mounted on a basic shape model.

  In recent years, with the improvement of image processing capability, 3D model data has been used for presentation of products and the like. By using the three-dimensional model data, it is possible to see various products on a personal computer screen from an arbitrary angle. Various methods have been proposed as a method for photographing such 3D model data (see, for example, Patent Document 1).

  In addition, not only displaying 3D model data but also a system that simulates the appearance by attaching various equipment to a basic shape model displayed using 3D model data has been proposed. For example, a system has been proposed which is used when generating an image when wearing spectacles on an image of his / her face, coordinating clothes, etc., or examining a combination of interiors of a room.

  In such image-based model representation, the model can only be replaced in units of images. For this reason, when wearing equipment such as clothes on a basic shape model such as an existing model, there is a problem that the equipment attached below protrudes from the equipment attached above. Also, when expressing multiple basic shape models in one image, the context can only be specified for the entire model, so the context between models is not unique, that is, the models are entangled The display of was incomplete. For this reason, a large amount of man-hours such as manually correcting the model image has been conventionally required.

For example, in a conventional three-dimensional model generation device, as shown in FIG. 14, a first equipment (outerwear) 1401 and a first equipment 1401 are installed on a basic shape model (mannequin) 1400. When the second equipment 1402 to be attached is worn on top of each other, the model can only be replaced in units of images, which causes a problem that the second equipment 1402 protrudes from the first equipment 1401. I was doing it.
JP 2001-148021 A

The conventional three-dimensional model generation apparatus described above has the following problems.
(1) When a plurality of equipments are attached to the basic shape model, there is a problem that the equipment attached below protrudes from the equipment attached above.
(2) When a plurality of models are expressed in one image, it is impossible to display when the models are intertwined.

  An object of the present invention is to provide a three-dimensional model generation apparatus and method in which, when a plurality of equipments are attached to a basic shape model, the equipment attached below does not protrude from the equipment attached above.

  Another object of the present invention is to provide a three-dimensional model generation apparatus and method capable of expressing as if the models are entangled when a plurality of models are expressed in one image.

In order to achieve the above object, a 3D model generation apparatus of the present invention is a 3D model generation apparatus for generating a 3D model in which a plurality of equipments are mounted on a basic shape model,
A subject control unit that controls to change one or both of the color and brightness of each part obtained by dividing the basic shape model and the background display device when photographing the basic shape model;
The basic shape arranged in front of the background display device via a connected photographing device at a timing when the subject control unit changes the color or brightness of each part of the basic shape model and the background display device. An image capturing unit that captures an image of the model and captures an image of the basic shape model after the first equipment is mounted on the basic shape model;
An image of the basic shape model imaged by the imaging unit is divided into images of each part and background constituting the basic shape model, and the first equipment is based on an image attached to the basic shape model. Then, the image of each part of the basic shape model is divided into an in-equipment area that overlaps with the first equipment and an out-of-equipment area that does not overlap, and a background image before the first equipment is attached to the basic shape model An area dividing unit that divides each area into an in-equipment vicinity background adjacent to the in-equipment area and an out-of-equipment vicinity background adjacent to the out-of-equipment area
An equipment data storage unit in which data of a plurality of equipment to be attached to the basic shape model is stored;
After the image of the second equipment stored in the equipment data storage unit is synthesized with the basic shape model and the image of the first equipment is further synthesized, the second equipment is set for the first equipment. A drawing processing unit that performs a process of deleting the image of the second equipment that protrudes from the first equipment by using the background near the equipment as a mask image;
A display unit that displays a composite image generated in the drawing processing unit to a user.

  According to the present invention, the basic shape model is divided into a plurality of parts, and each part is divided into an equipment internal area and an external equipment area that overlap with the first equipment, and a background image is provided near the equipment internal background and the equipment external area. After dividing the image into the vicinity background and compositing the image of the first equipment on the image of the second equipment, mask processing is performed using the in-equipment vicinity background set for the first equipment as a mask image. Therefore, it is possible to perform processing for deleting the image of the second equipment that protrudes from the first equipment.

  In addition, when the region dividing unit divides the background image into the in-equipment vicinity background and the out-of-equipment vicinity background of each part of the basic shape model, the point is closest to a certain point existing in the background image. It may belong to the vicinity background of the part region, and when the certain point is equidistant from the plurality of part regions, it may belong to the vicinity background of the part region arbitrarily selected from the plurality of part regions.

Further, when combining the plurality of basic shape models in one image, the region dividing unit divides the image of the first equipment into a plurality of layers corresponding to each part of the basic shape model,
The drawing processing unit may set a center coordinate value for each layer of each basic shape model, and perform image synthesis for each layer based on the center coordinate value.

  According to the present invention, by dividing the image of the first equipment into a plurality of layers and setting the center coordinate value for each layer, the context of the basic shape model is not unique, and the basic shape models are entangled. Display can be performed.

As described above, according to the present invention, the following effects can be obtained.
(1) Since the background near the equipment set for the first equipment is used as a mask image and the second equipment that protrudes from the first equipment is deleted, a plurality of equipment is included in the basic shape model. When wearing, the equipment installed below will not protrude from the equipment installed above.
(2) The image of the first equipment is divided into a plurality of layers, and the center coordinate value is set for each layer. Therefore, when expressing a plurality of models in one image, the models are connected to each other. An expression that is tangled is possible.

  Next, embodiments of the present invention will be described in detail with reference to the drawings.

  In this embodiment, a mannequin is used as a basic shape model, clothes are used as equipment to be attached to the basic shape model, and a three-dimensional model generation system and method that coordinates clothes in a virtual space will be described.

  As shown in FIG. 1, the three-dimensional model generation apparatus 100 of the present embodiment includes a subject control unit 10, an imaging unit 20, an area division unit 30, a drawing processing unit 40, an equipment data storage unit 50, The display part 60 is comprised.

  In the present embodiment, a description will be given using a case where a first equipment 11 as a jacket and a second equipment 12 attached under the first equipment 11 are attached to the mannequin 102 which is a basic shape model. To do.

  The subject control unit 10 performs control so as to change one or both of the color and brightness of each part of the mannequin 102 and the background display device 101 when the imaging device 103 captures the mannequin 102 that is a basic shape model. .

  The photographing unit 20 is arranged in front of the background display device 101 via the connected photographing device 103 at a timing when the color or luminance of each part of the mannequin 102 and the background display device 101 is changed by the subject control unit 10. An image of the mannequin 102 is taken. Similarly, the imaging unit 20 captures an image of the mannequin 102 after the first equipment 11 is attached to the mannequin 102.

  The area dividing unit 30 divides the image of the mannequin 102 photographed by the photographing unit 20 into each part and background image constituting the mannequin 102. In addition, the area dividing unit 30 is configured to display an image of each part of the mannequin 102 based on an image in which the first equipment 11 is attached to the mannequin 102 and an equipment outside area that does not overlap the equipment inside area that overlaps the first equipment 11. Divide into Furthermore, the region dividing unit 30 displays the background image before the first equipment 11 is attached to the mannequin 102, the background near the equipment close to the equipment internal area of each part, and the background outside the equipment close to the external area. And divide each.

  The drawing processing unit 40 synthesizes the image of the second equipment 12 stored in the equipment data storage unit 50 with the mannequin 102 and further synthesizes the image of the first equipment 11. On the other hand, the image of the second equipment 12 protruding from the first equipment 11 is deleted by using the background in the equipment vicinity set as the mask image.

  The equipment data storage unit 50 stores data of a plurality of equipments to be attached to the mannequin 102. Here, in order to simplify the description, the data of the second equipment 12 that is clothes to be worn on the mannequin 102 and the data of the first equipment 11 such as a jacket worn on the second equipment 12 are used. Will be described as being stored. The display unit 60 displays the composite image generated in the drawing processing unit 40 to the user.

  Moreover, the area | region division part 30 divides | segments the image of the 1st equipment 11 into the some layer corresponding to each site | part of the mannequin 102, when synthesize | combining several mannequins in one image. Then, the drawing processing unit 40 sets a center coordinate value for each layer of each mannequin, and performs image composition for each layer based on the center coordinate value.

  Next, the operation of the three-dimensional model generation apparatus according to the present embodiment will be described in detail with reference to the drawings.

  First, a method for generating basic shape data, which is data of a basic shape model before mounting equipment, will be described with reference to the flowchart of FIG.

  A mannequin 102, which is a basic shape model, is created separately for each part (step 201), a color / brightness change pattern for each part is set (step 202), and a background color / brightness change pattern is set (step 202). 203). For example, when the background display device 101 is purple, the body color of the mannequin is set to blue, the left arm is red, and the right arm is yellow so that the color of each part can be easily distinguished. The set color / luminance change pattern for each part is set in the subject control unit 10.

  Then, a photograph of the mannequin 102 is taken by the photographing unit 20 via the photographing device 103 (step 204), and the color / brightness is changed in a pattern preset by the subject control unit 10 (step 205). Further, a picture is taken (step 206). Then, the image photographed by the photographing unit 20 is cut out by the region dividing unit 30 into the background and each region (step 207). In the present embodiment, as shown in FIG. 3, the photographed image is divided into a background (E), a torso (B), a neck and collar part (N), a right arm part (AR), and a left arm part (AL).

  If not all of the necessary angle shooting has been completed (step 208), the shooting angle is changed (step 209), and the processing of steps 204 to 207 is repeated. The processing so far is the same as the method described in Patent Document 1 except that a different color / luminance change pattern is set for each part.

  Next, a process for taking a picture by attaching equipment to the mannequin 102 will be described with reference to a flowchart of FIG.

  First, as shown in FIG. 5, the first equipment 11 serving as a jacket is attached to the mannequin 102 (step 401). Then, the mannequin 102 to which the first equipment 11 is attached is photographed by the same method as the photographing method shown in the flowchart of FIG. 2 (steps 401 to 404). Then, a layer and a mask are created for each part (step 405). The processing of step 405 will be described in detail below.

  Further, the processing in steps 402 to 405 is performed at the same shooting angle as that shot in the flowchart of FIG. 2 (step 408). Finally, a minimum rectangle surrounding this layer is obtained for each layer, and a minimum cuboid surrounding one layer is obtained from data of all angles. Then, the center coordinate of the minimum rectangular parallelepiped is set as the center coordinate value of each layer, and the process ends (step 407).

  Specifically, a front view, a side view, and an elevation view are obtained from the front, 90-degree sideways, and directly above images in consideration of the camera angle of view and shooting distance, and the layer is obtained from those views. Find the smallest rectangle that encloses and find the smallest cuboid.

  Next, the processing of step 405 in the flowchart of FIG. 4 will be described with reference to the flowchart of FIG.

  First, the area dividing unit 30 cuts out an equipment area W that is an image of the first equipment 11 from an image obtained by photographing the mannequin 102 to which the first equipment 11 is attached (step 601). Then, the region dividing unit 30 compares the image divided for each part of the mannequin 102 with the image of the equipment region W obtained in step 601, so that the mannequin 102 not wearing the first equipment 11. The image of each part is divided into an in-equipment area that overlaps with the first equipment 11 and an out-of-equipment area that does not overlap (step 602).

  Here, as shown in FIG. 5, the region dividing unit 30 divides the body (B), the neck region (N), the right arm region (AR), and the left arm region (AL), which are the various parts of the mannequin 102, into the body. In-equipment (BI), torso-equipped (BO), collar-equipped (NI), collar-equipped (NO), right-armed (ARI), right-armed (ARO), left-armed (ALI), Divide the left arm out of equipment (ALO). That is, each part which comprises the mannequin 102 which is a basic shape model is each divided | segmented into the part hidden by the 1st equipment 11 which is a jacket, and the part which is not hidden. In FIG. 5, the first equipment 11 is expressed as if it is transparent because the state below the first equipment 11 is made easier to understand. The part hidden in 11 cannot be seen.

  When this area division is expressed by an equation, the equipment area of the first equipment 11 is represented as W, each part area is represented as P, the equipment internal area of this part area P is represented as I (P), and the equipment outside area is represented as O (P). if you did this,

Can be expressed as

  Then, the area dividing unit 30 divides the background image before mounting the first equipment 11 into the in-equipment vicinity background close to the in-equipment area and the out-equipment vicinity background close to the out-of-equipment area (step) 603).

  In this embodiment, as shown in FIG. 7, the background (E) is the background near the fuselage equipment (BIE), the background outside the fuselage equipment (BOE), the background near the neck collar equipment (NIE), and the neck collar equipment outside. It is divided into a near background (NOE), a right arm equipment near background (ARIE), a right arm equipment outside background (AROE), a left arm equipment near background (ALIE), and a left arm equipment outside vicinity background (ALOE).

  As a method for dividing the background (E), for example, the following procedure is used.

  (1) For a certain point A existing in the background (E), when the part region closest to the point A among the part regions is Y, the point A shall belong to the Y vicinity background (EY).

  (2) When a certain point A is equidistant from a plurality of part regions under the above conditions (boundary region), it is made to belong to the vicinity background of the part region arbitrarily selected from those part regions.

  (3) The neighboring background to which each point in the background (E) belongs is determined based on the determination criteria (1) and (2) above.

  Each of the in-equipment near backgrounds (BIE), near-neck-equipment near-background (NIE), right-arm-equipment near-background (ARIE), and left-arm-equipment near-background (ALIE) Is set as a mask image.

  Here, if the mask image of the part region P is expressed as M (P, W) and the background near the arbitrary region K is expressed as N (K), it is expressed as M (P, W) = N (I (P)). Can do.

  Furthermore, the area dividing unit 30 divides the equipment area W obtained in step 601 into a plurality of layers (step 604). As a specific method of layer division, a region obtained by combining the region of each part of the mannequin 102 and the in-equipment vicinity background and the out-of-equipment vicinity background is a sum region, and the sum region overlaps with the equipment region W. The region (product region) is a layer corresponding to the part of the first equipment 11. For example, the right arm layer (ARL) is a product area of the right arm region (AR), the sum region of the in-equipment vicinity background (ARIE) and the right arm out-of-equipment vicinity background (AROE) of the right arm region, and the equipment region W. . Similarly, by creating the body layer (BL), the left arm layer (ALL), and the neck and collar region layer (NL), the equipment region W has four layers (ARL, BL, ALL, as shown in FIG. 8). , NL).

  When this layer division is expressed by an equation, if the layer of the part P of the equipment region W of the first equipment 11 is L (P, W),

Can be expressed as

  Then, as described above, in step 407 in the flowchart of FIG. 4, for each of these four layers (ARL, BL, ALL, NL), a minimum cuboid surrounding this layer is obtained for each layer, and this minimum cuboid is obtained. Is set as the center coordinate value of each layer.

  A drawing mannequin having the same shape as the basic shape and colored for drawing can be photographed and a layer mask can be created. However, when shooting, it may be replaced instead of being attached to the basic shape mannequin.

  Next, the processing of the drawing processing unit 40 when a plurality of equipments are attached to the mannequin and drawn using each layer and mask image obtained as described above will be described.

  First, a drawing method when the mannequin is a single unit will be described with reference to the flowchart of FIG.

  The drawing processing unit 40 selects a layer mask having an angle closest to the viewpoint / distance to be viewed first (step 901). Then, the layer mask farthest from the viewpoint is selected (step 902).

  As for the overlapping order, drawing is started from a layer whose center coordinate value is the same as that of the screen. For example, when the model displays leftward, overwriting is performed in the order of left arm layer (ALL) → neck and collar region layer (NL) → body layer (BL) → right arm layer (ARL). In the same layer, drawing is performed according to the order of equipment specified by the user (the order of equipment below). However, the normal mannequin layer for drawing is equipped at the bottom. Therefore, first, the layer L (P, W) and the mask M (P, W) of the equipment W that overlaps the lowermost layer for one layer are selected (step 903), and the layer L (P, W) is overwritten on the screen. The mask M (P, W) is overwritten with the background color (step 904). When drawing of all equipment is completed (step 905), the drawing processing unit 40 performs the same processing for the next layer (steps 903 and 904). When drawing processing for all layers is completed, the drawing processing unit 40 performs processing. The process ends (step 906).

  In step 904, when the equipment is drawn, by using the background in the vicinity of each part equipment as a mask of the equipment to be worn below, the lower equipment drawn in the mask is overwritten and deleted. As a result, the protrusion is removed by layering. For example, at the time of drawing the right arm layer (ARL), the right arm layer (ARL) area of the equipment attached below is masked by the right arm equipment inner vicinity background (ARIE) of the equipment attached above.

  As one of the equipments, by replacing an object having the same shape as the basic shape model with the basic shape model and photographing, the body part data can also be created consistently by the above method.

  FIG. 10 shows a process when the second equipment 12 is mounted on the mannequin 102 and the first equipment 11 is further mounted thereon on the mannequin 102 by the above processing.

  The image shown in FIG. 10A is an image in which the second equipment 12 is attached to the mannequin 102. An image in which the first equipment 11 is overwritten on the image in FIG. 10A is shown in FIG. ) In FIG. 10B, there is a portion where the second equipment 12 protrudes from the background near the equipment. Then, as shown in FIG. 10 (c), the first equipment 11 is overwritten with each equipment neighboring area (BIE, ARIE, NIE, ALIE) set as a mask. The second equipment 12 protruding from the equipment 11 can be deleted. In FIG. 10C, since the background outside the equipment is not masked, the second equipment 12 protruding from the sleeve of the first equipment 11 is drawn without being masked.

  Next, a drawing method when there are a plurality of mannequins will be described. When drawing a plurality of objects, an image obtained by independently drawing a single object for each layer is prepared. At that time, the center coordinates of each layer are prepared together. Then, the drawing processing unit 40 synthesizes each single image into a single composite image.

  In this case, each single unit is arranged at a desired position in the virtual space, and the position of each layer on the virtual space coordinates is calculated from the center coordinates of each layer. In the calculation of the layer position, when equipment is overlapped, a minimum rectangular parallelepiped surrounding the equipment image in the same layer is created and the center coordinates thereof are used. Finally, the drawing processing unit 40 creates a composite image by perspectively projecting the composite screen viewed from a desired viewpoint according to the coordinate value for each layer. By this processing, calculation is performed as if a standing signboard is standing for each layer.

  Processing of the drawing processing unit 40 that combines the plurality of mannequins in one screen will be described with reference to the flowcharts of FIGS. 11 and 12.

  First, drawing data is created for each object and each layer (step 1101). This process will be described in detail below with reference to the flowchart of FIG. A layer farthest from the viewpoint is selected (step 1102), and the screen of the selected layer is overwritten (step 1103). Then, when the drawing processing for all objects and all layers is completed, the processing is terminated (step 1104).

  Next, a method of creating drawing data for each object and each layer in step 1101 will be described with reference to the flowchart of FIG.

  First, an object to be drawn is selected (step 1201). This selection may be in any order. Then, a layer mask having an angle closest to the viewpoint / distance to be viewed is selected (step 1202). Then, the layer mask data is selected in an arbitrary order (step 1203), and the layer L (P, W) and mask M (P, W) of the equipment W that overlaps the lowest among the undrawn equipment for one layer. (Step 1204), the layer L (P, W) is overwritten on the screen, and the mask M (P, W) is overwritten with the background color (step 1205). When drawing of all equipment is completed (step 1206), the next layer / mask data is selected (step 1203) and the same processing is performed (steps 1204, 1205), and the selected object / selected layer drawing data is registered. (Step 1207). When drawing processing for all layers is completed (step 1208), the next object is selected (step 1201) and the same processing is performed (steps 1202 to 1208). When the drawing process for all objects is completed, the process is terminated (step 1209).

  An example of the image generated in this way is shown in FIG. FIG. 13 shows a case where two mannequins 1301 and 1302 are combined with clothes. In FIG. 13, the center coordinate value of the mannequin 1302 is set closer to the viewpoint than the center coordinate value of the mannequin 1301, but only the left arm of the mannequin 1301 is positioned in front of the right arm of the mannequin 1302. It is shown.

  As described above, in this embodiment, by dividing the image of the first equipment 11 into a plurality of layers and setting the center coordinate value for each layer, the basic shape model is not unique in the context, and the basic shape It is possible to display the models as if they were entangled.

  However, when drawing with the method described above, there may be a case where the image of the equipment attached below is discontinuously cut off at the boundary between the equipment interior background and the equipment outside background. obtain. Therefore, in order to alleviate the image being unnaturally cut and unsightly, the opacity (α value) is inclined at the boundary when the background image is divided into the background near the equipment background and the background outside the equipment. ). In this case, in addition to the in-equipment vicinity background as a mask, the out-equipment vicinity background is also used for drawing.

  When the opacity (α value) is smaller than 1, the image mounted below can be seen through a little. By setting the α value slightly smaller on the boundary of the mask and setting the original value to 1 as it goes away from the boundary, it is possible to alleviate unnatural cuts in the vicinity of the boundary. Further, even if the α value is given only to the mask side of the boundary, it is possible to eliminate the unnatural difference. A specific method for reducing the unnaturalness by providing the α value and blurring the boundary will be described below.

It is assumed that the α value S and the inclination ratio T on the boundary line are designated as parameters. The point x in each area of the equipment near background obtained by dividing the background image and the neighboring background outside the equipment and the distance to the area boundary are the shortest boundary points (both when dividing the background) If the distance from the point (the point determined to be equidistant from the region) is Lx, the α value (α (x)) at the point x is
α (x) = min (1, S + T · Lx).

  At the time of single drawing, at the point of the background region other than the mask (non-equipment nearby background), the updated pixel value of the point is expressed as α (x) · (pixel value before update) + (1−α (x) ) · (Background color), and for the point on the mask of the layer, the pixel value of the point is α (x) · (background color) + (1−α (x)) · (pixel value before update) Update to draw.

  The drawing method described in the single drawing section corresponds to the case where α (x) = 1. The addition of the α value is an extension of a single drawing method.

  In this embodiment, the case where a plurality of clothes are superimposed on the model has been described. However, the present invention is not limited to this, and the same applies to a case where a plurality of equipment is superimposed on the basic shape model. The present invention can be applied to.

  In the data creation method, by providing an interactive area editing method, more accurate area division is possible. With this editing operation, it is possible to efficiently create a mask layer by a simple manual operation.

  In addition, when editing the data divided into the in-equipment area and the out-of-equipment area, each part area is deformed by obtaining the logical sum of the figure designated by the user for the area designated by the user. An area transformation operation by subtracting the designated figure from the area other than the designated area may be provided. Then, after the change operation is performed, processing after the background division processing for dividing the background image into the in-equipment vicinity background and the out-of-equipment vicinity background is performed.

  Further, the above deformation operation may be applied to each image divided into the in-equipment vicinity background and the out-equipment vicinity background.

  Although not shown in the figure, the three-dimensional model generation apparatus of the present embodiment includes a recording medium on which a program for executing the three-dimensional model generation method described above is recorded. This recording medium may be a magnetic disk, a semiconductor memory, or another recording medium. This program is read from the recording medium into the 3D model generation device and controls the operation of the 3D model generation device. Specifically, the above processing is realized by the CPU in the three-dimensional model generation device instructing the hardware resources of the three-dimensional model generation device to perform specific processing under the control of this program.

It is a block diagram which shows the structure of the three-dimensional model production | generation apparatus of one Embodiment of this invention. It is a flowchart which shows the method of producing | generating the basic shape data which is the data of the basic shape model before mounting | wearing equipment. It is a figure for demonstrating each site | part which comprises the mannequin. It is a flowchart which shows the process at the time of mounting | wearing with the mannequin 102 and taking a photograph. It is a figure which shows a mode at the time of mounting | wearing the mannequin 102 with the 1st equipment 11 used as a jacket. It is a flowchart which shows the process of step 405 in the flowchart of FIG. 4 in detail. It is the figure which showed a mode that a background (E) was divided | segmented into the equipment near vicinity background of each site | part, and the non-equipment vicinity background. It is the figure which showed a mode that an equipment area | region was divided | segmented into four layers (ARL, BL, ALL, NL). It is a flowchart which shows the drawing method in case a mannequin is single. It is a figure which shows the process at the time of mounting | wearing the mannequin 102 with the 2nd equipment 12, and also mounting | wearing with the 1st equipment 11 on it. It is a flowchart which shows the process which synthesize | combines several mannequins in one screen. It is a flowchart which shows the process of step 1101 in FIG. 11 in detail. It is a figure which shows the image which combined what put on clothes to two mannequins 1301 and 1302. FIG. It is a figure for demonstrating the mode at the time of carrying out layering by the conventional three-dimensional model production | generation apparatus.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Subject control part 11 1st equipment 12 2nd equipment 20 Image pick-up part 30 Area division part 40 Drawing process part 50 Equipment data storage part 60 Display part 100 3D model production | generation apparatus 101 Background display apparatus 102 Mannequin 103 Image pick-up apparatus 201- 209 Step 401 to 408 Step 601 to 604 Step 901 to 906 Step 1101 to 1104 Step 1201 to 1208 Step 1301 and 1302 Mannequin 1400 Basic shape model (Mannequin)
1401 First equipment (outerwear)
1402 Second equipment E Background B Torso N Neck collar part AR Right arm part AL Left arm part BL Torso layer NL Neck collar part layer ARL Right arm layer ALL Left arm layer BIE Body part inside background BOE Body part outside background NIE Inside neck part Neighborhood background NOE Neck collar equipment outside background ARIE Right arm equipment inside neighborhood background AROE Right arm equipment outside neighborhood background ALIE Left arm equipment inside neighborhood background ALOE Left arm equipment outside neighborhood background

Claims (13)

A 3D model generation method for generating a 3D model in which a plurality of equipment is mounted on a basic shape model,
The basic shape model is imaged by the imaging unit by changing one or both of color and brightness for each part into which the basic shape model is divided, and the captured image is divided into the respective parts and the background image, respectively. Steps,
After mounting the first equipment mounted on the upper side of the other equipment to the basic shape model, by taking one or both of the color and brightness again for each part, and photographing the basic shape model, Dividing the image of each part into an equipment inside area that overlaps with the first equipment and an equipment outside area that does not overlap;
The background image before attaching the first equipment to the basic shape model is the background near the equipment close to the equipment internal area of each part of the basic shape model, and the vicinity outside the equipment close to the external equipment area. Dividing each into a background,
After the image of the second equipment is synthesized on the image of the basic shape model and the image of the first equipment is synthesized, the background in the equipment neighborhood set for the first equipment is masked. And a step of deleting the second equipment protruding from the first equipment by using as a three-dimensional model generation method. The step of dividing the background image into an in-equipment vicinity background and an out-of-equipment vicinity background of each part of the basic shape model,
Causing a point present in the background image to belong to the background near the nearest part region;
2. The three-dimensional method according to claim 1, further comprising the step of: when the certain point is equidistant from a plurality of part regions, belonging to a vicinity background of a part region arbitrarily selected from the plurality of part regions. Model generation method.   When combining a plurality of basic shape models in one image, the image of the first equipment is divided into a plurality of layers corresponding to each part of the basic shape model, and each layer of each basic shape model The three-dimensional model generation method according to claim 1, further comprising a step of setting a center coordinate value for each layer and performing image synthesis for each of the layers based on the center coordinate value. The step of deleting the image of the second equipment that protrudes from the first equipment by using the background near the equipment as a mask image,
For each point in each area of the equipment vicinity background and the equipment vicinity background adjacent to the equipment vicinity background, the distance to the area boundary between the equipment vicinity background and the equipment vicinity background 4. The method of generating a three-dimensional model according to claim 1, further comprising: setting opacity based on the opacity, and calculating a pixel value of a point in each area based on the opacity. 5. A three-dimensional model generation device for generating a three-dimensional model in which a plurality of equipment is mounted on a basic shape model,
A subject control unit that controls to change one or both of the color and brightness of each part obtained by dividing the basic shape model and the background display device when photographing the basic shape model;
The basic shape arranged in front of the background display device via a connected photographing device at a timing when the subject control unit changes the color or brightness of each part of the basic shape model and the background display device. A photographing unit for photographing an image of the model, and photographing an image of the basic shape model after the first equipment is mounted on the basic shape model;
An image of the basic shape model imaged by the imaging unit is divided into images of each part and background constituting the basic shape model, and the first equipment is based on an image attached to the basic shape model. Then, the image of each part of the basic shape model is divided into an in-equipment area that overlaps with the first equipment and an out-of-equipment area that does not overlap, and a background image before the first equipment is attached to the basic shape model A region dividing unit that divides each of the area into the in-equipment vicinity background adjacent to the in-equipment area and the out-of-equipment vicinity background adjacent to the out-of-equipment area,
An equipment data storage unit in which data of a plurality of equipment to be attached to the basic shape model is stored;
After the image of the second equipment stored in the equipment data storage unit is synthesized with the basic shape model and the image of the first equipment is further synthesized, the second equipment is set for the first equipment. A drawing processing unit that performs a process of deleting the image of the second equipment that protrudes from the first equipment by using the background near the equipment as a mask image;
A three-dimensional model generation apparatus comprising: a display unit that displays a composite image generated in the drawing processing unit to a user.   When dividing the background image into the in-equipment vicinity background and the out-of-equipment vicinity background of each part of the basic shape model, the region dividing unit is a part region where the point is closest to a certain point existing in the background image 5. The method according to claim 4, wherein when a certain point is equidistant from a plurality of part regions, the point belongs to a vicinity background of a part region arbitrarily selected from the plurality of part regions. 3D model generator. The region dividing unit, when combining a plurality of basic shape models in one image, divides the image of the first equipment into a plurality of layers corresponding to each part of the basic shape model,
The said drawing process part sets a center coordinate value for each layer of each said basic shape model, and performs image composition for each said layer based on this center coordinate value. Dimensional model generator.   The drawing processing unit uses the in-equipment vicinity background as a mask image to delete the image of the second equipment that protrudes from the first equipment, and the in-equipment vicinity background and the in-apparatus vicinity background. Opacity is set based on the distance to the area boundary between the in-equipment vicinity background and the out-of-equipment vicinity background for each point in each area with the out-of-equipment vicinity background adjacent to The three-dimensional model generation device according to any one of claims 5 to 7, wherein a pixel value of a point in each region is calculated based on the basis. A program for causing a computer to execute a 3D model generation method for generating a 3D model in which a plurality of equipment is mounted on a basic shape model,
The basic shape model is imaged by the imaging unit by changing one or both of color and brightness for each part into which the basic shape model is divided, and the captured image is divided into the respective parts and the background image, respectively. Processing,
After mounting the first equipment mounted on the upper side of the other equipment to the basic shape model, by taking one or both of the color and brightness again for each part, and photographing the basic shape model, A process of dividing the image of each part into an equipment inside area that overlaps with the first equipment and an equipment outside area that does not overlap;
The background image before attaching the first equipment to the basic shape model is the background near the equipment close to the equipment internal area of each part of the basic shape model, and the vicinity outside the equipment close to the external equipment area. A process of dividing each into a background,
After the image of the second equipment is synthesized on the image of the basic shape model and the image of the first equipment is synthesized, the background in the equipment neighborhood set for the first equipment is masked. A program for causing a computer to execute a process of deleting the second equipment that protrudes from the first equipment. The process of dividing the background image into the in-equipment vicinity background and the out-of-equipment vicinity background of each part of the basic shape model,
A process for causing a point existing in the background image to belong to the vicinity background of the closest region,
The program according to claim 9, further comprising: a process in which, when the certain point is equidistant from a plurality of part regions, it belongs to a vicinity background of a part region arbitrarily selected from the plurality of part regions.   When combining a plurality of basic shape models in one image, the image of the first equipment is divided into a plurality of layers corresponding to each part of the basic shape model, and each layer of each basic shape model The program according to claim 9 or 10, wherein a center coordinate value is set every time, and a computer further executes a process of performing image composition for each layer based on the center coordinate value. In the process of deleting the image of the second equipment that protrudes from the first equipment by using the background near the equipment as a mask image,
For each point in each area of the equipment vicinity background and the equipment vicinity background adjacent to the equipment vicinity background, the distance to the area boundary between the equipment vicinity background and the equipment vicinity background 12. The program according to claim 9, wherein an opacity is set based on the opacity, and a process of calculating a pixel value of a point in each region based on the opacity is performed. A computer-readable recording medium on which the program according to any one of claims 9 to 12 is recorded.

Images