JP2003067725A - Three-dimensional image creation system and three- dimensional image creation method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a three-dimensional image creation system that can create a three-dimensional image contoured along an object itself even if the object is covered with a jacket. SOLUTION: A plurality of infrared cameras 20 are used to shoot a measured person 10 wearing clothes along with the background, a PC 30 is used to generate a plurality of contour images from different viewpoints from the obtained object images, and voxel data on the measured person 10 are extracted from the contour images. Since the temperatures of the clothes that the measured person 10 wears and the background are lower than the body temperature of the measured person 10, the generation of the contour images enables the extraction of the contours of the measured person 10 him/herself. Measurements of the measured person 10 can be thereby measured with the clothes kept on.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a three-dimensional image creating apparatus and a three-dimensional image creating method for creating a three-dimensional image of an object.

[0002]

2. Description of the Related Art Conventionally, as this type of three-dimensional image forming apparatus, an apparatus for irradiating an object with a laser beam to create a three-dimensional image from this irradiation pattern or a stereo method from an image taken by a multi-lens camera has been used. A device for creating a three-dimensional image has been proposed. With such a device, the outer surface shape of the object can be obtained.

In the medical field, an MRI (Magnetic Resonance Imaging) apparatus using nuclear magnetic resonance is used. The internal structure of an object can be photographed using an MRI apparatus.

[0004]

However, the apparatus for obtaining the outer surface shape of the object has a problem that the outer shape of the object itself cannot be photographed when the object is covered with the exterior. It was For example, even if an attempt is made to obtain a silhouette shape in order to measure the size of a human body (person to be measured) who wears clothes, only the silhouette shape of clothes is obtained, and it is difficult to measure the person to be measured. Therefore, the person to be measured needs to take off clothes and wear a swimsuit at the time of measurement.

Further, the MRI apparatus can measure the internal structure of an object, for example, the size of a person to be measured who wears clothes, but at the time of measurement, the person to be measured does not stand still for a relatively long time. There was a problem that it should not be. Also,
Since the MRI apparatus is an expensive and large-sized apparatus, it cannot be used easily.

The present invention has been made in order to solve the above problems, and it is possible to create a three-dimensional image of the contour of the object itself even if the object is covered with an exterior. An object of the present invention is to provide an apparatus and a three-dimensional image creating method.

[0007]

A three-dimensional image creating apparatus according to the present invention is a three-dimensional image creating apparatus for creating a three-dimensional image of an object, which is arranged around the object and the object is A photographing means for photographing an object image by photographing with a background, and a plurality of contour images of the object itself from a plurality of object images having different viewpoints obtained by the photographing means, and three-dimensionally measuring the object from each contour image. And an image creating means for creating an image.

In the three-dimensional image creating apparatus of the present invention, the three-dimensional image of the object is created by using the contour image of the object itself. Therefore, even if the object is covered with the exterior, the contour of the object itself is displayed. It is possible to create a three-dimensional image.

In the three-dimensional image forming apparatus of the present invention, the photographing means may be a means for photographing invisible light to obtain an object image. By doing so, it is possible to preferably create a three-dimensional image of the contour when the object is a heat generating object. In this three-dimensional image creating apparatus, the photographing means may be a camera in which a visible light cut filter is arranged in front of an optical lens, and the visible light cut filter is detachably provided in the camera. It can also be assumed that it has been.

In the three-dimensional image creating apparatus of the present invention, the image creating means creates a contour image by dividing the object image into a background area and an object area based on a preset threshold value. It may be provided with a section. By doing so, it is possible to preferably generate the contour image. Further, in this three-dimensional image creating apparatus, the image generating means may include a hole filling processing unit that performs a hole filling process using the small background area existing in the object area of the contour image as the object area. it can.

In the three-dimensional image forming apparatus of the present invention in which the photographing means is a means for photographing invisible light, a background plate having a temperature lower than the temperature of the object and arranged as a background of the object is provided. It may be provided. In this case, the temperature difference between the background and the object becomes large, which makes it easier to create a contour image of the object.

In the three-dimensional image forming apparatus of the present invention, a plurality of the photographing means are arranged around the object, and the image generating means is constructed from the object images obtained by the plurality of photographing means. It is also possible to create a plurality of contour images of the object itself and create a three-dimensional image of the object from each of the contour images. By using a plurality of photographing means, the object can be photographed from different viewpoints at a time, so that the time for keeping the object stationary can be suppressed.

The three-dimensional image creating method of the present invention is a three-dimensional image creating method for creating a three-dimensional image of an object, wherein the object is viewed from different viewpoints by using photographing means arranged around the object. A capturing step for capturing an object image by capturing the background with a background, a contour image generating step for generating a plurality of contour images of the object from a plurality of object images obtained by photographing and having different viewpoints, and the object from the contour image And a three-dimensional image creating step of creating a three-dimensional image.

In the three-dimensional image creating method of the present invention, since the three-dimensional image of the object is created using the contour image of the object itself, the contour of the object itself is covered even if the object is covered with the exterior. It is possible to create a three-dimensional image.

In the three-dimensional image forming method of the present invention, the photographing step may photograph the temperature distribution. By doing so, it is possible to preferably create a three-dimensional image of the contour when the object is a heat generating object.

In the three-dimensional image creating method of the present invention, the image creating step creates a contour image by dividing the object image into a background area and an object area based on a preset threshold value. It may be provided with steps. By doing so, it is possible to preferably generate the contour image. In such a three-dimensional image creating method, the image generating step may include a hole filling processing step of performing a hole filling process using the small background area existing in the object area of the contour image as the object area. it can.

In the three-dimensional image creating method of the present invention, in the photographing step, a plurality of objects are arranged around the object to photograph the object from different viewpoints at a time using photographing means, and the contour image forming step. Can also create a plurality of contour images of the object itself from the respective object images obtained by the plurality of photographing means. This way
Since the object can be imaged from different viewpoints at the same time by using the plurality of imaging means, it is possible to suppress the time for keeping the object stationary.

[0018]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention (hereinafter referred to as embodiments) will be described below with reference to the drawings. In the drawings, members having the same or the same functions are designated by the same reference numerals and the description thereof will be omitted.

FIG. 1 is a block diagram showing the outline of the configuration of a three-dimensional image creating apparatus 100 of this embodiment, which is applied to the measurement of the size of the bust, hip, etc. of a subject 10 wearing clothes. The three-dimensional image creating apparatus 100 includes a plurality of infrared cameras 20 arranged around the subject 10 at equal intervals, and a personal computer (PC) 30 capable of transmitting and receiving data to and from each infrared camera 20.

General charge-coupled device (CCD) for visible light
In the camera, an infrared cut filter is provided on all CCDs. On the other hand, the infrared camera 20 removes the infrared cut filter provided in the front part of the CCD of the charge coupled device (CCD) camera, and provides a visible light cut filter in the front part of the CCD instead of the infrared cut filter. It is configured as a camera, and the temperature distribution between the person to be measured 10 and the background can be photographed as a shaded image. FIG. 2 is a diagram showing an example of an image of the infrared camera 20 arranged in front of the person to be measured 10. Normally, in an image taken by an infrared camera, the temperature distribution is shown by the density of the image, but in FIG. 2, the temperature distribution is shown as contour lines for the sake of explanation. The clothes and background worn by the person to be measured 10 are generally lower than the body temperature of the person to be measured 10. Therefore, in the object image obtained from the infrared camera 20,
The clothes and the background are regions where the temperature is low, and the subject 10 is regions where the temperature is high. A plurality of object images obtained from each infrared camera 20 are AD-converted and transmitted to the PC 30 as object image data. In addition, each infrared camera 20
It does not have to be arranged at equal intervals. In addition, it is preferable to arrange more cameras for a region that requires more accurate shape information.

The PC 30 is a central processing unit (CPU)
And a read-only storage device (ROM) that stores a processing program, a rewritable storage device (RAM) that temporarily stores data, an input / output port, and the like. Equipped with. The PC 30 temporarily stores the object image data transmitted from each infrared camera 20 in the RAM, and then transfers it to the CPU via the input / output port. The CPU creates three-dimensional image data by using the transferred object image data.
Various data created by the CPU can be displayed on the display device 32 connected to the PC 30.

Next, a method of creating a three-dimensional image using the three-dimensional image creating apparatus 100 configured as described above will be described. FIG. 3 is a flowchart showing a three-dimensional image creating method. Before photographing the person to be measured 10 and the background,
The position of each infrared camera 20 is calculated (step S10).
0). First, a reference object having a plurality of reference patterns whose three-dimensional positions are known is arranged so as to capture the subject 10, and each infrared camera 20 captures this reference object. Then, the reference pattern is extracted from the photographed image and Hou
coordinate transformation parameters (x, y, z, etc.) used to calculate the camera position with respect to the reference object using the gh transformation method or the like.
α, β, γ) is obtained. The three-dimensional image creating apparatus 100
Since an infrared camera is used as a means for capturing an image, it is desirable that this reference pattern is a heating element.

After step S100, the person to be measured 10 is placed in place of the reference object, and each infrared camera 20 photographs the temperature of the person to be measured 10 and the background from different viewpoints at once (step S200). Each infrared camera 20 transmits the captured image as object image data to the PC 30,
30 stores the object image data in the RAM.

Next, the PC 30 creates a three-dimensional image based on the input object image data (step S).
300). FIG. 4 is a flowchart showing details of the image creating step (step S300) executed by the CPU of the PC 30. The PC 30 transfers the object image data stored in the RAM to the CPU via the input / output port, and the CP
U is for the object image data of each infrared camera 20,
For example, a region having a temperature (36 ° C.) or lower corresponding to the body temperature is used as a background region, and a region having a temperature of 36 ° C. or higher is used as the measurement subject 10 region to perform a binarization process to generate a contour image (step S
310). FIG. 5 is a diagram showing an example of a contour image generated from the image shown in FIG. Here, a region regarded as the background is a background region 50, and a region regarded as the measurement subject 10 is an object region 52.

Here, if there is some error in the image of each infrared camera 20, as shown in FIG.
Background areas 50, which should not be present in 2, may occur like holes. In this case, the background area 5 in the object area 52
Fill-in processing is performed with 0 as the object area (step S3).
20), a contour image is generated as shown in FIG. This fill-in processing labels the background area 50 of the contour image, focusing on that the contour image shown in FIG. 5 should originally have one background area 50 and one object area 52, The adjacent labels are regarded as one aggregate, and the largest of the region sizes (the number of pixels) of each aggregate is set as the background region 50, and the region other than the background region 50 is set as the object region 52. . By doing so, the contour of the person to be measured 10 itself can be extracted as an image.

Each contour image of each infrared camera 20 obtained in step S320 is reconstructed to represent the measurement subject 10 as a set of voxel data, which is the data of the three-dimensional image (step S330). . Such a reconstruction method, for example, projects a voxel on one contour image, determines that the voxel is not the measured person 10 at this time if it is projected outside the contour of the object, and if it is projected within the contour, A method in which it is determined that the person to be measured 10 is determined, and such a determination is performed on each contour image obtained from each infrared camera, and only the voxels that are determined to be the person to be measured 10 are extracted and used as voxel data. Can be used.
If an error occurs in the contour image, for example, the document “A portable 3D Digitize” is used.
r "International Conference
e on Recent Advances in 3
-D Digital Imaging and Mo
deling, pp. The voting scheme described in 197-204 (1997) can also be used to correct the error.

The voxel data thus represented may be used as a three-dimensional image of the person to be measured 10, and the dimensions of the person to be measured 10 may be calculated based on the three-dimensional image or displayed on the display device 32. However, in applications that calculate dimensions and display them on a display device,
Some of them are based on the assumption that the person to be measured 10 is represented by polygon data. In this case, it is preferable to first extract the surface voxels of the object, convert the voxel surfaces into minute polygons, and then convert the voxel data into an appropriate number of polygon data using well-known polygon reduction processing. is there.

As described above, in the three-dimensional image creating apparatus 100 of this embodiment, the temperature distribution between the person to be measured 10 and the background is photographed by the plurality of infrared cameras 20, so that the person to be measured 10 wears clothes. In this state, the contour image of the person to be measured 10 can be generated. As a result, the measured person 10
You can create a three-dimensional image of your contour. Further, by using the plurality of infrared cameras 20, it is possible to obtain a plurality of contour images taken from different viewpoints in one shooting, and thus it is possible to suppress the time for which the person 10 to be measured is kept still.

In the three-dimensional image creating apparatus 100 of this embodiment, a background plate having a temperature lower than the body temperature of the person to be measured 10 may be arranged so as to surround the outer circumference of each infrared camera 20 shown in FIG. By doing so, the temperature difference between the background and the person to be measured 10 becomes large, and it becomes easier to create a contour image of the person to be measured 10.

Further, the three-dimensional image creating apparatus 1 of this embodiment
In 00, a plurality of infrared cameras were placed around the person to be measured 10 to capture object images with different viewpoints.
The person to be measured 10 may be placed on a turntable and the person to be measured 10 may be rotated and photographed by one infrared camera arranged at a fixed position. This makes it possible to take a contour of the person to be measured 10 with a small number of cameras even though the person to be measured 10 wears clothes, although the time to keep the person to be measured 10 stationary becomes long.

In the three-dimensional image creating apparatus 100 of the present embodiment, the temperature of the person to be measured 10 and the temperature of the background are photographed by the infrared camera, but the measurement is made by using other photographing means such as ultrasonic waves or X-rays. The contour of the person 10 itself may be photographed.

[0032]

In the three-dimensional image creating apparatus of the present invention, the three-dimensional image of the object is created by using the contour image of the object itself. Therefore, even if the object is covered with the exterior, the object itself is covered. It is possible to create a three-dimensional image of the contour.

[Brief description of drawings]

FIG. 1 is a configuration diagram showing an outline of a configuration of a three-dimensional image creating apparatus 100 of the present embodiment which is applied to measurement of dimensions of a measurement subject 10 who wears clothes.

FIG. 2 is a diagram showing an example of an image of an infrared camera 20 arranged in front of the person to be measured 10.

FIG. 3 is a flowchart showing a three-dimensional image creating method.

FIG. 4 is a flowchart showing details of an image creating step (step S300) executed by the CPU of the PC 30.

5 is a diagram showing an example of a contour image generated from the image shown in FIG.

FIG. 6 is a diagram when a hole-filling process is applied to the contour image shown in FIG.

[Explanation of symbols]

10 person to be measured, 20 infrared camera, 30 personal computer (PC), 100 three-dimensional image creating apparatus.

   ─────────────────────────────────────────────────── ─── Continued front page    (72) Inventor Toru Kitamura             2-5-3 Keihan Hondori, Moriguchi City, Osaka Prefecture             Within Yo Denki Co., Ltd. F term (reference) 2F065 AA04 AA31 AA53 BB05 CC16                       EE00 FF05 FF61 GG09 JJ03                       JJ05 LL26 QQ00 QQ24                 5B050 AA10 BA09 BA12 DA07 EA06                       EA26 FA02                 5B057 BA07 CA12 CB13 CD14 CH01

Claims (13)

[Claims] 1. A three-dimensional image creation apparatus for creating a three-dimensional image of an object, the imaging device being arranged around the object, and imaging the object with a background to obtain an object image, the imaging Image creating means for creating a plurality of contour images of the object itself from a plurality of object images having different viewpoints obtained by the means, and creating a three-dimensional image of the object from each of the contour images. 3D image creation device. 2. The three-dimensional image creating apparatus according to claim 1, wherein the photographing means photographs invisible light to form an object image. 3. The three-dimensional image creating apparatus according to claim 2, wherein the photographing means is a camera in which a visible light cut filter is arranged. 4. The three-dimensional image creating apparatus according to claim 3, wherein the visible light cut filter is detachably attached to the camera. 5. The image generation means comprises a contour image generation unit for generating a contour image by dividing the object image into a background area and an object area based on a preset threshold value. The three-dimensional image creating device according to claim 1. 6. The image generation means comprises a hole filling processing unit that performs a hole filling process using a small background area existing in the object area of the contour image as the object area. 3D image creation device. 7. The three-dimensional image creating apparatus according to claim 2, further comprising a background plate having a temperature lower than that of the object and arranged as a background of the object. 8. A plurality of the photographing means are arranged around the object, and the image creating means generates a plurality of contour images of the object itself from the respective object images obtained by the photographing means. The three-dimensional image creating apparatus according to claim 1, wherein the three-dimensional image creating apparatus creates a three-dimensional image of the object from each of the contour images. 9. A three-dimensional image creating method for creating a three-dimensional image of an object, wherein the object is imaged together with the background from different viewpoints by using imaging means arranged around the object to obtain an object image. A photographing step for obtaining, a contour image generating step for generating a plurality of contour images of the target object from a plurality of object images having different viewpoints obtained by photographing, and a third order for generating a three-dimensional image of the target object from the contour image A three-dimensional image creating method comprising: an original image creating step. 10. The method for producing a three-dimensional image according to claim 9, wherein in the photographing step, the temperature distribution is photographed to obtain an object image. 11. The image generation step includes a contour image generation step of generating a contour image by dividing the object image into a background area and an object area based on a preset threshold value. Item 9. The three-dimensional image creation method according to Item 9 or 10. 12. The image generation step according to claim 11, further comprising a hole filling process step of performing a hole filling process using a small background region existing inside the object region of the contour image as the object region. 3D image creation method. 13. The photographing step comprises photographing a plurality of objects from different viewpoints at a time by using photographing means arranged around the object, and the contour image creating step is performed by the photographing means. The three-dimensional image creating method according to any one of claims 9 to 12, wherein a plurality of contour images of the object itself are created from each of the obtained object images.