KR20150028474A - Color compansation method for 3D Image - Google Patents

Abstract

The present invention relates to a color compensation method of a three-dimensional image. When three-dimensional image is generated by using multiple image photographing devices, the multiple image photographing devices generate natural three-dimensional images by compensating each image information difference. The present invention includes the steps of: being performed by the three-dimensional image generating device to be connected to the multiple image photographing devices separated as a predetermined standard distance around a subject and dividing the multiple photographing devices into multiple groups; calculating the average value of color information for the image, which the image photographing devices belonging to each group obtains for the subject, and generating group color information by each group; and compensating image information of the image photographing device belonging to each group as group color information according to group color information.

Description

{Color compansation method for 3D Image}

The present invention relates to a method of correcting a three-dimensional image, and more particularly, to a method of correcting a three-dimensional image by generating a more natural three-dimensional image by minimizing image information deviations of the plurality of image pickup devices.

In order to form a three-dimensional image of a subject, a method of forming a three-dimensional image by processing a two-dimensional image or forming a three-dimensional image of a subject by using a plurality of cameras with a focus on the subject is used. In order to convert a two-dimensional image into a three-dimensional image, a large amount of data processing and a corresponding time are required. In the case of generating a three-dimensional image using a plurality of cameras, a deviation of color information of each camera and a position The generated three-dimensional image due to the image deviation due to the deviation may be unnatural.

In order to solve such a problem, Japanese Laid-Open Patent Application No. 10-2010-0002799 proposes a three-dimensional model generation method using color correction that corrects a color value variation due to a light source change when a three-dimensional image is generated using a plurality of cameras.

[0005] Patent Literature 10-2010-0002799 discloses a method of detecting a reference color table region based on a front image and a side image with respect to a subject, correcting a color of a front image and a side image using a representative color value of the reference color table region have. However, although a method of correcting the change of the color of the subject according to time and place has been proposed, the plurality of cameras do not correct the color of the image to be captured, If the number of cameras used to create is large, the color value registered in the reference color table may be inaccurate.

SUMMARY OF THE INVENTION An object of the present invention is to provide a three-dimensional image generating apparatus and a method thereof that divides a plurality of image pickup devices into a plurality of groups and corrects image information for each group using group image information for each group, .

According to the present invention, the above object is achieved by a three-dimensional image generating apparatus connected to a plurality of image capturing apparatuses spaced apart from each other by a preset reference distance around a subject, wherein the plurality of image capturing apparatuses are divided into a plurality of groups Calculating an average value of color information of an image acquired by the image capturing apparatus belonging to each group with respect to the subject to generate group color information for each group; And correcting the image information of the image pickup device to the group color information.

According to the present invention, the above object is achieved by a three-dimensional image generating apparatus connected to a plurality of image capturing apparatuses spaced apart from each other by a preset reference distance around a subject, wherein the plurality of image capturing apparatuses are divided into a plurality of groups Setting at least one of the image pickup devices of each group as a reference image pickup device, setting image information of an image picked up by the reference image pickup device as reference image information, And correcting the image information of the image capturing apparatus belonging to each of the groups with reference to the image information.

According to the present invention, when three-dimensional image information is generated by using a plurality of image pickup devices, it is possible to generate a more natural three-dimensional image by correcting the image information deviations of each of the plurality of image pickup devices.

FIG. 1 is a conceptual diagram of a method of correcting a three-dimensional image according to an embodiment of the present invention.
FIGS. 2 and 3 show reference drawings for a process of generating a three-dimensional moving image for a subject.
FIG. 4 is a cross-sectional view of an image obtained by successively picking up images in a state in which colors of different image pickup devices are not corrected, as shown in FIG.
FIG. 5 is a flowchart illustrating a method of generating a three-dimensional image according to an exemplary embodiment of the present invention . 5 will be described with reference to FIG.
FIG. 6 is a flowchart illustrating a method of generating a three-dimensional image according to another embodiment of the present invention .

There are two or more groups mentioned in this specification, and each group may include two or more image pickup devices. The image capturing apparatus may refer to a digital camera, a DSRL, a camcorder, and other devices capable of capturing still images or moving images.

The three-dimensional image generation device referred to in the present specification may be a computing device having a processor and a memory, and may refer to a device such as a desktop computer, a server computer, and a notebook computer. The three-dimensional image generating apparatus referred to in the present specification may be connected to a plurality of image capturing apparatuses to acquire image information from a plurality of image capturing apparatuses, and generate a three-dimensional image using the acquired image information. Here, the three-dimensional image generating apparatus can divide the plurality of image capturing apparatuses into a plurality of groups, and can correct the image information for each of the divided groups. This will be described later.

The image information referred to herein means an image captured by the image capturing apparatus and may include various types of information according to the image format. However, the three-dimensional image generating apparatus according to the present invention analyzes the image information, Information about at least one of color, brightness, white balance, and saturation.

The reference object referred to herein Imaging  The subject Imaging  Before, Focus , Height, color Imaging  Condition Setting  It can mean to be prepared for. For example, the image capturing apparatus uses the reference object Imaging  Condition setting  After, actual To capture  The subject To capture  will be.

Hereinafter, the present invention will be described in detail with reference to the drawings.

FIG. 1 is a conceptual diagram of a method of correcting a three-dimensional image according to an embodiment of the present invention.

Referring to FIG. 1, in a method of correcting a three-dimensional image according to an embodiment, a plurality of image pickup devices spaced apart by a same distance D0 around a reference object 50 are divided into a plurality of groups G1 to G7 , And a group divided into groups. The image information of each image capturing apparatus can be subjected to image correction in units of groups (G1 to G7) by the three-dimensional image generating apparatus (100). For example, when the image capturing apparatuses 10a to 10d belonging to the group G1 generate color information of an image for the reference object 50, the three-dimensional image generating apparatus 100 may generate a group average value It is possible to generate the group color information and to correct the color information of each image pickup device belonging to the group G1 by referring to the group color information. The correction of the color information is performed by the three-dimensional image generating apparatus 100, by referring to the group color information, to correct deviations of the images generated by the respective image pickup apparatuses by color information, and a separate table for color information correction is required no.

Here, the reference object 50 may be a moving object or a non-moving object. However, by editing the image information captured by the image capturing apparatus belonging to each of the groups G1 to G7 surrounding the reference object 50 while maintaining the predetermined distance D0 from the reference object 50, It is possible to acquire a three-dimensional moving image with respect to the reference object 50 regardless of whether it is moving or not. That is, even if the reference object 50 does not move, the images captured by the image capturing apparatus belonging to each of the groups G1 to G7 are sequentially reproduced to obtain a three-dimensional moving image of the reference object 50. [

The process of generating a three-dimensional moving image with respect to the reference object 50 will be described with reference to FIGS. 2 and 3. FIG.

2, the three-dimensional image generation apparatus 100 converts the image information captured by the image capturing apparatuses for each of the groups G1 to G7 from the image information of the group G7 to the image information of the group G1 The subject can be expressed by the sense of rotating in the direction D2 and the image information picked up by the image pickup device of each group G1 to G7 is divided into the image information of the group G1, , The reference object 50 can be expressed in the sense of rotating in the direction opposite to D2.

Here, the reproduction order of the image information is discussed with reference to each of the groups G1 to G7, but the image pickup devices belonging to the groups G1 to G7 are sequentially reproduced in accordance with the group-by-group reproduction order. For example, when it is assumed that the three-dimensional image generating apparatus 100 reproduces the image information of the group G1 to the image information of the group G7 in order, the reproducing sequence of the image capturing apparatus belonging to the group G1 is 10a, 10b, 10c and 10d, and then the image capturing apparatus belonging to the group G2 can be reproduced in the order similar to the order in which the image information of the image capturing apparatus belonging to the group G1 is reproduced.

On the other hand, the color correction of the three-dimensional moving image can be performed for each group as described above. The RGB (Red, Green, and Blue) values of the image information generated by the image capturing apparatuses 10a, 10b, 10c, and 10d belonging to the group G1 are the same as those of the image captured by the image capturing apparatuses 10a, 10b, 10c, and 10d And the average value may be an average value for the whole screen, but it is preferable that the average value is for the reference object 50. [ That is, the RGB values of the image information captured by the respective image capturing apparatuses 10a, 10b, 10c, and 10d belonging to the group G1 can be corrected based on the RGB average value of the reference object 50. [ At this time, the three-dimensional image generating apparatus 100 may correct all the color information of the respective image pickup devices 10a, 10b, 10c and 10d, or may correct only the subject area. However, it is not limited.

FIG. 3 is a conceptual diagram illustrating a method of correcting a three-dimensional image according to another embodiment of the present invention. 3 will be described with reference to FIG.

Referring to FIG. 3, a method of correcting a three-dimensional image according to an embodiment includes a method of correcting hue of a neighboring image pickup device adjacent to a reference image pickup device using color information of an image picked up by a reference image pickup device to be. As described with reference to FIG. 1, the image pickup device is selected one by one in the plurality of groups G1 to G7 connected to the three-dimensional image generation device 100, and is set as the reference image pickup device, The color information is extracted from the captured image information and the color of the image capturing apparatus belonging to the group G1 to G7 can be corrected on the basis of the extracted color information.

For example, in the case of the group G1, four image capturing apparatuses 10a, 10b, 10c, and 10d are allocated, and one of the four image capturing apparatuses 10a, 10b, 10c, . If it is assumed that the image capturing apparatus 10b is selected as the reference image capturing apparatus, the color information is extracted from the image information captured by the reference image capturing apparatus 10b, 10a, 10c and 10d can be corrected. Here, the reference image capturing apparatus 10b can acquire reference image information from two viewpoints. Referring to Figure 3,

1) the entirety of the reference image pickup device 10b Imaging  The reference image information may be set for the region 20,

2) All Imaging  Only the subject area 21 included in the area 20 can be set as the reference video information.

FIG. 4 is a cross-sectional view of an image obtained by successively picking up images in a state in which colors of different image pickup devices are not corrected, as shown in FIG.

Referring to FIG. 4, the background color of P1 is close to blue, the background color of P2 is bluish, and the background color of P3 is dark blue.

When each image P1, P2, and P3 is sequentially reproduced so that the reference object 50 is rotated in the A direction using the image information captured with respect to the reference object 50, the images P1, P2, and P3 ) In the background color. The color effect of the reference object 50 can be expressed by the variation of the background color. The color of the reference object 50 may be different from the color effect of the reference object 50, It is possible to cause an optical illusion that is fluctuating. In addition, such a color variation may cause a flicker phenomenon, and a viewer who views a three-dimensional moving image about the reference object 50 may feel visually uncomfortable or dizzy. In other words, the consistency of the color information improves the quality of the three-dimensional image. In addition, when viewing the completed three-dimensional image, the user can feel the natural three-dimensional image and the viewer can feel the visual comfort.

FIG. 5 is a reference view of an example of a reference object applied to a method of correcting color of a three-dimensional image.

5, the reference object 60 includes a body 61, a cap 62, and a pedestal 63. The body 61 is formed in a cylindrical shape, Outside RGB  Color tone band. At one end of the body The cap 62  Respectively, The cap 62  The cross section can be triangular. The pedestal (63) supports the body (61).

The color bands formed on the body 61 are detected by the respective image pickup devices Captured  And may be included in the image information generated by each image pickup device to generate the group color information. On the other hand, The cap 62  The shape of the cross section is triangular. Therefore, The cap 62  In each image pickup device, Captured  The difference between the slope and height of the image Calibrate  It is possible. This will be described with reference to FIG.

6, The cap 62  In the image pickup device using the cross section Captured  How to Correct Image Information Conceptual diagram  Respectively.

6, in the image pickup device, Captured  When the reference object 60 is displayed in the image information Is picked up , Captured  The reference object 60 The cap 62  As shown in FIG. 6 (a), the cross section may be triangular in shape. 6 (a) P2 Wow P3 The line segment P2 end D1  In a direction Upward  Is expressed. The three-dimensional image generating apparatus 100 corrects the positional deviation of the image information By doing  6 (b) Bo This correction of positional deviation can be handled in the following three perspectives.

One) The cap 62  Two coordinates of a triangle formed by a section P2 , P3 ), The slope of the image information generated by the image-capturing apparatus is referred to as the slope of the image information Calibrate .

2) The cap 62  location( P1 The height of the image information generated by the image capturing apparatus is referred to as " Calibrate .

3) Coordinates P1 , P2  And P3 The three-point internal angle of the triangle is referred to and the reference image of the reference object 60 To capture  When Imaging  In addition, Imaging  6 (b) Imaging  To match the time Calibrate  It is possible.

On the other hand, after correcting the position and color of each image capturing apparatus using the reference object 60, the image capturing apparatuses are arranged in such a manner that an object to be captured is arranged at a position of the reference object, A three-dimensional image can be generated by acquiring an image to be captured. The generation of the three-dimensional image is performed by sequentially reproducing the image information of the image pickup devices arranged in an arc around the subject in a desired direction, thereby giving a sense of rotation that rotates along the front, side, and back of the subject, The image information can be expressed in three dimensions. On the other hand, the image information captured by each image capturing apparatus may be merged into a three-dimensional image. Although various methods other than those mentioned above can be used for forming the three-dimensional image, since the present invention focuses on correcting the color deviation occurring when generating the three-dimensional image, rather than generating the three-dimensional image, The explanation of related matters is omitted.

FIG. 7 is a flowchart illustrating a method of generating a three-dimensional image according to an exemplary embodiment of the present invention. The description with reference to FIG. 7 will be made with reference to FIG. 1 and FIG. 6 together.

Referring to Figure 7, In the embodiment  The three-dimensional image generating apparatus 100 according to the first embodiment of the present invention is applied to each image pickup device arranged in a circular arc around a subject 50 or 60 The cap 62  By referring to the sectional image information, the image information about the subject correction do. The three-dimensional image generating apparatus 100 can determine whether the imaging time of the image information generated by each image capturing apparatus is correct or whether the subject is positioned at a correct height in the image information. For example, the three-dimensional image generating apparatus 100 may generate a three- 62)  Acquires the coordinate information of the object To capture  When the entire image pickup device is mounted on the object The cap 62  And can be expressed at the same height.

Next, the three-dimensional image pickup device is divided into a plurality of groups (S201). As shown in FIG. 1, a plurality of image pickup devices may be divided into several groups G1 to G7, wherein each group G1 to G7 includes the same number of image pickup devices to form a group have. Next, the three-dimensional image generating apparatus 100 can generate group color information for each of the groups G1 to G7 (S202). The color information per group can be obtained by extracting RGB information for each group from the image information picked up by the image pickup device belonging to each of the groups G1 to G7 and calculating an average value of the extracted RGB information for each group (S202) . At this time, the average value of the RGB information is referred to as group color information.

Here, each divided group ( G1  To G7 ) Refers to color bands formed on the body 61 RGB  Value Calibrate  . The color band RGB  Which is represented by a uniform color with respect to hue, Circumference plane  Accordingly, it is expressed as a band of uniform color. Therefore, even if the subject is viewed from any direction, the color band RGB  The colors are uniform, and each group ( G1  To G7 ) That is incident on the image capturing apparatus belonging to the image capturing apparatus RGB  The color of light is uniform.

Next, the three-dimensional image generating apparatus 100 can select whether to perform area correction for calculating color information only for the subject area or for the entire imaging area of each image pickup device, that is, (S203). If the user setting is the area correction, the 3D image generating apparatus 100 extracts a subject area in which the subject is located from the image information provided by each image capturing apparatus belonging to the group (S204) The RGB average value of the image pickup device is calculated to generate the group color information (S205), and the RGB values of the respective image pickup devices belonging to the group can be corrected with reference to the group color information (S206). For example, when it is assumed that the four image capturing apparatuses 10a 10b 10c and 10d belong to the group G1, the three-dimensional image generating apparatus 100 determines that each of the four image capturing apparatuses 10a 10b 10c and 10d The average of the RGB values of the subject areas of the respective image pickup devices 10a 10b 10c and 10d can be calculated and the average of the calculated RGB values can be set as the group color information after extracting the subject area from one image information. The three-dimensional image generating apparatus 100 corrects the RGB values of the image capturing apparatuses 10a 10b 10c and 10d based on the group color information. The group color information generation process for the group G1 is also applied to the other groups G2 to G7.

In the case where the 3D image generating apparatus 100 performs the entire area correction on the entire area, the 3D image generating apparatus 100, after step S203, The RGB value is extracted from the acquired image information, and the group color information can be set by calculating an average value of the extracted RGB values (S207). After setting the group color information, the three-dimensional image generating apparatus 1000 can correct the color information of each image pickup apparatus belonging to the group with reference to the group color information (S208).

FIG. 8 is a flowchart illustrating a method for generating a three-dimensional image according to another embodiment of the present invention. 8 will be described with reference to FIGS. 1 and 6. FIG.

First, the three-dimensional image generating apparatus 100 according to the embodiment divides the image capturing apparatuses that are equidistant from the reference subject 50 into a plurality of groups in order to image the subject 50 or 60 (not shown in the following) ). As shown in FIG. 1, a plurality of image pickup devices may be divided into several groups G1 to G7, wherein each group G1 to G7 includes the same number of image pickup devices to form a group have. Next, the three-dimensional image generating apparatus 100 can set reference image capturing apparatuses for each of the groups G1 to G7 (S302).

Here, each divided group ( G1  To G7 ) Refers to color bands formed on the body 61 RGB  Value Calibrate  . The color band RGB  Which is represented by a uniform color with respect to hue, Circumference plane  Accordingly, it is expressed as a band of uniform color. Therefore, even if the subject is viewed from any direction, the color band RGB  The colors are uniform, and each group ( G1  To G7 ) That is incident on the image capturing apparatus belonging to the image capturing apparatus RGB  The color of light is uniform.

Next, the three-dimensional image generating apparatus 100 can select whether to perform area correction for calculating color information only for the subject area or for the entire imaging area of each image pickup device, that is, (S303).

If the area correction is performed only for the subject area, the three-dimensional image generating device 100 extracts the subject area with the reference image capturing device (S304), extracts the subject area, And extracts the RGB values.

Next, the 3D image generating apparatus 100 sets the extracted RGB values as reference image information (S305), and corrects the color information (RGB value) of the image capturing apparatus belonging to the group using the reference image information (S306).

If the 3D image generating apparatus 100 performs the entire area correction on the entire area, the 3D image generating apparatus 100 proceeds to step S303. In step S303, the 3D image generating apparatus 100 generates image information Extracts RGB values from the acquired image information, and sets the extracted RGB values as reference image information (S307). Next, the three-dimensional image generating apparatus 100 can correct the hue (RGB value) of each image pickup device belonging to the group by referring to the reference image information (S308).

Group: G1 ~ G7 10a ~ 10d: Image pickup device
100: Three-dimensional image generating device

Claims (13)

Dimensional image generating apparatus connected to a plurality of image capturing apparatuses spaced apart from each other by a predetermined reference distance around a subject,
A step of dividing the plurality of image pickup devices into a plurality of groups and calculating an average value of color information on an image acquired by the image pickup device belonging to each group with respect to the subject to generate group color information for each group ; And
And correcting the image information of the image capturing apparatus belonging to each group to the group color information according to the group color information. The method according to claim 1,
The group color information may include:
Wherein the average value of the RGB values of the image information obtained by the group image capturing apparatus is an average value of the RGB values of the image information obtained by the group image capturing apparatus. The method according to claim 1,
Wherein the step of correcting by the group color information comprises:
And correcting the color information of the three-dimensional image by using the group color information for one area of the image information of each of the image pickup devices. The method of claim 3,
The one area may be,
Wherein the image pickup region of each of the image pickup devices belonging to the group is an object region on which the subject is disposed. The method according to claim 1,
The image information includes:
Color, brightness, white balance, and saturation of the three-dimensional image. The method according to claim 1,
The subject has a shape of a cylinder, and the body On the side  Triangular Cap  Respectively,
The body RGB  And a color gamut of a color is provided. The method according to claim 6,
Wherein the generating the group color information comprises:
Each of the image pickup devices belonging to the group is formed in the cylinder RGB  Calculating a mean value of the obtained image information and acquiring the image information of the color band of the color; The method according to claim 6,
Wherein the group color information is generated before the step of generating the group color information,
remind Cap Imaging  And performing a positional correction on the image information of each of the image pickup devices by referring to the slope and the height of the triangle formed by the cross section. Dimensional image generating apparatus connected to a plurality of image capturing apparatuses spaced apart from each other by a predetermined reference distance around a subject,
Dividing the plurality of image pickup devices into a plurality of groups;
Setting at least one of the group image capturing apparatuses as a reference image capturing apparatus;
Setting the image information of the image captured by the reference image capturing apparatus as reference image information; And
And a color correcting step of correcting the image information of the image capturing apparatus belonging to each group by referring to the reference image information of each group. 10. The method of claim 9,
The reference image capturing apparatus includes:
Wherein the image pickup device is one of image pickup devices included in each group when the plurality of image pickup devices are divided into a plurality of image pickup devices. 10. The method of claim 9,
The reference image information includes:
Wherein the image information is image information of a subject area in which the subject is located. 10. The method of claim 9,
The reference image information includes:
Further comprising at least one of color, lightness, white balance, and saturation included in the image information of the reference image pickup device. 10. The method of claim 9,
The reference image information includes:
Wherein the image information is image information for the entire imaging region including the subject.

Images