JP2011211739A - Stereoscopic vision image preparation device, stereoscopic vision image output device and stereoscopic vision image preparation method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide stereoscopic vision images suited to the intention of a photographer by generating a depth image reflecting the intention of the photographer during photographing.SOLUTION: The stereoscopic vision image preparation device includes: a first camera unit 16 for acquiring the two-dimensional image 62 of an object; a distance information acquisition means 78 for acquiring distance information to the object; a depth image generation means 80 for generating a depth image 88 for outputting the stereoscopic vision image of the object on the basis of at least the acquired distance information; a photographing related information acquisition means 82 for acquiring one or more pieces of photographing related information when the object is imaged; and a depth image generation method determination means 84 for determining one of a plurality of depth image generation methods for generating the depth image 88 on the basis of the acquired photographing related information. The depth image generation means 80 generates the depth image 88 on the basis of the acquired distance information and the depth image generation method determined in the depth image generation method determination means 84.

Description

  The present invention relates to a stereoscopic image creation device for generating a stereoscopic image of a subject, a stereoscopic image output device for outputting (for example, displaying) the generated stereoscopic image, and a stereoscopic image of the subject. The present invention relates to a method for creating a stereoscopic image.

  In general, a stereoscopic image of a subject can be generated by combining a two-dimensional image of the subject and depth information in which distance information from the photographing device to the subject is two-dimensionally arranged.

  Depth information for display represents, for example, a position in the direction perpendicular to the screen of individual pixels on a virtual screen, and is referred to as a depth image or a depth map.

  As a method of generating depth information, there is a method of measuring an actual distance from an imaging device to a subject and mapping the distance to a virtual depth value for display. When mapping, the actual distance to the subject can be linearly mapped to the depth value, or an arbitrary distance range can be limited and the range can be mapped with more detailed resolution.

  Therefore, conventionally, there is a method of providing definition information for the purpose of non-uniformly changing the interval between the depth information and the depth information value in the two-dimensional image data by a method of providing stereoscopic video data. It is disclosed (for example, see Patent Document 1).

  This Patent Document 1 further discloses a method for providing stereoscopic video data and a method for providing depth information represented by a different number of bits depending on a screen area to two-dimensional image data.

  Further, this Patent Document 1 is a display device that generates a stereoscopic video from two-dimensional image data and attached information, and has a plurality of tables for non-uniformly changing the interval of values of depth information. A display device that generates a parallax amount from a table and generates a stereoscopic image using the calculated parallax amount is disclosed.

International Publication No. 2004/071102 Pamphlet

  As described above, in the conventional example, it was possible to set a desired resolution at an arbitrary position on the depth by non-uniformly changing the interval of the depth information value. It was difficult to easily reflect in the data which position on the depth to focus on as the intention of the data.

  In addition, when depth information is converted, there may be a mixture of high and low resolution areas on the screen, but when editing data later, areas with high and low resolution areas on the screen will be displayed. There is a problem that it is difficult to discriminate between images, and that more computations are required to distinguish regions where the number of bits of depth information differs depending on the screen region.

  The present invention has been made in consideration of such problems, and it is possible to easily generate a depth image that reflects the intention of the photographer at the time of photographing (intention, such as which part of the photographer wants to capture clearly). An object of the present invention is to provide a stereoscopic image creation device, a stereoscopic image output device, and a stereoscopic image creation method capable of obtaining a stereoscopic image having a high stereoscopic effect suitable for a photographer's intention.

  Another object of the present invention is to easily generate a depth image and a depth accuracy image reflecting a photographer's intention at the time of photographing (which part of the photographer wants to take a clear picture or wants to record in detail). Stereoscopic image creation apparatus and stereoscopic image that can obtain a stereoscopic image with a high stereoscopic effect that suits the photographer's intention and can simplify the calculation of a region with low depth accuracy An object is to provide an output device and a stereoscopic image creation method.

  The stereoscopic image creation device according to the first aspect of the present invention includes a two-dimensional image acquisition unit that acquires a two-dimensional image of a subject, a distance information acquisition unit that acquires distance information to the subject, and at least the distance information acquisition unit. A depth image generating means for generating a depth image for outputting a stereoscopic image of the subject based on the distance information acquired in step (b), and shooting related information for acquiring one or more shooting-related information when the subject is captured. Depth image for determining one depth image generation method among information acquisition means and a plurality of depth image generation methods for generating the depth image based on the shooting related information acquired by the shooting related information acquisition means A generation method determination unit, wherein the depth image generation unit includes the distance information acquired by the distance information acquisition unit and the depth image generation method determination unit. And generating a depth image based on the constant has been the depth image generating method.

  This makes it possible to easily generate a depth image that reflects the photographer's intention at the time of photographing (intention, such as which part he wants to capture clearly), and has a high stereoscopic effect that matches the photographer's intention. A stereoscopic image can be obtained.

  Next, a stereoscopic image creation apparatus according to a second aspect of the present invention includes a two-dimensional image acquisition unit that acquires a two-dimensional image of a subject, a distance information acquisition unit that acquires distance information to the subject, and at least the distance A depth image generating unit that generates a depth image for outputting a stereoscopic image of the subject based on the distance information acquired by the information acquiring unit, and a plurality of shooting-related information when the subject is captured Photography related information acquisition means, depth accuracy image generation means for generating depth accuracy images in which accuracy information for setting depth accuracy in the generated depth images is arranged, and a plurality of depth images for generating the depth images Depth image generation method in which one depth image image generation is determined based on shooting related information acquired by the shooting related information acquisition means Of the plurality of depth accuracy image generation methods for generating the depth accuracy image, one depth accuracy image image generation is determined based on the imaging related information acquired by the imaging related information acquisition unit. A depth accuracy image generation method determination unit, wherein the depth image generation unit includes the distance information acquired by the distance information acquisition unit and the depth image generation method determined by the depth image generation method determination unit. A depth image is generated based on the depth image generation method determined by the depth accuracy image generation method determination unit, and the depth accuracy image generation unit generates the depth image based on the depth image generation method determined by the depth accuracy image generation method determination unit.

  As a result, it is possible to easily generate a depth image and a depth accuracy image reflecting the intention of the photographer at the time of photographing (which part of the photographer wants to take a clear picture, an intention to record in detail, etc.). As a result, it is possible to obtain a stereoscopic image with a high stereoscopic effect that suits the intention of the user, and to simplify the calculation of a region with low depth accuracy.

  In the second aspect of the present invention, the depth accuracy image generated by the depth accuracy image generation means may be a binary image indicating the level of accuracy. In this case, it is possible to simplify the calculation of the region with low depth accuracy.

  In the first and second aspects of the present invention described above, the image processing apparatus further includes storage means for storing the plurality of depth image generation methods, and the depth image generation method determination means is acquired by the imaging related information acquisition means. The depth image generation method corresponding to the shooting-related information may be read from the storage unit and supplied to the depth image generation unit. Alternatively, the depth image generation method determination unit receives a depth image generation method corresponding to the shooting related information acquired by the shooting related information acquisition unit among the plurality of depth image generation methods via a network, and generates the depth image You may make it supply to a means.

  In the first and second aspects of the present invention, the shooting-related information acquired by the shooting-related information acquisition unit includes an input shooting mode and the two-dimensional image generated by the two-dimensional image generation unit. There are luminance information of a three-dimensional image, lens aperture value at the time of shooting, focus distance information at the time of shooting, and the like. Examples of the focus distance information include auto focus distance information and manual focus distance information.

  Further, the shooting related information acquired by the shooting related information acquiring unit is region information in which the image of the subject is recorded in the two-dimensional image generated by the two-dimensional image generating unit. There may be. In this case, it may be area information in which an image of the face of the subject is recorded.

  Next, a stereoscopic image output apparatus according to a third aspect of the present invention includes a two-dimensional image acquisition unit that acquires a two-dimensional image of a subject, a distance information acquisition unit that acquires distance information to the subject, and at least the distance Depth image generation means for generating a depth image for outputting a stereoscopic image of the subject based on the distance information acquired by the information acquisition means, and depth accuracy in the generated depth image A depth accuracy image generation unit that generates a depth accuracy image in which accuracy information is arranged, and further, the two-dimensional image generated by the two-dimensional image generation unit and the depth image generation unit It has a stereoscopic image generation means for generating a stereoscopic image from the depth image and the depth accuracy image generated by the depth accuracy image generation means.

  As a result, it is possible to easily generate a depth image and a depth accuracy image reflecting the intention of the photographer at the time of photographing (which part of the photographer wants to take a clear picture, an intention to record in detail, etc.). Can output a stereoscopic image with a high stereoscopic effect that matches the intention (for example, display on a three-dimensional monitor), and can simplify the calculation of a region with low depth accuracy.

  Next, a stereoscopic image creation method according to a fourth aspect of the present invention includes a two-dimensional image acquisition unit that acquires a two-dimensional image of a subject, a distance information acquisition unit that acquires distance information to the subject, and at least the distance Stereoscopic image creation used in a stereoscopic image creation device having depth image generation means for generating a depth image for outputting a stereoscopic image of the subject based on the distance information acquired by the information acquisition means In the method, one depth among a plurality of depth image generation methods for acquiring one or more shooting-related information at the time of imaging the subject and generating a depth image for outputting a stereoscopic image of the subject. An image generation method is determined based on the acquired shooting-related information, and a depth image is generated based on the acquired distance information and the determined depth image generation method And wherein the Rukoto.

  This makes it possible to easily generate a depth image that reflects the photographer's intention at the time of photographing (intention, such as which part he wants to capture clearly), and has a high stereoscopic effect that matches the photographer's intention. A stereoscopic image can be obtained.

  Next, a stereoscopic image creation method according to a fifth aspect of the present invention includes a two-dimensional image acquisition unit that acquires a two-dimensional image of a subject, a distance information acquisition unit that acquires distance information to the subject, and at least the distance Stereoscopic image creation used in a stereoscopic image creation device having depth image generation means for generating a depth image for outputting a stereoscopic image of the subject based on the distance information acquired by the information acquisition means In the method, a plurality of shooting-related information when the subject is imaged is acquired, a depth accuracy image in which accuracy information for setting depth accuracy in the generated depth image is arranged, and the depth image One depth image image generation among a plurality of depth image generation methods for generating the image is determined based on the shooting related information acquired by the shooting related information acquisition means, Of the plurality of depth accuracy image generation methods for generating the depth accuracy image, one depth accuracy image image generation is determined based on the acquired shooting-related information, and the acquired distance information and the determination A depth image is generated based on the determined depth image generation method, and a depth accuracy image is generated based on the determined depth image generation method.

  As a result, it is possible to easily generate a depth image and a depth accuracy image reflecting the intention of the photographer at the time of photographing (which part of the photographer wants to take a clear picture, an intention to record in detail, etc.). As a result, it is possible to obtain a stereoscopic image with a high stereoscopic effect that suits the intention of the user, and to simplify the calculation of a region with low depth accuracy.

  As described above, according to the stereoscopic image creation device, the stereoscopic image output device, and the stereoscopic image creation method according to the present invention, the intention at the time of photographing by the photographer (intention such as which part he wants to capture clearly) ) Can be easily generated, and a stereoscopic image having a high stereoscopic effect suitable for the photographer's intention can be obtained.

  In addition, according to the stereoscopic image creation device, stereoscopic image output device, and stereoscopic image creation method according to the present invention, the intention of the photographer at the time of photographing (which part is desired to be clearly photographed, detailed recording, etc.) The depth image and the depth accuracy image reflecting the intention) can be easily generated, a stereoscopic image having a high stereoscopic effect suitable for the photographer's intention can be obtained, and an area with low depth accuracy can be obtained. Calculation can be simplified.

It is a lineblock diagram showing the 1st stereoscopic vision image creation device. It is a functional block diagram which shows the structure of a 1st stereoscopic vision image production apparatus. It is a graph which shows the example of the mapping table in case imaging | photography modes are landscape mode and night view mode. It is a graph which shows the example of the mapping table in case imaging | photography mode is portrait mode. It is a graph which shows the example of the mapping table in case imaging | photography mode is macro mode. It is a graph which shows the example of four types of mapping tables according to the focus distance of AF. It is a flowchart which shows operation | movement of the 1st process example. It is a flowchart which shows operation | movement of the 2nd process example. It is a block diagram which shows a 2nd stereoscopic vision image production apparatus. It is a flowchart which shows operation | movement of the 3rd process example. It is explanatory drawing which shows the reference | standard which determines the level of depth precision, when it is a imaging | photography mode suitable for the case where a background is bright. It is explanatory drawing which shows the reference | standard which determines the level of depth precision, when it is a photography mode suitable for the case where a background is dark. It is a flowchart which shows operation | movement of the 4th process example. It is explanatory drawing which shows the reference | standard which determines the level of depth precision based on a depth of field. It is a flowchart which shows operation | movement of the 5th process example. FIG. 16A is an explanatory diagram showing a state in which an image of a building is specified, and FIG. 16B sets the depth accuracy of the pixels constituting the building image to “high” and the depth accuracy of other pixels to “low”. It is explanatory drawing which shows the set example. It is a flowchart which shows operation | movement of the 6th process example. It is explanatory drawing which shows the state which specified the image of the face. It is a block diagram which shows a 3rd stereoscopic vision image production apparatus. It is explanatory drawing which shows the other usage example of a 2nd stereoscopic vision image production apparatus. It is a block diagram which shows a stereoscopic vision image output apparatus. It is a functional block diagram which shows the structure of a stereoscopic vision image output device. It is a flowchart which shows the processing operation of a stereoscopic vision image output device. FIG. 24A is a graph showing an example of the first correction table, and FIG. 24B is a graph showing an example of the second correction table. It is explanatory drawing which shows the other usage example of a stereoscopic vision image output device.

  Embodiments of a stereoscopic image creation device, a stereoscopic image output device, and a stereoscopic image creation method according to the present invention will be described below with reference to FIGS.

  First, the stereoscopic image creation device according to the first embodiment (hereinafter referred to as the first stereoscopic image creation device 10A) generates at least a two-dimensional image of a subject and a depth image corresponding to the two-dimensional image. The data is stored in the external storage device 12.

  As shown in FIG. 1, the first stereoscopic image creating apparatus 10A includes a first camera unit 16 having a first CCD image sensor 14, a second camera unit 20 having a second CCD image sensor 18, and digital signal processing. The main memory 22 for performing, the system memory 24 in which system information for performing system activation and the like is recorded, and the CPU 26 for activating and operating various programs.

  The first camera unit 16, the second camera unit 20, the main memory 22, the system memory 24, the CPU 26, and the like are connected through a control bus and a data bus (hereinafter simply referred to as a bus 28). In addition to the above-described members, the non-volatile memory 30, USB driver 32, I / O interface 34, calendar clock 36, timer 38, and the like are connected to the bus 28. An external connector 40 is connected to the USB driver 32, and the external storage device 12 is connected via the external connector 40. The I / O interface 34 is connected to switches on the operation panel 42 and LEDs. Each of these members is supplied with an external power source (not shown) connected to the connector 44 via a power control circuit 46 and a DC-DC converter 48.

  The first camera unit 16 includes a lens and a motor in addition to the first CCD image pickup device 14 described above, and includes a first optical system 50 for forming an image of a subject on the first CCD image pickup device 14, and a first CCD. A first analog signal processing circuit 52 that processes an imaging signal from the imaging device 14 into an analog video signal, a first A / D converter 54 that digitally converts the video signal into video data, and a first A / D conversion A first integrating circuit that generates a control signal for auto iris and autofocus based on the output from the detector 54, and a first integrating circuit that controls the aperture, focusing, zoom, etc. of the lens based on the control signal from the first integrating circuit 56. 1 drive control unit 58, and a first timing generation circuit 60 that outputs a timing signal to the first CCD image pickup device 14, the first analog signal processing circuit 52, and the like.Then, the video data output from the first A / D converter 54 is two-dimensionally recorded in the main memory 22 in accordance with the horizontal synchronizing signal, thereby generating a first two-dimensional image 62 (see FIG. 2). Will be. Accordingly, the first camera unit 16 functions as a two-dimensional image acquisition unit.

  The second camera unit 20 has the same configuration as that of the first camera unit 16 described above, and includes the following members in addition to the second CCD image sensor 18. That is, it has a lens and a motor, and the second optical system 64 for forming an image of a subject on the second CCD image sensor 18 and the image signal from the second CCD image sensor 18 are processed into an analog video signal. A second analog signal processing circuit 66 for converting the video signal into digital data by converting the video signal into video data, and for auto iris and autofocus based on the output from the second A / D converter 68. A second integration circuit 70 that generates a control signal, a second drive control unit 72 that controls the aperture, focusing, zoom, and the like of the lens based on the control signal from the second integration circuit 70, the second CCD image sensor 18, And a second timing generation circuit 74 that outputs a timing signal to the analog signal processing circuit 66 and the like. Then, the video data output from the second A / D converter 68 is two-dimensionally recorded in the main memory 22 in accordance with the horizontal synchronization signal, thereby generating a second two-dimensional image 76 (see FIG. 2). Will be.

  On the other hand, as shown in FIG. 2, the software activated and operated by the CPU 26 includes a distance information acquisition unit 78, a depth image generation unit 80, a photographing related information acquisition unit 82, and a depth image generation method determination unit 84. Have.

  The distance information acquisition unit 78 acquires distance information from the first camera unit 16 to the subject, for example. In this case, the first 2D image 62 from the first camera unit 16 and the second 2D image 76 from the second camera unit 20 are subjected to image processing, and distance information for each pixel in the first 2D image 62 is obtained. Each is calculated and acquired, and stored in the main memory 22 as a distance information file 86. As a method of acquiring distance information from two two-dimensional images, for example, a method described in Japanese Patent Application Laid-Open No. 2006-191357 can be used.

  In the above-described example, the method for acquiring the distance information with respect to the first two-dimensional image 62 has been described. However, the distance information with respect to the second two-dimensional image 76 may be acquired. In this case, the second camera unit 20 functions as a two-dimensional image acquisition unit.

  The depth image generation means 80 generates a depth image 88 for outputting a stereoscopic image of the subject based on at least the distance information (distance information file 86) for each pixel acquired by the distance information acquisition means 78.

  The shooting related information acquisition unit 82 is a unit that electrically acquires information input by the photographer during shooting and the state of the subject at the time of shooting as shooting related information. Examples of the shooting-related information include the following.

(1) A shooting mode that is input when the photographer operates the switches arranged on the operation panel 42.

(2) Luminance information of the first two-dimensional image 62 acquired by the first camera unit 16.

(3) A lens aperture value output from the first integration circuit 56.

(4) The focus distance of autofocus output from the first integration circuit 56.

(5) A recording range of the image of the subject included in the first two-dimensional image 62.

(6) A face image recording range included in the first two-dimensional image 62 when the subject is a human or animal face.

  The depth image generation method determination unit 84 selects one depth image generation method among a plurality of depth image generation methods for generating the depth image 88 based on the imaging related information acquired by the imaging related information acquisition unit 82. decide. Examples of the depth image generation method include mapping tables 90a to 90g of depth values with respect to distances as shown in FIGS. These mapping tables 90a to 90g are tabulated graphs having a logarithmic scale of distance on the horizontal axis and a number linear scale of depth values on the vertical axis. From the relationship of storage capacity, the distance of 100 m or more is set to infinity, and the range of depth values is set to 8 bits. The plurality of mapping tables 90a to 90g are stored in advance in the nonvolatile memory 30, for example.

  Examples of the plurality of mapping tables 90a to 90g (depth image generation method) include the examples shown in FIGS.

  3 is an example of the mapping table 90a when the shooting mode is “landscape mode, night view mode”, and FIG. 4 is an example of the mapping table 90b when the shooting mode is “portrait mode”. Fig. 6 is an example of a mapping table 90c when the photographing mode is "macro mode", and Fig. 6 is an example of four types of mapping tables 90d to 90g for each autofocus focus distance. In FIG. 6, the mapping table 90d is used when AF = 0.1 m, the mapping table 90e is used when AF = 1m, the mapping table 90f is used when AF = 5m, and the mapping is performed when AF = infinity. A table 90g is used.

  The characteristics of the mapping tables 90a to 90g shown in FIGS. 3 to 6 are based on the size of the recording range of the subject image included in the first 2D image and the size of the recording range of the face image included in the first 2D image. You may make it change by.

  3 to 6 show examples of the depth value mapping tables 90a to 90g based on the distance, but other depth value mapping tables based on the luminance may be prepared in the same manner. In this case, the depth value corresponding to the luminance information of the first two-dimensional image 62 acquired by the first camera unit 16 and the lens aperture value output from the first integration circuit 56 among the imaging related information can be obtained. it can. Of course, in the mapping table based on this luminance, the characteristics of the mapping table include the size of the recording range of the subject image included in the first 2D image 62 and the recording of the face image included in the first 2D image 62. You may make it change with the magnitude of a range.

  The depth image generation means 80 described above generates distance information (distance information file 86) for each pixel acquired by the distance information acquisition means 78 and one depth image generation determined by the depth image generation method determination means 84. A depth image is generated based on a method (mapping table).

  Here, two examples (first processing example and second processing example) of the processing operation of the first stereoscopic image creating apparatus 10A will be described with reference to FIG.

  In the first processing example, it is assumed that the non-volatile memory 30 stores, for example, three mapping tables 90a to 90c shown in FIGS.

  First, in step S1 of FIG. 7, the shooting related information acquisition unit 82 acquires the shooting mode. When photographing a subject, the photographer inputs a photographing mode intended to be optimal for the current photographing by operating a switch on the operation panel 42. Therefore, the photographing related information acquisition unit 82 acquires the input photographing mode based on the switch input interrupt, and stores it in a predetermined address of the main memory 22.

  Thereafter, in step S <b> 2 of FIG. 7, the depth image generation method determination unit 84 acquires a depth image generation method corresponding to the current shooting mode. Specifically, the mapping table corresponding to the acquired shooting mode is selected from the three mapping tables 90a to 90c stored in the nonvolatile memory 30, and the information, for example, the top address of the selected mapping table, The table number and the like are stored at a predetermined address in the main memory 22.

  Thereafter, in step S3 of FIG. 7, the first camera unit 16 acquires the two-dimensional image 62 (first two-dimensional image 62) of the subject based on the input of the photographing button by the photographer and records it in the main memory 22. To do. At this time, the second two-dimensional image 76 captured by the second camera unit 20 is also recorded in the main memory 22.

  Thereafter, in step S4 of FIG. 7, the distance information acquisition unit 78 performs image processing on the first two-dimensional image 62 and the second two-dimensional image 76 recorded in the main memory 22, and performs the first two-dimensional image 62. The distance information for each pixel is calculated and acquired, and is recorded in the main memory 22 as a distance information file 86.

  Thereafter, in step S5 of FIG. 7, the depth image generation means 80 reads one depth image generation method (mapping table) corresponding to the information of the mapping table stored in the predetermined address of the main memory 22 in step S2. Based on the mapping table and the distance information (distance information file 86) for each pixel acquired by the distance information acquisition means 78, the depth value is set for each pixel, and the depth image 88 is generated and generated. The depth image 88 is recorded in the main memory 22. At this stage, the first processing example ends.

  Next, a second processing example will be described with reference to FIG. In the second processing example, it is assumed that the non-volatile memory 30 stores four mapping tables 90d to 90g shown in FIG.

  First, in step S101 of FIG. 8, the imaging related information acquisition unit 82 acquires the focus distance of autofocus (AF). The photographer moves to a place where he / she intends that the distance to the subject is optimum, for example, when photographing the subject. At this time, the AF focusing distance is output from the first integrating circuit 56, the first optical system 50 is driven and controlled by the first drive control unit 58, and autofocusing control according to the focusing distance is performed. The second camera unit 20 performs the same process. Therefore, the imaging related information acquisition unit 82 acquires the AF focusing distance output from the first integration circuit 56 and stores it in a predetermined address of the main memory 22.

  Thereafter, in step S102 of FIG. 8, the depth image generation method determination means 84 acquires a depth image generation method corresponding to the focus distance of the current AF. Specifically, a mapping table corresponding to the obtained AF focusing distance is selected from the four mapping tables 90d to 90g stored in the nonvolatile memory 30, and the information, for example, the selected mapping table A head address, a table number, and the like are stored at predetermined addresses in the main memory 22.

  Thereafter, in step S103 of FIG. 8, the first camera unit 16 acquires a two-dimensional image 62 (first two-dimensional image) of the subject based on the input of the photographing button by the photographer and records it in the main memory 22. . At this time, the second two-dimensional image 76 captured by the second camera unit 20 is also recorded in the main memory 22.

  Thereafter, in step S104 of FIG. 8, the distance information acquisition unit 78 performs image processing on the first two-dimensional image 62 and the second two-dimensional image 76 recorded in the main memory 22 to obtain the first two-dimensional image 62. The distance information for each pixel is calculated and acquired, and is recorded in the main memory 22 as a distance information file 86.

  Thereafter, in step S105 of FIG. 8, the depth image generation means 80 reads one depth image generation method (mapping table) corresponding to the information of the mapping table stored in the predetermined address of the main memory 22 in step S102. Based on the mapping table and the distance information (distance information file 78) for each pixel acquired by the distance information acquisition means 78, the depth value is set for each pixel, and the depth image 88 is generated and generated. The depth image 88 is recorded in the main memory 22. At this stage, the second processing example ends.

  In the first processing example and the second processing example described above, the depth value mapping tables 90a to 90g based on the distance have been mainly described, but other processes using the mapping table based on the brightness, Processing combining the mapping tables can be performed in the same manner.

  Thus, in the first stereoscopic image creation device 10A, the photographer can generate a depth image that reflects the intention at the time of photographing (intention, such as which part he wants to capture clearly). Can be obtained. For example, according to the first processing example, it is possible to create a stereoscopic image suitable for the subject obtained by the photographing mode input by the photographer. According to the second processing example, it is possible to create a stereoscopic image suitable for the subject obtained by the AF focusing distance at the time of shooting. Similarly, a stereoscopic image suitable for the luminance of the two-dimensional image can be created, and a stereoscopic image suitable for the subject obtained by the lens aperture value at the time of shooting can be created.

  Next, a stereoscopic image creation device (hereinafter, referred to as a second stereoscopic image creation device 10B) according to a second embodiment having a more preferable aspect will be described with reference to FIGS.

  As shown in FIG. 9, the second stereoscopic image creation apparatus 10B has substantially the same configuration as the first stereoscopic image creation apparatus 10A described above, but has a distance information acquisition unit 78, a depth image generation unit 80, and the like. In addition to the photographing related information acquisition unit 82 and the depth image generation method determination unit 84, a depth accuracy image generation unit 92 is provided.

  Depending on the distance and brightness of the subject, there may be a case where it is desired to take a part of the subject clearly or in detail, and to simplify the other parts. That is, for one two-dimensional image, there is a case where the intention of increasing the depth accuracy of a part of the subject and setting the depth accuracy of other parts to be low may work.

  The depth accuracy varies depending on the brightness of the subject, the distance, the recording range on the two-dimensional image, the content of the subject, and the like.

  Therefore, the depth accuracy image generation unit 92 generates a depth accuracy image 94 in which accuracy information for setting the depth accuracy in the generated depth image is arranged. That is, another two-dimensional image (depth accuracy image 94) having the same pixel arrangement as that of the acquired two-dimensional image 62 is prepared, and the depth accuracy = “high” for the pixel in the acquired two-dimensional image 62 for which the depth accuracy is to be increased. Information (for example, logical value “1”) is allocated, and information indicating depth accuracy = “low” (for example, logical value “0”) is allocated to pixels that may have low depth accuracy. Then, by using this depth accuracy image 94 to calculate the amount of parallax from the depth value recorded in the depth image 88, the image of the subject photographed with the intention that the photographer wants to take a clear image is obtained. In particular, it is displayed (output) clearly.

  Next, four processing examples (third processing example to sixth processing example) in consideration of the depth accuracy will be described with reference to FIGS. Note that the processing by the depth image generation method determination unit 84 described above assumes a case where one mapping table corresponding to the shooting mode is determined.

  The third processing example includes processing for generating the depth accuracy image 94 based on the luminance information of the two-dimensional image 62.

  First, similarly to step S1 to step S5 in FIG. 7, in step S201 in FIG. 10, the shooting related information acquisition unit 82 acquires the shooting mode, and in step S202, the depth image generation method determination unit 84 sets the current shooting mode. A depth image generation method corresponding to is acquired. Thereafter, in step S203 of FIG. 10, the first camera unit 16 acquires a two-dimensional image 62 (first two-dimensional image) of the subject based on the input of the photographing button by the photographer. In step S204, the distance information The acquisition unit 78 acquires distance information for each pixel in the first two-dimensional image, that is, the distance information file 86. Thereafter, in step S205, the depth image generation unit 80 generates a depth image 88 based on the one depth image generation method (mapping table) determined in step S202 and the distance information file 86 acquired by the distance information acquisition unit 78. Generate.

  In step S206, the depth accuracy image generation unit 92 sets the depth accuracy for each pixel based on the luminance value for each pixel of the two-dimensional image 62 on the basis of the shooting mode and a preset threshold relating to the luminance. An image 94 is generated.

  For example, when the shooting mode is a shooting mode suitable for a bright background such as a ski resort, there is a case where a high-luminance subject has too much light and is almost indistinguishable from its shape. In this case, even if the depth accuracy is increased, there is almost no effect of making a stereoscopic image. Rather, it is preferable to reduce the depth accuracy to obtain a planar image. Therefore, as shown in FIG. 11, information indicating depth accuracy = “low” (for example, logical value “0”) is assigned to a pixel having high luminance (a pixel having a luminance value higher than the first threshold value Vt1), and luminance For a pixel with a low value (a pixel whose luminance value is equal to or less than the first threshold value), information indicating depth accuracy = “high” (for example, a logical value “1”) is assigned.

  On the other hand, if the shooting mode is suitable for a dark background such as a night view, the light intensity is too low for a subject with low brightness, and the shape may not be distinguished. In this case, even if the depth accuracy is increased, there is almost no effect of making a stereoscopic image. Rather, it is preferable to reduce the depth accuracy to obtain a planar image. Therefore, as shown in FIG. 12, for low-luminance pixels (pixels whose luminance value is lower than the second threshold value Vt2 (<first threshold value Vt1)), information indicating depth accuracy = “low” (for example, the logical value “ 0 ”) and information indicating depth accuracy =“ high ”(for example, logical value“ 1 ”) is assigned to pixels with high luminance (pixels having a luminance value equal to or higher than the second threshold).

  The depth accuracy image generation unit 92 generates the depth accuracy image 94 as described above, and records the generated depth accuracy image 94 in the main memory 22. At this stage, the third processing example ends.

  Next, a fourth processing example will be described with reference to FIGS. This fourth processing example includes processing for generating a depth accuracy image based on the distance information of the two-dimensional image and the depth of field.

  First, similarly to steps S1 to S5 in FIG. 7, in step S301 in FIG. 13, the shooting related information acquisition unit 82 acquires the shooting mode, and in step S302, the depth image generation method determination unit 84 determines the current shooting mode. A depth image generation method corresponding to is acquired. Thereafter, in step S303 in FIG. 13, the first camera unit 16 acquires a two-dimensional image 62 (first two-dimensional image) of the subject based on the input of the photographing button by the photographer. In step S304, the distance information The acquisition unit 78 acquires distance information for each pixel in the first two-dimensional image, that is, the distance information file 86. Thereafter, in step S305, the depth image generation unit 80 generates a depth image 88 based on the one depth image generation method (mapping table) determined in step S302 and the distance information file 86 acquired by the distance information acquisition unit 78. Generate.

  In step S <b> 306, the photographing related information acquisition unit 82 acquires lens information (for example, numerical aperture) and stores it in a predetermined address of the main memory 22.

  Thereafter, in step S <b> 307, the imaging related information acquisition unit 82 acquires the lens aperture value output from the first integration circuit 56 and stores it in a predetermined address of the main memory 22.

  Thereafter, in step S <b> 308, the imaging related information acquisition unit 82 acquires the AF focusing distance output from the first integration circuit 56 and stores it in a predetermined address of the main memory 22.

  Thereafter, in step S309, the depth accuracy image generation unit 92 calculates the depth of field based on the lens information acquired by the imaging related information acquisition unit 82, the aperture value, and the AF focusing distance.

  Thereafter, in step S310, the depth accuracy image generation means 92 sets the depth accuracy for each pixel based on the distance information (distance information file 86) for each pixel of the two-dimensional image 62 and the depth of field, and the depth accuracy image. 94 is generated.

  For example, among the pixels arranged in the two-dimensional image 62, for the pixels that are within the depth of field, an image of a subject photographed with the intention of the photographer to take a particularly clear image is formed. Since it is a pixel, it is preferable to increase the depth accuracy to make the stereoscopic image clear. On the other hand, pixels that are out of the depth of field are out of the subject that the photographer wants to take a particularly clear image, so even if the depth accuracy is increased, there is almost no effect on the stereoscopic image, but rather the depth accuracy. It is preferable to lower the value to obtain a flat image.

  Therefore, as shown in FIG. 14, the distance information for each pixel of the acquired two-dimensional image 62 is confirmed, and for the pixels whose distance is within the depth of field Dd, information indicating depth accuracy = “high” ( For example, a logical value “1”) is assigned, and information indicating depth accuracy = “low” (eg, logical value “0”) is assigned to a pixel whose distance is out of the depth of field.

  The depth accuracy image generation unit 92 generates the depth accuracy image 94 as described above, and records the generated depth accuracy image 94 in the main memory 22. At this stage, the fourth processing example ends.

  Next, a fifth processing example will be described with reference to FIG. The fifth processing example includes a process of generating the depth accuracy image 94 based on the image recorded in the central portion of the acquired two-dimensional image 62. This is because the image recorded in the central portion of the acquired two-dimensional image 62 is recorded with the intention that the photographer wants to take a particularly clear image, and the image recorded in the central portion. Increase depth accuracy.

  First, similarly to steps S1 to S5 in FIG. 7, in step S401 in FIG. 15, the shooting related information acquisition unit 82 acquires the shooting mode, and in step S402, the depth image generation method determination unit 84 sets the current shooting mode. A depth image generation method corresponding to is acquired. Thereafter, in step S403 of FIG. 15, the first camera unit 16 acquires a two-dimensional image 62 (first two-dimensional image) of the subject based on the input of the photographing button by the photographer. In step S404, the distance information The acquisition unit 78 acquires distance information for each pixel in the first two-dimensional image, that is, the distance information file 86. Thereafter, in step S405, the depth image generation unit 80 generates a depth image 88 based on the one depth image generation method (mapping table) determined in step S402 and the distance information file 86 acquired by the distance information acquisition unit 78. Generate.

  In step S <b> 406, the depth accuracy image generation unit 92 specifies the image of the subject recorded in the preset range (the range of the central portion) in the two-dimensional image 62. The example of FIG. 16 shows an example in which a building image 96 is specified as a subject image.

  Thereafter, in step S407, the depth accuracy image generation unit 92, as shown in FIG. 16B, information indicating depth accuracy = “high” (for example, logical value) for the pixels included in the building image 96 specified as described above. “1”) is assigned, and information indicating depth accuracy = “low” (for example, logical value “0”) is assigned to pixels not included in the building image 96.

  The depth accuracy image generation unit 92 generates the depth accuracy image 94 as described above, and records the generated depth accuracy image 94 in the main memory 22. At this stage, the fifth processing example ends.

  Next, a sixth processing example will be described with reference to FIG. This sixth processing example is almost the same as the fifth processing example described above, but whether or not the recorded image includes a human face or animal face image among the acquired two-dimensional images. Processing for generating a depth-accuracy image based thereon. This is recorded with the intention that the photographer wants to take a particularly clear picture when the subject is a human face or an animal face in the acquired two-dimensional image. Increase the depth accuracy of animal face images.

  First, similarly to steps S1 to S5 in FIG. 7, in step S501 in FIG. 17, the shooting related information acquisition unit 82 acquires the shooting mode, and in step S502, the depth image generation method determination unit 84 sets the current shooting mode. A depth image generation method corresponding to is acquired. Thereafter, in step S503 in FIG. 17, the first camera unit 16 acquires a two-dimensional image 62 (first two-dimensional image) of the subject based on the input of the photographing button by the photographer. In step S504, the distance information The acquisition unit 78 acquires distance information for each pixel in the first two-dimensional image, that is, the distance information file 86. Thereafter, in step S505, the depth image generation unit 80 generates a depth image 88 based on the one depth image generation method (mapping table) determined in step S502 and the distance information file 86 acquired by the distance information acquisition unit 78. Generate.

  In step S506, the depth accuracy image generation unit 92 searches the two-dimensional image 62 for whether a human face image or an animal face image is recorded, and specifies the recording range. For example, a reference image of a representative face of a human or a reference image of a representative face of an animal is prepared in advance, and pattern matching is performed to determine whether an image similar to the reference image is recorded in the acquired two-dimensional image. Search using law etc. If there is an image similar to the reference image as a result of the search, information on the recording range is stored at a predetermined address in the main memory 22. The example of FIG. 18 shows an example in which the recording range of the human face image 98 is specified.

  Thereafter, in step S507, as shown in FIG. 18, the depth accuracy image generation unit 92 assigns information indicating depth accuracy = “high” (for example, logical value “1”) to the pixels included in the specified recording range. Information indicating depth accuracy = “low” (for example, logical value “0”) is assigned to pixels in a range other than the recording range.

  The depth accuracy image generation unit 92 generates the depth accuracy image 94 as described above, and records the generated depth accuracy image 94 in the main memory 22. At this stage, the sixth processing example ends.

  As described above, in the second stereoscopic image creation device 10B, the depth image 88 and the depth reflecting the intention of the photographer at the time of photographing (intentions such as which part the photographer wants to capture clearly or want to record in detail) are reflected. The accuracy image 94 can be generated, and a stereoscopic image suitable for the photographer's intention can be obtained. For example, according to the third processing example, the depth accuracy can be set low for a portion where the stereoscopic effect is hardly expected according to the shooting mode input by the photographer, and a portion where the stereoscopic effect can be expected (the photographer can The depth accuracy can be set high for the desired portion. According to the fourth processing example, the depth accuracy can be set high for a portion that the photographer wants to take clearly, that is, an image that falls within the depth of field, and the depth accuracy is set low for an image that is out of the depth of field. be able to. According to the fifth processing example, the depth accuracy can be set high for an image recorded in the portion focused by the photographer, that is, the central portion, and the depth accuracy can be set low for an image that is out of the depth of field. . According to the sixth processing example, the depth accuracy can be set high for a portion that the photographer wants to take clearly, that is, an image of a human face or animal face, and the depth accuracy can be set low for other images. .

  In the above-described example, the distance information is obtained by providing the first camera unit 16 and the second camera unit 20, but in addition, a stereoscopic image creation device (hereinafter referred to as the third embodiment) shown in FIG. The distance measuring device 100 using laser light may be installed in place of the second camera unit 20 as described in the third stereoscopic image creating device 10C).

  The distance measuring apparatus 100 includes a laser light control unit 102 that controls to emit laser light from a laser light source (not shown) based on an instruction to emit laser light, and laser light that receives laser light reflected from a subject. The light receiving unit 104 and the signal processing circuit 106 that measures the distance to the subject based on the time from the laser beam emission instruction to the light reception, and functions as the distance information acquisition unit 78. The distance measuring device 100 scans the laser beam so as to cover the imaging range of the first camera unit 16, and the distance information (distance information file) for each pixel of the two-dimensional image 62 acquired by the first camera unit 16. 86).

  In the third stereoscopic image creation apparatus 10C, it is not necessary to install the second camera unit 20, and it is not necessary to record the second two-dimensional image 76 in the main memory 22. The storage capacity of the memory 22 can be reduced.

  In the above-described example, the AF distance information is used as the focus distance information at the time of shooting acquired by the shooting related information acquisition unit 82. Alternatively, manual focus distance information at the time of shooting may be used. .

  In the above example, the external storage device 12 is connected to the external connector 40 of the USB driver 32. However, as shown in FIG. 20, for example, the second stereoscopic image creation device 10B is connected to the personal computer 108. The two-dimensional image 62, the depth image 88, and the depth accuracy image 94 may be recorded on the hard disk of the personal computer 108. Further, the plurality of mapping tables 90 a to 90 g may be downloaded from the website 112 via the network 110 and the personal computer 108 instead of being obtained from the nonvolatile memory 30. In this case, a wide variety of mapping tables suitable for various shooting-related information can be obtained as appropriate, and it is also possible to easily cope with model changes and accurately reflect the photographer's intention at the time of shooting. Depth images can be generated. Of course, the two-dimensional image 62, the depth image 88, and the depth accuracy image 94 recorded on the hard disk of the personal computer 108 may be uploaded to the Web site 112 or transferred to another user's personal computer.

  Next, a stereoscopic image output apparatus 200 according to the present embodiment will be described with reference to FIGS.

  As shown in FIG. 21, the stereoscopic image output apparatus 200 connects a CPU 202 for starting and operating various programs, a main memory 204 for performing digital processing, and data processed by the main memory 204 to the outside. And an I / O interface 208 for outputting to the three-dimensional monitor 206. The CPU 202, the main memory 204, and the I / O interface 208 are connected through a control bus and a data bus (hereinafter simply referred to as a bus 210). In addition to the above members, a USB driver 212 is connected to the bus 210. An external connector 214 is connected to the USB driver 212, and the external storage device 12 is connected via the external connector 214.

  As shown in FIG. 22, software that is activated and operated by the CPU 202 includes an image reading unit 216 that reads the two-dimensional image 62, the depth image 88, and the depth accuracy image 94 stored in the external storage device 12 into the main memory 204, and Parallax amount calculation means 218 for calculating a parallax amount for each pixel of the two-dimensional image based on the depth value recorded in the depth image and the accuracy information recorded in the depth accuracy image 94, and a parallax A stereoscopic image generation unit 222 that generates a stereoscopic image 220 by shifting the pixels of the two-dimensional image 62 based on the amount of parallax for each pixel of the amount image 217; a monitor that generates the stereoscopic image 220; a personal computer; Stereoscopic image output means 224 for outputting to a printer or the like. The stereoscopic image output means 224 in the present embodiment shows a case where the generated stereoscopic image 220 is output to the three-dimensional monitor 206 and the stereoscopic image 220 is displayed.

  Here, the processing operation of the stereoscopic image output apparatus 200 will be described with reference to FIG.

  First, in step S <b> 601, the image reading unit 216 reads the two-dimensional image 62, the depth image 88, and the depth accuracy image 94 stored in the external storage device 12 and records them in the main memory 204.

  Thereafter, in step S602, the parallax amount calculation unit 218 sets the value n of the counter indicating the update of the pixel to be processed to an initial value “1” (n = 1).

  Next, in step S <b> 603, the parallax amount calculation unit 218 reads the depth value of the pixel (n-th pixel) corresponding to the counter value n in the depth image 88.

  Thereafter, in step S604, the parallax amount calculation unit 218 reads out accuracy information (high / low accuracy = 1/0) of the pixel (n-th pixel) corresponding to the counter value n in the depth accuracy image 94. .

  Thereafter, in step S605, it is determined whether the accuracy information is “0” (accuracy = “low”) or “1” (accuracy = “high”).

  When the accuracy information is “0” (accuracy = “low”), the process proceeds to step S606, and the parallax amount of the nth pixel is obtained based on the first correction table 226 for low accuracy shown in FIG. 24A.

  The first correction table 226 is a table in which the horizontal axis represents the depth value and the vertical axis represents the parallax amount. The first correction table has a characteristic that the amount of parallax increases stepwise as the depth value increases. Accordingly, when the depth value is between D0 and D9, for example, the parallax amount is uniformly T1, and when the depth value is between D10 and D19, for example, the parallax amount is uniformly T2, and the range in which the depth value exists. If there is no change, the pixel shift is not performed, and the stereoscopic effect hardly appears. Accordingly, the calculation processing for stereoscopic display is simplified correspondingly, and the calculation burden on the CPU 202 is reduced.

  On the other hand, if the accuracy information is “1” (accuracy = “high”), the process proceeds to step S607, and the parallax amount of the nth pixel is obtained based on the second accuracy correction table 228 shown in FIG. 24B. .

  Similar to the first correction table 226, the second correction table 228 is a table in which a horizontal axis represents a depth value and a vertical axis represents a parallax amount. In particular, the second correction table 228 has a characteristic that the amount of parallax increases linearly as the depth value increases. Accordingly, since the change in the depth value is directly reflected in the parallax amount as a linear change, it is possible to faithfully display fine irregularities.

  When the process in step S606 or step S607 is completed, the process proceeds to the next step S608, the counter value is updated by +1, and the process proceeds to step S609, where it is determined whether or not the process has been completed for all pixels. The If the processing for all the pixels has not been completed, the processing after step S603 is repeated.

  If it is determined in step S609 that the processing has been completed for all pixels, that is, if the parallax amount image 217 corresponding to the two-dimensional image 62 is completed, the process proceeds to the next step S610 to generate a stereoscopic image. The means 222 shifts the pixels of the two-dimensional image 62 based on the parallax amount for each pixel of the parallax amount image 217 to generate the stereoscopic image 220.

  Thereafter, in step S <b> 611, the stereoscopic image output unit 224 outputs the generated stereoscopic image 220 to the three-dimensional monitor 206. As a result, the current stereoscopic image 220 is displayed from the three-dimensional monitor 306. At this stage, the processing in the stereoscopic image output apparatus 200 according to the present embodiment ends.

  In the above-described example, a step-like characteristic is shown as the characteristic of the first correction table 226, but the parallax amount with respect to the depth value may be set to “0”. In this case, an image composed of pixels with accuracy = “low” is displayed as a planar image.

  In the above-described example, the stereoscopic image 220 is displayed based on the two-dimensional image 62, the depth image 88, and the depth accuracy image 94 recorded in the external storage device 12. However, as shown in FIG. In addition, the stereoscopic image output apparatus 200 according to the present embodiment is connected to the personal computer 108, and the two-dimensional image 62, the depth image 88, the depth accuracy image 94, and the network 110 recorded on the hard disk of the personal computer 108 are connected. Stereoscopic images based on the two-dimensional image 62, the depth image 88, the depth accuracy image 94 downloaded from the website 112 via the web site 112, and the two-dimensional image 62, the depth image 88, and the depth accuracy image 94 transferred from other users. 220 may be created and output (displayed, etc.).

  Note that the stereoscopic image creation device, the stereoscopic image output device, and the stereoscopic image creation method according to the present invention are not limited to the above-described embodiments, and various configurations can be adopted without departing from the gist of the present invention. Of course.

DESCRIPTION OF SYMBOLS 10A ... 1st stereoscopic vision image creation apparatus 10B ... 2nd stereoscopic vision image creation apparatus 10C ... 3rd stereoscopic vision image creation apparatus 12 ... External storage device 16 ... 1st camera part 20 ... 2nd camera part 62 ... 1st two-dimensional Image (2D image) 76 ... 2D image 78 ... Distance information acquisition means 80 ... Depth image generation means 82 ... Shooting related information acquisition means 84 ... Depth image generation method determination means 86 ... Distance information file 88 ... Depth image 90a ~ 90g ... Mapping table 92 ... Depth accuracy image generation means 94 ... Depth accuracy image 96 ... Building image 98 ... Face image 100 ... Distance measuring device 108 ... Personal computer 110 ... Network 112 ... Web site 200 ... Stereoscopic image output device 206 ... 3D monitor 216 ... Image reading means 217 ... Parallax amount image 218 ... Parallax amount calculation means 220 Stereoscopic image 222 ... stereoscopic image generation means 224 ... stereoscopic image output unit

Claims (14)

2D image acquisition means for acquiring a 2D image of a subject;
Distance information acquisition means for acquiring distance information to the subject;
Depth image generation means for generating a depth image for outputting a stereoscopic image of the subject based on at least the distance information acquired by the distance information acquisition means;
Shooting related information acquisition means for acquiring one or more shooting related information when the subject is imaged;
A depth image generation method determination unit that determines one depth image generation method among a plurality of depth image generation methods for generating the depth image based on the shooting-related information acquired by the shooting-related information acquisition unit; Have
The depth image generation unit generates a depth image based on the distance information acquired by the distance information acquisition unit and the depth image generation method determined by the depth image generation method determination unit. Stereoscopic image creation device. 2D image acquisition means for acquiring a 2D image of a subject;
Distance information acquisition means for acquiring distance information to the subject;
Depth image generation means for generating a depth image for outputting a stereoscopic image of the subject based on at least the distance information acquired by the distance information acquisition means;
Shooting-related information acquisition means for acquiring a plurality of shooting-related information when the subject is imaged;
Depth accuracy image generation means for generating a depth accuracy image in which accuracy information for setting depth accuracy in the generated depth image is arranged;
A depth image generation method determination unit that determines one depth image image generation among a plurality of depth image generation methods for generating the depth image based on the shooting related information acquired by the shooting related information acquisition unit; ,
Depth accuracy image generation in which one depth accuracy image image generation among a plurality of depth accuracy image generation methods for generating the depth accuracy image is determined based on imaging related information acquired by the imaging related information acquisition means A method determining means,
The depth image generation means generates a depth image based on the distance information acquired by the distance information acquisition means and the depth image generation method determined by the depth image generation method determination means,
The stereoscopic image creation apparatus, wherein the depth accuracy image generation unit generates a depth accuracy image based on the depth image generation method determined by the depth accuracy image generation method determination unit. The stereoscopic image creation device according to claim 2,
The stereoscopic image creation apparatus, wherein the depth accuracy image generated by the depth accuracy image generation means is a binary image indicating the level of accuracy. The stereoscopic image creation device according to any one of claims 1 to 3,
Furthermore, it has a memory | storage means to memorize | store the said several depth image generation method,
The depth image generation method determination unit reads out a depth image generation method corresponding to the shooting-related information acquired by the shooting-related information acquisition unit from the storage unit, and supplies the depth image generation method to the depth image generation unit. Stereoscopic image creation device. The stereoscopic image creation device according to any one of claims 1 to 3,
The depth image generation method determination means receives a depth image generation method corresponding to the shooting related information acquired by the shooting related information acquisition means from the plurality of depth image generation methods via a network, and sends the depth image generation means to the depth image generation means. A stereoscopic image creation device characterized by being supplied. In the stereoscopic image creation device according to any one of claims 1 to 5,
The stereoscopic image creating apparatus, wherein the shooting related information acquired by the shooting related information acquisition means is an input shooting mode. In the stereoscopic image creation device according to any one of claims 1 to 5,
The stereoscopic image creating apparatus, wherein the shooting related information acquired by the shooting related information acquiring unit is luminance information of the two-dimensional image generated by the two-dimensional image generating unit. In the stereoscopic image creation device according to any one of claims 1 to 5,
The stereoscopic image creating apparatus, wherein the shooting related information acquired by the shooting related information acquisition means is a lens aperture value at the time of shooting. In the stereoscopic image creation device according to any one of claims 1 to 5,
The stereoscopic image creating apparatus, wherein the shooting related information acquired by the shooting related information acquisition means is focusing distance information at the time of shooting. In the stereoscopic image creation device according to any one of claims 1 to 5,
The shooting-related information acquired by the shooting-related information acquisition unit is region information in which the image of the subject is recorded in the two-dimensional image generated by the two-dimensional image generation unit. A featured stereoscopic image creation device. The stereoscopic image creation apparatus according to claim 10,
The stereoscopic image creating apparatus, wherein the area information in which the subject image is recorded is area information in which the face image of the subject is recorded. 2D image acquisition means for acquiring a 2D image of a subject;
Distance information acquisition means for acquiring distance information to the subject;
Depth image generation means for generating a depth image for outputting a stereoscopic image of the subject based on at least the distance information acquired by the distance information acquisition means;
Depth accuracy image generation means for generating a depth accuracy image in which accuracy information for setting depth accuracy in the generated depth image is arranged;
Stereoscopic viewing from the two-dimensional image generated by the two-dimensional image generation unit, the depth image generated by the depth image generation unit, and the depth accuracy image generated by the depth accuracy image generation unit. A stereoscopic image output device comprising: a stereoscopic image generation means for generating an image. 2D image acquisition means for acquiring a 2D image of a subject;
Distance information acquisition means for acquiring distance information to the subject;
A stereoscopic image used in a stereoscopic image creation apparatus having depth image generation means for generating a depth image for outputting a stereoscopic image of the subject based on at least the distance information acquired by the distance information acquisition means. In the visual image creation method,
Acquiring one or more shooting-related information when the subject is imaged;
One depth image generation method is determined based on the acquired shooting-related information among a plurality of depth image generation methods for generating a depth image for outputting a stereoscopic image of the subject,
A stereoscopic image creation method, characterized in that a depth image is generated based on the acquired distance information and the determined depth image generation method. 2D image acquisition means for acquiring a 2D image of a subject;
Distance information acquisition means for acquiring distance information to the subject;
A stereoscopic image used in a stereoscopic image creation apparatus having depth image generation means for generating a depth image for outputting a stereoscopic image of the subject based on at least the distance information acquired by the distance information acquisition means. In the visual image creation method,
Acquire a plurality of shooting-related information when imaging the subject,
Generating a depth accuracy image in which accuracy information for setting the depth accuracy in the generated depth image is arranged;
Of the plurality of depth image generation methods for generating the depth image, one depth image image generation is determined based on the shooting related information acquired by the shooting related information acquisition means,
Of the plurality of depth accuracy image generation methods for generating the depth accuracy image, one depth accuracy image image generation is determined based on the acquired shooting-related information,
Generate a depth image based on the acquired distance information and the determined depth image generation method,
A stereoscopic image creation method, wherein a depth accuracy image is generated based on the determined depth image generation method.

Images