JP2007194695A - Three-dimensional image cutting-out position calculating apparatus and program thereof, and three-dimensional image cutting-out apparatus and program thereof - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a three-dimensional image cutting-out apparatus for generating a three-dimensional image less causing a burden on a viewer. <P>SOLUTION: An image input section 3 and an image input section 4 respectively receive inputs of photographed images for left and right eyes. An image separation processing 5 and an image separation processing 6 respectively generate left eye and right eye extracted images resulting from separating only a photographing object from the photographed images for the left and right eyes. A cutting-out position detection processing 7 compares the left eye extracted image with the right eye extracted image sequentially shifted laterally and detects a position with a least difference as a cutting-out position as a result of the comparison. A cutting-out processing 11 and a cutting-out processing 12 respectively cut out a cutting-out region wherein the left eye photographed image and the right eye photographed image shifted laterally up to the cutting-out position are overlapped respectively from the left eye photographed image and the right eye photographed image. A three-dimensional image generating processing 13 generates a three-dimensional image from the images cut out by the cutting-out processing 11 and the cutting-out processing 12. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a stereoscopic image cut-out position calculation device that processes a stereoscopic image taken by two cameras, a program thereof, a stereoscopic image cut-out device, and a program.

Conventionally, various stereoscopic display devices have been invented, and a method of reproducing stereoscopic data on a stereoscopic display device has been tried. When displaying 3D data on a 3D display using glasses such as a barrier 3D display or polarized glasses / shutter glasses, two viewpoint images corresponding to the left and right eyes are prepared in advance. Humans can perceive three-dimensionally by compositing on the display. In order to create an image to be displayed on these displays, as shown in FIG. 7, two cameras are arranged in parallel, and shooting is performed from the cutout position where the left and right angles of view intersect according to the position of the target. It is necessary to perform a process of cutting out the image of the cutout area.
In the prior art, in order to create a 3D live-action image to be displayed on the 3D display, the images taken by the two cameras are taken into a computer or memory, and the distance to the object is measured before the left and right cameras The size of the cutout area where the angle of view overlaps is calculated and cut out. For this reason, in a scene in which the shooting target dynamically changes, a three-dimensional live-action image targeting a certain distance is obtained. Moreover, in patent document 1, the cut-out area | region is calculated | required so that a difference may become the minimum from the correlation of a video on either side.
JP 2002-223458 A

  However, in the stereoscopic image creating apparatus shown in Patent Document 1, since the background correlation is high in a scene in which the background occupies a large amount, the position of the background is the same in the left-eye and right-eye images. There is a case where the position of the target object is separated, and when looking at the target object, the viewpoint of the left eye and the viewpoint of the right eye are separated, and there is a problem that the viewer is burdened and easily tired.

  The present invention has been made in view of such circumstances, and an object of the present invention is to provide a stereoscopic image extraction position calculation device and a stereoscopic image extraction device that generate a stereoscopic image with less burden on the viewer.

  The present invention has been made to solve the above-described problems, and the invention according to claim 1 is a first image receiving means for receiving an input of an extracted image for the left eye from which only an object to be photographed is extracted. A second image receiving means for receiving an input of an extracted image for the right eye, which is an image having the same size as the extracted image for the left eye and from which only the object to be photographed is extracted, and the extracted image for the left eye Alternatively, the left-eye extraction image is compared with the right-eye extraction image while sequentially shifting the right-eye extraction image in the horizontal direction, and as a result of comparison, the left-eye extraction image when the difference is the smallest Alternatively, the stereoscopic image cut-out position calculating device includes cut-out position detecting means for detecting the position of the extracted image for the right eye as a cut-out position.

  According to a second aspect of the present invention, there is provided a first image receiving means for receiving an input of an extracted image for the left eye from which only an object to be photographed is extracted, and an image having the same size as the extracted image for the left eye. A second image receiving means for receiving an input of an extracted image for the right eye from which only the object to be photographed is extracted, and a vertical direction of the object at each pixel position in the horizontal direction of the extracted image for the left eye First projection means for calculating the number of pixels of the object, second projection means for calculating the number of pixels in the vertical direction of the object at each pixel position in the horizontal direction of the extracted image for the right eye, and for the left eye The absolute value of the difference at each pixel position between the calculation result of the first projection means and the calculation result of the second projection means is summed up while sequentially shifting the extraction image or the extraction image for the right eye in the horizontal direction. The calculated value is the smallest. Kino wherein a three-dimensional image extraction position calculating device, characterized in that it comprises a projection comparing means for detecting as an extracted image or the position cut out position of the extracted image for the right eye left eye.

  According to a third aspect of the present invention, there is provided a first image input means for accepting an input of a left-eye photographed image and a second image input means for accepting an input of a right-eye photographed image having the same size as the left-eye photographed image. Image input means, and first image separation means for generating an extracted image for the left eye obtained by separating only the object to be photographed from the photographed image for the left eye received by the first image input means, Second image separation means for generating an extracted image for the right eye obtained by separating only the object to be photographed from the photographed image for the right eye received by the second image input means; and the extracted image for the left eye or the The left-eye extracted image is compared with the right-eye extracted image while sequentially shifting the right-eye extracted image in the horizontal direction, and as a result of comparison, the left-eye extracted image or the Cut out the position of the extracted image for the right eye A cut-out position detection unit that detects the position xc, a left-eye shot image or the left-eye shot image that is shifted laterally to the cut-out position xc detected by the cut-out position detection unit, and the right-eye shot image or The left eye shifted laterally to a cutout position xc detected by the cutout position detecting means and a first cutout means that cuts out an image of a cutout region that overlaps the lefteye shot image from the lefteye shot image. A second cutout unit that cuts out an image of a cutout region where the shot image for the left eye or the shot image for the left eye overlaps the shot image for the right eye or the shot image for the left eye from the shot image for the right eye; A stereoscopic image generating means for generating a stereoscopic image from the image cut out by the first cutting out means and the image cut out by the second cutting out means. That a three-dimensional image extraction apparatus.

  The invention according to claim 4 is the stereoscopic image cut-out position calculating device according to claim 3, wherein the cut-out position detecting means is the target at each pixel position in the horizontal direction of the extracted image for the left eye. First projecting means for calculating the number of pixels in the vertical direction of the object; and second projecting means for calculating the number of pixels in the vertical direction of the object at each pixel position in the horizontal direction of the extracted image for the right eye; While sequentially shifting the extracted image for the left eye or the extracted image for the right eye in the horizontal direction, the difference in each pixel position between the calculation result of the first projection means and the calculation result of the second projection means Projection comparison means for calculating a value obtained by summing absolute values and detecting the position of the extracted image for the left eye or the extracted image for the right eye when the calculated value is the smallest as the cutout position xc. Features.

  The invention according to claim 5 is the stereoscopic image cutting device according to claim 3 or claim 4, wherein the focal length is f, the focus is set to the input distance, and the left eye is focused. A first camera that captures a photographed image is installed in parallel with the first camera at a position spaced apart from the first camera by an arrangement interval Bc, has a focal length of f, and an input distance. The second camera that captures the right-eye photographed image in focus and the distance Dc is calculated by Dc = Bc · f / (Q · xc) (Q is a unit adjustment factor), and the distance And a distance calculating means for outputting Dc to the first camera and the second camera.

  Further, the invention described in claim 6 is a first image receiving means for receiving an input of an extracted image for the left eye from which only a subject to be photographed is extracted, and the same size as the extracted image for the left eye. Second image receiving means for receiving an input of an extracted image for the right eye from which only the object to be photographed is extracted, and sequentially extracting the extracted image for the left eye or the extracted image for the right eye in the horizontal direction. While shifting, the extracted image for the left eye and the extracted image for the right eye are compared, and the position of the extracted image for the left eye or the extracted image for the right eye when the difference is the smallest as a result of comparison is set as a cut-out position. It is a program for functioning as a cut-out position detecting means for detecting.

  According to a seventh aspect of the present invention, there is provided a first image input means for accepting an input of a left-eye photographed image from a computer, a first image input means for accepting an input of a right-eye photographed image having the same size as the left-eye photographed image. Second image input means, first image separation means for generating an extracted image for the left eye obtained by separating only the object to be photographed from the photographed image for the left eye received by the first image input means, 2nd image separation means for generating an extracted image for the right eye obtained by separating only the object to be photographed from the photographed image for the right eye received by the second image input means, the extracted image for the left eye or the right eye The extracted image for the left eye and the extracted image for the right eye are compared with each other while sequentially shifting the extracted image of the left eye and the extracted image for the right eye as a result of the comparison. Extracted image position Cutout position detection means for detecting as a cutout position, the left eye shot image or the left eye shot image, and the right eye shot image or the left eye shifted laterally to the cutout position detected by the cutout position detection means The left-eye photographic image obtained by laterally shifting the image of the cut-out area that overlaps with the photographic image for use to the cut-out position detected by the first cut-out means and the cut-out position detection means cut out from the left-eye shoot image Or a second cut-out means for cutting out an image of a cut-out area where the left-eye shot image and the right-eye shot image or the left-eye shot image overlap, from the right-eye shot image; A program for functioning as a stereoscopic image generating means for generating a stereoscopic image from an image cut out by the cutting means and an image cut out by the second cutting means. That.

  According to the present invention, the first extracted image obtained by extracting only the object from the photographed image and the second extracted image are compared while being shifted in the horizontal direction, and the position with the smallest difference is output as the cutout position. When a captured image is cut out using the cut-out position, a stereoscopic image with less burden on the viewer can be generated in the left eye image and the right eye image with the same shooting target.

  Further, according to the present invention, the extracted image for the left eye obtained by extracting only the object from the photographed image and the extracted image for the right eye are compared while being shifted in the horizontal direction, and the photographed image is based on the position with the smallest difference. Therefore, in the left-eye image and the right-eye image, the object to be photographed becomes the same place, and a stereoscopic image with less burden on the viewer can be generated.

  Further, according to the present invention, the first camera and the second camera are focused on the basis of the distance to the object calculated from the positional relationship of the object to be photographed in the image for the left eye and the image for the right eye. The first camera and the second camera can be focused on the object.

  First, an outline of an embodiment of the present invention will be described with reference to FIG. In the present embodiment, two cameras for the left eye and the right eye are installed in parallel, and stereoscopic image shooting is performed for shooting an object with each camera. Only the object is separated and extracted from each photographed image, but a warehouse is generated. At this time, in the image taken with the right eye camera, the position of the object in the image is shifted to the left in the horizontal direction compared to the image taken with the left eye camera. Therefore, for each of the left eye and right eye, after performing a projection process that takes the distribution of the number of pixels in the vertical direction at each pixel position in the horizontal direction, the distribution of the number of pixels for the right eye is shifted in the horizontal direction, A position where the distribution of the number of pixels for the left eye and the distribution of the number of pixels for the right eye match is searched. Then, using the shifted position when the left and right are matched as the cutout position, the image of the cutout area is cut out from each captured image, and a stereoscopic image is generated and displayed.

  Embodiments of the present invention will be described below with reference to the drawings. FIG. 2 is a schematic block diagram showing the configuration of the stereoscopic image cutting device according to one embodiment of the present invention. Reference numeral 1 denotes a camera that has a focal length f, shoots while focusing on the distance input from the distance calculation processing 15, and outputs captured image data for the left eye. 2 is installed in parallel with the camera 1 at a position distant from the camera 1 on the right side by the arrangement interval Bc, has a focal length f, and takes a picture focused on the distance input from the distance calculation processing 15 for the right eye. This is the same camera as the camera 1 that outputs the captured image data. Reference numeral 3 denotes an image input unit that receives input of captured image data for the left eye captured by the camera 1. Similarly to the image input unit 3, 4 is an image input unit that accepts input of captured image data for the right eye captured by the camera 2.

  Reference numeral 5 denotes image separation processing that is received by the image input unit 3 and generates extracted image data for the left eye obtained by separating only the object to be photographed from the captured image data for the left eye. Similar to the image separation process 5, 6 is an image separation process that is received by the image input unit 4 and generates extracted image data for the right eye obtained by separating only the object to be photographed from the photographed image data for the right eye. Reference numeral 7 denotes a cut-out position detection process including projection processes 8 and 9 and a projection comparison process 10. The projection process 8 outputs the left projection result obtained by calculating the number of pixels in the vertical direction of the object at each position in the horizontal direction of the extracted image data for the left eye. Similar to the projection process 8, the projection process 9 outputs the right projection result obtained by calculating the number of pixels in the vertical direction of the object at each position in the horizontal direction of the extracted image data for the right eye. As shown in FIGS. 6A and 6B, the projection comparison process 10 includes the left projection result and the position xc in the right direction (−L <xc <L, where L is the horizontal direction of the extracted image data. A value S (xc) obtained by summing the absolute values of the differences at each position from the right projection result shifted to the number of pixels in the direction (xc is an integer) is calculated for all positions xc, and the value S (xc) is The position xc when it becomes the smallest is detected as the cutout position.

  11 cuts out from the left-eye shot image data a cut-out area where the right-eye shot image data and the left-eye shot image data that have been shifted laterally to the cut-out position xc detected by the projection comparison processing 10 overlap. Cutting process. 12, similarly to the cutout process 11, a cutout area in which the right-eye shot image data shifted to the cutout position xc detected by the projection comparison process 10 and the left-eye shot image data overlap is used for the right eye. This is a cut-out process for cutting out from the captured image data. Reference numeral 13 denotes a stereoscopic image generation process for generating stereoscopic image data from the image data extracted by the extraction process 11 and the image data extracted by the extraction process 12. Reference numeral 14 denotes a stereoscopic image display device for displaying a stereoscopic image such as a barrier type three-dimensional display or a three-dimensional display using glasses such as polarizing glasses and shutter glasses. The distance calculation process 15 acquires the cut-out position xc from the projection comparison process 10, calculates the distance Dc by Dc = Bc · f / (Q · xc) (Q is a unit adjustment coefficient), and calculates the distance Dc. Output to camera 1 and camera 2. As described above, here, Bc is an arrangement interval between the camera 1 and the camera 2, and f is a focal length of the camera 1 and the camera 2.

  Note that these image separation processes 5 and 6, cut-out position detection treatment 7, cut-out processes 11 and 12, stereoscopic image generation process 13, and distance calculation process 15 may be realized by dedicated hardware, In addition, these processes are configured by a memory and a CPU (central processing unit), and a program for realizing the functions of these processes is loaded into the memory and executed to realize the functions. Good.

  Next, the operation of this stereoscopic image cutting device will be described. First, as shown in FIG. 3, a distance Bc is set and a camera 1 installed on the left side and a camera 2 installed in parallel with the camera 1 are used to shoot an object at a distance Dc ahead with a moving image. The camera 1 outputs left-eye shot image data, and the camera 2 outputs right-eye shot image data. The captured image data output by the camera 1 and the camera 2 is received by the image input unit 3 for the left-eye captured image data output by the camera 1, and the captured image data for the right eye output by the camera 2 is the image input unit 4. Accept. The image input unit 3 and the image input unit 4 separate the received captured image data frame by frame, the image input unit 3 outputs the image separation process 5, and the image input unit 4 outputs the image separation process 6. To do.

  When the image separation process 5 and the image separation process 6 receive the captured image data for the left eye and the right eye one frame at a time, the image separation process 5 outputs the received image data as it is to the cutout process 11, respectively. 6 is output to the clipping process 12 and, as shown in the flowchart of FIG. 4, the data of each pixel of the captured image data received frame by frame is compared with the data of each pixel of the background image data described later. Pixels that match the data are removed as the background, pixels that do not match the data are extracted as objects, and the image separation process 5 and the image separation process 6 generate extracted image data for the left eye and the right eye, respectively. Then, the image separation process 5 outputs the generated extracted image data for the left eye to the projection process 8, and the image separation process 6 outputs the generated extracted image data to the projection process 9 (S1). Note that the background image data used here is the image of only the background with the camera 1 and the camera 2 removed, and the image input 3 and 4 via the image inputs 3 and 4, respectively, prior to the moving image shooting. This is the data acquired and stored by the separation processes 5 and 6.

  When the projection process 8 and the projection process 9 receive the extracted image data for the left eye and the right eye, respectively, as shown in FIG. 5, the number of non-blank pixels is obtained by scanning in the vertical direction for each position in the horizontal direction. calculate. In the example of FIG. 5, “0”, “0”, “0”, “0”, “4”, “6”, “8”, “8”, “8” are provided for the positions 0 to 11 in the horizontal direction. ”,“ 6 ”,“ 4 ”,“ 0 ”. The projection process 8 receives the extracted image data for the left eye and outputs the left projection result calculated as described above to the projection comparison process 10, and the projection process 9 receives the extracted image data for the right eye and The right projection result calculated as described above is output to the projection comparison process 10 (S2).

  When the projection comparison process 10 receives the left projection result and the right projection result, when the number of pixels L in the horizontal direction is 12, as shown in FIG. The result is shifted to the left by 11 pixels, which is 1 less than the number of pixels L. At this time, the shifted position xc is expressed as xc = -11, with the right direction being a plus. As will be described later in detail, the projection comparison process 10 takes the absolute value of the difference at each position in the shifted state and calculates the total value S (xc) (S3). Next, the right projection result previously shifted to xc = -11 is shifted by one to the right so that xc = −10 is added to the position xc (S4). Next, in step S5, the determination condition is that the position xc is larger than the maximum. The maximum of the position xc is xc = L−1 = the previous one where the left projection result and the right projection result do not overlap. Therefore, when xc = −10, the projection comparison process 10 determines that the determination condition xc is not greater than the maximum, and the process returns to step S3 again. Thus, the projection comparison process 10 repeats the process of step S3 from xc = -11 to xc = 11. Then, xc = L = 12, and since the determination condition of step S5 is satisfied, the process proceeds to step S6. In step S6, the projection comparison processing 10 performs the position xc when the value S (xc) is the smallest value among the previously calculated values S (xc) (S (xc) = in FIG. 6B). Xc = 3), which is 0, is selected as the extraction position, and is output to the extraction processes 11 and 12 and the distance calculation process 15.

  When the cut-out process 11 receives the cut-out position xc from the projection comparison process 10, the cut-out width is a width that overlaps the left-eye shot image data when the right-eye shot image data is shifted to the cut-out position xc as shown in FIG. The image data of the cut-out area is extracted from the right end of the left-eye photographed image data received from the image separation process 5 and output to the stereoscopic image generation process 13 (S7). When the cut-out process 12 receives the cut-out position xc from the projection comparison process 10, the cut-out width that overlaps the left-eye shot image data when the right-eye shot image data is shifted to the cut-out position xc as shown in FIG. The image data of the cut-out area is extracted from the left end of the captured image data for the right eye received from the image separation process 6 and output to the stereoscopic image generation process 13 (S7). The stereoscopic image generation process 13 generates and outputs stereoscopic image data for the stereoscopic image display device 14 based on the image data received from the clipping processes 11 and 12. The stereoscopic image display device 14 receives stereoscopic image data and displays a stereoscopic image.

On the other hand, the distance calculation process 15 that has received the cut-out position xc calculates the distance Dc to the object by the equation (4).
Dc = Bc · f / (Q · xc) (4)
Where Bc is the installation interval between camera 1 and camera 2
f is the focal length of camera 1 and camera 2
Q is a coefficient for matching units
xc is the cut-out position The distance calculation process 15 outputs the calculated distance Dc to the camera 1 and the camera 2. Upon receiving the distance Dc, the camera 1 and the camera 2 focus on the distance Dc.
For this reason, the camera 1 and the camera 2 can focus on the object to be photographed.

Here, taking the case of xc = 0 as an example, the processing contents in step S3 of the projection comparison processing 10 described in detail above will be described. When xc = 0, as shown in FIG. 6A, the absolute value of the difference at each position between the following (1) that is the left projection result and the following (2) that is the right projection result that is not shifted. The following (3) is obtained.
“0”, “0”, “0”, “0”, “4”, “6”, “8”, “8”, “8”, “6”, “4”, “0” (1) )
“0”, “4”, “6”, “8”, “8”, “8”, “6”, “4”, “0”, “0”, “0”, “0” (2) )
| 0-0 | = 0, | 0-4 | = 4, | 0-6 | = 6, | 0-8 | = 8, | 4-8 | = 4, | 6-8 | = 2, | 8 −6 | = 2, | 8-4 | = 4, | 8-0 | = 8, | 6-0 | = 6, | 4-0 | = 4, | 0-0 | = 0, | 0-0 | = 0 (3)
Next, when the sum S (0) of each value of (3) is calculated, S (0) = 0 + 4 + 6 + 8 + 4 + 2 + 2 + 4 + 8 + 6 + 4 + 0 + 0 = 48.

  In the above embodiment, the projection comparison process 10 sets the range of the cutout position xc for calculating the sum S (xc) of the absolute values of differences as −L <xc <L. Therefore, the amount of calculation may be reduced by setting the range of the cutout position xc for calculating the sum S (xc) of the absolute values of the differences to 0 ≦ xc <L.

  Further, in the image separation processes 5 and 6, the extracted image data for extracting the object to be photographed is generated by comparing with the background image data obtained by photographing only the background in advance. When shooting an object, only a specific color is used for the background, and the specific color is stored in advance in the image separation processes 5 and 6 so that the color does not match the specific color. You may use the chroma key process which extracts a pixel as a target object and produces | generates extraction image data.

  In the present embodiment, a moving image is targeted, but a still image may be targeted. Further, although the camera 1 and the camera 2 are installed in parallel, they may be directed inward. When the camera 1 and the camera 2 are not installed in parallel, the equation (4) needs to be changed according to the arrangement relationship between the camera 1 and the camera 2.

  As another embodiment of the present invention, the cut-out position detection process 7 according to this embodiment is an independent apparatus including two image receiving units for inputting extracted image data to the projection process 8 and the projection process 9, respectively. A cutting position calculation device may be used.

  The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes a design and the like within the scope not departing from the gist of the present invention.

It is a figure explaining the outline | summary of the stereo image cutting device by one Embodiment of this invention. It is a block diagram which shows the structure of the stereo image cutting device by the same embodiment. It is a figure explaining the positional relationship of the camera 1, the camera 2, and the imaging | photography target object in the embodiment. It is a flowchart explaining operation | movement of the stereo image cutting device by the embodiment. It is a figure explaining operation | movement of the projection processes 8 and 9 in the embodiment. It is a figure explaining operation | movement of the projection comparison process 10 in the embodiment. It is a figure explaining the prior art.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1, 2 ... Camera 3, 4 ... Image input part 5, 6 ... Image separation process 7 ... Extraction position detection process 8, 9 ... Projection process 10 ... Projection comparison process 11, 12 ... Extraction process 13 ... Three-dimensional image generation process 14 ... Stereoscopic image display device 15 ... distance calculation processing

Claims (7)

A first image receiving means for receiving an input of an extracted image for the left eye from which only an object to be photographed is extracted;
A second image receiving means for receiving an input of an extracted image for the right eye, which is an image having the same size as the extracted image for the left eye and from which only the object to be photographed is extracted;
The left-eye extraction image or the right-eye extraction image is sequentially shifted in the horizontal direction while comparing the left-eye extraction image with the right-eye extraction image. A three-dimensional image cut-out position calculating device comprising: a cut-out position detecting unit that detects a position of the extracted image for the left eye or the extracted image for the right eye as a cut-out position. A first image receiving means for receiving an input of an extracted image for the left eye from which only an object to be photographed is extracted;
A second image receiving means for receiving an input of an extracted image for the right eye, which is an image having the same size as the extracted image for the left eye and from which only the object to be photographed is extracted;
First projecting means for calculating the number of pixels in the vertical direction of the object at each pixel position in the horizontal direction of the extracted image for the left eye;
Second projecting means for calculating the number of pixels in the vertical direction of the object at each pixel position in the horizontal direction of the extracted image for the right eye;
While sequentially shifting the extracted image for the left eye or the extracted image for the right eye in the horizontal direction, the difference in each pixel position between the calculation result of the first projection means and the calculation result of the second projection means Projection comparing means for calculating a value obtained by summing absolute values, and detecting a position of the extracted image for the left eye or the extracted image for the right eye when the calculated value is the smallest as a cutout position. A stereoscopic image cut-out position calculating device. First image input means for receiving input of a left-eye photographed image;
Second image input means for accepting an input of a right-eye shot image having the same size as the left-eye shot image;
First image separation means for generating an extracted image for the left eye obtained by separating only the object to be photographed from the photographed image for the left eye received by the first image input means;
Second image separation means for generating an extracted image for the right eye obtained by separating only the object to be photographed from the photographed image for the right eye received by the second image input means;
The left-eye extraction image or the right-eye extraction image is sequentially shifted in the horizontal direction while comparing the left-eye extraction image with the right-eye extraction image. Cutout position detecting means for detecting the position of the extracted image for the left eye or the extracted image for the right eye as a cutout position xc;
A cutout region in which the left-eye shot image or the left-eye shot image and the right-eye shot image or the left-eye shot image overlap each other, shifted laterally to the cutout position xc detected by the cutout position detection unit. First cutting means for cutting out the image of the left eye photographed image,
A cutout region in which the left-eye shot image or the left-eye shot image and the right-eye shot image or the left-eye shot image overlap each other, shifted laterally to the cutout position xc detected by the cutout position detection unit. A second cutting-out means for cutting out the image from the right-eye photographed image;
A stereoscopic image extraction apparatus comprising: a stereoscopic image generation unit that generates a stereoscopic image from the image extracted by the first extraction unit and the image extracted by the second extraction unit. The cutout position detecting means includes
First projecting means for calculating the number of pixels in the vertical direction of the object at each pixel position in the horizontal direction of the extracted image for the left eye;
Second projecting means for calculating the number of pixels in the vertical direction of the object at each pixel position in the horizontal direction of the extracted image for the right eye;
While sequentially shifting the extracted image for the left eye or the extracted image for the right eye in the horizontal direction, the difference in each pixel position between the calculation result of the first projection means and the calculation result of the second projection means A projection comparing means for calculating a value obtained by summing absolute values and detecting a position of the extracted image for the left eye or the extracted image for the right eye when the calculated value is the smallest as the cutout position xc. The three-dimensional image cutout position calculating device according to claim 3, wherein A first camera having a focal length f and focusing on the input distance to shoot the left-eye shot image;
The right-eye photographed image for the right eye, which is disposed on the right side of the first camera at a disposition distance Bc in parallel with the first camera, has a focal length of f, and focuses on the input distance. A second camera for shooting
A distance calculating unit that calculates the distance Dc by Dc = Bc · f / (Q · xc) (Q is a unit adjustment coefficient) and outputs the distance Dc to the first camera and the second camera; The stereoscopic image cutting device according to claim 3 or 4, further comprising: Computer
A first image receiving means for receiving an input of an extracted image for the left eye from which only a shooting object is extracted;
A second image receiving means for receiving an input of an extracted image for the right eye, which is an image having the same size as the extracted image for the left eye and from which only the object to be photographed is extracted;
The left-eye extraction image or the right-eye extraction image is sequentially shifted in the horizontal direction while comparing the left-eye extraction image with the right-eye extraction image. A program for functioning as cutout position detecting means for detecting the position of the extracted image for the left eye or the extracted image for the right eye as a cutout position. First image input means for accepting an input of a left eye photographed image;
A second image input means for receiving an input of a right-eye photographed image having the same size as the left-eye photographed image;
First image separation means for generating an extracted image for the left eye obtained by separating only the object to be photographed from the photographed image for the left eye received by the first image input means;
Second image separating means for generating an extracted image for the right eye obtained by separating only the object to be photographed from the photographed image for the right eye received by the second image input means;
The left-eye extraction image or the right-eye extraction image is sequentially shifted in the horizontal direction while comparing the left-eye extraction image with the right-eye extraction image. Cutout position detecting means for detecting the position of the extracted image for the left eye or the extracted image for the right eye as a cutout position;
A cutout region in which the left-eye photographed image or the left-eye photographed image and the right-eye photographed image or the left-eye photographed image, which are laterally shifted to the cutout position detected by the cutout position detecting means, overlap. First cutout means for cutting out an image from the photographed image for the left eye;
A cutout region in which the left-eye photographed image or the left-eye photographed image and the right-eye photographed image or the left-eye photographed image, which are laterally shifted to the cutout position detected by the cutout position detecting means, overlap. A second cutting means for cutting an image from the right-eye photographed image;
A program for functioning as a stereoscopic image generating unit that generates a stereoscopic image from an image cut out by the first cutting unit and an image cut out by the second cutting unit.

Images