JP2010109785A - Three-dimensional imaging apparatus and method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To eliminate an uncomfortable feeling for an image of three-dimensional display, and to enable high quality three-dimensional display when changing zoom magnification. <P>SOLUTION: Only a zoom lens 11B of an imaging unit 21B is moved to a tele-side at the time of zoom-in. At this time, a first image G1 is enlarged in response to zoom magnification of the imaging unit 21B so that a display field angle A0 of the first image G1 obtained by an imaging unit 21A to a monitor 20 accords with an imaging field angle of the imaging unit 21B. When a zoom operation is completed, only the zoom lens 11A of the imaging unit 21A is moved so as to accord with zoom magnification of the imaging unit 21B. At this time, a magnification ratio of the first image G1 is changed to a reduction side so that the display field angle of the first image G1 obtained by the imaging unit 21A to the monitor 20 accords with the display field angle of the imaging unit 21B. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a three-dimensional imaging apparatus and method for acquiring a plurality of images for three-dimensional display by photographing a subject from different positions, and a program for causing a computer to execute the three-dimensional imaging method.

  It is known that stereoscopic viewing can be performed using parallax by combining a plurality of images and displaying them three-dimensionally. In such a stereoscopic view, a plurality of images are acquired by photographing the same subject from different positions using a plurality of cameras, and the plurality of images are three-dimensionally obtained using the parallax of the subjects included in the plurality of images. It can be generated by displaying.

  Specifically, in the case of a method for realizing stereoscopic vision by the naked eye balance method, a plurality of images can be arranged side by side to perform three-dimensional display. In addition, a plurality of images are overlapped with different colors such as red and blue, or a plurality of images are overlapped with different polarization directions, and a plurality of images are combined to perform three-dimensional display. Can do. In this case, stereoscopic viewing can be performed by using the image separation glasses such as red-blue glasses and polarizing glasses to fuse the three-dimensionally displayed image with the automatic focusing function of the eyes (an anaglyph method, a polarizing filter). method).

  Further, it is also possible to display a plurality of images on a three-dimensional display monitor that can be stereoscopically viewed and stereoscopically viewed without using polarized glasses or the like, as in the parallax barrier method and the lenticular method. In this case, three-dimensional display is performed by cutting a plurality of images into strips in the vertical direction and arranging them alternately. In addition, a method of performing three-dimensional display by alternately displaying the left and right images while changing the light beam direction of the left and right images by using image separation glasses or attaching an optical element to the liquid crystal has been proposed. (Scan backlight method).

  In addition, a compound eye camera having a plurality of photographing units that performs photographing for performing such three-dimensional display has been proposed. Such a compound eye camera includes a plurality of photographing units arranged at predetermined intervals, generates a three-dimensional display image from images acquired by the plurality of photographing units, and uses the generated three-dimensional display image as a monitor. Three-dimensional display is possible.

  By the way, when photographing using a compound eye camera, it is possible to change the angle of view for photographing by using the zoom function provided in each imaging unit. In this case, the photographer can perform photographing so that the subject has a desired size by performing a zoom operation on the compound eye camera while viewing the through image displayed three-dimensionally. As described above, a method for accurately matching the zoom magnifications of the photographing units when performing zoom operation in a compound-eye camera has been proposed (see Patent Document 1).

  However, as described in Patent Document 1, a large amount of power is required to drive the zoom magnifications of the photographing units simultaneously. For this reason, when the zoom operation of the compound eye camera is performed, only the zoom magnification of one photographing unit is changed first, and then the zoom magnification of the other photographing unit is driven to match the zoom magnification of one camera. Has been proposed (see Patent Document 2).

In addition, in a compound eye camera having two photographing units, a zoom mechanism is provided only in one photographing unit, and when the zoom magnification is changed, an enlargement ratio of an image acquired by another photographing unit is changed by electronic zoom, A method for matching the display angle of view of an image acquired by another imaging unit with the imaging angle of view of one imaging unit has also been proposed (see Patent Document 3).
JP-A-9-133852 JP 2005-181527 A JP 9-2115012 A

  However, in the method described in Patent Document 2, since only the zoom magnification of one photographing unit is changed, the display angle of view of a plurality of images used for three-dimensional display does not match, and as a result, during zoom operation The three-dimensionally displayed image is very uncomfortable. On the other hand, the technique described in Patent Document 3 cannot perform high-quality three-dimensional display because the resolution of an image acquired by a photographing unit that does not have a zoom mechanism is reduced.

  The present invention has been made in view of the above circumstances, and an object thereof is to eliminate a sense of incongruity in an image displayed three-dimensionally and to perform high-quality three-dimensional display when changing the zoom magnification. And

A three-dimensional imaging device according to the present invention includes a plurality of imaging units having an optical zoom mechanism that acquires a plurality of images having parallax by imaging a subject at different positions.
3D processing means for performing 3D processing for 3D display on the plurality of images;
Display means for performing at least three-dimensional display of the plurality of images;
Zoom operation means for performing an operation of changing the zoom magnification at the time of the three-dimensional display;
When the zoom operation unit is operated, the optical zoom mechanisms of the plurality of photographing units are sequentially driven to sequentially change the zoom magnifications of the plurality of photographing units to the same zoom magnification, and the zoom magnification is changed. And a zoom control unit that changes an enlargement ratio of at least one of the plurality of images so that display angles of the plurality of images on the display unit coincide with each other. It is.

  “Sequentially driving the optical zoom mechanism” includes a case where the optical zoom mechanisms of a plurality of photographing units are alternately driven little by little. Also, when one optical zoom mechanism is driven at a high speed and the other optical zoom mechanism is driven at a low speed, that is, by driving at low power, the same effect as that of the present invention can be obtained. Included in "drive".

  In the three-dimensional imaging apparatus according to the present invention, when the zoom control unit is operated to zoom up the zooming unit, an optical zoom mechanism of one of the plurality of imaging units is provided. The zoom magnification of the one photographing unit is changed by driving, and the display angle of view of the other image acquired by the other photographing unit other than the one photographing unit on the display unit is the photographing of the one photographing unit. When the enlargement ratio of the other image is changed so as to coincide with the angle of view, and the operation of the zoom operation unit is stopped, the driving of the optical zoom mechanism of the one imaging unit is stopped, and the other imaging The optical zoom mechanism of the means is sequentially driven so as to coincide with the zoom magnification of the one photographing means, and the other image is displayed on the display means in accordance with the change of the zoom magnification of the other photographing means. The angle of view is To match the imaging angle of view of the imaging means may be a means for sequentially changing the magnification of the other images.

  In the three-dimensional imaging apparatus according to the present invention, when the zoom control unit performs a zoom-out operation on the zoom operation unit, the other imaging other than one of the plurality of imaging units is performed. The optical zoom mechanism of the unit is sequentially driven to sequentially change the zoom magnification of the other imaging unit to the minimum magnification, and the display angle of view of the other image acquired by the other imaging unit to the display unit is The enlargement ratio of the other image is sequentially changed so as to match the shooting angle of view of the one shooting unit, and then the optical zoom mechanism of the one shooting unit is driven to change the zoom magnification of the one shooting unit. In addition, the enlargement ratio of the other image is changed so that the display angle of view of the other image on the display unit matches the shooting angle of view of the one shooting unit, and the operation of the zoom operation unit is stopped. Then, the one shooting The optical zoom mechanism of the other photographing unit is sequentially driven so as to coincide with the zoom magnification of the one photographing unit, and the zoom magnification of the other photographing unit is changed. In accordance with the above, it is possible to sequentially change the enlargement ratio of the other image so that the display angle of view of the other image on the display unit coincides with the shooting angle of view of the one imaging unit.

  In the three-dimensional imaging apparatus according to the present invention, when the zoom control unit performs a zoom-out operation on the zoom operation unit, the optical zoom mechanism of the plurality of imaging units is sequentially driven by a predetermined amount. The display angles of the plurality of images on the display unit are changed so as to coincide with each other and later than the change of the shooting angle of view of the plurality of imaging units by driving the optical zoom mechanism. When an enlargement ratio of at least one of the images is changed and the operation of the zoom operation unit is stopped, a display angle of view of the plurality of images on the display unit and a captured image of the plurality of imaging units The optical zoom mechanisms of the plurality of photographing means may be sequentially driven so that the corners coincide with each other.

A three-dimensional imaging method according to the present invention includes a plurality of imaging units having an optical zoom mechanism for acquiring a plurality of images having parallax by imaging subjects at different positions.
3D processing means for performing 3D processing for 3D display on the plurality of images;
Display means for performing at least three-dimensional display of the plurality of images;
A three-dimensional imaging method in a three-dimensional imaging apparatus comprising a zoom operation means for performing an operation of changing a zoom magnification at the time of the three-dimensional display,
When the zoom operation means is operated, the optical zoom mechanism of the plurality of photographing means is sequentially driven, and the zoom magnification of the plurality of photographing means is sequentially changed so as to be the same zoom magnification,
While changing the zoom magnification, an enlargement ratio of at least one of the plurality of images is changed so that display angles of the plurality of images on the display unit coincide with each other. .

  In addition, you may provide as a program for making a computer perform the three-dimensional imaging | photography method by this invention.

  According to the present invention, when the zoom operation unit is operated, the optical zoom mechanisms of the plurality of photographing units are sequentially driven so that the zoom magnifications of the plurality of photographing units are sequentially changed to the same zoom magnification. Then, during the change of the zoom magnification, the enlargement ratio of at least one of the plurality of images is changed so that the display angle of view of the plurality of images on the display unit matches. As a result, when the zoom operation is performed, the zoom mechanism is driven only by any one of the photographing means, so that large power consumption can be prevented. In addition, even during the zoom operation, the display angle of view of the plurality of images acquired by the plurality of photographing units on the display unit coincides, so that it is possible to eliminate a sense of discomfort when stereoscopically viewing an image displayed three-dimensionally. .

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a schematic block diagram showing an internal configuration of a compound eye camera to which a three-dimensional imaging apparatus according to an embodiment of the present invention is applied. As shown in FIG. 1, the compound-eye camera 1 according to this embodiment includes two photographing units 21A and 21B, a photographing control unit 22, an image processing unit 23, a compression / decompression processing unit 24, a frame memory 25, a media control unit 26, an internal A memory 27 and a display control unit 28 are provided. The photographing units 21A and 21B are arranged so as to photograph a subject with a predetermined baseline length and convergence angle.

  FIG. 2 is a diagram illustrating the configuration of the photographing units 21A and 21B. As shown in FIG. 2, the photographing units 21A and 21B include focus lenses 10A and 10B, zoom lenses 11A and 11B, diaphragms 12A and 12B, shutters 13A and 13B, CCDs 14A and 14B, analog front ends (AFE) 15A and 15B, and A / D converters 16A and 16B are provided. The photographing units 21A and 21B include focus lens driving units 17A and 17B that drive the focus lenses 10A and 10B and zoom lens driving units 18A and 18B that drive the zoom lenses 11A and 11B.

  The focus lenses 10A and 10B are for focusing on a subject, and can be moved in the optical axis direction by focus lens driving units 17A and 17B including a motor and a motor driver. The focus lens driving units 17A and 17B control the movement of the focus lenses 10A and 10B based on focusing data obtained by AF processing performed by the imaging control unit 22 described later.

  The zoom lenses 11A and 11B are for realizing a zoom function, and can be moved in the optical axis direction by zoom lens driving units 18A and 18B including a motor and a motor driver. The zoom lens driving units 18A and 18B control the movement of the zoom lenses 11A and 11B based on an instruction from the zoom control unit 31 described later when the zoom lever 34A is operated. The zoom lenses 11A and 11B are moved step by step while the zoom lever 34A is being operated. Note that the amount of movement of the zoom lenses 11A and 11B in one step is predetermined.

  The apertures 12A and 12B are adjusted in aperture diameter by an aperture drive unit (not shown) based on aperture value data obtained by AE processing performed by the imaging control unit 22.

  The shutters 13A and 13B are mechanical shutters, and are driven by a shutter driving unit (not shown) according to the shutter speed obtained by the AE process.

  The CCDs 14A and 14B have a photoelectric surface in which a large number of light receiving elements are two-dimensionally arranged, and subject light is imaged on the photoelectric surface and subjected to photoelectric conversion to obtain an analog photographing signal. In addition, color filters in which R, G, and B color filters are regularly arranged are arranged on the front surfaces of the CCDs 14A and 14B.

  The AFEs 15A and 15B perform processing for removing noise of the analog photographing signal and processing for adjusting the gain of the analog photographing signal (hereinafter referred to as analog processing) for the analog photographing signals output from the CCDs 14A and 14B.

  The A / D converters 16A and 16B convert the analog photographing signals subjected to the analog processing by the AFEs 15A and 15B into digital signals. Note that an image represented by digital image data acquired by the photographing unit 21A is a first image G1, and an image represented by image data acquired by the photographing unit 21B is a second image G2.

  The imaging control unit 22 includes an AF processing unit and an AE processing unit (not shown). The AF processing unit determines the focusing area based on the pre-images acquired by the imaging units 21A and 21B by half-pressing the release button included in the input unit 34, and determines the focal positions of the lenses 10A and 10B. Output to 21A and 21B. The AE processing unit determines an aperture value and a shutter speed based on the pre-image, and outputs them to the photographing units 21A and 21B.

  In addition, the shooting control unit 22 instructs the shooting units 21A and 21B to perform main shooting for acquiring the main images of the first and second images G1 and G2 by fully pressing the release button. Before the release button is operated, the shooting control unit 22 displays a through image having a smaller number of pixels than the first and second images G1 and G2 for allowing the shooting unit 21A to check the shooting range. Then, an instruction to sequentially acquire at a predetermined time interval (for example, 1/30 second interval) is given.

  Note that the shooting control unit 22 performs AF processing even during shooting of a through image. The AF process in this case is performed by simple calculation as compared with the AF process based on the pre-image.

  The image processing unit 23 adjusts white balance, gradation correction, sharpness correction, and color correction on the digital image data of the first and second images G1 and G2 acquired by the imaging units 21A and 21B. Etc. are applied. It should be noted that reference numerals G1 and G2 before processing are also used for the first and second images after processing in the image processing unit 23.

  The compression / decompression processing unit 24 is processed by the image processing unit 23, and a three-dimensional display image generated from the main images of the first and second images G1 and G2 for three-dimensional display as will be described later. Is compressed in a compression format such as JPEG, and a three-dimensional image file for three-dimensional display is generated. The three-dimensional image file includes image data of the first and second images G1 and G2 and image data of a three-dimensional display image. In addition, a tag in which incidental information such as shooting date and time is stored is assigned to the image file based on the Exif format or the like.

  The frame memory 25 is used when various processes including the process performed by the image processing unit 23 described above are performed on the image data representing the first and second images G1 and G2 acquired by the imaging units 21A and 21B. This is a working memory.

  The media control unit 26 accesses the recording medium 29 and controls writing and reading of a 3D image file or the like.

  The internal memory 27 stores various constants set in the compound eye camera 1, a program executed by the CPU 33, and the like.

  The display control unit 28 two-dimensionally displays the first and second images G1 and G2 stored in the frame memory 25 at the time of shooting on the monitor 20 or the first and second images recorded on the recording medium 29. The images G1 and G2 are displayed two-dimensionally on the monitor 20. In addition, the display control unit 28 displays the first and second images G1 and G2 that have been subjected to the three-dimensional processing as described later on the monitor 20 in a three-dimensional manner or the three-dimensional image recorded in the recording medium 29. It is also possible to display the file on the monitor 20 three-dimensionally. Note that switching between the two-dimensional display and the three-dimensional display may be automatically performed, or may be performed by an instruction from the photographer using the input unit 34 described later. Here, when the three-dimensional display is performed, the through images of the first and second images G1 and G2 are three-dimensionally displayed on the monitor 20 until the release button is pressed.

  When the display mode is switched to the three-dimensional display, both the first and second images G1 and G2 are used for display as described later, and when the display mode is switched to the two-dimensional display, the first and second images are used. One of the second images G1 and G2 is used for display.

  Further, the compound eye camera 1 according to the present embodiment includes a three-dimensional processing unit 30. The three-dimensional processing unit 30 performs three-dimensional processing on the first and second images G1 and G2 in order to display the first and second images G1 and G2 on the monitor 20 in three dimensions. Here, as the three-dimensional display in the present embodiment, any known method can be used. For example, the first and second images G1 and G2 are displayed side by side and stereoscopically viewed by the naked eye balance method, or a lenticular lens is attached to the monitor 20 and the images G1 and G2 are placed at predetermined positions on the display surface of the monitor 20. By displaying the lenticular method, it is possible to use a lenticular method in which the first and second images G1 and G2 are incident on the left and right eyes to realize three-dimensional display. Further, the optical path of the backlight of the monitor 20 is optically separated so as to correspond to the left and right eyes, and the first and second images G1 and G2 are separated on the display surface of the monitor 20 to the left and right of the backlight. By alternately displaying in accordance with the above, it is possible to use a scan backlight system that realizes three-dimensional display.

  The monitor 20 is processed according to the method of three-dimensional processing performed by the three-dimensional processing unit 30. For example, when the three-dimensional display method is the lenticular method, a lenticular lens is attached to the display surface of the monitor 20, and when the scan backlight method is used, an optical element for changing the light beam direction of the left and right images. Is attached to the display surface of the monitor 20.

  Here, in the present embodiment, when the photographer performs a zoom operation using the zoom lever 34A while the through images of the first and second images G1 and G2 are displayed, an instruction from the zoom control unit 31 is given. The photographing units 21A and 21B perform a zoom operation. In addition, the zoom control unit 31 enlarges and reduces the through images of the first and second images G1 and G2 acquired by the imaging units 21A and 21B as necessary by electronic zoom. Processing performed by the zoom control unit 31 will be described later.

  The CPU 33 controls each part of the compound eye camera 1 according to a signal from the input part 34 including a release button and the like.

  The data bus 35 is connected to each part constituting the compound eye camera 1 and the CPU 33, and exchanges various data and various information in the compound eye camera 1.

  Next, processing performed in the present embodiment will be described. Since the present invention has a feature in the processing when the zoom operation is performed using the zoom lever 34A, in the following description, the zoom operation using the zoom lever 34A during the through image display is performed. Only the processing in the case of the case will be described. First, processing during zoom-up will be described. FIG. 3 is a flowchart showing processing performed at the time of zooming up in the present embodiment. FIG. 4 is a diagram illustrating driving of the zoom lenses 11A and 11B of the photographing units 21A and 21B and zooming of the first and second images G1 and G2. It is a figure which shows the state of display view angle A0. Note that the monitor 20 of the compound eye camera 1 has the first and second images obtained by the three-dimensional processing unit 30 performing three-dimensional processing on the first and second images G1 and G2 acquired by the photographing units 21A and 21B. It is assumed that the through images of the images G1 and G2 are displayed three-dimensionally. For the sake of explanation, the zoom lenses 11A and 11B of the photographing units 21A and 21B are assumed to be at the widest position, that is, at the wide end, as shown in FIG. In the following description, the photographing unit 21A corresponds to one photographing unit, and the photographing unit 21B corresponds to another photographing unit.

  The zoom control unit 31 monitors whether or not the zoom lever 34A has been operated by the photographer (step ST1). When step ST1 is affirmed, the zoom control unit 31 detects only the zoom lens 11A of the shooting unit 21A. Then, the zoom magnification of the photographing unit 21A is changed by moving one step to the tele side according to the operation of the zoom lever 34A. At the same time, the zoom control unit 31 sets the second image G2 so that the display angle A0 of the second image G2 acquired by the imaging unit 21B on the monitor 20 coincides with the imaging angle of view of the imaging unit 21A. The enlargement ratio of G2 is changed to the one-stage enlargement side (step ST2). Note that the enlargement ratio of the first image G1 is not changed. Here, one step of changing the enlargement ratio of the first and second images G1 and G2 corresponds to a change in zoom magnification by moving the zoom lenses 11A and 11B by one step.

  Next, the zoom control unit 31 determines whether or not the operation of the zoom lever 34A is finished (step ST3), and if step ST3 is negative, the process returns to step ST2.

  If step ST3 is positive, the zoom control unit 31 stops moving the zoom lens 11A (step ST4). In this state, the positional relationship between the zoom lenses 11A and 11B and the display angle of view A0 of the first and second images G1 and G2 on the monitor 20 are as shown in FIG. Subsequently, the zoom control unit 31 moves the zoom lens 11B one step to the tele side so that the zoom magnification of the photographing unit 21B matches the zoom magnification of the photographing unit 21A. At the same time, the zoom control unit 31 causes the second image G2 so that the display angle of view A0 of the second image G2 acquired by the imaging unit 21B on the monitor 20 matches the imaging angle of view of the imaging unit 21A. Is changed to the one-stage reduction side (step ST5). Note that the enlargement ratio of the first image G1 is not changed.

  Next, as shown in FIG. 4C, the zoom control unit 31 determines whether or not the positions of the zoom lenses 11A and 11B match (step ST6). If step ST6 is negative, the process returns to step ST5. . If step ST6 is affirmed, the movement of the zoom lens 11B is stopped (step ST7), and the zoom process is terminated.

  Next, processing during zoom-out will be described. FIG. 5 is a flowchart showing processing performed during zoom-out in the present embodiment, and FIG. 6 shows driving of the zoom lenses 11A and 11B of the photographing units 21A and 21B and zooming of the first and second images G1 and G2 during zoom-out. It is a figure which shows the state of display view angle A0. Note that the monitor 20 of the compound eye camera 1 has the first and second images obtained by the three-dimensional processing unit 30 performing three-dimensional processing on the first and second images G1 and G2 acquired by the photographing units 21A and 21B. It is assumed that the through images of the images G1 and G2 are displayed three-dimensionally. In addition, here, for the sake of explanation, it is assumed that the zoom lenses 11A and 11B of the photographing units 21A and 21B are at the most tele-side position, that is, at the tele end, as shown in FIG.

  The zoom control unit 31 monitors whether or not the zoom lever 34A has been operated by the photographer (step ST11), and when step ST11 is affirmed, the zoom control unit 31 controls only the zoom lens 11B of the shooting unit 21B. As shown in FIG. 6B, the display angle of view A0 on the monitor 20 of the second image G2 acquired by the imaging unit 21B coincides with the imaging angle of view of the imaging unit 21A while moving to the wide end. Then, the enlargement ratio of the second image G2 is changed to the enlargement side (step ST12). Note that the enlargement ratio of the first image G1 is not changed.

  Then, in response to the operation of the zoom lever 34A, only the zoom lens 11A of the photographing unit 21A is moved one step to the wide side to change the zoom magnification of the photographing unit 21A, and the display image of the second image G2 on the monitor 20 is displayed. The enlargement ratio of the second image G2 is changed to the one-stage reduction side so that the angle coincides with the photographing field angle of the photographing unit 21A (step ST13). Note that the enlargement ratio of the first image G1 is not changed.

  Next, the zoom control unit 31 determines whether or not the zoom lens 11A has moved to the wide end (step ST14). If step ST14 is affirmed, the zoom control unit 31 stops moving the zoom lens 11A (step ST15), and zoom processing is performed. Exit. If step ST14 is negative, the zoom control unit 31 determines whether or not the operation of the zoom lever 34A has ended (step ST16). If step ST16 is negative, the process returns to step ST13.

  If step ST16 is affirmed, the zoom control unit 31 stops moving the zoom lens 11A (step ST17). In this state, the positional relationship between the zoom lenses 11A and 11B and the display angle of view A0 of the first and second images G1 and G2 are as shown in FIG. Subsequently, the zoom control unit 31 moves the zoom lens 11B to the telephoto side by one step so that the zoom magnification of the photographing unit 21B matches the zoom magnification of the photographing unit 21A. At the same time, the zoom control unit 31 reduces the enlargement ratio of the second image G2 by one step so that the display angle of view of the second image G2 on the monitor 20 matches the shooting angle of view of the shooting unit 21A. (Step ST18). Note that the enlargement ratio of the first image G1 is not changed.

  Next, as shown in FIG. 6 (d), the zoom control unit 31 determines whether or not the positions of the zoom lenses 11A and 11B match (step ST19). If step ST19 is negative, the process returns to step ST18. . If step ST19 is positive, the movement of the zoom lens 11B is stopped (step ST20), and the zoom process is terminated.

  Next, another process during zoom-out will be described. FIGS. 7 and 8 are flowcharts showing other processing performed during zoom-out in the present embodiment. FIG. 9 shows driving of the zoom lenses 11A and 11B of the photographing units 21A and 21B during zoom-out of other processing, and the first processing. It is a figure which shows the state of the display angle of view of 2nd image G1, G2. Note that the monitor 20 of the compound eye camera 1 has the first and second images obtained by the three-dimensional processing unit 30 performing three-dimensional processing on the first and second images G1 and G2 acquired by the photographing units 21A and 21B. It is assumed that the through images of the images G1 and G2 are displayed three-dimensionally. For the sake of explanation, it is assumed that the zoom lenses 11A and 11B of the photographing units 21A and 21B are at the most tele-side position, that is, at the tele end, as shown in FIG.

  The zoom control unit 31 monitors whether or not the zoom lever 34A has been operated by the photographer (step ST21). When step ST21 is affirmed, the zoom control unit 31 responds to the operation of the zoom lever 34A. Only the zoom lens 11B of the photographing unit 21B is moved by one step to the wide side, and the second image G2 is displayed so that the display angle A0 of the second image G2 on the monitor 20 coincides with the photographing field angle of the photographing unit 21A. Is changed to the one-stage enlargement side (step ST22). Note that the enlargement ratio of the first image G1 is not changed. Therefore, in this state, the display angle of view A0 of the first and second images G1 and G2 displayed three-dimensionally on the monitor 20 is not changed.

  Next, the zoom control unit 31 determines whether or not the zoom lens 11B has moved by a predetermined amount as shown in FIG. 9B (step ST23). The predetermined amount can be, for example, an amount until the zoom lens 11B moves to, for example, a half position between the initial position of the zoom lens 11B (position before the zoom operation is performed) and the wide end. However, the present invention is not limited to this. If step ST23 is negative, the process returns to step ST22.

  If step ST23 is affirmed, the zoom control unit 31 stops moving the zoom lens 11B (step ST24). Subsequently, the zoom control unit 31 moves only the zoom lens 11A of the photographing unit 21A to the wide side by one step in accordance with the operation of the zoom lever 34A to change the zoom magnification of the photographing unit 21A, and the first and second Of the first and second images G1, G2 so that the display angle A0 of the images G1, G2 on the monitor 20 is changed with a delay from the change of the shooting angle of view due to the change of the zoom magnification of the zoom lens 11A. The enlargement ratio is changed to 1/2 reduction side (step ST25).

  Next, the zoom control unit 31 determines whether or not the zoom operation has ended (step ST26). If step ST26 is affirmed, a process of zooming up the photographing unit 21A is performed (step ST27), a process of zooming up the photographing unit 21B is performed (step ST28), and the process is terminated.

  FIG. 10 is a flowchart of the zoom-up process of the photographing unit 21A. First, the zoom control unit 31 moves the zoom lens 11A to the tele side by one step, and changes the enlargement ratio of the first image G1 to the one step reduction side (step ST41). Then, it is determined whether or not the shooting angle of view of the shooting unit 21A matches the display angle of view A0 of the first image G1 on the monitor 20 (step ST42). If step ST42 is negative, the process returns to step ST41. . If step ST42 is affirmed, the process ends. Here, for example, assuming that only the zoom lens 11B has moved to the wide end, the positional relationship of the zoom lenses 11A and 11B and the first and second images G1 and G1 at the end of the zoom-up process of the photographing unit 21A. The display field angle A0 of G2 is as shown in FIG.

  FIG. 11 is a flowchart of the zoom-up process of the photographing unit 21B. First, the zoom control unit 31 moves the zoom lens 11B to the tele side by one step, and changes the enlargement ratio of the second image G2 to the one step reduction side (step ST51). Then, it is determined whether or not the shooting angle of view of the shooting unit 21B matches the display angle of view A0 of the second image G2 on the monitor 20 (step ST52). If step ST52 is negative, the process returns to step ST51. . If step ST52 is positive, the zoom process is terminated. Here, when the zoom-up process of the photographing unit 21B is performed following the state of FIG. 9E, the positional relationship of the zoom lenses 11A and 11B after the process and the first and second images G1 and G2 are completed. The display angle of view A0 is as shown in FIG.

  Returning to FIG. 7 and FIG. 8, when step ST26 is negative, the zoom control unit 31 determines the shooting field angle of the shooting unit 21B and the display field angle A0 of the first and second images G1 and G2 on the monitor 20. Are matched (step ST29). If step ST29 is negative, the process returns to step ST25. Since the moving amount of the zoom lens 11A of the photographing unit 21A is larger than the change amount of the enlargement ratio of the first image G1, the photographing field angle of the photographing unit 21B and the first and second images G1, G2 are monitored. When the display angle of view A0 to 20 coincides, as shown in FIG. 9C, the zoom lens 11A has moved to the wide side with respect to the zoom lens 11B.

  If step ST29 is affirmed, the zoom control unit 31 stops the movement of the zoom lens 11A (step ST30), and further, only the zoom lens 11B of the photographing unit 21B is set to the wide side according to the operation of the zoom lever 34A. The zoom magnification of the photographing unit 21B is changed in steps, and the display angle of view A0 of the first and second images G1 and G2 on the monitor 20 is changed by changing the zoom magnification of the zoom lens 11B. The enlargement ratios of the first and second images G1 and G2 are changed to the 1/2 step reduction side so as to be changed later (step ST31).

  Next, the zoom control unit 31 determines whether or not the zoom operation has ended (step ST32). If step ST32 is affirmed, the process proceeds to step ST27, where the process of zooming up the photographing unit 21A is performed, the process of zooming up the photographing unit 21B is performed, and the zoom process ends.

  When step ST32 is negative, the zoom control unit 31 determines whether or not the zoom lens 11B has moved to the wide end as shown in FIG. 9D (step ST33), and when step ST33 is negative. Return to step ST31. If step ST33 is affirmed, the zoom control unit 31 stops the movement of the zoom lens 11B (step ST34), and only the zoom lens 11A of the photographing unit 21A is moved one step to the wide side in accordance with the operation of the zoom lever 34A. Then, the zoom magnification of the photographing unit 21A is changed, and the display angle of view A0 of the first and second images G1 and G2 on the monitor 20 is delayed from the change of the photographing angle of view due to the change of the zoom magnification of the zoom lens 11A. Thus, the enlargement ratios of the first and second images G1 and G2 are changed to the 1/2 step reduction side (step ST35).

  Next, the zoom control unit 31 determines whether or not the zoom operation has been completed (step ST36). When step ST36 is affirmed, it progresses to step ST27, performs the process which zooms up the imaging | photography part 21A, performs the process which zooms up the imaging | photography part 21B, and complete | finishes a zoom process.

  If step ST36 is negative, the zoom control unit 31 determines whether or not the display angle of view A0 of the first and second images G1 and G2 on the monitor 20 is the wide end (step ST37). . If step ST37 is negative, the process returns to step ST35. If the determination in step ST37 is affirmative, the zoom lens 11A has already moved to the wide end, and thus the zoom process ends.

  As described above, in the present embodiment, when the zoom operation is performed, the zoom lenses 11A and 11B of the photographing units 21A and 21B are sequentially moved until the zoom magnifications of the photographing units 21A and 21B become the same zoom magnification. It is changed sequentially. Then, according to the zoom magnification change, at least one of the first and second images G1 and G2 so that the display angles of the first and second images G1 and G2 on the monitor 20 coincide with each other. The enlargement ratio is changed. For this reason, when the zoom operation is performed, the zoom lenses 11A and 11B are moved only in any one of the photographing units 21A and 21B, so that large power consumption can be prevented. In addition, the display angle of view of the first and second images G1 and G2 on the monitor 20 coincides even during the zoom operation, so that the sense of incongruity when stereoscopically viewing the three-dimensionally displayed image can be eliminated. it can.

  In the above-described embodiment, the two-eye camera 1 is provided with the two photographing units 21A and 21B, and three-dimensional display is performed using the two images G1 and G2, but three or more photographing units are provided. The present invention can also be applied to the case where three-dimensional display is performed using these images. In this case, for example, when performing zoom-up processing, only the zoom lens of one of the plurality of imaging units is moved first, and then other imaging units other than the one imaging unit are sequentially moved. In the case of performing zoom-out processing, the zoom lens of another photographing unit other than one photographing unit among the plurality of photographing units is sequentially moved to the wide end first, and then the zoom of one photographing unit is performed. What is necessary is just to move a lens. When performing another zoom-out process, the zoom lenses of all the photographing units may be moved alternately.

  Although the embodiment of the present invention has been described above, a program that causes a computer to function as means corresponding to the zoom control unit 31 and to perform processes as shown in FIGS. 3, 5, 7, 8, 10, and 11 Is also one embodiment of the present invention. A computer-readable recording medium in which such a program is recorded is also one embodiment of the present invention.

1 is a schematic block diagram showing an internal configuration of a compound eye camera to which a three-dimensional imaging device according to an embodiment of the present invention is applied. Diagram showing the configuration of the shooting unit A flowchart showing processing performed at the time of zooming up in this embodiment The figure which shows the state of the drive of zoom lens 11A, 11B of imaging | photography parts 21A, 21B at the time of zooming up, and the display angle of view of 1st and 2nd image G1, G2. A flowchart showing processing performed during zoom-out in the present embodiment The figure which shows the state of the display angle of view of the drive of zoom lens 11A, 11B of imaging | photography parts 21A, 21B at the time of zoom out, and the 1st and 2nd images G1, G2. The flowchart which shows the other processing performed at the time of zoom out in this embodiment (the 1) The flowchart which shows the other processing performed at the time of zoom out in this embodiment (the 2) The figure which shows the state of the display angle of view of the drive of zoom lens 11A, 11B of imaging | photography parts 21A, 21B at the time of zoom out, and the 1st and 2nd images G1, G2. Flowchart of zoom-up process of photographing unit 21A A flowchart of zoom-up processing of the imaging unit 21B

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Compound eye camera 21A, 21B Image pick-up part 22 Image pick-up control part 28 Display control part 30 Three-dimensional processing part 31 Zoom control part

Claims (6)

A plurality of photographing means having an optical zoom mechanism for obtaining a plurality of images having parallax by photographing subjects at different positions;
3D processing means for performing 3D processing for 3D display on the plurality of images;
Display means for performing at least three-dimensional display of the plurality of images;
Zoom operation means for performing an operation of changing the zoom magnification at the time of the three-dimensional display;
When the zoom operation means is operated, the optical zoom mechanism of the plurality of photographing means is sequentially driven to sequentially change the zoom magnification of the plurality of photographing means to the same zoom magnification, and the zoom magnification is changed. And a zoom control unit that changes an enlargement ratio of at least one of the plurality of images so that display angles of the plurality of images on the display unit coincide with each other. Dimensional imaging device.   The zoom control means drives an optical zoom mechanism of one of the plurality of photographing means to increase the zoom magnification of the one photographing means when a zoom-up operation is performed on the zoom operation means. The other image is changed so that a display angle of view of the other image acquired by another imaging unit other than the one imaging unit on the display unit matches a shooting angle of view of the one imaging unit. When the operation of the zoom operation means is stopped, the driving of the optical zoom mechanism of the one photographing means is stopped, and the optical zoom mechanism of the other photographing means is changed to the one photographing means. Are sequentially driven so as to coincide with the zoom magnification of the other imaging means, and the display angle of view of the other image on the display means according to the change of the zoom magnification of the other imaging means The other to match the corner Three-dimensional imaging apparatus according to claim 1, characterized in that the means for changing the magnification of the image sequence.   When a zoom-out operation is performed on the zoom operation unit, the zoom control unit sequentially drives an optical zoom mechanism of another imaging unit other than one of the plurality of imaging units, The zoom magnification of the other photographing means is sequentially changed to the minimum magnification, and the display angle of view of the other image acquired by the other photographing means on the display means coincides with the photographing angle of view of the one photographing means. The zoom ratio of the other image is sequentially changed, and then the optical zoom mechanism of the one photographing unit is driven to change the zoom magnification of the one photographing unit and to the display unit of the other image When the enlargement ratio of the other image is changed so that the display angle of view coincides with the shooting angle of view of the one photographing means, and the operation of the zoom operation means is stopped, the optical zoom of the one photographing means is stopped. Stop driving the mechanism and The optical zoom mechanism of the shadow means is sequentially driven so as to coincide with the zoom magnification of the one photographing means, and the other image to the display means is changed according to the change of the zoom magnification of the other photographing means. 2. The three-dimensional imaging apparatus according to claim 1, wherein the three-dimensional imaging apparatus is a unit that sequentially changes an enlargement ratio of the other image so that a display field angle coincides with a shooting field angle of the one imaging unit.   When a zoom-out operation is performed on the zoom operation unit, the zoom control unit sequentially drives the optical zoom mechanism of the plurality of photographing units by a predetermined amount and displays the plurality of images on the display unit. An enlargement ratio of at least one of the plurality of images so that the angle of view coincides with each other and is changed later than the change of the photographing angle of view of the plurality of photographing units by driving the optical zoom mechanism And when the operation of the zoom operation unit is stopped, the plurality of photographing operations are performed so that the display field angles of the plurality of images on the display unit coincide with the photographing field angles of the plurality of photographing units. The three-dimensional imaging apparatus according to claim 1, wherein the optical zoom mechanism is a means for sequentially driving the means. A plurality of photographing means having an optical zoom mechanism for obtaining a plurality of images having parallax by photographing subjects at different positions;
3D processing means for performing 3D processing for 3D display on the plurality of images;
Display means for performing at least three-dimensional display of the plurality of images;
A three-dimensional imaging method in a three-dimensional imaging apparatus comprising a zoom operation means for performing an operation of changing a zoom magnification at the time of the three-dimensional display,
When the zoom operation unit is operated, the optical zoom mechanism of the plurality of imaging units is sequentially driven, and the zoom magnification of the plurality of imaging units is sequentially changed to be the same zoom magnification,
Three-dimensional imaging characterized by changing an enlargement ratio of at least one of the plurality of images so that display angles of the plurality of images on the display unit coincide during the change of the zoom magnification. Method. A plurality of photographing means having an optical zoom mechanism for obtaining a plurality of images having parallax by photographing subjects at different positions;
3D processing means for performing 3D processing for 3D display on the plurality of images;
Display means for performing at least three-dimensional display of the plurality of images;
A program for causing a computer to execute a three-dimensional imaging method in a three-dimensional imaging apparatus comprising zoom operation means for performing an operation of changing a zoom magnification at the time of three-dimensional display,
When the zoom operation means is operated, the optical zoom mechanism of the plurality of photographing means is sequentially driven, and the zoom magnification of the plurality of photographing means is sequentially changed to be the same zoom magnification;
Causing the computer to execute a procedure of changing an enlargement ratio of at least one of the plurality of images so that display angles of the plurality of images on the display unit coincide with each other while the zoom magnification is being changed. A program characterized by

Images