JP2011239207A - Imaging apparatus, imaging control method, and imaging control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a wide range of imaging with a simple structure.SOLUTION: A subject is imaged by an imaging part with a plurality of refractive lens parts having a convergence angle to obtain an image for a stereoscopic vision. In this case, (A) initially, vertical direction axes JA and JB of a subject image are parallel to each other in both left and right images. (B) In the case where the subject approaches a compound eye digital camera and when the refractive lens parts are rotated to adjust the convergence angle, the vertical direction axes JA and JB of the subject image of the subject are tilted. (C) Therefore, image reading regions 60 which are read out from image pick-up devices 54 are tilted by amounts corresponding to the rotated amounts of the refractive lens parts. This provides the image reading regions 60 corresponding to the rotation of the subject image.

Description

  The present invention relates to an imaging apparatus, an imaging control method, and an imaging control program, and in particular, an imaging apparatus, an imaging control method, and an imaging control program that capture a subject with a plurality of imaging optical systems to obtain a wide-angle image or a stereoscopic image. About.

  A panoramic camera that captures images with a single eye to obtain a wide field of view image is known. In addition, in order to obtain a three-dimensional image of a subject, a compound eye imaging apparatus and a stereo camera provided with a plurality of imaging optical systems are known.

  For example, there has been proposed a compound eye photographing apparatus that includes a pair of photographing means having a convergence angle and a changing means that can change the convergence angle (see Patent Document 1). In the compound eye imaging device of Patent Document 1, a pair of photographing means is provided so as to have a convergence angle, and the convergence angle can be changed, thereby suppressing the influence due to the distance to the subject.

  In addition, a compound eye photographing apparatus has been proposed in which an imaging system including an asymmetric aspherical off-axial reflecting surface and a prism having a positive refractive power is provided on the left and right sides so as to have a convergence angle, and the convergence angle can be changed. (See Patent Document 2). In the compound eye photographing apparatus disclosed in Patent Document 2, an apparent trapezoidal distortion due to a difference between left and right central viewpoints is suppressed by an off-axial optical system when a panoramic image is synthesized.

  There has also been proposed an imaging system that changes the imaging angle of one imaging unit so that the optical axes of a pair of imaging units that are spaced apart from each other (see Patent Document 3). In the imaging system of Patent Document 3, a stereoscopic image is generated by changing the imaging angle so that the optical axes intersect on the main subject.

JP 2008-233579 A JP 2000-23199 A JP 2008-216513 A

  However, the technique of Patent Document 1 requires a complicated and large-scale device because the convergence angle is changed by rotating the entire photographing unit.

  In the technique of Patent Document 2, since the optical system is made of an asymmetric aspherical surface, the structure is complicated, and the operating mechanism cannot be increased in size.

  Further, in the technique of Patent Document 3, it is necessary to move a pair of imaging means spaced apart to cross the optical axes, and the structure is complicated, and the apparatus cannot be increased in size.

  The present invention has been made in consideration of the above-described facts, and an object of the present invention is to provide an imaging apparatus, an imaging control method, and an imaging control program that enable a wide range of imaging with a simple structure.

  In order to achieve the above object, an image pickup apparatus according to the present invention includes an image pickup device fixed to a main body and a bent lens portion that bends light from a subject toward the image pickup device. An image pickup optical system for irradiating the element, wherein at least one of the plurality of image pickup optical systems is provided with the bent lens portion so as to be rotatable about the optical axis of the light receiving surface of the image pickup element. An image pickup means having an optical system, a detection means for detecting an inclination angle on a light receiving surface of the image pickup element of an optical image of a subject irradiated on the image pickup element when the bending lens unit is rotated, and the detection Adjusting means for tilting an image area for reading an image from the image sensor based on a detection result of the means and adjusting the size of the image area so as to be within the image sensor.

  According to the imaging apparatus of the present invention, the imaging means includes an imaging device fixed to the main body and an imaging optical system. The imaging optical system is a plurality of imaging optical systems that each include a bent lens portion that bends light from a subject toward the image sensor, and irradiates light from the subject toward the image sensor. For at least one of them, the bent lens portion is provided so as to be rotatable about the optical axis on the light receiving surface of the image sensor. In order to make the bent lens portion pivotable, a pivoting portion that can be pivoted with respect to the emission optical axis or that pivots about the incident optical axis on the light receiving surface of the image sensor with the emission optical axis as a reference is provided. You may have it. When this bent lens portion is rotated, the image on the fixed image sensor rotates about the optical axis. Therefore, the image is tilted by the rotation of the bent lens portion.

  Therefore, the detection means detects the inclination angle of the optical image of the subject irradiated on the image sensor when the bent lens unit is rotated on the light receiving surface of the image sensor. This detection only needs to be able to detect the rotation of the optical image of the subject on the image sensor, and it is only necessary to detect the rotation of the bent lens unit or directly detect the tilt of the image. Based on the detection result of the detection means, the adjustment means inclines the image area for reading an image from the image sensor and adjusts the size of the image area so as to be within the image sensor. Although the image irradiated to the image sensor is tilted, if the image is read from the image sensor as it is, a tilted image is obtained. For this reason, by tilting the image reading area of the image sensor, an image area for reading according to the rotation of the image accompanying the rotation of the bending lens unit is obtained. Further, by adjusting the size of the image area so that it can be accommodated in the image sensor, the image is not lost or is not reduced or reduced.

  Thus, when the direction to the subject is changed by rotating the bending lens unit, the inclination of the optical image of the subject rotating on the image sensor is detected, and the image area for reading the image from the image sensor is tilted. In addition, since the size of the image area is adjusted so as to be within the image sensor, the influence of the rotation of the bent lens portion on the obtained image can be suppressed, and a wide range of imaging can be performed.

  [2] An imaging device according to another invention includes an imaging element fixed to a main body and a bent lens portion that bends light from a subject toward the imaging element, and directs light from the subject toward the imaging element. A plurality of imaging optical systems for irradiating, wherein at least one of the plurality of imaging optical systems, the bending lens unit is provided so as to be rotatable about the optical axis of the light receiving surface of the imaging element; and Output from the image pickup device, detection means for detecting an inclination angle of a light receiving surface of the image pickup device of an optical image of a subject irradiated on the image pickup device when the bending lens unit is rotated, and An acquisition unit configured to acquire a captured image based on an image signal to be obtained, and an image region for cutting out the image with respect to the acquired captured image based on a detection result of the detection unit, and the imaging And a adjusting means for adjusting the size of the image area to fit within the frame of the image.

  According to the imaging device of another invention, the captured image is acquired based on the image signal output from the imaging device by the acquisition unit. Based on the detection result of the detection means, the adjustment means tilts the image area for cutting out the image with respect to the acquired captured image, and adjusts the size of the image area so as to be within the frame of the captured image. The image irradiated to the image sensor is tilted. If the image is acquired as it is, an image including the tilted image is acquired. Therefore, by tilting the image area when the image is cut out from the acquired image, an image area corresponding to the rotation of the image accompanying the rotation of the bending lens unit is obtained. Further, by adjusting the size of the image area so as to fit in the captured image, the image is not lost or is not reduced or reduced.

  As described above, when the direction to the subject is changed by rotating the bent lens unit, the inclination of the optical image of the subject rotating on the image sensor is detected, and the image is cut out from the acquired captured image. Since the image area is tilted and the size of the image area is adjusted so as to be accommodated in the image sensor, the influence of the rotation of the bent lens portion on the obtained image can be suppressed, and a wide range of photographing can be performed.

  [3] In the imaging apparatus, the imaging element fixed to the main body is a single imaging element, and the plurality of imaging optical systems irradiate light from a subject toward the single imaging element. Features.

  When a single image sensor is fixed to the main body, a single image sensor can be irradiated with light from a subject by a plurality of image pickup optical systems so that a plurality of image sensors can be used together. it can. In this case, an irradiation area may be designated for each imaging optical system on a single imaging device, or imaging may be performed in a time division manner.

  [4] In the imaging apparatus, the detection unit may detect an angle at which the bent lens unit is rotated about an optical axis on a light receiving surface of the imaging element. The rotation of the bent lens unit and the tilt of the image are linked. Therefore, the detection of the inclination of the image by the detecting means can be easily detected by detecting the angle at which the bent lens portion is rotated.

  [5] In the imaging apparatus, the detection unit detects an angle between an edge line of an irradiation light region of an optical image of a subject on the imaging element and a reference line when the bending lens unit is rotated. Features. The inclination of the image irradiated to the image sensor when the bent lens unit is rotated can be directly detected by a signal from the image sensor. Specifically, when the irradiated image is tilted, the end portion (edge) of the light irradiated to the image sensor is also tilted. Therefore, when an image is read from the image sensor, if the reference end (reference edge) of the image sensor is determined in advance, the inclination can be easily obtained from the angle formed by the reference line by the reference edge and the edge line of the end. Can do. Therefore, the image area can be tilted on the image sensor. Further, when an image is cut out from a captured image acquired based on an image signal output from the image sensor, a frame of the acquired captured image or the like is determined in advance as a reference end (reference edge). By doing so, the inclination can be easily obtained from the angle formed by the reference line by the reference edge and the edge line of the irradiation light region of the optical image of the subject. Therefore, the image area can be tilted on the captured image. In order to detect edges more clearly, it is preferable to provide a slit having a square opening in the imaging optical system.

  [6] In the imaging apparatus, the imaging unit changes an angle of view of the imaging unit by changing a focal length of the imaging optical system to at least a rotation-side imaging optical system in which the bending lens unit is rotated. An angle-of-view changing unit is provided, and the adjusting unit changes the angle of view of the imaging optical system on the rotation side so that an image tilted by the rotation is within an effective pixel area on the image sensor. And The effective pixel area on the image sensor is effective when reading out an image from the image sensor or cutting out an image from a captured image acquired based on an image signal output from the image sensor. Is a set range of pixels. An imaging apparatus having a zoom function in an optical system is known. Therefore, by providing an angle of view adjustment unit that adjusts the focal length of the imaging optical system, such as a zoom device, the angle of view of the imaging unit can be easily adjusted. Thereby, the size of the image irradiated to the image sensor can be adjusted, and the size of the image region can be easily adjusted.

  In the imaging apparatus, the bending lens unit may employ a prism or a reflection mirror for changing an optical path. Thus, by using a prism or a reflecting mirror, it is possible to obtain a light and simple structure and easy to manufacture. In addition, it is easy to rotate the prism by using a lightweight and simple structure prism or reflecting mirror.

  [7] In the imaging apparatus, the imaging unit changes an angle of view of the imaging unit by changing a focal length of the imaging optical system to at least a non-rotating imaging optical system in which the bending lens unit is not rotated. The angle of view of the imaging optical system on the non-rotation side where the bending lens portion is not rotated based on the angle of view with respect to the image tilted by the rotation. Is further changed. When the imaging device includes a bent lens unit that does not rotate, an image that passes through the rotated bent lens unit and an image that passes through the bent lens unit that does not rotate have different image inclinations. For this reason, for example, by changing the angle of view of the imaging optical system on the non-rotating side where the bending lens unit is not rotated so as to match the angle of view with respect to the image tilted by the rotation, the angle of view becomes uniform. And you can match the size of the image.

  [8] In the imaging apparatus, the adjustment unit further changes the size of the image area on the non-rotation side where the bending lens unit is not rotated based on the angle of view with respect to the image tilted by the rotation. It is characterized by that. When the imaging device includes a bent lens unit that does not rotate, an image that passes through the rotated bent lens unit and an image that passes through the bent lens unit that does not rotate have different image inclinations. For this reason, for example, by changing the size of the image area on the non-rotating side where the bending lens unit is not rotated so as to match the angle of view with respect to the image tilted by the rotation, the angle of view is made uniform. And you can match the size of the image.

  [9] In the imaging apparatus, the adjusting unit associates the number of pixels of an imaging element in which a plurality of vertical and horizontal pixels are arranged as the image area, and adjusts the number of pixels of the imaging element to adjust the size of the image area. It is characterized by adjusting. When using an image sensor in which a plurality of vertical and horizontal pixels are arranged, such as a CCD, the size of the image area can be set by selecting vertical and horizontal pixels that match the inclination of the image.

  [10] The imaging apparatus may further include a notifying unit for notifying a resolution or a focal length corresponding to the number of pixels adjusted by the adjusting unit. Selecting vertical and horizontal pixels that match the inclination of the image corresponds to selecting a resolution. That is, in the pixel number M2 after the image is tilted with respect to the pixel number M1 before the image is tilted, this corresponds to the resolution being changed according to the ratio (M2 / M1). Further, in N2 based on the number of pixels M2 after the image is tilted with respect to the image width N1 based on the number of pixels M1 before the image is tilted, this corresponds to changing the focal length according to the ratio (N2 / N1). Thus, by notifying the resolution or focal length corresponding to the number of pixels adjusted by the adjusting means, it is possible to notify the user of the shooting conditions in advance.

  [11] The imaging apparatus may further include a warning unit that warns when an adjustment result in the adjustment unit exceeds a predetermined adjustment amount. In some cases, the user does not like the extreme adjustment of tilting the image reading area of the image sensor or adjusting the size of the image reading area so as to be within the image sensor. Therefore, when the adjustment result in the adjustment unit exceeds a predetermined adjustment amount (for example, a value that defines a standard user's intention), for example, an extreme warning is given to the user, for example, by indicating a warning indicating that shooting is not possible. It is possible to grasp in advance that adjustment is to be performed, and adjustment that deviates from the user's intention can be avoided.

  [12] The image pickup apparatus further includes image output means for outputting an image determined by the image area adjusted by the adjustment means. By providing this image output means, it is possible to display, record or transmit an image of the adjusted image area.

  In the imaging apparatus, the image output unit includes a display unit that displays an image, and includes a grid line generation unit that generates and outputs a tilted grid line based on the tilt amount of the image area of the image sensor. You may make it. When an image is displayed on the display unit, when the image is tilted, the user often feels that shooting is not performed or feels uncomfortable. Therefore, by generating and outputting a tilted grid line based on the tilt amount of the image area, the grid line is displayed together with the image. Thereby, the inclination of the image can be presented to the user 0-user by a grid line (for example, a grid), and photographing support can be provided.

  [13] In the imaging apparatus, for at least two of the imaging optical systems, a rotation control unit that rotates the bent lens unit so that a part of the subject image irradiated on the imaging element overlaps or is connected. Is further provided. By overlapping or connecting a part of images by a plurality of imaging optical systems, it is possible to obtain a large-sized image (for example, an image as if taken with a wide angle of view) from the plurality of images.

  [14] In the imaging apparatus, the rotation control unit rotates the bending lens unit a plurality of times and instructs imaging to be performed every rotation. In this way, by rotating the bent lens portion a plurality of times and instructing imaging at each rotation, it is possible to obtain a photographed image as if it were photographed in a wide range, for example, at a 360 ° field of view. .

  [15] In the imaging device, for an image obtained by the plurality of imaging optical systems of the imaging means, any one of a plurality of images photographed synchronously from a plurality of viewpoints is acquired as a reference image, and The image processing apparatus further includes a creation unit that creates a stereoscopic image obtained from the reference image and the parallax image, using an image different from the reference image as a parallax image. In this way, it is easy to provide the stereoscopic image to the user by the creation unit that creates the stereoscopic image.

  [16] The imaging control method of the present invention includes an imaging element fixed to a main body and a bent lens part that bends light from a subject toward the imaging element, and directs light from the subject toward the imaging element. A plurality of imaging optical systems for irradiating, wherein at least one of the plurality of imaging optical systems, the bending lens unit is provided so as to be rotatable about the optical axis of the light receiving surface of the imaging element; and A detection step of detecting an inclination angle on a light receiving surface of the imaging device of an optical image of a subject irradiated on the imaging device when the bending lens unit is rotated; An adjustment step of tilting an image region for reading an image from the image sensor based on a detection result of the detection unit and adjusting a size of the image region so as to be within the image sensor.

  [17] An imaging control method according to another invention includes an imaging device fixed to a main body and a bent lens portion that bends light from a subject toward the imaging device, and directs light from the subject toward the imaging device. A plurality of imaging optical systems that irradiate the imaging optical system, wherein at least one of the plurality of imaging optical systems is provided with the bent lens portion rotatably about the optical axis of the light receiving surface of the imaging element; An imaging control method of an imaging apparatus, comprising: a step of detecting an inclination angle on a light receiving surface of the imaging element of an optical image of a subject irradiated on the imaging element when the bending lens unit is rotated; An acquisition step of acquiring a captured image based on an image signal output from the image sensor, and an image region for cutting out the image with respect to the acquired captured image based on the detection result of the detection unit Both include an adjustment step of adjusting the size of the image area so as to be within the frame of the captured image.

  [18] The imaging control program of the present invention includes an imaging element fixed to the main body and a bent lens part that bends light from the subject toward the imaging element, and directs light from the subject toward the imaging element. A plurality of imaging optical systems for irradiating, wherein at least one of the plurality of imaging optical systems, the bending lens unit is provided so as to be rotatable about the optical axis of the light receiving surface of the imaging element; and A detection step of detecting an inclination angle on a light receiving surface of the imaging element of an optical image of a subject irradiated on the imaging element when the bending lens unit is rotated; Based on the detection result of the detecting means, an image area for reading an image from the image sensor is tilted, and an adjustment step for adjusting the size of the image area so as to be within the image sensor. Make the computer execute.

  [19] An imaging control program according to another invention includes an imaging device fixed to a main body and a bent lens portion that bends light from a subject toward the imaging device, and directs light from the subject to the imaging device. A plurality of imaging optical systems that irradiate the imaging optical system, wherein at least one of the plurality of imaging optical systems is provided with the bent lens portion rotatably about the optical axis of the light receiving surface of the imaging element; An imaging control program for an imaging apparatus comprising: a step of detecting an inclination angle on a light receiving surface of the imaging element of an optical image of a subject irradiated on the imaging element when the bending lens unit is rotated; An acquisition step of acquiring a captured image based on an image signal output from the image sensor, and an image to be cut out from the acquired captured image based on a detection result of the detection unit And an adjustment step of adjusting the size of the image area so as to be within the frame of the captured image.

  As described above, according to the present invention, when the direction to the subject is changed by rotating the bending lens unit, the image area for obtaining the image by detecting the inclination of the image rotated on the image sensor. Since the size of the image area is adjusted so as to be tilted and fit within the image sensor, the influence of the rotation of the bent lens portion on the obtained image can be suppressed, and a wide range of shooting can be performed. can get.

It is a front side perspective view of the compound eye digital camera of a 1st embodiment. It is a back side perspective view of the compound eye digital camera of a 1st embodiment. It is the schematic which shows the internal structure of an imaging unit, (A) is a front view, (B) is a side view, (C) is a top view which shows the state which the bending lens part rotated. It is a block diagram which shows schematic structure about the electrical equipment part of a compound eye digital camera. It is an image figure which shows the relationship between a to-be-photographed object and a bending lens part when image | photographing a to-be-photographed object in order to obtain the image for stereoscopic vision. It is an image figure which shows the relationship between the right-and-left image by rotation of a bending lens part, and an image read-out area | region, (A) is an initial state, (B) is an approach state, (C) shows the tilted image read-out area | region. It is an image figure which shows the relationship between a to-be-photographed object and a bending lens part when one bending lens part is rotated when image | photographing a to-be-photographed object. It is a flowchart which shows the flow of the image processing routine of 1st Embodiment. It is a flowchart which shows the flow of the image processing routine of 2nd Embodiment. It is explanatory drawing of calculating the inclination of an image from a captured image, (A) shows an initial state, (B) shows the state after rotation. It is a flowchart which shows the flow of the image processing routine of 3rd Embodiment. It is a flowchart which shows the flow of the image processing routine of 4th Embodiment. It is an image figure which shows the adjustment process of the zoom mechanism of an imaging | photography part, (A) shows an initial state, (B) shows the state after rotation, (C) shows the state after zoom drive. It is a flowchart which shows the flow of the image processing routine of 5th Embodiment. It is a flowchart which shows the flow of the image processing routine of 6th Embodiment. It is explanatory drawing of a grid rotation, (A) shows an initial display, (B) shows the display after rotation. It is an image figure which shows the relationship between the to-be-photographed object and imaging unit for obtaining the wide-angle image which concerns on 7th Embodiment. It is explanatory drawing of the process of obtaining the wide-angle image which concerns on 7th Embodiment, (A) is an initial state, (B) is the state after rotation, (C) is an image reading area | region setting state, (D) is Shows the combined image. It is a flowchart which shows the flow of the image processing routine of 7th Embodiment. It is a front side perspective view of the compound-eye digital camera of 8th Embodiment. It is a back side perspective view of the compound eye digital camera of an 8th embodiment. It is an image figure which shows the relationship between the to-be-photographed object and imaging unit for obtaining the omnidirectional image which concerns on 8th Embodiment. It is an image figure which shows the arrangement | sequence of an omnidirectional image. It is a flowchart which shows the flow of the image processing routine of 7th Embodiment. It is an image figure which shows the relationship between a to-be-photographed object and a bending lens part, when image | photographing a to-be-photographed object in order to obtain an image with a different rotation angle with a compound eye digital camera. It is an image figure which shows the relationship between a to-be-photographed object and a bending lens part, when imaging | photography a to-be-photographed object in order to rotate the bending lens part of the imaging unit of one imaging | photography part with a compound eye digital camera, and to obtain an image. It is a flowchart which shows the flow of the image processing routine of 9th Embodiment. It is an image figure which shows the relationship between the right-and-left image and image read-out area | region by rotation of a bending lens part, (A) is an initial state, (B) is the optical adjustment state in a non-rotation side, (C) is in a rotation side. (D) shows the electrical adjustment state on the non-rotating side. It is explanatory drawing of the process which cuts out from the image which reads all the pixels from the image pick-up element in the imaging | photography part of 10th Embodiment, and forms an image, (A) is a bending angle when a rotation angle is an initial value, (B) is bending. When the lens unit is rotated, (C) shows an image cutout area, and (D) shows a cutout. It is the schematic which shows the structure of the imaging unit periphery in the compound-eye digital camera of 11th Embodiment, (A) is a top view of an imaging unit, (B) is a rear view, (C) shows the modification of image division.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In this embodiment, a case where the imaging apparatus of the present invention is applied to a compound-eye digital camera will be described.

[First Embodiment]
In the first embodiment, in a compound-eye digital camera, the adjustment of the convergence angle for obtaining a stereoscopic image is easily processed with a simple configuration.

  FIG. 1 is a front perspective view of the compound-eye digital camera 1 of the first embodiment, and FIG. 2 is a rear perspective view. As shown in FIG. 1, a release button 2, a power button 3, and a zoom lever 4 are provided on the upper part of the compound-eye digital camera 1. Further, on the front surface of the compound-eye digital camera 1, a flash 5 and lenses of the two photographing units 21A and 21B are disposed. A liquid crystal monitor 7 for performing various displays and various operation buttons 8 are disposed on the back surface of the compound-eye digital camera 1. Each of the two photographing units 21 </ b> A and 21 </ b> B includes an imaging unit 6.

  In the present embodiment, a configuration in which the imaging unit 6 is included in each of the two imaging units 21A and 21B will be described. However, the following description can be applied to a case where only one of the imaging units 6 is included.

  FIG. 3 is a schematic diagram showing the internal configuration of the imaging unit 6. 3A is a front view of the image pickup unit 6, FIG. 3B is a side view, and FIG. 3C is a top view showing a state in which a bent lens portion described later is rotated. As shown in FIGS. 3A and 3B, the imaging unit 6 irradiates the imaging device 54 with light from a subject by an imaging system including a bent lens unit 50, an imaging lens group 52, and an imaging device 54. (Imaging). The image sensor 54 is housed in a housing 55 fixed to the main body of the compound-eye digital camera 1 and is fixed to the main body. A lens barrel 53 is fixed to the housing 55. An imaging lens group 52 is installed inside the lens barrel 53. A rotation drive unit 51 is attached to the lens barrel 53. A bending lens unit 50 is installed in the rotation driving unit 51 so as to be rotatable. As described above, the imaging unit 6 includes the fixed portion fixed to the compound-eye digital camera 1 including the imaging lens group 52 and the imaging element 54 and the freely rotating portion including the bent lens portion 50. Yes. The imaging lens group 52 includes a zoom mechanism. Examples of the bent lens unit 50 include a prism and a reflection mirror.

  The rotation drive unit 51 is for rotating the bent lens unit 50. The bent lens unit 50 rotates around the light receiving surface of the image sensor 54 and the optical axis CL of the imaging lens group 52 in a direction intersecting the optical axis CL of the imaging lens group 52 (arrow R direction). As a result, the bent lens unit 50 bends light from the subject and deflects it to the image sensor 54 as shown in FIG. 3 (C), and changes the direction with respect to the subject by the rotational drive of the rotational drive unit 51. It is possible to do it. FIG. 3 (C) shows a case of turning by an angle θ.

  FIG. 4 is a block diagram illustrating a schematic configuration of the electrical component of the compound-eye digital camera 1. As shown in FIG. 4, the compound-eye digital camera 1 includes two photographing units 21A and 21B, a photographing control unit 22, an image processing unit 23, a compression / decompression processing unit 24, a frame memory 25, a media control unit 26, and an internal memory 27. A display control unit 28 and a CPU 35. The CPU 35 receives input from various operation buttons 8 and executes various programs. Note that the photographing units 21A and 21B are arranged so as to have a predetermined baseline length with a convergence angle at which the subject is viewed. Information on the angle of convergence and the baseline length is stored in the internal memory 27.

  The two photographing units 21 </ b> A and 21 </ b> B are connected to 36 through the interface unit 20. The interface unit 20 is connected to the angle sensor 33 so that a detection signal from the angle sensor 33 is input. The angle sensor 33 detects the rotation angle of the bent lens unit 50 in the imaging unit 6. In addition, a rotation drive unit 51 is connected to the interface unit 20.

  In the present embodiment, the case where the bending lens unit 50 is rotated by the rotation driving unit 51 will be described, but the present invention is not limited to this. For example, the rotation driving unit 51 may be configured as a rotation unit, and the bending lens unit 50 may be manually rotated. In this case, the angle sensor 33 detects the rotation angle of the bent lens unit 50 that is manually rotated. In addition, by using an element such as a motor with an encoder, the angle sensor 33 and the rotation driving unit 51 can share driving and detection with one element.

  The imaging control unit 22 includes an AF processing unit and an AE processing unit (not shown). The AF processing unit determines the in-focus area and the focal position of the lens based on the pre-images acquired by the imaging units 21A and 21B by half-pressing the release button 2 (S1 operation). To 21B. The AE processing unit determines the aperture value and the shutter speed based on the pre-image, and outputs them to the photographing units 21A and 21B.

  In addition, the shooting control unit 22 instructs the shooting unit 21A to acquire the main image of the left image and the shooting unit 21B to acquire the main image of the right image by fully pressing the release button 2 (S2 operation). . Before the release button 2 is operated, the shooting control unit 22 displays a through image having a smaller number of pixels than the main image for confirming the shooting range at a predetermined time interval (for example, 1/30 second interval). An instruction to sequentially acquire is given to the imaging units 21A and 21B.

  The image processing unit 23 performs image processing such as white balance adjustment, gradation correction, sharpness correction, and color correction on the digital image data of the left image and the right image acquired by the photographing units 21A and 21B. Apply.

  The compression / decompression processing unit 24 performs compression processing on the image data representing the left image and the right image processed by the image processing unit 23 in, for example, a compression format such as JPEG, so that an image file for stereoscopic viewing is obtained. Is generated. Multi-picture format can be used as this stereoscopic image file, and the left and right image data includes additional information such as baseline length, convergence angle, shooting date and time, and viewpoint position. The viewpoint information to be represented is stored in association with each other.

  The frame memory 25 is a work memory used when performing various processes including the processes performed by the above-described image processing unit 23 on the image data representing the left image and the right image acquired by the imaging units 21A and 21B. .

  The media control unit 26 accesses the recording medium 29 to control writing and reading of image files and the like.

  The internal memory 27 stores various constants set in the compound-eye digital camera 1, a program executed by the CPU 35, and the like.

  The display control unit 28 displays the stereoscopic image generated from the left image and the right image stored in the frame memory 25 at the time of shooting on the liquid crystal monitor 7, or displays the left image and the right recorded on the recording medium 29. An image or a stereoscopic image is displayed on the liquid crystal monitor 7.

  The compound-eye digital camera 1 includes a three-dimensional processing unit 30 and a rotation control unit 31.

  In order to perform stereoscopic display of the left image and the right image on the monitor 7, the three-dimensional processing unit 30 performs a three-dimensional process on the left image and the right image and generates a stereoscopic image in consideration of the amount of parallax. The parallax amount is generated based on the left image and the right image in order to make the stereoscopic effect of the stereoscopic image appropriate. Here, the parallax can be calculated as a difference in pixel position in the horizontal direction between the left image and the right image of the subject included in both the left image and the right image. By appropriately generating the parallax amount, the stereoscopic effect of the subject included in the stereoscopic image can be made appropriate.

  The rotation control unit 31 performs rotation control for rotating the bent lens unit 50 of the imaging unit 6 or reading an image from an area corresponding to an image rotated by the rotation of the bent lens unit 50. A description will be given of reading an image from an area corresponding to an image rotated by the rotation of the bent lens unit 50.

  FIG. 5 shows a relationship between the subject and the rotated bent lens unit 50 included in the imaging unit 6 of the compound-eye digital camera 1 when the subject is photographed to obtain a stereoscopic image by the compound-eye digital camera 1. It is. In the following description, A and B are given to the components corresponding to the photographing units 21A and 21B. As shown in FIG. 5, in order to obtain a stereoscopic image, the subject is positioned within the angle of view of the photographing units 21A and 21B. The angle formed by the optical axis LA formed by the bent lens unit 50A of the photographing unit 21A and the optical axis LB formed by the bent lens unit 50B of the photographing unit 21B is a convergence angle G. The convergence angle G has a standard initial value G0 determined in advance. When the convergence angle G is determined by the initial value G0, the vertical axes JA and JB of the subject image are the left and right images as shown in FIG. Both are parallel. For this reason, if all the area | regions of the image pick-up element 54 are read, the image for stereoscopic vision will be obtained.

  On the other hand, in order to adjust the convergence angle when the subject approaches the compound-eye digital camera 1 side, the bent lens unit 50A is rotated in the arrow RA direction, and similarly the bent lens unit 50B is rotated in the arrow RB direction. 6B, the vertical axes JA and JB of the subject image of the subject image are inclined. Therefore, the image reading area 60 to be read from the image sensor 54 is tilted by an amount corresponding to the amount by which the bent lens portions 50A and 50B are rotated. Thus, an image reading area 60 corresponding to the rotation of the subject image is obtained. At this time, by changing the size of the image readout area so as to be within the initial readout area of the image sensor 54, the image readout area of the image sensor 54 can be used effectively. This image readout area corresponds to the image area of the present invention.

  In addition, although FIG. 5 demonstrated the case where both the bending lens parts 50 of the imaging | photography parts 21A and 21B were rotated, as shown in FIG. 7, it is the same even when only one is rotated. In addition, the image rotated on the image sensor 54 may be processed (details will be described later).

  In the above embodiment, the case where both the bending lens portions 50 of the photographing units 21A and 21B are rotated has been described. However, this is a case where the bending lens portions 50 of the photographing portions 21A and 21B are independently rotated. However, similarly, the image may be processed on the image rotated on the image sensor 54.

  The rotation control unit 31 may be configured by a hardware device, or may be configured by software by executing a program using the above-described hardware resources.

  The above-described interface unit 20, imaging control unit 22, image processing unit 23, decompression processing unit 24, frame memory 25, media control unit 26, internal memory 27, display control unit 28, three-dimensional processing unit 30, rotation control The unit 31 and the CPU 35 are connected to the bus 36 so that data and commands can be exchanged.

  Next, an image processing routine in the compound-eye digital camera of the first embodiment will be described with reference to FIG.

  When the photographer operates the power button 3 of the compound-eye digital camera 1 to turn on the power, the CPU 35 starts processing, and in step 100, initial setting of the compound-eye digital camera 1 is performed. At this time, the convergence angle G is set to the initial value G0. In the next step 102, whether or not the convergence angle G is adjusted is set. The setting in step 102 is performed by reading that the photographer has instructed the compound-eye digital camera 1 to perform short-distance shooting or the like. When the bent lens unit 50 is manually rotated, the convergence angle G is set to be adjustable by detecting that the convergence angle G is deviated from the initial value.

  In the next step 104, the left and right images obtained by irradiating the subject images onto the image sensors 54A and 54B are acquired by the photographing units 21A and 21B and output (displayed) as through images by the S1 operation. In this case, the through image to be displayed on the liquid crystal monitor 7 may selectively display either one of the photographing units 21A and 21B. For example, both images may be displayed by alternately displaying in time division. If a 3D display device is provided, 3D display may be performed based on the left and right images. In step 104, an in-focus area is determined by an AF processing unit and an AE processing unit (not shown), and an aperture value and a shutter speed are determined.

  In the next step 106, the distance from the compound-eye digital camera 1 to the subject to be imaged is measured, and in the next step 108, the optical axis LA and the optical axis LB intersect at the measured position (step 106). The bent lens portions 50A and 50B are rotated. These processes are executed until the in-focus area is determined. When the in-focus area is determined (Yes in step 110), an imaging instruction by the S2 operation is waited.

  Next, in step 112, it is detected that the S2 operation has been performed by reading the signal of the release button 2, and the process proceeds to step 114, where captured images that are left and right images in which the subject images are irradiated to the image sensors 54A and 54B are captured. To start. At this time, since the bent lens unit 50 is rotated, the convergence angle G is detected by reading a signal from the angle sensor 33 (step 116). In the next step 118, an image reading area is determined from the convergence angle G detected in step 116.

  Specifically, the rotation angle θ of the bent lens unit 50 detected by the angle sensor 33 is obtained, and the image reading area 60 of the image sensor 54 is rotated by the rotation angle θ of the bent lens unit 50 (FIG. 6 ( C)). At this time, the size (number of pixels k) of the image reading area 60 is determined by the following formula.

k = c · (1 / SQR (cos (X) + α · sin (X)))
X = ABS (θ)
However,
c is the total number of pixels of the image sensor 54;
α is the aspect ratio (horizontal / vertical),
SQR () is a square function,
ABS () is an absolute value function,
It is.

  In the next step 120, an image is read from each of the image sensors 54A and 54B in the image reading area 60 determined in step 118, temporarily stored, synthesized (step 122), and displayed (step 124). . These processes are to generate a stereoscopic image from the temporarily stored left and right images and to display the stereoscopic image on the monitor 7.

  Next, in step 126, it is determined whether or not parallax adjustment according to the photographer's instruction is unnecessary by reading the signals of the various operation buttons 8, and in the case of unnecessary determination, the image is stored in step 128 and this processing routine is executed. finish. The image saving process in step 128 is to generate and save an image file of a stereoscopic image.

  On the other hand, if the result in Step 126 is negative, parallax adjustment is necessary, so in Step 130, the parallax amount is calculated for the left and right images read from each of the image sensors 54A and 54B by the image reading areas 60A and 60B. Parallax adjustment processing is performed. This parallax adjustment process is to increase or decrease the parallax amount according to an adjustment amount instruction by various operation buttons 8 or a movement amount of a dedicated lever (not shown), and as a result, the position adjustment of the image position of the stereoscopic image is performed. . In this parallax adjustment process, images being parallax adjusted are sequentially displayed. In the next step 132, it is determined whether or not the adjustment has been completed by reading the end signals of the various operation buttons 8. If the determination is affirmative, the completed image after the parallax adjustment is saved (step 128), When the processing routine is finished and the result is negative, the processing routine is returned to step 130 and the above processing is repeated.

  As described above, according to the compound-eye digital camera of this embodiment, the structure of the device for changing the convergence angle can be simplified by making only the bent lens portion rotatable. Further, since only the bent lens portion can be rotated, the driving load can be reduced. As a result, power consumption can be suppressed, power supply to other processes can be increased, and product performance can be improved.

  In this embodiment, the case where the image reading area is determined after the S2 operation (step 112) has been described. However, the image reading area may be performed after the S1 operation (step 104. In this way, before shooting. The image reading area can be determined in advance and can be recognized by the photographer.Specifically, the processing of step 116 and step 118 is performed between step 108 and step 110. Good.

[Second Embodiment]
Next, a second embodiment will be described. Since the configuration of the imaging apparatus of the second embodiment is the same as that of the first embodiment, description thereof is omitted.

  The second embodiment is for adjusting the convergence angle with high accuracy in the compound-eye digital camera 1 of the first embodiment.

  The image processing routine of the second embodiment will be described with reference to FIG. In addition, about the process same as the image processing routine of 1st Embodiment, the same code | symbol is attached | subjected and description is abbreviate | omitted and a different part is demonstrated hereafter. FIG. 9 shows an additional part different from FIG.

  In steps 100 to 108, through images are output (displayed), and the bent lens portions 50A and 50B are rotated so that they converge at a distance-measured position from the compound-eye digital camera 1 to the subject to be photographed. Next, when the subject is in focus (Yes in step 110), the process proceeds to step 200.

  In step 200, the inclination is detected from the edge of the image on the image sensor 54. Specifically, as shown in FIGS. 10A and 10B, the images on the imaging elements 54A and 54B are rotated by rotating each of the bent lens portions 50A and 50B. At this time, the end of the light from the subject, that is, the opening end (pupil image) rotates with the rotation. As a result, edge lines 56A and 56B at the open ends are formed on the image pickup devices 54A and 54B, and the angle θa and θb formed by the edge lines 56A and 56B and the end lines on the image pickup devices 54A and 54B are displayed. The inclination can be obtained. That is, when an image is read from the image sensor, if the end line of the image sensor is determined in advance as a reference end (reference edge), the reference line (end line) by the reference edge and the edge line of the image end The inclination can be easily obtained by the angle formed.

  In the next step 202, each of the bent lens portions 50A and 50B is rotated by a small amount, and in the next step 204, it is determined whether or not the left / right balance is appropriate. This corresponds to fine adjustment of the convergence angle. For example, if the difference value between the angles θa and θb is within a predetermined minute angle, it is determined that the left / right balance is appropriate, and the routine proceeds to step 112.

  Hereinafter, the same processing as in the first embodiment is performed.

  As described above, according to the compound-eye digital camera of the second embodiment, the state of the convergence angle can be always detected and can be adjusted. Thereby, highly accurate angle control becomes possible. In addition, even when there are variations in the initial rotation angle and the angle after the rotation of each of the bending lens portions of the photographing units 21A and 21B, the rotation angles can be matched with high accuracy. In addition, since the rotation angles of the bending lens portions of the photographing units 21A and 21B can be accurately detected, it is possible to suppress image misalignment when the left and right images are combined after imaging.

  In the present embodiment, a case has been described in which the tilt is detected from the edge of the image on the image sensor 54 immediately before the S2 operation (after step 110), but the operation is performed after the S2 operation (after step 112). Also good. Specifically, it may be performed between the processing of step 116 and step 118.

[Third Embodiment]
Next, a third embodiment will be described. Since the configuration of the compound-eye digital camera of the third embodiment is the same as that of the first embodiment, description thereof is omitted.

  The third embodiment notifies the photographer of photographing conditions changed by rotation in the compound-eye digital camera of the first embodiment.

  The image processing routine of the third embodiment will be described with reference to FIG. In addition, about the process same as the image processing routine of 1st Embodiment, the same code | symbol is attached | subjected and description is abbreviate | omitted and a different part is demonstrated hereafter. FIG. 11 shows an additional part different from FIG.

  In steps 100 to 108, through images are output (displayed), and the bent lens portions 50A and 50B are rotated so that they converge at a distance-measured position from the compound-eye digital camera 1 to the subject to be photographed.

  Next, at step 300, the convergence angle G is detected by reading a signal from the angle sensor 33 as in step 116, and at the next step 302, an image reading area is determined from the convergence angle G as in step 118. The determined image readout area obtains the focal length of the image after changing the angle of view from the size of the image readout area 60 (number of pixels k) and the change in the size of the image readout area 60 (for example, from the fluctuation of the image width). be able to. Note that the resolution may be notified instead of the notification of the number of pixels. This is because the variation in the number of pixels corresponds to the resolution. The number of pixels and the focal length may be recorded in an image file in association with image data.

  In the next step 304, either the number of pixels due to the change in the size of the image readout area 60 obtained in step 302 and the actual focal length obtained from, for example, the fluctuation of the image width, or the resolution instead of the number of pixels, Notification is made by displaying on the liquid crystal monitor 7. Since this notification is preferably recognized by the photographer, blinking display is preferable.

  Next, it is determined whether or not the subject is in focus. If the result is affirmative, the process proceeds to step 112. If the result is negative, the process returns to step 106, and the above process is repeatedly executed.

  Hereinafter, the same processing as in the first embodiment is performed.

  As described above, according to the compound-eye digital camera of the third embodiment, the imaging condition can be notified to the user in advance by notifying the adjusted number of pixels or the corresponding resolution or focal length. it can.

  In the present embodiment, the case where the notification process is performed between the operation of S1 and the operation of S2 (between steps 108 and 110) has been described, but it may be performed after the operation of S2 (after step 112). Specifically, it may be performed between the processing of step 118 and step 120.

  Further, the third embodiment can be applied to any of the first to second embodiments.

[Fourth Embodiment]
Next, a fourth embodiment will be described. Since the configuration of the compound-eye digital camera of the fourth embodiment is the same as that of the first embodiment, description thereof is omitted.

  In the fourth embodiment, in the compound-eye digital camera of the first embodiment, the optical image is adjusted to a size suitable for an image reading area changed by rotation.

  The image processing routine of the fourth embodiment will be described with reference to FIG. In addition, about the process same as the image processing routine of 1st Embodiment, the same code | symbol is attached | subjected and description is abbreviate | omitted and a different part is demonstrated hereafter. FIG. 12 shows an additional part different from FIG.

  In steps 100 to 108, through images are output (displayed), and the bent lens portions 50A and 50B are rotated so that they converge at a distance-measured position from the compound-eye digital camera 1 to the subject to be photographed. Next, in steps 300 to 302, the convergence angle G is detected to determine the image reading area.

  Next, in step 400, the subject image is enlarged or reduced to a size corresponding to the size of the image reading area 60 obtained in step 302. For example, when the bent lens portions 50A and 50B are rotated, the image frame (the edge lines 56A and 56B) is fixed, so that the subject image protrudes from the adjusted image reading area 60. This is because the angle of view of the image read in the image reading area 60 whose size is adjusted with the rotation changes according to the rotation of the bent lens portion. Therefore, in step 400, the subject image is enlarged or reduced so that the angle of view before the rotation matches the angle of view of the image read in the image reading area 60 after the rotation. The process of step 400 is executed by a zoom mechanism included in the imaging lens group 52. As the driving amount of the zoom mechanism included in the imaging lens group 52, the focal length f obtained when the image reading area 60 is obtained in step 302 can be used. The focal length of the zoom mechanism may be adjusted so as to be this focal length f. Further, the focal length of the zoom mechanism may be determined so that the image frame can be accommodated in the obtained image reading area 60 by using the enlargement / reduction of the image frame by adjusting the zoom mechanism. Adjustment by this zoom mechanism will be described.

  FIG. 13 is an image diagram illustrating the adjustment process of the zoom mechanism in the photographing unit 21A. The rotation angle θa of the bent lens unit 50A detected by the angle sensor 33 is obtained, and the image reading area 60A of the image sensor 54 is rotated by the rotation angle θa of the bent lens unit 50. At this time, the size of the image readout area 60A is changed so as to be within the initial readout area of the image sensor 54 (see FIG. 13B). At this stage, the subject image protrudes from the image reading area 60A. That is, the edge line 56A at the opening end by the bent lens portion 50A rotates as it is, so that the subject image protrudes. Therefore, the drive value (focal length f) of the zoom mechanism is determined by the following formula so that the image has a size suitable for the image reading area 60A. When the zoom mechanism included in the imaging lens group 52 is driven so that the obtained focal length f is obtained, the image of the subject fits in the image reading area 60A (see FIG. 13C).

f = fb · (1 / RT (ca / cb))
However,
fb is a focal length before rotation, ca is the number of pixels of the image sensor 54 after rotation,
cb is the number of pixels of the image sensor 54 before rotation;
RT () is a square root function,
It is.

  Next, it is determined whether or not the subject is in focus (step 110). If the result is affirmative, the process proceeds to step 112. If the result is negative, the process returns to step 106, and the above process is repeatedly executed.

  Hereinafter, the same processing as in the first embodiment is performed.

  As described above, according to the compound-eye digital camera of the fourth embodiment, the focal length is adjusted by the zoom mechanism to suppress the view angle fluctuation. Therefore, it is possible to easily provide the photographer with images having substantially the same angle of view without sequentially operating the zoom mechanism.

  In the present embodiment, the case where the notification process is performed between the operation of S1 and the operation of S2 (between steps 108 and 110) has been described, but it may be performed after the operation of S2 (after step 112). Specifically, it may be performed between the processing of step 118 and step 120.

  The fourth embodiment can be applied to any of the first to third embodiments.

[Fifth Embodiment]
Next, a fifth embodiment will be described. Since the configuration of the stereoscopic endoscope apparatus of the fifth embodiment is the same as that of the first embodiment, description thereof is omitted.

  In the fifth embodiment, the compound-eye digital camera of the first embodiment warns when the amount by which the image reading area is changed by rotation is larger than a preset value.

  The image processing routine of the fifth embodiment will be described with reference to FIG. In addition, about the process same as the image processing routine of 1st Embodiment, the same code | symbol is attached | subjected and description is abbreviate | omitted and a different part is demonstrated hereafter. FIG. 14 shows an additional part different from FIG.

  In steps 100 to 108, through images are output (displayed), and the bent lens portions 50A and 50B are rotated so that they converge at a distance-measured position from the compound-eye digital camera 1 to the subject to be photographed. Next, in steps 300 to 302, the convergence angle G is detected to determine the image reading area.

  In step 100, an initial value stored in the internal memory 27 in advance is read and set. This initial value defines an allowable amount when the image reading area is changed by rotation. Specifically, at least one of the number of pixels and the focal length is stored. This initial value is not limited to being stored in the internal memory 27. For example, it may be set by the photographer.

  Next, in step 500, the number of pixels and the focal length are determined by determining whether at least one of the number of pixels and the focal length in the image reading area determined in step 302 is within an allowable range set in advance as an initial value. It is determined whether or not a photographing condition of being within an allowable range is satisfied. If the determination in step 500 is affirmative, the process proceeds to step 110, and the same processing as described above is performed. If the determination is negative, the process proceeds to step 502.

  In step 502, a warning indicating that the photographing condition is not met is displayed on the liquid crystal monitor 7, and photographing is set to a prohibited state. In the warning display, it is preferable to display information indicating that photographing is set to a prohibited state. The release from the photographing prohibited state is performed when the power is turned off or when it is determined that the number of pixels and the focal length are within the allowable range and the photographing condition is satisfied.

  Hereinafter, the same processing as in the first embodiment is performed.

  As described above, according to the compound-eye digital camera of the fourth embodiment, the focal length is adjusted by the zoom mechanism to suppress the view angle fluctuation. Therefore, it is possible to easily provide the photographer with images having substantially the same angle of view without sequentially operating the zoom mechanism.

  In the present embodiment, a case is described in which warning processing is performed between the operation of S1 and the operation of S2 (between steps 108 to 110), but may be performed after the operation of S2 (after step 112). In this case, it is preferable to perform processing so as to interrupt the photographing processing.

  Further, the fifth embodiment can be applied to any of the first to fourth embodiments.

[Sixth Embodiment]
Next, a sixth embodiment will be described. Since the configuration of the compound-eye digital camera of the sixth embodiment is the same as that of the first embodiment, description thereof is omitted.

  In the sixth embodiment, in the compound-eye digital camera of the first embodiment, when a grid line (grid) that supports composition selection at the time of photographing is presented to the photographer, the image reading area is rotated by the rotation of the bending lens unit. The grid line (grid) is rotated according to the above.

  The image processing routine of the sixth embodiment will be described with reference to FIG. In addition, about the process same as the image processing routine of 1st Embodiment, the same code | symbol is attached | subjected and description is abbreviate | omitted and a different part is demonstrated hereafter. FIG. 15 shows an additional part different from FIG.

  In steps 100 to 108, through images are output (displayed), and the bent lens portions 50A and 50B are rotated so that they converge at a distance-measured position from the compound-eye digital camera 1 to the subject to be photographed. Next, in steps 300 to 302, the convergence angle G is detected to determine the image reading area.

  Next, in step 600, the grid line 62 is rotated according to the inclination of the image reading area 60 obtained in step 302 and displayed on the liquid crystal monitor 7.

  FIG. 16 is an image diagram showing display of a through image on the liquid crystal monitor 7 of the compound-eye digital camera 1. When the rotation position of the bent lens unit 50 is in the initial state, the grid lines (grids) 62 displayed on the liquid crystal monitor 7 are parallel to the vertical and horizontal directions of the liquid crystal monitor 7 (see FIG. 16A). In this case, since the bent lens unit 50 is in the initial state, the image display frame 61 on the liquid crystal monitor 7 corresponding to the image reading area 60 coincides with the outer frame of the liquid crystal monitor 7. On the other hand, when the bending lens unit 50 is rotated, the image reading area 60 of the image sensor 54 is rotated by the rotation angle θ of the bending lens unit 50A detected by the angle sensor 33 (see FIG. 16B). In this case, the image display frame 61 on the liquid crystal monitor 7 is rotated at an angle corresponding to the rotation of the image reading area 60. Therefore, the grid line 62 is rotated at an angle corresponding to the rotation angle of the image reading area 60 and displayed on the liquid crystal monitor 7 (see FIG. 16B).

  Next, it is determined whether or not the subject is in focus (step 110). If the result is affirmative, the process proceeds to step 112. If the result is negative, the process returns to step 106, and the above process is repeatedly executed.

  Hereinafter, the same processing as in the first embodiment is performed.

  As described above, according to the compound-eye digital camera of the sixth embodiment, the grid line (grid) is rotated and displayed in accordance with the rotation of the image reading area by the rotation of the bending lens unit. The photographer can select the composition at the time of shooting using the grid) as an index, and can support shooting.

  This embodiment is suitable for a camera equipped with an optical viewfinder that collects a part of a light beam from a subject that reaches the image sensor via a bent lens portion. That is, there is an optical finder that is fixed to the main body so that a range corresponding to an angle of view when photographing is provided so as to be visible. For this reason, the image provided to be visible according to the rotation of the bent lens portion is rotated. This image rotation makes it difficult to select a composition at the time of shooting. Therefore, in this optical viewfinder, a rotatable grid line (grid) is provided, and the grid line (grid) is rotated in accordance with the rotation of the bent lens part, so that the photographer can easily compose the image during shooting. It can be selected as a suitable shooting support. As an example of a rotatable grid line (grid), a rotor with a grid line (grid) on a transparent glass is provided in the optical viewfinder, and the rotor is rotated or a grid line (grid) is displayed. There is a type in which a possible liquid crystal element is provided in an optical finder, and its grid lines are rotated to display.

  In this case, it is possible to further improve the present invention by providing a camera equipped with an optical viewfinder with a liquid crystal monitor. That is, the actual tilt image can be confirmed with the optical viewfinder, and the image read from the tilted image can be confirmed with the liquid crystal monitor. Accordingly, it is possible to check the image after shooting while viewing the actual image. Further, an image obtained by the optical viewfinder and an image read from the tilted image may be switched and displayed on the liquid crystal monitor.

  Note that the sixth embodiment can be applied to any of the above-described embodiments.

[Seventh Embodiment]
Next, a seventh embodiment will be described. Since the structure of the compound-eye digital camera 1 of 7th Embodiment is the same as 1st Embodiment, description is abbreviate | omitted.

  The first embodiment can obtain, for example, a wide-angle image in a compound-eye digital camera.

  In the present embodiment, the rotation control unit 31 performs rotation control for rotating the bent lens unit 50 of the imaging unit 6 or reading an image from an area corresponding to an image rotated by the rotation of the bent lens unit 50. In the point which performs, it is the same as that of the said embodiment. The difference between the present embodiment and the above embodiment is that the turning direction of the bent lens unit 50 turns in the direction opposite to the arrows RA and RB shown in FIG.

  FIG. 17 shows the relationship between the subject and the rotated bent lens unit 50 included in the imaging unit 6 of the compound-eye digital camera 1 when the subject is photographed in order to obtain a wide-angle image with the compound-eye digital camera 1 according to the present embodiment. It shows the relationship. As shown in FIG. 17, in order to obtain a wide wide-angle image, the bent lens portions 50A and 50B are turned with respect to the subject so that the subject is positioned in the vicinity of the end of the angle of view of the photographing units 21A and 21B. The angle formed by the optical axis LA formed by the bent lens unit 50A of the photographing unit 21A and the optical axis LB formed by the bent lens unit 50B of the photographing unit 21B spreads in the divergence direction.

  By the way, in the state in which the compound-eye digital camera 1 is initially set as a standard, the vertical axes JA and JB of the subject image are parallel to the left and right images as shown in FIG. For this reason, if a subject which is a common part in the left and right images is overlapped and the images are combined, a wide image can be obtained.

  On the other hand, when a wider wide-angle image is desired, when the bent lens portion 50A is rotated in the direction of the arrow RB and similarly the bent lens portion 50B is rotated in the direction of the arrow RA, FIG. As shown, the vertical direction axes JA and JB of the subject image of the subject image are inclined. Therefore, the image reading area 60 to be read from the image sensor 54 is tilted by an amount corresponding to the amount by which the bent lens portions 50A and 50B are rotated. Thus, an image reading area 60 corresponding to the rotation of the subject image is obtained. In order to obtain the maximum wide-angle image at the time of shooting, it is preferable to reduce the overlapping portion of the subject. For this purpose, the bent lens portions 50A and 50B are turned with respect to the subject so that the subject is positioned near the ends of the angle of view of the photographing units 21A and 21B (see FIG. 17). In this case, if the images are read out in the image reading areas 60A and 60B (see FIG. 18C) and the obtained images are combined, a wide-angle image with the maximum width can be obtained (FIG. 18D). )reference).

  In addition, although FIG. 18 demonstrated the case where both the bending lens parts 50 of the imaging | photography parts 21A and 21B were rotated, you may rotate only any one.

  With reference to FIG. 19, an image processing routine in the electrical device of the seventh embodiment will be described. In addition, about the process same as the image processing routine of the said embodiment, the same code | symbol is attached | subjected and description is abbreviate | omitted.

  When the photographer operates the power button 3 of the compound-eye digital camera 1 to turn on the power, the CPU 35 starts processing, and in step 700, initial setting of the compound-eye digital camera 1 is performed. At this time, the turning angle H (initial rotation value in the direction of the arrow RA) is set in advance. In the next step 702, it is read that the photographer has issued an instruction to acquire a wide wide-angle image by operating the various operation buttons 8, and whether or not the turning angle H is adjusted is set.

  In the next step 704, the through image is output (displayed) and focused by the S1 operation. In the next step 706, the distance from the compound-eye digital camera 1 to the subject to be imaged is measured, and in the next step 708, a turning angle for the subject to be positioned at the end of the angle of view is obtained at the measured position. In step 710, the bent lens portions 50A and 50B are turned to rotate. These processes are executed until the in-focus area is determined. When the in-focus area is determined (Yes in step 712), an imaging instruction by the S2 operation is awaited.

  Next, in step 714, it is detected that the S2 operation has been performed by reading the signal of the release button 2, and captured images that are left and right images in which the subject images are irradiated to the image sensors 54A and 54B are captured (step 716). At this time, since each of the bent lens portions 50 is rotated, the turning angle H is detected by reading a signal from the angle sensor 33 (step 718). In the next step 720, an image reading area is determined from the detected turning angle H.

  Specifically, as in the first embodiment, the rotation angle θ of the bent lens unit 50 is obtained, and the image reading area 60 of the image sensor 54 is rotated by the rotation angle θ of the bent lens unit 50 (see FIG. 18 (C)).

  In the next step 722, images are read from each of the image sensors 54A and 54B in the image reading area 60, temporarily stored, image-synthesized (step 724), and image display (step 726). These processes are to generate a wide wide-angle image from the temporarily stored left and right images and display the image on the monitor 7.

  Next, in step 728, it is determined whether or not adjustment according to the photographer's instruction is necessary by reading the signals of the various operation buttons 8, and in the case of unnecessary determination, the image is stored in step 128 and this processing routine is terminated. To do. The image storage processing in step 730 may store an image synthesized as a wide wide-angle image, or generate and store an image file in which each image is associated.

  On the other hand, if the result is negative in step 728, adjustment is necessary for image synthesis. Therefore, in step 732, the left and right images read from each of the image sensors 54A and 54B by the image reading areas 60A and 60B are subjected to synthesis adjustment processing. . This composition adjustment processing is to determine a margin or a position to connect the left and right images according to an adjustment amount instruction by various operation buttons 8 or a movement amount of a dedicated lever (not shown). In this composition adjustment process, the images being subjected to composition adjustment are sequentially displayed. In the next step 734, it is determined whether or not the adjustment has been completed by reading the end signals of the various operation buttons 8. If the determination is affirmative, the completed composite adjusted image is saved (step 730)). When this processing routine is finished and the result is negative, the processing returns to step 732 and the above processing is repeated.

  As described above, according to the compound-eye digital camera of this embodiment, the structure of the device for changing the turning angle can be simplified by making only the bent lens portion rotatable. Further, since only the bent lens portion can be rotated, the driving load can be reduced. As a result, power consumption can be suppressed, power supply to other processes can be increased, and product performance can be improved. Furthermore, a wider wide-angle image, for example, a panoramic image can be obtained.

  In the present embodiment, the case where the image reading area is determined after the S2 operation (Step 714) has been described, but it may be performed after the S1 operation (Step 704. In this way, before shooting. The image reading area can be determined in advance and can be recognized by the photographer.

[Eighth Embodiment]
Next, an eighth embodiment will be described. Since the configuration of the compound-eye digital camera of the eighth embodiment is substantially the same as that of the first embodiment, the same parts are denoted by the same reference numerals, detailed description thereof will be omitted, and different parts will be described below.

  The eighth embodiment is for synthesizing a large number of images to obtain a wider wide-angle image.

  FIG. 20 is a front perspective view of the compound-eye digital camera 1 according to the eighth embodiment, and FIG. 21 is a rear perspective view. As shown in FIG. 20, the compound-eye digital camera 1 according to the eighth embodiment includes a window 80A that opens 180 degrees in charge of the photographing unit 21A and a window 80B that opens 180 degrees in charge of the photographing unit 21B. It is installed. Thereby, the imaging unit 6 included in each of the imaging unit 21A and the imaging unit 21B can be rotated (turned) by 180 degrees. Therefore, the compound-eye digital camera 1 of the present embodiment can shoot in all directions of 360 degrees.

  In the present embodiment, a configuration in which the imaging unit 6 is included in each of the two imaging units 21A and 21B will be described, but the imaging unit 6 may be provided in only one of them.

  FIG. 22 shows the subject and the rotated bent lens unit 50 included in the imaging unit 6 of the compound-eye digital camera 1 when photographing the subject to obtain an omnidirectional wide-angle image by the compound-eye digital camera 1 according to the present embodiment. This shows the relationship. As shown in FIG. 22, in order to obtain a wide wide-angle image, the bent lens unit 50A, the subject (photographing reference target) is positioned near the end of the angle of view of the photographing units 21A, 21B with respect to the subject. Turn 50B.

  As described above, when the bent lens portions 50A and 50B are turned and a wide wide-angle image is desired, the bent lens portion 50A is rotated in the direction of the arrow RB, and similarly the bent lens portion 50B is rotated in the direction of the arrow RA. Then, since the vertical axes JA and JB of the subject image of the subject image are inclined (see FIG. 18B), the image readout is read out from the image sensor 54 by an amount corresponding to the amount of rotation of the bending lens portions 50A and 50B. Tilt region 60. Using this as a reference, processing is repeated in order in the turning direction.

  Specifically, as shown in FIG. 22, the bent lens portions 50A and 50B are turned, and the same processing as in the seventh embodiment is performed on the subject to be imaged. At this time, since the distance to the subject can be calculated, the angle of view can also be obtained. Therefore, the number of times for obtaining a 360-degree connected image can be obtained. In the example of FIG. 22, a connected image can be obtained by rotating 6 times (3 times for the bent lens unit 50). In this case, images are taken in the order of images Pa1, Pa2, Pa3 in the bent lens portion 50A, and images are taken in the order of images Pb1, Pb2, Pb3 in the bent lens portion 50B. When this is connected, a connected image of 360 degrees is obtained (see FIG. 23).

  With reference to FIG. 24, an image processing routine of the eighth embodiment will be described. In addition, about the process same as the image processing routine of 7th Embodiment, the same code | symbol is attached | subjected and description is abbreviate | omitted and a different part is demonstrated hereafter.

  In steps 700 to 704, a through image is output (displayed), and in the next step 800, distance measurement is performed on a subject that is a reference target for photographing. In the next step 802, a turning angle serving as a reference for the subject to be positioned at the end of the angle of view at the measured position (distance) is obtained from the distance measurement result in step 800, and a 360-degree connected image is obtained. The number of repetitions (number of turns) is calculated. Next, in step 710, each of the bent lens portions 50A and 50B is rotated by a reference turning angle. Since the processing in step 710 is for confirmation, it can be omitted if confirmation is unnecessary.

  Next, in accordance with a shooting instruction (S2 operation), a captured image that is a left or right image is captured, rotated by a reference turning angle, an image reading area is determined from the reference turning angle, and the image sensor 54A is set in the image reading area 60. , 54B are repeatedly executed until the 360-degree connected image is obtained (steps 716 to 722).

  When all the turns are completed (Yes in step 804), the temporarily stored plural images are combined, displayed, and stored (steps 724 to 730). Although the synthesis adjustment processing (steps 728, 732, and 734) in FIG. 19 is omitted, it may be executed.

  As described above, according to the compound-eye digital camera of the present embodiment, it is possible to obtain an omnidirectional image without dividing the image by rotating only the bent lens portion a plurality of times. As a result, a wider wide-angle image, for example, a panoramic image can be obtained without complicated and large-scale apparatus calibration.

[Ninth Embodiment]
Next, a ninth embodiment will be described. Since the configuration of the compound-eye digital camera of the ninth embodiment is substantially the same as that of the fourth embodiment, the same parts are denoted by the same reference numerals, detailed description thereof will be omitted, and different parts will be described below.

  In the ninth embodiment, N (N is a natural number of 2 or more) imaging optical systems have different rotation angles between two or more imaging optical systems. That is, among the N imaging optical systems (N is a natural number of 2 or more), m (m is a natural number of N or less and 1 or more) imaging optical systems, the bending lens unit is rotated at the same or different rotation angle. It is something to let you. Here, in order to simplify the description, a case where the present invention is applied to the configuration of the compound-eye digital camera of the first embodiment will be described (N = 2, m = 1 or m = 2).

  FIG. 25 shows a state in which the bent lens portions 50A and 50B are rotated at different rotation angles (θa << θb) in the imaging units 6 of the imaging units 21A and 21B of the compound-eye digital camera 1 ( N = 2, m = 2). In FIG. 26, in the compound-eye digital camera 1, the imaging unit 6 of the imaging unit 21B is fixed, and the bending lens unit 50A of the imaging unit 6 of the imaging unit 21A is rotated to obtain a different rotation angle. (N = 2, m = 1).

  As shown in FIGS. 25 and 26, when the bending lens unit 50A of the photographing unit 21A or the bending lens unit 50A of the photographing unit 21A and the bending lens unit 50B of the photographing unit 21B are rotated, as described above, the imaging element 54 is used. The optical image of the upper subject rotates. Along with this rotation, the image reading area 60 is tilted and the size of the image reading area is changed so as to be within the initial reading area of the imaging element 54, thereby effectively using the image reading area of the imaging element 54. . However, when the rotation angles are different, the inclination of the reading area is different and the size of the reading area 60A is also different, so that the angle of view by the photographing units 21A and 21B is different. Therefore, in order to make the size of the angle of view by the imaging units 21A and 21B coincide with each other, in this embodiment, the size of the angle of view of at least one of the imaging units 21A and 21B is adjusted.

  First, in the case of N = 2 and m = 1, that is, as shown in FIG. 26, the bending lens unit 50B of the photographing unit 21B is fixed, and the bending lens unit 50A in the imaging unit 6 of the photographing unit 21A is rotatable. The case where it comprises is demonstrated.

  With reference to FIG. 27, an image processing routine of the ninth embodiment will be described. In addition, about the process same as the image processing routine of the said embodiment, the same code | symbol is attached | subjected and detailed description is abbreviate | omitted.

  When the power is turned on, the CPU 35 starts processing, and various settings including initial settings of the compound-eye digital camera 1 are performed in step 101. The processing at step 101 is the same processing as steps 100 and 102. The convergence angle G described above is set to an initial value G0, and whether or not the convergence angle is adjusted is set by reading an instruction such as a close-up shooting.

  In the next step 104, the left and right images obtained by irradiating the subject images onto the image sensors 54A and 54B are acquired by the photographing units 21A and 21B and output (displayed) as through images by the S1 operation. The through image may be displayed either selectively on the liquid crystal monitor 7 by selectively displaying either one of the photographing units 21A and 21B, for example, by alternately displaying the images through time division. Next, the distance from the compound-eye digital camera 1 to the subject to be imaged is measured (step 106).

  Next, in step 900, only the bent lens portion 50A is rotated so that the optical axis LA and the optical axis LB intersect at the measured position (step 106), and in the next step 902, the rotation angle θa is detected. To do. This detection of the rotation angle corresponds to the convergence angle detection. In the next step 904, an image reading area is determined from the detected rotation angle θa (step 902) in the same manner as in step 118. That is, when the bending lens unit is rotated, the subject image of the image sensor 54 rotates as described above. For this reason, the image reading area 60A of the image sensor 54 is rotated by the detected rotation angle θa of the bent lens portion 50A (see FIGS. 28B to 28D).

  Here, since only the bent lens portion 50A is rotated and only the image reading area 60A is rotated, a difference occurs in the angle of view of the left and right images. In order to obtain left and right images with the same angle of view, it is necessary to adjust the angle of view. The angle of view adjustment includes an optical adjustment method using a zoom mechanism and an electric adjustment method using a setting change of an image readout area. In this embodiment, it is assumed that a technique to be performed on the camera side is determined in advance.

  First, in step 906, it is determined whether or not optical adjustment by the zoom mechanism is to be performed by reading the setting. If fixed, the process proceeds to step 908, and if not, the process proceeds to step 914. In step 908, it is determined whether or not the zoom mechanism to be optically adjusted is on the fixed side (non-rotating side) of the bent lens unit.

  If the determination in step 908 is affirmative, in step 912, the zoom mechanism included in the imaging lens group 52B on the fixed side (non-rotating side) is adjusted. This adjustment is to enlarge or reduce the subject image to a size commensurate with the size of the image reading area 60A on the rotation side (step 904). For example, when the bending lens unit 50A is rotated, the image reading area 60A is adjusted within the image frame (edge line 56A) (see FIG. 28B). This is because the image reading area 60A becomes smaller in accordance with the rotation of the bent lens portion, and the angle of view of the image virtually changes to the tele side. Therefore, in step 912, the zoom mechanism included in the imaging lens group 52B on the fixed side (non-rotating side) is adjusted so that the angle of view changed by the rotation is obtained. As the driving amount of the zoom mechanism, the focal length obtained when the image reading area 60A is obtained can be used. By doing so, the angles of view match.

  FIG. 28B is an image diagram showing the adjustment process of the zoom mechanism in the photographing unit 21B. The detected rotation angle θa of the bending lens portion 50A is obtained, and the image reading area 60A of the image sensor 54 is rotated by the rotation angle θa of the bending lens portion 50A. Due to this rotation, the image reading area 60A protrudes from the image sensor 54A (the image reading area immediately after the rotation is expressed as 60Aa). Therefore, the image reading area 60A is enlarged or reduced so that the image reading area 60A fits on the image sensor 54A. At this stage, the angle of view is different between the left image by the image reading area 60A on the image sensor 54A and the right image by the image reading area 60B on the image sensor 54B. In order to make this coincide, the zoom mechanism included in the imaging lens group 52B on the fixed side (non-rotating side) is adjusted so that the angle of view changes as a result of being rotated. In other words, the angle of view is adjusted to the tele side so that the image frame is enlarged from the image frame 56B (the image frame before zoom mechanism adjustment is described as 56Ba) that matches the image reading area 60B.

  On the other hand, when the result in step 908 is negative, in step 910, the zoom mechanism included in the imaging lens group 52A on the rotation side is adjusted. In this adjustment, the subject image is enlarged or reduced by adjusting a zoom mechanism included in the imaging lens group 52A of the rotated bent lens unit 50A. That is, the subject image is enlarged or reduced (reduced in FIG. 28) so that the angle of view before the rotation matches the angle of view of the image read in the image reading area 60A after the rotation. By doing so, the angles of view match.

  FIG. 28C is an image diagram showing the adjustment process of the zoom mechanism in the photographing unit 21A. The detected rotation angle θa of the bending lens portion 50A is obtained, and the image reading area 60A of the image sensor 54 is rotated by the rotation angle θa of the bending lens portion 50A. The image reading area 60A is enlarged or reduced so that the image reading area 60A protruding by this rotation fits on the image sensor 54A, and the zoom mechanism is adjusted so that the image has a size suitable for the image reading area 60A. . In other words, the angle of view is adjusted to the wide side so that the image frame is enlarged from the image frame 56A (the image frame after zoom mechanism adjustment is represented as 56Ab) that matches the image reading area 60A.

  Next, when electrical adjustment is performed instead of optical adjustment (or when adjustment is not necessary), the result is negative in step 906, and whether or not the electrical adjustment is performed by reading the setting in step 914. If the result is fixed, the process proceeds to step 916. If the result is negative, the process proceeds to step 110 without performing adjustment.

  If the determination in step 914 is affirmative, in step 916, the size of the image reading area 60B on the fixed side (non-rotating side) is adjusted. In this adjustment, the size of the image reading area 60B on the fixed side (non-rotating side) is adjusted to a size commensurate with the size of the image reading area 60A on the rotation side (step 904). That is, since the image reading area 60A is reduced by the rotation of the bending lens portion 50A, the image reading area 60B is adjusted so as to coincide with the image reading area 60A. By doing so, the angles of view match.

  FIG. 28D is an image diagram illustrating a process of adjusting the image reading area 60 in the photographing unit 21B. The image reading area 60A is rotated by the detected rotation angle θa of the bent lens portion 50A, and the image reading area 60A becomes smaller. Therefore, the adjusted image reading area 60A and the image reading area 60B are matched (the image reading area immediately before the adjustment is expressed as 60Ba). The adjustment of the image reading area 60B corresponds to an electric zoom mechanism. That is, it corresponds to virtually adjusting the angle of view by enlarging or reducing the image reading area 60B. The example of FIG. 28D corresponds to adjusting the angle of view to the tele side.

  The above processing is executed until the in-focus area is determined. When the in-focus area is in focus, an affirmative decision is made in step 110, and an imaging instruction by the S2 operation is awaited. Next, in step 112, it is detected that the S2 operation has been performed by reading the signal of the release button 2, and in step 113, the photographing process is executed. The processing of step 113 is the same processing as steps 114 to 120. The left and right images from the image sensors 54A and 54B are taken in, an image reading area is determined according to the rotation angle (convergence angle), and the image reading area Images are read from each of the image sensors 54A and 54B, temporarily stored, synthesized (step 122), and displayed (step 124). These processes are to generate a stereoscopic image from the temporarily stored left and right images and to display the stereoscopic image on the monitor 7.

  Next, a case where N = 2 and m = 2, that is, a case where the bent lens portions 50A and 50B are configured to be rotatable and the rotation angles are different as shown in FIG. 25 will be described. When the bent lens portions 50A and 50B are rotated with different rotation angles, the inclination of the image reading area is relatively different and the size is relatively different between the left and right images. What is necessary is just to process like the above. In addition, a reference angle of view included in the left and right images may be determined in advance, and may be adjusted to match this reference angle of view.

  Next, among the N (N is a natural number of 2 or more) imaging optical systems, the bending lens portions of the m imaging optical systems (m is a natural number of 1 or more and N or less) are rotated at the same or different rotation angles. The case where it moves is demonstrated. In this case, by designating one set from among the N imaging optical systems, performing adjustment in units of one set of bent lens portions described in the above compound eye digital camera, and repeating this up to N, The angle of view can be matched.

  As described above, according to the compound-eye digital camera of the present embodiment, it is possible to obtain an image with the same angle of view even if there is a difference in the rotation angle of the bent lens unit. As a result, a plurality of images having the same appearance can be obtained without complicated and large-scale apparatus calibration.

  In the present embodiment, for example, a case has been described in which both eyes of a compound-eye digital camera are rotatably provided, but the present invention is not limited to this. At least one of the bent lens portions may be rotatably provided, and the other may be fixedly installed. It is of course possible to provide a plurality of pivotable bent lens parts and handle any bent lens in the same way as a fixedly installed bent lens. You may make it use in combination with a flexible lens part.

[Tenth embodiment]
Next, a tenth embodiment will be described. Since the configuration of the tenth embodiment is substantially the same as that of the above embodiment, the same parts are denoted by the same reference numerals and detailed description thereof is omitted.

  In the above-described embodiment, the case has been described in which the image reading area to be read from the imaging element is set and the image reading area is tilted (rotated) by an amount corresponding to the amount of rotation of the bent lens unit. In this embodiment, instead of setting and reading an image reading area to be read from the image sensor, all pixels in the effective pixel area of the image sensor are read, and an image cutout area is set for an image composed of all the read pixels. Then, the image cutout region is cut out from the read image consisting of all pixels to obtain an image.

  FIG. 29 is an explanatory diagram of a process of cutting out an image formed by reading all pixels from the image sensor in the photographing unit 21A to form an image. 29 is an image diagram viewed from the back surface of the image sensor 54A, and the left column portion is an image diagram showing an image formed by the image sensor 54A.

  In photographing with an initial rotation angle, the vertical axis JA of the subject image is parallel to the vertical direction of the image, as shown in FIG. Therefore, the image frame 56A of the light flux reaches the image pickup device 54A via the bent lens portion 50A, and the orientation of the left image 58A read from the image pickup device 54A coincides. As shown in FIG. 29B, when the bending lens portion 50A is rotated, the image frame 56A is rotated with respect to the imaging element 54A. In the present embodiment, all the pixels are read from the image sensor 54A, and a left image 58A including all the read pixels is obtained. The left image 58A is rotated (the vertical axis JA of the subject image is inclined). Then, in order to adjust the rotation of the left image 58A in which the subject image has been rotated, as shown in FIG. 29C, an image cutout area 63A corresponding to the above-described image readout area 60A is set on the left image 58A. . An image is cut out from the left image 58A for the set image cut-out region, and a final left image 59A is obtained as shown in FIG. It should be noted that the process of extracting an image from the captured image in the set image clipping region is appropriately performed, and may be performed on the image signal for each pixel output from the imaging unit, or after the image signal is A / D converted. May be performed on the image signal, and is preferably performed before the compression processing by the compression / decompression processing unit 24 described above.

  In this way, the image cutout area 63A is set, an image is cut out from the image 58A composed of all pixels in the set image cutout area, and an image obtained by adjusting the image rotated by rotation is obtained. These processes can be replaced with a process of setting an image reading area in the imaging device of the above-described embodiment, rotating the image reading area in accordance with the rotation of the bending lens unit, and reading and obtaining an image.

  As described above, according to the present embodiment, all the pixels are read from the image sensor, and the image is extracted from the image clip region in the image clip region and the rotation-adjusted image is obtained. Control can be simplified and the load on the image sensor can be reduced. In addition, since the image can be easily cut out by image processing, it can be realized with a simple configuration without significantly changing the conventional apparatus configuration.

  In this embodiment, all the pixels in the effective pixel area of the image sensor are read out, an image cutout area is set for an image made up of all the read out pixels, and the image cutout area is cut out from the image made up of all read out pixels. And get an image. For this reason, the application of the reference edge is different from the case of reading an image from the image sensor as in the second embodiment. That is, instead of detecting the tilt from the edge of the image on the image sensor 54, the tilt is detected from an image obtained by reading all the pixels in the effective pixel area of the image sensor. That is, when an image cutout region is set to an image composed of all pixels read from the image sensor and the image cutout region is cut out to obtain an image, the frame of the acquired picked-up image is used as a reference end (reference edge) in advance. Set it up. By doing so, the inclination can be easily obtained from the angle formed by the reference line by the reference edge and the edge line of the irradiation light region of the optical image of the subject.

[Eleventh embodiment]
Next, an eleventh embodiment will be described. Since the configuration of the eleventh embodiment is substantially the same as the above embodiment, the same parts are denoted by the same reference numerals and detailed description thereof is omitted.

  In the above embodiment, the case where the image pickup unit is provided for each image pickup unit has been described, but the present invention is not limited to this. In the present embodiment, a case where a single image sensor includes a plurality of imaging optical systems will be described.

  FIG. 30 is a schematic diagram showing a configuration around the imaging unit 6 in the compound-eye digital camera of the present embodiment. 30A is a top view of the imaging unit, FIG. 30B is a rear view, and FIG. 30C is a conceptual diagram showing a modification of image division described later.

  As illustrated in FIGS. 30A and 30B, a multiplexing unit 70 is provided between the left and right imaging units 6 and a single imaging element 54. The multiplexing unit 70 is based on a region separation method, and includes reflection mirrors 72 and 74 and a prism 76. The multiplexing unit 70 reflects the light beam from the bent lens unit 50A in the order of the reflection mirror 72 and the prism 76, and guides it to the bent lens unit 50A side (left side) of the image sensor 54. Similarly, the multiplexing unit 70 reflects the light beam from the bent lens unit 50B in the order of the reflection mirror 74 and the prism 76, and guides it to the bent lens unit 50B side (right side) of the image sensor 54. Thereby, the light flux propagated through each imaging unit 6 provided in each of the imaging units 21A and 21B is separated into the right side and the left side of the single imaging element 54 and converged.

  A single image sensor 54 projects a light beam for forming a left image and a right image. Therefore, the left image and the right image can be obtained independently by setting the left portion of the image sensor 54 as the left image and the right portion of the image sensor 54 as the right image. This image separation may be performed by setting and reading out an image reading region in the image sensor 54, or may be performed by reading out all pixels of the image sensor 54 and cutting out the image.

  As shown in FIG. 30C, there is a time division method as another example of image separation. In this case, a multiplexing prism 77 is used instead of the prism 76. The combining prism 77 combines the light flux from the bent lens portion 50A and the light flux from the bent lens portion 50B with substantially the same optical axis and converges the light into the single image sensor 54. Further, the multiplexing prism 77 can selectively switch the light beam directed to the image sensor 54 to the light beam from the bending lens unit 50A or the light beam from the bending lens unit 50B by a control signal from the switch 78. This switching element can be realized by a liquid crystal shutter, for example.

  Therefore, the light beam for forming the left image and the right image can be alternately projected onto the single image sensor 54 by the control signal from the switch 78. As a control signal by the switch 78, an image formed by pixels from the image sensor 54 can be set as a left image or a right image. In this case as well, separation may be performed by setting and reading an image reading area in the image sensor 54, or may be performed by reading out all pixels of the image sensor 54 and cutting out the image.

  As described above, according to the compound-eye digital camera of this embodiment, a single imaging device can be used, and a plurality of imaging optical systems can be configured with simple optical elements and electrical elements.

  In each of the above-described embodiments, the case where the bending lens unit is rotated about the optical axis toward the image sensor as the central axis has been described, but the optical axis itself toward the image sensor is inclined (so-called tilt function). It may be used for performing. This tilt function effectively functions to compensate for image misalignment associated with image rotation caused by the above-described rotation.

  Note that the image processing routine of each of the above embodiments may be programmed and executed by the CPU.

DESCRIPTION OF SYMBOLS 1 ... Compound eye digital camera 6 ... Imaging unit 7 ... Liquid crystal monitor 31 ... Rotation control part 33 ... Angle sensor 35 ... CPU
DESCRIPTION OF SYMBOLS 50 ... Bending lens part 51 ... Rotation drive part 52 ... Imaging lens group 53 ... Lens barrel 54 ... Imaging element 55 ... Housing 60 ... Image reading area

Claims (19)

A plurality of imaging optical systems each including an imaging element fixed to a main body and a bent lens portion that bends light from a subject toward the imaging element, and irradiates light from the subject toward the imaging element; An imaging optical system having at least one of a plurality of imaging optical systems, the imaging optical system provided with the bent lens portion so as to be rotatable about the optical axis of the light receiving surface of the imaging element;
Detecting means for detecting an inclination angle of a light receiving surface of the imaging element of an optical image of a subject irradiated to the imaging element when the bending lens unit is rotated;
Based on the detection result of the detection means, the adjustment means for tilting the image area for reading an image from the image sensor and adjusting the size of the image area so as to be within the image sensor;
An imaging apparatus comprising: A plurality of imaging optical systems each including an imaging element fixed to a main body and a bent lens portion that bends light from a subject toward the imaging element, and irradiates light from the subject toward the imaging element; An imaging optical system having at least one of a plurality of imaging optical systems, the imaging optical system provided with the bent lens portion so as to be rotatable about the optical axis of the light receiving surface of the imaging element;
Detecting means for detecting an inclination angle of a light receiving surface of the imaging element of an optical image of a subject irradiated to the imaging element when the bending lens unit is rotated;
Obtaining means for obtaining a captured image based on an image signal output from the image sensor;
An adjustment unit that tilts an image area for cutting out the image with respect to the acquired captured image based on a detection result of the detection unit and adjusts a size of the image region so that the image area fits in a frame of the captured image; ,
An imaging apparatus comprising:   The imaging device fixed to the main body is a single imaging device, and the plurality of imaging optical systems irradiate light from a subject toward the single imaging device. Item 3. The imaging device according to Item 2.   The imaging unit according to any one of claims 1 to 3, wherein the detection unit detects an angle at which the bent lens unit is rotated about an optical axis on a light receiving surface of the imaging element. apparatus.   The said detection means detects the angle of the edge line of the irradiation light area | region of the optical image of the to-be-photographed object to the said image pick-up element, and a reference line, when the said bending lens part rotates. Item 5. The imaging device according to any one of Item 4. The imaging unit includes an angle-of-view changing unit that changes an angle of view of the imaging unit by changing a focal length of the imaging optical system to at least a rotation-side imaging optical system in which the bent lens unit is rotated.
The adjusting means is characterized in that the angle of view of the imaging optical system on the rotation side is changed so that an image tilted by the rotation falls within an effective pixel area on the image sensor. The imaging device according to any one of claims 1 to 5. The imaging unit includes an angle-of-view changing unit that changes an angle of view of the imaging unit by changing a focal length of the imaging optical system to at least a non-rotating imaging optical system in which the bent lens unit is not rotated. Equipped,
The adjustment means further changes the angle of view of the imaging optical system on the non-rotation side where the bending lens portion is not rotated based on the angle of view with respect to the image tilted by the rotation. The imaging device according to any one of claims 1 to 6.   The adjusting means further changes the size of the image area on the non-rotating side where the bent lens portion is not rotated based on an angle of view with respect to an image tilted by the rotation. The imaging device according to claim 7.   The adjustment means adjusts the size of the image area by associating the number of pixels of an image sensor in which a plurality of vertical and horizontal pixels are arranged as the image area and adjusting the number of pixels of the image sensor. The imaging device according to any one of claims 1 to 8.   The imaging apparatus according to claim 9, further comprising notification means for notifying a resolution or a focal length corresponding to the number of pixels adjusted by the adjustment means.   The imaging device according to claim 1, further comprising a warning unit that warns when an adjustment result in the adjustment unit exceeds a predetermined adjustment amount.   The imaging apparatus according to claim 1, further comprising an image output unit that outputs an image determined by an image region adjusted by the adjustment unit.   The at least two of the imaging optical systems further include a rotation control unit that rotates the bent lens unit so that a part of the subject image irradiated on the imaging element overlaps or is connected. The imaging device according to any one of claims 1 to 12.   The imaging apparatus according to claim 13, wherein the rotation control unit rotates the bent lens unit a plurality of times to instruct imaging.   With respect to an image obtained by a plurality of imaging optical systems of the imaging means, any one of a plurality of images photographed synchronously from a plurality of viewpoints is acquired as a reference image, and an image different from the reference image is parallaxed The imaging apparatus according to claim 1, further comprising a creation unit that creates a stereoscopic image obtained from the reference image and the parallax image as an image. A plurality of imaging optical systems each including an imaging element fixed to a main body and a bent lens portion that bends light from a subject toward the imaging element, and irradiates light from the subject toward the imaging element; An imaging control method for an imaging apparatus, comprising: an imaging optical system in which at least one of a plurality of imaging optical systems is provided with the bent lens portion pivotable about an optical axis on a light receiving surface of the imaging element. ,
A detection step of detecting an inclination angle of a light receiving surface of the imaging element of an optical image of a subject irradiated on the imaging element when the bending lens unit is rotated;
An adjustment step of tilting an image area for reading an image from the image sensor based on a detection result of the detection unit and adjusting a size of the image area so as to be within the image sensor;
An imaging control method including: A plurality of imaging optical systems each including an imaging element fixed to a main body and a bent lens portion that bends light from a subject toward the imaging element, and irradiates light from the subject toward the imaging element; An imaging control method for an imaging apparatus, comprising: an imaging optical system in which at least one of a plurality of imaging optical systems is provided with the bent lens portion pivotable about an optical axis on a light receiving surface of the imaging element. ,
A step of detecting an inclination angle on a light receiving surface of the imaging element of an optical image of a subject irradiated on the imaging element when the bending lens unit is rotated;
An acquisition step of acquiring a captured image based on an image signal output from the image sensor;
An adjustment step of tilting an image area for cutting out the image with respect to the acquired captured image based on a detection result of the detection unit, and adjusting a size of the image area so as to be within a frame of the captured image; ,
An imaging control method including: A plurality of imaging optical systems each including an imaging element fixed to a main body and a bent lens portion that bends light from a subject toward the imaging element, and irradiates light from the subject toward the imaging element; An imaging control program for an imaging apparatus, comprising: an imaging optical system in which at least one of a plurality of imaging optical systems is provided with the bent lens portion pivotable about an optical axis on a light receiving surface of the imaging element. ,
A detection step of detecting an inclination angle of a light receiving surface of the imaging element of an optical image of a subject irradiated on the imaging element when the bending lens unit is rotated;
An adjustment step of tilting an image area for reading an image from the image sensor based on a detection result of the detection unit and adjusting a size of the image area so as to be within the image sensor;
An imaging control program for causing a computer to execute. A plurality of imaging optical systems each including an imaging element fixed to a main body and a bent lens portion that bends light from a subject toward the imaging element, and irradiates light from the subject toward the imaging element; An imaging control program for an imaging apparatus, comprising: an imaging optical system in which at least one of a plurality of imaging optical systems is provided with the bent lens portion pivotable about an optical axis on a light receiving surface of the imaging element. ,
A step of detecting an inclination angle of a light receiving surface of the imaging element of an optical image of a subject irradiated on the imaging element when the bending lens unit is rotated;
An acquisition step of acquiring a captured image based on an image signal output from the image sensor;
An adjustment step of tilting an image region for cutting out the image with respect to the acquired captured image and adjusting the size of the image region so as to be within the frame of the captured image based on the detection result of the detection unit; ,
An imaging control program for causing a computer to execute.

Images