JP2010130196A - Photographing apparatus and method of processing signal - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a photographing apparatus capable of taking an image with different photographing magnification from each of a plurality of photographing parts so as to have a good image quality, of equalizing white balance of each image taken by each photographing part, and of reflecting an object field condition more properly. <P>SOLUTION: A focal length of each photographing optical system provided in a first photographing part 1A and a second photographing part 1B is set to be different from each other. An inner digital signal processor adjusts white balance based on an image signal representing an image captured by the second photographing part 1B on a wide-angle side whose focal length is adjusted to be relatively small. The white balance is applied to an image signal of the first photographing part side. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an imaging device that includes a plurality of imaging units, and that each of the plurality of imaging units captures an object located at substantially the same place, and a signal processing method for image signals in the imaging device.

  Patent Document 1 discloses a technique in which a subject that cannot be photographed at one time, for example, a moving body such as a train, is photographed a plurality of times, and overlapping portions of the photographed images at each time are joined to form a single image. Has been. Japanese Patent Application Laid-Open No. 2004-228688 discloses a technique for matching the white balance of a composite image by joining images at each shooting time so that the luminance difference / chromaticity difference between overlapping images at each shooting time is minimized.

  In this way, when images are taken continuously a plurality of times and overlapping portions of the photographed images are joined, a process for joining the overlapping portions is required so that the difference in white balance between the photographing times is minimized.

  By the way, recently, an imaging apparatus including a plurality of imaging units has been proposed (see, for example, Patent Document 2). In the photographing apparatus including the plurality of photographing units, the same subject can be photographed at different photographing magnifications at a time. In this way, if the same subject can be photographed at a different magnification at the same time by each of the plurality of photographing units, both of the photographing units can shoot at the same time. The advantage is that it is easy to adjust the white balance of the image.

  However, in the video camera of Patent Document 2, a signal processing unit that receives image signals from the first imaging unit and the second imaging unit and performs signal processing is shared, and the signal processing unit in the shared signal processing unit Synchronized with the gain of each color (R color, G color, B color) amplifier (hereinafter referred to as white balance gain) for white balance adjustment being switched between the first photographing unit and the second photographing unit. Therefore, since the configuration is fixedly set, the white balance of the image signals generated by the two photographing units may be different and may not reflect the state of the object scene.

  Further, in Patent Document 2, since a predetermined zoom magnification is configured by combining both photographing units in order to reduce the size of the photographing device, one photographing unit can only photograph at a photographing magnification according to the telephoto side. On the other hand, the other photographing unit can only shoot at the photographing magnification on the wide angle side.

In Patent Document 3, an optical system having a distortion aberration characteristic of enlarging the central part and compressing the peripheral part is used, and further, interpolation processing is performed by a signal processing unit at a later stage, so that the maximum focal length (so-called telephoto) is obtained. And a minimum focal length (so-called wide angle) have been proposed (see Patent Document 3). When using the imaging device of this Patent Document 3, it is possible to acquire a telephoto and wide-angle image at a time, but because of the use of a special lens, the image quality of both an image captured at a telephoto and an image captured at a wide-angle is both There is a problem that both deteriorate.
Japanese Patent Laid-Open No. 05-122606 Japanese Patent Laid-Open No. 05-110939 JP 2007-96588 A

  In view of the above circumstances, the present invention can shoot images with different shooting magnifications with a good image quality in each of a plurality of shooting units, and further make the white balance of each image shot by each shooting unit the same and It is an object of the present invention to provide a photographing apparatus that can more appropriately reflect the situation of the field of view.

A plurality of imaging optical systems, each of which is adjustable in focal length and adjusted to different focal lengths, and a plurality of images received by subject light formed by each of the plurality of imaging optical systems. A plurality of imaging units each having a plurality of imaging elements for generating signals;
A signal processing unit that performs white balance adjustment processing on the image signals generated by each of the plurality of imaging elements,
The signal processing unit is based on an image signal obtained by an imaging element that receives subject light imaged by an imaging optical system in which a focal length of the plurality of imaging optical systems is adjusted to be relatively small. A white balance gain is calculated, and the calculated white balance gain is applied to white balance adjustment processing of a plurality of image signals obtained by each of the plurality of imaging elements.

  According to the photographing apparatus of the present invention, a plurality of photographing optical systems that are adjustable in focal length and adjusted to different focal lengths, and a subject is imaged by each of the plurality of photographing optical systems. A plurality of imaging units having a plurality of imaging elements that respectively receive the subject light and generate a plurality of image signals are provided, and the focal lengths of the plurality of imaging units are adjusted independently of each other. For this reason, the focal length of each of the plurality of photographing units, in other words, the photographing magnification is set without being restricted by each other. Further, since the first photographing unit and the second photographing unit perform photographing independently, an image with good image quality can be obtained in both cases.

  Further, based on the image signal obtained by the imaging element that receives the subject light imaged by the imaging optical system in which the focal length of the plurality of imaging optical systems is adjusted to be relatively small by the signal processing unit. The white balance gain is calculated, and the white balance gain is also applied to the image signal obtained by the image sensor that receives the subject light imaged by the photographing optical system adjusted to other focal length. The white balance of the signal is adjusted.

  The white balance of the image changes depending on the type of illumination light source, for example, whether the illumination is the sun, an incandescent lamp, or a fluorescent lamp. Therefore, the focal length is relatively small as in the signal processing unit. When the light source type that is illuminating the image is identified from the so-called wide-angle image that has been adjusted, and the light source type is applied to the so-called telephoto image that has a longer focal length than the wide-angle image, Even if the subject captured by the long-distance shooting part is filled with flowers that contain a lot of red, the situation of the object scene (that is, the type of light source) is appropriately reflected and is the same as the color of the wide-angle image A color image is also obtained in the telephoto image.

  Here, it is preferable that the plurality of photographing optical systems are arranged side by side so as to include the same subject within the angle of view.

  Then, when the focal lengths of the two imaging units are equal, the left eye image signal and the right eye image signal for a stereoscopic image are respectively generated by both imaging units, and the focal lengths are different. An image signal of a wide-angle image and a telephoto image including the same subject can be obtained.

  It is preferable that an imaging instruction unit for instructing imaging is provided, and the plurality of imaging units perform imaging simultaneously upon receiving one imaging instruction from the imaging instruction unit.

  If it does so, the imaging | photography of the several image according to several imaging | photography part can be performed simultaneously. In addition, it is not necessary to perform the process of adjusting the white balance as in Patent Document 1 in consideration of the change in white balance with time.

  In addition, it is preferable to have initialization means for adjusting the focal lengths of the plurality of photographing optical systems to different focal lengths when the photographing apparatus is powered on.

  Then, even if the focal length is adjusted by the user's operation, in the initial state, the user captures the subjects captured by both of the imaging units at different focal lengths without an operation of changing the focal length. With the above configuration, the user can confirm the subject captured by both shooting units on the display screen, for example, and if he / she thinks the shooting magnification is too different, the user can freely adjust his / her favorite shooting magnification by operation. Can do.

The signal processing method of the present invention that achieves the above object includes a plurality of photographing optical systems each capable of adjusting a focal length and adjusted to different focal lengths, and a subject connected by each of the plurality of photographing optical systems. A signal processing method in a photographing apparatus including a plurality of photographing units each having a plurality of photographing elements that receive imaged subject light and generate a plurality of image signals, respectively.
A white balance gain is calculated based on an image signal obtained by a photographing element that receives subject light imaged by a photographing optical system in which a focal length is adjusted to be relatively small among the plurality of photographing optical systems. A calculation step;
An adjustment step of adjusting the white balance of each of the plurality of image signals by applying the white balance gain calculated in the calculation step to the plurality of image signals obtained by each of the plurality of imaging elements. And

  According to the signal processing method of the present invention, in the first step, an image photographed by a so-called wide-angle photographing unit in which the focal length of both photographing units is adjusted to be relatively small. The white balance gain is calculated based on the signal, and the white signal is also obtained for the image signal captured by the photographing unit set on the so-called telephoto side, which is adjusted to a focal length longer than the focal length in the second step. The balance gain is applied and white balance adjustment is performed.

  In other words, whether the illumination light is the sun, a fluorescent lamp, or an incandescent lamp is identified based on the image signal generated by the photographing unit whose focal length is adjusted to be relatively small, and its light source type The white balance gain representing the light source type is set in the first step, and in the second step, the white balance gain representing the light source type is set in the image signal representing the image photographed at the telephoto. Done.

  As described above, it is possible to shoot images with different shooting magnifications with good image quality in each of the plurality of shooting units, and to make the white balance of each image shot in each shooting unit the same, and An imaging apparatus capable of reflecting the situation more appropriately is realized.

  Embodiments of the present invention will be described below.

  FIG. 1 is a diagram illustrating a photographing apparatus according to an embodiment of the present invention.

  FIG. 1A shows a perspective view of the photographing apparatus 1 as viewed obliquely from above. FIG. 1B shows a view of the photographing apparatus 1 of FIG.

  The photographing apparatus 1 shown in FIG. 1A includes two photographing units 1A and 1B. Hereinafter, the two photographing units will be described as the first photographing unit 1A and the second photographing unit 1B.

  The first photographing unit 1A and the second photographing unit 1B are arranged side by side so as to be able to generate an image signal for stereoscopic viewing. These photographing units 1A and 1B are for the right eye. An image signal for the left eye is generated. When the power switch 10A on the upper surface of the photographing apparatus 1 in FIG. 1 is operated and a mode switch described later is set to a mode called, for example, a stereoscopic mode, and the shutter button 10C is operated, the photographing magnifications of the photographing units 1A and 1B are mutually The image data for stereoscopic viewing is generated by both the photographing units 1A and 1B.

  In addition, the photographing apparatus 1 of the present embodiment is equipped with a mode called an independent mode in which both the photographing units 1A and 1B perform photographing individually with respect to the stereoscopic mode, and this independent mode is selected. Then, both the imaging units 1A are configured to capture the subject at different imaging magnifications. When the power switch 10A is operated in a state where the independent mode is set, the photographing magnifications of both the photographing units 1A and 1B are the telephoto TELE having the maximum focal length and the wide angle Wide having the minimum focal length, respectively. Automatically set. As is well known, the photographing magnification corresponds to the focal length of the photographing optical system. Accordingly, in the following description, the photographing magnification and the focal point are appropriately selected so that the explanation at that time can be easily understood. Select and explain the word distance.

  The shutter button 10C provided in the photographing apparatus 1 of this embodiment has two operation modes of half-pressing and full-pressing. In this photographing apparatus 1, when the shutter button 10C is half-pressed, exposure adjustment and Focus adjustment is performed, and shooting is performed when the button is fully pressed. Further, a flash light emission window WD for emitting a flash toward the subject when the field luminance is dark is provided above the photographing unit 1B.

  Further, as shown in FIG. 1B, a liquid crystal monitor DISP capable of three-dimensional display is provided on the back of the photographing apparatus 1, and when the mode switch 10G is set to the stereoscopic mode, the liquid crystal monitor DISP is displayed on the liquid crystal monitor DISP. The same subject captured by both photographing units 1A and 1B is displayed as a stereoscopic image.

  Further, when the mode switch 10G is set to the independent mode, the first and second photographing units perform photographing at different photographing magnifications. For example, the images captured by both of the photographing units 1A and 1B are divided into two screens and displayed on the display screen, or one is displayed on the entire display screen and the other is displayed on the display screen.

  In the present embodiment, when the mode switch 10G is operated and the independent mode is set, if the zoom switch 10D is operated in a state where the lens changeover switch 10H is tilted to the lens 1 side, the shooting of the first shooting unit 1A is performed. When the magnification is adjusted and the lens switch 10H is tilted to the lens 2 side and the zoom switch 10D is operated, the photographing magnification of the second photographing unit 1B is adjusted. In this way, the photographing process in the independent mode is performed, and an image with the photographing magnification captured by both photographing units is divided and displayed on the display screen. Thereafter, the shutter button 10C is operated, so that shooting at two different shooting magnifications is performed simultaneously.

  In addition to the zoom switch 10D and the menu / OK button 10E, a cross key 10F and the like are also provided on the back. Hereinafter, the power switch 10A, the shutter button 10B, the mode dial 10C, the zoom switch 10D, the menu / OK button 10E, the cross key 10F, the mode switch 10G, the lens switch 10H, and the like are collectively referred to as the operation unit 10. There is.

  FIG. 2 is a block diagram showing an internal configuration of the photographing apparatus 1 of FIG.

  With reference to FIG. 2, the internal structure of the imaging device 1 will be described.

  The operation of the photographing apparatus 1 is controlled by the CPU 100 in a centralized manner.

  A ROM 101 is connected to the CPU 100 via a bus Bus, and a program necessary for the operation of the photographing apparatus 1 is stored in the ROM 101. The CPU 100 comprehensively controls the operation of the photographing apparatus 1 in accordance with the procedure of this program.

  Note that the flash ROM 102 stores calculation constants and the like necessary when the DSPs constituting the AF detection unit 120, the AWB detection unit 130, the digital signal processing unit 116, and the like perform calculations.

  First, when the power switch 10A in the operation unit 10 shown in FIG. 1 is operated, the CPU 100 controls a power control unit (not shown) to supply power from the battery to each unit in FIG. 2 through the power control unit. The photographing apparatus 1 is shifted to an operating state. Thus, the CPU 100 starts shooting processing. The AF detection unit 120, the AE / AWB detection unit 130, the image input controller 114A, and the digital signal processing unit 116 are configured by a processor such as a DSP (Digital Signal Processor), and the CPU 100 cooperates with the DSP. Suppose that the process is executed. Further, it is assumed that the display control unit 119 and the liquid crystal monitor DISP are configured by an LCD (Liquid Crystal Display).

  Here, the internal configuration of the first imaging unit 1A and the second imaging unit 1B described above with reference to FIG. 1 will be described with reference to FIG. It should be noted that each constituent member of the first photographing unit 1A is described with the word “first”, and each constituent member of the second photographing unit 1B is described with the word “second”.

  The first photographing unit 1A adjusts the relative distance between the first photographing optical system 110A constituting a zoom lens with adjustable focal length and the plurality of lenses constituting the first photographing optical system 110A. The first lens driving unit 103A that moves the focus lens in the photographing optical system in the optical axis direction, and the subject light formed by the first photographing optical system to receive the subject light. A first image sensor (hereinafter referred to as a CCD since a CCD solid-state image sensor is used) 111A for generating an image signal to be represented is provided.

  In addition, the first photographing optical system 110A is provided with a first diaphragm IA and a mechanical shutter SHA. The first diaphragm driver 104A and the first diaphragm driver 104A for changing the aperture diameter of the first diaphragm IA are provided. A first shutter control unit 105A that controls opening and closing of the mechanical shutter SHA and a CCD control unit 106A that sets an electronic shutter for the CCD are provided.

  The second imaging unit 1B has the same configuration as the first imaging unit 1A, and the second imaging optical system 110B, the second lens driving unit 104B, and the subject that are zoom lenses are the second imaging optical system. A second CCD 111B or the like is provided which receives subject light formed as an image and generates an image signal representing the subject.

  The zoom magnification of the first imaging optical system 110A and the zoom magnification of the second imaging optical system 110B are the same. When the mode switch 10G is set to the independent mode, both the imaging units 1A and 1B are used. Is configured such that the photographing magnification of the photographing optical system included in is separately set within the zoom magnification by the operation of the lens switching switch 10G and the zoom switch 10D. This will be described later. Also, in FIG. 2, one lens LA and LB schematically shows that the photographing optical systems 110A and 110B are zoom lenses and have focus lenses. The lens changeover switch 10H of FIG. 2 should be originally included in the operation unit 10, but only the lens changeover switch 10H is illustrated separately from the operation unit 10 because it is a feature of the present invention.

  Here, the power switch 10A is turned on while the mode switch 10G shown in FIG. 1B is tilted to the independent mode side, and the first imaging unit 1A and the second imaging unit 1B have the maximum initial values. A photographing operation after the focal length (telephoto) and the minimum focal length (wide angle) are set will be described.

  The first photographing unit 1A and the second photographing unit 1B have the same configuration except that both photographing optical systems are adjusted to different focal lengths to generate different image signals. Then, the first A / D converter 113A and the second A / D converter 113B convert the image signals of both photographing units into digital signals, and the first and second image input controllers 114A and 114B in the subsequent stage. Since the processing after being guided to the bus Bus is exactly the same except for the white balance processing performed in the digital signal processing unit, the image of the second photographing unit 1B in which the focal length is adjusted to be relatively small. The configuration will be described along the signal flow.

  First, the operation when the subject captured by the second photographing unit 1B is directly displayed on the liquid crystal monitor DISP as a through image will be described with reference to FIG.

  In response to the operation of the power switch 10A in the operation unit 10, the CPU 100 controls a power supply control unit (not shown) to supply power from the battery to each unit to shift the photographing apparatus 1 to the operating state.

  First, the CPU 100 controls the lens driving unit 103B and the aperture driving unit 104B to start adjusting exposure and focus. Further, the CCD control unit 106B is instructed to set the electronic shutter in the CCD 111B, and for example, the image signal is output from the CCD 111B to the first analog signal processing unit 112B every 1/60 seconds. At this time, the mechanical shutter SHB is opened under the control of the shutter control unit 105B.

  In the analog signal processing unit 112B, the timing signal is supplied from the CCD control unit 106A, the image signal is supplied every 1/60 seconds from the CCD 111B, noise reduction processing, etc. are performed, and noise reduction processing is performed. The analog image signal thus obtained is supplied to the A / D converter 113B at the next stage. Also in the A / D converter 113B, an analog image signal is converted into a digital image signal every 1/60 seconds in synchronization with the timing signal from the CCD controller 106B. The digital image signal thus converted and output by the A / D converter 113B is guided to the bus Bus every 1/60 seconds by the image input controller 114B, and the image signal guided to the bus Bus is stored in the RAM 115. The Since an image signal is output from the CCD 111B every 1/60 seconds, the contents of the RAM 115 are rewritten every 1/60.

  The image signals stored in the RAM 115 are read out every 1/60 by the DSP constituting the AF detection unit 120, the AE / AWB detection unit 130, and the digital signal processing unit 116.

  In the AF detection unit 120, the CPU 100 controls the lens driving unit 104B to detect the contrast every 1/60 while the focus lens is moved, and performs an AF search. Based on the detection result of the AF detection unit 120, the CPU 100 instructs the lens driving unit 103B to move the focus lens to the in-focus position and stop it. For this reason, the focus is immediately adjusted no matter which direction the second photographing unit 1B is directed, and the focused subject is displayed almost always on the liquid crystal monitor DISP.

  Further, the AE / AWB detection unit 130 detects the luminance and calculates the white balance gain set for each color amplifier in the digital signal processing unit 116 every 1/60. The CPU 100 controls the aperture driving unit 105A according to the luminance detection result of the AE / AWB detection unit 130 to change the aperture diameter of the aperture I, and the digital signal processing unit 116A receives the signal from the AE / AWB detection unit 130. The white balance gain calculation result is received and the white balance gain is set for each color amplifier.

  In this digital signal processing unit 116A, processing is performed so as to obtain an image signal suitable for display including white balance adjustment, and the image converted into one suitable for display by signal processing of the digital signal processing unit 116A. The signal is stored in the VRAM 118.

  The same operation as described above is also performed by the first photographing unit 1A at the same timing. However, when the digital signal processing unit 116 processes the image signal output from the first CCD 111A included in the first photographing unit 1A, the digital signal processing unit 116 calculates the signal using the image signal by the AE / AWB detection unit 130. Instead of using the white balance gain, the white balance gain calculated based on the image signal obtained by using the photographing optical system of the second photographing unit 1B whose focal length is adjusted to be relatively small is used. Use to adjust white balance.

  The CPU 100 transfers the image signal generated by the first imaging unit 1A and the image signal generated by the second imaging unit 1B in the VRAM 118 to the display control unit 119, and both of them are displayed on the liquid crystal monitor DISP. Divide and display the image. Since the image signals are continuously output from the first and second imaging elements 111A and 111B every 1/60, the image signal in the VRAM 118 is rewritten every 1/60, and the image on the liquid crystal monitor DISP is also 1/60. The image is switched and displayed every 60, and the image is displayed as a moving image.

  When the subject on the liquid crystal monitor DISP is referred to and the shutter button 10A in the operation unit 10 is half-pressed, the CPU 100 immediately before the shutter button 10C is half-pressed by the AE / AWB detection unit 130. Receiving the detected AE value, the first and second aperture driving units 105A and 105B are instructed to make the first and second apertures IA and IB have a diameter corresponding to the AE value, and the first and second The lens driving unit 104A is instructed to cause the AF detection unit 120 to detect contrast while moving each focus lens. When the AF detection unit 120 detects the maximum contrast, the CPU 100 receives the in-focus position P1 where the maximum contrast is obtained, moves the first and second focus lenses to the in-focus position, and stops them.

  When the shutter button 10C is fully pressed, the CPU 100 starts a still image shooting process. The CPU 100 drives the mechanical shutters SHA and SHB to open and close in accordance with the shutter time and instructs the CCD control units 106A and 106B to set the electronic shutter in accordance with the shutter time in the CCDs 111A and 111B. Image signals are output from the second CCDs 111A and 111B to the first and second analog signal processing units 112A and 112B, and the first and second analog signal processing units 112A and 112B perform noise reduction processing and the like. . Thereafter, the analog image signals are converted into digital image signals by the first and second A / D converters 113A and 113B. At this time, images captured by the photographing optical system 110B, which is adjusted to have a relatively small focal length, immediately before the full-press detected by the AE / AWB detection unit 130 is detected by each color amplifier in the digital signal processing units 116A and 116B. White balance gain is set.

  Here, in accordance with the instruction from the CPU 100, the first and second image input controllers 114A guide the digital image signals converted by the first and second A / D converters 113A and 113B to the bus Bus side, and the bus Bus. All the image signals are temporarily stored in the RAM 115 via. Thereafter, the digital signal processing units 116A and 116B read out the image signals from the RAM 115, perform white balance adjustment, etc., convert them into image signals suitable for display, and compress / decompress the converted image signals using the bus Bus. To the unit 150. The CPU 100 causes the compression / decompression processing unit 150 to compress the image data, and then transfers the compressed image data to the recording control unit 160 using the bus Bus, and header information related to the compression and shooting. Is supplied to the recording control unit 160, and the recording control unit 160 generates an image file and causes the recording medium 161 to record the image file.

  With this configuration, it is possible to arbitrarily set the shooting magnifications of the subjects shot by the two shooting units 1A and 1B, and the two shooting units can shoot images with different shooting magnifications with good image quality. Furthermore, the white balance of each image at each shooting magnification can be made to reflect the situation of the object scene.

  Here, by adjusting the white balance of the digital signal processing unit 116 that constitutes an example of the signal processing unit according to the present invention, the white balance of the image at each shooting magnification is made the same and the situation of the object scene is reflected. Whether this is possible will be described with reference to FIGS.

  FIG. 3 is a diagram for explaining that both photographing units 1A and 1B capture a subject at different angles of view, and FIG. 4 is a diagram illustrating a subject captured by both photographing units 1A and 1B.

  In the imaging apparatus shown in FIGS. 1 and 2, when the independent mode is set, as shown in FIG. 3, the first imaging unit 1A and the second imaging unit 1B have different focal lengths, that is, Shooting is performed with different shooting magnifications set.

  Therefore, the images shown in FIGS. 4A and 4B are respectively generated in the CCDs 111A and 111B provided in both photographing units.

  Therefore, in the AE / AWB detection unit 130, the image on the side where the focal length of the imaging optical system 110B in FIG. 4A is adjusted to be relatively small reflects the situation of the object scene (light source type of illumination). Assuming that the image is an image, the white balance gain in the digital signal processing unit 116 is calculated based on the image signal output from the CCD 111B included in the second photographing unit 1B, and is used for white balance adjustment in the digital signal processing unit 116. Set the white balance gain for the color amplifier.

  As can be seen by comparing the images in FIGS. 4 (a) and 4 (b), the wide-angle image in FIG. 4 (a) includes the telephoto image in FIG. 4 (b). It can be seen that illumination light such as (this illumination light indicates the state of the object scene) is widely accepted. On the other hand, the telephoto image is a part of the wide-angle image, and when the white balance gain is calculated using the image of FIG. 4B, for example, the color of the wall of the house is blue. If it is, it can be seen that the white balance gain is biased to blue.

  Therefore, the white balance gain obtained based on the integrated value of wide-angle images with a wide field of view is also applied to the telephoto image that forms part of the wide-angle image, so that the white balance of the telephoto image is correctly adjusted. To be able to.

  That is, it is possible to make the white balance of each image at each photographing magnification the same and reflect the situation of the object scene.

  Finally, a photographing process executed in cooperation with the CPU 100 in FIG. 2 and the DSP constituting the AF detection unit 120, the AE / AWB detection unit 130, and the digital signal processing unit 116 will be described with reference to a flow.

  FIG. 5 is a flowchart showing a procedure of imaging processing executed in cooperation between the CPU 100 and the DSP constituting the AF detection unit 120, the AE / AWB detection unit 130, and the like. FIG. 6 shows the processing in step S508 of FIG. It is a flowchart which shows the detail of.

  FIG. 5 shows the contents of processing that is started in response to the power switch 10A being turned on while the mode switch 10G is switched to the independent mode side. FIG. 6 shows the processing in step S508. Details of the contents are shown.

  Referring to FIG. 5, the contents of the photographing process executed in cooperation between CPU 100 and the DSP constituting the AF detection unit in response to power switch 10A being turned on with mode switch 10G set to the independent mode. Will be explained.

  First, in response to the power being turned on, in steps S501 and S502, the main CPU instructs the lens driving units 103A and 103B, and the imaging optical system 110A and the second imaging unit 1B included in the first imaging unit 1A. Are set to the maximum focal length (TELE) and the minimum focal length (Wide), respectively.

  In the next step S503, it is determined whether or not the zoom switch 10D is operated. If it is determined that the zoom switch 10D is not operated, the process proceeds to No, and it is determined in step S504 whether or not the shutter button 10C is half-pressed. If it is determined in step S504 that the shutter button 10C has not been half-pressed, the process returns to step S503 and the processes in steps S503 and S504 are repeated.

  If it is determined that the zoom switch 10D is being operated while the processes in steps S503 and S504 are being repeated, the process proceeds to Yes in step S503, and in step S505, the lens selector switch 10H is on the lens 1 side or the lens 2 side. Determine which of the two has been defeated. If it is determined that the lens change-over switch 10H is tilted to the lens 1, the process proceeds to the lens 1 side and instructs the first lens driving unit 103A to set the focal length of the first photographing optical system 110A to the zoom switch 10D. Adjust according to the operation.

  Returning to step S503, if it is determined in step S503 that the zoom switch 10D has not been operated, the process proceeds to step S504. If it is determined that the shutter button 10C has not been half-pressed, the processing from step S503 to step S504 is repeated.

  If it is determined in step S503 that the zoom switch 10D is being operated while the processing from step S503 to step S504 is being repeated, the process proceeds to Yes in step S503, and the lens changeover switch 10H is moved to the lens 1 in step S505. It is determined whether it is tilted to the side or the lens 2 side. Here, if it is determined that the lens changeover switch 10H has changed from the above state and is tilted to the lens 2 side, the process proceeds to the lens 2 side to instruct the second lens driving unit 103B to perform the second photographing optical system. The focal length of 110B is adjusted according to the operation of the zoom switch 10D, and the process returns to step S503. If it is determined in step S503 that the zoom switch is not operated, the process proceeds to step S504, and if it is determined that the shutter button 10C is not half-pressed, the processes in steps S503 and S504 are repeated.

  If the main CPU 100 determines that the shutter button 10C has been half-pressed, the process proceeds to Yes, starts shooting processing in step S508, and records an image signal on the recording medium 161 in step S509. If it is determined in step S510 that the power switch 10A is turned off or the mode switch 10G is not switched to the three-dimensional mode, the process returns to step S503 to repeat the processing from step S503 to step S504. If it is determined in step S510 that the power switch 10A has been turned off, or if it is determined that the mode switch 10G has been switched to the stereoscopic mode, the processing of this flow is terminated.

  Here, a signal processing method of the image signal generated by the first imaging unit 1A and the second imaging unit 1B performed by the digital signal processing unit 116, which is a feature of the present embodiment, will be described with reference to FIG. This will be described in detail.

  It determines with having been half-pressed by step S504 of FIG. 5, and progresses to Yes side, and imaging | photography process is started by step S508. In step S5081, the main CPU 100 instructs the aperture driving units 104A and 104B to change the aperture diameter of the aperture according to the AE detection result of the AE / AWB detection unit 130, and drives the lens according to the detection result of the AF detection unit 120. The units 103A and 103B are instructed to move the focus lens to the in-focus position and stop it.

  Proceeding to the next Step S5082, the AE / AWB detection unit 130 is based on the image signal generated by the wide-angle imaging optical system 110B in which the focal length on the second imaging unit 1B side is adjusted to be relatively small. A white balance gain for specifying the light source type and adjusting the white balance is calculated.

  In the next step S5083, the digital signal processing unit 116 sets the internal white balance gain in each color amplifier based on the calculation result of the white balance gain of the AE / AWB detection unit 130.

  In step S5084, it is determined whether or not the button is fully pressed. If it is determined that the button is not fully pressed, the process returns to step S503 to repeat the processing from step S503 to step S5084. The CPU 100 instructs the shutter control units 105A and 105B to open the mechanical shutters SHA and SHB, and instructs the CCD control units 106A and 106B to set the electronic shutters in the CCDs 111A and 111B so that the subject light is applied to the CCDs 111A and 111B. Make an image. The main CPU 100 instructs the shutter control units 105A and 105B to close the mechanical shutters SHA and SHB, and outputs image signals from the first and second CCDs 111A and 111B at the electronic shutter off timing in step S5086, and then step S5087. Thus, the digital signal processing unit 116 performs signal processing including white balance processing of both image signals. In step S5088, the main CPU 100 transfers the image signal processed by the digital signal processing unit 116 to the compression / decompression processing unit 150 and causes the compression / decompression processing unit 150 to compress the image signal. Then, returning to step S509, the recording control unit 160 is supplied with information related to compression in the compression / decompression processing unit and information related to shooting of the compressed image, and generates an image file from them and records it on the recording medium 161. .

  In the present embodiment, the process of step S5082 corresponds to an example of a calculation step according to the present invention, and steps S5083 and S5087 correspond to an example of an adjustment step according to the present invention.

  When the processing of the flow shown in FIGS. 5 and 6 is executed by the main CPU 100 and the DSP constituting the AF detection unit 120, the AE / AWB detection unit 130, and the digital signal processing unit 116, each of the two photographing units is good. Shooting can be performed with image quality, and the white balance of each image at each magnification can be made to reflect the state of the scene as described above.

  In the above-described embodiment, two imaging units are taken as an example of a plurality of imaging units. However, the number of imaging may be three or more. In any case, using the white balance gain calculated based on the image signal obtained by the image sensor that receives the subject light imaged by the photographing optical system whose focal length is adjusted to be relatively small, When the white balance of the image signal obtained by the image sensor that receives the subject light imaged by the photographing optical system having a relatively long focal length is adjusted, the white of the image obtained by the photographing optical system at each focal length is adjusted. All balances reflect the situation in the object scene.

It is a figure which shows the imaging device which is one Embodiment of this invention. It is a block diagram which shows the internal structure of the imaging device 1 of FIG. It is a figure explaining that both imaging | photography parts 1A and 1B catch a to-be-photographed object with a different angle of view. It is a figure which shows the to-be-photographed object which both imaging | photography parts 1A and 1B catch. 6 is a flowchart illustrating a procedure of imaging processing executed in cooperation between a CPU 100 and a DSP that constitutes an AF detection unit, an AE / AWB detection unit, and the like. It is a flowchart which shows the detail of the process of the step of FIG.

Explanation of symbols

1 photographing apparatus 100 CPU
101 ROM
102 Flash memory 110A 110B Imaging optical system 111A 111B Image sensor (CCD)
112A 112B Analog signal processor 113A 113B A / D converter 114A 114B Image input controller 115 RAM
116 Digital signal processor 118 VRAM
119 Display control unit 120 AF detection unit 130 AE / AWB detection unit

Claims (5)

A plurality of imaging optical systems, each of which is adjustable in focal length and adjusted to different focal lengths, and a plurality of images received by subject light formed by the subject imaged by each of the plurality of imaging optical systems. A plurality of imaging units each having a plurality of imaging elements for generating signals;
A signal processing unit that performs white balance adjustment processing on image signals generated by each of the plurality of imaging elements,
The signal processing unit is based on an image signal obtained by a photographing element that receives subject light imaged by a photographing optical system in which a focal length of the plurality of photographing optical systems is adjusted to be relatively small. An imaging apparatus, wherein a white balance gain is calculated, and the calculated white balance gain is applied to white balance adjustment processing of a plurality of image signals obtained by each of the plurality of imaging elements.   The photographing apparatus according to claim 1, wherein the plurality of photographing optical systems are arranged side by side in a direction including the same subject within an angle of view.   3. The imaging instruction unit for instructing imaging, wherein the plurality of imaging units perform imaging simultaneously upon receiving one imaging instruction from the imaging instruction unit. Shooting device.   4. The apparatus according to claim 1, further comprising an initialization unit that adjusts focal lengths of the plurality of photographing optical systems to different focal lengths when the photographing apparatus is powered on. 5. Shooting device. A plurality of imaging optical systems, each of which is adjustable in focal length and adjusted to different focal lengths, and a plurality of images received by subject light formed by the subject imaged by each of the plurality of imaging optical systems. A signal processing method in an imaging device including a plurality of imaging units each having a plurality of imaging elements that generate signals,
A white balance gain is calculated based on an image signal obtained by a photographing element that receives subject light formed by a photographing optical system in which a focal length is adjusted to be relatively small among the plurality of photographing optical systems. A calculation step;
Adjusting the white balance of each of the plurality of image signals by applying the white balance gain calculated in the calculating step to the plurality of image signals obtained by each of the plurality of imaging elements. A signal processing method.

Images