JP2012147369A - Imaging apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve the following problem: a conventional imaging apparatus generates images with noise components under a state where the illumination of a subject is low and AGC operates and particularly an imaging apparatus that can photograph 3D moving images and still pictures, when conspicuous noise exists in a parallax image, makes noise included in each image stereoscopic and hence may have an unsightly image looking like an image standing out independently of a subject.SOLUTION: An imaging apparatus includes: means for detecting an amplification factor of an AGC function in an own apparatus and imaging means that picks up a subject image and selectively outputs either of plane image data showing an image for plan view or stereoscopic image data showing an image for stereoscopic view according to the detected AGC amplification factor of the own apparatus.

Description

  The present invention relates to an image pickup apparatus, and more particularly to an image pickup apparatus having a function of shooting a 2D moving image and a 3D moving image.

  In recent years, with the development of 3D television and movie content, an environment in which a general user can easily view 3D video is being prepared. In conjunction with this, a camera capable of 3D imaging has also been proposed for the imaging apparatus.

  Conventionally, a method of capturing a 3D image from a plurality of viewpoints at the same time and acquiring and generating a 3D image from the amount of parallax between the viewpoints is generally used for capturing 3D images. However, since 3D video undergoes a process in which a human recognizes a video as a 3D image in the brain from an image with parallax, the image visually recognized by the eye is appropriately adjusted according to the human 3D image recognition process. If it is not, there is a risk that the viewer may feel uncomfortable. Therefore, as in Patent Document 1, when 3D video is captured by an imaging device that supports 3D, the camera control method (in the case of Patent Document 1, the period of exposure control, etc.) is changed compared to 2D imaging. In addition, an apparatus that does not give the viewer a sense of incongruity during 3D shooting has been proposed.

JP 2008-187385 A

  However, there are various other cases where the viewer feels uncomfortable in the 3D video. In particular, when a general camera user who is not a professional shoots 3D video, it is difficult for the photographer to determine whether or not the shooting situation is suitable for 3D shooting. Therefore, it is required to automatically determine and control shooting, or to perform some processing on the recorded 3D video.

  The present invention takes such circumstances into consideration, and if there is a possibility of giving the viewer a sense of incongruity when shooting 3D video, it is appropriate to control the camera automatically or to process the shot video. It is to provide an imaging apparatus capable of capturing a simple image.

  The above object is achieved by the following imaging device. That is, the present invention relates to an imaging optical system capable of stereoscopic imaging that forms an optical image of a subject, and an optical image formed by the imaging optical system, and the optical image is converted into an electrical image signal. When the image signal amplification factor exceeds a predetermined value during photographing, the stereoscopic photographing is stopped.

  The above object is achieved by the following imaging device. That is, according to the present invention, the first and second optical systems that are arranged side by side and each form a subject image and the two subject images formed by the first and second optical systems are respectively captured. , Generating stereoscopic image data indicating an image for stereoscopic viewing, and converting the image data into an electrical image signal, an amplifying unit for amplifying the image signal, and the amplified gain The distance between the optical axes of the first and second optical systems by moving at least one of the first and second optical systems in a direction perpendicular to the optical axis. Changing means for changing the stereo base.

  The above object is achieved by the following imaging device. That is, the present invention generates right-eye image data and left-eye image data representing a stereoscopic image, and converts the image data into an electrical image signal, and amplifies the image signal. And a parallax adjusting unit that adjusts the parallax between the image data for the right eye and the image data for the left eye according to the amplified amplification factor.

  According to the present invention, even when a 3D image is shot, there is a possibility that the shot image may give the viewer a sense of incongruity. By controlling the camera automatically or processing the shot image, Video can be taken.

1 is an external view of an imaging apparatus according to Embodiment 1 of the present invention. FIG. 2 is a block diagram for explaining an internal configuration of the imaging apparatus according to Embodiment 1 of the present invention. The flowchart which shows the series of processing content in Embodiment 1 of this invention. The flowchart which shows the series of processing content in Embodiment 1 of this invention. Block diagram for explaining an internal configuration of an imaging apparatus according to Embodiment 2 of the present invention A flowchart showing a series of processing contents in the second embodiment of the present invention. A flowchart showing a series of processing contents in the second embodiment of the present invention. Block diagram for explaining an internal configuration of an imaging apparatus according to Embodiment 3 of the present invention Block diagram for explaining an internal configuration of parallax adjustment unit 800 according to Embodiment 3 of the present invention The figure explaining the example of the parallax in Embodiment 3 of this invention. A flowchart showing a series of processing contents in the third embodiment of the present invention. A flowchart showing a series of processing contents in the third embodiment of the present invention. The figure which shows the example of the relationship between the gain of AGC and the stereo base or the amount of parallax in Embodiment 3 of this invention.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(Embodiment 1)
FIG. 1 is an external view of an imaging apparatus according to Embodiment 1. The imaging apparatus shown in FIG. 1 has two photographing lenses 100R (right side facing the subject), 100L (left side facing the subject), a recording ON / OFF switch 101, a mode switch 102, and a zoom lever 103. And a strobe 104.

  A 3D image is captured based on two images having parallax in the left-right direction obtained through the two imaging lenses 100R and 100L. The imaging apparatus can also capture a 2D image using only one of the two imaging lenses.

  The mode changeover switch 102 switches between shooting modes such as 2D shooting and 3D shooting, moving image shooting and still image shooting. The zoom lever 103 instructs to change the focal length of the two photographing lenses 100R and 100L. The strobe 104 is used when shooting a dark subject. When the recording ON / OFF switch 101 is pressed once in the moving image shooting mode, the recording of the moving image is started, and when it is pressed again, the recording is stopped.

  FIG. 2 is a block diagram for explaining the internal configuration of the imaging apparatus shown in FIG.

  In FIG. 2, L at the end is an element for obtaining an image signal from a subject image obtained via the photographing lens 100 </ b> L, elements that perform the same operations are given the same numbers, and description thereof is omitted.

  In FIG. 2, a photographing lens 100R is an optical system composed of a plurality of lens groups for forming a photographed image on the image sensor 200R, and has a zoom function and a focusing function.

  The image sensor 200R is a photoelectric conversion device that converts a formed subject image into an electrical signal (image signal), and for example, a CCD image sensor or a CMOS image sensor.

  The analog signal processing unit 201R performs processing such as coarse gain adjustment and noise removal on the video signal obtained from the image sensor 200R. After these processes, the video signal is converted into a digital signal by the A / D converter 202R.

  The signal converted into a digital signal by the A / D conversion unit 202R is sent to the digital signal processing unit 203R.

  The digital signal processing unit 203R, for example, separation of luminance signal and color difference signal, noise removal, signal gain adjustment (AGC function described later), gamma correction, sharpness improvement processing, electronic zoom processing, and other digital processing necessary for the camera Execute. The brightness of the subject is detected from the signal level of the photographed image signal, information necessary for exposure control (aperture and shutter speed control) of the photographing lens 100R is extracted, and supplied to a system control unit 208 described later. .

  The memory 204 stores a signal that has passed through the digital signal processing unit 203R. Here, the stored signal is not limited to the signal after being processed by the digital signal processing unit 203R. The signal supplied from the A / D converter 202R is temporarily stored in the memory 204 as it is, and only necessary signals are read from the memory 204, for example, in units of blocks, processed by the digital signal processor 203R, and written to the memory 204 again. It can also be used like buffer memory, such as returning.

  The memory control unit 205 controls recording of signals to the memory 204 and reading of signals from the memory 204 in accordance with instructions from the system control unit 208 described later.

  The optical system driving unit 206R drives a zoom motor, a focus motor, and an aperture motor (not shown) to control the zoom magnification, focusing, aperture 210R, and shutter (not shown) of the taking lens 100R, and a system control unit 208 described later. The zoom magnification and focus position (focus adjustment) of the taking lens 100R, the aperture of the aperture 210R, and the opening / closing of the shutter are adjusted in accordance with the command signal from.

  The image sensor drive control unit 207R supplies pulse signals for controlling the exposure timing, signal readout timing, and electronic shutter operation of the image sensor 200R, and controls the image sensor 200R according to a command signal from the system control unit 208 described later. Drive control.

  The photographic lens 100L, the image sensor 200L, the analog signal processor 201L, the A / D converter 202L, the digital signal processor 203L, the optical system drive 206L, and the image sensor drive controller 207L are assigned the same numbers as described above. It is an element having the same function as the element, and a description thereof is omitted.

  The system control unit 208 includes optical signal drive control units 206R and 206L, image sensor drive control units 207R and 207L, a digital signal processing unit 203R, and a digital signal processing units 203R and 203L, a mode switch 102, and a zoom lever 103 state. 203L, the memory control unit 205, and a 3D video generation unit 209, which will be described later, are integratedly controlled to give instructions to perform appropriate operations in conjunction with each other during 3D video shooting. For example, it consists of a microcomputer and a control program stored in it.

  The 3D video generation unit 209 generates a 3D video based on two image signals obtained from two elements that process two photographing lenses and subject images obtained therefrom.

  The operation of the imaging apparatus of the first embodiment configured as described above will be described below.

  It is assumed that the mode switch 102 of the imaging device is set in advance to the 3D moving image shooting mode. First, when the operator turns on the power of the entire image pickup apparatus, initialization of the entire apparatus starts immediately and the state shifts to a shooting (recording) standby state. At this time, the brightness of the subject is detected from the camera-through image by the digital signal processing units 203R and 203L so that an appropriate exposure video can be obtained simultaneously with the start of recording, and the detected value is sent to the system control unit 208. . Based on this detected value, the system control unit 208 controls the apertures 210R and 210L through the optical system drive control units 206R and 206L to adjust the brightness of the subject to be appropriate. However, if the subject is dark and the subject does not have a predetermined brightness even when the apertures 210R and 210L are opened, the AGC function of the digital signal processing units 203R and 203L is set to valid (on) and with a specified gain (amplification factor). Amplifies the gain of the signal.

  Next, when the operator of the imaging apparatus presses the recording ON / OFF switch 101 to start recording, the system control unit 208 sets the zoom magnifications of the photographing lenses 100R and 100L to the same and correctly focuses the two lenses. After that, the two image sensors 200R and 200L are driven at the same timing to start photographing. The image signals photographed at a predetermined frame period are output from the two image sensors 200R and 200L, and pass through the analog signal processing units 201R and 201L, the A / D conversion units 202R and 202L, and the digital signal processing units 203R and 203L. And supplied to the 3D video generation unit 209, where a 3D video is generated. A 3D video generation method is a known technique.

  For example, in the present embodiment, a time-division 3D moving image for recording left-eye video and right-eye video is generated from two-parity moving images with parallax obtained from two imaging devices. Recording media (such as hard disks and semiconductor memory cards).

  When shooting a moving image using an imaging device, if the photographer is a non-professional general camera user, it is unlikely that measures such as applying appropriate lighting to the subject will be taken according to the shooting situation. For this reason, in general imaging devices for consumer use, the brightness of the subject is detected and the aperture, shutter speed, and signal gain are automatically adjusted, so that the subject can be photographed with appropriate brightness even in various shooting situations. Is provided. In particular, the function of automatically adjusting the signal gain according to the brightness of the subject is called an AGC (auto gain control) function as shown in the patent document (Japanese Patent Laid-Open No. 2009-60369), and is very common in consumer imaging devices. It has become a function. However, since the AGC function increases the gain of the noise component when the signal gain is increased, the signal noise is emphasized when applied to an image taken under a very dark condition such as a subject at night or indoors. There is a problem that results in a very unsightly image. This is also a problem in 2D shooting, but causes more troublesome problems in 3D shooting. That is, in 3D shooting, if there is significant noise in a parallax image for stereoscopic viewing (for example, two images of an image viewed with the left eye and an image viewed with the right eye each having parallax), the noise included in each image is stereoscopically displayed. It may be an unsightly and uncomfortable image that appears to be seen and noise appears independently of the subject.

  Therefore, in the first embodiment, the above-described image discomfort is reduced by limiting the video that can be recorded based on the brightness of the subject and the operation state of the AGC function of the digital signal processing units 203R and 203L.

  This operation will be described in detail with reference to the flowcharts of FIGS.

  FIG. 3 and FIG. 4 are flowcharts for explaining the operation for limiting 3D shooting in the first embodiment. An algorithm for realizing this operation is implemented in the system control unit 208 as hardware or software.

  In FIG. 3, when the power of the entire imaging apparatus is turned on by the operator, the initialization of the entire apparatus starts immediately and the state shifts to a shooting (recording) standby state (step 300). Next, in step 301, the brightness of the subject is detected from the camera-through images by the digital signal processing units 203R and 203L so that an appropriate exposure video can be obtained simultaneously with the start of recording. Sent to. Based on the detected value, the system control unit 208 controls the apertures 210R and 210L through the optical system drive control units 206R and 206L to adjust the brightness of the subject to be appropriate. However, if the subject is dark and the subject does not reach the predetermined brightness even when the apertures 210R and 210L are opened, the AGC function of the digital signal processing units 203R and 203L is set to valid (on), and the signal is amplified with a specified amplification factor. To do.

  In the next step 302, the gain of the AGC function of the digital signal processing units 203R and 203L is checked to determine whether or not it is a certain value or more. If the amplification factor is equal to or greater than a certain value, the process proceeds to step 303 to set the imaging apparatus to the 3D recording prohibited state. Here, when the imaging device is set to the 3D recording prohibited state, 3D recording is prohibited and the moving image recording is limited to 2D recording even if the mode switch 102 of the imaging device is set to the 3D moving image shooting mode. And Then, in step 304, the photographer is notified through the display means or warning sound generating means (not shown) equipped in the imaging apparatus that the imaging apparatus has been set to the 3D recording prohibited state.

  Conversely, if the amplification factor is less than a certain value, the process proceeds to step 305, and the imaging apparatus is set to the 3D recording permission mode. Naturally, the 3D recording permission mode indicates a state in which 3D recording is possible. In step 306, the photographer is notified of the fact that the imaging apparatus is set to the 3D recording permission state via a display means or a warning sound generation means (not shown) provided in the imaging apparatus.

  After the state of the imaging device is displayed or notified in step 304 or step 306, each step starting from step 301 is repeated at a constant cycle (for example, the imaging cycle (frame cycle) of the imaging device). The state of continues to be updated. The display or notification to the photographer in steps 304 and 306 is not necessarily required.

  Next, an operation after an instruction to start recording will be described with reference to FIG. Note that the six steps (410, 411, 412, 413, 414, and 415) shown in FIG. 4 will be described together for the sake of clarity.

  In FIG. 4, when recording is started, the state of the imaging apparatus regarding 3D recording is confirmed in step 400. If the imaging device is set to the 3D recording permission mode, the process proceeds to step 401 and 3D recording is started. On the other hand, in the 3D recording prohibition mode, the process proceeds to step 402 and 2D recording is started.

  Thereafter, each step starting from step 403 is repeated at a constant cycle (for example, the imaging cycle (frame cycle) of the imaging device), and the recording state of the imaging device is continuously changed. Specifically, in step 403, the state of the imaging device related to 3D recording is confirmed at the above-described fixed period. If the imaging device is set to the 3D recording permission mode, the process proceeds to step 404 where the current recording state is confirmed. If the current state is 3D recording, the process proceeds to step 405 to continue 3D recording. On the other hand, if 2D recording is in progress, the recording is switched to 3D (step 406).

  If the imaging apparatus is set to the 3D recording prohibition mode in step 403, the process proceeds to step 407 and the current recording state is confirmed. If the current state is 3D recording, the process proceeds to step 408 to switch the recording to 2D. On the other hand, if 2D recording is in progress, 2D recording is continued (step 409).

  Finally, the six steps 410, 411, 412, 413, 414, and 415 will be described. These six steps are steps for notifying the photographer that the recording state has been switched and the recording state has been switched, and through a display means or warning sound generating means (not shown) equipped in the imaging device, It notifies the photographer of the change of state by video or audio. Specifically, step 410 is a step for informing the photographer in advance that 2D recording is started in step 402, and 411 is for informing that 2D recording has already started. Similarly, step 412 is a step for notifying the photographer in advance that switching to 3D recording is performed at step 406, and 413 is for notifying that 3D recording has already started. Step 414 is a step for notifying the photographer in advance that switching to 2D recording is performed at step 408, and 415 is for notifying that 2D recording has already started.

  Note that switching from 3D shooting to 2D shooting is performed by supplying only an image obtained from one of the two camera systems of the imaging apparatus to the 3D video generation unit 209 and only one camera image. The video may be output, or two images may be synthesized to synthesize a 2D video.

  As described above, according to the first embodiment, at the time of video shooting, in a situation where a certain level of amplification processing is performed on the video signal by the AGC function and the 3D video is uncomfortable due to noise, the video is converted from 3D to 2D. By switching automatically, it is possible to shoot images suitable for viewing.

(Embodiment 2)
An imaging apparatus according to Embodiment 2 of the present invention will be described with reference to FIGS. In the second embodiment, the stereo base changing unit 500 for varying the physical distance (hereinafter stereo base) between the photographing lenses 100R and 100L is provided in the imaging apparatus in the first embodiment described above. This will be described as a configuration in which this is controlled from the system control unit 501. Parts similar to those in FIG. 1 to FIG. 4 of the first embodiment are denoted by the same reference numerals in FIG. 5, FIG. 6, and FIG.

  FIG. 5 is a block diagram showing an internal configuration of the imaging apparatus according to Embodiment 2 of the present invention.

  In FIG. 5, a stereo base changing unit 500 includes a mechanism and a drive motor for freely changing the stereo base between two photographing lenses 100R and 100L. The stereo base is changed based on a command signal from the system control unit 501. change. By changing the stereo base between the two photographing lenses 100R and 100L by the stereo base changing unit 500, it is possible to change the stereoscopic effect (amount of pop-out) of the 3D image to be shot. Note that changing the stereo base means changing the parallax between the left and right images. A method for adjusting the parallax between two images in order to adjust the parallax and the stereoscopic effect (protrusion amount) of the 3D video is, for example, a horizontal positional deviation between the two left and right images obtained by two cameras. There is a method of adjusting the amount by image processing. Another method is disclosed in, for example, Japanese Patent Application Laid-Open No. 2010-45584.

  Here, as described in Embodiment 1 of the present invention, when there is significant noise in the parallax images, the noise included in each image is stereoscopically viewed and the noise appears to stand out independently of the subject and is uncomfortable and uncomfortable. It becomes an image with.

  Therefore, in the first embodiment, the stereo base between the two photographing lenses 100R and 100L is freely changed based on the brightness of the subject and the operation state of the AGC function of the digital signal processing units 203R and 203L. By adjusting the three-dimensional effect (the amount of pop-out) of the 3D video, the noise embossing feeling is reduced, and the above-mentioned image discomfort is reduced.

  This operation will be described in detail with reference to the flowcharts of FIGS.

  FIG. 6 and FIG. 7 are flowcharts for explaining the operation for adjusting the stereoscopic effect (the pop-out amount) of the 3D video imaged in the second embodiment. An algorithm for realizing this operation is implemented in the system control unit 501 as hardware or software.

  In FIG. 6, when the power supply of the entire image pickup apparatus is turned on by the operator, the initialization of the entire apparatus starts immediately and the state shifts to a shooting (recording) standby state (step 300). Next, in step 601, the digital signal processing units 203R and 203L detect the brightness of the subject from the camera-through images so that an appropriate exposure image can be obtained simultaneously with the start of recording, and the detected value is used as the system control unit 501. Sent to. Based on the detected value, the system control unit 501 controls the apertures 210R and 210L through the optical system drive control units 206R and 206L to adjust the brightness of the subject to be appropriate. However, if the subject is dark and the subject does not reach the predetermined brightness even when the apertures 210R and 210L are opened, the AGC function of the digital signal processing units 203R and 203L is set to valid (on), and the signal is amplified with a specified amplification factor. To do.

  In the next step 602, the gain of the AGC function of the digital signal processing units 203R and 203L is checked to determine whether or not it is greater than a certain value. If the amplification factor is equal to or greater than a certain value, the process proceeds to step 603 to set the imaging apparatus to the SB (stereo base) change mode. Here, when the imaging apparatus is set to the SB change mode, the system control unit 501 changes the stereo base between the two optical systems 100R and 100L to a setting other than the initial value at the time of 3D shooting. At this time, it is preferable to change the stereo base in such a direction that the stereoscopic effect (the pop-out amount) of the 3D video is reduced, and specifically, the stereo base between 100R and 100L is changed to be shorter.

  In step 604, the photographer is informed via the display means or warning sound generation means (not shown) equipped in the imaging apparatus that the imaging apparatus has been set to the SB change mode.

  Conversely, if the amplification factor is less than a certain value, the process proceeds to step 605, and the imaging apparatus is set to the SB fixed mode. The SB fixed mode indicates a state where the stereo base between the two optical systems 100R and 100L is fixed to the initial value. In step 606, the photographer is notified of the fact that the image pickup apparatus has been set to the SB fixed mode via a display means or a warning sound generation means (not shown) provided in the image pickup apparatus.

  After the state of the imaging device is displayed or notified in step 604 or step 606, each step starting from step 601 is repeated at a constant cycle (for example, the imaging cycle (frame cycle) of the imaging device). The state of continues to be updated. Note that the display or notification to the photographer in steps 604 and 606 is not necessarily required.

  Next, the operation after the instruction to start recording will be described with reference to FIG. Note that the six steps (708, 709, 710, 711, 712, 713) shown in FIG. 7 will be described later together for the sake of clarity.

  In FIG. 7, when recording is started, the state of the imaging apparatus regarding 3D recording is confirmed in step 700. When the imaging device is set to the SB change mode, the process proceeds to step 701 and 3D recording is started. On the other hand, in the case of the SB fixed mode, the process proceeds to step 702 and the stereo base (SB) is changed, and then 3D recording is started in step 701.

  Thereafter, each step starting from step 703 is repeated at a constant cycle (for example, an imaging cycle (frame cycle) of the imaging device), and the recording state of the imaging device is continuously changed. Specifically, in step 703, the state of the imaging device related to 3D recording is confirmed at the above-described fixed period. If the image pickup apparatus is set to the SB fixed mode, the process proceeds to step 704 to check the current recording state. If the stereo base is fixed at the initial value, the process returns to step 703. On the other hand, if the stereo base has been changed to other than the initial value, the stereo base is switched to the initial value (step 705).

  When the imaging apparatus is set to the SB change mode in step 703, the process proceeds to step 706 and the current recording state is confirmed. If the stereo base is fixed at the initial value, the process proceeds to step 707 and the stereo base is switched to a value other than the initial value. On the other hand, if the stereo base is other than the initial value, recording is continued.

  Finally, the six steps 708, 709, 710, 711, 712, and 713 will be described. These six steps are steps for notifying the photographer that the stereo base has been switched and that the stereo base has been switched. Through the display means or warning sound generation means (not shown) provided in the imaging device, The photographer is notified of the switching by video or audio. Specifically, step 708 is a step for informing the photographer in advance that the stereo base is changed in step 702, and 709 is for informing that the stereo base has already been changed. Similarly, step 710 is a step for notifying the photographer in advance that the stereo base is switched to the initial value in step 705, and 711 is for notifying that the stereo base has already been switched. Further, step 712 is a step for notifying the photographer in advance that the stereo base is switched in step 707, and 713 is for notifying that the stereo base has already been switched.

  As described above, according to the second embodiment, in a situation where a certain level of amplification processing is performed on the video signal by the AGC function at the time of video shooting, and the 3D video is uncomfortable due to noise, the stereo base of the imaging device is used. By adjusting the stereoscopic effect (protruding amount) of the 3D video imaged by automatically switching the image, it is possible to reduce the noise embossing feeling and to reduce the uncomfortable feeling of the image already described.

(Embodiment 3)
An imaging apparatus according to Embodiment 3 of the present invention will be described with reference to FIGS. In the third embodiment, instead of changing the stereo base between the photographing lenses 100R and 100L in the second embodiment described above, the left and right images photographed via the photographing lenses 100R and 100L are changed. This is a configuration for changing the parallax. Note that the same parts as those in the first and second embodiments described above are denoted by the same reference numerals in the drawings and description thereof is omitted.

  FIG. 8 is a block diagram showing an internal configuration of the imaging apparatus according to Embodiment 3 of the present invention.

  In FIG. 8, the parallax adjustment unit 800 freely changes the parallax between the two left and right images photographed via the two photographing lenses 100R and 100L. By changing the parallax between the two left and right images by the parallax adjustment unit 800, it is possible to change the stereoscopic effect (the amount of pop-out) of the 3D video to be shot. Note that the method of adjusting the parallax between two images in order to adjust the stereoscopic effect (projection amount) of the 3D video is, for example, a spatial displacement in the horizontal direction between the two left and right images obtained by two cameras. There is a method of adjusting the amount by image processing. Another method is disclosed in, for example, Japanese Patent Application Laid-Open No. 2010-45584.

  FIG. 9 is a block diagram showing an internal configuration of the parallax adjustment unit 800 shown in FIG. In FIG. 9, a parallax detection unit 900 is a means for detecting the parallax between two left and right images supplied from the digital signal processing units 203R and 203L. Note that a parallax detection method, for example, a method of detecting the amount of horizontal misalignment between two left and right images is common. Specifically, one of the left and right images is used as a reference, an appropriate rectangular area is provided in this reference image, and a pattern matching is searched for in the other image where the pattern matches the rectangular area. By doing so, the positional deviation amount is detected.

  The buffer memory 901 is a memory that temporarily stores left and right image data supplied from the digital signal processing units 203R and 203L. The buffer memory 901 can cut out and output an image from an arbitrary horizontal direction position with respect to two stored image data based on a command from a parallax changing unit 902 described later.

  The parallax changing unit 902 designates the horizontal cutout position when reading the image from the buffer memory 901 based on the parallax changing instruction from the system control unit 801 and the parallax detection result between the two images in the parallax detecting unit 900. .

  FIG. 10 is a diagram schematically showing the parallax (D in the figure) between two images.

  The operation of the third embodiment configured as described above will be described below.

  As described in the first and second embodiments of the present invention, when there is significant noise in a parallax image, the noise included in each image is stereoscopically viewed, and the noise appears to stand out independently of the subject. It becomes an image.

  Therefore, in the third embodiment, the parallax between the two left and right images photographed through the two photographing lenses 100R and 100L based on the brightness of the subject and the operation state of the AGC function of the digital signal processing units 203R and 203L. By changing the three-dimensional effect (the amount of pop-out) of the 3D video to be taken, the noise embossing feeling is reduced, and the above-mentioned image discomfort is reduced.

  This operation will be described in detail with reference to the flowcharts of FIGS.

  In FIG. 11, when the power of the entire imaging apparatus is turned on by the operator, the initialization of the entire apparatus starts immediately and the state shifts to a shooting (recording) standby state (step 300). Next, in step 1101, the digital signal processing units 203R and 203L detect the brightness of the subject from the camera-through images so that an appropriate exposure video can be obtained simultaneously with the start of recording, and this detected value is used as the system control unit 801. Sent to. Based on this detection value, the system control unit 801 controls the apertures of the apertures 210R and 210L via the optical system drive control units 206R and 206L to adjust the brightness of the subject to be appropriate. However, if the subject is dark and the subject does not reach the predetermined brightness even when the apertures 210R and 210L are opened, the AGC function of the digital signal processing units 203R and 203L is set to valid (on), and the signal is amplified with a specified amplification factor. To do.

  In the next step 1102, the gain of the AGC function of the digital signal processing units 203R and 203L is checked to determine whether or not it is a certain value or more. If the amplification factor is equal to or greater than a certain value, the process proceeds to step 1103, and the imaging apparatus is set to the parallax change mode. Here, when the imaging apparatus is set to the parallax change mode, the system control unit 801 changes the parallax between the two images obtained from the two optical systems 100R and 100L to a setting other than the initial value at the time of 3D shooting. At this time, since the parallax is preferably changed in a direction in which the stereoscopic effect (the amount of pop-out) of the 3D video is reduced, specifically, the original parallax between the two captured images (in the parallax detection unit 900) The parallax is changed to be smaller than the parallax detected.

  In step 1104, the photographer is informed via the display means or warning sound generating means (not shown) equipped in the imaging apparatus that the imaging apparatus is set to the parallax change mode.

  Conversely, when the amplification factor is less than a certain value, the process proceeds to step 1105, and the imaging apparatus is set to the parallax fixed mode. The parallax fixed mode indicates a state in which the parallax between two images obtained from the two optical systems 100R and 100L is fixed to an initial value. Then, in step 1106, the photographer is notified through the display means or warning sound generation means (not shown) equipped in the imaging apparatus that the imaging apparatus is set to the parallax fixed mode.

  After the state of the imaging device is displayed or notified in step 1104 or step 1106, each step starting from step 1101 is repeated at a fixed cycle (for example, the imaging cycle (frame cycle) of the imaging device). The state of continues to be updated. Note that the display or notification to the photographer in steps 1104 and 1106 is not necessarily required.

  Next, an operation after an instruction to start recording will be described with reference to FIG. Note that the six steps (1208, 1209, 1210, 1211, 1212, and 1213) shown in FIG. 12 will be collectively described later for the sake of clarity.

  In FIG. 12, when the recording is started, in step 1200, the state of the imaging device related to the 3D recording is confirmed. When the imaging device is set to the parallax change mode, the process proceeds to step 1201 and 3D recording is started. On the other hand, in the case of the parallax fixed mode, the process proceeds to step 1202 and the parallax of the two images obtained from the two optical systems 100R and 100L is changed in the parallax changing unit 902 under the instruction of the system control unit 801. 3D recording is started.

  Thereafter, each step starting from step 1203 is repeated at a constant cycle (for example, an imaging cycle (frame cycle) of the imaging device), and the recording state of the imaging device is continuously changed. Specifically, in step 1203, the state of the imaging apparatus related to 3D recording is confirmed at the above-described fixed period. If the imaging apparatus is set to the parallax fixed mode, the process proceeds to step 1204 and the current recording state is confirmed. If the current parallax is fixed at the initial value, the process returns to step 1203. On the other hand, if the parallax has been changed to a value other than the initial value, the parallax is switched to the initial value (step 1205).

  When the imaging apparatus is set to the parallax change mode in step 1203, the process proceeds to step 1206 and the current recording state is confirmed. If the current parallax is fixed to the initial value, the process proceeds to step 1207 to switch the parallax to a value other than the initial value. On the other hand, if the parallax is other than the initial value, the recording is continued.

  Finally, six steps 1208, 1209, 1210, 1211, 1212, and 1213 will be described. These six steps are steps for informing the photographer that the parallax has been switched and the parallax has been switched, and the video or This is to notify the photographer of the change by voice. Specifically, step 1208 is a step for notifying the photographer in advance that the parallax is changed in step 1202, and 1209 is for notifying that the parallax has already been changed. Similarly, step 1210 is a step for notifying the photographer in advance that the parallax is switched to the initial value in step 1205, and 1211 is for notifying that the parallax has already been switched. Step 1212 is a step for notifying the photographer in advance that the stereo base is switched in step 1207, and 1213 is for notifying that the stereo base has already been switched.

  As described above, according to the third embodiment, in a situation where a certain level of amplification processing is performed on the video signal by the AGC function at the time of video shooting, and the 3D video is uncomfortable due to noise, By adjusting the stereoscopic effect (protruding amount) of 3D video shot by automatically switching the amount of parallax between the two images obtained from the optical system, the sense of noise emphasis is reduced, and the above-described image discomfort is reduced. can do.

  In Embodiments 2 and 3, the stereo base or the amount of parallax can be changed between the initial value and the changed value other than the initial value. However, the stereo base or the amount of parallax can be changed rapidly. This is not preferable because the stereoscopic effect of the 3D video changes abruptly. Therefore, it is better to change these switching gradually over a certain period.

  In the second and third embodiments, the configuration has been described in which the stereo base or the parallax between two images is changed when the gain of the AGC is a certain value or more. However, the present invention is not limited to this. For example, FIG. As shown, a stereo base or a configuration in which the parallax is changed in two or more stages according to the gain of AGC may be used.

  According to the present invention, even when a 3D video is shot, there is a possibility that the shot video may give the viewer a sense of incongruity. By controlling the camera automatically or processing the shot video, an appropriate 3D video can be obtained. Is a system that can be used for 3D video imaging devices.

100R, 100L Imaging lens 200R, 200L Image sensor 201R, 201L Analog signal processor 202R, 202L A / D converter 203R, 203L Digital signal processor 204 Memory 205 Memory controller 206R, 206L Optical system drive controller 207R, 207L Element drive control unit 208, 501, 801 System control unit 209 3D video generation unit 210R, 210L Aperture 500 Stereo base change unit 800 Parallax adjustment unit

Claims (16)

An imaging device that outputs an optical image of a subject as an electrical image signal,
An imaging optical system capable of stereoscopic shooting that forms an optical image of a subject;
Imaging means for receiving an optical image formed by the imaging optical system and converting the optical image into an electrical image signal;
Amplifying means for amplifying the image signal;
If the amplification factor of the image signal exceeds a predetermined value during shooting, the stereoscopic shooting is stopped.
Imaging device. Recording means for recording an image, and
The image signal includes first and second image signals having parallax,
When the amplification factor of the image signal exceeds a predetermined value, either the first image signal or the second image signal is selectively recorded on the recording unit;
The imaging device according to claim 1. A synthesis means for synthesizing the image,
The image signal includes first and second image signals having parallax,
When the amplification factor of the image signal exceeds a predetermined value, the first image signal and the second image signal are combined by the combining unit.
The imaging device according to claim 1. When the amplification factor of the image signal exceeds a predetermined value,
A notification means for notifying the user of the shooting state;
The imaging device according to claim 1. When the amplification factor of the image signal exceeds a predetermined value,
A guide unit that guides a user to shooting conditions that allow stereoscopic shooting;
The imaging device according to claim 1. The image signal is composed of three or more image signals having parallax.
The imaging device according to claim 1. An imaging device that outputs an optical image of a subject as an electrical image signal,
First and second optical systems that are arranged side by side and each form a subject image;
Two subject images formed by the first and second optical systems are respectively captured to generate stereoscopic image data indicating a stereoscopic image, and the image data is converted into an electrical image signal. Imaging means to perform,
Amplifying means for amplifying the image signal;
The first and second optical systems are moved by moving at least one of the first or second optical systems in a direction perpendicular to the optical axis in accordance with the amplified gain. Changing means for changing the stereo base which is the distance between the optical axes of
An imaging apparatus comprising: A synthesis means for synthesizing the image,
The image signal includes first and second image signals having parallax,
When the amplification factor of the image signal exceeds a predetermined value, the first image signal and the second image signal are combined by the combining unit.
The imaging device according to claim 7. When the amplification factor of the image signal exceeds a predetermined value,
A notification means for notifying the user of the shooting state;
The imaging device according to claim 7. When the amplification factor of the image signal exceeds a predetermined value,
A guide unit that guides a user to shooting conditions that allow stereoscopic shooting;
The imaging device according to claim 7. The image signal is composed of three or more image signals having parallax.
The imaging device according to claim 7. An imaging device that outputs an optical image of a subject as an electrical image signal,
Imaging means for generating right-eye image data and left-eye image data indicating a stereoscopic image, and converting the image data into an electrical image signal;
Amplifying means for amplifying the image signal;
Parallax adjusting means for adjusting parallax between the image data for the right eye and the image data for the left eye according to the amplified amplification factor;
An imaging apparatus comprising: A synthesis means for synthesizing the image,
The image signal includes first and second image signals having parallax,
When the amplification factor of the image signal exceeds a predetermined value, the first image signal and the second image signal are combined by the combining unit.
The imaging device according to claim 12. When the amplification factor of the image signal exceeds a predetermined value,
A notification means for notifying the user of the shooting state;
The imaging device according to claim 12. When the amplification factor of the image signal exceeds a predetermined value,
A guide unit that guides a user to shooting conditions that allow stereoscopic shooting;
The imaging device according to claim 12. The image signal is composed of three or more image signals having parallax.
The imaging device according to claim 12.

Images