JP2017200061A - Imaging apparatus, control method, program and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging apparatus which allows for confirmation of more detailed focus state, when displaying a screen while enlarging for focus state confirmation, in an imaging apparatus having two image pick-up devices of different number of pixels.SOLUTION: A camera 100 has an image pick-up device 105 and an image pick-up device 106 having a lower resolution of image to be acquired than that of the image pick-up device 105. The image pick-up device 105 receives a first flux out of fluxes separated by a half mirror 130, and the image pick-up device 106 receives a second flux out of the fluxes separated by the half mirror 130. When a CPU 131 is displaying an image acquired from the image pick-up device 106, and a specified area of a part of the image acquired from the image pick-up device 106 is displayed while enlarging, an image acquired from the image pick-up device 105 is used as an image to be displayed while enlarging.SELECTED DRAWING: Figure 5

Description

  The present invention relates to an enlarged display of an image in an imaging apparatus including two imaging elements. The present invention also relates to a control method, a program, and a storage medium.

  2. Description of the Related Art Conventionally, a plurality of image sensors are provided, a light beam that has passed through an imaging optical system is separated into a plurality of light beams, and each image sensor that receives each separated light beam receives a signal so that each image sensor outputs a signal. Imaging devices that are possible are known.

  Patent Document 1 discloses an imaging apparatus that includes a first imaging element and a second imaging element, and the second imaging element has a smaller number of pixels than the first imaging element.

JP 2014-232137 A

  When enlarging display during live view or moving image recording for confirmation of the focus state, it is desirable to use an image with high resolution. In Patent Document 1, live view display and moving image recording are performed using an image based on a signal output from a second image sensor with a small number of pixels in order to increase the frame rate. However, Patent Document 1 does not consider enlarged display.

  Therefore, the present invention is to check the focus state in more detail when an image is enlarged and displayed, for example, for confirmation of the focus state, in an image pickup apparatus having two image pickup devices with different numbers of pixel portions. An object of the present invention is to provide an imaging apparatus capable of Moreover, it aims at providing the control method, a program, and a storage medium.

  The present invention includes a light beam separating unit that separates a light beam that has passed through the imaging optical system into a first light beam and a second light beam, and a plurality of pixel units, which receives the first light beam and outputs a signal. A second imaging device having a first imaging device and a plurality of pixel units, receiving the second light flux, and outputting a signal, wherein the number of pixel units is smaller than that of the first imaging device. And when the image magnification in the display means for displaying an image based on the signal output from the first image sensor or the second image sensor is smaller than a predetermined magnification, the second imaging An image based on a signal output from the element is displayed, and if an enlargement magnification of at least a part of the image on the display means is greater than or equal to the predetermined magnification, an image based on the signal output from the first image sensor is displayed. And a control means.

  As another aspect, the present invention includes a light beam separating unit that separates a light beam that has passed through the imaging optical system into a first light beam and a second light beam, and a plurality of pixel units, and the first light beam is A first image sensor that receives light and outputs a signal, and a plurality of pixel units, an image sensor that receives the second light flux and outputs a signal, the pixel being more pixels than the first image sensor. Based on a signal output from the second image sensor on a second image sensor having a small number of parts and display means for displaying an image based on the signal output from the first image sensor or the second image sensor In the case of displaying an image, when the designated area designated for a part of the image based on the signal output from the second image sensor is enlarged and displayed, the designated area is used as the image used for the enlarged display. The first imaging element for the associated region And control means for displaying an image based on the output signals from and having a.

  As another aspect, the present invention includes a light beam separating unit that separates a light beam that has passed through the imaging optical system into a first light beam and a second light beam, and a plurality of pixel units, and the first light beam is A first image sensor that receives light and outputs a signal, and an image sensor that has a plurality of pixel portions, receives the second light flux, and outputs a signal, and outputs more signals than the first image sensor. The second image sensor outputs a second image sensor having a low image resolution based on the signal to be output and a display means for displaying the image based on the first image sensor or the signal output by the second image sensor. In the case where an image based on the received signal is displayed, when the designated area designated for a part of the image based on the signal output from the second image sensor is enlarged and displayed, An image based on the signal output by one image sensor It characterized by having a Shimesuru control means.

  According to the present invention, in an imaging apparatus having two imaging elements having different numbers of pixels, for example, when an image is enlarged and displayed for confirmation of the focus state, the focus state can be confirmed in more detail. .

1 is a diagram illustrating a configuration example of an imaging apparatus according to Embodiment 1 and Embodiment 2. FIG. 6 is a diagram illustrating a configuration example of a video signal processing unit according to Embodiment 1 and Embodiment 2. FIG. 6 is a flowchart illustrating an example of an enlarged display of the imaging apparatus according to the first embodiment. 10 is a flowchart illustrating an example of an enlarged display of the imaging apparatus according to the second embodiment. 6 is a display example of an enlarged display screen according to Example 1 and Example 2. FIG. It is an example of a display of an enlarged display screen when exposure differs in image sensor 105 and image sensor 106.

[Example 1]
[Configuration Example of Camera 100]
An embodiment of the present invention will be described below with reference to FIG. FIG. 1 is a block diagram illustrating a configuration example of a camera 100 that is an imaging apparatus according to the present embodiment. The camera 100 is detachable from a lens (imaging optical system) that guides a light beam corresponding to the optical image of the subject to each part in the camera 100. Note that the present invention can be applied not only to the camera 100 but also to an imaging device in which a lens and a camera body are integrated. The lens 101 is a lens group 107 including a focus lens, a zoom lens, and the like, and guides a light beam that is an optical image of an incident subject to the half mirror 103. The lens 101 can be attached to and detached from the camera body via the mount 102.

  The lens control unit 141 controls driving of the lens 101. The lens control unit 141 controls the driving of the lens 101 to execute zoom, focus, and aperture control.

  The half mirror 103 (light beam separating means) separates the incident light beam into a first light beam and a second light beam (not shown), and the first light beam is sent to the image sensor 105 (first image sensor). The light beam is guided to the image sensor 106 (second image sensor).

  The image sensor 105 and the image sensor 106 are, for example, CMOS image sensors, and have a plurality of pixel portions. The image sensor 105 and the image sensor 106 receive a subject image that has passed through the lens 101 and photoelectrically convert it. In this embodiment, the image sensor 105 and the image sensor 106 can acquire phase difference type autofocus information. That is, in this embodiment, so-called imaging surface phase difference type focus detection can be performed. Note that focus detection in this embodiment is acquisition of a defocus amount. Examples of the imaging surface phase difference type focus detection and the configuration of the imaging device for realizing this are known, and are disclosed in, for example, Japanese Patent Application Laid-Open Nos. 2014-174460 and 2013-7998. Here, the description is simplified. In this embodiment, each of the imaging element 105 and the imaging element 106 includes a plurality of pixel units, and each of the plurality of pixel units includes a pair of photoelectric conversion units for one pixel unit. Further, each of the plurality of pixel portions has one microlens for each pixel portion. In this embodiment, the pair of signals photoelectrically converted by the pair of photoelectric conversion units has parallax. A signal having a pair of parallaxes is added to each of the plurality of pixel units to generate a pair of focus detection signals having a parallax. By using the pair of focus detection signals, the video signal processing unit 121 calculates the defocus amount.

  The shutter 104 is a focal plane shutter that adjusts the exposure time during still image shooting. In this embodiment, the exposure time of the image sensor 105 is adjusted by the focal plane shutter, and the exposure time of the image sensor 106 is adjusted by the electronic shutter function, but this is not restrictive. The imaging device 105 may have an electronic shutter function and adjust the exposure time with a control pulse. In this embodiment, it is assumed that the image sensor 105 mainly performs still image shooting and the image sensor 106 mainly performs moving image shooting. For this reason, in this embodiment, the image sensor 105 has a larger number of pixels than the image sensor 106, so that a high-resolution image can be acquired based on the signal output from the image sensor 105. However, a configuration may be employed in which a shutter for the image sensor 106 is provided and still image shooting is performed by the image sensor 106, and the applications of the image sensor 105 and the image sensor 106 are not limited.

  The video signal processing unit 121 performs signal processing on images output from the image sensor 105 and the image sensor 106. For example, digital image white balance, color interpolation, color correction, γ conversion, edge enhancement, resolution conversion, noise reduction processing, analysis of image brightness, contrast, phase difference AF information, etc., and processing the processed image Output to the memory 132.

  The analysis data output from the video signal processing unit 121 is used for exposure control and autofocus control.

  The still image encoding processing unit 122 receives an image arranged in the memory 132 as input, performs image compression represented by, for example, JPEG, and outputs the compressed still image to the memory 132 again.

  The moving image encoding processing unit 123 receives a plurality of images arranged in the memory 132 as an input, for example, H.264. Image compression represented by H.264 is performed, and the compressed moving image is output to the memory 132 again.

  In addition to the output image of the video signal processing unit 121, the memory 132 temporarily stores data when the CPU 131 performs various processes.

  A non-volatile memory (not shown) holds program data executed by the CPU 131.

  The timing generation unit 142 provides the image sensor 105, the image sensor 106, and the video signal processing unit 121 with timings such as accumulation operation and signal processing.

  In addition to the components described above, a lens controller 141, a power supply 110, a memory 132, a non-volatile memory (not shown), a display controller 151, a card input / output unit 171, and various switches are connected to the bus 150. .

  The various switches described above are the main switch 161, the first release switch 162, the second release switch 163, the enlargement / reduction change button 164, the moving image recording start / end button 165, the up / down / left / right selection button 166, and the enter button 167. It is.

  The power supply 110 supplies power to each circuit provided in the camera 100 via the bus 150.

  The display control unit 151 displays the display image stored in the memory 132 in accordance with the signal from the timing generation unit 142 via the bus 150 and is converted from the digital image by the D / A conversion unit 152. Is displayed. The converted analog image is displayed on an external display unit 156 provided outside via a display unit 153 such as a TFT having a liquid crystal display element, or a cable such as a VIDEO output terminal 154 or an HDMI (registered trademark) output terminal 155. Is done.

  An area inside the memory 132 in which the digital image is stored is referred to as VRAM. The display control unit 151 reads the VRAM in the memory 132 and performs the above-described processing, whereby the display analog image is updated on the display unit 153. The moving image can be displayed by continuously performing the above-described operation and continuously updating the display image on the display unit 153 or the external display unit 156.

  The card slot 172 can be inserted with a removable recording medium 173 such as an SD card. The recording medium 173 is electrically connected to the card input / output unit 171 while being inserted into the card slot 172. In this state, the image recorded in the memory 132 can be recorded on the recording medium 173. In addition, data recorded in the recording medium 173 can be read by the camera 100.

  The CPU 131 is connected to each unit in the camera 100 as described above via the bus 150, and is a control unit that comprehensively controls each unit in the camera 100. In this embodiment, the CPU 131 instructs the lens control unit 141, the timing generation unit 142, the video signal processing unit 121, and the display control unit 151 to control each unit in the camera 100. Note that the CPU 131 may be configured to control driving of each unit in the camera 100 without providing the control unit and the processing unit as described above. In addition, the configuration may be such that the control unit and the processing unit described above perform control (processing) in conjunction with each other without providing the CPU 131 to control driving of each unit in the camera 100.

[Basic operation of camera 100]
Hereinafter, the basic operation of the camera 100 which is the imaging apparatus according to the present embodiment will be described with reference to FIG. First, when the main switch 161 is turned on by the user, the power supply 110 supplies power to each unit constituting the camera 100. When power is supplied to each part of the camera 100, the image sensor 106 can photoelectrically convert the optical image of the subject that is guided to the image sensor 106 and is imaged.

  Next, an image is taken in periodically from the image sensor 106 (for example, 60 times per second), and after various processing is performed, the image is placed in the VRAM of the memory 132. As a result, images captured from the image sensor 106 can be sequentially displayed (live view) on the display unit 153.

  Next, when the user operates the up / down / left / right selection button 166 and the determination button 167, various parameters displayed on the GUI can be selected and set.

  Further, the user can operate the enlargement / reduction change button 164 to enlarge / reduce the display image.

  Next, when the user presses the moving image recording start / end button 165 during live view, recording of the moving image based on the signal output from the image sensor 106 is started or ended.

  Next, the first release switch 162 (hereinafter referred to as SW1) is turned on by a first stroke (half-pressed state) of a release button (not shown) to start preparation for photographing a subject. Here, as the details of the preparation for photographing, the above-described control of focus, zoom, aperture, etc. is executed as necessary by the driving control of the lens 101 by the lens control unit 141.

  Next, the second release switch 163 (hereinafter referred to as SW2) is turned on by a second stroke (fully pressed state) of a release button (not shown), and starts photographing the subject. Shooting here refers to acquiring an image to be recorded based on a signal output from the image sensor 105 or the image sensor 106. As details of photographing the subject, an optical image of the subject is photoelectrically converted by driving the shutter 104 and the image sensor 105, and an image subjected to various image processing is captured.

[Exposure Control and Focus Control of Camera 100 (Basic Operation of Camera 100)]
Hereinafter, exposure control and focus control of the camera 100 which is the imaging apparatus according to the present embodiment will be described with reference to FIG. FIG. 2 is a block diagram showing the flow of exposure control and focus control in the video signal processing unit 121 and the CPU 131. The video signal processing unit 121 and the CPU 131 have a first video signal processing unit 201, a first exposure detection unit 202 (first exposure detection unit), and a first focus detection unit 203 corresponding to the imaging element 105. In addition, the video signal processing unit 121 and the CPU 131 include a second video signal processing unit 211, a second exposure detection unit 212 (second exposure detection unit), and a second focus detection unit 213 corresponding to the image sensor 106. Further, the video signal processing unit 121 and the CPU 131 include an exposure control unit 221, an image sensor control unit 222, and a focus control unit 223.

  The first video signal processing unit 201 analyzes image brightness, contrast, phase difference AF information, and the like from the image output from the image sensor 105. The first video signal processing unit 201 outputs an analysis result such as image brightness to the first exposure detection unit 202 and an analysis result such as contrast and phase difference AF information to the first focus detection unit 203. The first exposure detection unit 202 performs exposure detection based on analysis data such as image brightness output from the first video signal processing unit 201, and outputs the analysis result to the exposure control unit 221. The first focus detection unit 203 performs focus detection based on analysis data such as contrast and phase difference AF information output from the first video signal processing unit 201, and outputs the analysis result to the focus control unit 223.

  The second video signal processing unit 211, the second exposure detection unit 212, and the second focus detection unit 213 respectively perform a first video signal processing unit 201, a first exposure detection unit 202, and a second focus detection unit 213 on the image output from the image sensor 106. Processing equivalent to that of the single focus detection unit 203 is performed.

  The exposure control unit 221 receives the analysis results output from the first exposure detection unit 202 and the second exposure detection unit 212 as input, calculates an exposure control value, and outputs the exposure control value to the image sensor control unit 222. If the exposure control mode includes automatic aperture control, the aperture value may be output to the lens control unit 141. The image sensor control unit 222 receives the exposure control value output from the exposure control unit 221 and controls the charge accumulation time of the image sensor 105 and the image sensor 106.

  The focus control unit 223 receives the analysis results output from the first focus detection unit 203 and the second focus detection unit 213 as input, calculates a focus control value, and outputs the focus control value to the lens control unit 141.

  The above is the basic operation of the camera 100 in the present embodiment.

[Enlarged display during live view display (Figure 3)]
Hereinafter, enlarged display during live view (also referred to as LV) display will be described with reference to the flowchart of FIG.

  This process is realized by the CPU 131 executing a program recorded in a nonvolatile memory (not shown).

  When the live view display is started, the CPU 131 determines whether or not the live view enlarged display is valid in S301, that is, whether or not the enlargement / reduction change button 164 has been operated. If yes, go to S311. Here, the live view enlarged display is a state in which the enlargement / reduction change button 164 is turned on during the live view (Lv). Note that the period from when the enlargement / reduction change button 164 is turned on until the enlargement display ends is also referred to as an enlargement display mode.

  When the enlargement / reduction change button 164 is turned on, enlargement display is performed for a designated area, which is an area designated as an enlargement display area. Further, the position of the area to be enlarged (designated area) can be moved with the up / down / left / right selection buttons 166. The designated area may be an area predetermined by the user. Further, for example, the CPU 131 (designation control unit) may control the designated area so that the center is the designated area, or the designated area may be designated so as to include the focus detection area up to immediately before.

  Further, the designated area may be directly designated by the user when performing enlarged display in the enlarged display mode. For example, when the enlargement / reduction change button 164 is turned on, an enlarged display frame 501 for designating an area to be enlarged (designated area) is displayed, and the area to be enlarged is moved by the up / down / left / right selection button 166. Also good. Furthermore, the enlargement / reduction change button 164 may be operated to change the enlargement magnification of the area to be enlarged and displayed.

  When the external display unit 156 has a touch panel, the enlargement display area may be moved by a drag operation on the screen, and the enlargement magnification of the enlargement display area may be changed by a pinch operation.

  The enlargement / reduction instruction and the movement of the enlargement display frame 501 need only be performed according to the purpose, and can be performed by a member other than the enlargement / reduction change button 164 and the up / down / left / right selection button 166 (eg, a lever, a ring, etc.). It may be done.

  In S302, the second video signal processing unit 211 performs various signal processing on the image output from the image sensor 106. For example, the second video signal processing unit 211 analyzes the white balance, color interpolation, color correction, γ conversion, edge enhancement, resolution conversion, noise reduction processing of the digital image, image brightness, contrast, phase difference AF information, and the like. Do. The processed image is output to the memory 132, the analysis result of the brightness of the image is output to the second exposure detection unit 212, and the analysis result of the contrast and phase difference AF information is output to the second focus detection unit 213. When live view enlargement display is not effective, an image based on the signal output from the image sensor 106 is used for display, so that a higher frame than when an image based on the signal output from the image sensor 105 is used for display is used. Live view can be displayed at a rate.

  In S303, the second focus detection unit 213 performs focus detection based on analysis data such as contrast and phase difference AF information output from the second video signal processing unit 211, and outputs the analysis result to the focus control unit 223. Proceed to At this time, in the automatic exposure control mode, the second exposure detection unit 212 performs exposure detection based on analysis data such as image brightness output from the second video signal processing unit 211, and controls the analysis result for exposure control. To the unit 221.

  In S304, the CPU 131 controls the display unit 153 to perform live view display (FIG. 5A) on the image captured from the image sensor 106, and the process proceeds to S305.

  In S311, the CPU 131 determines whether the moving image is being recorded. If the moving image is being recorded, the process proceeds to S322 and S332. If it is determined that the moving image is not being recorded, the process proceeds to S312.

  In S <b> 312, the video signal processing unit 121 reads an image from the image sensor 105. At this time, the CPU 131 (conversion unit) converts a designated area specified by the user or in advance and an area corresponding to the designated area in the image sensor 105 as an area to be enlarged and displayed in the image based on the signal output from the image sensor 106. Associate. The designated area is, for example, the area of the enlarged display frame 501 in FIG. As an example, the region obtained by the following Expression 1 is set as an image region (corresponding region) based on the signal output from the image sensor 105 corresponding to the designated region of the image based on the signal output from the image sensor 106. The CPU 131 controls to output the corresponding area to the first video signal processing unit 201, and the process proceeds to S313.

  In the conversion formula of Expression 1, the CPU 131 uses the number of pixels of the image sensor 105 and the number of pixels of the image sensor 106 to correspond the designated area of the image based on the signal output from the image sensor 106 and the corresponding area of the image sensor 106. Put it on. As shown in Expression 1, when the number of pixels of the image sensor 105 is a numerator, the number of pixels of the image sensor 106 is a denominator, and the x coordinate and the y coordinate of the designated area of the image sensor 106 are coordinates A (x, y), the image sensor A coordinate A ′ of the image sensor 105 corresponding to the coordinate A 106 can be obtained. At this time, instead of reading the entire area of the image sensor 105, only the area necessary for the enlarged display process may be read. As a result, the processing speed can be improved.

  In S313 to S314, the image sensor 105, the first video signal processing unit 201, the first focus detection unit 203, and the first exposure detection unit 202 perform processing equivalent to that in steps S303 to S304. Then, the CPU 131 (control unit) controls to display the live view enlarged image (FIG. 5B) on the display unit 153 (first display unit).

  In step S313, the video signal processing unit 121 performs focus detection using the focus detection signal output from the image sensor 105, and the lens control unit 141 controls driving of the lens 101 based on the focus detection result. Focus detection can be performed with higher accuracy by performing focus detection using a focus detection signal output from the image sensor 105 having a larger number of pixels than the image sensor 106. Since it is determined that the live view enlarged display is valid in S301, it is expected that the user wants to finely adjust the focus state, which matches the user's request.

  Further, during the processing from S312 to S314, the image reading processing based on the signal output from the image sensor 106 may be stopped. As a result, power consumption can be suppressed as compared with the case where both the image sensor 105 and the image sensor 106 are driven.

  In step S322, the video signal processing unit 121 performs white balance, color interpolation, color correction, γ conversion, edge enhancement, resolution conversion, noise reduction processing, and the like on the image output from the image sensor 106. The image is output to the memory 132.

  In S322, the moving image encoding processing unit 123 receives a plurality of images arranged in the memory 132 as an input, for example, H.264. Image compression represented by H.264 is performed, and the compressed moving image is output to the memory 132 again. Then, the compressed moving image recorded in the memory 132 is recorded on the recording medium 173.

  In S332 to S333, processing equivalent to S312 to S313 is performed and the process proceeds to S314. In S314, the live view enlarged image (FIG. 5B) is displayed, and the process proceeds to S305.

  In S305, the CPU 131 determines whether the live view display is continued. If it is continued, the process proceeds to S301, and if it is not continued, the live view process is terminated.

  As described above, in the present embodiment, when an image based on the signal output from the image sensor 106 is displayed, the designated area specified for a part of the image based on the signal output from the image sensor 106 is enlarged. indicate. At this time, an image based on a signal output from the image sensor 105 having a smaller number of pixels than the image sensor 106 is displayed as an image used for enlarged display. Thereby, in an imaging device having two imaging elements having different numbers of pixels, the focus state can be confirmed in more detail when an image is enlarged and displayed for confirmation of the focus state.

[Example 2]
In the first embodiment, only the enlarged image is displayed on the display unit 153 for the enlarged display during the live view. However, a composite image obtained by synthesizing the enlarged image may be displayed on a part of the normal image. The normal image here is an entire image of an image based on a signal output from the image sensor 105 or the image sensor 106.

  Hereinafter, a case where an enlarged image is combined with a normal image in live view and displayed will be described with reference to a flowchart of FIG.

  When the live view display is started, the CPU 131 determines in S501 whether the live view enlarged display is valid. If the enlarged display is invalid, the process proceeds to S402, and if valid, the process proceeds to S412 and S413.

  Steps S402, S403, S404, and S405 are the same as steps SS302, S303, S304, and S305 of the first embodiment, and thus the description thereof is omitted.

  Step S412 is the same as step S322, and steps S422 and S423 are the same processes as steps S312 and S313, respectively, and thus description thereof is omitted.

  In S414, the video signal processing unit 121 combines the normal image in S412 and the enlarged image in S422 and displays them as shown in FIG.

  In addition, when recording a moving image in a present Example, you may make it record a moving image based on the image read by S412, for example.

  As described above, according to the present embodiment, when an image is enlarged and displayed for confirmation of the focus state in the image pickup apparatus having two image pickup devices having different numbers of pixels, the focus state is more specifically set. Can be confirmed.

[Other variations]
In the first embodiment, the display of the normal image and the display of the enlarged image are performed by switching the display of the same display unit 153. However, the normal image and the enlarged image are displayed separately on the display unit 153 and the external display unit 156. Also good. In this case, an external display unit 156 (second display unit) is connected to the VIDEO output terminal 154 and the HDMI (registered trademark) output terminal 155 of the imaging apparatus. By displaying the enlarged image on the external display unit 156, the focus state can be confirmed in more detail.

  In the first and second embodiments, the case where the enlarged image is displayed based on the image based on the signal output from the imaging element 105 when the live view enlarged display is effective has been described. At this time, in consideration of the resolution of the display unit 153, when the magnification of the enlarged display is less than the predetermined magnification, the image based on the signal output from the image sensor 106 is enlarged. An image based on the signal output from the image sensor 105 may be displayed as an enlarged image. As an example of the predetermined magnification, the pixel equal magnification of the image sensor 106 may be set as a threshold value. While the focus state can be confirmed by the image based on the signal output from the image sensor 106, the image based on the signal output from the image sensor 106 is used, so that it is not necessary to switch the image sensor to be used until the predetermined magnification is reached.

  In the first embodiment and the second embodiment, when the sizes of the image sensor 106 and the image sensor 105 are different, an offset value (offset value) may be further set for the equation 1 described in the first embodiment (equation). 2). Thereby, it is possible to perform the association taking into account the difference in the size of the image sensor.

  In the first and second embodiments, when a moving image for recording is acquired based on the signal output from the image sensor 106 and focus detection is performed using the focus detection signal acquired from the image sensor 105, the image sensor The frame rate may be different between 105 and the image sensor 106. Specifically, the frame rate of the image sensor 105 may be higher than the frame rate of the image sensor 106. Since the frame rate during moving image recording is fixed to the frame rate of the moving image to be recorded, the focus detection signal is output at a frame rate higher than the frame rate of the moving image with the image sensor not used for moving image recording. This increases the number of times the focus detection signal is output, so that focus processing (focus detection and lens control) can be performed at high speed and with high accuracy. The same effect can be obtained by outputting the focus detection signal at a frame rate higher than the frame rate of the moving image with the image sensor not used for moving image recording during the live view. In order to increase the frame rate of the high-resolution imaging device 105, the reading of the imaging device 105 may partially read an area corresponding to the focus area of the low-resolution imaging device 106.

  In the first and second embodiments, the exposure control unit 221 varies the exposure between the image sensor 105 and the image sensor 106 based on the detection result of the first exposure detector 202 and / or the second exposure detector 212. As such, it may be controlled independently. The exposure here is determined by shutter speed, exposure time (charge accumulation time), ISO sensitivity, and the like. For example, when the exposure of the moving image based on the signal output from the image sensor 106 in S323 is equal to or greater than the predetermined exposure or less than the predetermined exposure, the image based on the signal output from the image sensor 105 displayed in S322 is focused. The exposure may be controlled so that it can be easily confirmed. That is, the exposure of the image sensor 105 that matches the focus adjustment different from the exposure setting of the image sensor 106 may be analyzed by the first exposure detection unit 202 and output to the exposure control unit 221. Specifically, when the CPU 131 (exposure determination unit) determines that the area within the enlargement frame of the normal image is equal to or greater than a predetermined exposure as shown in FIG. 6A, the image sensor as shown in FIG. 6B. The enlarged image 105 is controlled so that the exposure is lower than the image of the image sensor 106. On the other hand, when the CPU 131 determines that the image within the enlargement frame of the normal image is less than the predetermined exposure, the enlarged image of the image sensor 105 is controlled to have a higher exposure than the image of the image sensor 106. Thereby, even if it is difficult to confirm the focus state in the image of the image sensor 105 due to exposure, the focus state can be confirmed in more detail using the image of the image sensor 106.

  In the first and second embodiments, the case where the focus processing (focus detection and lens control) is automatically performed (so-called AF) has been described. However, the focus state may be manually adjusted by the user (so-called MF). At this time, S303, S313, and S333 are replaced with the MF operation by the user.

  Further, the present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program Can also be realized. Further, it can be realized by a circuit (for example, ASIC) that realizes one or more functions.

  As mentioned above, although preferable embodiment of this invention was described, this invention is not limited to these embodiment, A various deformation | transformation and change are possible within the range of the summary.

100 camera (imaging device)
103 Half mirror 105 Image sensor 106 Image sensor 131 CPU

Claims (24)

A light beam separating means for separating a light beam that has passed through the imaging optical system into a first light beam and a second light beam;
A first imaging device having a plurality of pixel portions, receiving the first light flux, and outputting a signal;
A second imaging device having a plurality of pixel portions, receiving the second light flux, and outputting a signal, wherein the number of pixel portions is smaller than that of the first imaging device;
The signal output from the second image sensor when the magnification of the image in the display means for displaying an image based on the signal output from the first image sensor or the second image sensor is smaller than a predetermined magnification. Control means for displaying an image based on a signal output from the first image sensor when an enlargement magnification of at least a part of the image on the display means is greater than or equal to the predetermined magnification; An imaging apparatus comprising:   The control means associates the designated area with the designated area as an image used for the enlarged display when the designated area designated for a part of the image based on the signal output from the second image sensor is enlarged and displayed. The image pickup apparatus according to claim 1, wherein an image based on a signal output from the first image pickup element is displayed for a region.   The control means displays a composite image of an image based on a signal output from the first image sensor corresponding to the designated area and an image based on a signal output from the second image sensor. The imaging device according to claim 1 or 2. Conversion means for associating the designated area of the image based on the signal output from the second image sensor with an area corresponding to the designated area in the first image sensor;
The converting means is configured to select the designated region of the image based on a signal output from the second image sensor and the first area based on a ratio of the number of pixels of the first image sensor to the number of pixels of the second image sensor Performing correspondence with a corresponding region in an image based on a signal output from one image sensor;
The said control means displays the image of the said 1st image pick-up element corresponding to the said designation | designated area | region based on matching of the said conversion means, The one of Claim 1 thru | or 3 characterized by the above-mentioned. Imaging device.   5. The image pickup apparatus according to claim 1, further comprising an exposure control unit that independently controls exposure of the first image sensor and the second image sensor. 6. When recording a moving image based on an image based on a signal output from the second image sensor, if the exposure of the image based on the signal output from the second image sensor is equal to or greater than a predetermined exposure, the exposure The control means controls the exposure of the image based on the signal output from the first image sensor to be lower than the exposure of the image based on the signal output from the second image sensor, and the second image sensor When the exposure of the image is less than a predetermined exposure, the exposure control means determines that the exposure of the image based on the signal output from the first image sensor is the exposure of the image based on the signal output from the second image sensor. Control to be higher than
The imaging apparatus according to claim 5, wherein the control unit performs an enlarged display using an image based on a signal output from the first imaging element.   7. The control unit according to claim 1, wherein the control unit enables an enlarged display of an image based on a signal output from the first image sensor on an external display unit different from the display unit. The imaging apparatus according to item 1.   The imaging apparatus according to claim 1, wherein the designated area is an area designated by a user.   The imaging apparatus according to claim 8, wherein the designated area is a designated area designated in advance before the enlarged display mode is set.   The designated area is an area designated by a user during an enlarged display mode when a designated area designated for a part of an image based on a signal output from the second image sensor is enlarged and displayed. The imaging device according to claim 8.   The imaging apparatus according to claim 1, further comprising a designation control unit that designates the designated area.   The imaging apparatus according to claim 11, wherein the designated area is an area including a center.   The imaging apparatus according to claim 11, wherein the designated area is an area including a focus detection area used for focus detection immediately before.   The image pickup apparatus according to claim 1, wherein a moving image is recorded based on a signal output from the second image pickup element. Focus detection means for performing phase difference type focus detection using a focus detection signal acquired from at least one of the first image sensor or the second image sensor;
The focus detection unit performs focus detection using a focus detection signal acquired from the first image sensor when the control unit displays an image acquired from the first image sensor. The imaging device according to any one of claims 1 to 14.   16. The imaging apparatus according to claim 15, wherein the phase difference type focus detection by the focus detection means is acquisition of a defocus amount by a phase difference type.   Each of the first image sensor and the second image sensor has a plurality of pixel units, and the plurality of pixel units have one microlens and a pair of photoelectric conversion units per pixel unit. The imaging device according to any one of claims 1 to 16.   When performing focus detection using a focus detection signal acquired from the first image sensor, the frame rate of the first image sensor is higher than the frame rate of the second image sensor. The imaging device according to any one of claims 1 to 17. A light beam separating means for separating a light beam that has passed through the imaging optical system into a first light beam and a second light beam;
A first imaging device having a plurality of pixel portions, receiving the first light flux, and outputting a signal;
An image pickup device that has a plurality of pixel portions, receives the second light flux, and outputs a signal, and has a second image pickup device with a smaller number of pixel portions than the first image pickup device. In the control method of the imaging device,
A display step of displaying an image based on a signal output from the first image sensor or the second image sensor on the first display unit;
When the magnification of the image in the display step is smaller than a predetermined magnification, an image based on the signal output from the second image sensor is displayed, and the magnification of at least a part of the image on the display means is the predetermined magnification And a control step of displaying an image based on the signal output from the first image sensor when the magnification is equal to or greater than the magnification.   The program for making a computer perform each step in the control method of the imaging device of Claim 19.   A storage medium for storing the program according to claim 20 so that the program can be read by a computer. A light beam separating means for separating a light beam that has passed through the imaging optical system into a first light beam and a second light beam;
A first imaging device having a plurality of pixel portions, receiving the first light flux, and outputting a signal;
A second imaging device having a plurality of pixel portions, receiving the second light flux, and outputting a signal, wherein the number of pixel portions is smaller than that of the first imaging device;
In the case where an image based on the signal output from the second image sensor is displayed on the display means for displaying an image based on the signal output from the first image sensor or the second image sensor, the second When the designated area designated for a part of the image based on the signal output from the image pickup element is enlarged and displayed, the first image pickup element for the area associated with the designated area is used as the image used for the enlarged display. Control means for displaying an image based on a signal output from the image pickup apparatus.   The control means uses the image based on the signal output from the first image sensor when the magnification of the enlarged display with respect to the image based on the signal output from the second image sensor is equal to or greater than a predetermined magnification. 23. The imaging apparatus according to claim 22, wherein enlarged display is performed, and when the magnification is less than the predetermined magnification, enlarged display is performed using an image based on a signal output from the second imaging element. A light beam separating means for separating a light beam that has passed through the imaging optical system into a first light beam and a second light beam;
A first imaging device having a plurality of pixel portions, receiving the first light flux, and outputting a signal;
An image pickup device having a plurality of pixel portions, receiving the second light flux, and outputting a signal, wherein the image pickup device has a lower image resolution based on the signal output from the first image pickup device. When,
In the case where an image based on the signal output from the second image sensor is displayed on the display means for displaying an image based on the signal output from the first image sensor or the second image sensor, the second Control means for displaying an image based on a signal output from the first image sensor as an image used for the enlargement when displaying a specified area specified for a part of an image based on a signal output from the image sensor An imaging device comprising:

Images