JP2013088559A - Imaging apparatus, imaging method, and finder device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To further accurately observe an image to be captured, through a finder without moving an entire finder unit.SOLUTION: The imaging apparatus includes: a first imaging element for capturing a first image; a finder optical system that has an optical axis different from that of an imaging optical system for guiding light to the first imaging element and forms an optical image observable through the finder; a second imaging element that acquires a second image from an optical image in a same range as the optical image observable through the finder; a control unit that performs a control such that an imaging range of the second imaging element includes the imaging range of the first imaging element; a detecting unit that detects an area in the second image corresponding to the first image; and a display unit that displays an image superimposed on the optical image, the image being generated based on the detection result of the area, corresponding to the first image, and representing the area within the optical image observable through the finder.

Description

  The present invention relates to an imaging apparatus, an imaging method, and a finder apparatus.

  In recent years, digital cameras that perform image processing on image data acquired by an image sensor and store the data in a recording medium or a built-in memory have become widespread. There are methods such as a reflex finder, an electronic view finder, and a range finder as a finder method for observing a subject when photographing with the digital camera.

  Among the above-mentioned finder methods, the range finder does not have the disadvantages of blackout with a single-lens reflex camera (reflex finder) or image display delay with an electronic finder. It is effective for. However, in the range finder, since a finder optical system having an optical axis different from that of the photographing optical system is used, a deviation between the optical image observable by the finder and the photographed image, that is, parallax is not generated. May occur. Therefore, there is a technique for suppressing the parallax.

  For example, in Patent Document 1, a common part between an image acquired from an imaging optical system and an image captured from a finder optical system is extracted, and the coordinates of the common part in both images are matched so that the entire finder unit is matched. A technique for adjusting the optical axis of a finder optical system by rotating the lens is disclosed.

JP, 2007-116271, A

  However, although the technique of the above-mentioned Patent Document 1 suppresses parallax and enables an optical image close to a photographed image to be observed with a finder, a driving mechanism for moving the entire finder unit is necessary. Greatly increases the size and cost. Further, the technique disclosed in Patent Document 1 does not completely match a photographed image with an optical image that can be observed with a viewfinder. That is, with this technique, the user cannot accurately observe the captured image.

  Therefore, the present invention proposes a new and improved imaging apparatus, imaging method, and finder apparatus that allow a photographed image to be more accurately observed without moving the entire finder unit.

  According to the present invention, the first imaging element for photographing that acquires the first image and the optical that has an optical axis different from that of the photographing optical system that guides light to the first imaging element and that can be observed with the viewfinder A finder optical system that forms an image, a second imaging element that acquires a second image from an optical image in the same range as an optical image that can be observed by the finder, and an imaging range of the second imaging element Based on a control unit that performs control to include the imaging range of the first imaging device, a detection unit that detects a region in the second image corresponding to the first image, and a detection result of the region An image pickup apparatus is provided that includes a display unit that superimposes and displays an image showing a region in an optical image that can be observed with the viewfinder corresponding to the first image.

  The finder optical system has a zoom function that allows the angle of view to be changed, and the control unit adjusts the angle of view of the finder optical system so as to be larger than the angle of view of the photographing optical system. The above control may be performed.

  The control unit may acquire information related to the angle of view of the photographing optical system and adjust the angle of view of the finder optical system based on the information.

  The control unit may also acquire information on the closest distance of the photographing optical system and adjust the angle of view of the finder optical system based on the information on the field angle and the information on the closest distance.

  The control unit may adjust an angle of view of the finder optical system based on a detection result of the region in the second image.

  The control unit may adjust the field angle of the finder optical system to a larger field angle when the region in the second image corresponds to a part of the first image.

  The display unit may display an image indicating a warning when the angle of view of the finder optical system cannot be adjusted to a larger angle of view.

  When the ratio of the size of the second image to the size of the region in the second image is equal to or greater than a predetermined threshold, the control unit reduces the angle of view of the finder optical system to a smaller angle of view. You may adjust it.

  The imaging apparatus may further include a changing unit that changes a control value related to the operation of the imaging apparatus using information on pixels included in the region in the second image.

  The change unit may change the control value when performing continuous shooting.

  The control value may be an exposure control value of the imaging apparatus.

  The control value may be a control value used for image processing of the first image.

  The control value used for the image processing may be a white balance gain used for white balance adjustment of the first image.

  The control value used for the image processing may be an enhancement coefficient used for the edge enhancement processing of the first image.

  In addition, according to the present invention, the first imaging device for photographing that acquires the first image has an optical axis different from that of the photographing optical system that guides light to the first imaging device, and can be observed with a finder. An imaging method in an imaging apparatus, comprising: a finder optical system that forms a simple optical image; and a second imaging element that acquires a second image from an optical image in the same range as the optical image that can be observed by the finder. , A step of performing control so that the imaging range of the second imaging element includes the imaging range of the first imaging element, and detecting a region in the second image corresponding to the first image A step of superimposing and displaying on the optical image an image showing a region in the optical image that can be observed with the finder corresponding to the first image, generated based on the detection result of the region; An imaging method is provided.

  According to the present invention, there is provided a finder device that can be attached to and detached from an imaging apparatus having a first imaging element for imaging to acquire a first image, and that is an imaging optical system that guides light to the first imaging element. A finder optical system that forms an optical image that can be observed by the finder, and a second imaging that acquires a second image from an optical image in the same range as the optical image that can be observed by the finder. Corresponding to the first image, a drive unit that drives the finder optical system in accordance with a control for including an image pickup range of the first image pickup element, an image pickup range of the element, and the second image pickup element An image showing a region in the optical image that can be observed with the finder corresponding to the first image, generated based on the detection result of the region in the second image, is superimposed and displayed on the optical image. And a finder device comprising: There is provided.

  In addition, according to the present invention, a finder that forms an optical image that has an optical axis different from that of the photographic optical system that guides light to the first imaging element for capturing the first image and that can be observed by the finder. An optical system, a second image sensor that acquires a second image from an optical image in the same range as the optical image that can be observed by the finder, and a display that displays the image superimposed on the optical image that can be observed by the finder And a finder device that can be attached to and detached from the imaging device, wherein the imaging range of the first imaging device and the second imaging device includes the imaging range of the first imaging device. A control unit for performing detection, a detection unit for detecting a region in the second image corresponding to the first image, and the finder corresponding to the first image generated based on a detection result of the region. Image showing the area in the optical image that can be observed with And a display control unit that superimposes to the optical image is displayed on the display unit of the finder, an imaging apparatus equipped with is provided.

  As described above, according to the imaging apparatus, the imaging method, and the finder apparatus according to the present invention, it is possible to more accurately observe a photographed image with the finder without moving the entire finder unit.

It is explanatory drawing which shows the 1st example of the schematic structure of the imaging system which concerns on one Embodiment. It is explanatory drawing which shows the 2nd example of schematic structure of the imaging system which concerns on one Embodiment. It is explanatory drawing for demonstrating an example of generation | occurrence | production of parallax. It is a block diagram which shows an example of a structure of the digital camera which concerns on one Embodiment. It is a block diagram which shows an example of a structure of the finder unit which concerns on one Embodiment. 5 is an explanatory diagram for describing a first example of an arrangement of a finder unit 200. FIG. It is explanatory drawing for demonstrating the 2nd example of arrangement | positioning of the finder unit 200. FIG. It is a block diagram which shows an example of a structure of the process part which concerns on one Embodiment. It is explanatory drawing for demonstrating an example of the extraction of a feature point, and collation of an image. It is explanatory drawing for demonstrating the 1st example of imaging | photography corresponding | compatible area | region. It is explanatory drawing for demonstrating the 2nd example of imaging | photography corresponding | compatible area | region. It is explanatory drawing for demonstrating the 3rd example of an imaging | photography corresponding | compatible area | region. It is explanatory drawing for demonstrating the 4th example of an imaging | photography corresponding | compatible area | region. It is explanatory drawing for demonstrating an example of the imaging | photography corresponding | compatible area | region after a view angle adjustment. It is explanatory drawing for demonstrating the 1st example of a region image. It is explanatory drawing for demonstrating the 2nd example of a region image. It is explanatory drawing for demonstrating the 3rd example of a region image. It is explanatory drawing for demonstrating an example of a warning image. It is explanatory drawing for demonstrating an example of the division | segmentation block of an imaging | photography corresponding area. It is explanatory drawing for demonstrating an example of the change of the exposure control value based on an imaging | photography corresponding | compatible area | region. It is a flowchart which shows an example of the schematic flow of the imaging process in one Embodiment. It is a flowchart which shows an example of the schematic flow of the control value change process in one Embodiment.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.

  Thereafter, <1. Introduction>, <2. Configuration of digital camera>, <3. Configuration of processing unit>, <4. Embodiments of the present invention will be described in the order of processing flow>.

<1. Introduction>
First, an example of a schematic configuration of an imaging system according to the present embodiment, and advantages and technical problems of the imaging apparatus will be described with reference to FIGS.

(Schematic configuration of imaging system)
With reference to FIG. 1 and FIG. 2, an example of a schematic configuration of an imaging system 1 according to an embodiment of the present invention will be described.

  FIG. 1 is an explanatory diagram illustrating a first example of a schematic configuration of an imaging system 1 according to the present embodiment. Referring to FIG. 1, the imaging system 1a includes a digital camera 100a and a photographing lens 300a. In the present embodiment, the digital camera 100a is an example of an imaging device.

  In the imaging system 1a, the photographing lens 300a is a lens that can be attached to and detached from the digital camera 100a. When the photographic lens 300a is attached to the digital camera 100a, the photographic lens 300a guides light incident on the photographic lens 300a to an image sensor in the digital camera 100a. In other words, the imaging lens 300a forms an optical image of the subject on the imaging surface of the imaging element in the digital camera 100a. The digital camera 100a converts the light guided to the image sensor into an electrical signal, and performs various processes on the electrical signal, thereby generating a digital image for recording.

  In the imaging system 1a, the finder unit 200a is a range finder type finder unit and is built in the digital camera 100a. The finder unit 200a guides light incident on the finder window 201a to a finder eyepiece window (not shown). In other words, the finder unit 200a forms an optical image of the subject on the finder eyepiece window. Thereby, the user can observe the optical image when looking into the viewfinder eyepiece window.

  FIG. 2 is a schematic diagram showing a second example of the appearance of the digital camera 100 in the present embodiment. Referring to FIG. 2, the imaging system 1b includes a digital camera 100b, a finder unit 200b, and a photographing lens 300b. In the present embodiment, the digital camera 100b is an example of an imaging device, and the finder unit 200b is an example of a finder device.

  The imaging system 1b differs from the imaging system 1a in that the finder unit 200b is an independent finder unit that can be attached to and detached from the digital camera 100b. However, the digital camera 100b, the finder unit 200b, and the photographing lens 300b basically operate in the same manner as the digital camera 100a, the finder unit 200a, and the photographing lens 300a. The digital camera 100b and the finder unit 200b can transmit and receive information via an interface as necessary.

(Advantages and technical issues of imaging devices)
The example of the schematic configuration of the imaging system 1 according to the present embodiment has been described above with reference to FIGS. 1 and 2. Next, the advantages and technical problems of the imaging system 1 will be described with reference to FIG. 3. Will be described.

  First, as an advantage, since the imaging system 1 includes the range finder type finder unit 200, the imaging system 1 is particularly effective for continuous shooting of a moving subject. This is because, in a single-lens reflex camera, a phenomenon in which light to the finder is blocked by driving a mirror at the time of shutter, that is, a blackout phenomenon occurs, but in the imaging system 1, the finder unit has an independent optical axis. Such a blackout phenomenon does not occur. Therefore, in the imaging system 1, even if the shutter is continuously released in continuous shooting, the user can continue to observe the subject without blocking the light. In the electronic viewfinder, image display delay occurs due to image processing required from photoelectric conversion in the image sensor to display in the finder. In the finder unit 200 of the imaging system 1, an optical image is formed. No delay occurs. Therefore, in the imaging system 1, the user can observe the moving subject without delay.

  The imaging system 1 has such advantages, but there are technical problems to be solved. More specifically, a range finder generally uses an optical system for a finder having an optical axis different from that of a photographing optical system. There is a possibility that a gap between them, that is, a parallax occurs. When the parallax occurs, the user cannot observe the entire photographed image with the viewfinder. In addition, even if the entire image to be photographed can be observed with the viewfinder, the user cannot know how much of the optical image that can be observed with the viewfinder corresponds to the image to be photographed. . Hereinafter, this point will be described more specifically with reference to FIG.

  FIG. 3 is an explanatory diagram for explaining an example of occurrence of parallax. Referring to FIG. 3, a range of images to be captured, that is, an imaging range 10 (hereinafter referred to as imaging range 10) of an imaging element for imaging, and an optical image range 20 that can be observed with a finder (hereinafter referred to as finder observation range 20). There is a gap between In this case, the user can observe the finder observation range 20 when looking into the finder eyepiece window. However, the user cannot observe the entire photographing range 10. Further, the user cannot observe the entire photographing range 10 and cannot know how much of the finder observation range 20 corresponds to the photographing range 10. As described above, when the range finder is employed, generally, the user cannot accurately observe the photographed image with the finder.

  Therefore, in the present embodiment, it is possible to observe a photographed image with a finder more accurately without moving the entire finder unit. Thereafter, <2. Configuration of Digital Camera>, <3. Configuration of processing unit> and <4. The specific contents of the processing flow> will be described.

<2. Digital camera configuration>
An example of the configuration of the digital camera 100 according to the present embodiment will be described with reference to FIGS. FIG. 4 is a block diagram illustrating an example of the configuration of the digital camera 100 according to the first embodiment. Referring to FIG. 4, a digital camera 100 is shown, and a photographing lens 300 is shown for explaining the digital camera 100. As an example, a finder unit 200 built in the digital camera 100 is shown as a part of the digital camera 100. In order to make the description easier to understand, the following description will be made in the order of the finder unit 200, the photographing lens 300, and the main body 101 of the digital camera 100.

(Finder unit 200)
FIG. 5 is a block diagram illustrating an example of the configuration of the finder unit 200 according to the present embodiment. Referring to FIG. 5, the finder unit 200 includes a finder window 201, a finder optical system 210, a finder eyepiece window 221, a motor 223, a driver 225, a CMOS image sensor (hereinafter referred to as CMOS) 230, an image input controller 235, a liquid crystal display (hereinafter referred to as “liquid crystal display”). , LCD) 240 and LCD driver 241. Here, the motor 223 is an example of a drive unit, the CMOS 230 is an example of a second image sensor, and the LCD 240 is an example of a display unit.

  The finder window 201 is a window through which light enters the finder unit 200. Since the positions of the finder window 201 and the photographing lens 300 are deviated, a deviation between the photographing range 10 and the finder observation range 20 occurs as described above.

  The finder optical system 210 has an optical axis different from that of an optical system that guides light to a CMOS 120 (described later) located in the main body 101 and forms an optical image (hereinafter referred to as a finder optical image) that can be observed with the finder. More specifically, for example, the finder optical system 210 forms an optical image that can be observed by the user through the finder eyepiece window 221 by refracting light incident from the finder window 201. The finder optical system 210 forms an optical image in the same range as the finder optical image on the imaging surface of the CMOS 230.

  More specifically, for example, the finder optical system 210 includes a zoom lens 211, a prism 213, an eyepiece lens 215, and a condenser lens 217.

  First, the zoom lens 211 enables adjustment of the angle of view of the finder optical system 210. More specifically, for example, the zoom lens 211 adjusts the angle of view of the finder optical system 210 by continuously changing the focal length by moving back and forth in the optical axis direction. The viewfinder observation range 20 can be changed by adjusting the angle of view. For example, the zoom lens 211 reduces the angle of view by increasing the focal length, and increases the angle of view by decreasing the focal length. In other words, the finder optical system 210 has a zoom function that allows the angle of view to be changed.

  The prism 213 guides the light from the zoom lens 211 toward the viewfinder eyepiece window 221 and the CMOS 230. The prism 213 guides light from the LCD 240 toward the viewfinder eyepiece window 221.

  The eyepiece lens 215 condenses the light from the prism 213 toward the viewfinder eyepiece window 221. The condensing lens 217 condenses the light from the prism 213 toward the imaging surface of the CMOS 230.

  Next, the viewfinder eyepiece window 221 is a window for the user of the digital camera 100 to observe the optical image of the subject. More specifically, the finder eyepiece window 221 allows the light that has passed through the zoom lens 211, the prism 213, and the eyepiece lens 215 to pass outside the finder unit 200. The finder eyepiece window 221 is mounted with, for example, protective glasses for eyepieces.

  The motor 223 drives the zoom lens 211 of the finder optical system 220. That is, the motor 223 moves the zoom lens 211 back and forth in the optical axis direction. Further, the driver 225 causes the motor 223 to drive the zoom lens 211 in accordance with control by a finder control unit 187 of the processing unit 170 described later. The motor 223 drives the finder optical system 220 in accordance with control for allowing the imaging range of the CMOS 230 to include the imaging range of the CMOS 120 described later. This point will be described in detail later together with the finder control unit 187.

  The CMOS 230 acquires a second image (hereinafter referred to as a finder side image) from an optical image in the same range as the finder optical image. More specifically, for example, the CMOS 230 converts light that has passed through the zoom lens 211, the prism 213, and the condenser lens 217 into an electrical signal. Next, the CMOS 230 removes the noise of the electric signal by a built-in correlated double sampling / amplifier circuit (hereinafter, CDS / AMP) 231 and amplifies the electric signal after the noise removal with a predetermined gain. Then, the CMOS 230 acquires an image of RAW data by digitally converting the amplified electric signal by an internal analog / digital converter (hereinafter referred to as ADC) 233.

  Note that the CDS / AMP 231 and the ADC 233 may be circuits externally connected to the CMOS 230 without being built in the CMOS 230. In this case, the CDS / AMP 231 may be further separated into a correlated double sampling circuit and an amplifier circuit. In addition, the CMOS 230 may adjust the electrical signal using an electronic shutter.

  The image input controller 235 writes the finder side image from the CMOS 230 into the SDRAM 139 described later.

The LCD 240 displays an image superimposed on the finder optical image. For example, the LCD 240 displays an image in accordance with control by a display control unit 191 of the processing unit 170 described later. Specific contents of the displayed image will be described in detail later together with the display control unit 191.
It may be.

  The LCD driver 241 displays an image on the LCD 240 by applying a voltage to the display cell of the LCD 240 based on the image signal. For example, the LCD driver 241 acquires an image signal output by a display control unit 191 of the processing unit 170 described later.

-Arrangement of viewfinder unit 200-
The configuration of the finder unit 200 has been described above. Next, a first example and a second example of the arrangement of the finder unit 200 will be described with reference to FIGS. 6 and 7.

  First, FIG. 6 is an explanatory diagram for explaining a first example of the arrangement of the finder unit 200. Referring to FIG. 6, in the finder unit 200, a finder window 201, a zoom lens 211, a prism 213, an eyepiece lens 215, and a finder eyepiece window 221 are linearly arranged in one direction. In addition, the LCD 240, the prism 213, the condenser lens 217, and the CMOS 230 are linearly arranged in a direction perpendicular to the one direction.

  In this case, the light 51 incident from the finder window 201 first passes through the zoom lens 211. A part of the light 51 passes through the prism 213 and the eyepiece lens 215 and reaches the finder eyepiece window 221. On the other hand, the remainder of the light 51 is refracted by the prism 213, passes through the condenser lens 217, and reaches the CMOS 230. Thus, the finder optical system 210 forms the finder optical image on the finder eyepiece window 221, and the CMOS 230 can acquire an image from the optical image in the same range as the finder optical system.

  The light 53 of the image displayed on the LCD 240 is refracted by the prism 213, passes through the eyepiece lens 215, and reaches the viewfinder eyepiece window 221. In this manner, the LCD 240 can display an image superimposed on the viewfinder optical image by the light 51.

  Next, FIG. 7 is an explanatory diagram for explaining a second example of the arrangement of the finder unit 200. Referring to FIG. 7, in the finder unit 200, the zoom lens 211, the prism 213, the condenser lens 217, and the CMOS 230 are linearly arranged in one direction. In addition, the LCD 240, the prism 213, the eyepiece lens 215, and the viewfinder eyepiece window 221 are linearly arranged in a direction perpendicular to the one direction.

  In this case, the light 51 incident from the finder window 201 is reflected by the mirror and first passes through the zoom lens 211. A part of the light 51 passes through the prism 213 and the condenser lens 217 and reaches the CMOS 230. On the other hand, the remainder of the light 51 is refracted by the prism 213, passes through the eyepiece lens 215, and reaches the viewfinder eyepiece window 221. Thus, the finder optical system 210 forms the finder optical image on the finder eyepiece window 221, and the CMOS 230 can acquire an image from the optical image in the same range as the finder optical system.

  The light 53 of the image displayed on the LCD 240 passes through the prism 213 and the eyepiece lens 215 and reaches the viewfinder eyepiece window 221. In this manner, the LCD 240 can display an image superimposed on the viewfinder optical image by the light 51.

(Shooting lens 300)
Next, the configuration of the photographing lens 300 will be described. Referring to FIG. 4, the photographing lens 300 includes a photographing system optical system 310, an ADC 321, motors 323 and 325, drivers 327 and 329, a lens processing unit 330, a ROM 340 and a RAM 350.

  The imaging optical system 310 guides light to a CMOS 120 (described later) located in the main body 101 of the digital camera 100. That is, the imaging system optical system 310 forms an optical image on the imaging surface of the CMOS 120.

  More specifically, for example, the photographing system optical system 310 includes a zoom lens 311, a diaphragm 313, and a focus lens 315.

  First, the zoom lens 311 enables adjustment of the angle of view of the photographing optical system 310. More specifically, for example, the zoom lens 311 adjusts the angle of view of the photographing optical system 310 by continuously changing the focal length by moving back and forth in the optical axis direction. By adjusting the angle of view, the imaging range of the imaging CMOS 120, that is, the imaging range 10 can be changed. For example, the zoom lens 311 reduces the angle of view by increasing the focal length, and increases the angle of view by decreasing the focal length. Here, the zoom lens 311 is moved back and forth in the optical axis direction manually, for example. The zoom lens 311 may be driven to move back and forth in the optical axis direction under the control of the digital camera 100.

  The diaphragm 313 adjusts the amount of light guided to the CMOS 120 by changing the size of the hole by opening and closing operations.

  The focus lens 315 adjusts the focus of the subject by moving back and forth in the optical axis direction.

  Next, the ADC 321 acquires an electrical signal according to the back-and-forth movement of the zoom lens 311 in the optical axis direction, converts the electrical signal to digital, and outputs information related to the focal length to the lens processing unit 330.

  The motor 323 drives the diaphragm 313. That is, the motor 323 opens and closes the diaphragm 313. The motor 325 drives the focus lens 315. That is, the motor 323 moves the focus lens 315 back and forth in the optical axis direction.

  The driver 327 causes the motor 323 to drive the diaphragm 313 in accordance with control by a lens processing unit 330 described later. The driver 329 causes the motor 325 to drive the focus lens 315 in accordance with control by a lens processing unit 330 described later.

  The lens processing unit 330 performs various information processing such as control and calculation in the photographing lens 300.

  For example, the lens processing unit 330 transmits information regarding the photographing optical system 310 to the digital camera 100. More specifically, for example, the lens processing unit 330 acquires information on the focal length output by the ADC 321 and specifies the focal length of the zoom lens 311. Then, the lens processing unit 330 transmits the focal length of the zoom lens 311 to the digital camera 100 as information regarding the angle of view of the photographing optical system 310. In addition, the lens processing unit 330 transmits, for example, the closest distance of the photographing optical system 310, the latest aperture value, the latest focus position, and the like to the digital camera 100. The lens processing unit 330 communicates with the digital camera via an SIO (Serial Input / Output) 331. The SIO 331 is an interface that enables two-way simultaneous communication between the lens processing unit 330 and the digital camera 100.

  For example, the lens processing unit 330 controls the photographing optical system 310 in accordance with an instruction from the digital camera 100. More specifically, the lens processing unit 330 receives a determined aperture value (hereinafter, “F value”) from the digital camera 100, for example. Then, the lens processing unit 330 calculates a necessary amount of opening / closing operation of the aperture 313 from the determined aperture value and the actual aperture value at that time, and instructs the driver 327 to perform the opening / closing operation of the necessary amount. . The lens processing unit 330 receives the calculated proper focus position from the digital camera 100, for example. Then, the lens processing unit 330 calculates the necessary amount of forward and backward movement of the focus lens 315 from the calculated proper focus position and the actual focus position at that time, and moves the necessary amount forward and backward. The driver 329 is instructed.

  The lens processing unit 330 is mounted by, for example, a CPU (Central Processing Unit).

  The ROM 340 stores programs and calculation parameters used by the lens processing unit 330.

  The RAM 350 is used as a work memory for the lens processing unit 330 to develop a program when the program is executed, and is also used as a buffer memory for temporarily recording data.

(Main body 101 of digital camera 100)
Next, the configuration of the main body 101 of the digital camera 100 will be described. Referring to FIG. 4, the main body 101 includes a mechanical shutter 110, a motor 111, a driver 113, a CMOS 120, an image input controller 125, a battery 131, a nonvolatile memory 133, a compression processing unit 135, a VRAM 137, an SDRAM 139, an operation unit 141, and an LCD 150. , An LCD driver 151, a recording medium 160, a media controller 161, and a processing unit 170. Here, the CMOS 120 is an example of a first image sensor.

  The mechanical shutter 110 blocks the light incident through the photographing lens 300 or allows the light to pass in the direction of the CMOS 120 by an opening / closing operation.

  The motor 111 drives the mechanical shutter 110. That is, the motor 111 opens and closes the mechanical shutter 110. Further, the driver 113 causes the motor 111 to drive the mechanical shutter 110 in accordance with control by the processing unit 170 described later.

  The CMOS 120 is an imaging element for imaging that acquires a first image (hereinafter referred to as an imaging side image) from light guided by the imaging optical system 310 of the imaging lens 300. More specifically, the CMOS 120 converts light from the photographing lens 300 into an electrical signal. Here, the CMOS 120 adjusts an electric signal by, for example, an electronic shutter. Next, the CMOS 120 removes the noise of the electric signal by the built-in CDS / AMP 121, and amplifies the electric signal after the noise removal with a predetermined gain. Then, the CMOS 120 acquires an image of the RAW data by digitally converting the amplified electric signal by the ADC 123.

  The image input controller 125 writes the photographing side image from the CMOS 120 into the SDRAM 139.

  The battery 131 supplies power to the digital camera 100 and the photographing lens 300.

  The nonvolatile memory 133 stores information that should be temporarily or permanently stored in the digital camera 100. For example, the non-volatile memory 133 stores a recording-side image for recording, software executed by the processing unit 170, and the like. Note that the nonvolatile memory 133 is implemented by, for example, a flash memory, an MRAM (Magnetoresistive Random Access Memory), or the like.

  The compression processing unit 135 compresses the image processed by the image processing unit 195 of the processing unit 170 into image data of an appropriate format. The image compression format may be a reversible format or an irreversible format. As an example of an appropriate format, the compression processing unit 135 may convert an image into a JPEG (Joint Photographic Experts Group) format or a JPEG2000 format.

  VRAM 137 temporarily stores the contents displayed on LCD 150 and LCD 240. The resolution and the maximum number of colors of the LCD 150 and LCD 240 depend on the capacity of the VRAM 137. The VRAM 137 may be separated into a VRAM for the LCD 150 and a VRAM for the LCD 240.

  The SDRAM 139 is used as a work memory for the processing unit 170 to develop a program when the program is executed, and is also used as a buffer memory for temporarily recording data. For example, the SDRAM 139 temporarily stores a shooting side image and a viewfinder side image. The SDRAM 139 has a storage capacity sufficient to store a plurality of images. Writing of an image to the SDRAM 139 is controlled by the image input controllers 125 and 235.

  The operation unit 141 includes members for performing various settings relating to operation of the digital camera 100 and photographing. Members of the operation unit 141 may include a power button, a cross key and a selection button for selecting a shooting mode, a shutter button for starting a shooting operation of the subject, and the like. The operation unit 141 outputs information indicating the operation result to the processing unit 170.

  The LCD 150 displays various setting screens of the digital camera 100, captured images (that is, recorded recording-side images), and the like. Further, the LCD 150 may display, as an electronic viewfinder, a shooting-side image that is continuously acquired before the shutter is released in real time.

  The LCD driver 151 displays an image on the LCD 150 by applying a voltage to the display cell of the LCD 150 based on the image signal. For example, the LCD driver 151 acquires an image signal output by a display control unit 191 of the processing unit 170 described later.

  The recording medium 160 records a photographed image (that is, a recorded photographing side image). The recording medium 160 is a memory card, for example.

  The media controller 161 controls input / output of images to the recording medium 160.

  The processing unit 170 performs various information processing such as control and calculation in the digital camera 100 and the photographing lens 300.

  The configuration of the main body 101, the finder unit 200, and the photographing lens 300 of the digital camera 100 has been described above. Next, the processing unit 170 provided in the main body 101 that plays an important role in the present embodiment will be described. This will be described in more detail.

<3. Configuration of processing unit>
Here, an example of the configuration of the processing unit 170 provided in the main body unit 101 of the digital camera 100 will be described with reference to FIGS. FIG. 8 is a block diagram illustrating an example of the configuration of the processing unit 170 according to the present embodiment. Referring to FIG. 8, the processing unit 170 includes a timing generator 171 (hereinafter referred to as TG 171), an input / output interface 173 (hereinafter referred to as I / O 173), an SIO 175, an automatic exposure control unit 177 (hereinafter referred to as AE control unit 177), an automatic focus. A control unit 179 (AF control unit 179), an appropriate white balance calculation unit 181 (hereinafter, appropriate WB calculation unit 181), an appropriate edge strength calculation unit 183, an area detection unit 185, a finder control unit 187, a finder image generation unit 189, a display A control unit 191, a control value changing unit 193, and an image processing unit 195 are included.

  Here, the finder control unit 187 is an example of a control unit, the region detection unit 185 is an example of a detection unit, and the control value change unit 193 is an example of a change unit.

(TG171)
The TG 171 controls the operation timing of the CMOS 120. More specifically, for example, the TG 171 controls the timing of the electronic shutter of the CMOS 120, that is, the timing of charge reading and resetting in the CMOS 120.

(I / O173)
The I / O 173 is an input / output interface between the processing unit 170, the driver 113, and the CMOS 120. For example, the I / O 173 is used for an instruction from the AE control unit 177 to the driver 113 or the CMOS 120.

(SIO175)
The SIO 175 is an interface that enables simultaneous communication between the processing unit 170 and the photographing lens 300 in both directions.

(AE control unit 177)
The AE control unit 177 automatically controls the exposure of the digital camera 100. More specifically, for example, the AE control unit 177 calculates an appropriate exposure value (hereinafter, EV value) based on the pixel information of the photographing side image. As an example, the appropriate EV value is calculated from the luminance average value for each divided block of the shooting-side image. Then, the AE control unit 177 sets a new exposure control value based on the calculated appropriate EV value. The exposure control value includes an EV value, an F value, a shutter speed, and ISO sensitivity.

  Here, when the F value changes, the AE control unit 177 instructs the photographing lens 300 to realize the determined F value via the SIO 175, for example. As described above, the AE control unit 177 automatically controls the aperture 313.

  Further, when the shutter speed changes, the AE control unit 177 instructs, for example, the driver 113 that drives the mechanical shutter 110 and the TG 171 that controls the timing of the electronic shutter of the CMOS 120 to realize the determined shutter speed. As described above, the AE control unit 177 automatically controls the electronic shutter in the mechanical shutter 110 and the CMOS 120.

  When the ISO sensitivity changes, the AE control unit 177 calculates the gain of the electric signal in the CDS / AMP 121 of the CMOS 120 according to the ISO sensitivity, for example. Then, the AE control unit 177 instructs the CMOS 120 via the I / O 173 to realize the calculated gain. As described above, the AE control unit 177 automatically controls the CDS / AMP 121 that determines the ISO sensitivity.

(AF control unit 179)
The AF control unit 179 automatically controls the focus of the digital camera 100. More specifically, for example, the AF control unit 179 calculates an appropriate focus position. Then, the AF control unit 179 instructs the photographing lens 300 to realize the calculated proper focus position via the SIO 175.

(Appropriate WB calculation unit 181)
The appropriate WB calculation unit 181 automatically calculates an appropriate WB gain used for white balance (hereinafter referred to as WB) adjustment of the recording-side image to be recorded. More specifically, for example, the appropriate WB calculation unit 181 calculates an appropriate WB gain from the R / G / B average value for each divided block of the shooting-side image. Then, the appropriate WB calculation unit 181 instructs the image processing unit 195 to set the WB gain to the appropriate WB gain.

(Adaptive edge strength calculation unit 183)
The appropriate edge strength calculation unit 183 automatically calculates an appropriate enhancement coefficient used for edge enhancement processing of the recorded image on the photographing side. More specifically, for example, the appropriate edge strength calculation unit 183 calculates an appropriate enhancement coefficient from the frequency characteristics of the shooting-side image. Then, the appropriate edge strength calculation unit 183 instructs the image processing unit 195 to set the enhancement coefficient to the appropriate enhancement coefficient.

(Area detection unit 185)
The area detection unit 185 detects an area in the finder side image corresponding to the shooting side image (hereinafter referred to as a shooting corresponding area). Here, as described above, the viewfinder-side image acquired by the CMOS 230 is acquired from an optical image in the same range as the viewfinder optical image, and thus can be said to be an image showing the range of the viewfinder optical image, that is, the viewfinder observation range 20. . Therefore, the region in the finder optical image corresponding to the photographing side image can be specified by detecting the region in the finder side image corresponding to the photographing side image.

  More specifically, for example, the region detection unit 185 first extracts a plurality of feature points common to the shooting-side image and the viewfinder-side image, and collates both images based on the plurality of feature points. Thus, the photographing corresponding area is detected. The detection is realized by using, for example, a SIFT (Scale-Invariant Feature Transform) algorithm. According to the SIFT algorithm, even if the magnification and angle between images are different, both images can be accurately verified. Hereinafter, an example of feature point extraction and image matching will be described with reference to FIG.

  FIG. 9 is an explanatory diagram for explaining an example of feature point extraction and image matching. Referring to FIG. 9, a shooting side image 30 and a viewfinder side image 40 are shown. The area detection unit 185 extracts, for example, a plurality of feature points 31 and 41 that are common between images. Here, the feature points 31a, 31b, 31c, 31d and 31e of the photographing side image 30 and the feature points 41a, 41b, 41c, 41d and 41e of the finder side image 40 are common between the images. Then, the area detection unit 185 collates both images based on the feature point 31 and the feature point 41. As a result, an imaging corresponding area is obtained.

  Next, a specific example of the imaging corresponding area will be described with reference to FIGS.

  FIG. 10 is an explanatory diagram for describing a first example of the imaging corresponding region 43. Referring to FIG. 10, a shooting corresponding area 43a is shown in the finder side image 40a. The photographing corresponding region 43a corresponds to the entire photographing side image 30. Therefore, it can be seen from the detected photographing corresponding region 43a that the range of the finder optical image, that is, the finder observation range 20, includes the imaging range of the photographing CMOS 120, that is, the photographing range 10.

  FIG. 11 is an explanatory diagram for describing a second example of the imaging corresponding area 43. Referring to FIG. 11, a shooting corresponding region 43b that substantially matches the viewfinder side image 40b is shown. Therefore, it can be seen from the detected photographing corresponding region 43b that the finder observation range 20 substantially matches the photographing range 10.

  FIG. 12 is an explanatory diagram for describing a third example of the imaging corresponding area 43. Referring to FIG. 12, a shooting corresponding area 43c is shown in the finder side image 40c. However, the shooting corresponding area 43 c corresponds to only a part of the shooting side image 30. Therefore, it can be seen from the detected photographing corresponding region 43 c that the finder observation range 20 does not include the photographing range 10. That is, it can be seen that the entire imaging-side image 30 cannot be observed with the finder.

  FIG. 13 is an explanatory diagram for describing a third example of the imaging corresponding area 43. Referring to FIG. 13, a shooting corresponding area 43d is shown in the viewfinder side image 40d. However, the size of the photographing corresponding area 43d is very small compared to the size of the viewfinder side image 40d. That is, the ratio of the size of the viewfinder side image 40d to the size of the shooting corresponding area 43d is equal to or greater than a predetermined threshold. Therefore, it can be seen from the detected photographing corresponding region 43d that the finder field ratio (ratio of the size of the finder optical image range to the size of the imaging range of the photographing CMOS 120) is too large. That is, it can be seen that it is difficult to observe the imaging-side image 30 with the viewfinder.

  As described above, the area detection unit 185 detects the imaging corresponding area 43. Then, the area detection unit 185 outputs the detected shooting corresponding area 43 as a detection result to the finder control unit 187, the finder image generation unit 189, and the control value change unit 193. Further, when the shooting corresponding area 43 corresponds to a part of the shooting side image 30 as shown in FIG. 12, for example, the area detection unit 185 causes the finder control unit 187 to send the entire shooting side image 30 and the viewfinder side image 40. The positional relationship is also output. Further, as shown in FIG. 13, when the ratio of the size of the finder-side image 40d to the size of the shooting-corresponding region 43d is equal to or larger than a predetermined threshold, the area detection unit 185 causes the finder control unit 187 to set the above ratio. Information indicating that the threshold was exceeded is also output.

(Finder control unit 187)
The finder control unit 187 performs control so that the imaging range of the CMOS 230 includes the imaging range of the CMOS 120 for photographing. That is, with reference to FIG. 3, the control is for the viewfinder observation range 20 that is the range of the viewfinder optical image to include the shooting range 10 that is the shooting range of the CMOS 120 for shooting. More specifically, since the finder optical system 210 has a zoom function that enables the change of the angle of view, the finder control unit 187 has, for example, a finder optical system that is larger than the angle of view of the photographing optical system 310. The above control is performed by adjusting the angle of view 210. According to such control, it is possible to include the photographing range 10 in the finder observation range 20 without moving the finder unit 200 as a whole. Hereinafter, a specific example of control by the finder control unit 187 will be described.

  For example, the finder control unit 187 acquires information related to the angle of view of the photographing optical system 310 and adjusts the angle of view of the finder optical system 210 based on the information. More specifically, for example, the finder control unit 187 acquires the focal length of the zoom lens 311 as information related to the angle of view of the photographing optical system 310 from the photographing lens 300 via the SIO 175. Next, for example, the finder control unit 187 determines the focal length of the zoom lens 311 and the zoom lens 211 that are set in advance so that the field angle of the finder optical system 210 is slightly larger than the field angle of the photographing optical system 310. Refer to the focal length and correspondence relationship. Then, the finder control unit 187 determines the focal length of the zoom lens 211 based on the correspondence relationship. Here, the finder control unit 187 calculates the required amount of forward / backward movement of the zoom lens 211 from the calculated focal length and the actual focal length at that time, and performs the required forward / backward movement of the finder unit 200. The driver 225 is instructed. According to such adjustment of the angle of view, the photographing range 10 can be included in the finder observation range 20 with a certain degree of accuracy by a simple process of acquiring information related to the angle of view of the photographing optical system 310. In addition, for example, when the focal length or angle of view of the finder optical system 210 is not adjusted, it is different from a desired value, or when the focal length or angle of view of the photographing optical system 310 changes abruptly. However, the imaging range 10 can be included in the finder observation range 20 quickly and with a certain degree of accuracy.

  The correspondence relationship between the focal lengths of both zoom lenses can be determined as follows. First, the angle of view of the photographing optical system 310 is calculated from the focal length of the zoom lens 311 and the size of the CMOS 120. Next, an angle of view slightly larger than the angle of view of the photographing optical system 310 is determined as the angle of view of the finder optical system 210. Then, the focal length of the zoom lens 211 corresponding to the determined angle of view of the finder optical system 210 is calculated. In this manner, the correspondence between the focal length of the zoom lens 311 and the focal length of the zoom lens 211 can be determined. In addition, although the case where the correspondence relationship of the focal length is determined in advance has been described, the finder control unit 187 may calculate the focal length of the zoom lens 211 from the focal length of the zoom lens 311 each time.

  The finder control unit 187 also acquires, for example, information related to the closest distance of the photographing optical system 310 and adjusts the angle of view of the finder optical system 210 based on the information related to the angle of view and the information related to the closest distance. To do. More specifically, for example, the finder control unit 187 increases the angle of view of the finder optical system 210 when the closest distance is smaller, and displays the image of the finder optical system 210 when the closest distance is larger. Make the corner smaller. That is, in the above correspondence relationship between the focal length of the zoom lens 311 and the focal length of the zoom lens 211, if the focal length of the zoom lens 311 is the same, the shorter the closest distance, the shorter the focal length of the zoom lens 211. Become. The following is an example of a part of the correspondence relationship for each closest distance.

  According to such adjustment of the angle of view, the angle of view of the finder optical system 210 can be adjusted to a more appropriate angle of view. That is, when the closest distance is shorter, the angle of view of the finder optical system 210 can be increased. As a result, even if a closer subject may be photographed because the closest distance is short, the view angle of the finder optical system 210 is increased according to the closest distance, so that the finder observation range can be obtained with higher accuracy. 20 can include the imaging range 10. Further, when the closest distance is longer, the field angle of the finder optical system 210 can be made smaller. As a result, the view angle of the finder optical system 210 is adjusted to an unnecessarily large angle of view even though the closest subject is not photographed because the closest distance is long, so that the viewfinder field ratio is more than necessary. Can be avoided.

  As described above, the field angle adjustment method of the finder optical system 210 based on the information related to the field angle of the photographing optical system 310 has been described. Next, an adjustment method used in combination with or instead of the angle-of-view adjustment method will be described.

  The finder control unit 187 adjusts the angle of view of the finder optical system 210 based on, for example, the detection result of the shooting corresponding area 43 in the finder side image 40. A first example and a second example of the angle of view adjustment method based on such a detection result will be described below.

  First, as a first example, the finder control unit 187 increases the angle of view of the finder optical system 210 when the shooting corresponding area 43 in the finder side image 40 corresponds to a part of the shooting side image 30. Adjust to. That is, the viewfinder control unit 187 adjusts the angle of view of the viewfinder optical system 210 to a larger angle of view when the viewfinder observation range 20 does not include the shooting range 10.

  More specifically, for example, when the shooting-corresponding region 43 in the finder-side image 40 corresponds to a part of the shooting-side image 30, the finder control unit 187 determines the entire shooting-side image 30 from the region detection unit 185. The positional relationship with the viewfinder side image 40 is acquired. Then, the finder control unit 187 can include the photographing range 10 in the finder observation range 20 based on the positional relationship between the entire photographing side image 30 and the finder side image 40 and the angle of view of the finder optical system 210 at that time. An appropriate angle of view of the finder optical system 210 is calculated. For example, the appropriate angle of view can be calculated by simulating a change in the photographing corresponding region 43 when the angle of view of the finder optical system 210 is gradually increased from the angle of view at that time. Then, the finder control unit 187 calculates the shift amount of the focal length necessary for adjusting the angle of view of the finder optical system 210 at that time to the appropriate angle of view. Thereafter, the finder control unit 187 instructs the driver 225 of the finder unit 200 to change the focal length of the finder optical system 210 by the shift amount. The result of the adjustment of the angle of view will be described with reference to FIG.

  FIG. 14 is an explanatory diagram for explaining an example of the photographing corresponding region 43 after the angle of view adjustment. As a premise, FIG. 12 shows a shooting corresponding area 43 before the angle of view adjustment. Referring to FIG. 12, the shooting corresponding area 43 c corresponds to only a part of the shooting image 30. That is, the finder observation range 20 cannot include the shooting range 10. Referring to FIG. 14, as a result of adjusting the angle of view of the finder optical system 210 to an appropriate angle of view, the shooting corresponding region 43 c corresponds to the entire shooting image 30. That is, the finder observation range 20 includes the entire shooting range 10.

  By adjusting the angle of view as described above, the shooting range 10 can be more reliably included in the finder observation range 20. As a result, by observing the viewfinder optical image, it is possible to more reliably observe the entire photographing side image 30 regardless of the focus position of the photographing optical system 310.

  When the angle of view of the viewfinder optical system 210 cannot be adjusted to a larger angle of view, the viewfinder control unit 187 outputs information indicating that the angle of view adjustment is impossible to the display control unit 191.

  Next, as a second example, when the ratio of the size of the finder side image 40 to the size of the shooting corresponding region 43 in the finder side image 40 is equal to or greater than a predetermined threshold, the finder control unit 187 The angle of view 210 is adjusted to a smaller angle of view. That is, the viewfinder control unit 187 reduces the angle of view of the viewfinder optical system 210 when the viewfinder field ratio (ratio of the size of the viewfinder observation range 20 to the size of the shooting range 10) is equal to or greater than a predetermined threshold. Adjust to the corner.

  More specifically, for example, when the ratio of the size of the finder-side image 40 to the size of the shooting-corresponding region 43 is equal to or greater than a predetermined threshold, the finder control unit 187 determines that the ratio is the threshold Information indicating the above and the detected photographing corresponding region 43 are acquired. Then, the finder control unit 187 minimizes the finder field ratio while including the shooting range 10 in the finder observation range 20 from the viewfinder side image 40 and the shooting corresponding area 43 and the angle of view of the finder optical system 210 at that time. An appropriate angle of view of the finder optical system 210 is calculated. For example, the appropriate angle of view can be calculated by simulating a change in the photographing corresponding region 43 when the angle of view of the finder optical system 210 is gradually reduced from the angle of view at that time. Then, the finder control unit 187 calculates the shift amount of the focal length necessary for adjusting the angle of view of the finder optical system 210 at that time to the appropriate angle of view. Thereafter, the finder control unit 187 instructs the driver 225 of the finder unit 200 to change the focal length of the finder optical system 210 by the shift amount.

  Referring to FIG. 13 again, the size of the shooting corresponding region 43d is very small compared to the size of the finder side image 40d, and the ratio of the size of the finder side image 40d to the size of the shooting corresponding region 43d is a predetermined threshold value. That's it. That is, the viewfinder field ratio is too large. Then, referring to FIG. 11, as a result of adjusting the angle of view of the finder optical system 210 to an appropriate angle of view, the photographing corresponding region 43b substantially coincides with the finder side image 40b. That is, the viewfinder field ratio is slightly over 100%.

  By adjusting the angle of view, it is possible to minimize the finder field ratio while including the shooting range 10 in the finder observation range 20. As a result, it is easier to confirm the shooting side image 30 in the finder optical image. Further, since the manufacturing error generated for each individual is corrected, it contributes to the reduction of the manufacturing cost.

(Finder image generation unit 189)
The finder image generation unit 189 generates an image (hereinafter referred to as a region image) indicating a region in the finder optical image corresponding to the shooting-side image 30 based on the detected shooting-corresponding region 43. The region image is displayed on the LCD 240 of the finder unit 200 and superimposed on the finder optical image. Based on the size of the LCD 240 and the viewfinder optical image 60, the viewfinder image generation unit 189 determines the viewfinder optical image corresponding to the shooting-side image 30 when displayed on the LCD 240 from the relationship between the viewfinder-side image 40 and the shooting corresponding region 43. An image showing the area within 40 can be generated. Hereinafter, a specific example of the region image will be described with reference to FIGS. 15 to 17.

  FIG. 15 is an explanatory diagram for describing a first example of the region image 70. The first example is an example in the case where the shooting corresponding area 43a is detected as shown in FIG. Referring to FIG. 15, a finder optical image 60a and a region image 70a observed when looking through the finder eyepiece window 221 are shown. The region image 70a is a mask image for showing a region 61a corresponding to the photographing side image 30 in the finder optical image.

  FIG. 16 is an explanatory diagram for describing a second example of the region image 70. The second example is an example in the case where the shooting corresponding area 43c is detected as shown in FIG. Referring to FIG. 16, a viewfinder optical image 60b and a region image 70b that are observed when looking through the viewfinder eyepiece window 221 are shown. Similar to FIG. 15, the region image 70 b is a mask image for indicating a region 61 b corresponding to the shooting-side image 30 in the finder optical image. Here, the brightness of the mask of the area image 70b and the brightness of the finder optical image 60 are close to each other.

  FIG. 17 is an explanatory diagram for describing a third example of the region image 70. The third example is an example in which the brightness of the mask of the second example is improved. Referring to FIG. 17, the difference between the brightness of the mask of the area image 70b and the brightness of the finder optical image 60 is large. Therefore, it is easier to confirm the presence of the area image 70b and the area 61b than in the case of FIG.

  The region image 70 is not limited to the masks as shown in FIGS. The area image 70 may be an arbitrary image in which the area 61 corresponding to the shooting-side image 30 in the finder optical image 60 can be confirmed. For example, the region image 70 may be an image of only a line surrounding the region 61.

(Display control unit 191)
The display control unit 191 generates an image indicating the area in the finder optical image 60 corresponding to the shooting-side image 30 (that is, the area image 70) generated based on the detection result of the shooting corresponding area 43 in the finder optical image 60. The images are superimposed and displayed on the LCD 240 of the finder unit 200. That is, the display control unit 191 causes the LCD 240 to display the region image 70 generated by the finder image generation unit 189 on the finder optical image. For example, the display control unit 191 causes the LCD 240 to display the region image 70 as illustrated in FIGS. 15 to 17. Thus, the display of the area image 70 enables the finder unit 200 to accurately observe the shooting side image. That is, when observing the finder optical image 60, the user can accurately grasp from where to where is the imaging range 10 by looking at the region image 70. Further, as described above, since the finder observation range 20 includes the photographing range 10 by adjusting the angle of view of the finder optical system 210, it is not necessary to move the entire finder unit 200.

  The display control unit 191 displays an image indicating a warning (hereinafter, a warning image) on the LCD 240 when the angle of view of the finder optical system 210 cannot be adjusted to a larger angle of view. For example, when the display control unit 191 acquires information indicating that the angle of view is not adjustable from the finder control unit 187, the display control unit 191 displays a predetermined warning image on the LCD 240. This point will be described with reference to FIG.

  FIG. 18 is an explanatory diagram for explaining an example of the warning image 80. Referring to FIG. 18, a finder optical image 60c and a warning image 80 that are observed when looking into the finder eyepiece window 221 are shown. As the warning image 80, an image “Please use LCD outside ZOOM interlocking” is displayed.

  By displaying the warning image 80 as described above, it is possible to notify the user that the finder observation range 20 cannot include the shooting range 10 as a second best measure for adjusting the angle of view.

  In addition, the display control unit 191 causes the LCD 150 to display the shooting-side image 30 after image processing by the image processing unit 195, for example.

(Control value changing unit 193)
The control value changing unit 193 changes the control value related to the operation of the digital camera 100 using the information on the pixels included in the shooting corresponding area 43 in the finder side image 40. The control value changing unit 193 changes the control value when performing continuous shooting, for example. Hereinafter, the change of the control value will be described more specifically.

  As a first example, the control value is an exposure control value of the digital camera 100, for example. That is, the control value changing unit 193 changes the exposure control value using the information on the pixels included in the shooting corresponding area 43. The exposure control value includes, for example, an EV value, an F value, a shutter speed, or ISO sensitivity.

  For example, the control value changing unit 193 calculates an appropriate EV value using information on the pixels included in the imaging corresponding area 43, and changes the exposure control value based on the appropriate EV value. More specifically, for example, the control value changing unit 193 divides the shooting corresponding region 43 into blocks when starting continuous shooting, and calculates a luminance average value for each block. Next, the control value changing unit 193 calculates an appropriate EV value based on the luminance average value for each divided block. Then, the control value changing unit 193 stores the appropriate EV value as a reference value. The calculation of such an appropriate EV value will be described more specifically with reference to FIG.

  FIG. 19 is an explanatory diagram for explaining an example of a divided block of the photographing corresponding area 43. Referring to FIG. 19, for example, the photographing corresponding area 43 c in the finder side image 40 c is divided into 5 × 5 blocks 45. Then, a luminance average value for each block 45 is calculated, and an appropriate EV value is calculated based on the luminance average value.

  After storing the appropriate EV value as the reference value, the control value changing unit 193 continuously calculates the appropriate EV value, and the difference between the calculated EV value and the reference value (ie, the calculated EV value−reference value). Value). Then, when the magnitude of the difference between the EV values is equal to or greater than a predetermined threshold value, the control value changing unit 193 adds a value obtained by adding the difference to the EV value set by the AE control unit 177 to a new EV. The value is set in the AE control unit 177 as a value. In addition to the setting, the control value changing unit 193 stores the latest appropriate EV value calculated by itself as a new reference value. In this way, by adding the above difference to the set EV value, it is possible to reflect the relative change amount of the EV value over time in the set EV value. Such a change in the EV value will be described more specifically with reference to FIG.

  FIG. 20 is an explanatory diagram for explaining an example of changing the exposure control value based on the imaging corresponding area 43. Referring to FIG. 20, the exposure side image 30 is exposed with the exposure control value E for each frame F based on the vertical synchronization (VD) signal. In addition, the image I of the RAW data acquired by the CMOS 120 from the light incident by the exposure is input to the SDRAM 139 by the image input controller 125 in the next frame F. In the next frame F, the AE control unit 177 calculates and sets an appropriate exposure control value AE. For example, in the frame F1, exposure is performed with the exposure control value E-1. Next, in the frame F2, the image I-1 acquired according to the exposure by the exposure control value E-1 in the frame F1 is input to the SDRAM 139. In the frame F3, an appropriate exposure control value AE-1 is calculated and set based on the image input in the frame F2. Then, exposure is performed from the frame F4 with the set new exposure control value E-2. Thus, the exposure control value is set every three frames. Although not explicitly shown in FIG. 20, image input is performed not only in the frames F2, F5, and F8 but also in each frame F. For example, in the frame F2, exposure is performed with the exposure control value E-1, and in the frame F4, an image acquired according to the exposure with the exposure control value E-1 in the frame F2 is input to the SDRAM 139.

  On the other hand, for the finder side image 40, for example, a frame f having a length half that of the frame F is set using a VD signal having a shorter cycle than the VD signal. Since the finder optical system 210 and the CMOS 230 are independent from the photographing side image 30, the length of the frame f can be freely set in this way. Exposure is performed with the exposure control value e for each frame f. Also, an image i of RAW data acquired by the CMOS 230 from the light incident by the exposure is input to the SDRAM 139 by the image input controller 235 in the next frame f. Then, in the next frame f, the control value changing unit 193 calculates a proper exposure control value ae, calculates a difference between the proper exposure control value ae and the reference value, and compares the difference with a threshold value. Then, the exposure control value E is changed according to the comparison result with the threshold value. As a result, the control value changing unit 193 can complete the calculation of an appropriate exposure control value based on the exposure at the same time earlier than the AE control unit 177. Although not explicitly shown in FIG. 20, the image input of RAW data is performed in each frame f as well as the frame F.

  For example, when the brightness of the subject changes between the frames F3 and F4, the AE control unit 177 performs exposure with the exposure control value E-2 in the frame F4 after the change, and inputs the image I-2. In frame F5, an appropriate exposure control value AE-2 is calculated and set in frame F6. Therefore, the exposure reflecting the change in brightness is performed after the frame F7. On the other hand, the control value changing unit 193 performs exposure with the exposure control value e-3 after the change in the frame f7, inputs the image i-3 with the frame f8, calculates the appropriate exposure control value ae-3, and A new exposure control value E is set at frame f9. Therefore, the exposure reflecting the change in brightness is performed after the frame f10, that is, after the frame F6.

  As described above, according to the exposure control using the pixels included in the shooting corresponding area 43, the exposure control value can be changed more quickly according to the change in the brightness of the subject during continuous shooting. As a result, in continuous shooting, it is possible to reduce the number of images shot with exposure that does not match the brightness of the subject.

  Next, as a second example, the control value is a control value used for image processing of the shooting-side image 30.

  For example, the control value used for the image processing is a WB gain used for WB adjustment of the shooting-side image 30. That is, the control value changing unit 193 changes the WB gain used for the WB adjustment of the shooting-side image 30 using the pixel information included in the shooting corresponding area 43.

  More specifically, for example, when the continuous shooting is started, the control value changing unit 193 divides the shooting corresponding area 43 into blocks, and calculates an R / G / B average value for each block. Next, the control value changing unit 193 calculates an appropriate WB gain based on the R / G / B average value for each divided block. The calculation is the same as the calculation of the luminance average value described with reference to FIG. Then, the control value changing unit 193 stores the appropriate WB gain as a reference value.

  After storing the appropriate WB gain as a reference value, the control value changing unit 193 continuously calculates an appropriate WB gain value and calculates a ratio of the calculated WB gain to the reference value. When the ratio is equal to or greater than a predetermined threshold, the control value changing unit 193 sets a value obtained by multiplying the WB gain set by the image processing unit 195 by the ratio as a new WB gain. Instruct the image processing unit 195 as follows. In addition to the setting, the control value changing unit 193 stores the latest appropriate WB gain calculated by itself as a new reference value. With such a setting, the relative change amount of the WB gain over time can be reflected in the set WB gain, similarly to the change of the exposure control value.

  Further, for example, the control value used for the image processing is an enhancement coefficient used for the photographing side image 30 edge enhancement processing. That is, the control value changing unit 193 changes the enhancement coefficient used for the edge enhancement process on the shooting-side image 30 using the pixel information included in the shooting corresponding area 43.

  More specifically, for example, the control value changing unit 193 calculates the frequency characteristics of the shooting corresponding region 43 when starting continuous shooting. Next, the control value changing unit 193 calculates an appropriate enhancement coefficient based on the frequency characteristic. Then, the control value changing unit 193 stores the appropriate enhancement coefficient as a reference value.

  After storing the appropriate enhancement coefficient as a reference value, the control value changing unit 193 continuously calculates the appropriate enhancement coefficient, and the difference between the calculated enhancement coefficient and the reference value (that is, the calculated enhancement coefficient−reference Value). When the magnitude of the difference is equal to or greater than a predetermined threshold, the control value changing unit 193 sets a value obtained by adding the difference to the enhancement coefficient set by the image processing unit 195 as a new enhancement coefficient. The image processing unit 195 is instructed to do so. In addition to the setting, the control value changing unit 193 stores the latest proper enhancement coefficient calculated by itself as a new reference value. With such a setting, as with the change in the exposure control value and the WB gain, the relative change amount of the enhancement coefficient over time can be reflected in the set enhancement coefficient.

  As described above, the WB gain for the WB adjustment and the enhancement coefficient for the edge enhancement process are exemplified, and the change of the control value used for the image processing has been described. Due to such a change in the control value, for example, even if the frame for continuous shooting is extremely short and the control value used for image processing has to be fixed, the pixels included in the shooting corresponding region 43 By using this information, the control value can be changed to a more appropriate value during continuous shooting.

(Image processing unit 195)
The image processing unit 195 performs various types of image processing on the shooting side image 30 acquired by the CMOS 120. For example, the image processing unit 195 performs WB adjustment and edge enhancement processing on the shooting-side image 30.

  Further, the image processing unit 195 sets the WB gain in accordance with an instruction from the appropriate WB calculation unit 181. Further, the image processing unit 195 sets an enhancement coefficient for edge enhancement processing in accordance with instructions from the appropriate edge strength calculation unit 183.

  Further, the image processing unit 195 changes the control value used for image processing in accordance with the instruction from the control value changing unit 193. For example, the image processing unit 195 sets a WB gain and an enhancement coefficient for edge enhancement processing in accordance with an instruction from the control value changing unit 193.

  Although an example of the configuration of the processing unit 170 has been described above, the processing unit 170 is implemented by, for example, a CPU and a DSP (Digital Signal Processor).

<4. Process flow>
Next, with reference to FIG. 21 and FIG. 22, an example of the photographing process according to the present embodiment will be described.

(Flow of the entire shooting process)
FIG. 21 is a flowchart illustrating an example of a schematic flow of an imaging process according to the present embodiment.

(Control value change processing flow)
First, in step S301, the finder control unit 187 acquires information related to the angle of view of the photographing optical system 310. Next, in step S <b> 303, the finder control unit 187 adjusts the angle of view of the finder optical system 210 based on information regarding the angle of view of the photographing optical system 310.

  Next, in step S <b> 305, the CMOS 120 acquires the photographing side image 30 from the light guided by the photographing optical system 310 of the photographing lens 300. In step S <b> 307, the CMOS 230 acquires the finder side image 40 from the optical image in the same range as the finder optical image 60. In step S 309, the region detection unit 185 detects a region in the finder side image 40 corresponding to the shooting side image 30, that is, the shooting corresponding region 43.

  Next, in step 311, the finder control unit 187 determines whether or not the shooting corresponding area 43 corresponds to a part of the shooting side image 30. If the shooting corresponding area 43 corresponds to a part of the shooting-side image 30, the process proceeds to step S315. On the other hand, when the shooting corresponding area 43 corresponds to the entire shooting side image 30, the process proceeds to step S313.

  In step S <b> 313, the LCD 240 generates an image indicating the area in the finder optical image 60 corresponding to the shooting-side image 30 (that is, the area image 70) generated based on the detection result of the shooting corresponding area 43. Superimposed on the display.

  In step S315, the finder control unit 187 allows the finder observation range 20 to include the shooting range 10 based on the positional relationship between the entire shooting side image 30 and the viewfinder side image 40 and the angle of view of the finder optical system 210 at that time. In addition, an appropriate angle of view of the finder optical system 210 is calculated. Next, in step S317, the finder control unit 187 calculates the shift amount of the focal length necessary for adjusting the angle of view of the finder optical system 210 at that time to the appropriate angle of view.

  In step S319, the finder control unit 187 determines whether or not the ratio of the size of the finder side image 40 to the size of the shooting-corresponding region 43 in the finder side image 40 (that is, the finder field ratio) is equal to or greater than a predetermined threshold. judge. If the ratio is equal to or greater than the predetermined threshold, the process proceeds to step S321. On the other hand, if the ratio is less than the predetermined threshold, the process proceeds to step S331.

  In step S321, the viewfinder control unit 187 sets the viewfinder field ratio while including the shooting range 10 in the viewfinder observation range 20, based on the viewfinder side image 40, the shooting corresponding region 43, and the angle of view of the viewfinder optical system 210 at that time. An appropriate angle of view of the finder optical system 210 to be minimized is calculated. Next, in step S323, the finder control unit 187 calculates the focal length shift amount necessary for adjusting the angle of view of the finder optical system 210 at that time to the appropriate angle of view.

  In step S325, the finder control unit 187 determines whether the angle of view can be set. That is, the finder control unit 187 determines whether or not the focal length can be changed by the calculated shift amount. If the angle of view can be set, the process proceeds to step S327. On the other hand, if the angle of view cannot be set, the process proceeds to step S329.

  In step S327, the driver 225 of the finder unit 200 adjusts the angle of view of the finder optical system 210 by changing the focal length of the finder optical system 210 by the calculated shift amount.

  In step S329, the LCD 240 displays the warning image 80.

  In step S331, the control value changing unit 193 determines whether or not the shooting mode is the continuous shooting mode. If it is the continuous shooting mode, the process proceeds to step S400. If it is not the continuous shooting mode, the process proceeds to step S333.

  In step S <b> 400, the control value changing unit 193 changes the control value related to the operation of the digital camera 100 using the information on the pixels included in the shooting corresponding area 43 in the finder side image 40.

  In step S333, it is determined whether or not to end shooting. When the shooting is finished, the process is finished. On the other hand, if the shooting is not finished, the process returns to step 305.

  The example of the schematic flow of the imaging process has been described above with reference to FIG. 21. Next, the control value change process in step S400 will be described in more detail with reference to FIG.

(Control value change processing flow)
FIG. 22 is a flowchart showing an example of a schematic flow of the control value change process according to the present embodiment.

  First, in step S <b> 401, the control value changing unit 193 confirms the shooting corresponding area 43. Next, in step S <b> 403, the control value changing unit 193 divides the shooting corresponding area 43 into blocks 45. In step S <b> 405, the control value changing unit 193 calculates an R / G / B average value for each block 45. In step S <b> 407, the control value changing unit 193 calculates a luminance average value for each block 45. In step S409, the control value changing unit 193 calculates the frequency characteristic of the imaging corresponding region 43.

  Next, in step S411. It is determined whether or not the finder side image 40 is the first finder side image 40 in continuous shooting. If the finder side image 40 is the first finder side image 40, the process proceeds to step S413. On the other hand, otherwise, the process proceeds to step S421.

  In step S413, the control value changing unit 193 calculates an appropriate WB gain from the R / G / B average value for each block 45, and stores the appropriate WB gain as a reference value. In step S415, the control value changing unit 193 calculates an appropriate EV value from the luminance average value for each block 45, and stores the appropriate EV value as a reference value. In step S417, the control value changing unit 193 calculates an appropriate enhancement coefficient in the edge enhancement process from the frequency characteristics of the imaging corresponding region 43, and stores the appropriate edge enhancement coefficient as a reference value.

In step S421, the control value changing unit 193 calculates the latest value of the appropriate WB gain. Next, in step S423, the control value changing unit 193 calculates the ratio of the latest value to the reference value. Then, in step S425, if the magnitude of the ratio is smaller than the threshold value _{T 1,} the process proceeds to step S431. If the magnitude of the ratio is a threshold value above T _1, the process proceeds to step S427.

  In step S427, the control value changing unit 193 causes the image processing unit 195 to set a value obtained by multiplying the WB gain set by the image processing unit 195 by the above ratio as a new WB gain. That is, the WB gain for the shooting side image 30 is changed. In step S429, the control value changing unit 193 stores the latest value calculated by itself as a new reference value.

Next, in step S431, the control value changing unit 193 calculates the latest value of the appropriate EV value. Next, in step S433, the control value changing unit 193 calculates the difference between the latest value and the reference value. Then, in step S435, if the magnitude of the difference is smaller than the threshold value _{T 2,} the process proceeds to step S441. If the magnitude of the difference is the threshold value T ₂ or more, the process proceeds to step S437.

  In step S437, the control value changing unit 193 causes the AE control unit 177 to set a value obtained by adding the above difference to the EV value set by the AE control unit 177 as a new EV value. That is, the EV value for the shooting side image 30 is changed. In step S439, the control value changing unit 193 stores the latest value calculated by itself as a new reference value.

Next, in step S441, the control value changing unit 193 calculates the latest value of the appropriate enhancement coefficient. Next, in step S443, the control value changing unit 193 calculates the difference between the latest value and the reference value. Then, in step S445, if the magnitude of the difference is smaller than the threshold value T _3, the process ends. If the magnitude of the difference is the threshold value T ₃ or more, the process proceeds to step S447.

  In step S447, the control value changing unit 193 causes the image processing unit 195 to set a value obtained by adding the difference to the enhancement coefficient set by the image processing unit 195 as a new enhancement coefficient. That is, the enhancement coefficient for the shooting side image 30 is changed. In step S449, the control value changing unit 193 stores the latest value calculated by itself as a new reference value. Then, the process ends.

  Although the present embodiment has been described above, according to the present embodiment, a photographed image can be more accurately observed with the finder without moving the entire finder unit.

  More specifically, the field angle of the finder optical system 210 is adjusted to be larger than the field angle of the photographing optical system 310. Thereby, it is possible to include the photographing range 10 in the finder observation range 20 without moving the entire finder unit 200.

  Further, the angle of view of the finder optical system 210 is adjusted according to the acquired information regarding the angle of view of the photographing optical system 310. According to such adjustment of the angle of view, the photographing range 10 can be included in the finder observation range 20 with a certain degree of accuracy by a simple process of acquiring information related to the angle of view of the photographing optical system 310. In addition, for example, when the focal length or angle of view of the finder optical system 210 is not adjusted, it is different from a desired value, or when the focal length or angle of view of the photographing optical system 310 changes abruptly. However, the imaging range 10 can be included in the finder observation range 20 quickly and with a certain degree of accuracy.

  Further, the angle of view of the finder optical system 210 is adjusted according to the closest distance. According to such adjustment of the angle of view, when the closest distance is shorter, the angle of view of the finder optical system 210 is increased, and when the closest distance is longer, the angle of view of the finder optical system 210 is further increased. It becomes possible to keep it small.

  Further, the angle of view of the finder optical system 210 is adjusted according to the detection result of the photographing corresponding area 43. By adjusting the angle of view as described above, the shooting range 10 can be more reliably included in the finder observation range 20. In addition, it is possible to minimize the finder field ratio while including the photographing range 10 in the finder observation range 20.

  When the angle of view cannot be adjusted, a warning image 80 is displayed. By displaying the warning image 80 as described above, it is possible to notify the user that the finder observation range 20 cannot include the shooting range 10 as a second best measure for adjusting the angle of view.

  In addition, various control values are changed using the pixel information of the imaging corresponding area 43. Thereby, for example, the exposure control value can be changed more quickly during continuous shooting according to the change in the brightness of the subject. Further, for example, even when the continuous shooting frame is very short and the image processing control value is fixed, it is necessary to use the pixel information included in the shooting corresponding area 43 to perform continuous shooting. It is possible to change the control value for image processing to a more appropriate value during shooting.

  Further, according to the present embodiment, even when the shooting distance is not clear, that is, before the focus is achieved, the shooting corresponding region 43 is specified, and the finder optical image 40 corresponding to the shooting side image 30 is specified. The area inside can be shown. In this way, it is possible to observe the captured image with the viewfinder before determining the shooting distance.

  As mentioned above, although preferred embodiment of this invention was described referring an accompanying drawing, it cannot be overemphasized that this invention is not limited to the example which concerns. It will be apparent to those skilled in the art that various changes and modifications can be made within the scope of the claims, and these are naturally within the technical scope of the present invention. Understood.

  For example, a digital camera has been described as an example of an imaging apparatus, but the imaging apparatus is not limited to this. The imaging device may be another device such as a mobile phone terminal or a video camera having a digital camera function.

  Moreover, although the example in which the finder unit is mainly incorporated in the imaging device has been described, the imaging device and the finder unit are not limited to this. The imaging device may be an imaging device to which the finder unit can be attached and detached, and the finder unit may be a finder device that can be attached to and detached from the imaging device.

  Further, each step in the imaging process of this specification does not necessarily have to be processed in time series in the order described in the flowchart. For example, each step in the imaging process may be processed in an order different from the order described in the flowchart, or may be processed in parallel.

DESCRIPTION OF SYMBOLS 1 Imaging system 10 Shooting range 20 Viewfinder observation range 30 Shooting side image 40 Viewfinder side image 41 Feature point 43 Shooting corresponding area 45 Block 60 Viewfinder optical image 70 Area image 80 Warning image 100 Digital camera 110 Mechanical shutter 120 CMOS
170 Processing Unit 177 AE Control Unit 181 Appropriate WB Calculation Unit 183 Appropriate Edge Strength Calculation Unit 185 Region Detection Unit 187 Viewfinder Control Unit 189 Viewfinder Image Generation Unit 191 Display Control Unit 193 Control Value Change Unit 195 Image Processing Unit 200 Viewfinder Unit 210 Viewfinder Optical System 211 Zoom lens 223 Motor 230 CMOS
240 LCD
300 Shooting Lens 310 Shooting Optical System 311 Zoom Lens 313 Aperture

Claims (17)

A first imaging element for taking a first image;
A finder optical system that forms an optical image that has an optical axis different from that of the photographic optical system that guides light to the first image sensor and is observable by the finder;
A second image sensor for acquiring a second image from an optical image in the same range as an optical image observable by the finder;
A control unit that performs control so that the imaging range of the second imaging element includes the imaging range of the first imaging element;
A detection unit for detecting a region in the second image corresponding to the first image;
A display unit, which is generated based on the detection result of the region, and displays an image indicating a region in the optical image observable with the finder corresponding to the first image, superimposed on the optical image;
An imaging apparatus comprising: The finder optical system has a zoom function that enables changing the angle of view,
The imaging apparatus according to claim 1, wherein the control unit performs the control by adjusting an angle of view of the finder optical system so as to be larger than an angle of view of the photographing optical system.   The imaging apparatus according to claim 2, wherein the control unit acquires information related to a field angle of the photographing optical system and adjusts a field angle of the finder optical system based on the information.   The control unit also acquires information on the closest distance of the photographing optical system, and adjusts the angle of view of the finder optical system based on the information on the angle of view and the information on the closest distance. The imaging device described.   The imaging device according to claim 2, wherein the control unit adjusts an angle of view of the finder optical system based on a detection result of the region in the second image.   The said control part adjusts the field angle of the said finder optical system to a larger field angle, when the said area | region in the said 2nd image respond | corresponds to a part of said 1st image. Imaging device.   The imaging apparatus according to claim 6, wherein the display unit displays an image indicating a warning when the angle of view of the finder optical system cannot be adjusted to a larger angle of view.   When the ratio of the size of the second image to the size of the region in the second image is equal to or greater than a predetermined threshold, the control unit reduces the angle of view of the finder optical system to a smaller angle of view. The imaging device according to any one of claims 5 to 7, wherein the imaging device is adjusted.   The imaging according to any one of claims 1 to 8, further comprising: a changing unit that changes a control value related to an operation of the imaging device using information on a pixel included in the region in the second image. apparatus.   The imaging apparatus according to claim 9, wherein the changing unit changes the control value when performing continuous shooting.   The imaging device according to claim 9 or 10, wherein the control value is an exposure control value of the imaging device.   The imaging device according to claim 9, wherein the control value is a control value used for image processing of the first image.   The imaging apparatus according to claim 12, wherein the control value used for the image processing is a white balance gain used for white balance adjustment of the first image.   The imaging device according to claim 12 or 13, wherein the control value used for the image processing is an enhancement coefficient used for edge enhancement processing of the first image. A first image pickup device for taking a first image and a viewfinder having an optical axis different from that of the taking optical system for guiding light to the first image pickup device and forming an optical image that can be observed with the viewfinder An imaging method in an imaging apparatus comprising: an optical system; and a second imaging element that acquires a second image from an optical image in the same range as an optical image observable with the finder,
Performing control so that the imaging range of the second imaging element includes the imaging range of the first imaging element;
Detecting a region in the second image corresponding to the first image;
An image generated based on the detection result of the area and indicating an area in the optical image that can be observed with the viewfinder corresponding to the first image, superimposed on the optical image;
An imaging method including: A finder device that can be attached to and detached from an imaging device having a first imaging element for photographing to acquire a first image,
A finder optical system that forms an optical image that has an optical axis different from that of the photographic optical system that guides light to the first image sensor and is observable by the finder;
A second image sensor for acquiring a second image from an optical image in the same range as an optical image observable by the finder;
A driving unit that drives the finder optical system in accordance with control for including an imaging range of the first imaging element by an imaging range of the second imaging element;
An image indicating a region in the optical image that can be observed with the viewfinder corresponding to the first image, generated based on the detection result of the region in the second image corresponding to the first image, A display unit that superimposes and displays the optical image;
A finder device comprising: A finder optical system that forms an optical image that has an optical axis different from that of the photographic optical system that guides light to the first imaging element for photographing that acquires the first image, and is observed by the finder. A finder device comprising: a second imaging device that acquires a second image from an optical image in the same range as the possible optical image; and a display unit that displays an image superimposed on the optical image that can be observed by the finder. A detachable imaging device,
The first image sensor;
A control unit that performs control so that the imaging range of the second imaging element includes the imaging range of the first imaging element;
A detection unit for detecting a region in the second image corresponding to the first image;
An image indicating a region in the optical image that can be observed with the viewfinder corresponding to the first image, generated based on the detection result of the region, is superimposed on the optical image and displayed on the display unit of the viewfinder device. A display control unit
An imaging apparatus comprising:

Images