JP2020005033A - Imaging apparatus and control method thereof - Google Patents

Abstract

To prevent generation of an unnatural synthesized image when replacement to a lens having a different image circle or a lens that requires optical correction by image processing such as distortion correction is performed during multiple exposure shooting.SOLUTION: An imaging apparatus including an imaging unit with a lens interchangeable includes a synthesis unit that synthesizes a plurality of images obtained by performing imaging a plurality of times by the imaging unit to generate a synthesized image, a detection unit that detects attachment/detachment of the lens, and a control unit that controls the synthesis unit in accordance with the detection by the detection unit. Here, when the lens is re-mounted on the basis of the detection by the detection unit when imaging are performed the plurality of times by the synthesis unit, and the image circle of the re-mounted lens is different from the image circle of the lens that has been mounted before the re-mounting, the control unit suspends the imaging for generating the synthesized image by the imaging unit.SELECTED DRAWING: Figure 4

Description

  The present invention relates to an imaging device and a control method thereof.

  2. Description of the Related Art There is a digital camera capable of so-called multi-exposure shooting in which images obtained by multiple shootings are synthesized and recorded as a single synthesized image. Before shooting, you can select a combination processing method such as the number of combined images, weighted average, comparatively bright combination, or comparatively dark combination, or select an image that has already been taken as a base image and combine the base image with the image to be taken. Some can generate multiplexed images.

JP 2012-19343 A JP 2007-22237 A

  In an interchangeable lens camera, it is possible to change lenses during multiple exposure shooting. If a lens with a different image circle or a lens that requires optical correction by image processing such as distortion correction is replaced during multiple exposure shooting, an unnatural composite image may be generated.

  As a technique for changing settings during multiple exposure shooting, Japanese Patent Application Laid-Open No. H11-163,086 discloses a technique that allows a digital camera capable of multiple exposure shooting to change the aspect ratio setting of an image recorded during shooting. Further, Japanese Patent Application Laid-Open No. H11-163,086 discloses a technique that allows a digital camera capable of multiple exposure shooting to change settings such as recording image quality and recording size during shooting.

  In the imaging devices described in Patent Literatures 1 and 2, setting of an image output by the imaging device, such as an aspect ratio, a recording image quality, and a recording size, can be changed during photographing. However, no consideration is given to lens replacement, that is, a change in the quality of a captured image itself input to an imaging device, such as an image circle of a lens or an amount of distortion.

  The present invention has been made in view of such a point, and during multiple exposure shooting, from a lens that has been mounted until then to a lens having a different image circle or a lens that requires optical correction by image processing such as distortion correction. It is an object of the present invention to provide a technique for preventing generation of an unnatural composite image in the case of replacement.

In order to solve this problem, for example, an imaging device of the present invention has the following configuration. That is,
An image pickup apparatus having an interchangeable lens image pickup means,
A synthesizing unit that synthesizes a plurality of images obtained by performing imaging a plurality of times by the imaging unit and generates a synthesized image;
Detecting means for detecting attachment / detachment of the lens;
Control means for controlling the synthesizing means in accordance with the detection by the detection means,
The control means includes:
The lens has been re-mounted based on the detection by the detecting unit when performing the imaging multiple times by the synthesizing unit, and the image circle of the re-mounted lens is the lens that was mounted before the re-mounting. When the image circle is different from the image circle, the imaging by the imaging means for generating the composite image is interrupted.

  According to the present invention, an unnatural composite image is prevented from being generated when a lens having a different image circle or a lens that requires optical correction by image processing such as distortion correction is replaced during multiple exposure shooting. can do.

FIG. 1 is a block diagram of an imaging device according to an embodiment. FIG. 9 is a diagram illustrating an example of a setting menu screen related to multiple exposure shooting. FIG. 3 is a diagram illustrating an example of an image shot in multiple exposure shooting. 5 is a flowchart illustrating an operation of the imaging device according to the first embodiment. The figure which shows the difference of the image circle by a lens. FIG. 4 is a diagram illustrating an example of a warning message according to the first embodiment. 9 is a flowchart illustrating an operation of the imaging device according to the second embodiment. FIG. 10 is a diagram illustrating an example of a warning message according to the second embodiment. 9 is a flowchart illustrating the operation of the imaging device according to the third embodiment. 13 is a flowchart illustrating the operation of the imaging device according to the fourth embodiment.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. Note that the configurations in the embodiments described below are merely examples, and the present invention is not limited to the illustrated configurations.

  FIG. 1 is a block diagram of an imaging apparatus typified by a digital camera with interchangeable lenses according to the embodiment. The imaging device according to the embodiment includes an imaging device main body 100 and a lens unit 180 that is detachable from the imaging device main body 100.

  In the imaging apparatus main body 100, a shutter 120 controls an exposure amount of an imaging unit 122 described later. The imaging unit 122 has an imaging device configured by a CCD, a CMOS device, or the like that converts an optical image into an electric signal. On the surface of the image sensor, filters of R, G, and B color components are arranged in a Bayer array. Therefore, the image data is composed of the pixel data of the Bayer array of the image data obtained immediately by the imaging unit 122. Further, the imaging unit 122 has an A / D conversion processing function. The AF evaluation value detection unit 123 calculates an AF evaluation value from contrast information obtained from a digital image signal and a phase difference obtained from a parallax image, and outputs the obtained AF evaluation value from the imaging unit 122 to the system control unit 150. Note that the image sensor in the present embodiment is a so-called full-size sensor.

  The image processing unit 124 performs resizing processing and color conversion processing such as predetermined pixel interpolation and reduction on image data output from the imaging unit 122 or image data from the memory control unit 15. Further, the image processing unit 124 can acquire distance information between the subject and the imaging device. Specifically, the image processing device 124 acquires the distance to the subject by detecting a phase difference from the two given parallax images, and acquires distance information from the imaging device to the subject for each pixel. Further, the image processing unit 124 performs a predetermined calculation process using the captured image data, and the system control unit 150 performs exposure control and distance measurement control based on the calculation result. As a result, TTL (through the lens) AE (automatic exposure) processing and EF (flash automatic light emission control) processing are performed. The image processing unit 124 performs an AF (autofocus) process. At this time, the output of the AF evaluation value detection unit 123 included in the imaging unit 122 may be used. The image processing unit 124 further performs predetermined arithmetic processing using the captured image data, and also performs TTL AWB (auto white balance) processing based on the obtained arithmetic results. Further, the image processing unit 124 performs a process of combining a plurality of images, and also generates a multiplexed image. Further, the image processing unit 124 performs debayer processing on the Bayer array RAW image data, and performs conversion, encoding, and decoding processing into image data of one pixel and three components.

  The output data of the imaging unit 122 is directly written into the memory 132 via the image processing unit 124 and the memory control unit 115 or via the memory control unit 115. The memory 132 stores image data obtained and A / D converted by the imaging unit 122, and image data to be displayed on the display unit 128. The memory 132 has a sufficient storage capacity to store a predetermined number of still images, moving images and sounds for a predetermined time. The memory 132 also serves as a memory for displaying images (video memory). The D / A converter 113 converts the image display data stored in the memory 132 into an analog signal and supplies the analog signal to the display unit 128. Thus, the display image data written in the memory 132 is displayed on the display unit 128 via the D / A converter 113. The display unit 128 performs display on a display such as an LCD according to the analog signal from the D / A converter 113. The digital signal that has been A / D converted once by the imaging unit 122 and stored in the memory 32 is converted into an analog signal by the D / A converter 113, and sequentially transferred to the display unit 128 for display, thereby functioning as an electronic viewfinder. Through images can be displayed.

  The nonvolatile memory 156 is an electrically erasable / recordable memory, and for example, a flash memory or the like is used. The nonvolatile memory 156 stores constants, programs, and the like for the operation of the system control unit 150. Here, the program is a program for executing various flowcharts described later in the present embodiment. In addition, the nonvolatile memory 156 stores a lens table 156a in which a model name of a lens unit connectable to the imaging apparatus main body 100 and identification information of the lens unit are paired. The characteristic information of the lens unit includes the size of the image circle.

  The system control unit 150 executes the program recorded in the above-described nonvolatile memory 156 to control each processing unit of the imaging apparatus main body 100 in an integrated manner. A system memory 152 uses a RAM. In the system memory 152, constants and variables for operation of the system control unit 150, programs read from the nonvolatile memory 156, and the like are loaded.

  The system timer 153 is a time measuring unit that measures the time used for various controls and the time of a built-in clock. The mode changeover switch 160, the first shutter switch 162 and the second shutter switch 163 accommodated in the shutter button 161, and the operation unit 170 function as operation means for inputting various operation instructions to the system control unit 150. The mode switch 160 switches the operation mode of the system control unit 150 to any one of a still image recording mode, a moving image recording mode, and a reproduction mode. The modes included in the still image recording mode include an auto shooting mode, an auto scene determination mode, a manual mode, various scene modes for setting shooting for each shooting scene, a program AE mode, a custom mode, and a multiple exposure shooting mode. The mode switch 160 directly switches to any of these modes included in the still image shooting mode. Alternatively, the mode may be switched once to the still image shooting mode by the mode change switch 160, and then switched to any of these modes included in the still image shooting mode using another operation member. Similarly, the moving image shooting mode may include a plurality of modes.

  The first shutter switch 162 is turned on by operating the shutter button 161 provided on the imaging apparatus main body 100 during half operation (so-called half-press (instruction for shooting preparation)) to generate a first shutter switch signal SW1. The system control unit 150 starts operations such as an AF (auto focus) process, an AE (auto exposure) process, an AWB (auto white balance) process, and an EF (auto flash light control) process in response to the first shutter switch signal SW1. I do.

  The second shutter switch 163 is turned on when the operation of the shutter button 161 is completed, that is, when the shutter button 161 is fully pressed (photographing instruction), and generates a second shutter switch signal SW2. The system control unit 150 starts a series of photographing processing operations from signal reading from the imaging unit 122 to writing of image data to the recording medium 190 by the second shutter switch signal SW2.

  Each operation member of the operation unit 170 is appropriately assigned a function for each scene by, for example, selecting and operating various function icons displayed on the display unit 128, and functions as various function buttons. The function buttons include, for example, an end button, a return button, an image forward button, a jump button, a refinement button, an attribute change button, and the like. For example, when a menu button is pressed, a menu screen on which various settings can be made is displayed on the display unit 128. The user can intuitively perform various settings using the menu screen displayed on the display unit 128 and the four-way buttons and the SET button for up, down, left, and right. As a menu screen that can be set variously, there is a screen for selecting a previously shot image recorded on the recording medium 190 as a base image when the multiple exposure shooting mode is selected. Multiple-exposure shooting that combines shot images is also possible. Further, there is also a screen for selecting whether or not to crop the readout size of the image to be captured to the APS-C sensor size. When the cropping setting is set, and when the lens for the full size sensor is attached, the APS-C You can shoot with C sensor size. This cropping process will be described later with reference to FIG.

  The power control unit 141 includes a battery detection circuit, a DC-DC converter, a switch circuit for switching a block to be energized, and the like, and detects whether or not a battery is mounted, the type of the battery, and the remaining battery level. Further, the power supply control unit 141 controls the DC-DC converter based on the detection result and the instruction of the system control unit 150, and supplies a necessary voltage to each unit including the recording medium 190 for a necessary period.

  The power supply unit 140 includes a primary battery such as an alkaline battery and a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, and a Li battery, and an AC adapter. The recording medium I / F 118 is an interface with a recording medium 190 such as a memory card or a hard disk. The recording medium 190 is a recording medium such as a memory card for recording a captured image, and includes a semiconductor memory, a magnetic disk, and the like.

  The connector 171 electrically connects the imaging device main body 100 to the lens unit 180. The connector 171 transmits a control signal, a status signal, a data signal, and the like between the imaging apparatus main body 100 and the lens unit 180, and has a function of supplying currents of various voltages. Whether the lens unit 180 is attached to the connector 171 is detected by the lens attachment / detachment detection unit 154.

  Next, the configuration of the lens unit 180 will be described. The imaging lens 181 includes a plurality of lenses including a focus lens that adjusts focus by moving in the optical axis direction and a zoom lens that performs zooming. The aperture 182 adjusts the amount of light to the imaging unit 122 of the imaging apparatus main body 100. The lens control unit 183 controls the entire lens unit 180 in accordance with a control signal from the system control circuit 150 of the imaging apparatus main body 100, and also controls the driving of the focus lens and zoom lens of the imaging lens 181 and the aperture 182. In addition, the lens control unit 183 includes a memory that stores operation constants, variables, programs, and the like. Further, the lens control unit 183 includes identification information such as a model name and a serial number unique to the lens unit 180, management information, function information such as an amount of aberration such as an open aperture value and a minimum aperture value, a focal length, and distortion. A non-volatile memory for storing past setting values and the like is also provided. The connector 184 electrically connects the lens unit 180 to the imaging device main body 100. The connector 184 transmits a control signal, a status signal, a data signal, and the like between the imaging device main body 100 and the lens unit 180, and has a function of supplying currents of various voltages.

  Next, a basic operation of the multiple exposure shooting will be described with reference to FIGS. FIG. 2 shows a setting menu screen relating to multiple exposure shooting, and FIG. 3 shows an image shot in multiple exposure shooting.

  When the user presses the menu button of the operation unit 170, a menu screen relating to various settings is displayed. When the user operates the up, down, left, and right buttons of the operation unit 170 to select a setting item related to multiple exposure shooting, a sub menu screen 200 for multiple exposure shooting shown in FIG. Settings can be changed.

  The multiple exposure shooting menu screen 200 includes setting items 201 to 204 and a button 205 for selecting a reference image. Among these, the setting item 201 is a setting item for selecting whether or not to perform multiple exposure shooting, and selects one of “Yes” and “No”. After selecting “Yes”, exiting the menu and returning to shooting, the camera enters the multiple exposure shooting mode.

  The setting item 202 is a setting item for selecting a method of overlapping exposure during multiple exposure shooting. The user can select one of “addition”, “average”, “comparison (bright)”, and “comparison (dark)” Either one can be selected. In the “addition”, the luminances of a plurality of images to be combined are simply added. In the “average averaging”, the luminances of a plurality of images to be synthesized are added so as to be an average of the number of images to be described later. In “comparison (bright)”, the luminances of the images to be combined are compared to leave a bright portion, and conversely, in “comparison (dark)”, the images are superimposed so that a dark portion remains.

  The setting item 203 is a setting item for selecting the number of images to be combined in the multiple exposure shooting, and the user can specify the number of images to be superimposed. In the multiple exposure shooting mode, after the set number of images have been shot and the composite image has been recorded, the mode is returned from the multiple shooting mode to the normal snap mode.

  The setting item 204 is a setting item for selecting an image to be recorded on the recording medium 190 in the multiple exposure shooting, and the user can select either “all images” or “only multiple images”. When “all images” is selected, both the plurality of images from which the images are superimposed and the multiple-exposure composite image are recorded on the recording medium 190. When “only multiple images” is selected, only multiple exposure composite images are recorded on the recording medium 190, and individual captured images that are the basis of the multiple images are not recorded.

  When the user presses the button 205, one image file already stored in the recording medium 190 is selected, and a multiple exposure composite image is generated and recorded. When the user sets “5” in the setting item 203 and selects one image file (RAW image file) already recorded by pressing the button 205, the image represented by the selected image file is displayed. A multiple exposure image is generated by setting the first image (first image) and the remaining four images as images captured thereafter.

  The number of image files to be selected may be two or more. In this case, for example, when two are selected, a multiple exposure image may be generated from two images indicated by the two selected files and three images to be captured.

  Reference numeral 601 in FIG. 3A indicates the first captured image in the multiple exposure shooting mode, and reference numeral 602 in FIG. 3B indicates the second captured image. Reference numeral 603 in FIG. 9C is a multiple exposure composite image at the time when the second image capturing is completed.

[First Embodiment]
FIG. 4 is a flowchart illustrating a processing procedure in the multiple exposure mode of the system control unit 150 according to the first embodiment. When the user selects the multiple exposure shooting mode with the mode switching switch 160 or selects the multiple exposure shooting by menu setting, the imaging apparatus main body 100 enters the multiple exposure shooting mode, and the processing in FIG. 4 is executed. In the processing of each step in FIG. 4, the system control unit 150 loads a predetermined program read from the nonvolatile memory 156 on the system memory 152 and controls the operation and processing of each unit configuring the imaging apparatus main body 100. It is realized by. It is assumed that various settings (such as the number of images to be combined and the designation of a combined image file) of the multiple exposure have already been performed by the user, and the set information has been stored in the system memory 152. Unless otherwise changed, the number of combined images during the previous multiple exposure shooting may be set as the number of combined images this time. In this case, the number of combined images may be stored in the nonvolatile memory 156.

  In step S <b> 401, the system control unit 150 acquires from the system memory 152 and the nonvolatile memory 156 the number N of multiple composite images, which is one of the setting information of the multiple exposure shooting mode. Subsequently, in S402, the system control unit 150 selects and multiplexes the base image as the first image from the already captured images based on the information stored in the system memory 152 and the nonvolatile memory 156. It is determined whether or not a base image selection for starting exposure shooting has been made. If the system control unit 150 determines that the base image has not been selected (NO in S402), the process proceeds to S403, and substitutes an initial value “0” for a variable n for counting the number of shots. On the other hand, if the base image has been selected (YES in S402), the system control unit 150 advances the processing to S404, and substitutes an initial value “1” for a variable n.

  In S405, system control unit 150 determines whether or not the lens unit has been reinstalled based on a signal from lens attachment / detachment detection unit 154. Re-attachment of the lens unit includes, for example, a case where the attached lens is once removed and attached again, or a case where the lens unit is replaced with a lens different from the attached lens.

  If it is determined that the lens unit has been remounted (YES in S405), the process proceeds to S406, and if it is determined that the lens has not been remounted (NO in S405), the system control unit 150 proceeds to S409. Proceed to.

  In step S406, the system control unit 150 determines whether the variable n is “0”, that is, whether the base image has not been selected, or whether any of the plurality of images has been shot in the multiple exposure shooting mode. Determine whether or not. In other words, the system control unit 150 determines whether or not there is an image of the multiple composition source. If the system control unit 150 determines that the variable n is “0” (YES in S406), the process proceeds to S409. If the variable n is other than “0” (NO in S406), the system control unit 150 advances the processing to S407.

  In S407, system control unit 150 determines whether or not the image circle of the newly mounted lens unit is different from the image circle of the lens unit which has been mounted so far.

  Specifically, the system control unit 150 can communicate with the lens unit 180 being mounted through the connector 80 and acquire identification information such as a model name. Then, the system control unit 150 can obtain the image circle of the currently mounted lens unit by searching the lens table 156a in the nonvolatile memory 156 using the obtained identification information. Therefore, the system control unit 150 compares the image circle of the lens unit before the lens unit is remounted (it is stored at a predetermined address in the nonvolatile memory 156) with the image circle of the dot unit after the lens unit is remounted. By performing the comparison, the determination processing of S407 is performed.

  Note that the determination process of S407 may be determined based on whether it is necessary to switch the size of an image read and recorded from the imaging unit 122 according to the attached lens unit. Further, the image read from the imaging unit 122 is scanned by the image processing unit 124 and the system control unit 150 to detect the amount of vignetting in the peripheral portion of the image, and to determine whether the amount is different from the previous amount of vignetting. The determination may be made.

  Here, the difference between the image circles will be described with reference to FIGS. Reference numerals 501 and 502 in FIGS. 5A and 5B indicate a state in which light passing through the lens unit forms an image on the image sensor of the image capturing unit 122. Reference numeral 501 indicates a state when a lens unit for a full size sensor is mounted, and reference numeral 502 indicates a state when a lens unit for an APS-C size sensor is mounted. As described above, the image sensor in the present embodiment is a full size sensor. However, when the lens unit for the APS-C size sensor is mounted, light does not shine on the peripheral portion of the image sensor, and "vignetting" occurs around the image. Therefore, when the lens unit for the APS-C size sensor is mounted, the system control unit 150 controls the imaging unit 122 to convert an image of an area indicated by reference numeral 503 in the imaging device into a captured image. And perform crop processing. By performing the crop processing in this way, although the size is reduced, one image excluding the vignetting portion can be obtained.

  On the other hand, in the case of multi-exposure shooting, images are synthesized as shown in FIG. Resulting in an unnatural composite image. Also, if the readout size of an image is cropped to the APS-C sensor size and only the portion that is exposed to light is cut out and read, the image size will be different and cannot be combined.

  Therefore, in the present embodiment, if the system control unit 150 determines that the image circle of the lens unit that has been remounted is the same as the image circle of the lens unit that has been mounted (NO in S407), the process proceeds to S409. Proceed. If the system control unit 150 determines that the image circle of the lens unit that has been remounted is different from the image circle of the lens unit that has been mounted (YES in S407), the system control unit 150 interrupts the subsequent imaging processing. The process proceeds to S408.

  In step S408, the system control unit 150 causes the display unit 28 to display a message (FIG. 6) indicating that the multiple exposure shooting is to be ended. Then, the system control unit 150 advances the process to S415 in order to record the composite image obtained by the previous shooting as an image file on the recording medium 190.

  In S409, system control unit 150 determines whether second shutter switch 163 has been turned on (whether second shutter switch signal SW2 has been generated). If the system control unit 150 determines that the second shutter switch 163 is not turned on (NO in S409), the process returns to S405, and waits for the second shutter switch 163 to be turned on. If the system control unit 150 determines that the second shutter switch 163 has been turned on, the process proceeds to S410.

  In S410, system control unit 150 captures a still image frame by image capturing unit 122, stores the obtained image data (RAW image data in Bayer array) in memory 132, and advances the processing to S411. In S411, system control unit 150 increases the value of variable n by “1”, and advances the processing to S412.

  In S412, system control unit 150 determines whether or not the value of variable n is greater than “1”. That is, the system control unit 150 determines whether or not the target image of the combining process already exists. When determining that the variable n is equal to or smaller than “1” (NO in S412), the system control unit 150 returns the process to S405. If the system control unit 150 determines that the variable n is larger than “1” (YES in S412), the process proceeds to S413.

  In step S413, the system control unit 150 controls the image processing unit 24 to combine the image data captured in step S410 and stored in the memory 132, generate combined image data, and store the combined image data in the memory 132. If the variable n is greater than “2”, that is, if the image captured in S410 is the third or subsequent image, the system control unit 150 obtains the captured image data by the previous synthesis processing. The image is synthesized with the synthesized image data to generate new synthesized image data and stored in the memory 132. After finishing the process in S413, the system control unit 150 advances the process to S414. In the combining process in S413, the combining process is performed without changing the image data in the Bayer array.

  In S414, system control unit 150 determines whether or not variable n is equal to “N”, that is, whether or not multiple exposure shooting is to be ended. If the variable n is not equal to “N” (NO in S414), the system control unit 150 returns the process to S405. If the system control unit 150 determines that the variable n is equal to “N”, the process proceeds to S415.

  In step S415, the system control unit 150 controls the image processing unit 124 to perform development processing (including debayer processing), that is, processing such as white balance adjustment and pixel interpolation on the composite image data generated in step S413. , YUV data, and writes the data to the memory 132. After finishing the process in S415, the system control unit 150 advances the process to S416.

  In S416, the system control unit 150 controls the image processing unit 24, compresses and encodes the developed composite image data generated in S415 into JPEG still image data, writes the JPEG still image data in the memory 132, and proceeds to S417. Proceed.

  In step S417, the system control unit 150 records the JPEG still image data compression-encoded in step S416 on the recording medium 190 via the recording medium I / F 118, and ends a series of multiple exposure shooting. Note that, when “save captured image” is selected in the setting item of FIG. 2, each captured image (the image obtained in S410) stored in the memory 132 and used for synthesis is also recorded in the storage medium 190. Will be done.

  As described above, during the multiple exposure shooting, if the re-attachment of the lens unit is newly detected and the image circle of the re-attached lens unit is different from the image circle of the lens unit that was attached before, a message is displayed. Is displayed to end the multiple exposure shooting. By doing so, it is possible to prevent an incorrect multiplex image from being synthesized when a lens unit having a different image circle from the lens unit that has been mounted is mounted during multiple exposure shooting. For example, when multiple-exposure shooting is started with a lens unit for a full-size sensor attached, and if a lens unit for an APS-C size sensor is replaced halfway, an incorrect multiple image is prevented from being synthesized. Can be. Further, although the initially set N images are not combined, a combined image using an image obtained by taking a partial image can be stored in the storage medium 190.

[Second embodiment]
Next, processing of the imaging device according to the second embodiment will be described. The configuration itself of the imaging apparatus according to the second embodiment is the same as that of the first embodiment (FIG. 1), and a detailed description thereof will be omitted.

  In the first embodiment, when the lens unit is remounted during multiple exposure shooting and the image circle of the lens unit is different from the image circle of the lens unit that has been mounted, a message is displayed and the multiplication is performed. Exposure shooting ended. On the other hand, in the second embodiment, when a lens unit having a different image circle from the lens unit that has been mounted is mounted during multiple exposure shooting, a warning message is displayed and the same image circle is again displayed. Shooting can be continued by re-installing the lens unit. This prevents incorrect multi-images from being synthesized when a lens unit with a different image circle from the lens unit that was mounted so far is mounted, and does not terminate shooting if mounted incorrectly. A series of multiple exposure shooting can be continued by mounting the correct lens unit again.

  FIG. 7 is a flowchart illustrating a processing procedure in the multiple exposure mode of the system control unit 150 according to the second embodiment. It is assumed that various settings (such as the number of images to be combined and the designation of a combined image file) for the multiple exposure have already been performed, and the set information is held in the system memory 152 or the nonvolatile memory 156. .

  The processes of S701 to S707 and S709 to S717 in FIG. 7 are the same as S401 to S407 and S409 to S417 of FIG. FIG. 7 differs from FIG. 4 in the processes of S721 to S726 after S707 is determined to be No (corresponding to after S407 in FIG. 4 is determined to be No).

  In S721, system control unit 150 causes display unit 128 to display a message (FIG. 8) indicating that a lens unit having a different image circle has been mounted and prompting the user to replace the lens unit again. In addition, the system control unit 150 can select whether to record the composite image obtained by the previous shooting and end the multiple exposure shooting or to discard the composite image and end the multiple exposure shooting. Is displayed on the display unit 128, and the process proceeds to S722.

  In S722, system control unit 150 determines whether or not the user has selected to end the multiple exposure shooting from the menu displayed in S721. If it is determined that the user has not selected the end of the multiple exposure shooting (NO in S722), the system control unit 150 advances the process to S724, and it is determined that the user has selected the end of the multiple exposure shooting ( (S722: YES), the process proceeds to S723.

  In S723, system control unit 150 determines whether or not the user has selected to record the composite image obtained by the previous shooting, based on the menu displayed in S721. If it is determined that the user has not selected to record the composite image (NO in S723), the system control unit 150 ends the series of multiple exposure shooting. If the system control unit 150 determines that the user has selected to record the composite image (YES in S723), the process proceeds to S715.

  In S724, system control unit 150 determines whether or not the lens unit has been reinstalled by lens attachment / detachment detection unit 154. If it is determined that the lens unit has been mounted (YES in S724), the process proceeds to S725, and if it is determined that the lens unit has not been mounted (NO in S724), the system control unit 150 performs the mounting again. The process returns to S721 to wait.

  In S725, system control unit 150 determines whether or not the image circle of the lens unit that has been remounted is different from the image circle of the lens unit that was used in the immediately preceding shooting. If it is determined that the image circle of the lens unit that has been re-mounted is the same as the image circle of the lens unit used in the immediately preceding shooting (YES in S725), the process proceeds to S726. If the system control unit 150 determines that the image circle of the lens unit that has been mounted again is different from the image circle of the lens unit used in the immediately preceding shooting (NO in S725), the process returns to S721.

  In S726, system control unit 150 hides the warning message displayed in S721, returns the process to S705, and continues a series of multiple exposure shooting.

  A series of multiple exposure shooting processing from S709 to S717 is the same as S409 to 417 in the first embodiment, and a description thereof will be omitted.

  As described above, according to the second embodiment, when a lens unit having a different image circle from the lens unit that has been mounted is mounted during multiple-exposure shooting, a warning message is displayed and the user is notified. A series of multiple exposure shooting can be terminated according to the selection of. Further, when the user does not select the end of the series of multiple exposure shooting and re-attachs the same lens unit of the image circle again, the series of multiple exposure shooting can be continued. This prevents incorrect multi-images from being synthesized when a lens unit with a different image circle from the lens unit that was mounted so far is mounted, and does not terminate shooting if mounted incorrectly. A series of multiple exposure shooting can be continued by mounting another lens unit again. For example, when multiple-exposure shooting is started with a lens unit for a full-size sensor attached, and if a lens unit for an APS-C size sensor is replaced halfway, an incorrect multiple image is prevented from being synthesized. Can be. Further, when the lens unit for the full size sensor is mounted again, a series of multiple exposure shooting can be continued.

[Third Embodiment]
Next, processing of the imaging device according to the third embodiment will be described. The configuration itself of the imaging apparatus according to the third embodiment is the same as that of the first embodiment (FIG. 1), and a detailed description thereof will be omitted.

  In the first embodiment, when a new lens unit is mounted during multiple exposure shooting, if the image circle of the mounted lens unit is different from the image circle of the lens unit that has been mounted, a message is displayed. Is displayed to end the multiple exposure shooting.

  Similarly, in the third embodiment, a lens unit is newly mounted during multiple exposure shooting, and image correction settings such as distortion correction become effective in the newly mounted lens unit, that is, image correction is not performed. When a required lens unit is attached, a message is displayed and multiple exposure shooting is terminated. In this way, when a lens unit that requires image correction is mounted during multiple exposure shooting, an image that does not require image correction and an image that requires image correction are combined, and an unnatural multiple image is generated. It can be prevented from being generated.

  FIG. 9 is a flowchart illustrating a processing procedure in the multiple exposure mode of the system control unit 150 according to the third embodiment. It is assumed that various settings (such as the number of images to be combined and the designation of a combined image file) for the multiple exposure have already been performed, and the set information is held in the system memory 152 or the nonvolatile memory 156. . When the multiple exposure mode is started, the settings of image correction such as distortion correction are fixed to be invalid, and then the multiple exposure shooting mode is started.

  S901 to S905 and S909 to S917 in FIG. 9 are the same as S401 to S405 and S409 to S417 in FIG. 9 differs from FIG. 4 in the processing of S921 to S923 after S905 is determined to be No (corresponding to the determination after S405 in FIG. 4 is No).

  In step S921, the system control unit 150 determines whether or not the image correction setting needs to be enabled in the newly mounted lens unit, that is, whether or not a lens unit that requires image correction is mounted. judge. The determination as to whether it is necessary to fix the image correction setting effectively may be performed by storing information indicating whether correction is necessary in the lens table 156a in association with the lens identification information (model name). The system control unit 150 may receive the identification information from the attached lens unit via the connector 171, obtain the information on the necessity of correction of the corresponding lens unit from the lens table 156 a, and make the determination. In some cases, the system control unit 150 may make a determination using correction function information for distortion or the like of the lens unit 180 acquired from the lens unit 180 through the connector 171. Further, the image read out from the imaging unit 122 may be scanned by the image processing unit 124 or the system control unit 150 to detect and determine the amount of aberration of the image.

  If the system control unit 150 determines that it is not necessary to fix the image correction setting in the newly mounted lens unit to be effective and fixed (NO in S921), the process proceeds to S909. If the system control unit 150 determines that the image correction setting needs to be valid for the newly mounted lens unit (YES in S921), the process proceeds to S922.

  In step S922, the system control unit 150 displays a message indicating that the multiple exposure shooting is to be completed on the display unit 128, and advances the process to step S923. In S923, system control unit 150 determines whether or not the value of coefficient n is greater than “1”, that is, whether or not at least two images have been shot for multiple exposure. If variable n is greater than “1” (YES in S923), system control unit 150 causes the process to proceed to S915. If the system control unit 150 determines that the variable n is equal to or less than “1” (No in S923), the process ends a series of multiple exposure shooting.

  Until the series of multiple-exposure shooting from S909 to S917 is completed, steps S409 to S417 in the first embodiment are the same, and a description thereof will be omitted.

  As described above, according to the third embodiment, when a lens unit is newly mounted during multiple exposure shooting, image correction settings such as distortion correction are effectively fixed in the mounted lens unit. In this case, that is, when a lens unit that requires image correction is attached, a message is displayed and the multiple exposure shooting ends. By doing so, it is possible to prevent an incorrect multiple image from being synthesized when a lens unit that requires image correction is attached during multiple exposure shooting in which the image correction setting is invalidated and fixed. For example, it is possible to prevent an incorrect multiplex image from being synthesized when the lens unit is replaced with a lens unit having a large distortion and effectively fixing the image correction setting instead of being inexpensive during multiple exposure shooting.

[Fourth embodiment]
Next, processing of the imaging device according to the fourth embodiment will be described. The configuration itself of the imaging apparatus according to the fourth embodiment is the same as that of the first embodiment (FIG. 1), and a detailed description thereof will be omitted.

  In the fourth embodiment, when a lens unit newly installed during multiple exposure shooting needs to enable image correction settings such as distortion correction, that is, when a lens unit that requires image correction is mounted , A message is displayed to end the multiple exposure shooting. In contrast, in the fourth embodiment, when a lens unit that requires image correction is mounted during multiple exposure shooting, a warning message is displayed, and a lens unit that does not require image correction is mounted again. If you fix it, you can continue shooting. Thus, it is possible to prevent an unnatural composite image from being synthesized when a lens unit that requires image correction is attached during multiple exposure shooting in which the image correction setting is invalidated. Further, when the lens unit is attached by mistake, it is possible to continue the series of multiple exposure shooting by re-attaching the lens unit without ending the shooting.

  FIG. 10 is a flowchart illustrating a processing procedure in the multiple exposure mode of the system control unit 150 according to the fourth embodiment. It is assumed that various settings (such as the number of images to be combined and the designation of a combined image file) for the multiple exposure have already been performed, and the set information is held in the system memory 152 or the nonvolatile memory 156. . When the multiple exposure mode is started, the settings of image correction such as distortion correction are fixed to be invalid, and then the multiple exposure shooting mode is started.

  The processing of S1001 to S1005 and S1009 to S1017 is the same as that of S401 to S405 and S409 to S417 in the first embodiment, and a description thereof will not be repeated.

In step S1021, the system control unit 150 determines whether a lens unit that requires image correction is attached. If the system control unit 150 determines that a lens unit that does not require image correction is attached (No in S1021), the process proceeds to S1009. If the system control unit 150 determines that a lens unit requiring image correction has been attached (YES in step S1021), the process advances to step S1022. In step S1022, the system control unit 150 determines whether a lens unit that requires image correction is required. The display unit 128 displays a message prompting the user to replace the lens unit again because the lens unit is attached. At the same time, a menu is displayed on the display unit 128 from which the composite image obtained by the previous shooting is recorded and the multiple exposure shooting can be terminated or the composite image is discarded and the multiple exposure shooting is terminated. The process proceeds to S1023.

  In S1023, system control unit 150 determines whether or not the user has selected to end the multiple exposure shooting from the menu displayed in S1022. If it is determined that the user has not selected to end the multiple exposure shooting (NO in S1023), system control unit 150 advances the process to S1025. If the system control unit 150 determines that the user has selected to end the multiple exposure shooting (YES in S1023), the process proceeds to S1024.

  In S1024, system control unit 150 determines whether or not the user has selected to record the composite image obtained by the previous shooting, based on the menu displayed in S1022. If the system control unit 150 determines that the user has not selected to record the composite image (NO in S1024), the series of multiple exposure shooting ends. If the system control unit 150 determines that the user has selected to record the composite image (YES in S1204), the process proceeds to S1015.

  In S1025, system control unit 150 determines whether or not the lens unit has been reinstalled by lens attachment / detachment detection unit 154. If it is determined that the lens unit is mounted (YES in S1025), the process proceeds to S1026, and if it is determined that the lens unit is not remounted (NO in S1025), the process returns to S1022. .

  In S1026, system control unit 150 determines whether or not it is necessary to validate the image correction setting in the lens unit that has been remounted, that is, whether or not a lens unit that requires image correction has been mounted. I do. If the system control unit 150 determines that it is not necessary to validate the image correction setting in the lens unit that has been re-mounted (NO in S1026), the process proceeds to S1027. If it is determined that the image correction setting needs to be made valid for the lens unit that has been re-mounted (YES in S1026), the process returns to S1022.

  In S1027, system control unit 150 hides the warning message displayed in S1022, returns the process to S1005, and continues a series of multiple exposure shooting.

  A series of multiple exposure photographing processing from S1009 to S1017 is the same as S409 to S417 in the first embodiment, and a description thereof will be omitted.

  As described above, according to the fourth embodiment, when the image correction setting needs to be effectively fixed in a newly mounted lens unit during multiple exposure shooting, that is, a lens unit in which image correction is essential When the is mounted, a warning message is displayed, and a series of multiple exposure shooting can be ended according to the user's selection. Further, when the user does not select the end of the series of multiple exposure shooting and re-attachs a lens unit that does not require image correction again, the series of multiple exposure shooting can be continued. Accordingly, it is possible to prevent an incorrect multiplex image from being synthesized when a lens unit that requires image correction is attached during multiple exposure shooting in which the image correction setting is invalidated and fixed. Further, when the lens unit is attached by mistake, the photographing is not terminated, and another lens unit can be attached again to continue a series of multiple exposure photographing.

(Other Examples)
The present invention supplies a program for realizing one or more functions of the above-described embodiments to a system or an apparatus via a network or a storage medium, and one or more processors in a computer of the system or the apparatus read and execute the program. It can also be realized by the following processing. Further, it can be realized by a circuit (for example, an ASIC) that realizes one or more functions.

Claims (12)

An image pickup apparatus having an interchangeable lens image pickup means,
A synthesizing unit that synthesizes a plurality of images obtained by performing imaging a plurality of times by the imaging unit and generates a synthesized image;
Detecting means for detecting attachment / detachment of the lens;
Control means for controlling the synthesizing means in accordance with the detection by the detection means,
The control means includes:
The lens has been re-mounted based on the detection by the detection unit when performing the imaging multiple times by the synthesizing unit, and the image circle of the re-mounted lens has been mounted before the re-mounting. An imaging device for interrupting imaging by the imaging means to generate the composite image when the imaging circle is different from the imaging circle. The control means includes:
The lens has been re-mounted based on the detection by the detection unit when performing the imaging multiple times by the synthesizing unit, and the image circle of the re-mounted lens has been mounted before the re-mounting. 2. If the image circle is different from the image circle of the above, it waits until a lens of the same image circle as the lens attached before re-attachment is attached, and continues the plurality of imagings by the re-attachment. An imaging device according to item 1. The control means includes:
The lens has been re-mounted based on the detection by the detection unit when performing the imaging multiple times by the synthesizing unit, and the image circle of the re-mounted lens has been mounted before the re-mounting. 3. A display means for displaying, on a predetermined display unit, a message prompting the user to attach a lens having the same image circle as the lens attached before re-attachment when the image circle is different from the lens attached. Imaging device. An image pickup apparatus having an interchangeable lens image pickup means,
A synthesizing unit that synthesizes a plurality of images obtained by performing imaging a plurality of times by the imaging unit and generates a synthesized image;
Detecting means for detecting attachment / detachment of the lens;
Control means for controlling the synthesizing means in accordance with the detection by the detection means,
The control means includes:
If the lens is re-mounted based on the detection by the detecting unit when performing the imaging multiple times by the synthesizing unit, and the re-mounted lens is a lens that requires image correction, An imaging apparatus for interrupting imaging for generating the composite image by means. The control means includes:
If the lens is re-mounted based on the detection by the detecting unit when the image capturing is performed a plurality of times by the combining unit, and the re-mounted lens is a lens that requires image correction, The image pickup apparatus according to claim 4, wherein the camera waits for an unnecessary lens to be attached, and continues the plurality of times of imaging by the reattachment. The control means includes:
If the lens is re-mounted based on the detection by the detecting unit when the image capturing is performed a plurality of times by the combining unit, and the re-mounted lens is a lens that requires image correction, The imaging apparatus according to claim 5, further comprising a display unit that displays a message prompting the user to attach an unnecessary lens on a predetermined display unit.   The control unit may be configured to interrupt the imaging by the imaging unit in order to generate the composite image and, when capturing a plurality of images before the interruption, to stop the imaging before the interruption. The imaging apparatus according to claim 1, wherein a composite image generated from the plurality of images is recorded in a storage medium.   The imaging apparatus according to claim 1, further comprising a setting unit configured to set the number of images to be combined by the combining unit. Further comprising a designation unit for designating a first image to be used in the synthesizing unit, from a storage medium storing the captured image,
9. The image processing apparatus according to claim 1, wherein when the specifying unit selects an image from the storage medium, the synthesizing unit synthesizes the selected image as an image captured first in the plurality of imagings. The imaging device according to any one of the above. A method for controlling an imaging apparatus having an imaging unit with interchangeable lenses,
A synthesizing step of synthesizing a plurality of images obtained by performing imaging a plurality of times by the imaging unit and generating a synthesized image;
A detection step for detecting the attachment / detachment of the lens,
A control step of controlling the synthesis step according to the detection by the detection step,
The control step includes:
The lens has been re-mounted based on the detection by the detection step when performing the imaging multiple times in the synthesizing step, and the image circle of the re-mounted lens is the lens that was mounted before the re-mounting. A method for generating the composite image in the image capturing step when the image circle is different from the image circle of the image circle. A method for controlling an imaging apparatus having an imaging unit with interchangeable lenses,
A synthesizing step of synthesizing a plurality of images obtained by performing imaging a plurality of times by the imaging unit and generating a synthesized image;
A detection step for detecting the attachment / detachment of the lens,
A control step of controlling the synthesis step according to the detection by the detection step,
The control step includes:
If the lens is remounted based on the detection in the detection step when performing the imaging multiple times in the synthesizing step, and the remounted lens is a lens that needs image correction, A method for controlling an imaging apparatus, comprising: interrupting imaging for generating the composite image by means.   12. A program for causing a processor of an imaging apparatus having an imaging unit capable of replacing a lens to read and execute the processing so that the imaging apparatus executes each step of the method according to claim 10 or 11.