JP2013251724A - Photographing instrument - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain, through a simple operation, an HDR photographed image and image data matching the taste of a user.SOLUTION: A photographing instrument comprises: an imaging section that picks up a subject image; an exposure modifying section able to set a plurality of pick-up images by use of a plurality of exposure values and able to perform switching among the exposure values; an image combining section that combines the plurality of picked-up images obtained by the plurality of picked-up images by use of the plurality of exposure values; a display control section that shows a display based on the image obtained by combining the images by use of the image combining section; and an operation detecting section that controls the switching among the exposure values by use of the exposure modifying section.

Description

  The present invention relates to an imaging device capable of high dynamic range imaging.

  In recent years, portable devices with a photographing function (photographing devices) such as digital cameras have become widespread. Some types of photographing apparatuses have a display unit and a function of displaying a photographed image. Further, there is a display screen that displays a menu screen to facilitate operation of the photographing device.

  In addition, some photographic devices have an automatic exposure adjustment function. Normally, exposure adjustment is performed so that the exposure is appropriate for the main subject. However, when the brightness difference of the subject is large, the bright part may be skipped and the dark part may be blackened.

  Therefore, conventional photographic equipment that enables high dynamic range (HDR) shooting that expands the dynamic range and suppresses overexposure and underexposure by taking and combining multiple photos while changing the exposure. It has become.

  For example, Patent Document 1 proposes a technique for confirming the effect of dynamic range expansion by displaying a histogram in real time. Further, in Patent Document 2, a photographer arbitrarily selects an image from images captured by a camera having a multiple exposure shooting mode, and edits and combines the images on the camera monitor, thereby obtaining an image. A technique for providing a composite image according to the photographer's preference by making it possible to confirm the correction result on the spot.

JP 2009-239637 A JP 2006-253810 A

  However, conventionally, there has been a problem that a relatively complicated check operation is necessary for a user to obtain a composite image according to his / her preference by HDR shooting.

  An object of this invention is to provide the imaging device which can obtain the HDR picked-up image and image data according to a user's liking by simple operation.

  An imaging apparatus according to the present invention includes an imaging unit that captures a subject image, and a plurality of exposure values that are set in the imaging unit and a plurality of exposure values that can be switched. An image composition unit that synthesizes a plurality of captured images obtained by a plurality of imaging using the plurality of exposure values, a display control unit that displays a display based on the image synthesized by the image synthesis unit, An operation detecting unit that controls switching of the plurality of exposure values by the exposure changing unit.

  According to the present invention, it is possible to obtain an HDR photographed image and image data according to the user's preference with a simple operation.

1 is a block diagram showing a circuit configuration of a photographing apparatus according to a first embodiment of the present invention. Explanatory drawing for demonstrating the display on the display screen at the time of HDR imaging | photography mode. Explanatory drawing for demonstrating the display on the display screen at the time of HDR imaging | photography mode. The flowchart for demonstrating camera control. Explanatory drawing for demonstrating the HDR imaging | photography assistance method employ | adopted in the 2nd Embodiment of this invention. Explanatory drawing for demonstrating the HDR imaging | photography assistance method employ | adopted in the 2nd Embodiment of this invention. Explanatory drawing for demonstrating the HDR imaging | photography assistance method employ | adopted in the 2nd Embodiment of this invention. Explanatory drawing which shows the HDR scale display 61 corresponding to FIG. Explanatory drawing which shows user operation. Explanatory drawing for demonstrating the imaging timing and imaging pixel number in each synthetic | combination step, taking time in a horizontal direction. The flowchart which shows camera control. The flowchart for demonstrating 2nd Embodiment. The flowchart for demonstrating 2nd Embodiment. The flowchart which shows the modification of 2nd Embodiment. Explanatory drawing which shows an example of a warning display. The flowchart which shows the other modification of 2nd Embodiment. Explanatory drawing which shows an example of a warning display. FIG. 3 is an explanatory diagram illustrating a structure of a RAW data file generated by image recording by a recording unit. Explanatory drawing which shows the example in case each image before HDR synthetic | combination is linked | related, and RAW data recording is carried out.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

(First embodiment)
FIG. 1 is a block diagram showing a circuit configuration of the photographing apparatus according to the first embodiment of the present invention. The photographing apparatus 1 in the present embodiment includes a main body unit 10, an interchangeable lens 20, and a display unit 30. The main body 10 is configured by housing main circuit portions of the photographing apparatus 1 in a housing. The main body 10 has an interchangeable lens 20 detachably attached to the front surface and a display portion 30 provided on the back surface.

  The display unit 30 has a display screen 31 that displays a captured image, as will be described later. A touch panel 32 is provided on the display screen 31. The touch panel 32 can generate an operation signal according to the position on the display screen 31 pointed by the user with a finger. This operation signal is supplied to a signal processing and control unit 11 described later of the main body unit 10. Accordingly, the signal processing and control unit 11 can detect a position on the display screen 31 touched by the user and a slide operation in which the user slides on the display screen 31 with a finger, and executes processing corresponding to the user operation. Can be done.

  The display unit 30 is provided with a display screen 31 along the back surface of the main body unit 10, and the photographer can check the through image displayed on the display screen 31 at the time of shooting. Shooting operation can be performed.

  The interchangeable lens 20 includes a lens unit 21 that guides a subject image to the imaging unit 12 of the main body unit 10. The lens unit 21 includes a lens for zooming and focusing, and the like, and includes an operation unit 22 for driving and controlling these lenses. By operating the operation unit 22 configured by a zoom ring, a focus ring, or the like, not only the focus but also the zoom position and the aperture can be adjusted.

  The operation unit 22 outputs an operation signal based on a user operation to the control unit 23. The control unit 23 is configured by a microcomputer or the like, and generates a focus signal and a zoom signal based on a rotation operation and a shift operation based on an operation signal from the operation unit 22 to control the drive unit 24.

  The drive unit 24 configured by a motor or the like drives a focus lens related to focusing and a zoom lens related to zooming provided in the lens unit 21 to perform focus control and zoom control. The lens unit 21 is provided with a focus control unit 21a and a zoom control unit 21b. The focus control unit 21a outputs a signal corresponding to the position of the focus lens to the focus position determination unit 25a. Further, the zoom control unit 21b outputs a signal corresponding to the position (zoom position) of the zoom lens to the zoom position determination unit 25b.

  The focus position determination unit 25 a determines the focus position based on the output of the focus control unit 21 a and outputs the determination result to the control unit 23. The zoom position determination unit 25 b determines the zoom position based on the output of the zoom control unit 21 b and outputs the determination result to the control unit 23. The control unit 23 receives the determination result of the focus position and the zoom position, and controls the drive unit 24 so that the focus position and the zoom position corresponding to the operation of the operation unit 22 are obtained.

  The interchangeable lens 20 is provided with a communication unit 28. The main body unit 10 is provided with a communication unit 13. The communication unit 28 transmits and receives information to and from the communication unit 13 of the main body unit 10 via a predetermined transmission path. When communication with the communication unit 13 of the main body 10 is established, the control unit 23 causes the communication units 28 and 13 to transmit the lens information stored in the recording unit 26 and zoom information related to the zoom operation to the main body 10. Can do.

  Based on the lens information, the main body 10 can recognize what zoom function the interchangeable lens 20 has, the focal length range (magnification), the focal length, the brightness number, and the like of the zoom lens. Further, the main body unit 10 is also provided with information on a rotation operation from the operation unit 22. The control unit 23 is configured to be controlled by the signal processing and control unit 11 by being supplied with a control signal from the signal processing and control unit 11 of the main body unit 10 via the communication units 13 and 28.

  In the present embodiment, various interchangeable lenses can be adopted, and not only interchangeable lenses but also non-replaceable lenses may be employed.

  The main body 10 constituting the photographing apparatus 1 has an imaging unit 12 configured by an imaging element such as a CCD or a CMOS sensor. The imaging unit 12 photoelectrically converts a subject image from the interchangeable lens 20 provided on the front surface of the main body unit 10 to obtain a captured image. The imaging unit 12 is driven and controlled by the signal processing and control unit 11 and outputs a captured image.

  The signal processing and control unit 11 is configured by, for example, a CPU (not shown) or the like, and performs camera control according to a program stored in a flash memory (not shown). The signal processing and control unit 11 outputs a driving signal for the imaging element to the imaging unit 12 and reads a captured image from the imaging unit 12. The signal processing and control unit 11 performs predetermined signal processing, for example, color adjustment processing, matrix conversion processing, noise removal processing, and other various signal processing on the read captured image.

  The main body unit 10 is also provided with a clock unit 14 and an operation determination unit 15. The clock unit 14 generates time information used by the signal processing and control unit 11. The operation determination unit 15 generates an operation signal based on a user operation with respect to an operation unit including a shutter button, a function button, and various switches such as a shooting mode setting (not shown) provided in the main body unit 10, and a signal processing and control unit 11 is output. The signal processing and control unit 11 controls each unit based on the operation signal.

  The signal processing and control unit 11 can compress the captured image after signal processing, and can apply the compressed image to the recording unit 16 for recording. As the recording unit 16, for example, a card interface can be adopted, and the recording unit 16 can record image information, audio information, and the like on a recording medium such as a memory card.

  In addition, the display control unit 11a of the signal processing and control unit 11 executes various processes related to display. The display control unit 11 a can give the captured image after the signal processing to the display unit 30 and the eyepiece display unit 17. The display unit 30 and the eyepiece display unit 17 each have a display screen such as an LCD, and display an image given from the display control unit 11a. Moreover, the display control part 11a can also display various menu displays etc. on these display screens.

  Further, the main body unit 10 is provided with an eye sensor 35 that detects that the user has brought his / her eye close to the eyepiece part of the eyepiece display unit 17. Based on the detection result of the eye sensor 35, the signal processing and control unit 11 can determine whether or not the user has brought the eye close to the eyepiece.

  In the present embodiment, the signal processing and control unit 11 can perform shooting in the HDR shooting mode. The touch / operation detection unit 11b detects a user's touch operation, slide operation, pressing operation, and the like based on an operation signal from the touch panel 32 and an operation signal from the operation determination unit 15 that detects an operation of each operation unit (not shown). To do. The HDR mode setting unit 11c determines whether the user has instructed the HDR shooting mode based on the detection result of the touch / operation detection unit 11b. When the HDR mode setting unit 11c determines that the HDR shooting mode is instructed by the user, the HDR mode setting unit 11c sets each unit to the HDR shooting mode. For example, in the HDR shooting mode, the exposure changing unit 11d controls the aperture and the shutter speed to perform shooting while changing the exposure value EV.

  In the present embodiment, in the HDR imaging mode, the display control unit 11a is controlled by the HDR mode setting unit 11c to display on the display screen 31 an HDR auxiliary display for controlling HDR imaging. The HDR auxiliary display may be displayed on the display screen of the eyepiece display unit 17. Further, the HDR mode setting unit 11c may display the HDR auxiliary display only when the user performs a further operation when the HDR shooting mode is designated. In the HDR shooting mode, the display control unit 11a changes the display of the HDR auxiliary display according to the detection result of the touch / operation detection unit 11b.

  In the present embodiment, the exposure change unit 11d is given the detection result of the touch / operation detection unit 11b, and can set the exposure value according to the exposure change operation by the user.

  The image composition unit 11e generates an HDR composite image by a known HDR image composition method. For example, the image synthesizing unit 11e is provided with a plurality of captured images taken while changing the exposure value EV from the imaging unit 12, and by combining these images, the image synthesizing unit 11e has a wide dynamic range with less overexposure and blackout. Generate an image. Further, the image composition unit 11e performs processing such as a tone mapping method on the generated high dynamic range image to reduce the dynamic range, thereby generating an HDR composite image with a specified dynamic range.

  In the present embodiment, the image composition unit 11e is provided with the detection result of the touch / operation detection unit 11b, and performs HDR image composition of the captured images captured with the exposure value according to the exposure change operation by the user. .

  The display control unit 11a is provided with the HDR composite image from the image composition unit 11e, and provides the HDR composite image to the display unit 30 and the eyepiece display unit 17. The display unit 30 and the eyepiece display unit 17 display the HDR composite image given from the display control unit 11a. In the HDR shooting mode, the display control unit 11a displays the HDR composite image on the display screen 31 and displays the HDR auxiliary display on the HDR composite image. Note that the HDR auxiliary display may be displayed on the eyepiece display unit 17.

  Next, the operation of the embodiment configured as described above will be described with reference to FIGS. 2 and 3 are explanatory diagrams for explaining display on the display screen in the HDR shooting mode, and FIG. 4 is a flowchart for explaining camera control.

  In the present embodiment, for example, the user supports the main body 10 with the left hand (not shown), and performs photographing with the photographing device 1 while holding the main body 10 with the right hand. As shown in FIG. 3, a shutter button 50 is disposed on the right side on the upper surface of the main body 10, and the user takes a picture by pressing the shutter button 50 with the index finger 48 of the right hand.

  When the power of the photographing apparatus 1 is turned on, the signal processing and control unit 11 determines whether or not the HDR photographing mode is instructed in step S1 of FIG. If the HDR shooting mode is not instructed, the signal processing and control unit 11 determines whether or not the reproduction mode is instructed in step S2. When the reproduction mode is instructed, the signal processing and control unit 11 reproduces the selected image in step S3. When the user instructs to change the reproduced image, the signal processing and control unit 11 shifts the process from step S4 to step S5 and changes the image. Note that if the playback mode is not designated in step S2, the signal processing and control unit 11 shifts to an image communication mode in which the captured image is transmitted in step S6.

  When the HDR shooting mode is instructed, the signal processing and control unit 11 determines whether or not lens replacement has been performed in step S11. If lens replacement has been performed, the control unit of the interchangeable lens 20 is determined. The lens information is acquired by communicating with 23 (step S12).

  Next, the signal processing and control unit 11 starts displaying a through image in step S13. That is, the signal processing and control unit 11 takes a captured image from the imaging unit 12 and performs predetermined signal processing. The display control unit 11 a gives a captured image to, for example, the display unit 30 to display a through image on the display screen 31.

  In the next step S14, it is determined whether or not an operation for displaying the HDR auxiliary display has been performed by the HDR mode setting unit 11c. The touch / operation detection unit 11b detects an operation of the touch panel 32 on the display screen 31 by the user and operations of various operation units. For example, when the user performs a slide operation on the screen from the outside (outside the screen) of the touch panel 32, the HDR mode setting unit 11c determines that an operation for displaying the HDR auxiliary display has been performed. Also good. For example, the HDR mode setting unit 11c may determine that an operation for HDR auxiliary display has been performed when the user presses the shutter button 50 halfway.

  FIG. 2 shows four captured images with different exposure values for the same subject with the same angle of view. FIG. 2A shows the highest exposure value, and the exposure value decreases in the order of FIG. 2B, FIG. 2C, and FIG. The captured image 41 in FIG. 2 shows a state in which a relatively dark background 42, a relatively bright background 43 such as a cloud, and a person 44 are captured. In FIG. 2A, the exposure value is the highest, and the bright background 43 portion is whiteout. On the contrary, FIG. 2D is an example in which the exposure value is the lowest, and the dark background 42 and the person 44 are blacked out.

  Immediately after the transition to the HDR shooting mode, before an operation for HDR auxiliary display is performed, HDR image synthesis is performed with a predetermined exposure setting. For example, the signal processing and control unit 11 uses the exposure value at the time of automatic exposure adjustment as a reference exposure value, and takes a captured image with a positive exposure value, a captured image with a negative exposure value, and a captured image with a reference exposure value. It is assumed that an HDR composite image is generated by the three captured images. In this case, the signal processing and control unit 11 uses three captured images: a captured image captured with the largest exposure value in the initial state, a captured image captured with the smallest exposure value, and a captured image with the reference exposure value. Thus, an HDR composite image is generated. For example, assuming that the exposure values in FIGS. 2A to 2D are exposure values of 2 steps on the + side, 1 step on the + side, 1 step on the − side, and 2 steps on the − side, respectively, the signal processing and control unit 11. In step S32, three captured images, that is, the captured image 41 having the exposure value of +2 and the exposure value of −2, that is, the captured image 41 having the exposure value in FIGS. 2A and 2D and the captured image having the reference exposure value. Is used to generate an HDR composite image. This HDR composite image is displayed on the display screen 31 as a through image.

  If the HDR mode setting unit 11c determines that an operation for displaying the HDR auxiliary display has been performed, the display control unit 11a performs the HDR auxiliary display in step S21. FIG. 3 shows that the HDR scale display 45 as the HDR auxiliary display is displayed on the through image. The HDR scale display 45 is used to change and determine the exposure values of a plurality of captured images to be combined in HDR image combining by a user operation. The HDR scale display 45 includes bar displays 46 and 47 that are slidable in response to a user's slide operation. For example, the bar display 46 is for setting an exposure value whose exposure value is higher (+ side) than the reference exposure value set by the automatic exposure control, and the bar display 47 is exposed more than the reference exposure value. This is for setting an exposure value having a low value (-side).

  The user can change and determine the exposure value on the + side by sliding the bar display 46, and can change and determine the exposure value on the − side by sliding the bar display 47. The exposure changing unit 11d sequentially sets two exposure values set by the bar displays 46 and 47 in addition to the reference exposure value, and causes the image pickup unit 12 to output three images picked up with these exposure values. The image composition unit 11e performs HDR composition of three captured images captured with different exposure values, and generates an HDR composite image.

  For example, it is assumed that the signal processing and control unit 11 can obtain a captured image with four exposure values as shown in FIGS. 2A to 2D in the HDR imaging mode. In this case, the bar displays 46 and 47 can be slid in two stages on the + side and two stages on the − side, respectively.

  When the bar display 46 is slid to the uppermost position, the exposure changing unit 11d sets the exposure value of FIG. 2A and slides the bar display 46 to a position slightly above the center of the HDR scale display 45. In this case, the exposure value shown in FIG. Further, the exposure changing unit 11d sets the exposure value of FIG. 2D when the bar display 47 is slid to the lowest side, and the bar display 47 is positioned slightly below the center of the HDR scale display 45. 2 is set to the exposure value shown in FIG.

  Now, for example, it is assumed that an HDR composite image based on the captured images of FIGS. 2B and 2C is obtained. FIG. 3A shows the HDR composite image 40 and the HDR scale display 45 displayed on the display screen 31 in this case. Here, as shown in FIG. 3A, the user places the thumb 49 on the bar display 47 and then slides the thumb 49 to the lowermost end of the HDR scale display 45, whereby the bar display 47 is displayed as shown in FIG. It shall be moved to the lowest end as shown in b). Similarly, it is assumed that the user slides the bar display 46 to the uppermost end as shown in FIG.

  These operations are detected in steps S22 and S25, and the exposure changing unit 11d sets the exposure values shown in FIGS. 2A and 2D as images used for HDR image synthesis (steps S23 and S26). In this way, the captured image 41 shown in FIGS. 2A and 2D is output from the imaging unit 12 in addition to the captured image based on the reference exposure value. The image synthesizing unit 11e generates an HDR synthesized image by synthesizing these three images. The HDR composite image 40 is displayed on the display screen 31 by the display control unit 11a (steps S24 and S27).

  As shown in steps S22 to S27, each time the user slides the bar displays 46 and 47, an exposure value corresponding to the slide operation is set, and imaging according to the set exposure value is captured and HDR is performed. Image composition is performed. For example, when only the bar display 47 is slid to the lowest end in the state of FIG. 3A, HDR image composition based on the captured image 41 of FIGS. 2B and 2D is performed.

  The signal processing and control unit 11 can also display a reset display 51 for resetting the user's exposure value changing operation on the bar display 46. When the user touches the display screen 31 at the position of the reset display 51, the signal processing and control unit 11 shifts the processing from step S31 to step S32, and performs HDR imaging with the initially set exposure value. Even when the user does not perform any operation on the HDR auxiliary display, HDR shooting in the initial state is performed in step S32.

  Further, when a predetermined time has elapsed without half-pressing the shutter button 50 or touching / sliding the touch panel 32, the display control unit 11a shifts the processing from step S33 to step S34, and erases the display of the HDR auxiliary display. To do. The signal processing and control unit 11 can perform a touch release operation in which shooting is performed by a touch operation on the touch panel 32 in a state where the HDR auxiliary display is not displayed.

  In step S35, the signal processing and control unit 11 performs exposure control and focus control. In the next step S36, the signal processing and control unit 11 determines whether or not a photographing operation has been performed. When the user performs shooting by operating the shutter button 50, the signal processing and control unit 11 performs shooting in step S37. The signal processing and control unit 11 gives the HDR synthesized image generated by the image synthesizing unit 11e to the recording unit 16 to form an image file.

  As described above, in the present embodiment, in the HDR shooting mode, the HDR auxiliary display for changing the exposure in the HDR shooting is displayed, and a plurality of captured images shot with the exposure corresponding to the user's exposure changing operation are displayed. An HDR composite image is generated. The generated HDR composite image is displayed as a through image, and an exposure change operation by the user is accepted. As a result, the user performs HDR shooting by selecting a composite image according to his / her preference while confirming the HDR image composition result with the through image. In this way, it is possible to obtain an HDR photographed image according to the user's preference with a simple operation.

  The exposure can be changed by an operation for changing the + side exposure with respect to the reference exposure value and an operation for changing the − side exposure. This makes it easy for the user to intuitively understand the correspondence between the exposure change operation and the HDR composite image result, and the operation for obtaining a favorite composite image is easy.

(Second Embodiment)
FIGS. 5 to 9 are explanatory diagrams for explaining an HDR imaging support method employed in the second embodiment of the present invention. The hardware configuration of this embodiment is the same as that of the first embodiment.

  This embodiment is different from the first embodiment in the operation control of each part in the HDR shooting mode by the HDR mode setting unit 11c and the display method of the HDR auxiliary display by the display control unit 11a. In the first embodiment, the user can easily shoot a favorite composite image by setting the exposure of the captured image used for HDR image composition. On the other hand, in the present embodiment, in the HDR shooting mode, the HDR image composition is sequentially performed and displayed while automatically changing the exposure of a plurality of captured images used for the HDR image composition, and the composition desired by the user is achieved. An image is selected.

  FIG. 5 shows a display example of the HDR auxiliary display displayed on the display screen 31. In FIG. 5, a through image 67 (design is omitted) is displayed on the display screen 31 provided on the back surface of the main body unit 10. In the present embodiment, in the HDR shooting mode, the display control unit 11a displays an HDR scale display 61 on a part of the display screen 31 as an HDR auxiliary display. The HDR scale display 61 indicates a scale display 62 indicating the range of exposure values, a bar display 63 indicating the range of current exposure values, a composite number display 64 indicating the number of captured images to be combined, and a maximum value of the range of exposure values. A display 65 is included.

  For example, the user can perform normal shooting and HDR shooting by holding the main body 10 with the thumb 71 a of the right hand 71 and other fingers and pressing the shutter button 50 with the index finger 71 b of the right hand 71.

  The HDR mode setting unit 11c detects the user's half-press operation of the shutter button based on the detection result of the touch / operation detection unit 11b, and when the half-press operation continues for, for example, 2 seconds or more, the HDR shooting mode is designated by the user. It is determined that the recording has been performed, and each unit is set to the HDR shooting mode. Note that the signal processing and control unit 11 determines that a half-press operation within 2 seconds is a user operation such as AE lock or AF lock. Thereby, the AE lock and AF lock operations and the transition operation to the HDR shooting mode can be performed by half-pressing the shutter button 50.

  In the present embodiment, when the HDR shooting mode is instructed, the exposure changing unit 11d sets a plurality of prescribed exposure values, picks up a plurality of captured images with a plurality of exposure values, and creates an HDR composite image. A plurality of exposure values to be set are switched every predetermined period. For example, the exposure changing unit 11d sets the exposure value at the time of automatic exposure adjustment as the reference EV, and sets a plurality of exposure values whose exposure values change from the reference EV to the plus side and the minus side by the same EV range.

  6 and 7 are for explaining exposure value setting and image composition processing by the exposure changing unit 11d. FIG. 6 shows processing steps (synthesizing steps) every 3 to 8 seconds after half-pressing operation. As shown in FIG. 6, in the first composition step 3 seconds after the half-press operation of the shutter button, that is, 1 second after the transition to the HDR shooting mode, the exposure value of ± 1 EV from the reference EV and the reference EV is set. Set and take 3 images. The interval between the EV values of the composite frames is 1 EV, and an HDR composite image is obtained by combining these three images. The HDR composite image is displayed on the display screen 31 by the display control unit 11a.

  Similarly, in the second composition step 4 seconds after the half-pressing operation of the shutter button, that is, 2 seconds after shifting to the HDR shooting mode, the exposure value of ± 2 EV is set from the reference EV and the reference EV to 3 Take a single image. The interval between the EV values of the composite frames is 2 EV, and an HDR composite image is obtained by combining these three images. The HDR composite image is displayed on the display screen 31 by the display control unit 11a.

  Thereafter, similarly, the third to sixth synthesis steps are sequentially performed every second, and the switching of the exposure value of the captured image used for the HDR image synthesis, the imaging, the HDR image synthesis, and the display are automatically performed sequentially. FIG. 7 shows the exposure value of the captured image synthesized corresponding to FIG. 6, and shows the exposure value when the reference EV is 10 EV. As shown in FIG. 7, in the first composition step 3 seconds after the half-pressing operation of the shutter button, three images are captured with the exposure values of 9, 10, and 11 EV, and the HDR image is composed. Further, for example, in the fifth compositing step 7 seconds after the half-pressing operation of the shutter button, five images are captured with exposure values of 4, 7, 10, 13, and 16 EV, and an HDR composite image is generated. .

  In the present embodiment, the HDR mode setting unit 11c controls the display control unit 11a to display the HDR scale display 61 that is linked to the HDR image composition process in each composition step in the HDR shooting mode. FIG. 8 shows an HDR scale display 61 corresponding to FIG. As shown in FIG. 8, the display control unit 11a displays the HDR scale display 61 at the same time (after 0 seconds) as the transition to the HDR shooting mode. In the HDR shooting mode, imaging is performed a plurality of times while changing the exposure, and the obtained plurality of captured images are combined. Therefore, in the HDR shooting mode, it is better not to perform an operation for changing the angle of view such as hand play. Since the HDR scale display 61 is displayed before HDR shooting is started, the user can prepare to perform HDR shooting such as fixing the angle of view by this display.

  Next, the display control unit 11a changes the display of the HDR scale display 61 in accordance with actual exposure switching and a plurality of images. That is, the display control unit 11a displays the bar display 63 so that the upper end is positioned at the position of ± 1 on the scale in the HDR scale display 61 in the first composition step 1 second after the transition to the HDR shooting mode. To do. Next, the display control unit 11a displays the bar display 63 so that the upper end is positioned at ± 2 on the scale in the second synthesis step 2 seconds after the transition to the HDR imaging mode. Thereafter, similarly, the display control unit 11a raises the position of the upper end of the bar display 63 by one scale at each synthesis step every second.

  In addition, the HDR composite image is sequentially displayed as a through image on the display screen 31, and the user recognizes the HDR composite image and the exposure setting for obtaining the HDR composite image from the display on the display screen 31. Can do. The user presses the shutter button fully at the timing when the favorite HDR composite image is displayed. By this full pressing operation, the HDR mode setting unit 11c can recognize an exposure value for obtaining a favorite HDR composite image, and the exposure changing unit 11d is set at a timing when the user fully presses the shutter button. Set the exposure value. As a result, a plurality of images are captured for obtaining a composite image that the user likes, and HDR image composition, display, and recording are performed.

  In addition, the HDR composite image is sequentially generated while changing the exposure for 2 seconds from the half-press of the shutter button to the transition to the HDR shooting mode, and for 0 second from the HDR shooting mode until the HDR scale display 61 is displayed. The time interval of 1 second to be displayed can be changed as appropriate.

  The HDR mode setting unit 11c can also change the timing of automatic exposure switching and image composition processing according to a user operation. FIG. 9 shows such a user operation. As shown in FIG. 9, in the HDR shooting mode, when the user performs a slide operation on the display screen 31, for example, automatic exposure switching and image composition processing can be stopped. For example, the HDR mode setting unit 11c detects the number of times that the user has performed the slide operation, and returns the combining step by the number of slides. For example, in the third synthesis step of FIG. 6, when the user performs a slide operation twice, the exposure change unit 11d sets the exposure value of the first synthesis step under the control of the HDR mode setting unit 11c. The control unit 11a displays the HDR scale display 61 of the first synthesis step. When the user moves his / her finger away from the display screen 31, the HDR mode setting unit 11c restarts the automatic exposure switching and image composition processing shown in FIG.

  Next, the operation of the embodiment configured as described above will be described with reference to the explanatory diagram of FIG. 10 and the flowcharts of FIGS. 11 to 13. FIG. 10 is for explaining the imaging timing and the number of imaging pixels in each synthesis step by taking time in the horizontal direction. FIG. 11 is a flowchart showing camera control.

  When the power of the photographing apparatus 1 is turned on, a through image display is performed in step S41 of FIG. The signal processing and control unit 11 performs predetermined video signal processing on the captured image from the imaging unit 12, and causes the display control unit 11a to display a through image on the display screen 31. In step S42, the HDR mode setting unit 11c determines whether the half-press operation of the shutter button 50 has been performed. When the HDR mode setting unit 11c determines that the half-press operation has been performed, in step S43, the HDR mode setting unit 11c initializes the elapsed time and then starts measuring the elapsed time (duration) of the half-press operation.

  The signal processing and control unit 11 performs autofocus adjustment in step S45, and performs automatic exposure adjustment in step S46. By the processing in step S46, the signal processing and control unit 11 obtains an EV value that gives a corrected exposure based on the sensitivity of the imaging device of the imaging unit 12 and the brightness of the subject obtained from the output of the imaging device. Set as reference EV.

  Next, the HDR mode setting unit 11c determines whether or not the elapsed time from the half-press operation has reached 2 seconds (step S47). When the half-press operation continues for 2 seconds or longer, the HDR mode setting unit 11c sets the HDR shooting mode in each unit.

  It is assumed that 2 seconds have not elapsed since the half-press operation. In this case, the signal processing and control unit 11 determines whether or not the pressing operation of the shutter button 50 is ended in step S50. When the pressing operation of the shutter button 50 is completed, the process returns from step S50 to the half-press determination in step S42. If the pressing operation of the shutter button 50 has not ended, the signal processing and control unit 11 determines whether or not the shutter button 50 has been fully pressed (step S51). When the shutter button 50 is not fully pressed, the signal processing and control unit 11 returns the process from step S52 to step S47, and determines whether 2 seconds have elapsed since the half-press operation.

  Here, it is assumed that 2 seconds have elapsed since the half-press operation. The HDR mode setting unit 11c sets the HDR shooting mode, and the display control unit 11a displays the HDR scale display 61 in step S48. In step S49, the exposure changing unit 11d sets the exposure at a prescribed timing and order, and the image synthesis unit 11e generates a synthesized image by synthesizing a plurality of captured images from the imaging unit 12 with an HDR image. . The display control unit 11a gives the composite image to the display screen 31 to display it. In this way, the user can confirm on the display screen 31 the state of the combined image that has been HDR combined while changing the exposure at a specified timing. Note that step S49 is repeated through the processes of steps S50 to S52, and the HDR effect confirmation process is repeated until the pressing operation of the shutter button 50 ends or is fully pressed.

  FIG. 12 is a flowchart specifically showing the HDR effect confirmation processing in step S49.

  In step S61, the HDR mode setting unit 11c detects a slide operation on the display screen 31 by the user. When a slide operation is detected, for example, the elapsed time is returned according to the number of slides within a predetermined time (step S62). Assuming that one synthesis step is returned by one slide, the elapsed time may be returned by 1 second per slide in the example of FIG.

  In step S63, the HDR mode setting unit 11c determines whether or not the user is touching the display screen 31. The HDR mode setting unit 11c stops the timer when the user is touching the display screen 31 (step S64), and determines whether the timer is stopped when the user is not touching ( Step S65), if it is stopped, the timer is restarted.

  Each synthesis step shown in FIG. 6 proceeds according to the elapsed time by the timer. When the user touches the display screen 31 with a finger and stops the elapsed time of the timer, the progress of the synthesis step can be stopped. Further, when the user performs a slide operation, the elapsed time can be returned according to the number of slides, and the synthesis step can be returned.

  Next, in step S67, the exposure changing unit 11d acquires information corresponding to the elapsed time from a memory (not shown) that stores a table corresponding to FIG. That is, the exposure changing unit 11d acquires information on the positive value in the EV value range relative to the reference, information on the number of combined frames, and information on the EV value interval of the combined frames from the table. The exposure changing unit 11d initializes the acquired frame number counter to 0 in step S68, and then calculates the EV value of the frame acquired in step S69.

For example, the exposure changing unit 11d sets the EV value to be acquired as EV value = (reference EV value−positive value in the range of EV values with respect to the reference).
+ (Acquired frame number counter x EV value interval of composite frame) (1)
Calculated by

  The exposure value of the image acquired in each synthesis step of FIG. 6 is determined by this equation (1). For example, in the first step of FIG. 6, the positive value of the EV value range with respect to the reference is 1, and (reference EV value−positive value of the EV value range with respect to the reference) = reference EV−1EV. . The exposure changing unit 11d sets the exposure value calculated in (1). Imaging is performed with the exposure value set in the imaging unit 12 (step S71).

  The signal processing and control unit 11 determines whether or not uncorrectable camera shake has occurred in step S72. If there is no uncorrectable camera shake, the exposure change unit 11d increments the acquisition frame number counter by one. If the acquired frame number counter has not reached the number of combined frames, the exposure changing unit 11d returns the process from step S74 to step S69, and then calculates an exposure value for imaging.

  In the example of the first synthesis step in FIG. 6, the EV value of the expression (1) for the second acquisition frame is EV value = (reference EV−1) + (1 × 1) = reference EV. In step S71, imaging with the reference EV value is performed. Furthermore, the EV value of the expression (1) for the third acquisition frame of the first synthesis step is EV value = (reference EV−1) + (2 × 1) = reference EV + 1EV, and in the next step S71. Then, imaging with reference EV + 1 EV is performed.

  Further, for example, in the example of the second synthesis step in FIG. 6, the EV value of the expression (1) for the first acquisition frame is EV value = (reference EV−2) + (0 × 2) = reference. EV-2EV, and the EV value of the expression (1) for the second acquisition frame is EV value = (reference EV-2) + (1 × 2) = reference EV, and the EV value for the third acquisition frame is The EV value of the equation (1) is EV value = (reference EV−2) + (2 × 2) = reference EV + 2EV.

  In this way, the EV value at the time of each imaging in the first to sixth synthesis steps of FIG. 6 is calculated by the steps of steps S69 to S74 in accordance with the elapsed time determined by the timer. If the signal processing and control unit 11 determines in step S72 that an uncorrectable camera shake has occurred, the signal processing and control unit 11 discards the image acquired in step S78, and returns the process to step S68. A plurality of imaging operations in the synthesis step are repeated.

  When the number of combined frames is reached in each combining step, the process proceeds from step S74 to step S75, and the image combining unit 11e performs HDR image combining of a plurality of captured images. Next, the signal processing and control unit 11 obtains the information used for calculating the exposure, that is, the positive value information in the range of the EV value with respect to the reference, the number of combined frames, and the EV value interval information of the combined frames. It is held in a current set value memory (not shown) (step S76). Note that the information acquired in step S67 is overwritten and saved in the current value setting memory.

  The display control unit 11a gives the composite image synthesized by the image synthesis unit 11e to the display unit 30 and displays it on the display screen 31 (step S77). Thereby, the user can confirm on the display screen 31 the HDR synthetic | combination image synthesize | combined in the exposure range corresponding to the elapsed time which the timer is calculating | requiring.

  In step S51 of FIG. 11, it is assumed that the full pressing operation of the shutter button 50 is detected. In step S53, the signal processing and control unit 11 determines whether or not the HDR shooting mode is set. If the HDR processing mode is not set, the signal processing and control unit 11 performs a normal shooting operation in step S55. If the signal processing and control unit 11 is in the HDR imaging mode, the HDR processing is performed in step S54.

  FIG. 13 is a flowchart specifically showing the HDR imaging process in FIG. In FIG. 13, the same procedures as those in FIG.

  The flow in FIG. 13 is different from the flow in FIG. 12 in that steps S61 to S67 in FIG. 12 are omitted and step S78 is added, and step S79 is adopted instead of step S76. In step S78, the exposure changing unit 11d acquires information held in the current value setting memory.

  Usually, the number of pixels of the display screen 31 is smaller than the number of pixels of the image sensor of the imaging unit 12, and a through image is generated using information from a part of pixels of the image sensor when displaying a through image. Therefore, the HDR composite image at the time of checking the HDR effect is also generated using only information from some pixels of the image sensor, unlike the actual shooting. For this reason, when the shutter button 50 is fully pressed, the exposure value is set again, a plurality of images are taken, and HDR image composition is performed on the obtained plurality of taken images, thereby recording an HDR composite image. To get to.

  The current value setting memory holds information that is a source of calculation of an exposure value for obtaining a composite image generated at the timing when the shutter button 50 is fully pressed. In step S78, the exposure changing unit 11d reads information held in the current value setting memory. In steps S69 to S74, the exposure changing unit 11d performs imaging while setting the exposure value. In step S <b> 75, the image composition unit 11 e performs HDR image synthesis on the obtained plurality of captured images to generate an HDR composite image. The HDR composite image is provided to the recording unit 16 and recorded on the recording medium (step S79), and is also provided to the display control unit 11a and displayed on the display screen 31 (step S77).

  FIG. 10 shows the imaging timing when the shutter button 50 is fully pressed during the display of the composite image in the second composite step. FIG. 10 shows the imaging period in a rectangle with time in the horizontal direction, and the amplitude in the vertical direction indicates the number of captured images.

  Two seconds after the shutter button 50 is half-pressed, the mode shifts to the HDR shooting mode, and one second later, image synthesis is performed in the first synthesis step. It is assumed that the normal through image display before shifting to the HDR shooting mode is performed at, for example, 30 fps (frame / second). In the first synthesis step, in the example of FIG. 6, three images are captured with the exposure values of the reference EV, the reference EV-1 EV, and the reference EV + 1 EV. When the first synthesis step for 1 second is completed, the process proceeds to the second synthesis step. In the example of FIG. 6, in the second synthesis step, three images are captured with exposure values of the reference EV, the reference EV-2EV, and the reference EV + 2EV. Thereafter, during the period in which the shutter button 50 is half-pressed, the composition step proceeds every second, and the HDR image composition is performed while the range of exposure values gradually increases.

  Note that in each synthesis step, one composite image is obtained for each of a plurality of images and the shutter speed changes, so that the through image display is somewhat jerky. Note that imaging and image synthesis for obtaining an HDR image only once in each synthesis step may be performed, and still image display using the HDR composite image may be performed during each synthesis step.

  When the user fully presses the shutter button 50 during the display of the HDR composite image in the second composite step, the process shifts to HDR photography, the exposure value in the second composite step is set again, and imaging is performed. In this case, as illustrated in FIG. 10, the image composition unit 11e acquires a captured image using, for example, all pixels of the image sensor, and generates an HDR composite image.

  As described above, also in this embodiment, the same effect as that of the first embodiment can be obtained. In the present embodiment, the user can pick up a favorite HDR composite image by half-pressing and fully pressing the shutter button, and is extremely excellent in operability. By pressing the shutter button halfway, the mode can be shifted to the HDR shooting mode, and shooting in a state where there is little camera shake at the time of HDR shooting becomes easy. In addition, a desired composite image can be obtained by a simple operation of fully pressing the shutter button half pressed.

  In addition, even when the user has pressed the shutter button halfway to shift to the HDR shooting mode, and the frame rate of the through image decreases in the HDR shooting mode, the user does not feel discomfort in the display and the display changes. You won't be confused by mistakes.

  The HDR auxiliary display is provided in a range that can be reached by the thumb of the hand holding the photographing device, and can be easily operated by the thumb. In this embodiment, the example in which the elapsed time is returned by the number of slides has been described. However, the elapsed time is directly designated by the slide end point position by touching and sliding the bar display during the HDR auxiliary display. Also good.

  In this embodiment, an HDR composite image is generated with a small number of captured images at a relatively early time after the half-press operation has elapsed, and an HDR composite image is generated with a large number of captured images with the passage of time. It is designed to generate. As a result, it is possible to generate an HDR composite image even in a scene that requires rapid shooting by being fully pressed at a relatively early time, and for an elaborate image such as a landscape by being fully pressed at a relatively late time. Also, an HDR composite image can be acquired.

  In the present embodiment, it is obvious that automatic exposure switching is not limited to the setting shown in FIG.

(Modification)
FIG. 14 is a flowchart showing a modification of the second embodiment. The flow in FIG. 14 is different from the flow in FIG. 12 in that step S81 is adopted instead of step S69 and steps S82 to 85 are adopted instead of step S78.

  In the flow of FIG. 12, the EV value of the frame to be acquired is calculated, but in the flow of FIG. 14, the EV value of the frame to be acquired is read from a memory (not shown) in step S81. If the signal processing and control unit 11 detects an uncorrectable camera shake in step S72, the signal processing and control unit 11 stops the timer for counting the elapsed time in step S82, and discards other than the image based on the reference EV in step S83.

  In this modification, in step S81, first, a reference EV is set, and in step S71, imaging is performed by exposure setting of the reference EV. Therefore, even when camera shake occurs, imaging using the reference EV is completed. In step S83, an image other than the image based on the reference EV is discarded, so that a captured image captured at least according to the exposure setting of the reference EV can be displayed. In step S <b> 84, the display control unit 11 a displays the captured image captured by the reference EV on the display screen 31 of the display unit 30. Further, the display control unit 11a displays a warning display on the display screen 31 indicating that HDR image synthesis due to camera shake or the like has failed.

  FIG. 15 is an explanatory diagram showing an example of a warning display. As shown in FIG. 15, a through image 67 is displayed on the display screen 31, and a warning display 81 indicating that HDR image composition due to camera shake or the like has failed is displayed. The user can recognize from the warning display 81 that the HDR image composition has failed.

  As described above, in this modification, even when an uncorrectable camera shake occurs in the HDR shooting mode, the captured image captured by the exposure setting of the reference EV is displayed as it is without being synthesized, and the HDR image synthesis fails. It is possible to display a warning display indicating that this has occurred. Even a user who does not know that it is necessary to pay attention to camera shake in shooting in the HDR shooting mode can notify that it is necessary to pay attention to camera shake in HDR shooting. It can also be made sure that it is not done.

(Modification)
FIG. 16 is a flowchart showing another modification of the second embodiment. The flow of FIG. 16 differs from the flow of FIG. 14 in that steps S91 and S92 are employed instead of steps S83 and S84.

  In the flow of FIG. 14, when an uncorrectable camera shake occurs, an example in which only an image captured with the reference EV value is displayed, but in the flow of FIG. 16, the uncorrectable image is discarded, An HDR composite image is generated using another image.

  In step S81, first, a reference EV is set, and then, exposure values from which the exposure value from the reference EV is symmetric are positive and negative. In step S91, the image composition unit 11e discards the image that cannot be corrected, and generates an HDR composite image using another image in step S92. In this case, an image picked up with an exposure value whose exposure value is symmetric with respect to the reference EV is used. The display control unit 11 a displays the composite image on the display screen 31 of the display unit 30. Also in this case, a warning display indicating that HDR image synthesis due to camera shake or the like has failed is displayed on the display screen 31.

  FIG. 17 is an explanatory diagram showing an example of a warning display. As shown in FIG. 17, a through image 67 is displayed on the display screen 31, and a warning display 81 indicating that HDR image composition due to camera shake or the like has failed is displayed. The HDR scale display 61 indicates that an HDR composite image using five captured images is displayed.

  As described above, in this modified example, even when an uncorrectable camera shake occurs in the HDR shooting mode, an HDR composite image is generated and displayed using images other than the uncorrectable image, and the HDR image composite has failed. A warning display can be displayed, and the user can be surely recognized that incomplete HDR imaging is being performed.

  In each of the above embodiments, an example in which only an HDR composite image is recorded has been described. However, each captured image (pre-combination image) used for image composition may be recorded together with the composite image. At the time of reproduction, the image file of the pre-combination image can be used for further correction corresponding to the user's preference. Furthermore, the present invention can also be applied to a playback device that plays back using such a pre-combination image file.

  In each of the above embodiments, the recording format in the recording unit 16 is not particularly limited. For example, the composite image recorded on the recording medium by the recording unit 16 may be in JPEG format or RAW format. In particular, if the RAW format file is recorded, it is possible to record both the pre-combination image and the post-combination image and recombine them later.

  For example, the recording unit 16 includes a recording medium control circuit (not shown), and controls recording of image file data and the like on the recording medium and reading of image file data and the like by the recording medium control circuit. The recording medium is configured such that a rewritable recording medium can be loaded, and is detachable from the main body unit 10. In addition, it may be configured to be connectable to the Internet, a telephone line, a LAN, etc. by wireless communication.

  The structure of a RAW data file generated by filing an image by the recording unit 16 will be described with reference to FIG. The structure of this RAW data file is known, and only the outline will be described below.

  As shown in FIG. 18, the RAW data file is a file for recording RAW data in a format compliant with EXIF. A header is provided in the same manner as EXIF, and various types of data are assigned by IFD (Image File Directory).

  In the RAW data file, information necessary for reproducing the main image data (main image data IFD0) and information at the time of shooting the main image data (shooting information IFD1) are recorded in the field F1 at the head of the file.

  In the RAW data file, thumbnail image data compressed by JPEG generated by the recording unit 16 is assigned to the subsequent field F2, and information (flat data) uniquely defined by the manufacturer of the main body unit 10 is further assigned to the subsequent field F3. The sentence maker note IFD) is recorded. Since the first three fields F1 to F3 are created in the EXIF format, the RAW data file is formed so that the RAW data assigned to the main image data can be reproduced by various applications capable of processing the EXIF file. The

  Subsequently, shooting information DS0 at the time of shooting the main image data is assigned to the RAW data file. Specifically, the aperture setting (settings such as 0 EV and -1 EV) of the interchangeable lens 20 at the time of shooting the RAW data DR, the shutter speed, the shooting mode, and the like are recorded in the field F4. In the subsequent field F5, parameters necessary for image processing for reproducing the time of shooting are recorded. For example, the aperture is recorded as 0 EV, for example, in the field F4 on the leading side, and a specific aperture value 5. 6 etc. are recorded.

  In addition, the RAW data file needs to be devised, for example, in bulb photography. In the subsequent field F6, various pieces of cut-out reference information DS0B are set. Specifically, focus position information at the time of shooting, background position information at the time of shooting, and the like are recorded. Here, the photographing time information (Tst−Tfn) is recorded based on the time information output from the clock unit 14 at the time of photographing. In addition, as described later, the pre-addition image flag performs addition processing in which image data is read from the imaging unit 12 and recording RAW data every time the update time elapses. This pre-addition image flag indicates that the image data is before the addition operation. Similarly, the post-addition image flag indicates that the image data has been subjected to the addition operation.

  Further, the user display update image flag recorded in the field F6 indicates that such an operation has been performed when the user displays the progress of exposure at an arbitrary time in bulb photography or the like. Flag. The vibration presence / absence information is information indicating the presence / absence of vibration applied to the main body 10 by a shake detection unit (not shown). Disturbance crossing information is information indicating the presence or absence of a disturbance image that crosses the screen. The image sensor temperature information is temperature information detected by a temperature measuring circuit (not shown). In the RAW data file, other various parameters are sequentially assigned to form shooting information DS0 when shooting the main image data.

  In the RAW data file, shooting information DS1, DS2,. The shooting information DS1, DS2,... In the editing process is shooting information set in the editing process, and is set corresponding to the image processing information DS0A that reproduces the shooting time assigned to the shooting information DS0 at the time of shooting. In the shooting information DS1, DS2,..., History information is added to shooting information such as aperture setting, shutter speed, shooting mode, and the like assigned to the field F4 of the shooting information DS0 at the time of shooting. Is formed. In the subsequent field F8, specific image processing information corresponding to the shooting information assigned to the immediately preceding field F7 is recorded.

  In the RAW data file, information necessary for reproduction of the thumbnail image data DT is assigned to the shooting information DS1, DS2,... In the editing process, and the thumbnail image data DT is assigned to the subsequent field. Subsequently, RAW data DR, which is main image data, is assigned. The RAW data file is information corresponding to the cutout reference information (field F6) assigned to the shooting information DS0 at the time of shooting following the main image data, and the cutout reference information set during the editing process can be added. Formed.

  In the case of HDR shooting, the image data after HDR composition may be recorded as RAW data, or each image before HDR composition may be associated with each other, and RAW data may be recorded. A method for recording image data as RAW data will be described. This requires less data capacity for recording. In other words, only the pixels different from the original image signal coming out of the image sensor by the synthesis are provided with the original image signal. As a result, it is usually only necessary to look at the RAW data after synthesis, and it is possible to restore the pixel signal to the original part only if it is anxious about unnatural synthesis. It becomes possible to do. Here, two pieces of information of “processed pixel designation information” indicating processed pixels and “processed pixel original data” as pre-combination image information are recorded. This makes it easy for the user to reprocess the HDR composite image that the camera has simply performed at high speed. At the time of shooting and playback, the characteristics and size of the device to be displayed and the environment may be different, and it may be desirable to express different images. Therefore, a file with such ingenuity can be said to be a preferred image file format for the user.

  FIG. 19 shows an example of recording RAW data by associating each image before HDR composition. The example of FIG. 19 is an example in which a composite image file is configured in a multi-picture format as an example of a multi-image file. In general, a multi-image file created according to a multi-picture format is configured as a combination of a plurality of image files. Each image file starts with SOI (Start Of Image) and ends with EOI (End Of Image). Each image file in the multi-image file is provided with an APP segment, and image data is recorded following the APP segment.

  For example, when a composite image file is generated according to the multi-picture format when three images are combined as in the first to third steps of FIG. 6, the composite image file is 1 as shown in FIG. It is composed of three RAW composite image files (composite RAW) and three pre-RAW image files 1, 2, and 3.

  In the example of FIG. 19, the RAW composite image file has two APP segments APP1 (1) and APP2 (1). In the APP segment APP1 (1), information on image composition and information on HDR auxiliary display are recorded. The MP index IFD is recorded in the APP segment APP2 (1). The MP index IFD is information indicating an offset amount for each image file recorded in the composite image file. The offset amount is, for example, the distance (for example, the number of bytes) from a certain reference position (for example, the top position) in the JPEG composite image data to the SOI of each image file. With such an MP index IFD, it is possible to read any image file in the multi-image file.

  The pre-combination image file 1 has two APP segments APP1 (2) and APP2 (2), and the pre-combination image file 2 also has two APP segments APP1 (3) and APP2 (3). The image file 3 also has two APP segments APP1 (4) and APP2 (4). In the APP segment APP1 (2), exposure information 1 corresponding to the pre-combination image data 1 is recorded. Further, exposure information 2 corresponding to the pre-combination image data 2 is recorded in the APP segment APP1 (3). Further, exposure information 3 corresponding to the pre-combination image data 3 is recorded in the APP segment APP1 (4).

  FIG. 19 shows an example in which the number of composites is three, but a multi-image file can be created using the same concept even when the number of composites is four or more. That is, even when the number of combined images is 4 or more, it is only necessary to sequentially add an image file in which an APP segment for recording exposure information and pre-combination image data are recorded between SOI and EOI.

  Further, the composition of the composite image file shown in FIG. 19 is an example, and the storage method of the composite RAW image file and the image file may be freely set within a range compliant with the multi-picture format.

  Furthermore, in each embodiment of the present invention, a digital camera has been described as an apparatus for photographing. However, the camera may be a digital single lens reflex camera or a compact digital camera, such as a video camera or a movie camera. A camera for moving images may be used, and a camera built in a personal digital assistant (PDA) such as a mobile phone or a smartphone may of course be used.

  The present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Moreover, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above embodiments. For example, you may delete some components of all the components shown by embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

  It should be noted that even if the operation flow in the claims, the description, and the drawings is described using “first,” “next,” etc. for convenience, it is essential to carry out in this order. It doesn't mean. In addition, it goes without saying that the steps constituting these operation flows can be omitted as appropriate for portions that do not affect the essence of the invention.

    DESCRIPTION OF SYMBOLS 1 ... Imaging device, 10 ... Main-body part, 11 ... Signal processing and control part, 11a ... Display control part, 11b ... Touch / operation detection part, 11c ... HDR mode setting part, 11d ... Exposure change part, 11e ... Image composition part , 12 ... Imaging unit, 20 ... Interchangeable lens, 30 ... Display unit, 31 ... Display screen, 32 ... Touch panel.

Claims (9)

An imaging unit that captures a subject image;
An exposure changing unit capable of setting a plurality of imaging with a plurality of exposure values in the imaging unit and switching the plurality of exposure values;
An image synthesis unit that synthesizes a plurality of captured images obtained by a plurality of imaging with the plurality of exposure values;
A display control unit for displaying a display based on the image synthesized by the image synthesis unit;
An imaging device comprising: an operation detection unit that controls switching of the plurality of exposure values by the exposure change unit. The imaging apparatus according to claim 1, wherein the display control unit displays an auxiliary display corresponding to the plurality of exposure values. The photographing apparatus according to claim 2, wherein the operation detection unit controls switching of the plurality of exposure values by an operation on the auxiliary display using a touch panel. The imaging device according to claim 1, wherein the operation detection unit controls switching of the plurality of exposure values by an operation on a shutter button that controls imaging of the imaging unit. The photographing apparatus according to claim 1, wherein the exposure change unit determines the plurality of exposure values according to an operation of the operation detection unit. The photographing apparatus according to claim 5, wherein the exposure changing unit switches the plurality of exposure values in accordance with an operation of the operation detecting unit. The said exposure change part switches the said some exposure value automatically, and stops the said switching according to operation of the said operation detection part, and determines the said some exposure value of Claim 5 characterized by the above-mentioned. Shooting equipment. A recording control unit for generating an image file based on the image combined by the image combining unit;
The photographing apparatus according to claim 1, wherein the recording control unit includes information on the plurality of exposure values in the image file. A recording control unit for generating an image file based on the image combined by the image combining unit;
The photographing apparatus according to claim 1, wherein the recording control unit includes the image combined image and the pre-combination image in the image file.

Images