JP6143553B2 - Imaging apparatus and control method thereof - Google Patents

Description

  The present invention relates to an imaging apparatus having a function of detecting an inclination angle of an imaging apparatus and a control method thereof.

  In recent years, in an imaging apparatus such as a digital camera, it has become possible to detect the inclination angle of the imaging apparatus by detecting the direction of gravity by using an inclination sensor or the like. Thus, an imaging device that records tilt information in captured image data for the purpose of correcting the tilt of the captured image is known.

  For example, Patent Document 1 discloses a technique for obtaining a horizontal image by correcting a captured image in a direction opposite to the inclination at the time of photographing using inclination information with respect to the direction of gravity at the time of photographing. As described above, in a camera that detects tilt using a gravity sensor such as an acceleration sensor, the tilt at the time of shooting is corrected using the detected tilt information, or the captured image data is tilted as post-processing information. 2. Description of the Related Art Imaging apparatuses that record information are known.

JP 2006-129391 A

  However, in the past, when acquiring posture information of the imaging device, the posture immediately before the start of exposure was detected and recorded in the photographed image, but in order to correct the image using the tilt information at the time of photographing, the photographing is performed. The tilt information at the time of photographing could not be obtained accurately due to the influence of the vibration of pressing the start instruction member. For this reason, there has been a problem that correct correction cannot be performed when the tilt of the captured image is corrected after shooting.

(Object of invention)
An object of the present invention is to provide an imaging apparatus capable of acquiring an accurate tilt angle even when subjected to vibration generated when a photographing start instruction unit is operated, and a control method therefor.

In order to achieve the above object, the imaging apparatus of the present invention provides:
In an image pickup apparatus including an inclination detection means for detecting an inclination angle, an inclination detection instruction means for instructing detection of an inclination angle of the image pickup apparatus by the inclination detection means during an exposure period, and an inclination angle detected by the inclination detection means. A recording means for recording in association with the image capturing means, and a photographing start instruction means for instructing the start of photographing. The timing is a timing at which a predetermined time has elapsed since the start is instructed, and when exposure is completed before the predetermined time has elapsed, the tilt angle is not recorded in association with the captured image.
Alternatively, the imaging device of the present invention is
In an image pickup apparatus including an inclination detection means for detecting an inclination angle, an inclination detection instruction means for instructing detection of an inclination angle of the image pickup apparatus by the inclination detection means during an exposure period, and an inclination angle detected by the inclination detection means. And a recording start instruction means for instructing the start of shooting, and the tilt detection instruction means responds to the fact that a predetermined time has elapsed since the start of shooting was instructed by the shooting start instruction means. The detection of the tilt angle is instructed, and the detection of a plurality of tilt angles is instructed at a predetermined sampling period during the exposure period from the elapse of a predetermined time to the end of exposure.

  According to the present invention, it is possible to acquire an accurate inclination angle of the imaging apparatus even when subjected to vibration generated when the photographing start instruction unit is operated.

1 is a block diagram illustrating a schematic configuration of an imaging apparatus that is Embodiment 1 of the present invention. FIG. It is a figure which shows that inclination information is misdetected by the vibration which an imaging device receives. It is a figure explaining that inclination correction turns into incorrect correction by erroneous detection of inclination information. It is a figure explaining the timing which detects the inclination information of Example 1. FIG. 6 is a flowchart illustrating processing for detecting inclination information according to the first exemplary embodiment. It is a figure explaining the timing which detects the inclination information of Example 2. FIG. 2 is a flowchart illustrating processing for detecting inclination information. It is a figure explaining the timing which detects the inclination information of Example 3. FIG. 10 is a flowchart illustrating processing for detecting tilt information according to the third embodiment. 14 is a flowchart illustrating processing for detecting tilt information according to the fourth embodiment. 14 is a flowchart illustrating processing for detecting tilt information according to the fourth embodiment. It is a figure explaining the timing which detects the inclination information of Example 5. FIG. 10 is a flowchart illustrating processing for detecting tilt information according to the fifth exemplary embodiment.

  The mode for carrying out the present invention is as described in Examples 1 to 5 below.

  FIG. 1 is a block diagram illustrating a schematic configuration of an imaging apparatus that is Embodiment 1 of the present invention. In FIG. 1, an imaging apparatus 100 includes a variable power lens (hereinafter referred to as zoom lens) 10, a focus lens (hereinafter referred to as focus lens) 12, a diaphragm / shutter unit 13 incorporating a diaphragm and a shutter, and converts an optical image into an electrical signal. The imaging device 14 is provided. In addition, the imaging apparatus 100 includes a gain amplifier 120 that amplifies the analog signal output of the imaging element 14 to set the sensitivity of the imaging apparatus 100, and an A / D converter 16 that converts the analog signal output of the imaging element 14 into a digital signal. Prepare. In addition, the imaging apparatus 100 includes an imaging device 14, an A / D converter 16, a D / A converter 26, and a timing generation unit 18 that supplies a clock signal and a control signal. The timing generator 18 is controlled by the memory controller 22 and the system controller 50.

  In addition, the imaging apparatus 100 includes an image processing unit 20. The image processing unit 20 performs predetermined pixel interpolation processing and color conversion processing on the data from the A / D converter 16 or the data from the memory control unit 22. In addition, the image processing unit 20 includes an inclination correction processing unit 303. The inclination correction processing unit 303 performs image processing that rotates the photographed image data around the optical axis (roll direction) by a predetermined angle, cuts out part of the image data (selects the range of the image data), and the like. . Further, the image processing unit 20 includes a divided exposure photographing processing unit 306. A desired exposure time is divided and continuously photographed, and a plurality of divided images are aligned to perform image processing such as superimposition processing and clipping processing. Further, the image processing unit 20 performs a predetermined calculation process using the captured image data. The system control unit 50 controls the exposure control unit 40 and the focus adjustment unit 42 on the basis of the obtained calculation result. TTL AF (autofocus) processing, AE (automatic exposure) processing, EF (flash) Pre-flash) processing is being performed. Further, the image processing unit 20 performs predetermined calculation processing using the captured image data, and also performs TTL AWB (auto white balance) processing based on the obtained calculation result.

  The memory control unit 22 controls the A / D converter 16, the timing generation unit 18, the image processing unit 20, the image display memory 24, the D / A converter 26, the memory 30, and the compression / decompression unit 32. The data of the A / D converter 16 is sent via the image processing unit 20 and the memory control unit 22, or the data of the A / D converter 16 is sent directly via the memory control unit 22 and the image display memory 24 or the memory 30. Is written to.

  A system control unit 50 that controls the entire imaging apparatus 100 controls the exposure control unit 40 by calculating an appropriate exposure value based on the luminance level measured by the TTL via the memory control unit 22. The display image data written in the image display memory 24 is displayed on the image display unit 28 including an LCD or the like via the D / A converter 26. If the image data captured using the image display unit 28 is sequentially displayed, the electronic viewfinder function can be realized. The memory 30 is for storing captured still images and moving images, and has a sufficient storage capacity for storing a predetermined number of still images and moving images for a predetermined time. This makes it possible to write a large amount of images to the memory 30 at high speed even in the case of panoramic imaging or continuous shooting that continuously captures a plurality of still images. The memory 30 can also be used as a work area for the system control unit 50. The memory 30 functions as a storage unit that stores relative information of the focus adjustment unit 42 with respect to the operation of the zoom control unit 44 as a scaling unit for scaling the subject image.

  A compression / decompression unit 32 that compresses and decompresses image data by adaptive discrete cosine transform (ADCT) or the like reads an image stored in the memory 30, performs compression processing or decompression processing, and writes the processed data to the memory 30. The memory 52 stores constants, variables, programs, and the like for operating the system control unit 50. The exposure control unit 40 controls the aperture / shutter unit 13 having an aperture function and a shutter function. The focus adjustment unit 42 controls focusing of the focus lens 12. The zoom control unit 44 controls zooming of the zoom lens 10. The exposure control unit 40 and the focus adjustment unit 42 are controlled using the TTL method. Based on the calculation result obtained by calculating the captured image data by the image processing unit 20, the system control unit 50 performs the exposure control unit 40 and the focus adjustment. The unit 42 is controlled.

  The display unit 54 is configured by a liquid crystal display device, a speaker, and the like that display an operation state, a message, and the like using characters, images, sounds, and the like according to execution of a program by the system control unit 50. One or a plurality of display units 54 are installed at positions in the vicinity of the operation unit 70 of the imaging apparatus 100 that are easily visible. As the electrically erasable / recordable nonvolatile memory 56, for example, a flash ROM or the like is used.

  Next, the operation members 62 and 63 for inputting various operation instructions of the system control unit 50 and the operation members of the operation unit 70 are configured by switches and dials. Here, a specific description of these operation members will be given.

  The first shutter switch 62 (SW1) is turned on during the operation of a release switch member (not shown), and AF (auto focus) processing, AE (automatic exposure) processing, AWB (auto white balance) processing, EF ( An instruction to start an imaging preparation operation such as (flash pre-flash) processing is given. The second shutter switch 63 (SW2) is turned on (ON) when the operation of a release switch member (not shown) is completed, and instructs the start of a series of processes. The series of processes is an exposure process in which a signal read from the image sensor 14 is written to the memory 30 via the A / D converter 16 and the memory control unit 22, and is further calculated by the image processing unit 20 and the memory control unit 22. Development processing using The series of processes is a recording process in which image data is read from the memory 30, compressed by the compression / decompression unit 32, and written to the recording medium 200.

  The acceleration sensor 300 is a sensor that detects acceleration applied to the imaging apparatus 100. The acceleration detected by the acceleration sensor 300 includes gravitational acceleration in addition to acceleration due to shake. The tilt information detection unit 301 provided in the system control unit 50 detects the gravitational acceleration by the acceleration sensor 300 and performs a process of determining the tilt angle of the imaging apparatus 100. The system control unit 50 includes an inclination information detection instruction unit 302 that instructs the inclination information detection unit 301 to detect inclination information. The inclination information detection instruction unit 302 issues an inclination information detection instruction after a predetermined time has elapsed since the shutter switch SW2 was pressed. In addition, an instruction to detect inclination information is given to the inclination information detection unit 301 at a predetermined timing during the photographing period based on information such as an exposure time and a flash emission timing calculated from the luminance level measured by the system control unit 50. .

  The system control unit 50 includes a shooting information generation unit 304 that generates shooting information (shutter speed, aperture value, sensitivity, white balance, shooting mode, etc., as well as a tilt angle during shooting). The imaging information generated here is recorded in the image data or in a file associated with the image data.

  The operation unit 70 including various buttons and a touch panel has menu buttons and the like. The operation unit 70 can select settings according to various shooting scenes such as an auto mode. The flash emission unit 57 that illuminates the subject calculates the appropriate emission amount based on the luminance level measured by the flash emission instruction unit 305 provided in the system control unit 50, and is controlled to emit light in synchronization with the exposure time.

  The power control unit 80 is configured by a battery detection circuit, a DC-DC converter, a switch circuit that switches a block to be energized, and the like. The power source 86 includes a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li battery, an AC adapter, or the like. The power supply controller 80 and the power supply 86 are connected via connectors 82 and 84. The interface 90 and the connector 92 may be configured using a standard conforming to a standard such as a Secure Digital (SD (registered trademark)) card. The recording medium 200 includes a recording unit 202 composed of a semiconductor memory, a magnetic disk, or the like, an interface (I / F) 204 with the imaging apparatus 100, and a connector 206 that connects to the imaging apparatus 100.

  First, an example of the attitude detection method of the imaging device 100 will be described. FIG. 2A is a diagram illustrating a state of acceleration received by the acceleration sensor 300 when the imaging apparatus 100 is stationary. Since no external acceleration is received in FIG. 2A, the acceleration sensor detects only acceleration g in the Y-axis minus direction as gravity acceleration. The scale below FIG. 2A is for explaining the posture state of the imaging apparatus 100, and a similar display is displayed on the display unit 54 of the imaging apparatus 100 so that the operator can visually recognize the imaging apparatus. 100 posture states may be displayed. In FIG. 2, the center position of the scale is described with the imaging apparatus 100 in a horizontal state.

  On the other hand, FIG. 2B is a diagram showing a state of acceleration received by the acceleration sensor 300 when the release switch member is pressed and the shutter switch SW2 is turned on. Acceleration occurs with respect to the imaging apparatus 100 due to the influence of shaking of the hand when the photographer presses the release switch member, and the acceleration sensor 300 detects this shaking. Further, the shutter switch SW2 often has a click feeling so that the photographer can feel the feeling when the release switch member is completely pressed. This click vibration is transmitted to the substrate of the imaging apparatus 100, so that an accurate inclination cannot be detected even if the imaging apparatus 100 is fixed. As a result, the acceleration of the vibration component is detected on the X axis and the Y axis as shown in FIG. 2B, and an error occurs if the tilt angle is detected from the acceleration immediately after the shutter switch SW2 is turned on. As a result, the scale display indicating the posture state of the imaging apparatus 100 also fluctuates, indicating that the correct posture cannot be confirmed.

  FIG. 3 illustrates an example in which the tilt information is acquired when the release switch member is pressed, and the correction is erroneously performed when the tilt correction process is performed on the captured image. FIG. 3A shows an image captured by the imaging apparatus 100 in a stationary state and a horizontal state at the time of shooting. However, since the tilt information of the photographed image is acquired and recorded in association with the photographed image immediately after the release switch member is pressed, the vibration when the release switch member is pressed is transmitted to the acceleration sensor 300 in FIG. It is explained that an inclination of 100 is erroneously detected by an angle σ from the vertical. As a result, when the tilt correction process is performed on the captured image, the captured image is tilted and corrected by an angle σ as shown in FIG.

  The first embodiment proposes a means for solving the above problem. FIG. 4 is a diagram illustrating an example of processing for acquiring tilt information in the still image shooting sequence of the imaging apparatus 100.

  First, exposure is performed to display a live image on the image display unit 28. When the shutter switch SW2 is pressed and an exposure start is instructed, after a preparatory process such as drive switching of the image sensor 14, still image shooting is performed. Exposure is started. Subsequently, when a time during which a desired exposure amount measured in advance before exposure is accumulated in the image sensor 14 has elapsed, a process for closing the shutter is executed.

  In FIG. 4, since the vibration when the release switch member is pressed and the shutter switch SW2 is turned on is detected by the acceleration sensor 300 in the imaging apparatus 100 as in the acceleration waveform in the figure, the release switch member is pressed. If the tilt information of the imaging apparatus 100 is detected immediately after this, the tilt information detection accuracy may be reduced. VD is a vertical synchronizing signal.

  In the first embodiment, when the time for which a desired exposure amount is accumulated in the image sensor has elapsed, the tilt information of the image capturing apparatus 100 is detected in accordance with the timing of closing the shutter blades. Although not shown here, vibration is generated because the shutter blade hits the stop member when the shutter blade is completely closed. Therefore, by detecting the tilt information at the timing when the shutter blade closing control is started, the tilt information can be acquired without detecting the vibration of the shutter blade being fully closed.

  FIG. 5 is a flowchart showing a process for acquiring the tilt information of the imaging apparatus 100 shown in FIG. First, in step S100, the system control unit 50 determines whether the release switch member is pushed by the photographer, the shutter switch SW2 is turned on, and a photographing start instruction is issued. When there is no shooting start instruction (No in S100), the system control unit 50 repeats the shooting start instruction detection process at a predetermined cycle. When a shooting start instruction is detected (Yes in S100), the system control unit 50 starts exposure for still image shooting (S101). When the charge is accumulated in the image sensor 14 until a desired exposure amount is reached, the system control unit 50 starts a process of closing the shutter blades (shutter closing process) via the exposure control unit 40 (S102). Then, the tilt information detection unit 301 included in the system control unit 50 of the imaging apparatus 100 acquires the tilt information ω of the imaging apparatus 100 from the acceleration sensor 300 (S103). Thereafter, the shutter closing process ends (S104), and the exposure ends when the image sensor 14 is shielded from light (S105). After the exposure is completed, the electric charge accumulated in the image sensor 14 is taken out and development processing is performed to obtain photographed image data (S106). The system control unit 50 records the shooting tilt information ω acquired in step S103 in the memory 30 or the recording medium 200 in association with the captured image data (S107).

  In the above description, the shutter is described as a mechanical light-shielding device. However, in the case of using a process of stopping charge accumulation by moving the charge accumulated in the image sensor 14 to a read transfer path or the like without using the light-shielding device. The tilt information ω of the imaging apparatus 100 may be acquired during the exposure end process in step S105 without performing the processes in steps S102 and S104.

  An image pickup apparatus that is Embodiment 2 of the present invention will be described with reference to FIGS. The schematic configuration of the second embodiment is the same as the configuration shown in the block diagram of FIG. The second embodiment deals with a case where the exposure period is longer than a predetermined time.

  FIG. 6 is a diagram illustrating an example of processing for acquiring tilt information when the exposure time S is longer than the predetermined threshold time T in the still image shooting sequence of the imaging apparatus 100.

  The tilt information of the imaging apparatus 100 is acquired after a predetermined time t has elapsed since the shutter switch SW2 was turned on and the exposure start was instructed. Here, the predetermined time t is a waiting time until the tilt information of the imaging apparatus 100 is detected. This predetermined time t will be described below.

As shown in FIG. 6, let A be the preparation time from the start of shooting to the start of still image exposure, and S be the exposure time for still image shooting. If the time from when the shutter switch SW2 is pressed until the vibration converges when the shutter switch SW2 is pressed is B, B <t <(A + S)
The predetermined time t is determined so that Therefore, when t−A is a predetermined threshold time T, and the exposure time S is greater than the threshold time T, the tilt information of the image capturing apparatus 100 after a predetermined time t has elapsed after the shutter switch SW2 is turned on and the start of exposure is instructed. To get. Here, when the predetermined time t is longer than the time from when the start of shooting is instructed until the exposure of the still image ends, as shown in the following equation, the tilt information of the imaging device 100 is not recorded in the shot image.

t ≧ (A + S)
Here, when the imaging device 100 detects acceleration other than gravitational acceleration by the acceleration sensor 300 during the exposure period, such as when shaking or panning or riding on a vehicle, it is determined that the camera is not stationary (t ≦ B). Since the detected tilt information cannot be trusted, the tilt information is not recorded in the captured image data.

  FIG. 7 is a flowchart showing a process for acquiring the tilt information of the imaging apparatus 100 shown in FIG. First, in step S100, it is determined whether or not the shutter switch SW2 of the image pickup apparatus 100 is turned on and an instruction to start shooting is given. When there is no shooting start instruction (No in S100), the system control unit 50 repeats the shooting start instruction detection process at a predetermined cycle. When a shooting start instruction is detected (Yes in S100), the system control unit 50 determines an exposure time S for still image shooting. When the exposure time S is shorter than the predetermined threshold time T (Yes in S110), the system control unit 50 starts exposure (S101). The system controller 50 starts a process of closing the shutter blades (shutter closing process) when charges are accumulated in the image sensor 14 until the desired exposure amount is reached via the exposure controller 40 (S102). Then, the inclination information detection unit 301 provided in the system control unit 50 of the imaging apparatus 100 acquires the inclination information ω of the imaging apparatus 100 (S103). Thereafter, the shutter closing process ends (S104), and the exposure ends when the image sensor 14 is shielded from light (S105). After the exposure is completed, the electric charge accumulated in the image sensor 14 is taken out and development processing is performed to obtain photographed image data (S106). Then, the system control unit 50 records the photographing tilt information ω acquired in step S103 in association with the photographed image data (S107).

  When the exposure time S is equal to or longer than the predetermined threshold time T (No in S110), the system control unit 50 starts exposure (S111). The time after the shooting start instruction is detected in step S100 is measured (No in S110), and the system control unit 50 tilt information provided in the system control unit 50 of the imaging apparatus 100 when the predetermined time t has elapsed (Yes in S111). The detection unit 301 acquires the tilt information ω of the imaging device 100 (S113). When charge is accumulated in the image sensor 14 until the desired exposure amount is reached, the shutter closing process is started (S114), and when the shutter closing process is completed (S104), a series of processing from step S105 to step S107 is performed.

  An image pickup apparatus that is Embodiment 3 of the present invention will be described with reference to FIGS. The schematic configuration of the third embodiment is the same as the configuration shown in the block diagram of FIG. The third embodiment deals with processing different from the second embodiment when the exposure period is longer than a predetermined value.

  FIG. 8 is a diagram illustrating an example of processing different from that in FIG. 6 for acquiring tilt information when the exposure time S is longer than the predetermined threshold time T in the still image shooting sequence of the imaging apparatus 100.

  The acceleration sensor 300 detects the acceleration information of the imaging device 100 from the time when the shutter switch SW2 is turned on until a predetermined time t has elapsed until the end of exposure at a predetermined sampling period. The tilt information detection unit 301 acquires tilt information (ω1 to ωn) of the imaging apparatus 100 from acceleration data (a1, a2,... An) for posture detection acquired by the acceleration sensor 300. The tilt information detection unit 301 may calculate an average value for the obtained tilt information and record the average value in association with the captured image data. All the tilt information (ω1 to ωn) along with the sampling period information may be recorded. You may record in relation to data.

  FIG. 9 is a flowchart showing a process for acquiring the tilt information of the imaging apparatus 100 shown in FIG. Steps S100 to S102, S104 to S106, S111, S112, and S114 perform the same processing as the same steps in the first and second embodiments, and thus description thereof is omitted. If the exposure time S is shorter than the predetermined threshold time T (Yes in S110), exposure is started in step 101. When the shutter closing process is started in step 102, the tilt information detection unit 301 provided in the system control unit 50 of the imaging apparatus 100 acquires the tilt information ωn of the imaging apparatus 100 (S130). In this process, n = 1. After that, the tilt information detection unit 301 records the shooting tilt information ω1 acquired in step S130 in association with the captured image data (S131).

  When the exposure time S is equal to or longer than the predetermined threshold time T (No in S110), the exposure is started. When a predetermined time t has elapsed since the imaging start instruction was detected, the process proceeds to step S132. In step S132, the tilt information detection unit 301 provided in the system control unit 50 of the imaging device 100 acquires the tilt information ω1 to ωn of the imaging device 100 until the shutter closes (S132). In step S131, the system control unit 50 records the average angle of the inclination information ω1 to ωn during the exposure period in association with the captured image data.

  In step S131, it is described that the average angle of the inclination information ω1 to ωn during the exposure period is calculated, but all the inclination information during the exposure period may be recorded in association with the captured image data.

  An image pickup apparatus that is Embodiment 4 of the present invention will be described with reference to FIGS. The schematic configuration of the fourth embodiment is the same as the configuration shown in the block diagram of FIG. The fourth embodiment deals with flash photography.

  FIG. 10 is a diagram illustrating an example of processing for acquiring tilt information in a still image shooting sequence involving flash emission of the imaging apparatus 100.

  When the release switch member is pressed and the shutter switch SW2 is turned on to instruct the start of exposure, exposure for still image shooting is started after preparatory processing such as drive switching of the image sensor 14. Subsequently, the flash light emitting unit 57 is controlled to emit light for a predetermined time in synchronism during the exposure period. As shown in FIG. 1, the system control unit 50 includes a flash light emission instruction unit 305 that controls the timing, light emission amount, and light emission time of the flash light emission unit 57. As a result, the subject to which the flash light has arrived is photographed as if it were stopped in the photographed image. At this time, the tilt information detection instruction unit 302 issues a tilt information detection instruction at the timing when the flash is synchronized and emitted during exposure, and the tilt information detection unit 301 detects the tilt information of the imaging apparatus 100.

  FIG. 11 is a flowchart illustrating processing for acquiring the tilt information of the imaging apparatus 100 illustrated in FIG. First, in step S100, the system control unit 50 determines whether or not the shutter switch SW2 of the imaging apparatus 100 is turned on and a shooting start instruction is issued. When there is no shooting start instruction (No in S100), the system control unit 50 repeats the shooting start instruction detection process at a predetermined cycle. When a shooting start instruction is detected (Yes in S100), exposure for still image shooting is started (S101). When the flash emission unit 57 issues a flash instruction in synchronization with the exposure period (S140), the tilt information detection instruction unit 302 provided in the system control unit 50 of the imaging apparatus 100 together with the flash emission issues a detection instruction to detect tilt information. The inclination information ω of the image pickup apparatus 100 is acquired by the unit 301 (S103). When charge is accumulated in the image sensor 14 until a desired exposure amount is reached, a shutter closing process is started (S102). Subsequent steps S104 to S107 are the same as those in FIG.

  An imaging apparatus that is Embodiment 5 of the present invention will be described with reference to FIGS. The schematic configuration of the fifth embodiment is the same as the configuration shown in the block diagram of FIG. The fifth embodiment deals with multiple divided exposure shooting.

  FIG. 12 shows a sequence of divided exposure shooting in which the imaging apparatus 100 performs continuous shooting with the exposure time divided into three, multiplexes the remaining shot images with respect to the first shot image, and obtains a composite image. FIG. 5 is a diagram illustrating an example of processing for acquiring inclination information in this sequence.

  When the release switch member is pressed and the shutter switch SW2 is turned on and an exposure start is instructed, the exposure for the first still image shooting is started after a preparation process such as drive switching of the image sensor 14. Subsequently, when a time during which a desired exposure amount measured in advance before exposure is accumulated in the image sensor 14 has elapsed, tilt information of the image capturing apparatus 100 is detected and at the same time a process of closing the shutter blades is performed. When the process of closing the shutter blades is completed and the image sensor 14 is shielded from light, the charge accumulated in the image sensor 14 is taken out and converted into digital data, and then the image data is temporarily stored in the memory 30. .

  Subsequently, the second to third shooting is performed. First, the shutter blade that was closed when the first image was taken is opened, and the second exposure is started. When the time for which the desired exposure amount is accumulated in the image sensor 14 has elapsed, the shutter blades are closed again, the electric charge accumulated in the image sensor 14 is taken out and converted into digital data, and the image information is temporarily stored in the memory 30. Keep it. These photographing processes are performed up to the third time, and the three image data stored in the memory 30 are developed by the image processing unit 20. Then, with the first image as a reference, the second and third images are aligned in order and the multiplexing process is performed. The series of divided exposure photographing is performed by the divided exposure photographing processing unit 306 provided in the image processing unit 20.

  The tilt information of the imaging device 100 that is recorded in association with the image data that is obtained by multiplexing the three images shot by the above processing and synthesized into one image is recorded as the tilt information of the imaging device 100 detected in the first shooting. Shall.

  FIG. 13 is a flowchart illustrating processing for acquiring the tilt information of the imaging apparatus 100 illustrated in FIG. In FIG. 12, the exposure time is described as being continuously shot with three divisions, but the number of divisions may be changed according to the total exposure time.

  Therefore, in FIG. 13, the following description will be made on the assumption that the exposure time is divided into m and continuous shooting is performed. In step S100, when the release switch member of the imaging apparatus 100 is pressed and the shutter switch SW2 is turned on, the system control unit 50 determines whether or not a shooting start instruction has been issued. When there is no shooting start instruction (No in S100), the system control unit 50 repeats the shooting start instruction detection process at a predetermined cycle. When a shooting start instruction is detected (Yes in S100), the division number m of the exposure time detected by the system control unit 50 is determined (S150), and the count of the number of shots is initialized to 1. In step S150, the system control unit 50 performs a process of counting the number of continuous shots, and repeats shooting until the number of shots reaches m (Yes in S151). First, the system control unit 50 starts exposure (S101). When charge is accumulated in the image sensor 14 until a desired exposure amount is reached, shutter closing processing is started via the exposure control unit 40 (S102).

  Here, if it is the first shooting (Yes in S153), the tilt information detection unit 301 included in the system control unit 50 of the imaging apparatus 100 acquires the tilt information ω of the imaging apparatus 100 (S103). Thereafter, when the shutter closing process is finished (S104) and the image sensor 14 is shielded from light, the system control unit 50 executes the process of finishing the exposure and taking out the electric charge accumulated in the image sensor 14 (S105). .

  After the exposure is completed (S105), the system control unit 50 increments the number of shots (S154). Then, the system control unit 50 performs a shutter opening process for the next shooting through the exposure control unit 40 (S155), and returns to the process of step S151. If the first image was not shot in step S153 (No in S153), the processes from step S104 to S155 are performed, and the process returns to step S151.

  After repeating the above steps S101 to S155 m times, if it is determined in step S151 that the number of shots is m (Yes in S151), the divided exposure shooting processing unit 306 determines the m shots acquired in step S105. The photographed image data is developed and combined by multiplexing processing (S152). At this time, the division exposure photographing processing unit 306 performs the multiplexing process as a multiplexing process after performing processing so as to align the respective images by subjecting the position, size, rotation direction, and the like of the subject to affine transformation. The tilt information ω of the first imaging device 100 acquired in step S156 is recorded in association with the captured image data synthesized in step S152 (S107).

  Further, in the processing flow of the imaging apparatus 100 described with reference to FIG. 12, it is described that the tilt information of the imaging apparatus 100 is acquired at the end of exposure of the first captured image, but as described with reference to FIG. Acceleration information from when SW2 is pressed and a predetermined time t has elapsed until the end of exposure may be sampled at a predetermined cycle. The inclination information obtained in this way may be recorded in association with photographed image data by calculating an average value. Further, all inclination information (ω1 to ωn) sampled together with the period information may be recorded in association with the captured image data.

  Further, during the period from the first image capturing to the completion of the m-th image exposure, the acceleration information of the image capturing apparatus 100 is sampled at a predetermined cycle, and the average value of the obtained tilt information is calculated to obtain captured image data. It may be recorded in association with the. Alternatively, the sampling time and all detected tilt information (ω1 to ωn) of the imaging apparatus 100 may be recorded in association with the captured image data.

  Alternatively, when shooting is performed by emitting the flash light emitting unit 57 during exposure of any one or a plurality of first to mth images, the tilt information of the imaging device 100 in the captured image emitted by the flash light emitting unit is captured. You may record in relation to image data.

  Although not illustrated, the tilt information of the imaging apparatus 100 described above is not only recorded in association with the captured image, but also a captured image that has been tilt-corrected using the tilt information after being captured by the tilt correction processing unit 303 is displayed. You may make it record. At this time, the tilt information of the imaging apparatus may not be recorded in the corrected captured image.

  In the above description, the tilt information of the imaging apparatus 100 is described as being calculated from the output value of the acceleration sensor and detected, but a sensor capable of detecting the tilt information in the rotation direction may be used instead. In addition, although it has been described that the tilt in the horizontal direction is detected and recorded in association with the captured image, it is needless to say that tilt information in the tilt direction may be detected at the same timing as the tilt in the horizontal direction.

  In any of the first to fifth embodiments described above, since the detection of the tilt angle is instructed during the exposure period, it is possible to eliminate the influence of vibration generated by the operation of the photographing start instruction means.

  As mentioned above, although the preferable Example of this invention was described, this invention is not limited to these Examples, A various deformation | transformation and change are possible within the range of the summary.

100 Imaging device 63 Second shutter switch SW2
DESCRIPTION OF SYMBOLS 300 Acceleration sensor 301 Inclination information detection part 302 Inclination information detection instruction | indication part 305 Flash light emission instruction | indication part 306 Divided exposure imaging | photography process part

Claims (8)

In an imaging apparatus provided with an inclination detection means for detecting an inclination angle,
Inclination detection instruction means for instructing detection of the inclination angle of the imaging apparatus by the inclination detection means during an exposure period;
A recording unit that records the tilt angle detected by the tilt detection unit in association with a captured image ;
Shooting start instruction means for instructing the start of shooting,
The tilt detection instructing means sets the timing during the exposure period instructing detection of the tilt angle as a timing at which a predetermined time has elapsed since the start of shooting was instructed by the shooting start instructing means,
An image pickup apparatus , wherein when the exposure ends before the predetermined time elapses, the tilt angle is not recorded in association with a photographed image . In an imaging apparatus provided with an inclination detection means for detecting an inclination angle,
Inclination detection instruction means for instructing detection of the inclination angle of the imaging apparatus by the inclination detection means during an exposure period;
A recording unit that records the tilt angle detected by the tilt detection unit in association with a captured image;
Shooting start instruction means for instructing the start of shooting,
The tilt detection instructing unit instructs the detection of the tilt angle in response to a lapse of a predetermined time after the start of shooting is instructed by the shooting start instructing unit, and from the lapse of the predetermined time to the end of exposure. An imaging apparatus characterized by instructing detection of a plurality of tilt angles at a predetermined sampling period during an exposure period. The imaging apparatus according to claim 2 , wherein the recording unit records an average value of the plurality of inclination angles. The predetermined time is longer than the time until the vibration generated by the operation of the shooting start instruction means converges, and the exposure time is added to the time from the start of shooting is instructed by the shooting start instruction means to the start of exposure. The imaging apparatus according to claim 1 , wherein the imaging apparatus is determined to be shorter than time. Light emitting means for illuminating the subject;
A light emission instruction means for instructing the light emission means to emit light,
The tilt detection indication means, when the emission instruction means for instructing the light emission during the exposure period, the image pickup apparatus according to claim 1 or 2, characterized in that indicating the detection of the inclination angle. It has divided exposure photographing means for performing continuous photographing by dividing an exposure period and superimposing each photographed image to obtain a composite image,
The tilt detection indication means, when a plurality of exposures are performed by the division exposure shooting unit, according to claim 1, characterized in that indicating the detection of the inclination angle by the inclination detecting means during the first exposure period Or the imaging device of 2 . An inclination detection instruction step for instructing detection of an inclination angle of the imaging apparatus during the exposure period;
An inclination detection step of detecting an inclination angle of the imaging device according to an instruction in the inclination detection instruction step;
A recording step of recording the tilt angle detected in the tilt detection step in association with a captured image ;
A shooting start instruction step for instructing the start of shooting,
In the tilt detection instructing step, the timing during the exposure period instructing the detection of the tilt angle is a timing at which a predetermined time has elapsed since the start of shooting was instructed,
In the recording step, when the exposure is completed before the predetermined time elapses, the tilt angle is not recorded in association with a captured image . An inclination detection instruction step for instructing detection of an inclination angle of the imaging apparatus during the exposure period;
An inclination detection step of detecting an inclination angle of the imaging device according to an instruction in the inclination detection instruction step;
A recording step of recording the tilt angle detected in the tilt detection step in association with a captured image;
A shooting start instruction step for instructing the start of shooting,
In the tilt detection instructing step, detection of the tilt angle is instructed in response to a lapse of a predetermined time after the start of photographing is instructed, and a predetermined period is set during an exposure period from the lapse of the predetermined time to the end of exposure. A method for controlling an imaging apparatus, comprising: instructing detection of a plurality of tilt angles at a sampling period of.

Images