JP2014116878A - Imaging device and imaging method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging device and an imaging method for enabling a user to surely acquire the best photographic image in accordance with the release operation of the user without increasing image data to be read out of an imaging element, and to be temporarily stored.SOLUTION: The imaging device includes: an adjustment value storage memory 13 for performing image processing to image data, and for storing display time lag information until a live view image is displayed at a display part and release time lag information unique to a photographer since the photographer intends the start of photography until actually instructs a photography start operation. On the basis of the display time lag information and the release time lag information, when the photographer instructs the photography start operation, a time going back by time in which a timing detection signal is detected is set as a recording start time, and a photographic image is acquired and recorded in a memory 11 for storage.

Description

  The present invention relates to an image pickup apparatus and an image pickup method capable of moving image shooting and still image shooting at a high frame rate.

  For example, when shooting a moving object as a subject, there is a time lag in the timing from when the photographer intends to when shooting is actually performed, so it is difficult to acquire a shot image at a desired release timing. there were. For this reason, it is proposed to perform continuous shooting for a predetermined time before and after the release operation, and to select a still image or a moving image shot at a timing desired by the photographer from the continuously shot moving images. Has been.

  For example, Patent Document 1 discloses an imaging device that varies a preset recording time range in accordance with a shooting mode so that a photographer does not miss a desired shooting timing. . According to this imaging apparatus, in the sport mode suitable for the launch fireworks mode or the athletic meet, a photographed image can be recorded by designating a predetermined time before the start of recording and after the start of recording.

  In recent years, the image reading speed of the image sensor and the image signal processing speed have been improved. For this reason, the shooting time interval during continuous shooting is shortened, and more continuous shot images can be acquired in a short shooting time. In moving image shooting, shooting can be performed at a higher shooting frame rate, and a smoother moving image can be acquired for a subject with much movement than during playback.

JP 2011-044898 A

  As described above, since the image reading speed and the image processing speed are improved, even when the continuous shooting time is the same, more image data is obtained than in the past. Therefore, even when shooting is performed at the shooting timing determined by the photographer as the best, if it is determined that the shooting is unnecessary after shooting, a large amount of image data is wasted. In addition, it is necessary to secure a sufficient recording capacity in consideration of image data that is wasted.

  Therefore, in an imaging apparatus as disclosed in Patent Document 1, it is desirable that the continuous shooting time be kept to the minimum necessary in consideration of the recording capacity of image data. However, the time required for the photographer to observe the subject in the live view display image, determine the best shooting timing, perform the release operation, and actually start shooting (hereinafter referred to as the release time lag) There are individual differences (release time lag unique to the photographer). Further, there is a delay time required for image processing to be read from the image sensor and used for live view display (display delay time, hereinafter referred to as a display time lag). Therefore, in order to obtain an image shot at the best timing, it is necessary to start shooting after the release operation by a time considering the release time lag unique to the photographer and the display time lag.

  The present invention has been made in view of such circumstances, and the photographer does not increase the temporarily stored image data to be read from the image sensor, and the photographer can select the best photographed image according to the release operation of the photographer. An object of the present invention is to provide an imaging apparatus and an imaging method that can be reliably acquired.

  In order to achieve the above object, an image pickup apparatus according to a first aspect of the invention includes an image pickup unit that picks up a subject image and sequentially converts it into image data, and a release operation that detects a timing detection signal instructing a shooting start operation by a photographer An input unit, a buffer memory unit that sequentially updates the image data for a preset frame to the latest image data and temporarily holds the image, a delay time measurement image, and a live view image based on the image data Release time lag information detection for detecting the release time lag information specific to the photographer from when the photographer intends to start shooting until the actual shooting start operation is instructed according to the delay time measurement image And display time lag information until the live view image is displayed on the display unit after image processing is performed on the image data and A delay time storage unit for storing release time lag information, and the timing detection signal when a photographer instructs the shooting start operation based on the display time lag information and the release time lag information stored in the delay time storage unit A pre-capture shooting time setting unit that sets a time that goes back from the time when the image is detected as a recording start time, and a recording unit that performs a recording operation by transferring predetermined image data from the image data stored in the buffer memory unit to a recording medium When the photographer performs a release operation and shoots, the image data recorded in the buffer memory unit corresponds to the time that is set back by the time set by the pre-capture shooting time setting unit. The obtained image data is extracted and recorded in the recording unit.

  In the imaging device according to a second aspect of the present invention, in the first aspect, the release time lag information is a first release time lag in which a moving body image is displayed as the delay time measurement image and a photographer's response time is measured. And a second release time lag for displaying the instantaneous change of the still image as the delay time measurement image and measuring the photographer's response time.

  In the imaging device according to a third aspect of the present invention, in the first aspect, the release time lag information measures a delay time when the photographer operates the release button and a delay time when the photographer operates the touch panel. Detect by doing.

  In the imaging device according to a fourth invention, in the first invention, the display time lag information is a delay time based on at least one of a shooting frame rate, an image effect process, an image quality correction process, and a shooting scene.

  An imaging method according to a fifth aspect of the present invention is an imaging method including a delay time storage unit that performs image processing on image data output from the imaging unit and stores display time lag information until a live view image is displayed on the display unit. An image capturing method in the apparatus, which uses a delay time measurement image to detect release time lag information specific to a photographer from when the photographer intends to start shooting until the actual shooting start operation is instructed. Time lag information is stored in the delay time storage unit, a subject image is captured, sequentially converted into image data, the image data is stored in a buffer memory unit, and the display time lag information stored in the delay time storage unit And when the photographer goes back from the time when the timing detection signal was detected when the photographer instructed the shooting start operation based on the release time lag information. Is set as the recording start time, and when the photographer performs a release operation and shoots, an image corresponding to the time that is set back by the set recording start time from the image data recorded in the buffer memory unit. Data is extracted and recorded in the recording unit.

  According to the present invention, it is possible to surely obtain the best photographed image by the photographer without increasing the image data to be read and temporarily stored from the image sensor and according to the release operation of the photographer. And an imaging method can be provided.

1 is a block diagram mainly showing an electrical configuration of a camera according to an embodiment of the present invention. It is a flowchart which shows the operation | movement for adjusting the response time of the camera which concerns on one Embodiment of this invention. FIG. 10 is a diagram showing a selection screen at the time of pre-capture response adjustment in the camera according to the embodiment of the present invention. In the camera which concerns on one Embodiment of this invention, it is a figure which shows the change of the screen display for adjustment at the time of the 1st response time adjustment at the time of pre-capture response adjustment. In the camera which concerns on one Embodiment of this invention, it is a figure which shows the change of the screen display for adjustment at the time of the 2nd response time adjustment at the time of pre-capture response adjustment. It is a figure which shows the pre capture time adjustment table in the camera which concerns on one Embodiment of this invention. It is a figure which shows an example of the pre capture time adjustment value in the camera which concerns on one Embodiment of this invention. It is a flowchart which shows the imaging | photography sequence of the camera which concerns on one Embodiment of this invention. It is a figure which shows the time change of the buffer memory data processing at the time of buffering in the camera which concerns on one Embodiment of this invention. It is a figure which shows the image acquired from the buffer memory at the time of video recording in the camera which concerns on one Embodiment of this invention. It is a flowchart which shows the modification of the operation | movement for adjusting the response time of the camera which concerns on one Embodiment of this invention.

  Hereinafter, a preferred embodiment using a camera will be described as an imaging apparatus to which the present invention is applied according to the drawings. The camera according to a preferred embodiment of the present invention is a digital camera. This digital camera has an imaging unit, images a subject image by the imaging unit, sequentially converts it into image data, and a display unit that arranges the subject image on the back of the main body based on the converted image data Alternatively, live view display is performed on an electronic viewfinder (EVF). A photographer who is a user determines a composition and a photo opportunity by observing a live view display, and records a still image or a moving image.

  Further, an adjustment screen display is displayed on the display unit or the like, a release time lag unique to the photographer is measured, and this release time lag is stored in advance. Further, in this camera, delay time (display time lag) information required for live view display image processing according to the type of image processing (for example, shading correction, trimming enlargement processing, etc.) is recorded in the recording unit in advance. At the time of shooting, image data at a timing intended by the photographer is recorded on a recording medium using a release time lag and a display time lag unique to the photographer.

  FIG. 1 is a block diagram mainly showing an electrical configuration of a camera 100 according to an embodiment of the present invention. The control unit 1 has a CPU (Central Processing Unit) and performs input / output control of signals for each block according to a program stored in a non-volatile memory such as a flash RAM. The whole of 100 is controlled.

  The photographing lens 2 is a single focus lens or a variable focal length lens (zoom lens) composed of a plurality of lenses, and forms a subject image. The photographic lens 2 is adjusted by the lens control unit 3 by moving the focus lens in the optical axis direction. When the photographic lens 2 is a zoom lens, the zoom lens is moved in the optical axis direction and the focal length is adjusted. . In addition, the lens control unit 3 has a diaphragm mechanism, and performs aperture control with the diaphragm mechanism to adjust the amount of light incident on the image sensor 4.

  An image sensor 4 is disposed on the optical axis of the photographic lens 2. The image sensor 4 photoelectrically converts the formed subject image into an image signal, A / D converts the image signal, and outputs image data obtained by digitizing image information. That is, the image sensor 4 captures a subject image and sequentially converts the acquired image signal into image data. The output of the image sensor 4 is connected to the AE processing unit 5, the AF processing unit 6, the buffer memory 12, and the image processing unit 7. Further, the image pickup device 4 has an electronic shutter, and when performing live view display, moving image shooting, or the like, it can continuously perform image pickup operations and output image data continuously.

  The AE processing unit 5 acquires the luminance information of the subject based on the image data output from the image sensor 4. The subject luminance information acquired by the AE processing unit 5 is output to the control unit 1, and the control unit 1 calculates the aperture control aperture value for proper exposure and the exposure control value such as the shutter speed, and the lens control unit. Exposure control is performed by 3 etc. In addition, the image processing unit 7 described later calculates a gain amount when adjusting the luminance output of the image data.

  The AF processing unit 6 first extracts a high-frequency component at a predetermined spatial frequency based on the image data output from the image sensor 4 and calculates a contrast evaluation value. Next, this contrast value is output to the control unit 1, and the control unit 1 drives and controls the focus lens via the lens control unit 3 to focus the image formed on the image sensor 4. That is, the focus lens is driven and controlled by the lens control unit 3 so that the contrast evaluation value of the subject is maximized.

  The image processing unit 7 performs gradation correction, white balance correction, noise removal correction, edge enhancement correction, shading correction, aberration correction calculation based on aberration information of the photographing lens, and the like on the image data output from the image sensor 4. Perform image processing. In addition, special effect filtering processing is performed on image data when various special effect processing such as peripheral resolution reduction processing, color saturation enhancement, and color extraction is performed on the captured image. Also, image data compression processing is performed so that a predetermined recording format for still images and moving images is obtained.

  The output of the image processing unit 7 is connected to the storage memory 11 and the display control unit 8. The display control unit 8 transmits a display image signal to the electronic viewfinder 9 and the display unit. The electronic viewfinder (EVF) 9 allows a photographer to observe a live view image at the time of photographing through the eyepiece. The display unit 10 includes a liquid crystal display device (LCD) and an organic EL device, and displays a live view image at the time of shooting, a menu image for setting shooting conditions, and the like. Further, as will be described later, a delay time measurement image is displayed when acquiring release time lag information unique to the photographer. That is, the display unit 10 functions as a display unit that displays a delay time measurement image and a live view image based on the image data.

  The storage memory 11 is a memory for recording image data converted into a predetermined recording data format by the image processing unit 7, and is a removable recording medium such as a nonvolatile recording medium (for example, an SD card (registered trademark)). Recording medium, or a non-volatile memory built in the camera 100). The storage memory serves as a recording unit that performs a recording operation by transferring predetermined image data from the image data stored in the buffer memory unit to a recording medium.

  The buffer memory 12 is a memory that temporarily stores the image data output from the image sensor 4 and the image data processed by the image processing unit 7 and outputs the temporarily stored image data to the image processing unit 7. . As will be described later, the buffer memory 12 is also used as a memory for buffering continuously captured image data during pre-capture shooting. Therefore, the buffer memory 12 functions as a buffer memory unit that sequentially updates image data for a preset frame to the latest image data and temporarily holds it.

  As will be described later, the adjustment value storage memory 13 stores display time lag information and release time lag information used during pre-capture shooting. The display time lag information is information regarding a delay time until image processing is performed on the image data output from the image sensor 4 and a live view image is displayed on the display unit 10 (or the electronic viewfinder 9). The release time lag information is information regarding a delay time unique to the photographer from when the photographer intends to start photographing until when the photographer actually instructs the photographing start operation. Since the display time lag information differs depending on the shooting mode, the display time lag information corresponding to the shooting mode is also stored.

  The display time lag information stored in the adjustment value storage memory 13 is stored in advance at the time of factory shipment of the digital camera, and the release time lag information is stored in advance as a default value at the time of factory shipment. However, as will be described later with reference to FIGS. 2 to 5, the photographer individually measures and rewrites the default value into the measured release time lag information. The adjustment value storage memory 13 is preferably composed of an electrically rewritable nonvolatile memory. Therefore, the adjustment value storage memory 13 functions as a delay time storage unit that stores display time lag information until the live view image is displayed on the display unit after image processing is performed on the image data and the release time lag information. . Release time lag information and display time lag information stored in the adjustment value storage memory 13 will be described later with reference to FIGS. 6 and 7.

  The touch panel operation unit 14, the release button 15, the moving image recording button 16, and the operation button 17 function as an operation input unit, and also function as a release operation input unit that detects a timing detection signal instructing a shooting start operation by a photographer. The touch panel operation unit 14 is arranged so as to be superimposed on the display unit 10, and a signal indicating a contact position (coordinates) is controlled when the photographer touches the display screen of the display unit 10 with a finger, a touch pen, or the like. Is output to section 1.

  The release button 15 is a push button for taking a still image, and has a push button switch that can detect two steps of a half-pressed state and a fully-pressed state. When the release button 15 is pressed halfway, the AF processing unit 5 and the AE processing unit 6 perform adjustment operations such as focus adjustment and illuminance adjustment. Further, in the fully pressed state, the photographing operation is started.

  The moving image recording button 16 is a push button for shooting a moving image. When the moving image recording button 16 is pressed, the moving image recording is started, and when the moving image recording button 16 is pressed again, the moving image recording is stopped. The operation button 17 has various operation buttons such as a menu button, a cross button, an OK button, and a playback button. Note that the operation member is not limited to a button, and may be any operation member such as a dial or a lever.

  The control unit 1 described above detects release time lag information for detecting release time lag information specific to the photographer from when the photographer intends to start shooting until the actual shooting start operation is instructed according to the delay time measurement image. It functions as a detector. This function will be described later with reference to FIG.

  The control unit 1 also detects the timing when the photographer instructs the shooting start operation based on the display time lag information and the release time lag information stored in the delay time storage unit (the adjustment value storage memory 13 functions). It also functions as a pre-capture shooting time setting unit that sets a time that goes back from the time when the signal is detected as the recording start time. This function will be described later with reference to FIG. In addition, when the photographer performs a release operation and shoots, the control unit 1 corresponds to a time that is set back by the time set by the pre-capture shooting time setting unit from the image data recorded in the buffer memory unit. The extracted image data is extracted and recorded in the recording unit. This function will be described later with reference to FIGS.

  Next, an adjustment operation for measuring release time lag information unique to the photographer will be described with reference to FIGS. FIG. 2 is a flowchart for performing an adjustment operation for measuring release time lag information. This flowchart (including flowcharts shown in FIGS. 8 and 11 described later) is executed by the control unit 1 based on a program stored in the nonvolatile memory.

  When the adjustment operation is started, a description is first displayed on the display unit 10 (S1), and then it is determined whether or not the adjustment operation is performed (S2). Here, a screen display explaining to the photographer whether or not to measure the release time lag information is displayed, and it is determined whether or not the photographer performs adjustment according to this screen display. FIG. 3A is an example of an explanation display, and in response to the question of whether to adjust the pre-capture time, either “OK” or “Cancel” is selected with the cross button and confirmed with the OK button. Alternatively, on the display screen, touching any one of the screen areas where “OK” or “Cancel” is displayed selects whether or not to perform the adjustment.

  If adjustment is performed as a result of the determination in step S2, next, an explanation of the adjustment content is displayed (S3). Here, adjustment of the pre-capture time will be described. FIG. 3B is an example of this explanation display, indicating that “adjust the shooting operation response time” is displayed, and the photographer selects “item” with the OK button or touches the touch panel operation unit 14. To go to the next.

  Once the details of the adjustment have been described in step S3, next an adjustment item is selected (S4). In this embodiment, there are two types: (1) a first adjustment method for adjusting the response time due to a change in the shape of the display image, and (2) a second adjustment method for adjusting the response time at the stop timing of the moving image. The adjustment method is prepared. FIG. 3C is an example of a screen on which the photographer selects one of the first and second adjustment methods. The first and second adjustment methods will be described later with reference to FIGS. 4 and 5.

  If the first and second adjustment methods are selected in step S4, then the shooting operation start method is selected. In this embodiment, three types of shooting operation start methods are prepared: (3) release button 15, (4) moving image shooting button 16, and (5) release by touch input on touch panel operation unit 14. . FIG. 3D is an example of a screen for the photographer to select one of the start of the photographing operation.

  Therefore, in step S4, there are two types of adjustment time measurement methods ((1) or (2)) and three types of shooting operation start methods ((3) to (5)). There is a measurement method. In step S4, any one of six types of conditions is selected and adjusted. If any of the above six conditions is recorded in the past as the adjustment time (release time lag information) unique to the photographer, the adjustment conditions that have not yet been registered are prioritized. May be registered.

  When an adjustment item is selected in step S4, measurement of adjustment time is started. First, the pre-change image is displayed (S5), and the post-change image is displayed (S6). The pre-change image and the post-change image are displayed differently depending on the selected adjustment time measurement method.

  When the selected adjustment time measurement method is (1) the first adjustment method for adjusting the response time due to the shape change of the display image, an image as shown in FIG. 4 is displayed. This first adjustment method measures the response time for the moment when the display image changes from the first still image to the second still image.

  In step S4, first, as shown in FIG. 4A, an adjustment time measurement method is described, and then a still image as shown in FIG. 4B is displayed. Subsequently, in step S5, a still image (different from FIG. 4B) as shown in FIG. 4C is displayed. The adjustment time starts to be measured from the time when the different still images are displayed. Note that the adjustment time measurement still image shown in FIG. 4 is an example, and the shape of the figure may be appropriately changed. Of course, it does not have to be a simple figure, such as changing from a flower photograph to a star photograph.

  When the selected adjustment time measurement method is (2) the second adjustment method in which the response time is adjusted at the stop timing of the moving image, an image as shown in FIG. 5 is displayed. In the second adjustment method, a response time is measured for a moment when a part of a moving image of a display image moves in a certain direction in time series and the moving image falls within a target display range.

  In step S4, first, the adjustment time measurement method is described as shown in FIG. 5A, and then the star mark is placed on the square box as shown in FIGS. Move in the direction. In step S5, as shown in FIG. 5D, a star mark is placed in a square box. From this point, measurement of the adjustment time is started. Note that the adjustment time measurement image shown in FIG. 5 is an example, and the figure shape may be appropriately changed.

  When the changed image is displayed in step S6, next, a designated photographing start operation is detected (S7). Here, the detection is performed based on the photographing operation start method designated in step S4. That is, as the shooting operation, any one of the release button 15, the moving image shooting button 16, and the touch panel operation unit 14 is designated, and the designated shooting operation is detected.

  If the designated photographing start operation in step S7 cannot be detected, it is next determined whether or not 5 seconds have elapsed since the changed image was displayed (S20). If it has not elapsed, the process returns to step S7. On the other hand, if the result of determination is that it has elapsed, measurement is stopped (S21). In step S20, it is determined whether or not a predetermined time (5 seconds) has elapsed since the measurement of the adjustment time was started.

  In the determination at step S20, steps S7 and S20 are sequentially repeated until a predetermined time elapses. However, when the predetermined time elapses, it is determined that there is an abnormality, measurement is stopped at step S21, and the process returns to step S1. In the present embodiment, the predetermined time is 5 seconds, but is not limited to 5 seconds as long as it can be determined as “abnormal”. Further, when the selected adjustment time measurement method is the second adjustment method for adjusting the response time at the stop timing of the moving object image, it is determined whether the moving object is outside the measurement region, and the measurement is performed. If it becomes out of the area, the measurement may be stopped.

  If the result of determination in step S7 is that a designated shooting start operation has been detected, the adjustment time measurement ends, "adjustment time" is calculated, and it is determined whether or not the adjustment time is 0 seconds (S8). . In steps S5 and S6, the measurement of the adjustment time is started, and the time until it is determined that there is a detection in step S7 is calculated. If the calculated adjustment time is 0 seconds, it is determined that the adjustment time has not been correctly measured, and the process returns to step S1. In the present embodiment, the determination time is set to 0 seconds, but it may be a time that can be determined that measurement cannot be performed correctly.

  If the result of determination in step S8 is that the adjustment time is not 0 seconds, then the “adjustment time result” is displayed on the display unit 10 (S9). Here, the adjustment time calculated in step S8 is displayed on the display unit 10 so that the photographer can check it.

  If the adjustment time result is displayed in step S9, it is next determined whether or not readjustment is performed (S10). Here, the photographer determines whether or not to perform readjustment by looking at the result of the adjustment time, and the determination is made based on the result. For this purpose, an “readjustment” icon may be displayed on the adjustment time result display screen and input by an OK button or a touch operation.

  As a result of the determination in step S10, when readjustment is performed, the process returns to step S1 and readjustment is performed. On the other hand, if the readjustment is not performed as a result of the determination, next, “adjustment time” is registered (S11). Here, the adjustment time obtained as a result of the measurement is registered in the adjustment value storage memory 13 as release time lag information unique to the photographer.

  If the adjustment time is registered in step S11, it is next determined whether or not all the adjustment contents have been registered (S12). Here, the data registered in the adjustment value storage memory 13 is referred to and it is determined whether or not “adjustment time” data exists for all six types of conditions.

  If all the adjustment contents are not registered as a result of the determination in step S12, it is determined whether or not adjustments under other conditions are registered (S22). Here, among the adjustment items displayed in step S4, adjustment conditions not yet registered are displayed, and the photographer is instructed to select whether or not to register by measuring the adjustment time. As a result of this determination, when registering, the process returns to step S1 and readjustment is performed.

  If the result of determination in step S22 is not registered, or if the result of determination in step S12 is that all adjustment details have been registered, or the result of determination in step S2 is that adjustment is not performed, the shooting information is stored. Register (S15). Here, the measured photographing time of the photographer, for example, a name, a nickname, a number, or the like is associated with the measured adjustment time and registered in the adjustment value storage memory 13. When this registration process ends, the adjustment operation ends.

  As described above, in the adjustment operation in the present embodiment, the adjustment image before the change is changed to the adjusted image after the change, and the response time of the photographer is measured with respect to this change (S5 to S8). The adjustment time (release time lag information) is registered in the adjustment value storage memory 13 based on the above.

  In measuring the adjustment time, a moving body image is displayed as an adjustment image (delay time measurement image), and a photographer's response time is measured. A second adjustment method (second release time lag) in which the instantaneous change of the image is displayed to measure the photographer's response time can be selected. Some subjects change instantaneously and others change dynamically, and an appropriate adjustment time (release time lag) can be measured.

  The adjustment time is measured by measuring a delay time when the photographer operates the release button and a delay time when the photographer operates the touch panel. When the operation button is operated and when the touch panel is operated, the adjustment time (release time lag) differs depending on the photographer, and the appropriate adjustment time (release time lag) can be measured. In the present embodiment, the moving image recording button 16 is not measured, but the moving image recording button 16 may of course measure the adjustment time (release time lag).

  Next, the pre-capture time adjustment table stored in the adjustment value storage memory 13 will be described with reference to FIGS. FIG. 6 shows the data contents of the pre-capture time adjustment table stored in the adjustment value storage memory 13. In the adjustment value storage memory 13, as shown in FIG. 6A, a user response time adjustment value table 13a corresponding to the release time lag information unique to the photographer, and a shooting mode delay table 13b corresponding to the display time lag information. And have. The user response time adjustment value table 13a is a table for storing the adjustment time for each photographer detected by the adjustment operation described with reference to FIGS. Further, the shooting mode delay table 13b is a table for storing a delay time required for capturing an image with the image sensor 4, performing image processing, and displaying the image on the display unit.

  As shown in FIG. 6 (b), the user response time adjustment value table 13a includes the photographer information, the adjustment screen displays the shape change (first adjustment method) and the moving body stop (second adjustment method) on the vertical axis. In addition, in the shooting start method, a total of six types of response times are recorded with the release button, moving image recording button, and touch panel contact as the vertical axis. As shown in FIG. 6C, the shooting mode delay table 13b includes processing delay time when performing image effect processing, image quality correction processing, and the like, delay time based on the shooting frame rate, delay time based on the shooting scene, and the like. These processing delay times are recorded.

  That is, images captured in real time by the imaging device 4 are sequentially processed and displayed on the display unit 10 and the electronic viewfinder 11 of the camera 100 according to the present embodiment. In the so-called live view display state, a display delay occurs according to the display frame rate (fps) indicating the update period of the display unit image. Therefore, the pre-capture time of each individual photographer as described above (returns before the release operation). In addition to the time until the start of shooting: Release time lag), in addition to the time corresponding to the display time lag corresponding to the frame rate of the display unit, the pre-capture time (until shooting starts before the release operation) Time).

  Further, the image signal output from the image sensor 4 is not necessarily recorded as an image signal as it is, but for the photographer to obtain desired image quality characteristics, for example, edge enhancement processing, noise reduction processing, auto white balance processing, Image processing such as correction correction processing may be selected. These processes are performed on the image data output from the image sensor 4 by the image processing unit 7 by a spatial frequency filtering process or a geometric correction calculation process. Since the live view image is displayed based on the image data after performing these image processings, in addition to the delay time of the display unit described above, the processing time required for the image processing calculation is considered in the pre-capture time. There is a need.

  Therefore, the processing delay time depending on the shooting conditions, that is, the delay time information from when the image data is output from the image sensor 4 at the time of live view display to when the camera 100 is displayed on the display unit is displayed in the shooting mode delay table. 13b is stored in the adjustment value storage memory 13. Note that FIG. 6C is an example, and the stored information may be appropriately selected according to the function of the camera 100 and the like.

  FIG. 7 shows an example of the time adjustment value in the pre-capture time adjustment table stored in the adjustment value storage memory 13 shown in FIG. FIGS. 7A to 7C show examples of response times of the photographers (A, B, and C) stored in the user response time adjustment value table 13a.

  FIG. 7D shows an example of the in-camera processing delay correction amount stored in the shooting mode delay table 13b. In the example of FIG. 7D, the delay correction amount is 0 second when there is no image effect processing, the delay correction amount is 1 msec when the edge enhancement processing is performed, and the delay correction amount is 2 msec when the shading correction is performed. Is 1 msec, the delay correction amount is 10 msec when the subject motion is small, the delay correction amount is 50 msec when the subject motion is large, and the delay correction amount is 40 msec when 25 fps is displayed. By adding these delay correction amounts according to the set image effects, image quality correction processing, etc., the processing delay correction amount in the camera can be obtained.

  The pre-capture time setting value at the time of shooting during live view display corresponds to the delay time [Tuser] stored in the user response adjustment value table 13a, which is a photographer-specific adjustment value, and the shooting conditions at the time of shooting. The processing delay time is set to a value obtained by adding the delay time [Tcamera] referenced from the shooting mode delay table 13b. As a result, the image processing conditions as shown in FIG. 6, in particular the special delay time from when the image sensor 4 in the camera 100 outputs image data until the image is displayed on the display unit, according to the shooting conditions. This can be reflected in the delay pre-capture time due to the processing method when the image processing delay time is different due to the effect processing or the like.

  Next, the photographing operation performed using the pre-capture time will be described using the flowchart shown in FIG. When the shooting operation flow is entered, first, shooting conditions are selected (S60). Here, information on shooting conditions such as a shooting frame rate and a shooting operation input method (release button 15, moving image recording button 16, touch panel operation unit 14) is detected. Also, pre-registered photographer information is input by the photographer's operation. Furthermore, during live view display, correlation processing is performed from the acquired image, the amount of movement of the subject is detected as a motion vector, and the amount of movement of the specific subject is determined.

  Once the shooting conditions are selected, image processing, correction processing, and shooting conditions are selected (S61). Here, the setting of the image processing means 7 for the acquired image at the time of pre-capture shooting is detected.

  Once image processing, correction processing, and shooting conditions are selected, the delay time table is then referenced (S62). Here, based on the detection conditions in steps S60 and S61, the adjustment values stored in the adjustment value storage memory 13 are referred to, the user response time adjustment value table 13a corresponding to the photographer, and the shooting conditions. The delay times (Tuser and Tcamera) corresponding to the response times stored in the shooting mode delay table 13b (see FIG. 6) are read.

  Once the delay time table is referred, the pre-capture time is calculated (S63). Here, the sum of the adjustment values of Tuser and Tcamera read from the adjustment value storage memory 13 in step S62 is calculated as the pre-capture adjustment time (Tpre-rec).

  When the pre-capture time is calculated, the continuous imaging operation is started. First, continuous images are acquired and stored in a buffer memory (S64). Here, each continuous image data acquired by continuous imaging during live view display is sequentially recorded in the buffer memory 12. The recording in the buffer memory 12 will be described later with reference to FIG.

  Once continuous image acquisition has been carried out, it is next determined whether or not there is an empty space in the buffer memory 12 (S65). The buffer memory 12 can record a predetermined amount of image data. Here, the determination is based on whether the recorded image data exceeds a predetermined capacity.

  If the result of determination in step S65 is that the buffer memory 12 is free, it is determined whether or not a release operation has been detected (S66). Here, it is determined whether or not the release operation has been instructed by the shooting operation input method set based on the shooting operation input method (release button 15, moving image recording button 16, touch panel operation unit 14) detected in step S60. If the release operation is not detected as a result of this determination, the process returns to step S64 to perform continuous image acquisition or the like.

  If the result of determination in step S65 is that there is no free space in the buffer memory, then the oldest image frame data is erased (S80). Here, since there is no space in the buffer memory 12, the image data of the oldest frame image stored in the buffer memory 12 is deleted.

  Subsequently, the latest acquired image frame data is recorded (S81). Instead of the image data of the frame image deleted in the process in step S80, the image data of the latest acquired image is recorded in the buffer memory 12 and updated. Therefore, the latest image data (the predetermined number of frames is the upper limit) is recorded in the buffer memory 12 from the start of continuous image acquisition in step S64 until the release operation is detected in step S66. The recording in the buffer memory 12 will be described later with reference to FIG.

  If the release operation is detected as a result of the determination in step S66, the image data string at the time point that is pre-captured from the release detection is referred to (S67). Here, the continuous image recorded in the buffer memory 12 is referred to, and the image data string at the time point of going back the pre-capture time calculated in step S63 from the time point of the photographing start operation is referred to.

  Subsequently, the pre-captured image data sequence is transferred to the recording unit (storage memory 11) and recorded (S68). Here, in the case of moving image shooting, an image data sequence from a point back by the pre-capture time is transferred to the recording unit and recorded. Further, in the case of still image shooting, image data at a time point that is back by the pre-capture time is transferred and recorded.

  Once the pre-captured image data sequence is transferred to the recording unit, next, continuous moving image shooting is performed (S69). When the shooting method is a moving image, continuous moving image shooting is performed for moving image shooting. In the case of still image shooting, steps S69 to S73 are skipped, and the flow of the shooting operation is terminated.

  If continuous moving image shooting is continued in step S69, next, continuous images are acquired and stored in the buffer memory (S70). Here, the continuously shot image sequences that have been shot are sequentially transferred to the buffer memory 12 and stored.

  Subsequently, as in step S65, it is determined whether or not there is a free space in the buffer memory 12 (S71). Here, it is determined whether or not there is free space in the buffer memory 12 during continuous shooting. If the result of this determination is that there is free space, it is next determined whether or not a shooting end operation has been detected (72). When the photographer finishes moving image shooting, the moving image recording button 16 is operated again. In this step, determination is made based on whether or not this operation has been performed. If the result of this determination is that a shooting end operation has not been detected, processing returns to step S70, and continuous shooting for moving images is continued.

  If the result of determination in step S71 is that there is no space in the buffer memory 12, all images in the buffer memory are transferred to the recording unit (S82). As a result, the buffer memory 12 is emptied, and continuously captured image data for moving images can be recorded. When all the images in the buffer memory are transferred to the recording unit, the process returns to step S70, and the continuous shooting for the moving image is continued.

  If the result of determination in step S72 is that a shooting end operation has been detected, the continuous shooting operation is ended and the buffer memory image is transferred to the recording unit (S73). Here, the image data recorded in the buffer memory 12 is transferred to the storage memory 11 which is a recording unit, and the image data is recorded. When the image data is recorded, the shooting operation flow is finished.

  As described above, in the flow of the shooting operation in the present embodiment, the delay time corresponding to the set shooting conditions (shooting start operation method, image processing, correction processing, etc.) and the delay time unique to the photographer are set as the delay time. The pre-capture time is calculated by reading from the tables 13a and 13b (S60 to S63). The image data continuously captured by the image sensor 4 is stored in the buffer memory 12 (S64, S65, S80, S81), and the image data or the image at the time point that is back by the pre-capture time from the time when the photographing start operation is performed. A still image or a moving image is acquired using the data string (S66 to S68).

  Next, the time change of buffer memory data processing during buffering in the buffer memory 12 will be described. This process corresponds to a series of processes in steps S64, S65, S80, and S81 and a series of processes in S69, S70, S71, and S82 in the flowchart shown in FIG.

  In the example shown in FIG. 9, the buffer memory 12 has a capacity capable of recording image data for 16 frames. At time T1, image data from the first frame to the 15th frame is recorded. At time T2, the image data of the 16th frame is stored. At this point, the buffer memory is full, that is, there is no empty area in the buffer memory.

  At time T3, image data for the 17th frame is newly acquired. Since the buffer memory is in a memory full state, the image of the first frame is erased and the image of the 17th frame is stored. Subsequently, at time T4, image data for the 18th frame is newly acquired. Since the buffer memory is in a memory full state, the second frame image is erased and the 18th frame image is stored. Thereafter, each time a new image is acquired, the oldest image is erased and the new image is stored.

  As described above, when the image data is stored in the entire storage area of the buffer memory 12, the oldest image in the buffer memory is deleted and a new image is updated (FIFO processing). In FIG. 9, continuously shot images for moving images are held in the image buffer memory for 1, 2,...

  The image recorded in the buffer memory 12 may be recorded as uncompressed image data. However, it is advantageous to perform buffering after image compression by the image processing unit 7 because the burden on the buffer memory 12 is reduced and a large number of frames (number of frames) can be stored.

  Next, the storing operation of the buffer memory during moving image shooting using the pre-capture adjustment will be described with reference to FIG. FIG. 10 is an image diagram when recording a moving image using the pre-capture adjustment, and corresponds to a series of processes in steps S69 to S72 and S82 in the flowchart of FIG.

  Whether or not to use the adjustment value is set by the photographer on the menu screen of the camera 100. When the photographer sets to use the pre-capture adjustment value, and when the acquired value Tuser is recorded in advance in the photographer-specific adjustment time (release time lag information), that is, the user response time adjustment value table 13a. Is the processing delay time (display time lag information) in the camera, that is, the time obtained by adding the acquired value Tcamera to the shooting mode delay table 13b is the pre-capture time. In the case of moving image shooting, image data at a position that is back by a pre-capture time from the start of shooting is read from the buffer memory 12, and recording is started with that image as a start image.

  In FIG. 10, when the time t2 is the shooting start time, the time t1 that is back by the pre-capture time tpr is the shooting start time, and recording starts with the image data of the fifth frame as the start image. When shooting stops at the 14th frame at time t4, the 5th to 14th frames are recorded as a moving image. Note that even when shooting is stopped, up to time t3 that is back by the pre-capture time tpr, that is, 5 to 10 frames may be recorded as a moving image.

  Also in the case of still image shooting, the image sensor is always buffered by the all-pixel readout drive using the electronic shutter operation, so that the still image is shot by going back by the pre-capture adjustment time. be able to. That is, in normal still image shooting, an image at the shooting start time t2 (image at the ninth frame) is recorded, but the image at the time t1 (image at the fifth frame) is traced back by the pre-capture adjustment time. It can be recorded as a still image and the release time lag can be canceled. In this case, it is possible to reduce missed shots by recording several frames before and after considering variations in human reaction speed.

  Next, a modification of the adjustment operation shown in FIG. 2 will be described using the flowchart shown in FIG. In one embodiment of the present invention, the adjustment time is measured once. However, in this modification, the adjustment time is measured a plurality of times, and the average value is stored as the adjustment value.

  The flowchart shown in FIG. 11 is different from the flowchart of FIG. 2 in that step S7a is added and the calculation of the adjustment time in step S8 is different, so this difference will be mainly described.

  The adjustment operation is started, the pre-change image is displayed (S5), the post-change image is displayed (S6), and after the adjustment time measurement is started, it is determined whether or not the designated photographing start operation is detected. (S7). If the result of this determination is that a designated shooting start operation has been detected, it is next determined whether or not adjustment has been performed five times (S7a). Here, it is counted how many times the adjustment value of the response time has been measured, and it is determined whether or not it has been performed a predetermined number of times. In the present embodiment, the predetermined number of times is five. However, the number of adjustments is not limited to this, and it is sufficient that the measurement accuracy of the adjustment time has no practical problem.

  If the result of determination in step S7a is that the adjustment is less than 5 times, the process returns to step S5 and repeats the adjustment time measurement. On the other hand, when the adjustment is five times, the measurement of the adjustment time is ended, the adjustment time is calculated, and it is determined whether or not the adjustment time is 0 second (S8). In calculating the adjustment time, in one embodiment of the present invention, since the measurement was performed only once, it was the measured time itself. However, in this modification, since the adjustment time is measured a plurality of times, an average value is calculated, and this average value is used as the adjustment time. Since the subsequent processing is the same as that shown in the flowchart of FIG.

  Thus, in this modification, measurement of adjustment time is repeated a plurality of times, and the average value is used as the adjustment time. Since the release time lag information unique to the photographer has a large variation in measurement, a more accurate adjustment value can be obtained by measuring a plurality of times and obtaining an average value. In particular, when the measurement is performed by the second adjustment method that adjusts the response time at the stop timing of the moving image, an error due to timing occurs in addition to the first adjustment method in which the image is simply changed. For this reason, accuracy can be improved by performing adjustment several times. In this modification, the average value is obtained when calculating the adjustment value. However, the average value is not limited to this. For example, the maximum value among a plurality of measurement values is adopted as the adjustment value. Also good.

  As described above, in one embodiment of the present invention and its modification, the display time lag information until the live view image is displayed on the display unit after image processing is performed on the image data (the shooting mode in FIG. 6). The delay table 13b) stores release time lag information (user response time adjustment value table 13a in FIG. 6) unique to the photographer from when the photographer intends to start photographing until when the photographer actually instructs the photographing start operation. Based on the display time lag information and the release time lag information (see the adjustment value storage memory 13), a time that goes back from the time when the timing detection signal was detected when the photographer instructed the shooting start operation is set as the recording start time. I have to.

  For this reason, in one embodiment of the present invention and its modification, the photographer selects the best captured image according to the release operation of the photographer without increasing the image data to be read and stored temporarily from the image sensor. It can be acquired with certainty.

  In the embodiment and the modification of the present invention, when measuring the adjustment value, the delay time measurement image is displayed on the display unit 10 and the adjustment time is measured. Of course, it is possible to measure the adjustment time when photographing while observing the live view image with the electronic viewfinder 9.

  In the present embodiment, the digital camera is used as the photographing device. However, the camera may be a digital single lens reflex camera, a mirrorless camera, or a compact digital camera, such as a video camera or a movie camera. It may be a camera for moving images, or may be a camera built in a mobile phone, a smart phone, a personal digital assistant (PDA), a game machine, or the like.

  In addition, regarding the operation flow in the claims, the specification, and the drawings, even if it is described using words expressing the order such as “first”, “next”, etc. It does not mean that it is essential to implement in this order.

  The present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, you may delete some components of all the components shown by embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

DESCRIPTION OF SYMBOLS 1 ... Control part (CPU), 2 ... Shooting lens, 3 ... Lens control part, 4 ... Image pick-up element, 5 ... AE processing part, 6 ... AF processing part, 7. ..Image processing unit, 8 ... Display control unit, 9 ... Electronic viewfinder (EVF), 10 ... Display unit, 11 ... Storage memory, 12 ... Buffer memory, 13 ... Adjustment value storage memory, 13a ... User response time adjustment value table, 13b ... Shooting mode delay table, 14 ... Touch panel operation section, 15 ... Release button, 16 ... Movie recording button, 17. ..Operation buttons

Claims (5)

An imaging unit that captures a subject image and sequentially converts it into image data;
A release operation input unit for detecting a timing detection signal instructing a shooting start operation by a photographer;
A buffer memory unit that sequentially updates the image data for a preset frame to the latest image data and temporarily holds the data;
A display unit for displaying a delay time measurement image and a live view image based on the image data;
According to the delay time measurement image, a release time lag information detection unit that detects release time lag information unique to the photographer from when the photographer intends to start photographing until the actual photographing start operation is instructed,
A delay time storage unit that stores the display time lag information and the release time lag information until image processing is performed on the image data and a live view image is displayed on the display unit;
Based on the display time lag information and the release time lag information stored in the delay time storage unit, a recording start time is a time that is earlier than the time when the timing detection signal was detected when the photographer instructed the shooting start operation. A pre-capture shooting time setting section set as
A recording unit for transferring predetermined image data from the image data stored in the buffer memory unit to a recording medium and performing a recording operation;
Have
When the photographer performs a release operation and shoots, image data corresponding to the time that is set back by the time set by the pre-capture shooting time setting unit is extracted from the image data recorded in the buffer memory unit. And recording in the recording unit.   The release time lag information displays a moving object image as the delay time measurement image, a first release time lag for measuring the response time of the photographer, and an instantaneous change of a still image as the delay time measurement image. The imaging apparatus according to claim 1, further comprising a second release time lag for measuring a response time of the photographer.   The imaging according to claim 1, wherein the release time lag information is detected by measuring a delay time when the photographer operates the release button and a delay time when the photographer operates the touch panel. apparatus.   The imaging apparatus according to claim 1, wherein the display time lag information is a delay time based on at least one of a shooting frame rate, an image effect process, an image quality correction process, and a shooting scene. An imaging method in an imaging apparatus having a delay time storage unit that performs image processing on image data output from an imaging unit and stores display time lag information until a live view image is displayed on a display unit,
Using the delay time measurement image, the release time lag information specific to the photographer from when the photographer intends to start shooting until the actual shooting start operation is instructed is detected, and this release time lag information is stored in the delay time storage unit. Remember
Capture a subject image, sequentially convert it into image data, store the image data in the buffer memory unit,
Based on the display time lag information and the release time lag information stored in the delay time storage unit, a recording start time is a time that is earlier than the time when the timing detection signal was detected when the photographer instructed the shooting start operation. Set as
When a photographer performs a release operation and shoots, image data corresponding to a time that is set back by the set recording start time is extracted from the image data recorded in the buffer memory unit and stored in the recording unit. Record,
An imaging method characterized by the above.

Images