JP2006033033A - Method and program for reproducing motion image and image pickup device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a motion image reproducing technique capable of reproducing frame images corresponding to a desired photographing condition as motion images when frame pictures having different photographing conditions are sequentially photographed and recorded. <P>SOLUTION: The image pickup device can photograph at a high-speed frame rate of three times that of motion image reproduction. When this image pickup device photographs a motion image, a photographing operation is repeated while a focusing condition is changed in a three stages concerning, for example, a focusing position of a main object, thereby enabling sequentially acquiring three kinds of image data (a-c sequence) such as image data f1 of rear focus, image data f2 of just focus and image data f3 of front focus and recording the acquired data. In reproducing this, the frame image of the focus condition selected by a user is extracted from among a group of recorded frame images and time-sequentially reproduced. As a result, the frame images corresponding to the photographing conditions desired by the user can be appropriately reproduced as motion images. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a moving image reproduction technique for performing moving image reproduction based on a frame image group recorded in a recording unit.

  In moving image shooting in an imaging apparatus, a technique for generating a moving image with a wide dynamic range at the same frame rate as the original image by alternately acquiring two types of frame images captured at different exposure times and combining them. (See Patent Document 1).

JP 2003-46857 A

  However, since the technique disclosed in Patent Document 1 generates a composite image by combining two types of frame images, it is possible to reproduce a moving image composed of the composite images, but each frame image is composed of the original frame images. Even when it is desired to play back each moving image, it is not always possible to cope with this. Even if it can be reproduced, since the images are alternately captured, the moving image is reproduced at half the frame rate at the time of photographing, and the smooth movement is impaired.

  The present invention has been made in view of the above problems, and provides a moving image reproduction technique capable of appropriately reproducing a frame image corresponding to a desired shooting condition when frame images having different shooting conditions are sequentially captured and recorded. The purpose is to provide.

  In order to solve the above-mentioned problem, the invention of claim 1 is a moving image reproduction method for reproducing a moving image based on a frame image group recorded in a predetermined recording means, and (a) changed at the time of photographing the frame image group A selection step of selecting one shooting condition from the two or more shooting conditions, and (b) extracting a frame image captured under the first shooting condition from the frame image group and capturing the extracted frame image. A playback step of displaying moving images by displaying on a display means in a sequence order, and the frame image group is an image group captured while sequentially changing the two or more shooting conditions at a timing based on a predetermined frame rate. is there.

  Further, according to a second aspect of the present invention, in the moving image reproduction method according to the first aspect of the invention, in the reproduction step, (b-1) discrimination information corresponding to the first photographing condition is given from the frame image group. In addition, each of the frame images of the frame image group recorded in the predetermined recording unit is provided with the determination information for distinguishing the two or more photographing conditions.

  According to a third aspect of the present invention, in the moving image reproduction method according to the first or second aspect of the present invention, the predetermined frame rate is N times (N Is an integer of 2 or more).

  According to a fourth aspect of the present invention, when executed by a computer that reproduces a moving image based on a frame image group recorded in a predetermined recording means, the computer changes to (a) when the frame image group is shot. A selection step of selecting one shooting condition from two or more shooting conditions; and (b) a time series in which a frame image captured under the first shooting condition is extracted from the frame image group, and the extracted frame image is captured. And a playback step of displaying a moving image by sequentially displaying on the display means, and the frame image group is an image group captured while sequentially changing the two or more shooting conditions at a timing based on a predetermined frame rate. It is a moving picture reproduction program characterized by being.

  Further, the invention of claim 5 is an image pickup apparatus having a display means capable of displaying an image, wherein (a) an image pickup means for sequentially generating frame images relating to a subject, and (b) based on a predetermined frame rate. (C) the two or more shooting conditions; and (c) the two or more shooting conditions, wherein two or more shooting conditions are sequentially changed at the timing, and frame images are sequentially picked up by the image pickup means and recorded as a frame image group on a predetermined recording medium. Selecting means for selecting one shooting condition from (d) extracting a frame image taken under the first shooting condition from the frame image group, and displaying the extracted frame image in time series in which the extracted frame images are taken. And a playback control means for playing back a moving image.

  According to the first to fifth aspects of the present invention, an image is captured under a selected one imaging condition from a group of frame images captured while sequentially changing two or more imaging conditions at a timing based on a predetermined frame rate. The extracted frame images are extracted, and the extracted frame images are displayed on the display means in the time series in which the extracted frame images are picked up to reproduce the moving image. As a result, a frame image corresponding to a desired shooting condition can be appropriately reproduced as a moving image.

  In particular, in the second aspect of the invention, since the frame image to which the discrimination information corresponding to one shooting condition is added is extracted from the frame image group, it is possible to easily extract the frame image having the same shooting condition.

  In the invention of claim 3, since the predetermined frame rate is N times (N is an integer of 2 or more) the frame rate at the time of image reproduction, natural moving image reproduction can be performed.

<First Embodiment>
<Principal configuration of imaging device>
FIG. 1 is a perspective view showing an imaging apparatus 1A according to the first embodiment of the present invention. FIG. 2 is a rear view of the image pickup apparatus 1A. 1 and 2 show three axes of X, Y, and Z that are orthogonal to each other in order to clarify the orientation relationship.

  The imaging apparatus 1A is configured as a digital camera, for example, and a photographing lens 11 and a flash 12 are provided on the front surface of the camera body 10. A C-MOS sensor (hereinafter simply referred to as “CMOS”) 21 as an image pickup device that photoelectrically converts a subject image incident through the shooting lens 11 to generate a color image signal is provided behind the shooting lens 11. It has been.

  The photographing lens 11 includes a zoom lens 111 and a focus lens 112 (see FIG. 3). By driving these lenses in the optical axis direction, zooming and focusing of a subject image formed on the CMOS 21 are performed. Can be realized.

  A shutter button 13 is disposed on the upper surface of the imaging apparatus 1A. The shutter button 13 is used when a user performs a pressing operation when shooting a subject to give a shooting instruction to the imaging apparatus 1A. The shutter button 13 is in a half-pressed state (S1 state) and a fully-pressed state (S2 state). Is configured as a two-stage switch capable of detecting Here, if the fully-pressed state (S2 state) is set while moving image shooting is set as the shooting mode, moving image shooting is performed during the period until the fully-pressed state is reached again.

  A mounting portion 14 for mounting a memory card 9 for recording image data obtained by the main photographing operation accompanying the pressing operation of the shutter button 13 is formed on the side surface portion of the imaging device 1A. Further, a card eject button 15 that is operated when the memory card 9 is ejected from the mounting portion 14 is disposed on the side surface of the imaging apparatus 1A.

  On the back of the imaging device 1A, a liquid crystal display (LCD) 16 that displays a live view display that displays the subject in a moving image mode before the actual shooting, and an image display such as a shot image, a shutter speed and a zoom. And a rear operation unit 17 for changing various setting states of the imaging apparatus 1A.

  The rear operation unit 17 includes a plurality of operation buttons 171 to 173. For example, zoom operation and exposure setting can be performed by operating the operation buttons 171, and moving image shooting mode and moving image reproduction mode can be performed by operating the operation buttons 173. Can be set.

  FIG. 3 is a diagram illustrating functional blocks of the imaging apparatus 1A. Below, the function of each part is demonstrated along the sequence of video recording. In the present embodiment, the Motion JPEG format is used as the moving image format.

  When the main switch is operated and the camera is activated, a subject light image is formed on the CMOS 21 through the zoom lens 111 and the focus lens 112, and frame images of analog signals related to the subject are sequentially generated. The analog signal is converted into a digital signal by A / D conversion in the signal processing unit 22 and is temporarily stored in the memory 23.

  The image data primarily stored in the memory 23 is subjected to image processing such as γ conversion and aperture control in the image processing unit 24, and then subjected to processing for display on the LCD 16, and is displayed on the LCD 16 in a live view.

  The composition of the subject can be confirmed by such a live view display of the subject, and the angle of view can be changed by operating the operation button 171 while visually recognizing the subject image. In this case, when the zoom operation by the operation button 171 is detected by the control unit 20A, the zoom lens 111 is driven to set the angle of view desired by the user. Note that the CMOS 21 of the imaging apparatus 1A can capture an image at 90 fps as described later, but the image is updated once every three frames on the LCD 16 during live view display.

  When the control unit 20A detects that the shutter button 13 is half-pressed (S1), the AE calculation unit 25 calculates an appropriate exposure amount for the entire captured image based on the output from the CMOS 21, and the shutter speed and signal The gain of the amplifier in the processing unit 22 is set.

  When the calculation in the AE calculation unit 26 is completed, the white balance (WB) calculation unit 27 calculates an appropriate WB setting value, and the image processing unit 24 sets R gain and G gain for performing white balance correction. .

  When the calculation in the WB calculation unit 27 is completed, the focus calculation unit 25 calculates an AF evaluation value used in contrast AF based on the output from the CMOS 21, and drives the focus lens 112 based on the calculation result. Is controlled by the control unit 20A to focus on the subject. Specifically, a focus motor (not shown) is driven to detect a lens position where the high frequency component of the image acquired by the CMOS 21 reaches a peak, and the focus lens 112 is moved to this position.

  Next, when the shutter button 13 is fully pressed, moving image shooting starts. During moving image shooting, the image data from the image processing unit 24 is stored in the memory card 9. When the full press is performed again, the moving image shooting is finished. Live view display continues.

  The moving image shooting sequence of the imaging apparatus 1A described above is executed by the control unit 20A controlling each unit in an integrated manner.

  The control unit 20A includes a CPU that functions as a computer, and includes a flash ROM 201 and a RAM 202. The flash ROM 201 stores various control programs for controlling the image pickup apparatus 1A. Among them, for example, when a moving image reproduction program is executed, the images are taken together at a high frame rate of 90 fps. The operation of individually reproducing the types of moving images is performed by the imaging apparatus 1A (detailed later).

  Program data such as a moving image reproduction program recorded on the memory card 9 can be stored in the flash ROM 201 of the control unit 20A. Thereby, the stored program can be reflected in the operation of the imaging apparatus 1A.

  Hereinafter, the moving image shooting operation and the moving image reproduction operation of the imaging apparatus 1A will be described in detail.

<Movie shooting operation>
FIG. 4 is a diagram for explaining a moving image shooting operation and a reproduction operation in the imaging apparatus 1A. 4A to 4D, the horizontal axis represents the time axis.

  In the CMOS 21 of the image pickup apparatus 1A, as shown in FIG. 4A, moving images can be taken at 90 fps, that is, the time interval between frames is about 11.1 ms. That is, the CMOS 21 can be driven at a frame rate three times as high as the display frame rate (30 fps) when displaying a moving image on the LCD 16. The numbers 1, 2, 3,... In FIG. 4 (a) are frame numbers (No) and indicate that the image was taken later as the number increased.

  Even if a video is recorded at such a frame rate, if it is played back at a general frame rate of 30 fps (the time interval between frames is about 33.3 ms), it will be sufficient as a video as far as the human eye can see. In the image pickup apparatus 1A, a moving image recorded at 90 fps is thinned out and reproduced.

  Specifically, as shown in FIG. 4B, in the frame image group (Nos. 1 to 24) shown in FIG. 4A, the frame numbers are 1, 4, 7,..., 3n−. An image of 2 (n is a natural number) is extracted and reproduced as a moving image. In the following description, for convenience of explanation, images with frame numbers 1, 4, 7,... Are referred to as a-series image groups, and are also indicated as a1, a2, a3,.

  Further, as shown in FIG. 4C, in the frame image group (Nos. 1 to 24) shown in FIG. 4A, the frame numbers are 2, 5, 8,..., That is, 3n−1 (n Is extracted as a moving image. In the following, for convenience of explanation, images with frame numbers of 2, 5, 8,... Are referred to as b-series image groups, and are also displayed as b1, b2, b3.

  Further, as shown in FIG. 4D, among the frame image groups (No. 1 to 24) shown in FIG. 4A, the frame numbers are 3, 6, 9,..., That is, 3n (n is a natural number). ) Is extracted and reproduced as a moving image. In the following, for convenience of explanation, images with frame numbers of 3, 6, 9,... Are referred to as c-series image groups, and are also displayed as c1, c2, c3.

  As described above, the image capturing apparatus 1A can simultaneously acquire a group of ac images in one shooting, but can acquire three types of moving images by shooting under different shooting conditions in each of the ac sequences. Is possible. For example, in each of the image series of a to c series, the photographic lens is focused on the main subject (here, the part located in the center of the image), focused slightly forward, focused slightly behind. By shooting while changing to three stages of the in-focus position, three types of in-focus moving images can be acquired. Specifically, frame images are sequentially captured by the CMOS 21 while sequentially changing these three focusing conditions, and are recorded on the memory card (recording medium) 9 as a group of frame images.

  FIG. 5 is a diagram for explaining three types of in-focus states. FIGS. 5A to 5C show scenes in which three automobiles P1 to P3 are traveling, respectively, and the distance from the imaging device 1A increases in the order of the automobiles P3, P2, and P1. It has become.

  In the image shown in FIG. 5A, after the focus calculation unit 25 performs a focus calculation on the automobile P2 of the main subject (focused subject), the focus position is set slightly behind the focus position. This is a photographed image and is focused on the automobile P1. 5A to 5C express that the line is drawn out of focus as the line width for drawing the automobiles P1 to P3 increases.

  The image shown in FIG. 5B is an image taken at this in-focus position after the focus calculation unit 25 performs the focus calculation on the car P2 of the main subject, and is focused on the car P1 in the center of the screen. ing.

  The image shown in FIG. 5C is an image obtained by performing the focus calculation for the automobile P2 as the main subject in the focus calculation unit 25 and then setting the focus position slightly before this focus position. Focusing on the car P3.

  As described above, since the imaging apparatus 1A can shoot in three types of in-focus states, the user cares whether or not the user wants to accurately focus on the vehicle that he / she wants to shoot in the in-focus state during video shooting. You can concentrate on shooting without.

  A specific moving image shooting operation for acquiring moving images (frame image groups) in the above three types of in-focus states will be described below.

  FIG. 6 is a flowchart for explaining the moving image shooting operation in the imaging apparatus 1A. This operation is executed by the control unit 20A.

  First, it is determined whether or not the shutter button 13 has been half-pressed by the user while the moving image shooting mode is set and the preview display is performed on the LCD 16 by operating the operation button 173 (step ST1). If the shutter button 13 is half-pressed, the process proceeds to step ST2. If the shutter button 13 is not half-pressed, step ST1 is repeated.

  In step ST2, the AE calculation unit 26 performs AE calculation to determine an appropriate shutter speed of the CMOS 21 and a gain of the signal processing unit 22.

  In step ST3, the WB calculation unit 27 performs WB calculation to determine appropriate R gain and B gain.

  In step ST4, the focus calculation unit 25 performs focus calculation, and the focus lens 112 is moved to the focus position of the main subject by the above-described contrast AF.

  In step ST5, it is determined whether the shutter button 13 has been fully pressed by the user. If the shutter button 13 is fully pressed, the process proceeds to step ST6. If the shutter button 13 is not fully pressed, the process returns to step ST2.

  In step ST6, the focus position of the focus lens 112 is set to the back side. Specifically, the focus lens 112 is moved in the direction corresponding to the back side from the focus position of the main subject detected in step ST4.

  In step ST7, an a-sequence image as shown in FIG. 5A is taken in the focused state set in step ST6. Here, the image acquired by the CMOS 21 is signal-processed by the signal processing unit 22, temporarily stored in the memory 23, then subjected to image processing by the image processing unit 24 and recorded in the memory card 9.

  In step ST8, the focus lens 112 is set to the in-focus position. Specifically, the focus lens 112 is moved to the focus position of the main subject detected in step ST4.

  In step ST9, a b-series image as shown in FIG. 5B is taken while the main subject is in focus. Here, the image acquired by the CMOS 21 is signal-processed by the signal processing unit 22, temporarily stored in the memory 23, then subjected to image processing by the image processing unit 24 and recorded in the memory card 9.

  In step ST10, the focus position of the focus lens 112 is set to the near side. Specifically, the focus position of the focus lens 112 is moved in the direction corresponding to the near side from the focus position of the main subject detected in step ST4.

  In step ST11, a c-sequence image as shown in FIG. 5C is taken in the in-focus state set in step ST10. Here, the image acquired by the CMOS 21 is signal-processed by the signal processing unit 22, temporarily stored in the memory 23, then subjected to image processing by the image processing unit 24 and recorded in the memory card 9.

  In step ST12, it is determined whether the shutter button 13 is fully pressed again. If the shutter button 13 is fully pressed, the process proceeds to step ST13. If not, the process returns to step ST6 to repeat the photographing operation.

  In step ST13, post-processing is performed. Specifically, the image processing is performed on the image still remaining in the memory 23 by the operations of the above-described steps ST7, ST9, and ST11, an operation of creating a tab to be described later, and recording it on the memory card 9 is performed.

  In step ST14, it is determined whether the post-processing has been completed. Here, when the post-processing is completed, the process returns to step ST1, and when the post-processing is not completed, step ST13 is repeated.

  Through the moving image shooting operation as described above, an image of each frame shown in FIG. 7 can be acquired. That is, the a-sequence images of the frames f1 (a1), f4 (a2), f7 (a3), and f10 (a4) are taken in time series by the operation of step ST7, and the frames f2 (b1), The b-sequence images of f5 (b2), f8 (b3), and f11 (b4) are sequentially taken, and the frames f3 (c1), f6 (c2), f9 (c3), f12 ( The c-series images of c4) are taken sequentially.

  In steps ST6 and ST10 described above, it is not essential to set the main subject in a predetermined amount before and after the in-focus position. For example, the focus calculation for each of the automobile P1 and the automobile P3 shown in FIG. 5 is performed. You may make it focus every time imaging is performed. In this case, focusing accuracy is improved for targets other than the main subject.

  The reproduction operation based on the frame image group photographed as described above will be described below.

<Video playback operation>
FIG. 8 is a diagram showing a data arrangement of frame images recorded on the memory card 9.

  Tag information TG indicating shooting conditions and the like is added to the recorded image data DI of each frame, and under which shooting conditions the image data DI was shot in a part TGp of the tag information TG. That is, a shooting condition tag is provided to indicate in which focusing state the shooting was performed.

  In this way, by adding discrimination information for distinguishing the three shooting conditions to each frame image, it is possible to determine whether the recorded image data corresponds to an image of a series, b series, or c series. Can play.

  FIG. 9 is a flowchart for explaining a moving image reproduction operation in the imaging apparatus 1A. This reproduction operation is performed by executing the moving image reproduction program in the flash ROM 201 by the control unit 20A.

  After the moving image playback mode is set by operating the operation button 173, the three in-focus conditions, that is, the in-focus position, the in-focus position of the main subject, and the in-focus position changed in the above-described moving image shooting operation. Then, it is checked whether one focusing condition that the user wants to reproduce is selected (step ST20). Regarding the selection of the in-focus state, for example, the characters “back side”, “main subject (appropriate)”, and “front side” are displayed on the LCD 16, and any of them can be selected by a user operation on the rear operation unit 17. It has become.

  In step ST21, the counter FCnt is reset, specifically, 1 is substituted into the counter FCnt. The counter FCnt corresponds to the frame No. in each of the above-described series a to c. For example, the counter FCnt = 1 corresponds to each of the frames a1, b1, and c1 (FIG. 7) of the a to c series.

  In step ST22, it is determined whether the current timing is 30 fps. This is an operation necessary to update the display of the frame image at the frame rate timing because the moving image reproduction on the LCD 16 is performed at a frame rate of 30 fps. Here, for example, the clock in the control unit 20A is measured, the operation after step ST23 is performed every 33.3 ms period, and the other time zones are set in a standby state.

  If it is 30 fps timing in step ST22, the process proceeds to step ST23. If it is not 30 fps timing, step ST22 is repeated and the process waits.

  In step ST23, it is determined by the check in step ST20 whether the in-focus moving image set at the in-focus position has been selected by the user. Here, if a moving image focused on the back side of the main subject is selected, the process proceeds to step ST25, and if not selected, the process proceeds to step ST24.

  In step ST24, it is determined by the check in step ST20 whether the in-focus moving image set at the in-focus position of the main subject has been selected by the user. Here, when the moving image focused on the main subject is selected, the process proceeds to step ST26, and when it is not selected, the process proceeds to step ST27.

  In step ST25, an a-series frame image having a frame number corresponding to the current value of the counter FCnt is displayed on the LCD 16.

  In step ST26, a b-series frame image having a frame number corresponding to the current value of the counter FCnt is displayed on the LCD 16.

  In step ST27, a c-series frame image having a frame number corresponding to the current value of the counter FCnt is displayed on the LCD 16.

  In step ST28, the counter FCnt is incremented. That is, the value of the counter FCnt is increased by 1.

  In step ST29, it is determined whether the user ends the reproduction. Specifically, it is determined whether the operation button 173 has been operated by the user to release the moving image playback mode or whether the frame image currently displayed on the LCD 16 is the last frame. If the reproduction is not terminated here, the process returns to step ST22.

  A specific reproduction process by the above moving image reproduction operation will be described below.

  FIG. 10 is a diagram for explaining the reproduction process. Note that the frame images f1 to f12 in this figure correspond to the frame images f1 to f12 at the time of moving image shooting shown in FIG.

  When the user selects the in-focus moving image set at the in-focus position behind the main subject, the a-series moving image is reproduced (step ST25). In this case, as shown in FIG. The frame images f1 (a1), f4 (a2), f7 (a3), and f10 (a4) to which the discrimination information corresponding to the shooting condition at the in-focus position is added in the shooting condition tag TGp are extracted from the frame image group. Then, the images are reproduced and displayed on the LCD 16 in the time series in which the images are taken.

  When a moving image in a focused state set at the in-focus position of the main subject is selected by the user, a b-series moving image is played back (step ST26). In this case, the shooting condition tag shown in FIG. In TGp, frame images f2 (b1), f5 (b2), f8 (b3), and f11 (b4) to which discrimination information corresponding to the imaging condition of the focus position of the main subject is extracted from the frame image group, The images are reproduced and displayed on the LCD 16 in the order of the captured images.

  When the user selects a moving image in a focused state set at the in-focus position before the main subject, a c-series moving image is reproduced (step ST27). In this case, as shown in FIG. The frame images f3 (c1), f6 (c2), f9 (c3), and f12 (c4) to which the discrimination information corresponding to the shooting condition at the in-focus position on the shooting condition tag TGp is extracted from the frame image group. Then, the images are reproduced and displayed on the LCD 16 in the time series in which the images are taken.

  Through the above operation of the image pickup apparatus 1A, the frame images corresponding to the in-focus state selected by the user are extracted from the group of frame images picked up and recorded while changing the in-focus state at the high-speed frame rate and reproduced in time series. Therefore, the frame image corresponding to the focusing condition desired by the user can be appropriately reproduced as a moving image.

Second Embodiment
An imaging apparatus 1B according to the second embodiment of the present invention has a configuration similar to that of the first embodiment shown in FIGS. 1 to 3, but the configuration of the control unit is different.

  That is, in the control unit 20B of the imaging apparatus 1B, a control program for performing a moving image shooting operation and an image shooting operation described below is stored in the ROM 201.

<Movie shooting operation>
In the imaging apparatus 1B, similarly to the imaging apparatus 1A of the first embodiment, 90 fps moving image shooting shown in FIG. 4 can be performed, and three types of moving images a to c can be acquired by one shooting. In the imaging apparatus 1B, the focusing condition is not changed to three stages as in the first embodiment, but the exposure condition is changed to three stages.

  FIG. 11 is a diagram for explaining three types of exposure states. In each of the images shown in FIGS. 11A to 11C, the person SB is photographed in a backlight state.

  The image shown in FIG. 11 (a) is an image taken after the AE calculation unit 26 performs the AE calculation and setting the entire image from the appropriate exposure state to the under-feeling.

  The image shown in FIG. 11 (b) is an image that was captured after the AE calculation unit 26 performed AE calculation and set to an appropriate exposure state (reference parameter) for the entire image.

  The image shown in FIG. 11 (c) is an image that was shot after the AE calculation unit 26 performed the AE calculation, and the entire image was set to an overexposed state from an appropriate exposure state. Note that, since the photographing is performed in the backlight, the image shown in FIG. 11C taken with the overexposure to the person SB rather than the image shown in FIG. On the other hand, the exposure is appropriate.

  As described above, since the imaging apparatus 1B can shoot in three types of exposure states, the user can concentrate on shooting without worrying about whether or not the person SB is properly exposed during moving image shooting.

  As for the moving image shooting operation for acquiring the above three types of exposed moving images, the same operation as in the first embodiment is performed.

  As a result, frame images are sequentially acquired as images g1, g2, g3,... G12 shown in FIG. These frame images include under-exposure frames g1 (a1), g4 (a2), g7 (a3), and g10 (a4), a series of images, and an appropriate exposure frame g2 (b1), b series images of g5 (b2), g8 (b3), and g11 (b4) and c series images of frames g3 (c1), g6 (c2), g9 (c3), and g12 (c4) that are overexposed. And are included.

  The reproduction operation of the moving image shot as described above will be described below.

<Video playback operation>
FIG. 13 is a flowchart for explaining the moving image reproduction operation in the imaging apparatus 1B. This operation is performed by executing a moving image reproduction program in the flash ROM 201 by the control unit 20B.

  In steps ST30 to ST32, operations similar to those in steps ST20 to ST22 shown in the flowchart of FIG. 9 are performed.

  In step ST33, it is determined by the check in step ST30 whether an underexposed moving image has been selected by the user. If an underexposed video is selected, the process proceeds to step ST35, and if not selected, the process proceeds to step ST34.

  In step ST34, it is determined by the check in step ST30 whether a moving image with proper exposure has been selected by the user. Here, when a moving image suitable for exposure is selected, the process proceeds to step ST36, and when it is not selected, the process proceeds to step ST37.

  In steps ST35 to ST39, operations similar to those in steps ST25 to ST29 shown in the flowchart of FIG. 9 are performed.

  A specific reproduction process by the above moving image reproduction operation will be described with reference to FIG.

  When an underexposed video is selected by the user, an a-series video is played (step ST35). In this case, determination corresponding to the underexposed shooting condition in the shooting condition tag TGp shown in FIG. The frame images g1 (a1), g4 (a2), g7 (a3), and g10 (a4) to which the information is added are extracted from the frame image group, and are reproduced and displayed on the LCD 16 in the order of the captured time series.

  When the user selects a movie with proper exposure, a b-series movie is played (step ST36). In this case, the shooting condition tag TGp shown in FIG. The frame images g2 (b1), g5 (b2), g8 (b3), and g11 (b4) to which the information is added are extracted from the frame image group, and are reproduced and displayed on the LCD 16 in the time series in which the images were taken.

  When an overexposed video is selected by the user, a c-series video is played back (step ST37). In this case, determination corresponding to the overexposed shooting condition in the shooting condition tag TGp shown in FIG. The frame images g3 (c1), g6 (c2), g9 (c3), and g12 (c4) to which the information is added are extracted from the frame image group, and are reproduced and displayed on the LCD 16 in the time series in which the images were taken.

  By the operation of the imaging apparatus 1B described above, a frame image corresponding to the exposure condition selected by the user is extracted from the group of frame images captured and recorded while changing the exposure condition at a high frame rate, and is reproduced in time series. The frame image corresponding to the exposure condition desired by the user can be appropriately reproduced as a moving image.

<Third Embodiment>
An imaging apparatus 1C according to the third embodiment of the present invention has a configuration similar to that of the first embodiment shown in FIGS. 1 to 3, but the configuration of the control unit is different.

  That is, in the control unit 20C of the imaging apparatus 1C, a control program for performing a moving image shooting operation and an image shooting operation described below is stored in the ROM 201.

<Movie shooting operation>
In the imaging apparatus 1C, similarly to the imaging apparatus 1A of the first embodiment, 90 fps moving image shooting shown in FIG. 4 can be performed, and three types of moving images a to c can be acquired by one shooting. In the imaging apparatus 1C, the zoom condition (the focal length condition regarding the photographing lens 11) is changed to three stages without changing the focusing condition to three stages as in the first embodiment.

  FIG. 14 is a diagram for explaining three types of zoom states. In each of the images shown in FIGS. 14A to 14C, a person OB is captured.

  The image shown in FIG. 14A is an image captured by setting the telephoto side somewhat from the zoom value (focal length) set by the user.

  The image shown in FIG. 14B is an image taken at a zoom value set by the user.

  The image shown in FIG. 14C is an image captured by setting the zoom value slightly wider than the zoom value set by the user.

  As described above, since the imaging apparatus 1C can shoot in three types of zoom states, the user can concentrate on shooting without worrying about the angle of view during moving image shooting.

  The moving image shooting operation for acquiring moving images in the three types of zoom states as described above is performed in the same manner as in the first embodiment.

  As a result, frame images are sequentially acquired as images h1, h2, h3,... H12 shown in FIG. These frame images have the a-series images of frames h1 (a1), h4 (a2), h7 (a3), and h10 (a4) that are in a tele zoom state, and a user-specified zoom state. B-series images of frames h2 (b1), h5 (b2), h8 (b3), h11 (b4), and frames h3 (c1), h6 (c2), h9 (c3), which are in the zoom state on the wide side, and a c-series image of h12 (c4).

  The reproduction operation of the moving image shot as described above will be described below.

<Video playback operation>
FIG. 16 is a flowchart for explaining the moving image reproduction operation in the imaging apparatus 1C. This operation is performed by executing a moving image reproduction program in the flash ROM 201 by the control unit 20C.

  In steps ST40 to ST42, operations similar to those in steps ST20 to ST22 shown in the flowchart of FIG. 9 are performed.

  In step ST43, it is determined whether the moving image in the tele zoom state has been selected by the user through the check in step ST40. Here, when the moving image in the tele zoom state is selected, the process proceeds to step ST45, and when it is not selected, the process proceeds to step ST44.

  In step ST44, it is determined whether the moving image in the zoom state designated by the user is selected by the check in step ST40. Here, when a moving image in a zoom state designated by the user is selected, the process proceeds to step ST46, and when not selected, the process proceeds to step ST47.

  In steps ST45 to ST49, operations similar to those in steps ST25 to ST29 shown in the flowchart of FIG. 9 are performed.

  A specific reproduction process by the above moving image reproduction operation will be described with reference to FIG.

  When the user selects a video in the zoom state on the tele side, an a-series video is played (step ST45). In this case, the shooting condition tag TGp shown in FIG. The frame images h1 (a1), h4 (a2), h7 (a3), and h10 (a4) to which the corresponding discrimination information is added are extracted from the frame image group, and are reproduced and displayed on the LCD 16 in the order of the captured time series.

  When a user-selected zoomed moving image is selected by the user, a b-series moving image is played (step ST46). In this case, the shooting condition tag TGp shown in FIG. The frame images h2 (b1), h5 (b2), h8 (b3), and h11 (b4) to which the corresponding discrimination information is assigned are extracted from the frame image group and are reproduced and displayed on the LCD 16 in the order of the captured time series.

  When the user selects a wide-side zoom movie, the c-series movie is played (step ST47). In this case, the wide-side shooting condition is set in the shooting condition tag TGp shown in FIG. The frame images h3 (c1), h6 (c2), h9 (c3), and h12 (c4) to which the corresponding discrimination information is assigned are extracted from the frame image group, and are reproduced and displayed on the LCD 16 in the order of the captured images.

  Through the operation of the imaging apparatus 1A described above, a frame image corresponding to the zoom condition selected by the user is extracted from a group of frame images captured and recorded while changing the zoom condition (focal length condition) at a high frame rate. Since the images are reproduced in time series order, the frame images corresponding to the zoom conditions desired by the user can be appropriately reproduced as moving images.

<Fourth embodiment>
An imaging apparatus 1D according to the fourth embodiment of the present invention has a configuration similar to that of the first embodiment shown in FIGS. 1 to 3, but the configuration of the control unit is different.

  That is, in the control unit 20D of the imaging apparatus 1D, a control program for performing a moving image shooting operation and an image shooting operation described below is stored in the ROM 201.

<Movie shooting operation>
In the imaging device 1D, similarly to the imaging device 1A of the first embodiment, 90 fps moving image shooting shown in FIG. 4 can be performed, and three types of moving images a to c can be acquired by one shooting. In the imaging apparatus 1D, the focus condition is not changed to three stages as in the first embodiment, but the white balance (WB) condition is changed to three stages.

  FIG. 17 is a diagram for explaining three types of WB states. In each of the images shown in FIGS. 17A to 17C, an evening scene is captured.

  The image shown in FIG. 17 (a) is an image taken after setting the WB calculation value to be reddish from an appropriate WB control value after the WB calculation unit 27 performs the WB calculation. In this case, since the WB control value is set red, an image showing a vivid evening scene can be acquired.

  The image shown in FIG. 17B is an image that is captured after the WB calculation unit 27 performs WB calculation and is set to an appropriate WB control value (reference parameter). In this case, an image that is shot with an appropriate value based on the WB calculation but is somewhat unsatisfactory as an evening scene is acquired.

  The image shown in FIG. 17 (c) is an image that is captured after the WB calculation unit 27 performs the WB calculation and is set to be more bluish than the appropriate WB control value. In this case, since the WB control value is set to be bluish, an image that is somewhat lacking in sunset scenery is acquired.

  As described above, since the imaging apparatus 1D can shoot in three types of WB states, the user can concentrate on shooting without worrying about whether or not the white balance is intended for moving image shooting.

  The moving image shooting operation for acquiring moving images in the three types of WB states as described above is performed in the same manner as in the first embodiment.

  As a result, frame images are sequentially acquired as images k1, k2, k3,... K12 shown in FIG. These frame images include a-series images of frames k1 (a1), k4 (a2), k7 (a3), and k10 (a4) that are in a red WB state, and frames that are in an appropriate WB state. b-series images of k2 (b1), k5 (b2), k8 (b3), and k11 (b4), and frames k3 (c1), k6 (c2), k9 (c3), and k12 in a bluish WB state (c4) c-series images are included.

  The reproduction operation of the moving image shot as described above will be described below.

<Video playback operation>
FIG. 19 is a flowchart for describing a moving image reproduction operation in the imaging apparatus 1D. This operation is performed by executing a moving image reproduction program in the flash ROM 201 by the control unit 20D.

  In steps ST50 to ST52, operations similar to those in steps ST20 to ST22 shown in the flowchart of FIG. 9 are performed.

  In step ST53, it is determined by the check in step ST50 whether a moving image in a reddish WB state has been selected by the user. Here, if a reddish WB moving image is selected, the process proceeds to step ST55, and if not selected, the process proceeds to step ST54.

  In step ST54, it is determined by the check in step ST50 whether or not a moving image in an appropriate WB state has been selected by the user. Here, when a moving image in an appropriate WB state is selected, the process proceeds to step ST56, and when not selected, the process proceeds to step ST57.

  In steps ST55 to ST59, operations similar to those in steps ST25 to ST29 shown in the flowchart of FIG. 9 are performed.

  A specific reproduction process by the above moving image reproduction operation will be described with reference to FIG.

  When the user selects a reddish WB movie, the a-series movie is played (step ST55). In this case, the shooting condition tag TGp shown in FIG. The frame images k1 (a1), k4 (a2), k7 (a3), and k10 (a4) to which the corresponding discrimination information is assigned are extracted from the frame image group and are reproduced and displayed on the LCD 16 in the order of the captured time series.

  When the user selects a moving image in the proper WB state, a b-sequence moving image is played (step ST56). In this case, the shooting condition tag TGp shown in FIG. The frame images k2 (b1), k5 (b2), k8 (b3), and k11 (b4) to which the discriminating information is added are extracted from the frame image group and are reproduced and displayed on the LCD 16 in the order of the captured time series.

  When a user selects a bluish WB moving image, a c-series moving image is played (step ST57). In this case, the bluish shooting condition is set in the shooting condition tag TGp shown in FIG. The frame images k3 (c1), k6 (c2), k9 (c3), and k12 (c4) to which the corresponding discrimination information is assigned are extracted from the frame image group, and are reproduced and displayed on the LCD 16 in the order of the captured time series.

  In order to extract the frame images corresponding to the WB condition selected by the user from the group of frame images picked up and recorded while changing the WB condition at the high-speed frame rate and to reproduce them in time series by the operation of the imaging apparatus 1D described above. The frame image corresponding to the WB condition desired by the user can be appropriately reproduced as a moving image.

<Modification>
In each of the above embodiments, it is not essential to use an imaging device as a moving image playback device, and the following personal computer (hereinafter referred to as “personal computer”) may be used.

  FIG. 20 is a diagram for explaining a main configuration of the personal computer 3.

  The personal computer 3 includes a processing unit 30 having a box-like shape, an operation unit 31 having a mouse 311 and a keyboard 312, and a display unit 32 composed of, for example, a CRT. On the front face of the processing unit 30, a drive 301 for mounting an optical disk and a drive 302 for mounting a memory card 9 are provided.

  In such a personal computer 3, a memory card 9 on which a frame image group photographed at a high-speed frame rate of 90 fps in the imaging apparatus 1A is mounted in the drive 302, and a moving image reproduction operation in the imaging apparatus 1A (see FIG. 9). ) Is performed on the personal computer 3, the moving images in the three in-focus states described above are individually reproduced on the display unit 32.

  About this reproduction | regeneration operation | movement, the moving image reproduction | regeneration program stored in the hard disk in the process part 30 will be implemented by running with CPU. The hard disk can store the data of the moving image reproduction program recorded on the optical disk via the drive 301, and the stored program can be reflected in the operation of the personal computer 3.

  In each of the above embodiments, it is essential to change one of the focusing condition, the exposure condition, the zoom (focal length related to the imaging optical system) condition, and the white balance condition as the shooting condition. Alternatively, a plurality of conditions may be combined and changed from these four types of shooting conditions.

  In each of the above embodiments, it is not essential to use a CMOS as an image sensor, and a CCD may be used.

1 is a perspective view showing an imaging apparatus 1A according to a first embodiment of the present invention. It is a rear view of imaging device 1A. It is a figure which shows the functional block of 1 A of imaging devices. It is a figure for demonstrating the video recording operation | movement and reproduction | regeneration operation | movement in 1 A of imaging devices. It is a figure for demonstrating three types of focusing states. It is a flowchart explaining the moving image shooting operation | movement in 1 A of imaging devices. It is a figure for demonstrating the frame image acquired by video recording. 4 is a diagram showing a data arrangement of frame images recorded on a memory card 9. FIG. It is a flowchart explaining the moving image reproduction operation | movement in 1 A of imaging devices. It is a figure for demonstrating reproduction | regeneration processing. It is a figure for demonstrating three types of exposure states in the imaging device 1B which concerns on 2nd Embodiment of this invention. It is a figure for demonstrating the frame image acquired by video recording. It is a flowchart explaining the moving image reproduction operation | movement in the imaging device 1B. It is a figure for demonstrating three types of zoom states in 1 C of imaging devices which concern on 3rd Embodiment of this invention. It is a figure for demonstrating the frame image acquired by video recording. It is a flowchart explaining the moving image reproduction operation | movement in 1 C of imaging devices. It is a figure for demonstrating three types of WB states in the imaging device 1D which concerns on 4th Embodiment of this invention. It is a figure for demonstrating the frame image acquired by video recording. It is a flowchart explaining the moving image reproduction operation | movement in imaging device 1D. It is a figure for demonstrating the principal part structure of the personal computer 3 which concerns on the modification of this invention.

Explanation of symbols

1A to 1D Imaging device 9 Memory card 16 Liquid crystal display (LCD)
20A-20D controller 21 CMOS
22 signal processing unit 23 memory 24 image processing unit 25 focusing calculation unit 26 AE calculation unit 27 WB calculation unit 111 zoom lens 112 focus lens 171 to 173 operation button 201 flash ROM
a1-a4 a-sequence image b1-b4 b-sequence image c1-c4 c-sequence image f1-f12, g1-g12, h1-h12, k1-k12 frame image TGp shooting condition tag

Claims (5)

A moving image reproduction method for performing moving image reproduction based on a frame image group recorded in a predetermined recording means,
(a) a selection step of selecting one shooting condition from two or more shooting conditions changed at the time of shooting the frame image group;
(b) a reproduction step of extracting a frame image captured under the one shooting condition from the frame image group, displaying the extracted frame image on a display unit in time-series order, and reproducing a moving image;
With
The moving image reproducing method, wherein the frame image group is an image group captured while sequentially changing the two or more shooting conditions at a timing based on a predetermined frame rate. The video playback method according to claim 1,
The regeneration step includes
(b-1) an extraction step of extracting a frame image to which discrimination information corresponding to the one photographing condition is added from the frame image group;
Have
The moving image reproduction method according to claim 1, wherein the discrimination information for distinguishing the two or more shooting conditions is assigned to each frame image of the frame image group recorded in the predetermined recording unit. In the moving image reproducing method according to claim 1 or 2,
The moving image reproduction method according to claim 1, wherein the predetermined frame rate is a frame rate N times (N is an integer of 2 or more) a frame rate at the time of moving image reproduction in the reproduction step. By being executed by a computer that reproduces a moving image based on a group of frame images recorded in a predetermined recording means,
In the computer,
(a) a selection step of selecting one shooting condition from two or more shooting conditions changed at the time of shooting the frame image group;
(b) a reproduction step of extracting a frame image captured under the one shooting condition from the frame image group, displaying the extracted frame image on a display unit in time-series order, and reproducing a moving image;
And execute
The moving image reproduction program characterized in that the frame image group is an image group captured while sequentially changing the two or more shooting conditions at a timing based on a predetermined frame rate. An imaging apparatus having display means capable of displaying an image,
(a) imaging means for sequentially generating frame images related to the subject;
(b) a shooting control unit that sequentially captures frame images by the imaging unit while sequentially changing two or more shooting conditions at a timing based on a predetermined frame rate, and records the frame images in a predetermined recording medium;
(c) selection means for selecting one shooting condition from the two or more shooting conditions;
(d) a reproduction control unit that extracts a frame image captured under the one shooting condition from the frame image group, displays the extracted frame image in the time series in which the extracted frame image is captured, and reproduces a moving image;
An imaging apparatus comprising:

Images