JP2007325152A - Imaging device, and program thereof - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging device where photographing content until then with respect to a series of animation photographed presently during photographing the series of the animation, and to provide a program thereof. <P>SOLUTION: When photographing of the animation is started during an animation photographing mode, still image photographing processing is performed (S3) and thereafter, animation photographing and recording processing and display processing of animation data obtained by the processing are started, and processing of displaying still image data obtained at a step S3 is started (S4). Next, it is judged whether a shutter button is pressed (S5). When the shutter button is pressed, the still image photographing processing is performed (S6), and processing of adding the newly photographed still image data to the animation data obtained by the animation photographing and recording processing and the already displayed still image data and displaying it is started. That is, whenever still image photographing is carried out during animation photographing, displayed still images are increased. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an imaging apparatus and a program thereof, and more particularly to an imaging apparatus having a moving image shooting function and a program thereof.

  In recent years, the video shooting function has been improved, and a video shooting function has been introduced that enables still image shooting during video shooting. Along with this, digital cameras with various functions have appeared. For example, there is a camera that can capture still images using all CCD output pixels during moving image shooting by an imaging device using an interlaced CCD by processing moving images and still images in a time-sharing manner (Patent Document 1). .

JP Patent Publication No. 2005-311572

However, conventional moving image shooting has the following problems.
For example, during a series of movie shooting, it is not possible to check what movie has been shot so far, and there is a problem that if you check this, you must stop shooting the movie once .

  Therefore, the present invention has been made in view of such conventional problems, and an imaging apparatus capable of confirming the contents of the current shooting of a series of moving pictures that have been shot during the series of moving pictures, and its The purpose is to provide a program.

In order to achieve the above object, an image pickup apparatus according to the first aspect of the present invention includes an image pickup means for picking up an image of a subject,
Moving image shooting control means for shooting a moving image by the imaging means;
Instruction means for instructing a predetermined timing;
During the series of moving image shooting by the moving image shooting control means, the frame data taken by the moving image is sequentially displayed as a moving image in the first display area of the display means, and the timing is indicated each time the instruction means is instructed. A first display control means for adding a still image based on the image data obtained by the imaging means and continuously displaying it in the second display area of the display means;
It is provided with.

Further, for example, as described in claim 2, when the timing is instructed by the instructing unit, the image capturing unit includes a still image capturing control unit that captures a still image of a subject,
The first display control means includes
Still images based on still image data captured by the still image capturing control unit may be continuously displayed in the second display area of the display unit.

For example, as described in claim 3, the moving image shooting control unit includes:
The moving image shooting may be temporarily interrupted when the timing is instructed by the instruction unit, and the moving image shooting may be resumed when the still image shooting control unit finishes shooting the still image.

For example, as described in claim 4, when the timing is instructed by the instruction unit, the frame data captured at that time is obtained from the frame data captured by the moving image capturing control unit. Frame data extracting means for extracting,
The first display control means includes
Still images based on the frame data extracted by the frame data extraction means may be continuously displayed in the second display area of the display means.

For example, as described in claim 5, the instruction unit includes
You may make it instruct | indicate the timing arbitrarily designated by the user.

For example, as described in claim 6, the instruction unit includes
You may make it instruct | indicate a timing for every predetermined timing or a predetermined time interval.

  Further, for example, as described in claim 7, a recording control unit that records the moving image data obtained by the moving image photographing control unit in the recording unit may be provided.

For example, as described in claim 8, the recording control unit includes:
The image data obtained by the imaging unit at the timing instructed by the instruction unit may be recorded in association with the moving image data obtained by the moving image shooting control unit.

Further, for example, as described in claim 9, selection means for selecting arbitrary moving picture data from among moving picture data recorded in the recording means;
The moving image data selected by the selection unit is reproduced and displayed in the third display area of the display unit, and the image data captured by the imaging unit at the timing instructed by the instruction unit during shooting of the moving image data is displayed. Second display control means for reproducing and displaying a still image in the fourth display area of the display means;
Designation means for designating an arbitrary still image among the still images reproduced and displayed in the fourth display area of the display means by the second display control means, the second display control means,
When any of the still images being reproduced and displayed is designated in the fourth display area of the display means by the designation means, the moving image data selected by the selection means from the frame corresponding to the designated still image May be reproduced and displayed in the third display area of the display means.

Further, for example, as described in claim 10, selection means for selecting arbitrary moving picture data from among moving picture data recorded in the recording means;
The moving image data selected by the selection unit is reproduced and displayed in the third display area of the display unit, and the image data captured by the imaging unit at the timing instructed by the instruction unit during shooting of the moving image data is displayed. Second display control means for reproducing and displaying a still image in the fourth display area of the display means;
As an editing point, designation means for designating an arbitrary still image among the still images reproduced and displayed in the fourth display area of the display means by the second display control means;
Movie editing means for editing the movie data selected by the selection means based on the editing point specified by the specification means;
You may make it provide.

For example, as described in claim 11, the moving image editing means includes:
The moving image data selected by the selecting unit is selected by the selecting unit by deleting the moving image data before or after the frame data corresponding to the still image that is the editing point specified by the specifying unit. You may make it edit the moving image data.

Further, for example, as described in claim 12, the specifying means includes:
Specify two still images as edit points,
The moving image editing means includes
Of the moving image data selected by the selection unit, the moving image data between the frame data corresponding to the two still images that are the editing points specified by the specifying unit is deleted or the two still images that are the editing points. You may make it edit the moving image data selected by the said selection means by deleting moving image data other than between corresponding frame data.

To achieve the above object, a program according to a thirteenth aspect of the present invention is an image processing for imaging a subject;
A moving image shooting process for shooting a moving image by the imaging process;
An instruction process for instructing a predetermined timing;
During the series of moving image shootings by the moving image shooting process, the frame data captured by the moving images is sequentially displayed in the first display area of the display means, and at each timing when the timing is instructed by the instruction process. A display process of adding a still image based on the image data obtained by the imaging process and continuously displaying it on the second display area of the display means;
And each of the above processes is executed by a computer.

  According to the present invention, in a series of moving image shooting, frames sequentially shot during moving image shooting are displayed, and image data captured at an instructed timing is displayed as a still image. You can easily check what kind of video you have been shooting until then.

Hereinafter, the present embodiment will be described in detail with reference to the drawings as an example in which the imaging apparatus of the present invention is applied to a digital camera.
[First embodiment]

A. Configuration of Digital Camera FIG. 1 is a block diagram showing a schematic electrical configuration of a digital camera 1 that implements the moving image processing apparatus of the present invention.
The digital camera 1 includes a photographing lens 2, a lens driving block 3, an aperture 4, a CCD 5, a driver 6, a TG (timing generator) 7, a unit circuit 8, an image generation unit 9, a CPU 10, a key input unit 11, a memory 12, a DRAM 13, A flash memory 14, an image display unit 15, and a bus 16 are provided.

  The taking lens 2 includes a focus lens 2a, a zoom lens 2b, and the like that are composed of a plurality of lens groups. A lens driving block 3 is connected to the photographing lens 2. The lens driving block 3 includes a focus motor and a zoom motor that drive the focus lens 2a and the zoom lens 2b in the optical axis direction, respectively, and a focus motor driver that drives the focus motor and the zoom motor in accordance with a control signal sent from the CPU 9. And a zoom motor driver (not shown).

The diaphragm 4 includes a drive circuit (not shown), and the drive circuit operates the diaphragm 4 in accordance with a control signal sent from the CPU 10.
The aperture is a mechanism that controls the amount of light that enters from the photographic lens 2.

  The CCD 5 is driven by the driver 6 and photoelectrically converts the intensity of light of each color of the RGB value of the subject image for every fixed period and outputs it to the unit circuit 8 as an imaging signal. The operation timing of the driver 6 and the unit circuit 8 is controlled by the CPU 10 via the TG 7. The CCD 5 has a Bayer color filter and also functions as an electronic shutter. The shutter speed of the electronic shutter is controlled by the CPU 10 via the driver 6 and TG7.

  A TG 7 is connected to the unit circuit 8, a CDS (Correlated Double Sampling) circuit that holds the imaged signal output from the CCD 5 by correlated double sampling, and an AGC that performs automatic gain adjustment of the imaged signal after the sampling. An (Automatic Gain Control) circuit and an A / D converter that converts an analog image pickup signal after the automatic gain adjustment into a digital signal, the image pickup signal output from the CCD 5 passes through the unit circuit 8 as a digital signal. It is sent to the image generator 9.

  The image generation unit 9 performs processing such as γ correction processing and white balance processing on the image data sent from the unit circuit 8, generates a luminance color difference signal (YUV data), and generates the generated luminance color difference. The image data of the signal is sent to the CPU 10. That is, the image generation unit 9 performs image processing on the image data output from the CCD 5.

The CPU 10 has a function of performing compression / decompression processing (for example, compression / decompression of JPEG format, MPEG format), AF processing, and AE processing of the image data sent from the image generation unit 9, and the digital camera 1. It is a one-chip microcomputer that controls each part.
In particular, the CPU 10 has a function of performing moving image shooting processing and still image shooting processing during moving image shooting, displays a moving image shot by moving image shooting on the image display unit 14, and obtains a still image obtained during moving image shooting. Also has a function of displaying together. In addition, during playback and editing of a moving image, a moving image is displayed and a still image associated with the moving image is also displayed.

The key input unit 11 includes a plurality of operation keys such as a shutter button, a recording button, a mode key, a set key, and a cross key, and outputs an operation signal corresponding to a user key operation to the CPU 10.
The memory 12 stores a control program and necessary data necessary for the CPU 10 to implement the present invention, and the CPU 10 operates according to the program.

The DRAM 13 is used as a buffer memory for temporarily storing image data sent to the CPU 10 after being imaged by the CCD 5 and also as a working memory for the CPU 10.
The flash memory 14 is a recording medium that stores compressed image data.

  The image display unit 15 includes a color LCD and a driving circuit thereof, and displays a subject imaged by the CCD 5 as a through image when in a shooting standby state, and displays a moving image of the subject imaged by the CCD 5 even during moving image shooting. Display. If still image shooting processing is performed during moving image shooting, the still image shot with the moving image is displayed.

B. Operation of Digital Camera 1 The operation of the digital camera 1 in the embodiment will be described with reference to the flowchart of FIG.

When the moving image shooting mode is set by the operation of the user's mode key, the CPU 10 starts image pickup by the CCD 5 and displays the image data of the luminance color difference signal picked up and generated by the image generation unit 9 on the image display unit 15. That is, so-called through image display is started (step S1).
Next, the CPU 10 determines whether or not moving image shooting has been started (step S2). This determination is made based on whether or not an operation signal corresponding to pressing of the recording button has been sent from the key input unit 11.

  If it is determined in step S2 that moving image shooting has started, the CPU 10 performs still image shooting processing (step S3). That is, the luminance signal generated by the image generation unit 8 is read by causing the CCD 4 to sequentially output the pixel signal of the even line and the pixel signal of the odd line in one screen at a relatively long output timing to read the image data for all pixels. The image data (still image data) of the color difference signal is stored in the buffer memory (DRAM 13).

  Next, the CPU 10 starts moving image recording / recording processing and display processing (step S4). In other words, the frame data sequentially captured at a predetermined frame rate is compressed and recorded in the flash memory 14, and the captured frame data (recorded frame data) is displayed on the image display unit 15 (photographed). Video display processing).

  At this time, the image display unit 15 is divided into a region for displaying a moving image (first display region) and a region for displaying a plurality of still images (second display region). The process of displaying the obtained moving image and displaying the still image taken in step S3 together in the area where the still image is displayed is started. As the still image to be displayed, still image data obtained by still image shooting processing may be displayed, or thumbnail image data generated based on the still image data may be displayed. The thumbnail image data is image data obtained by reducing the image size of captured still image data, and the data amount is also reduced. The generated thumbnail image data is also stored in the buffer memory, and may be recorded in association with the still image data that has been generated.

FIG. 3A is a diagram illustrating a state of the screen of the image display unit 15 after starting the moving image shooting recording process / display process.
In FIG. 3A, the area 20 where a large image is displayed is an area for displaying a moving image (first display area), and the L-shaped area 21 displays a plurality of still images. This is the area (second display area) to be made.
As shown in FIG. 3A, a moving image obtained by the current moving image shooting / recording process is displayed in this area 20, and a still image shot immediately after the start of moving image shooting is displayed on the area 21. Recognize.

Next, the CPU 10 determines whether or not the shutter button has been pressed (step S5). This determination is made based on whether or not an operation signal corresponding to pressing of the shutter button is sent from the key input unit 11.
If it is determined in step S5 that the shutter button has been pressed, the CPU 10 performs still image shooting processing (step S6). The still image shooting process at this time is performed while continuing the moving image shooting and recording process. When performing still image shooting processing, the moving image shooting / recording processing may be temporarily interrupted, and when the still image shooting processing ends, the moving image shooting / recording processing may be resumed.

Next, the CPU 10 starts additional display of the photographed still image (step S7), and proceeds to step S8. This additional display means that a newly shot still image is added and displayed in addition to the already displayed still image.
When a new still image is shot, the still image already obtained by the still image shooting process is displayed in addition to the movie shot by the movie shooting and recording process, and a new still image shooting process is performed. Then, a still image newly obtained by adding to the moving image and the still image already displayed is displayed. As the still image to be displayed, still image data obtained by still image shooting processing may be displayed, or thumbnail image data generated based on the still image data may be displayed. The captured still image has a function as an index of the content of the moving image.

FIG. 3B shows the state of the screen displayed on the image display unit 15 at this time.
As can be seen from FIG. 3 (b), the still image taken on the second image is taken around the area where the moving image obtained by the current moving image recording process is displayed and on the first image. Appears below the still image. When the third still image shooting process is performed, the obtained third still image is displayed below the second still image.

As described above, when still image shooting is performed during moving image shooting, the still images shot in order so as to be L-shaped around the area where the moving image obtained by the moving image shooting and recording process is displayed. Will be displayed, and the number of displayed still images will increase. In other words, when still image shooting is performed during movie shooting, a newly shot still image is displayed in addition to the movie obtained by shooting and the displayed still image (still image shot in the past). To go.
As a result, the order in which the still images were taken and the contents of the moving images being captured by the current moving image recording process are known in time series.

  In the present embodiment, the still images displayed during moving image shooting are sequentially displayed in an L shape, but may be displayed in other forms (for example, an inverted L shape). Or a square shape that surrounds the displayed video). In addition, the image display unit 15 is divided into an area for displaying a moving image and an area for displaying a still image. The moving image obtained by the moving image recording process is displayed on the area for displaying a moving image, and the area for displaying a still image is displayed. The still images obtained by the still image shooting process are sequentially displayed. However, the moving image obtained by the moving image shooting and recording process is displayed on the entire surface of the image display unit 15 and obtained by the still image shooting process. You may make it display a still image on the displayed moving image smallly. In short, any mode may be used as long as the moving image currently being captured can be understood, and the shooting order of the captured still images and the past contents of the moving image being captured by viewing the still images can be understood.

On the other hand, if it is determined in step S5 that the shutter button has not been pressed, the process proceeds directly to step S8.
In step S8, the CPU 10 determines whether or not to finish moving image shooting. This determination is made based on whether or not an operation signal corresponding to pressing of the recording button has been sent from the key input unit 11. That is, moving image shooting is started by pressing the recording button, and moving image shooting is ended when the recording button is pressed again.

If it is determined in step S8 that moving image shooting is not to be ended, the process returns to step S5. If it is determined that moving image shooting is to be ended, a moving image file is generated based on the frame data recorded by the moving image shooting and recording process and stored in the buffer memory. A still image file is generated based on each still image data and recorded in the flash memory 14 (step S9).
Further, the generated moving image file and still image file are recorded in association with each other. In this video file and still image file, video thumbnail images and still image thumbnail images are also recorded. In still image files, still images taken at any position and timing of the video are recorded. Information indicating whether or not there is also recorded.

Next, the CPU 10 determines whether or not to end the moving image shooting mode (step S10). This determination is made to end the moving image shooting mode when another mode such as a playback mode is set by the user operating the mode key or when the power of the digital camera 1 is turned off.
If it is determined in step S10 that the moving image shooting mode is not terminated, the process returns to step S1.

  When the next series of movie shooting is performed (when a series of movie shooting is completed and a new series of movie shooting is performed), the still image data shot in the previous series of movie shooting is reset, and this time A still image taken during the series of moving image shooting is newly displayed together with the moving image. In other words, when a new series of movie shooting is performed, the still image shot during the previous movie shooting is not displayed, and the still image shot during the new movie shooting is displayed together with the movie. become.

C. As described above, in the first embodiment, since still images taken during moving image shooting are displayed together with the moving images being shot, the content of the shot still images and the number of still images shot can be simplified. In addition, the past contents of the moving image currently being shot can also be understood. For example, even when a moving image is shot for a long time, it is possible to easily recognize what kind of moving image has been shot.
In addition, if still image shooting is performed during moving image shooting, the captured still images are sequentially displayed together with the moving image, so that the interest of the user can be enhanced.

[Modification 1]
D. The first embodiment can be modified as follows.

  (1) When it is determined in step S2 that moving image shooting is to be started, after still image shooting processing is performed (step S3), moving image shooting recording processing and display processing are started (step S4), but moving image shooting is started. If it is determined, the process may go directly to step S4 without performing the still image shooting process.

  (2) In addition, when the shutter button is pressed during the moving image shooting / recording process (Y in step S5), the still image shooting process is performed (step S6). You may make it perform an imaging | photography process. In this case, it is determined whether or not a predetermined time has elapsed since the still image shooting process was performed in step S5. If the predetermined time has elapsed, the process proceeds to step S6. If the predetermined time has not elapsed, the process proceeds to step S8. Try to go forward. This predetermined time may be set in advance or may be arbitrarily set by the user. That is, still image shooting is automatically performed at a predetermined timing.

  (3) Further, although the still image shooting process is performed in step S3 and step S6, the timing at which the moving image shooting is started in step S2 in step S3 and step S6 without performing the still image shooting process, The frame data captured by the CCD 5 may be extracted at the timing when the shutter button is pressed in step S5, and still image data or thumbnail images may be generated based on the extracted frame data. In this case, the generated still image data and thumbnail image are displayed in step S4 and step S7, and in step S9, the generated still image data and thumbnail image are recorded.

  (4) Although the moving image file and the still image file are recorded in association with each other, they may not be recorded in association with each other. Still image data obtained by still image shooting processing may not be recorded.

  (5) Although all the still image data obtained by still image shooting is recorded, only the still image data selected by the user may be recorded.

  (6) Moreover, the aspect which combines said (1) thru | or (5) arbitrarily may be sufficient.

[Second Embodiment]
Next, a second embodiment will be described.
In the second embodiment, a moving image and a still image are displayed during moving image reproduction, and when still image data is selected, the moving image is reproduced from a position corresponding to the selected still image.

E. Operation of Digital Camera 1 In the second embodiment, the image pickup apparatus of the present invention is realized by using the digital camera 1 having the same configuration as that shown in FIG.
Hereinafter, the operation of the digital camera 1 according to the second embodiment will be described with reference to the flowchart of FIG.

  When the moving image playback mode is set by the user operating the mode key, the CPU 10 displays the moving image file (file name, moving image thumbnail image, moving image first frame image, etc.) recorded in the flash memory 14 as an image display unit. 15 is displayed as a list (step S31).

Next, the CPU 10 determines whether or not a moving image file to be reproduced is determined by the user from among the moving image files displayed in the list (step S32).
At this time, the user can select a moving image file to be reproduced by operating the cross key while viewing the displayed moving image file, and determine a moving image file to be reproduced by operating the SET key. The CPU 10 determines whether or not an operation signal corresponding to the operation of the SET key is sent from the key input unit 11.

  In step S32, the process stays in step S32 until it is determined that it is determined that the moving image file to be reproduced has not been determined. When it is determined that the moving image file to be reproduced has been determined, the moving image data of the determined moving image file is displayed and reproduced ( At the same time, the still image data or thumbnail image of the still image file associated with the moving image file is read out and displayed (step S33). As described in the first embodiment, the still image file associated with the moving image file is a still image file of a still image in which still image shooting was performed during moving image shooting.

  As described in the first embodiment, the reproduction of the moving image includes the region 20 (third display region) where the image display unit 15 displays the moving image and the region 21 (fourth display region) where the still image is displayed. The moving image of the determined moving image file is displayed in the area 20, and the still image (still image data or thumbnail image) recorded in association with the moving image file is displayed in the area 21. At this time, the order of still images to be displayed is displayed in the order of shooting.

FIG. 5A shows the state of the screen displayed on the image display unit 15 at that time.
A moving image of the determined moving image file is reproduced and displayed in the area 20, and a still image of the still image file recorded in association with the determined moving image file is displayed in the shooting order in the area 21. That is, the upper left image is a still image captured first, and the lower right image is a still image captured last.

  In addition, the first photographed still image is selected with a thick frame, and this thick frame indicates from which position the moving image data is reproduced and displayed. Accordingly, since the moving image data is currently displayed in order from the first frame, the first photographed still image is selected with a thick frame.

  When the video file to be played is determined, the video of the determined video file is played back and displayed, but the first frame of the video and the thumbnail image of the video are displayed without being played back. May be.

  Next, the CPU 10 determines whether or not a still image has been selected by the user (step S34). This determination is made based on whether or not an operation signal corresponding to the operation of the SET key is sent from the key input unit 11.

At this time, the user can temporarily select a still image by operating the cross key, and can select the temporarily selected still image by operating the SET key. At the time of provisional selection, in order to make the user recognize that the still picture is provisionally selected, the provisionally selected still picture is displayed differently from other still pictures.
As will be described later, when this still image is selected, the moving image data is reproduced and displayed from the frame data at the position corresponding to the selected still image. If the user selects a still image corresponding to the start location, the user can reproduce and display the moving image from the desired start location.

  If it is determined in step S34 that a still image has been selected, the CPU 10 reproduces and displays moving image data from a position corresponding to the selected still image (step S35), and proceeds to step S36. That is, of the moving image data determined in step S32, a moving image shot after the selected still image has been shot is reproduced and displayed. For example, if the position corresponding to the selected still image is the 20th frame of the moving image data, playback and display will start from the 20th frame.

FIG. 5B shows the state of the screen displayed on the image display unit 15 at that time. As shown in the figure, the fourth still image is selected, and the fourth still image is displayed. It can be seen that the moving image is played back and displayed from the frame at the position corresponding to the image.
On the other hand, if it is determined in step S34 that a still image has not been selected, the process proceeds directly to step S36.

  In step S36, the CPU 10 determines whether or not to end the reproduction of the moving image. This determination is made to end the reproduction of the moving image when the moving image data is displayed to the end or when an operation signal for stopping the reproduction is sent from the key input unit 11.

If it is determined in step S36 that the reproduction of the moving image is not terminated, the process returns to step S34. If it is determined that the reproduction of the moving image is terminated, the CPU 10 ends the reproduction of the moving image (step S37) and determines whether or not to end the moving image reproduction mode. Judgment is made (step S38). This determination is made to end the moving image shooting mode when another mode such as a shooting mode is set by the user operating the mode key or when the power of the digital camera 1 is turned off.
If it is determined in step S38 that the moving image playback mode is not terminated, the process returns to step S11.

F. As described above, in the second embodiment, when reproducing and displaying moving image data in which still image shooting was performed during moving image shooting, the moving image data is displayed and still image shooting is performed during moving image shooting. When a still image is displayed and the still image is selected, the moving image data is reproduced and displayed from the frame data corresponding to the still image, so that the user can easily reproduce the moving image data from the scene to be reproduced. .

[Modification 2]
G. The second embodiment can be modified as follows.

(1) In step S33, the still image data or thumbnail image of the still image file associated with the determined moving image file is read out and displayed, but the still image associated with the determined moving image file is displayed. Instead of the still image of the image file, the frame data of the determined moving image file may be extracted and displayed as a still image based on the extracted frame data.
In this case, frame data at predetermined frame intervals among all the frames of the determined moving image file are displayed as a still image.
For example, when the moving image data consists of 350 frames, the first frame, the 51st frame, the 101st frame, the 151st frame, the 201st frame, the 251st frame, and the 301st frame. The frame is displayed as a still image.
The predetermined frame interval may be a predetermined frame interval, or may be determined according to the total number of frames of moving image data (for example, all the still images to be displayed are equally spaced). Also good.

(2) In step S33, the still image data or thumbnail image of the still image file associated with the determined moving image file is read and displayed, but is recorded in association with the moving image file. Record the timing (time) when still image shooting was performed during movie shooting in the movie file without displaying the still image of the still image file, and save the movie data corresponding to the timing when the still image shooting was performed. The frame data may be extracted and the extracted frame data may be displayed as a still image.
In the case of (1) and (2) above, there is no need to record a moving image file in association with a still image file.

[Third Embodiment]
Next, a third embodiment will be described.
In the third embodiment, in edit mode, a moving image and a still image are displayed, and when a still image is selected, editing is performed using the position of the frame data of the moving image corresponding to the still image as an editing point. It is.

H. Operation of Digital Camera 1 The second embodiment also implements the imaging apparatus of the present invention by using the digital camera 1 having the same configuration as that shown in FIG.
The operation of the digital camera 1 according to the second embodiment will be described below with reference to the flowchart of FIG.

  When the moving image editing mode is set by the operation of the user's mode key, the CPU 10 displays the moving image file (file name, moving image thumbnail image, moving image first frame image, etc.) recorded in the flash memory 14 as an image display unit. 15 is displayed as a list (step S51).

Next, the CPU 10 determines whether or not a moving image file to be reproduced is determined by the user from the moving image files displayed in the list (step S52).
At this time, the user can select a moving image file to be edited by operating the cross key while viewing the moving image files displayed in a list, and determine a moving image file to be edited by operating the SET key. The CPU 10 determines whether or not an operation signal corresponding to the operation of the SET key is sent from the key input unit 11.

  If it is determined in step S52 that the moving image file to be edited has not been determined, the process remains in step S52 until it is determined that the moving image file to be edited has been determined. As illustrated in FIG. The moving image of the file is displayed in the region 20 (the first frame data and the thumbnail image of the moving image are displayed), and the still image data or the thumbnail image of the still image file associated with the moving image file is read and displayed in the region 21. It is displayed (step S53). At this time, since the first still image is selected and the user recognizes that the selected still image is selected, the selected still image, that is, the first still image is selected. The picture is surrounded by a thick frame.

  Next, the CPU 10 determines whether or not a still image has been selected by the user (step S54). This determination is made based on whether or not an operation signal corresponding to the operation of the cross key has been sent to the CPU 10.

If it is determined in step S54 that no still image has been selected, the process proceeds directly to step S56. If it is determined that a still image has been selected, the still image selected according to the selection operation is displayed in a discriminative manner, that is, a thick image. The frame is enclosed (step S55), and the process proceeds to step S56.
That is, the user can select an arbitrary still image from the displayed still images by operating the cross key. For example, when the first still image is selected and the arrow key “↓” is operated once, the second still image is selected as the selected still image, and the selected second image is selected. The still image is surrounded by a thick frame.

In step S56, the CPU 10 determines whether or not to determine the selected still image as an editing point.
This determination is made based on whether or not an operation signal corresponding to the operation of the SET key is sent from the key input unit 11, and the user operates the SET key when he / she wants to select the selected still image as an editing point. To do.

  If it is determined in step S56 that the selected still image is not determined as an edit point, the process returns to step S54. If it is determined that the selected still image is determined as an edit point, whether or not a deletion direction is designated. Is determined (step S57).

At this time, the CPU 10 causes the image display unit 15 to display a screen for designating the deletion direction. FIG. 7A is a diagram showing a state at that time.
There are two types of deletion directions: forward deletion and backward deletion. Looking at the figure, it can be seen that a screen for selecting either forward deletion or backward deletion is displayed. This forward deletion means deleting all the frames before the moving image frame corresponding to the still image determined as the editing point, and the backward deletion is after the moving image frame corresponding to the still image determined as the editing point. It means to delete all frames.

Also, for example, when a screen for selecting whether to delete forward or backward is displayed, the screen is displayed so that forward deletion is selected first, and every time the cross key is operated, backward deletion and forward deletion again are performed. In this way, display is made so that forward deletion or backward deletion is selected. Thereby, it is possible to select either the forward deletion direction or the backward deletion direction. In addition, the deletion direction selected in order to make the user recognize the currently selected deletion direction is displayed with a screen. Any method may be used as long as it is a method for recognizing the selection.
Then, the user can select the deletion direction by operating the cross key. When the user selects OK in the selected deletion direction, the user can determine the deletion direction by operating the SET key. When an operation signal corresponding to the operation of the SET key is sent, the selected deletion direction is determined.

  When determining in step S57 that the deletion direction has been determined, the CPU 10 executes the editing of the moving image of the moving image file determined in step S52 in accordance with the determination (step S58). That is, when the determined deletion direction is forward deletion based on the frame data of the moving image corresponding to the still image that is the editing point determined in step S56, all the frame data before the frame data is deleted, When the determined deletion direction is backward deletion, all the frame data after the frame data are deleted. Here, it is assumed that forward deletion is selected and determined as the deletion direction.

Next, the CPU 10 newly generates a moving image file based on the edited moving image data, records the generated moving image data in the flash memory 14, and associates the edited moving image file with the moving image file and the moving image file. The still image of the recorded still image file is displayed (step S59).
At this time, the edited moving image file (generated moving image file) is recorded in association with only the still image file of the still image corresponding to the frame of the moving image remaining after editing.

FIG. 7B is a diagram showing a state of a moving image and a still image displayed after editing.
When comparing (a) and (b) in FIG. 7, it can be seen that the still image determined as the editing point is the first still image, and the still image before the determined still image is displayed. I understand that it is not. This is because the still image file of the still image corresponding to the frame deleted by editing is not recorded in the edited moving image file in association with it.
In the above description, the generated moving image file is newly recorded. However, the generated moving image file may be overwritten and recorded on the moving image file determined in step 52 (moving image file that has been edited). . That is, the determined moving image file is deleted.

Next, the CPU 10 determines whether or not to end the moving image editing mode (step S60). This determination is made to end the moving image shooting mode when another mode such as a shooting mode is set by the user operating the mode key or when the power of the digital camera 1 is turned off.
If it is determined in step S60 that the moving image playback mode is not terminated, the process returns to step S51.

I. As described above, in the third embodiment, when editing moving image data in which still image shooting was performed during moving image shooting, the moving image data was displayed and still image shooting was performed during moving image shooting. Still images are also displayed, and selected still images are used as editing points, so that moving image data can be easily edited.

[Modification 3]
J. et al. The third embodiment can be modified as follows.

(1) The aspect described in [Modification 2] may be used as a modification of the third embodiment.
Briefly, in step S53, the still image data or thumbnail image of the still image file associated with the determined moving image file is read and displayed. However, the still image data or thumbnail image associated with the determined moving image file is displayed. Instead of a still image of a still image file, frame data of moving image data may be extracted and the extracted frame data may be displayed as a still image. That is, a frame at a predetermined frame interval or a frame corresponding to the timing at which a still image was taken is displayed as a still image.

(2) Also, one still image as an editing point is selected, and the frame is deleted based on the deletion direction determined in step S57 with reference to the frame corresponding to the selected still image. You may enable it to determine two still pictures used as an edit point. That is, two edit points may be designated.
In this case, moving image data between frames corresponding to two still images designated as editing points may be deleted, or moving image data between frames corresponding to two still images designated as editing points. May be left (moving image data other than moving image data between frames is deleted).

  The digital camera 1 in each of the above embodiments is not limited to the above embodiment, and may be a mobile phone with a camera, a PDA with a camera, a personal computer with a camera, a digital video camera, or the like. Any device may be used as long as it has a function capable of capturing a video or a function capable of processing moving image data.

1 is a block diagram of a digital camera according to an embodiment of the present invention. It is a flowchart which shows operation | movement of the digital camera 1 of 1st Embodiment. FIG. 6 is a diagram illustrating a state of a screen displayed on the image display unit 15 in the first embodiment. It is a flowchart which shows operation | movement of the digital camera 1 of 2nd Embodiment. In 2nd Embodiment, it is a figure which shows the mode of the screen displayed on the image display part. It is a flowchart which shows operation | movement of the digital camera 1 of 3rd Embodiment. In 3rd Embodiment, it is a figure which shows the mode of the screen displayed on the image display part.

Explanation of symbols

1 Digital Camera 2 Shooting Lens 3 Lens Drive Block 4 Aperture 5 CCD
6 Driver 7 TG
8 Unit circuit 9 Image generator 10 CPU
11 Key input section 12 Memory 13 DRAM
14 Flash memory 15 Image display unit 16 Bus

Claims (13)

Imaging means for imaging a subject;
Moving image shooting control means for shooting a moving image by the imaging means;
Instruction means for instructing a predetermined timing;
During the series of moving image shooting by the moving image shooting control means, the frame data taken by the moving image is sequentially displayed as a moving image in the first display area of the display means, and the timing is indicated each time the instruction means is instructed. A first display control means for adding a still image based on the image data obtained by the imaging means and continuously displaying it in the second display area of the display means;
An imaging apparatus comprising: When the timing is instructed by the instruction means, the image pickup means includes a still image shooting control means for shooting a still image of a subject,
The first display control means includes
2. The image pickup apparatus according to claim 1, wherein a still image based on still image data photographed by the still image photographing control means is continuously displayed in the second display area of the display means. The moving image shooting control means includes
3. The imaging apparatus according to claim 2, wherein the moving image shooting is temporarily interrupted when the timing is instructed by the instruction unit, and the moving image shooting is resumed when the still image shooting control unit finishes shooting the still image. Frame data extraction means for extracting frame data shot at that time from frame data shot by the moving picture shooting control means when the timing is instructed by the instruction means;
The first display control means includes
2. The imaging apparatus according to claim 1, wherein a still image based on the frame data extracted by the frame data extraction unit is continuously displayed in the second display area of the display unit. The instruction means includes
The imaging device according to claim 1, wherein a timing arbitrarily designated by a user is instructed. The instruction means includes
The imaging apparatus according to claim 1, wherein the timing is instructed at a predetermined timing or at predetermined time intervals. The imaging apparatus according to claim 1, further comprising a recording control unit that records the moving image data obtained by the moving image capturing control unit in a recording unit. The recording control means includes
8. The image pickup apparatus according to claim 7, wherein the image data obtained by the image pickup means at the timing instructed by the instruction means is recorded in association with the moving image data obtained by the moving image shooting control means. A selection means for selecting any video data among the video data recorded in the recording means;
The moving image data selected by the selection unit is reproduced and displayed in the third display area of the display unit, and the image data captured by the imaging unit at the timing instructed by the instruction unit during shooting of the moving image data is displayed. Second display control means for reproducing and displaying a still image in the fourth display area of the display means;
Designation means for designating an arbitrary still image among the still images reproduced and displayed in the fourth display area of the display means by the second display control means, the second display control means,
When any of the still images being reproduced and displayed is designated in the fourth display area of the display means by the designation means, the moving image data selected by the selection means from the frame corresponding to the designated still image The image pickup apparatus according to claim 7 or 8, wherein the image is reproduced and displayed in a third display area of the display means. A selection means for selecting any video data among the video data recorded in the recording means;
The moving image data selected by the selection unit is reproduced and displayed in the third display area of the display unit, and the image data captured by the imaging unit at the timing instructed by the instruction unit during shooting of the moving image data is displayed. Second display control means for reproducing and displaying a still image in the fourth display area of the display means;
As an editing point, designation means for designating an arbitrary still image among the still images reproduced and displayed in the fourth display area of the display means by the second display control means;
Movie editing means for editing the movie data selected by the selection means based on the editing point specified by the specification means;
The imaging apparatus according to claim 7 or 8, further comprising: The moving image editing means includes
The moving image data selected by the selecting unit is selected by the selecting unit by deleting the moving image data before or after the frame data corresponding to the still image that is the editing point specified by the specifying unit. The imaging apparatus according to claim 10, wherein the moving image data is edited. The designation means is:
Specify two still images as edit points,
The moving image editing means includes
Of the moving image data selected by the selection unit, the moving image data between the frame data corresponding to the two still images that are the editing points specified by the specifying unit is deleted or the two still images that are the editing points. 11. The imaging apparatus according to claim 10, wherein the moving image data selected by the selection unit is edited by deleting moving image data other than between corresponding frame data. Imaging processing for imaging a subject;
A moving image shooting process for shooting a moving image by the imaging process;
An instruction process for instructing a predetermined timing;
During the series of moving image shootings by the moving image shooting process, the frame data captured by the moving images is sequentially displayed in the first display area of the display means, and at each timing when the timing is instructed by the instruction process. A display process of adding a still image based on the image data obtained by the imaging process and continuously displaying it on the second display area of the display means;
A program characterized by causing a computer to execute the processes described above.