JP4553134B2 - Image generating apparatus and program thereof - Google Patents

Description

  The present invention relates to an image generation device and a program thereof, and more particularly to an image generation device and a program thereof that can extract a frame in a moving image as a still image.

2. Description of the Related Art Conventional image generation apparatuses, such as digital cameras, have become widespread that have a function of shooting a moving image as well as a function of shooting a still image of a subject.
In addition, digital cameras having a function of easily printing out a photographed still image by connecting the digital camera directly to a printer have also appeared.
Along with the development of such technology, a technology for creating and recording a still image from a specific frame of a moving image has appeared. Thereby, it is possible to easily print out an image of a specific frame of the moving image.
In addition, digital cameras that can be directly connected to a printer, create a still image from a specific frame of a moving image, and send the still image to the printer to print the image of the frame have appeared (Patent Literature). 1).

JP Patent Publication No. 2004-179823

However, in a conventional digital camera, even if you want only an image of a certain part of a certain frame image of a moving image, record the frame as a still image file, and then record the recorded still image file. Since a trimmed image is generated by reading out, there is a problem that it is troublesome and troublesome.
In addition, in order to cut out an image of a portion of a frame, since the frame is recorded as a still image file, unnecessary data is recorded, and the memory cannot be effectively used. Further, in order to secure the free space of the memory, there is a problem that it is troublesome and cumbersome because the recorded unnecessary data has to be erased.

  Therefore, the present invention has been made in view of such conventional problems, and provides an image generation apparatus and a program thereof that can easily obtain image data of a necessary part from a frame in a moving image. Objective.

For the purposes achieved, the image generating apparatus according to a first aspect of the present invention, an acquisition unit for acquiring moving image data, a first selection means for selecting frames in the moving image data obtained by the obtaining means, Generation means for generating a still image file from the frame selected by the first selection means; and first storage means for storing trimming information indicating an area to be trimmed of the frame selected by the first selection means; A second selection unit that selects a frame other than the frame selected by the first selection unit from the moving image data acquired by the acquisition unit, and the generation unit stores the still image file Torimi before generating, based on said first trimming information stored in the storage means, from the first frame selected by the selection means Generates the grayed image, based on the trimming information stored in said first storage means comprises means for generating a trimming image from the selected frame by said second selecting means, being the generated trimmed A still image file of an image is generated.

In order to achieve the above object, an image generation apparatus according to the invention described in claim 2 includes an acquisition unit that acquires moving image data, a first selection unit that selects a frame in the moving image data acquired by the acquisition unit, Generation means for generating a still image file from the frame selected by the first selection means; first image recognition means for recognizing a subject in the frame selected by the first selection means; and the acquisition means The second selection means for selecting a frame other than the frame selected by the first selection means from the moving image data acquired by the above, and an area for trimming the frame selected by the second selection means. second storage means for storing the trimming information, and determines a trimming area based on the recognized position of the subject by the first image recognition unit And a second storage control means for storing the trimming data to the serial second storage means, said generating means, prior to generating the still image file, which is recognized by the first image recognition unit subject A trimming image is generated from the frame selected by the first selection unit based on the position of the first selection unit, and selected by the second selection unit based on the trimming information stored in the second storage unit Means for generating a trimmed image from the generated frame , and generating a still image file of the generated trimmed image .

To achieve the above object, a program according to a third aspect of the present invention provides an acquisition process for acquiring moving image data, a first selection process for selecting a frame in the moving image data acquired by the acquisition process, A generation process for generating a still image file from a frame selected by one selection process; a first storage process for storing trimming information indicating an area to be trimmed of the frame selected by the first selection process; of the video data acquired by the acquisition process, the first frame other than the frame selected by the selection process comprises a second selection process for selecting the further, the generating process, the still image file before generating, based on the trimming information stored by the first storing process, or frame selected by the first selection process And it generates a trimming image, based on the trimming information stored by the first storing process, from frames selected by the second selection process to generate a trimming image, the trimming image the generated Including a process for generating a still image file, and causing each of the above processes to be executed by a computer .

To achieve the above object, a program according to a fourth aspect of the present invention provides an acquisition process for acquiring moving image data, a first selection process for selecting a frame in the moving image data acquired by the acquisition process, Acquired by a generation process for generating a still image file from a frame selected by one selection process, a first image recognition process for recognizing a subject in a frame selected by the first selection process, and the acquisition process Of the selected moving image data, a second selection process for selecting a frame other than the frame selected by the first selection process, and trimming information indicating a trimming area of the frame selected by the second selection process And a second storage process for determining and storing based on the position of the subject recognized by the first image recognition process, and Formation process, prior to generating the still image file, based on the position of the recognized object by the first image recognition processing, and generates a trimming image from the selected frame by the first selection process Processing for generating a trimming image from the frame selected by the second selection processing based on the trimming information stored by the second storage processing, and generating a still image file of the generated trimming image And each of the above processes is executed by a computer .

According to the present invention, a trimmed image can be generated easily and quickly from a frame in moving image data.

Hereinafter, the present embodiment will be described in detail with reference to the drawings as an example to which a digital camera is applied.
[First embodiment]
A. Configuration of Digital Camera FIG. 1 is a block diagram showing an electrical schematic configuration of a digital camera 1 that implements the image generation apparatus of the present invention.
The digital camera 1 includes a photographic lens 2, a lens driving block 3, a diaphragm shutter 4, a CCD 5, a TG (timing generator) 6, a unit circuit 7, a DRAM 8, a memory 9, a CPU 10, a flash memory 11, an image display unit 12, and a key input. Unit 13, sound processing unit 14, strobe driving unit 15, and strobe light emitting unit 16.

  The photographing lens 2 includes a focus lens and a zoom lens (not shown), and a lens driving block 3 is connected thereto. The lens driving block 3 includes a focus motor and a zoom motor that drive a focus lens and a zoom lens (not shown) in the optical axis direction, and a focus motor that drives the focus motor and the zoom motor in the optical axis direction according to a control signal from the CPU 10, respectively. It consists of a driver and a zoom motor driver.

The aperture / shutter 4 includes a drive circuit (not shown), and the drive circuit operates the aperture / shutter according to a control signal sent from the CPU 10. The aperture / shutter functions as an aperture and a shutter.
The diaphragm is a mechanism that controls the amount of light that enters from the photographic lens 2, and the shutter is a mechanism that controls the time that light is applied to the CCD 5, and the time that light is applied to the CCD 5 is It varies depending on the shutter opening / closing speed (shutter speed). Exposure can be determined by the aperture and shutter speed.

The CCD 5 converts the light of the subject projected through the photographing lens 2 and the diaphragm / shutter 4 into an electrical signal and outputs it as an imaging signal to the unit circuit 7. The CCD 5 is driven in accordance with a predetermined frequency timing signal generated by the TG 6. A unit circuit 7 is connected to the TG 6.
The unit circuit 7 includes a CDS (Correlated Double Sampling) circuit that holds the imaging signal output from the CCD 5 by correlated double sampling, an AGC (Automatic Gain Control) circuit that performs automatic gain adjustment of the imaging signal after the sampling, The A / D converter converts the analog image pickup signal after the automatic gain adjustment into a digital signal. The image pickup signal of the CCD 5 is sent to the CPU 10 as a digital signal through the unit circuit 7.

  The CPU 10 performs image processing (pixel interpolation processing, γ correction, luminance color difference signal generation, white balance processing, exposure correction processing, etc.) of the image data sent from the unit circuit 7, and compression / decompression (for example, JPEG) of the image data. Each part of the digital camera 1 has functions for performing processing such as compression / decompression of formats and MPEG formats, AF processing (AF processing using a contrast detection method and AF processing using pan focus), generation of a trimmed image, image recognition processing, and the like. It is a one-chip microcomputer that controls.

The memory 9 stores control programs necessary for each unit of the CPU 10, that is, programs necessary for various controls including AE and AF, and necessary data, and the CPU 10 operates according to the programs.
The memory 9 stores default values (trimming position information and trimming size information) indicating the display position and size of the trimming frame, and has a trimming information storage area for temporarily storing the trimming position information and the trimming size information. . This memory 9 functions as the first storage means and the second storage means of the present invention.

The DRAM 8 is used as a buffer memory for temporarily storing image data sent to the CPU 10 after being imaged by the CCD 5 and also as a working memory for the CPU 10.
The flash memory 11 is a recording medium for storing image data such as still image data and moving image data captured by the CCD 5 in the form of a still image file or a moving image file. The flash memory 11 corresponds to recording means of the present invention.

The image display unit 12 includes a color LCD and its drive circuit, and displays the subject imaged by the CCD 5 as a through image when in a shooting standby state, and is read from the storage flash memory 11 when reproducing a recorded image. The expanded recorded image is displayed. The image display unit 12 functions as display means of the present invention.
The key input unit 13 includes a plurality of operation keys such as a shutter button, a zoom continuous shooting key, a cross key, a SET key, and a mode switching key, and outputs an operation signal corresponding to a user's key operation to the CPU 10. The key input unit 13 functions as a first frame designating unit, a first area designating unit, a second frame designating unit, and a second area designating unit of the present invention.

The sound processing unit 14 includes a built-in microphone, an amplifier, an A / D converter, a D / A converter, an amplifier, a built-in speaker, and the like, and converts sound input to the built-in microphone into a digital signal when shooting an image with sound. And send it to the CPU 10. The CPU 10 sequentially stores the sent audio data in the buffer memory (DRAM 8) and records it in the flash memory 11 together with the image data picked up by the CCD 5.
In addition, the sound processing unit 14 emits sound or the like based on sound data attached to each image data from the built-in speaker when reproducing an image with sound.

  The strobe driving unit 15 drives the strobe light emitting unit 16 to flash according to the control signal of the CPU 10, and the strobe light emitting unit 16 flashes the strobe. The CPU 10 determines whether or not the shooting scene is dark based on the luminance component of the image data output from the photometric circuit or the CCD 5 (not shown), determines that the shooting scene is dark, and determines that shooting is to be performed (shutter button) When the button is pressed, a control signal is sent to the strobe drive unit 15.

B. Operation of Digital Camera 1 The operation of the digital camera 1 in the embodiment will be described with reference to the flowcharts of FIGS.
The playback mode is set by the user's operation of the mode switching key of the key input unit 13, and among the plurality of moving image files already recorded in the flash memory 11 by the operation of the cross key or the SET key of the user's key input unit 13. When a desired moving image file is selected (step S1), the CPU 10 determines whether or not a motion print is selected by the user's operation of the key input unit 13 (step S2). This determination is made based on whether or not an operation signal corresponding to the selection of the motion print has been sent from the key input unit 13. Motion printing refers to generating still image data from moving image data of a moving image file.

If it is determined in step S2 that no motion print has been selected, the CPU 10 determines whether or not an instruction to reproduce the selected moving image file has been given by the user's operation of the key input unit 13 (step S2). S3).
If it is determined in step S3 that a playback instruction has not been issued, the process returns to step S2. If it is determined that a playback instruction has been issued, the CPU 10 proceeds to the playback process of the selected moving image file.

If it is determined in step S2 that the motion print has been selected, the CPU 10 determines whether one frame cutout or nine frame cutout has been selected by the user (step S4). This determination is made based on which operation signal is sent from the key input unit 13 among the operation signal corresponding to the selection of one-frame cutout and the operation signal corresponding to the selection of nine-frame cutout.
If it is determined in step S4 that one frame cutout has been selected, the CPU 10 selects the first frame of the selected moving image file (moving image file selected in step S1) (first selecting means), and selects the selected frame. The image is displayed on the image display unit 12 (step S5).

  Next, the CPU 10 determines whether or not to determine the currently selected (displayed) frame as a highlight scene (step S6). This determination is made based on whether or not an operation signal corresponding to the set key operation is sent from the key input unit 13, and when an operation signal corresponding to the set key operation is sent, the displayed frame is displayed. As a highlight scene. A highlight scene refers to a frame to be recorded as a still image file. When the user wants to generate a still image file from an image of a frame displayed on the image display unit 12, the user operates a set key.

If it is determined in step S6 that the highlight scene is not determined, the CPU 10 determines whether or not the user has operated the cross key (step S7). This determination is made based on whether or not an operation signal corresponding to the operation of the cross key is sent from the key input unit 13.
If it is determined in step S7 that the operation of the cross key has not been performed, the process returns to step S6. If it is determined in step S7 that the operation of the cross key has been performed, the CPU 10 follows the operation of the user (the operation that has been sent). In accordance with the signal, a frame is selected (first selecting means), an image of the selected frame is displayed on the image display unit 12 (step S8), and the process returns to step S6. The function of displaying the frame selected by the first selection means corresponds to the display control means of the present invention.
That is, the user can select a highlight scene, that is, a frame that is a basis for generating a still image file, by operating the cross key during the loop of Step S6 to Step S8.

FIG. 4 shows an image of each frame of the selected moving image file.
Initially, the image of the first frame is displayed, but if the “↓” key of the cross key or the “→” key of the cross key is operated, the selected frame, that is, the image display section is displayed. The frames of the displayed image are in descending order, such as the second frame image, the third frame image, and the fourth frame image. When the user operates the “↑” key of the cross key or the “←” key of the cross key, the selected frame, that is, the frame of the image displayed on the image display unit 12 is five. The frames of the displayed image are in ascending order, such as the frame image of the eye, the frame image of the fourth frame, and the third frame image.

Then, the user can select a frame for which a still image file is to be generated by operating the cross key, and press the SET key to determine the selected frame as a highlight scene. Here, it is assumed that the user has operated the SET key when the fifth frame is selected (when the fifth frame image is displayed).
When the first frame image is displayed and the “↑” key or “←” key is operated, there is no further frame image, so the first frame image is displayed as it is. A frame image may be displayed, or the last frame image may be displayed.

If it is determined in step S6 that the scene is determined as the highlight scene, the CPU 10 reads the trimming position information and trimming size information (default value) stored in the memory 9 and stores them in the trimming information storage area of the memory 9, In accordance with the stored trimming information, a trimming frame is displayed over the displayed frame image (step S9). Here, the default values (trimming position information and trimming size information) stored in the memory 9 are default values such that the trimming frame is displayed at a predetermined size in the center of the image display unit 12. . Further, the trimming frame refers to a frame indicating a range where an image is cut out. The function of displaying the trimming frame corresponds to the display control means of the present invention.
FIG. 5 shows a state at that time, and a trimming frame 20 is displayed together with a fifth frame image. Note that the trimming designation range may be indicated by displaying the image in the trimming frame 20 in full screen without displaying the trimming frame 20.

Next, the CPU 10 determines whether or not the trimming position has been changed by the user (step S10). This determination is made based on whether or not an operation signal corresponding to the operation of the cross key is sent from the key input unit 13. The trimming position refers to the center position of the image to be cut out.
When it is determined in step S10 that the trimming position has been changed, the CPU 10 stores the changed trimming position in the trimming information storage area of the memory 9 (first storage control means), and the stored trimming position. Then, the trimming frame 20 is displayed (step S11), and the process proceeds to step S12. On the other hand, if it is determined in step S10 that the trimming position has not been changed, the process directly proceeds to step S12.

  In step S12, the CPU 10 determines whether the trimming size has been changed by the user. This determination is made based on whether or not an operation signal corresponding to the operation of the zoom key (“W” key, “T” key) of the key input unit 13 is sent from the key input unit 13. This trimming size refers to the size of the angle of view of an image to be cut out.

  When determining in step S12 that the trimming size has been changed, the CPU 10 stores the changed trimming size in the trimming information storage area of the memory 9 (first storage control means), and the stored trimming size. Accordingly, the trimming frame 20 is displayed (step S13), and the process proceeds to step S14. On the other hand, if it is determined in step S12 that the trimming size has not been changed, the process proceeds directly to step S14.

In step S14, it is determined whether or not the trimming position and the trimming size currently stored in the trimming information storage area, that is, the displayed trimming frame 20 is to be determined as a trimming area. This determination is made based on whether or not the user has operated the SET key.
If it is determined in step S14 that the trimming position and trimming size currently stored in the trimming information storage area are not determined as the trimming area, the process returns to step S10.

During the loop from step S10 to step S14, the user can adjust the trimming frame 20 to an image to be cut out.
For example, when it is desired to cut out a dog image in the state shown in FIG. 6A, the user cuts out the trimming position of the trimming frame 20 by operating the cross key as shown in FIG. 6B. After adjusting to the image of the desired dog, the trimming size of the trimming frame 20 is increased by operating the “T” key of the zoom key as shown in FIG. It can be adjusted to fit the image.

On the other hand, if it is determined in step S14 that the trimming position and trimming size currently stored in the trimming information storage area are determined as the trimming area, the CPU 10 trims the frame (displayed frame) determined as the highlight scene. The image data in 20 is cut out (copied) (step S15). That is, a trimmed image is generated (generation means).
Here, it is assumed that the user has operated the SET key in a state as shown in FIG.

Then, the CPU 10 generates a still image file from the cut-out image data (trimming image data) and records it in the flash memory 11 (recording control means). FIG. 7A shows the state of still image data of a still image file generated from a frame recorded in the flash memory 11.
Thereby, it is possible to cut out and record an image of a subject to be recorded as a still image file from an arbitrary frame in a moving image file that has been easily photographed.

On the other hand, if it is determined in step S4 that 9 frames have been cut out, the CPU 10 selects the first frame of the selected moving image file (first selecting means) and causes the image display unit 12 to display the image of the selected frame. (Step S17 in FIG. 3).
Next, the CPU 10 determines whether or not to determine the currently selected (displayed) frame as the highlight scene (step S18).

If it is determined in step S18 that the scene is not to be determined as a highlight scene, the CPU 10 determines whether or not the user has operated the cross key (step S19). This determination is made based on whether or not an operation signal corresponding to the operation of the cross key is sent from the key input unit 13.
If it is determined in step S19 that the operation of the cross key has not been performed, the process returns to step S18. If it is determined in step S19 that the operation of the cross key has been performed, the CPU 10 operates according to the user's operation (the operation that has been sent). In accordance with the signal, a frame is selected (first selecting means), an image of the selected frame is displayed on the image display unit 12 (step S20), and the process returns to step S18.

  During the loop from step S18 to step S20, the user can select a highlight scene, that is, a frame that is a basis for generating a still image file. Here, it is assumed that the user has operated the SET key when the fifth frame is selected (when the fifth frame is displayed), as in the case of single frame cutout. To do.

  On the other hand, if it is determined in step S18 that the scene is determined as the highlight scene, the CPU 10 reads the trimming position information and trimming size information (default value) stored in the memory 9 and stores them in the trimming information storage area of the memory 9. (First storage control means) The trimming frame 20 is displayed on the frame image being displayed in accordance with the stored trimming information (step S21). Also at this time, an image as shown in FIG. 5 is displayed on the image display unit 12 as in step S5 of FIG.

Next, the CPU 10 determines whether or not the trimming position has been changed by the user (step S22).
When determining in step S22 that the trimming position has been changed, the CPU 10 stores the changed trimming position in the trimming information storage area of the memory 9 (first storage control means), and the stored trimming position. Then, the trimming frame 20 is displayed (step S23), and the process proceeds to step S24. On the other hand, if it is determined in step S22 that the trimming position has not been changed, the process proceeds directly to step S24.

In step S24, the CPU 10 determines whether or not the trimming size has been changed by the user.
If it is determined in step S24 that the trimming size has been changed, the CPU 10 stores the changed trimming size in the trimming information storage area of the memory 9 (first storage control means), and the stored trimming size. Accordingly, the trimming frame 20 is displayed (step S25), and the process proceeds to step S26. On the other hand, if it is determined in step S24 that the trimming size has not been changed, the process proceeds directly to step S26.

In step S26, it is determined whether or not the trimming position and trimming size currently stored in the trimming information storage area, that is, the trimming frame 20 being displayed is to be determined as the trimming area.
If it is determined in step S26 that the trimming position and trimming size currently stored in the trimming information storage area are not determined as the trimming area, the process returns to step S22.
During the loop from step S22 to step S26, the user can adjust the trimming frame 20 to an image to be cut out.

  On the other hand, if it is determined in step S26 that the trimming position and trimming size currently stored in the trimming information storage area are determined as the trimming area, the CPU 10 determines the trimming position and trimming size stored in the trimming information storage area of the memory 9. The image data in the trimming frame 20 is cut out (copied) from the frame determined as the highlight scene (displayed frame) based on the above (generation means), and four frames before and after the frame determined as the highlight scene (Second selection means), and the image data is cut out (copied) from the selected eight frames based on the trimming position and the trimming information stored in the trimming information storage area of the memory 9 ( Generating means) (step S27). That is, a trimmed image is generated not only from the frame determined as the highlight scene but also from the four frames before and after the frame, and all images in the same trimming area are cut out. Note that the trimming range setting operation (steps S10 to S14) may be performed for each of the four frames before and after the frame in the same manner as the frame determined as the highlight scene.

  Next, the CPU 10 generates one set of image data from nine pieces of trimmed image data (9 pieces of cut-out image data), and records it as a still image file (recording control means) (step S28). One set of image data generated at this time is generated so that a trimmed image generated from a frame determined as a highlight scene becomes a main image.

  FIG. 7B shows an example of a state of one combined image generated from nine pieces of trimmed image data. The large image in the center of FIG. 7B is a trimmed image generated from the frame determined as the highlight scene, and the trimmed image generated from each of the four frames before the selected frame is small above it. Below that, a trimmed image generated from each of the four frames after the selected frame is displayed in a small size.

In this case, since the fifth frame is selected, the image that is largely displayed in the center is a trimmed image generated from the fifth frame, and the upper four small images are the fifth frame. The trimmed images generated from the first four frames, that is, the first, second, third, and fourth frames. The lower four small images are the sixth and seventh frames. These are trimmed images generated from the eighth and ninth frames.
As a result, it is possible to generate combined image data in which the image of the main subject is cut out from an arbitrary frame in the captured moving image file, which can be enjoyed as a stylish photo, and enhance the interest of the user. it can.

C. As described above, in the first embodiment, when a user selects a frame-cut motion print and the user selects a frame to be a highlight scene from among the frames of a moving image file, trimming is performed together with the frame. Since the frame 20 is displayed, and the image data in the displayed trimming frame 20 is cut out and recorded as a still image file, it can be recorded as a still image file from any frame in a video file that has been easily shot. It is possible to cut out and record an image of a subject to be desired.

  When the user selects a nine-frame motion print and the user selects a frame to be a highlight scene from the frames of the moving image file, the trimming frame 20 is displayed together with the frame, and the displayed trimming frame 20 is displayed. The image data in the frame and the four frames before and after the frame selected as the highlight scene are selected, and the image data in the range corresponding to the trimming frame 20 is also cut out from the selected eight frames. Nine trimmed images can be generated, and the labor of setting the trimming range for each sheet can be saved.

Further, since the generated nine trimmed images are recorded as one set of image data, it can be enjoyed as a stylish photo, and the user's interest can be enhanced. Also, by looking at the image of one piece of image data, a plurality of trimmed images can be seen at once, and the outline of the contents of the moving image data can be instantly recalled.
Further, since the user can change the display position and display range of the displayed trimming frame 20, it is possible to trim and record an image that the user wants to record.

[Second Embodiment]
Next, a second embodiment will be described.
In the first embodiment, in the case of nine-frame cutout, an image is cut out from the frames before and after the frame determined as the highlight scene in the determined trimming area. In the second embodiment, Cuts out the image data of the determined trimming area from the frame determined as the highlight scene, recognizes the subject of the cut out image data by image recognition, and recognizes the recognition from each frame before and after the frame determined as the highlight scene. The image data at the position where the subject is located is cut out.

D. Operation of Digital Camera 1 In the second embodiment, the image generation apparatus of the present invention is realized by using the digital camera 1 having the same configuration as that shown in FIG.
Hereinafter, the operation when the nine-frame cutout of the digital camera 1 according to the second embodiment is selected will be described with reference to the flowchart of FIG.

When branching to Y in step S26 of FIG. 3, the CPU 10 determines the trimming area, that is, the trimming position and the trimming size, the frame in the trimming frame 20 from the frame (displayed frame) determined as the highlight scene. The image data is cut out (step S51).
Next, the CPU 10 recognizes a subject (a subject such as a person, an animal, or a car) of the cut-out image data by image recognition processing (step S52). This function corresponds to the first image recognition means of the present invention.

Next, the CPU 10 selects four frames before and after the frame determined as the highlight scene, determines the trimming position of each selected frame based on the result of the image recognition process, and then trims the memory 9. The information is stored in the information storage area (step S53). That is, image recognition processing is performed on each of the four frames before and after the frame determined as the highlight scene, and it is determined at which position in the frame the subject recognized by the image recognition processing in step S52 is. The determined position is determined as a trimming position for each frame and stored in the trimming information storage area of the memory 9. At this time, the trimming size determined in step S26 may be used as it is, or the trimming size may be changed according to the size of the subject recognized for each frame.
The function of storing the trimming position determined for each frame in the trimming information storage area of the memory 9 corresponds to the second storage control means of the present invention.

  In the second embodiment, the frame determined as the highlight scene and the four frames before and after the frame need not necessarily be continuous frames. The selection of the four frames before and after may be performed manually or randomly, or may be performed according to a certain standard (for example, a frame with a large movement of the subject, a frame with little blurring, etc.).

Next, the CPU 10 cuts out image data based on the determined trimming positions from the four frames before and after determined as the highlight scene (generation unit) (step S54). At this time, the trimming size may be the trimming size determined in step S26, or may be changed according to the size of the subject recognized for each frame.
Next, the CPU 10 generates one set of image data from the extracted nine pieces of image data, and records the generated set image data in the flash memory 11 (recording control unit) (step S55).

E. As described above, in the second embodiment, image recognition processing is performed on each of the four frames before and after the highlight scene is determined, and the subject of the trimming frame 20 of the image determined as the highlight scene is determined. Since the position is determined and the determined position is stored for each frame as trimming position information, the trimming area is determined from the frame determined as the highlight scene and the four frames before and after the frame. The subject in the trimming frame 20 can be trimmed, and the image of the subject to be trimmed can be trimmed from all frames.

  In the second embodiment, in step S51 in FIG. 8, the subject within the trimming range determined in step S26 in FIG. 3 (that is, the trimming frame 20 when determined) is recognized. You may make it recognize the to-be-photographed object of all the images of the flame | frame determined as a highlight scene. It is determined at which position of the frame determined as the highlight scene the subject (for example, a person) recognized by the image recognition, the determined position is stored as trimming position information, and the frame determined as the highlight scene is determined. It is determined in which position the subject (for example, a person) recognized by image recognition is located in each of the four frames before and after the frame, and the determined position is stored as trimming position information for each frame. Also good. In this case, the processing in steps S21 to S26 in FIG. 3 is not necessary, and when the highlight scene is determined in step S18 in FIG. 3, the process proceeds directly to step S51 in FIG.

  In this case, the trimming position information of the frame determined as the highlight scene may be used as the trimming position information of the four frames before and after the frame. At this time, the trimming size may be a predetermined trimming size, a trimming size set by the user (steps S24 and S25), or a frame (including a frame determined as a highlight scene). The trimming size may be changed according to the size of the subject recognized every time. This method is not limited to the case of nine-frame cutout, and is also effective in the case of one-frame cutout.

  Further, in the second embodiment, in step S51 of FIG. 8, a subject in the trimming range determined in step S26 of FIG. 3 (that is, the trimming frame 20 when determined) is recognized, or a highlight scene is displayed. However, it is difficult to identify the subject to be recognized when a plurality of subjects are included in the trimming range or in the entire image of the frame. The subject position that the user wants to recognize may be designated by pinpoint, and the subject at the designated position may be recognized. This method is also not limited to the case of nine-frame cutout, and is also effective in the case of one-frame cutout.

[Modification]
F. Each of the above embodiments can be modified as follows.
(1) In the first and second embodiments, the first frame is selected and displayed on the image display unit 12 in step S5 of FIG. 2 and step S17 of FIG. A frame may be automatically selected from these frames, and an image of the selected frame may be displayed on the image display unit 12. Thereby, when the user does not want to generate a trimmed image based on the automatically selected frame, the user can manually select a desired frame.
Note that this automatic frame selection is performed, for example, by automatically selecting the frame with the smallest amount of blur among the frames of the moving image file, or the frame having the most change in subject movement or the like by image recognition processing. If a function for shooting and recording a movie for several seconds before and after the shutter button operation is provided, information for specifying a frame at the time when the shutter button is operated is stored in the movie file. This allows you to automatically select the frame at the time when the shutter button is operated, or to store information specifying the frame at the time when still image shooting was executed during movie shooting in the movie file. The frame at the time of shooting is automatically selected, or the frame at the start of recording or the frame at the end of recording is automatically selected. So as to.

  (2) In (1) above, after the frame is automatically selected, the user changes the frame selection or determines the highlight scene. May be forcibly determined as a highlight scene. That is, the processing in steps S6 to S8 in FIG. 2 may be eliminated.

(3) Although the user can manually change the trimming range, the trimming range may not be changed. That is, the processing in steps S10 to S14 in FIG. 2 and steps S22 to S26 in FIG. 3 may be eliminated. That is, trimming is performed at a predetermined position and size.
Further, only the trimming position or only the trimming size may be manually changed.

  (4) In step S9 in FIG. 2 and step S21 in FIG. 3, the trimming frame 20 is displayed at a predetermined position and size. However, the position is automatically determined by image recognition processing or the like. It may be displayed in size. At this time, the position and size automatically determined by image recognition processing or the like are stored in the trimming information storage area as trimming position information and trimming size information. The position and size determined by this image recognition processing are, for example, when a human face is recognized by image recognition, the position is stored as a trimming position, or the trimming size is set based on the size of the human face. Decide and remember. The trimming size may be a predetermined size.

  (5) In the above (4), after the trimming frame 20 is displayed at the position and size automatically determined by the image recognition processing or the like, the position and size to be trimmed by the user can be changed or determined. However, the trimming position and trimming size that are automatically determined by image recognition processing or the like may be forcibly determined. That is, the processing in steps S10 to S14 in FIG. 2 and steps S22 to S26 in FIG. 3 may be eliminated.

  (6) Also, in step S27 of FIG. 3, four frames before and after the frame determined as the highlight scene are selected and a trimming image is generated from the selected eight frames. The frame determined as the highlight scene and the four frames before and after the frame need not necessarily be continuous frames. That is, it is not necessary for each frame that is a basis for generating a trimmed image to be continuous. Further, the selection of the four frames before and after this may be performed manually or randomly, or the frames may be selected at predetermined intervals. Further, a frame with a small amount of blur may be automatically selected, or a frame with a change such as movement of the subject may be automatically selected by image recognition processing.

(7) Although nine trimmed images are generated in step S27 of FIG. 3 and steps S53 and 54 of FIG. 8, any number of trimmed images may be used.
(8) In step S27 in FIG. 3, and in steps S53 and S54 in FIG. 8, trimming images are generated from the frame determined as the highlight scene and the four frames before and after the frame. A trimmed image may be generated from the determined frame and eight frames other than the determined frame. That is, it is not necessary to limit the number of frames before and after the determined frame to, for example, two frames before the determined frame and six frames after the determined frame.

(9) Also, in step S27 of FIG. 3, a trimmed image is generated from the determined frame and the four frames before and after it based on the trimming position information and trimming size information determined in step S26. , based on the determined trimming position information, it generates a trimming image from the determined frame, with respect to four frames before and after the determined frame, trimming position based on the determined trimming information, trimming image by changing the size of the cropped May be generated.
For example, the trimming position of the preceding and following frames may be gradually made to the right, left, up, or down with the determined trimming position as the center. Further, the trimming size of the preceding and following frames may be gradually increased or decreased with the determined trimming size as the center.

(10) Further, in step S27 in FIG. 3, the trimming position information determined in step S26, based on the trimming size information has been to generate a trimming image from the frames before and after the frame determined in step S18, The user may be able to change the trimming position and the trimming size for each frame, and the trimming position and the trimming size are automatically determined for each frame using an image recognition process or the like. You may do it.

(11) Further, in step S27 in FIG. 3, the trimming position determined in step S26, based on the size of the cropped, was to generate a trimming image from the frames before and after the frame determined as the highlight scene, step The trimming image may be generated only from the frame determined in S18, and the trimming image may not be generated from the frames before and after the frame determined as the highlight scene. In this case, in step S28, one set of image data is generated from the trimmed image generated from the frame determined as the highlight scene and the frames before and after the determined frame.

  (12) In step S28 in FIG. 3 and step S55 in FIG. 8, one set of image data is generated and recorded from the nine trimmed images generated, but the set image data is generated. Instead, the generated nine trimmed images may be recorded as still image files. Further, one set of image data may be generated and recorded from the generated nine trimmed images, and each of the nine generated trimmed images may be recorded as a still image file.

  (13) In step S16 in FIG. 2, step S28 in FIG. 3, and step S55 in FIG. 8, a still image file is generated and recorded from the trimmed image. However, the still image file is not generated. Alternatively, when a still image file is generated but not recorded, for example, when the digital camera 1 and the printer are directly connected by a USB cable or the like, step S15 in FIG. 2, step S27 in FIG. The trimmed image obtained in step S54 in FIG. 8 (the still image file generated in step S16 in FIG. 2, step S28 in FIG. 3, and step S55 in FIG. 8) is output to the printer and printed out. Also good. Of course, it is also possible to read out a recorded still image file, output it to a printer, and print it out.

  (14) Furthermore, the digital camera 1 in each of the above embodiments is not limited to the above embodiment, and may be a mobile phone, a PDA, a personal computer, an IC recorder, a digital video camera, or the like. Any device can be used as long as it is capable of processing.

1 is a block diagram of a digital camera according to an embodiment of the present invention. It is a flowchart which shows operation | movement of the digital camera of 1st Embodiment. It is a flowchart which shows operation | movement of the digital camera of 1st Embodiment. It shows the state of the image of each frame of the moving image file. The state of the trimming frame 20 displayed together with the image of the moving image frame is shown. It is a figure which shows an example of how to match the trimming frame 20 with the subject to cut out. It is a figure which shows the mode of the still image data of the still image file produced | generated from the recorded flame | frame. It is a flowchart which shows operation | movement of the digital camera of 2nd Embodiment.

Explanation of symbols

1 Digital Camera 2 Shooting Lens 3 Lens Drive Block 4 Shutter / Shutter 5 CCD
6 TG
7 Unit circuit 8 DRAM
9 Memory 10 CPU
11 Flash memory 12 Image display unit 13 Key input unit 14 Audio processing unit 15 Strobe drive unit 16 Strobe light emitting unit

Claims (4)

An acquisition means for acquiring video data;
First selection means for selecting a frame in the video data obtained by the obtaining means,
Generating means for generating a still image file from the frame selected by the first selecting means;
First storage means for storing trimming information indicating an area to be trimmed of the frame selected by the first selection means;
A second selection unit that selects a frame other than the frame selected by the first selection unit from the moving image data acquired by the acquisition unit ;
With
The generating means includes
Before generating the still image file, a trimming image is generated from the frame selected by the first selection unit based on the trimming information stored in the first storage unit, and the first image file is generated . Including a means for generating a trimmed image from the frame selected by the second selecting means based on the trimming information stored in the storage means , and generating a still image file of the generated trimmed image. An image generating apparatus. An acquisition means for acquiring video data;
First selection means for selecting a frame in the moving image data acquired by the acquisition means;
Generating means for generating a still image file from the frame selected by the first selecting means ;
First image recognition means for recognizing a subject in the frame selected by the first selection means;
A second selection unit that selects a frame other than the frame selected by the first selection unit from the moving image data acquired by the acquisition unit;
Second storage means for storing trimming information indicating an area to be trimmed of the frame selected by the second selection means;
A second storage control means for storing the trimming data in the second storage means to determine a trimming area based on the position of the recognized object by the first image recognition unit,
With
The generating means includes
Before generating the still image file , based on the position of the subject recognized by the first image recognition unit, a trimming image is generated from the frame selected by the first selection unit , and the second image file is generated. Generating a trimming image from the frame selected by the second selection unit based on the trimming information stored in the storage unit , and generating a still image file of the generated trimming image. images generating device according to claim. Acquisition processing to acquire video data;
A first selection process for selecting a frame in the moving image data acquired by the acquisition process;
A generation process for generating a still image file from the frame selected by the first selection process;
A first storage process for storing trimming information indicating an area to be trimmed of the frame selected by the first selection process;
Of the video data acquired by the acquisition processing, a second selection process for selecting a frame other than the frame selected by the first selection process,
Including
Furthermore , the generation process includes:
Before generating the still image file, a trimming image is generated from the frame selected by the first selection processing based on the trimming information stored by the first storage processing, and the first image processing is performed. based on the trimming information stored in the storage process includes a process in which the second generates a trimming image from the frame selected by the selection process, generates a still image file of the generated trimming image,
Program characterized Rukoto to execute the above processes in a computer. Acquisition processing to acquire video data;
A first selection process for selecting a frame in the moving image data acquired by the acquisition process;
A generation process for generating a still image file from the frame selected by the first selection process;
A first image recognition process for recognizing a subject in a frame selected by the first selection process;
A second selection process for selecting a frame other than the frame selected by the first selection process from the moving image data acquired by the acquisition process;
A second storage process for determining and storing trimming information indicating an area to be trimmed in the frame selected by the second selection process based on the position of the subject recognized by the first image recognition process;
Including
Furthermore, the generation process includes:
Before generating the still image file, a trimmed image is generated from the frame selected by the first selection process based on the position of the subject recognized by the first image recognition process , and the second image file is generated. Including a process of generating a trimmed image from the frame selected by the second selection process based on the trimming information stored by the storage process, and generating a still image file of the generated trimmed image,
Program characterized Rukoto to execute the above processes in a computer.

Images