JP4349288B2 - Imaging apparatus, image processing method, and program - Google Patents

Description

  The present invention relates to an imaging device such as a digital camera capable of shooting a moving image, and more particularly to an imaging device having a function capable of creating a single still image that can be printed from moving image data obtained at the time of moving image shooting. The present invention relates to an image processing method and a program used for.

Conventionally, as an apparatus for converting a moving image into a still image, a printer apparatus described in Patent Document 1 is known. This Patent Document 1 discloses that a plurality of frame images are extracted from moving image data, and these frame images are arranged in a predetermined layout to create one printable still image data.
JP-A-9-130591

  Patent Document 1 described above converts a moving image to a still image on a printer device, and a still image cannot be obtained immediately from moving image data obtained at the time of moving image shooting. Furthermore, a still image created by the printer device described in Patent Document 1 is composed of a plurality of frame images arranged independently of the shutter timing. For this reason, there is a problem that a troublesome editing work such as rearranging the frame image corresponding to the shutter scene is required later.

  The present invention has been made in view of the above-described points, and a still image in which each frame image including a shutter scene is appropriately arranged by using moving image data obtained at the time of moving image shooting without requiring editing work by a user. An object of the present invention is to provide an imaging apparatus, an image processing method, and a program capable of easily obtaining an image.

An imaging apparatus according to claim 1 of the present invention is instructed by an imaging unit that continuously images a subject, an instruction unit that instructs an arbitrary timing during continuous imaging by the imaging unit, and the instruction unit. Moving image recording means for recording a plurality of image data captured by the imaging means as moving image data during a predetermined time before and after the timing as a reference, and a predetermined position for designating the arrangement position of the main frame and other frames According to the layout information, a still image creating means for arranging and synthesizing a plurality of frame images included in the moving image data to be made into a still image to create one still image, and the one still image creating means by the still image creating means When creating a still image, the main frame is arranged from among a plurality of frame images included in the moving image data to be converted into the still image. Frame specifying means for specifying a frame image to be processed, wherein the frame specifying means uses the moving image data recorded by the moving image recording means as a still image target to generate the one still image by the still image creating means. When creating, a frame image corresponding to the timing instructed by the instruction means is specified as a frame image to be arranged as the main frame.

The invention according to claim 2 of the present invention further identifies a frame image corresponding to an instruction timing by the instruction means from among a plurality of frame images included in the moving picture data stored and recorded by the moving picture recording means. Further comprising identification information recording means for recording identification information for identifying the frame image identified by the identification information recorded by the identification information recording means as a frame image to be arranged as the main frame. It is characterized by doing.

According to a third aspect of the present invention, the frame determination means further includes a frame image to be arranged as the main frame from among a plurality of frame images included in the moving image data to be the still image. And a frame image to be arranged as the other frame is specified.

Further, the invention described in claim 4 of the present invention is further characterized in that the still image creating means arranges the main frame in a form different from the other frame images.

Further, the invention according to claim 5 of the present invention further includes a reproducing unit for reproducing the moving image data recorded in the moving image recording unit, and a frame image obtained at the photographing timing when reproducing the moving image data by the reproducing unit. A playback control unit for initial display; and a creation instruction unit for instructing creation of a still image. The still image creation unit performs initial display by the playback control unit when the creation instruction unit instructs to create a still image. A still image in which the frame image thus arranged is arranged as a main frame is created.

Further, according to the sixth aspect of the present invention, the moving image data recorded by the moving image recording means is set as a still image target in response to a user's instruction operation. Manual control means for executing a process for creating a still image;

According to a seventh aspect of the present invention, there is further provided setting means for a user to arbitrarily set a predetermined operation mode related to moving image still image, and the moving image recording means according to an instruction from the instruction means. After recording the moving image data, a determination unit that determines whether or not the predetermined operation mode is set; and when the determination unit determines that the predetermined operation mode is set, Even if there is no user instruction from the control unit, after the moving image data is recorded by the moving image recording unit in accordance with the instruction from the instruction unit, the moving image data is automatically set as a still image target by the still image creating unit. And an automatic control means for executing a process of creating the one still image.

An image processing method according to claim 8 of the present invention is an image processing method used for an imaging apparatus including an imaging unit that continuously images a subject, and indicates an arbitrary timing during continuous imaging by the imaging unit. An instruction step for recording, a moving image recording step for recording a plurality of image data picked up by the imaging means as moving image data during a predetermined time before and after the timing indicated by the instruction step, and an arrangement position of the main frame A still image creating step for creating a single still image by arranging and synthesizing a plurality of frame images included in moving image data to be made into a still image in accordance with predetermined layout information for designating an arrangement position of other frames When the one still image is created by the still image creating step, A frame specifying step for specifying a frame image to be arranged as the main frame from a plurality of frame images included in the data, wherein the frame specifying step converts the moving image data recorded in the moving image recording step into a still image The frame image corresponding to the timing instructed by the instruction step is specified as the frame image to be arranged as the main frame when the one still image is generated by the still image generation step as the target of Features.

According to a ninth aspect of the present invention, there is provided a program for instructing a computer mounted in an image pickup apparatus having an image pickup means for continuously picking up a subject to any timing during continuous image pickup by the image pickup means. Moving image recording means for recording a plurality of pieces of image data captured by the imaging means as moving image data during a predetermined time before and after the timing instructed by the instruction means, the arrangement position of the main frame, and other Still image creating means for creating a single still image by arranging and synthesizing a plurality of frame images included in moving image data to be made into a still image according to predetermined layout information for designating a frame arrangement position; When the one still image is generated by the still image generating means, a plurality of frames included in the moving image data to be converted into the still image are included. A program for functioning as a frame specifying means for specifying a frame image to be arranged as the main frame from among the frame images, wherein the frame specifying means is for subjecting the moving picture data recorded by the moving picture recording means to a still image When the one still image is created by the still image creating means, a frame image corresponding to the timing instructed by the instruction means is specified as a frame image to be arranged as the main frame. To do.

According to the present invention, in response to a timing instruction during continuous imaging, a plurality of frame images captured before and after the instruction timing are stored as moving image data, and the recorded moving image data is stored in advance as main data. The frame image corresponding to the timing instruction is specified as the frame image to be arranged as the main frame when the still image is made according to the predetermined layout information in which the arrangement position of the frame and other frames is determined. The user can only specify the timing once, and the range of video data to be recorded and the main frame for making this video still will be determined automatically, so that it can be obtained during video shooting without the need for user editing. Still images with each frame image including shutter scenes properly arranged It can be simply obtained.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a diagram showing an external configuration when a digital camera is taken as an example of an imaging apparatus according to an embodiment of the present invention. FIG. 1 (a) is mainly a front configuration, and FIG. It is a perspective view which shows the structure of a back surface.

  The digital camera 1 has a photographing lens 3, a self-timer lamp 4, an optical viewfinder window 5, a strobe light emitting unit 6, a microphone unit 7 and the like on the front surface of a substantially rectangular thin plate-like camera body 2, and the (user) For example, a power key 8 and a shutter key 9 are provided on the right end side.

  The power key 8 is a key operated every time the power is turned on / off, and the shutter key 9 is a key for instructing a photographing timing at the time of photographing.

  Also, on the back of the digital camera 1, a shooting mode (R) key 10, a playback mode (P) key 11, an optical viewfinder 12, a speaker unit 13, a macro key 14, a strobe key 15, a menu (MENU) key 16, a ring A key 17, a set (SET) key 18, a display unit 19, and the like are provided.

  The shooting mode key 10 is operated automatically from the power-off state to automatically turn on the power and shift to the still image shooting mode. On the other hand, by repeatedly operating from the power-on state, the still image mode and the moving image mode are switched. Set cyclically. The still image mode is a mode for photographing a still image. The moving image mode is a mode for shooting a moving image. This movie mode includes a “standard movie mode” for shooting standard movies, a “pasto movie mode” for shooting momentary movies, and a “short movie mode” for shooting short-term movies. These modes are appropriately switched by operating the menu key 16. The “pasted movie mode” and the “short movie mode” will be described later with reference to FIGS.

  When the playback mode key 11 is operated from the power-off state, the playback mode key 11 is automatically turned on to enter the playback mode. The optical viewfinder 12 is used for optically confirming a subject to be photographed by a user during photographing.

  The macro key 14 is operated when switching between normal shooting and macro shooting in the still image shooting mode. The strobe key 15 is operated when switching the light emission mode of the strobe light emitting unit 6. The menu key 16 is operated when selecting various menu items. The ring key 17 is integrally formed with item selection keys in the up, down, left, and right directions, and the set key 18 located in the center of the ring key 17 sets the item selected at that time. To operate.

  The display unit 19 is composed of a color liquid crystal panel with a backlight, and displays a through image on the monitor as an electronic viewfinder in the photographing mode, and reproduces and displays the selected image and the like in the reproduction mode.

  Although not shown, the digital camera 1 has a memory card slot for attaching / detaching a memory card used as a recording medium, a serial interface connector for connecting to an external personal computer, etc., for example, USB (Universal). Serial Bus) connector and the like are provided.

  FIG. 2 is a block diagram showing an electronic circuit configuration of the digital camera 1.

  In the digital camera 1, a lens optical system 22 including a focus lens and a zoom lens (not shown) constituting the photographing lens 3 is provided so as to be movable within a predetermined range in the optical axis direction by driving a motor 21. A CCD (charge coupled device) 23, which is an image sensor, is disposed behind the optical axis. The CCD 23 receives light from each part of the subject input through the photographing lens 3 and outputs an electrical signal corresponding to the intensity of the light.

  In the recording mode, which is the basic mode, the CCD 23 is scanned and driven by a timing generator (TG) 24 and a driver 25, and outputs a photoelectric conversion output corresponding to a light image formed at regular intervals for one screen. The photoelectric conversion output of the CCD 23 is appropriately gain-adjusted for each primary color component of RGB in the state of an analog value signal, sampled and held by the sample hold circuit 26, and converted into digital data by the A / D converter 27. The

  Then, in the color process circuit 28, image processing including pixel interpolation processing and γ correction processing is performed to generate a digital luminance signal Y and color difference signals U and V (Cb, Cr), and DMA (Direct Memory Access). ) Output to the controller 29.

  The DMA controller 29 once uses the luminance signal Y and the color difference signals U and V output from the color process circuit 28 by using the composite synchronization signal, the memory write enable signal, and the clock signal from the color process circuit 28 once. And the DMA transfer to the DRAM 31 used as the buffer memory via the DRAM interface (I / F) 30.

  The control unit 32 controls the entire digital camera 1 and is constituted by a microcomputer including a CPU, a ROM storing an operation program executed by the CPU, a RAM used as a work memory, and the like. . In the present embodiment, the control unit 32 includes time T1 and time T2 before and after the shutter arbitrarily set in a “short movie mode” described later, and a layout used for creating a still image in the “motion print mode”. A setting storage unit 32a for storing information La is included.

  After the DMA transfer of the luminance and color difference signals to the DRAM 31 is completed, the control unit 32 reads the luminance and color difference signals from the DRAM 31 via the DRAM interface 30 and writes them to the VRAM 34 via the VRAM controller 33.

  The digital video encoder 35 periodically reads the luminance and color difference signals from the VRAM 34 via the VRAM controller 33, generates a video signal based on these data, and outputs the video signal to the display unit 19.

  As described above, the display unit 19 functions as a monitor display unit (electronic finder) at the time of shooting. By performing display based on the video signal from the digital video encoder 35, the display unit 19 captures from the VRAM controller 33 at that time. An image based on the image information is displayed in real time.

  As described above, when the image at that time is displayed in real time as the monitor image on the display unit 19, for example, when the shutter key 9 is pressed at a timing at which still image shooting is desired, a trigger signal is generated.

  In response to the trigger signal, the control unit 32 immediately stops the path from the CCD 23 to the DRAM 31 immediately after the DMA transfer of the luminance and color difference signals for one screen captured from the CCD 23 to the DRAM 31 is completed. , Transition to the record storage state.

  In this recording and storage state, the control unit 32 outputs the luminance and color difference signals for one frame written in the DRAM 31 to 8 pixels × 8 pixels for each of Y, Cb, and Cr components via the DRAM interface 30. The data is read out in units called basic blocks, written in a JPEG (Joint Photographic Coding Experts Group) circuit 37, and this JPEG circuit 37 uses an ADCT (Adaptive Discrete Cosine Transform), which is an entropy coding system. Data compression is performed by processing such as conversion.

  The obtained code data is read out from the JPEG circuit 37 and written in the recording memory 38 as a data file of one image. The memory 38 includes a memory card that is detachably mounted as a recording medium in addition to an internal memory such as a flash memory built in the main body in advance. With the compression processing of the luminance and color difference signals for one frame and the completion of writing all the compressed data to the memory 38, the control unit 32 activates the path from the CCD 23 to the DRAM 31 again.

  The control unit 32 is further connected with an audio processing unit 39, a USB interface (I / F) 40, and a strobe driving unit 41.

  The sound processing unit 39 includes a sound source circuit such as a PCM sound source, digitizes a sound signal input from the microphone unit (MIC) 7 during sound recording, and performs a predetermined data file format such as MP3 (MPEG-1 audio layer). 3) Data compression is performed in accordance with the standard to create an audio data file and send it to the memory 38. On the other hand, when reproducing the audio, the audio data file read from the memory 38 is uncompressed and converted into an analog signal. The sound is output through a speaker unit (SP) 13 provided on the back side.

  The USB interface 40 performs communication control when image data and other information are transmitted / received to / from another information terminal device such as a personal computer connected by wire via a USB connector. The strobe drive unit 41 charges a strobe capacitor (not shown) at the time of shooting, and then drives the strobe light emitting unit 6 to flash based on control from the control unit 32.

  In addition to the shutter key 9 described above, the key input unit 36 includes a power key 8, a shooting mode key 10, a playback mode key 11, a macro key 14, a strobe key 15, a menu key 16, a ring key 17, and a set key. 18 and the like, and signals accompanying these key operations are sent directly to the control unit 32.

  Further, when shooting a moving image instead of a still image, when the shutter key 9 is pressed, the captured moving image is compressed by the JPEG circuit 37 using a technique such as motion-JPEG and recorded in the memory 38. . When the shutter key 9 is operated again, the recording of the moving image data is finished.

  On the other hand, in the playback mode which is the basic mode, the control unit 32 selectively reads out the image data recorded in the memory 38 and is compressed by a procedure completely opposite to the procedure of data compression in the recording mode by the JPEG circuit 37. Decompress image data. The decompressed image data is held in the DRAM 31 via the DRAM interface 30, and then the content held in the DRAM 31 is stored in the VRAM 34 via the VRAM controller 33. The image data is periodically read out from the VRAM 34. A video signal is generated and reproduced and output by the display unit 19.

  If the selected image data is not a still image but a moving image, the multiple frames of still image data that make up the moving image data are played back and displayed sequentially in chronological order, and all the still image data is played back. For example, the top still image data is displayed until the next playback instruction is given.

  Here, the “pasted movie mode” and the “short movie mode” will be described with reference to FIGS. 3 and 4.

  FIG. 3 is a diagram for explaining the “pasted movie mode” provided in the digital camera 1, and FIG. 4 is a diagram for explaining the “short movie mode” provided in the digital camera 1. In the “standard movie mode”, which is a normal moving image mode, shooting starts at the timing when the shutter key 9 is pressed, and the shot image at that time is recorded. Then, when the shutter key 9 is pressed again, shooting is finished. In contrast, the “pasted movie mode” and the “short movie mode” are characterized in that a moving image is recorded before the shutter key 9 is pressed.

  That is, as shown in FIG. 3, in the “pasto movie mode”, the buffered image is constantly updated while updating a predetermined amount of captured images (past images) before the shutter key 9 is pressed, and the shutter key 9 is pressed. When this is done, actual recording is performed from the captured image T seconds before, and then the imaging is terminated when the shutter key 9 is pressed. The value of T is preset and is, for example, 5 seconds. That is, in the “pasto movie mode”, a moving image can be recorded within the limit of the memory capacity from a captured image T seconds before the shutter key 9 is pressed. As a result, it is possible to prevent missing of the decisive moment.

  On the other hand, as shown in FIG. 4, in the “short movie mode”, when a shutter key 9 is pressed once, moving images of a few seconds before and after that are recorded. That is, in this “short movie mode”, it is not necessary to give an instruction to end shooting, and a movie can be shot for several seconds by pressing the shutter key 9 once.

  The photographing time at this time can be arbitrarily set by the user on a time setting screen 51 as shown in FIG. The time setting screen 51 is displayed by operating the menu key 16, and is configured to individually set the times T1 and T2 before and after the shutter by operating the up / down / left / right cursor keys. In the figure, 52 is a time setting unit before the shutter, and 53 is a time setting unit after the shutter. Note that the shortest time and the longest time that can be taken are determined in advance. For example, the shortest time is 2 seconds and the longest time is 8 seconds, and the times T1 and T2 before and after the shutter can be set within this range.

  At this time, the “motion print mode” can be set in advance. The “motion print mode” is a function for creating one still image that can be printed from a moving image. When this function is set to ON, each frame of the moving image data recorded in the “short movie mode” is set. One still image that can be printed using the image can be automatically created.

  Reference numeral 54 in the figure denotes a motion print setting unit. By selecting this, the “motion print mode” is set to ON. In addition, when ON is set, a layout selection screen (not shown) is displayed, and a desired one can be selected from previously prepared still image layouts (designs).

  FIGS. 6A to 6D show an example of the still image layout, and the number of frames, the size, and the arrangement of a plurality of frame images constituting the moving image are different from each other. FIG. 6A shows an example of nine frames, and a main frame image (also referred to as a highlight frame) is arranged in the center. FIG. 5B shows an example of one frame, which is composed only of the main frame image (highlight frame). In addition, layouts such as those shown in FIGS.

  FIG. 7 is an explanatory diagram showing a specific data structure of the still image layout shown in FIG. The layout data 101 includes a plurality of setting information determined for each of a plurality of data items of ID00 to ID18.

  In the illustrated data item, “layout number” of ID00 is an identification number indicating the type of layout. The “highlight frame” of ID04 and the “frame” of ID05 to 13 are arrangement regions (positions and sizes) of frame images in still images, and the “highlight frame” is a main frame having a larger size than the other frames. One frame image arrangement area Fa, “frame” is data indicating the image arrangement area Fb of other frames. Note that “highlight frame” may not exist depending on the type of layout, and the number of data of “frame” increases or decreases depending on the type of layout. Further, the “bitmap” of IDs 14 to 17 is a decoration image and data indicating its arrangement.

Next, the operation of the embodiment will be described.
Note that the processes shown in the following flowcharts are executed when the control unit 32, which is a microcomputer, reads a program.

  FIG. 8 and FIG. 9 are flowcharts showing the shooting process of the digital camera 1 in the embodiment, and shows the process when the shooting mode is set by operating the shooting mode key 10. As described above, the shooting mode includes the still image mode and the moving image mode, and the moving image mode includes “pasted movie mode” and “short movie mode” in addition to the “standard movie mode”. These modes are appropriately switched by operating the menu key 16.

  When the still image mode is set (Yes in Step A11), still image shooting processing is executed (Step A12). In this still image shooting process, image data obtained by the CCD 23 serving as an image sensor is displayed on the display unit 19 as a through image, and when the shutter key 9 is pressed, the image data is captured as a still image and is transmitted in a predetermined manner. It is compressed and recorded in the memory 38.

  On the other hand, when “standard movie mode” in the moving image mode is set (Yes in step A13), standard movie shooting processing is executed (step A14). This standard movie shooting process is the same as the normal movie shooting process. That is, when the through key is displayed and the shutter key 9 is pressed, the image data is captured as a moving image, compressed by a predetermined method, and sequentially recorded in the memory 38. When the shutter key 9 is pressed again, the photographing process (data recording operation) at that time ends.

  When the “pasted movie mode” is set (Yes in step A15), a past movie shooting process is executed (step A16). In the past movie shooting process, as described with reference to FIG. 3, a predetermined amount of shot images (past images) are temporarily stored in the buffer memory (DRAM 31 in FIG. 2) before the shutter key 9 is pressed, and the shutter key When 9 is pressed, actual recording is performed from the captured image T seconds before. Then, at the timing when the shutter key 9 is pressed again, the photographing process (data recording operation) at that time ends.

  Here, when the “short movie mode” is set (Yes in step A17), the short movie shooting process is executed, and as described with reference to FIG. A moving image is recorded for several seconds. At this time, if the “motion print mode” is set to ON, one still image that can be printed is automatically created from the moving image at that time.

  Hereinafter, the operation during moving image shooting in the “short movie mode” will be described in detail.

  As described above, in the “short movie mode”, the shooting time can be arbitrarily changed within a predetermined range. When there is an instruction to change the shooting time by a predetermined operation (Yes in Step A18), the control unit 32 displays the time setting screen 51 shown in FIG. 5 on the display unit 19 (Step A19). At this time, a live view image is displayed on the screen of the display unit 19, and a time setting screen 51 is displayed thereon.

  The control unit 32 changes the shooting time according to the time set in the time setting units 52 and 53 before the shutter on the time setting screen 51 (step A20). Note that the times T1 and T2 before and after the shutter that define the photographing time are held in the setting storage unit 32a shown in FIG. If there is no instruction to change the shooting time, the preset times T1 and T2 are applied as they are.

  During this time, the image data of the subject is acquired by the CCD 23 which is an image sensor, and the image data is displayed on the display unit 19 as a through image, while the frame image of the moving image is displayed in the buffer memory (DRAM 31 in this case). Are sequentially stored (step A21). At that time, the control unit 32 deletes the frame image of the moving image recorded before the time T1 from the buffer memory to secure a free area (step A22).

  Here, when shooting is instructed by pressing the shutter key 9 (Yes in step A23), the control unit 32 is obtained from the CCD 23 from the time when the shooting instruction is given until the time T2 elapses. The stored image data is stored in the buffer memory in the chronological order as a frame image of the moving image (step A24).

  Then, after the time T2 has elapsed (Yes in step A25), the control unit 32 creates a moving image file based on the plurality of frame images stored in the buffer memory between the times T1 and T2 (step A26). More specifically, a moving image data obtained by continually merging a plurality of frame images in time series is compressed by a predetermined method to create one moving image file, and this is stored as another moving image in a memory 38 for storing the moving image data as a short movie. Record separately from the data. At this time, a shutter flag is added as identification information indicating that to the frame image obtained at the time of the shutter operation (step A27).

  In addition to the method of adding the identification information directly to the frame image, the frame image obtained at the time of the shutter operation may be identified using, for example, a management table for managing each frame image.

  Further, after the creation of the short movie moving image, the control unit 32 determines whether or not the “motion print mode” is set to ON (step A28). As described with reference to FIG. 5, the “motion print mode” is set to ON by selecting the motion print setting unit 54 on the time setting screen 51. When the “motion print mode” is set to ON (Yes in step A28), the control unit 32 immediately executes the motion print process using the moving image file recorded in the memory 38 as a short movie moving image (step A29). . The motion print process will be described in detail later using the flowchart of FIG.

  When the end of shooting is instructed (Yes in step A30), the shooting process here ends.

  FIG. 10 is a flowchart showing the motion print process executed in step A29. As described above, if the “motion print mode” is set to ON when a short movie moving image is created, one still image data that can be printed is automatically created based on the moving image data.

  The layout of the still image is basically selected when the user sets the “motion print mode” to ON, but can be changed to another layout at an arbitrary timing.

  That is, when there is a layout change instruction by a predetermined operation (Yes in Step B11), a layout setting screen (not shown) is displayed on the display unit 19 (Step B12). When a layout desired by the user is selected from the still image layouts as shown in FIGS. 6A to 6D, the layout information La stored in the setting storage unit 32a is changed according to the selected layout. (Step B13). The layout information La is data indicating the design of a still image generated when a moving image is converted into a still image, that is, the number, size, arrangement, and the like of a plurality of frame images (frames) constituting the moving image. If there is no layout change instruction, the preset layout information La is applied as it is.

  Here, the control unit 32 acquires a moving image file to be a still image from the memory 38 (step B14), and then converts the moving image data of the moving image file into a still image at the shooting timing (shutter operation timing). Based on the moving image data, a frame image to be a main frame and other frame images are determined (step B15).

  Specifically, a frame image obtained at the time of a shutter operation, that is, a frame image with a shutter flag added is extracted as a main frame, and other frame images (subframes) before and after the frame image are determined by the number of frames determined by the layout information La. Extract. At this time, if moving image data to be converted into a still image is compressed, it is decompressed as necessary, and each frame image is extracted to create a still image.

  When the main frame and other frame images are determined in this manner, the control unit 32 extracts these frame images from the moving image data, and then divides them into the main frame and other frame images based on the layout information La. One still image that can be arranged and printed is created (step B16).

  Specifically, for example, when a layout as shown in FIG. 6A is selected, a nine-frame frame image including a main frame (a frame image to which a shutter flag is added) is used. Then, the main frame is made larger than the sub-frame which is the other frame image and arranged at the center, and the sub-frame is arranged at the top and bottom of the main frame with a small size to create one still image.

  FIG. 11 shows an example of the still image. The main frame is arranged in a different form from the other frames at the center and corresponds to the shutter scene. The size of the main frame is about four times that of other frame images (subframes).

  If the layout shown in FIG. 7B is selected, one still image is created using only the main frame.

  The still image data created in this way is compressed by a predetermined method as necessary, and is recorded in the storage memory 38 as one still image file (step B17). The still image data may be transferred to the printer without being recorded in the memory 38.

  Thus, the main frame and other frame images are determined based on the shooting timing at the time of moving image shooting, and a still image in which these frames are arranged is automatically created. Therefore, it is possible to easily obtain a still image in which each frame image including a shutter scene is appropriately arranged using the moving image data obtained at the time of moving image shooting without requiring editing work by the user.

  Note that when creating a still image in which a plurality of frame images are arranged as shown in FIG. 11, the frame images before and after the shutter operation are used as subframes, but the frame images before the shutter operation may be used as subframes. .

  In addition to the “short movie mode”, the same motion print processing as described above may be executed during moving image shooting in the “pasted movie mode”, and a still image may be created from the moving image data shot at that time. In this case, the main frame and other frame images (subframes) are determined based on the first shutter operation.

  Further, not only when shooting a moving image, the user designates a moving image file to be a still image from each moving image file already recorded in the memory 38 at an arbitrary timing. Alternatively, a single printable still image may be created using the moving image data constituting the moving image file.

(Other embodiments)
Next, as another embodiment of the present invention, a case where a motion print process is executed at the time of reproducing a moving image will be described.

  FIG. 12 is a flowchart showing the playback process of the digital camera 1 according to another embodiment of the present invention, and shows the process when the playback mode is set by operating the playback mode key 11.

  When the user selects a video file to be played back by a predetermined operation in the state where the playback mode is set (step C11), the control unit 32 firstly selects the selected video file as video data of a short movie. It is determined whether or not there is (step C12). As a result, if the video data is a short movie (Yes in Step C12), the control unit 32 searches the frame image obtained at the time of the shutter operation based on the shutter flag from each frame image constituting the video data, This is set as the current frame (step C13).

  On the other hand, if it is other than the moving image data by the short movie (No in Step C12), the first frame image in the moving image data is set as the current frame (Step C14).

  Next, the control unit 32 reproduces and displays the current frame image on the display unit 19 (step C15). In this case, if the video data is a short movie, the frame image obtained at the time of the shutter operation is initially displayed.

  When the user operates the menu key 16 to instruct the “motion print mode” that is the still image creation mode (Yes in step C16), the control unit 32 displays the current frame image that is currently displayed. Motion print processing is executed as a main frame (step C17). Since the motion print process is the same as that in the above embodiment, a detailed description thereof will be omitted here.

  If there is no instruction for “motion print mode” (No in step C16), the control unit 32 displays next in accordance with a user instruction operation such as frame advance, fast forward, and fast reverse as normal playback processing. A power frame image is selected and displayed on the screen of the display unit 19 (step C18). When there is an instruction to end reproduction (Yes in step C19), the processing here ends.

  In this way, even during moving image reproduction, a single printable still image can be easily created using the moving image data being reproduced.

  In each of the embodiments described above, the digital camera has been described as an example. However, the present invention can be applied to any electronic device having a video shooting function, such as a mobile phone with a camera or a PDA (Personal Digital Assistant). It is.

  In short, the present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying constituent elements without departing from the scope of the invention in the implementation stage. Various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the respective embodiments. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

  In addition, the method described in the above-described embodiment is a program that can be executed by a computer, such as a magnetic disk (flexible disk, hard disk, etc.), an optical disk (CD-ROM, DVD-ROM, etc.), a semiconductor memory, etc. The program can be written on a medium and applied to various apparatuses, or the program itself can be transmitted through a transmission medium such as a network and applied to various apparatuses. A computer that implements this apparatus reads a program recorded on a recording medium or a program provided via a transmission medium, and performs the above-described processing by controlling operations by this program.

FIG. 1 is a diagram showing an external configuration when a digital camera is taken as an example of an imaging apparatus according to an embodiment of the present invention. FIG. 1 (a) is mainly a front configuration, and FIG. It is a perspective view which shows the structure of a back surface. FIG. 2 is a block diagram showing an electronic circuit configuration of the digital camera in the embodiment. FIG. 3 is a diagram for explaining a “pasted movie mode” provided in the digital camera according to the embodiment. FIG. 4 is a diagram for explaining a “short movie mode” provided in the digital camera according to the embodiment. FIG. 5 is a diagram showing an example of a time setting screen for setting the shooting time of the “short movie mode” in the embodiment. FIG. 6 is a diagram showing an example of a “motion print mode” still image layout provided in the digital camera according to the embodiment. FIG. 7 is an explanatory diagram showing a specific data structure of the still image layout in the embodiment. FIG. 8 is a flowchart showing a photographing process of the digital camera in the embodiment. FIG. 9 is a flowchart showing a photographing process of the digital camera in the embodiment. FIG. 10 is a flowchart showing motion print processing of the digital camera in the embodiment. FIG. 11 is a diagram illustrating an example of a still image created by the motion print process of the digital camera in the embodiment. FIG. 12 is a flowchart showing a playback process of a digital camera according to another embodiment of the present invention.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Digital camera, 2 ... Camera body, 3 ... Shooting lens, 4 ... Self-timer lamp, 5 ... Optical finder window, 6 ... Strobe light emission part, 7 ... Microphone part, 8 ... Power key, 9 ... Shutter key, 10 ... Shooting mode key, 11 ... Playback mode key, 12 ... Optical viewfinder, 13 ... Speaker unit, 14 ... Macro key, 15 ... Strobe key, 16 ... Menu (MENU) key, 17 ... Ring key, 18 ... Set (SET) key , 19 ... Display section, 21 ... Motor, 22 ... Lens optical system, 23 ... CCD, 24 ... Timing generator (TG), 25 ... Driver, 26 ... Sample hold circuit (S / H), 27 ... A / D conversion 28 ... color process circuit, 29 ... DMA controller, 30 ... DRAM interface (I / F), 31 ... DRAM, 32 ... control unit, 32a Setting storage unit 33 ... VRAM controller 34 ... VRAM 35 ... Digital video encoder 36 ... Key input unit 37 ... JPEG circuit 38 ... Memory 39 ... Audio processing unit 40 ... USB interface (I / F) 41 ... Strobe drive unit, 51 ... Time setting screen, 52 ... Time setting unit before shutter, 53 ... Time setting unit after shutter, 54 ... Motion print setting unit.

Claims (9)

Imaging means for continuously imaging a subject ;
Instruction means for instructing arbitrary timing during continuous imaging by the imaging means ;
A moving image recording unit that records a plurality of image data captured by the imaging unit as moving image data during a predetermined time before and after the timing instructed by the instruction unit ;
A single still image is created by arranging and synthesizing multiple frame images included in the moving image data to be converted into a still image according to predetermined layout information that specifies the arrangement position of the main frame and other frames. Still image creation means to
When creating the one still image by the still image creating means, a frame image to be arranged as the main frame is specified from among a plurality of frame images included in the moving image data to be converted into the still image Frame specifying means,
The frame specifying means, when creating the one still picture by the still picture creating means with the moving picture data recorded by the moving picture recording means as a still image target, at the timing instructed by the instruction means. An image pickup apparatus that identifies a corresponding frame image as a frame image to be arranged as the main frame . Identification information recording means for recording identification information for identifying a frame image corresponding to an instruction timing by the instruction means among a plurality of frame images included in the moving image data stored and recorded by the moving image recording means. ,
2. The imaging apparatus according to claim 1, wherein the frame specifying unit specifies a frame image identified by the identification information recorded by the identification information recording unit as a frame image to be arranged as the main frame. The frame determination means specifies a frame image to be arranged as the main frame from among a plurality of frame images included in the moving image data to be the still image, and a frame to be arranged as the other frame. The imaging apparatus according to claim 1, wherein an image is specified. The still image forming means, the image pickup apparatus according to any one of claims 1 to 3, wherein placing the main frame in different forms and the other frame images. Reproducing means for reproducing the moving image data recorded in the moving image recording means;
Reproduction control means for initially displaying the frame image obtained at the shooting timing when reproducing the moving image data by the reproduction means;
Comprising creation instruction means for instructing still image creation,
The still image creating unit creates a still image in which a frame image initially displayed by the reproduction control unit is arranged as a main frame when a still image creation is instructed by the creation instruction unit. Item 2. The imaging device according to Item 1. Manual control means for executing processing for creating the one still image by the still image creation means as a still image target for moving image data recorded by the movie recording means in response to a user's instruction operation;
The imaging apparatus according to claim 1, further comprising: A setting means for the user to arbitrarily set a predetermined operation mode related to the still image of the moving image;
Determining means for determining whether or not the predetermined operation mode is set after recording moving image data by the moving image recording means in response to an instruction by the instruction means;
If it is determined by the determining means that the predetermined operation mode is set, the moving image data is recorded by the moving image recording means in response to an instruction from the instruction means even if there is no user instruction from the manual control means. Automatic control means for automatically executing the process of creating the one still picture by the still picture creation means as a still image target after the video data is recorded,
The imaging apparatus according to claim 6, further comprising: In an image processing method used in an imaging apparatus including an imaging unit that continuously images a subject,
An instruction step for instructing an arbitrary timing during continuous imaging by the imaging means;
A moving image recording step of recording a plurality of image data captured by the imaging unit as moving image data during a predetermined time before and after the timing instructed by the instruction step;
A single still image is created by arranging and synthesizing multiple frame images included in the moving image data to be converted into a still image according to predetermined layout information that specifies the arrangement position of the main frame and other frames. A still image creation step,
When creating the one still image by the still image creating step, a frame image to be arranged as the main frame is specified from among a plurality of frame images included in the moving image data to be converted into the still image Frame identification step,
In the frame specifying step, the moving image data recorded in the moving image recording step is set as a still image target, and when the one still image is generated in the still image generating step, the timing is instructed in the instruction step. An image processing method, wherein a corresponding frame image is specified as a frame image to be arranged as the main frame. A computer mounted on an imaging device having imaging means for continuously imaging a subject,
Instruction means for instructing arbitrary timing during continuous imaging by the imaging means;
A moving image recording unit that records a plurality of image data captured by the imaging unit as moving image data during a predetermined time before and after the timing instructed by the instruction unit;
A single still image is created by arranging and synthesizing multiple frame images included in the moving image data to be converted into a still image according to predetermined layout information that specifies the arrangement position of the main frame and other frames. Still image creation means to
When creating the one still image by the still image creating means, a frame image to be arranged as the main frame is specified from among a plurality of frame images included in the moving image data to be converted into the still image A program that functions as a frame specifying means,
The frame specifying means, when creating the one still picture by the still picture creating means with the moving picture data recorded by the moving picture recording means as a still image target, at the timing instructed by the instruction means. A program for specifying a corresponding frame image as a frame image to be arranged as the main frame.

Images