JP4535089B2 - Imaging apparatus, image processing method, and program - Google Patents

Description

The present invention relates to an imaging device such as a digital camera capable of shooting a moving image, and particularly targets moving image data obtained at the time of moving image shooting, and an imaging device having a function of performing various processes after storing and recording the moving image data ; The present invention relates to an image processing method and a program used in the imaging apparatus.

Conventionally, as an apparatus for converting a moving image into a still image, a printer apparatus described in Patent Document 1 is known. This Patent Document 1 discloses that a plurality of frame images are extracted from moving image data, and these frame images are arranged in a predetermined layout to create one printable still image data.
JP-A-9-130591

  Patent Document 1 described above converts a moving image to a still image on a printer device, and a still image cannot be obtained immediately from moving image data obtained at the time of moving image shooting. Furthermore, a still image created by the printer device described in Patent Document 1 is composed of a plurality of frame images arranged independently of the shutter timing. For this reason, there is a problem that a troublesome editing work such as rearranging the frame image corresponding to the shutter scene is required later.

The present invention has been made in view of the above points. When various processes are performed using moving image data obtained at the time of moving image shooting without requiring editing by the user , specific processing is performed in these processes. An object of the present invention is to provide an imaging apparatus, an image processing method, and a program capable of easily selecting meaningful image data .

An imaging apparatus according to claim 1 of the present invention is a mode for selectively setting one of a plurality of moving image shooting modes including an image capturing unit that images a subject and a first moving image shooting mode and a second moving image shooting mode. When the setting means, the instruction means for instructing an arbitrary timing, and the first moving image shooting mode are set, the image pickup means starts an operation of continuously imaging a subject, and then the instruction When an arbitrary timing is instructed by the means, a plurality of image data picked up by the image pickup means are stored and recorded as moving image data during a predetermined time before and after the instruction timing as a reference. The first moving image to which the identification information for identifying the image data corresponding to the instruction timing is added and recorded among the plurality of image data included in the moving image data Recording means and when the second moving image shooting mode is set, the imaging means between the time when an arbitrary timing is first designated by the instruction means and the time when an arbitrary timing is designated next The second moving image recording means for storing and recording the plurality of image data captured by the above as moving image data without adding the identification information, the moving image data photographed by the first moving image recording means, and the second from among the plurality of moving image data including a moving picture data photographed by the video recording means, and selection means for selecting the moving image data to be predetermined processing using a plurality of image data included in the moving picture data, wherein The moving image data selected by the selection means is moving image data shot by the first moving image recording means or moving image data shot by the second moving image recording means A determination unit that determines whether the video data is captured by the first video recording unit by the determination unit; and a plurality of pieces of image data included in the selected video data are When the predetermined processing used is performed, the image data indicated by the identification information is processed as special image data among the plurality of image data included in the moving image data, and the second determination unit performs the second processing. When it is determined that the video data is captured by the video recording means, the image indicated by the identification information is used when performing a predetermined process using a plurality of image data included in the selected video data. And control means for performing processing without handling the data as special image data.

According to a second aspect of the present invention, in the imaging apparatus according to the first aspect, the predetermined process using the moving image data is a process of sequentially reproducing and displaying a plurality of image data included in the moving image data. And when the determining means determines that the moving image data is taken by the first moving image recording means, the control means includes a plurality of pieces of image data included in the selected moving image data. Then, when the image data indicated by the identification information is first reproduced and displayed, and the determination unit determines that the image data is captured by the second moving image recording unit, the selected data Of the plurality of image data included in the moving image data, the head image data is first reproduced and displayed .

Further, a third aspect of the present invention, in the above imaging apparatus according to claim 1, wherein the predetermined processing using the moving image data, place synthesizing a plurality of image data included in the moving image data in a predetermined layout A process of generating one piece of image data, and the control unit determines that the selected moving image data when the determining unit determines that the moving image data is captured by the first moving image recording unit; The image data indicated by the identification information is controlled to be arranged at the main position on the layout among the plurality of image data included in the image data .

According to a fourth aspect of the present invention, the apparatus further comprises temporary storage means for temporarily storing a plurality of image data obtained by imaging by the imaging means, wherein the first moving image recording means is instructed by the instruction means. A plurality of image data including image data that has already been temporarily stored in the temporary storage unit at the timing and image data that is newly captured by the imaging unit after the instruction timing is stored and recorded as moving image data. Features.

According to a fifth aspect of the present invention, among a plurality of image data temporarily stored in the temporary storage unit, an image not included in the moving image data stored and recorded by the first moving image recording unit It further comprises a discarding means for discarding the data without saving and recording.

According to a sixth aspect of the present invention, a plurality of images for a predetermined capacity are temporarily stored retroactively from the image last captured by the imaging unit, and a plurality of images to be subjected to primary storage are stored in the imaging unit. Further comprising primary storage control means for updating as a new image is captured by the first storage means, and the first moving picture recording means has already been primarily stored by the primary storage control means at an instruction timing by the instruction means. A plurality of images including the stored images are stored and recorded as moving image data.

Further, claim 7 of the present invention further comprises setting means for arbitrarily setting the predetermined time before or after the instruction timing, and the first moving image recording means is arranged before or after the instruction timing as a reference. A plurality of image data picked up by the image pickup means during a predetermined time set by the setting means is stored and recorded as moving image data.

According to an eighth aspect of the present invention, there is provided a program executed by a computer mounted on an imaging apparatus, the computer including an imaging unit that images a subject, a first moving image shooting mode, and a second moving image shooting. A mode setting means for selectively setting any one of a plurality of moving image shooting modes including a mode, an instruction means for instructing an arbitrary timing, and when the first moving image shooting mode is set, the imaging When the operation of continuously imaging the subject is started by the means, and then an arbitrary timing is instructed by the instruction means, the image is picked up by the imaging means for a predetermined time before and after the instruction timing. A plurality of image data are stored and recorded as moving image data, and the instruction among the plurality of image data included in the stored and recorded moving image data When the first moving image recording means for adding and recording the identification information for identifying the image data corresponding to the imming and the second moving image shooting mode are set, the instruction means first arbitrarily selects A plurality of image data picked up by the image pickup means between the time when the timing is specified and the time when the next arbitrary timing is specified is stored as moving image data without adding the identification information. A plurality of moving image data included in the moving image data among a plurality of moving image data including moving image recording means, moving image data shot by the first moving image recording means, and moving image data shot by the second moving image recording means. image selecting means for selecting the moving image data to be prescribed processing using the data, moving picture data selected by the selection means, the first moving image recording means Determination means for determining whether the moving image data is taken by the second moving image recording means or the moving image data taken by the first moving image recording means by the determining means. If it is determined that the identification information is included in the plurality of image data included in the moving image data when performing predetermined processing using the plurality of image data included in the selected moving image data. Is processed as special image data, and is included in the selected moving image data when the determining unit determines that the moving image data is captured by the second moving image recording unit Control means for performing processing without treating the image data indicated by the identification information as special image data when performing predetermined processing using a plurality of image data. It is characterized by functioning.

According to a ninth aspect of the present invention, in an image processing method used in an imaging apparatus including an imaging unit that continuously images a subject, a plurality of moving images including a first moving image shooting mode and a second moving image shooting mode are used. When the mode setting step for selectively setting one of the shooting modes, the instruction step for instructing an arbitrary timing, and the first moving image shooting mode are set, the imaging unit continuously sets the subject. Then, when an arbitrary timing is instructed by the instruction step, a plurality of image data captured by the imaging means during a predetermined time before and after the instruction timing is used as a reference. An image corresponding to the instruction timing among a plurality of image data included in the stored and recorded moving image data while being stored and recorded as moving image data When the first moving image recording step for adding and recording identification information for identifying the data and the second moving image shooting mode are set, an arbitrary timing is first indicated by the instruction step. A second moving image recording step for storing and recording a plurality of pieces of image data captured by the image pickup means as moving image data without adding the identification information between the time when the arbitrary timing is instructed and A plurality of pieces of image data included in the moving image data are selected from among a plurality of pieces of moving image data including the moving image data shot by the first moving image recording step and the moving image data shot by the second moving image recording step. a selection step of selecting a moving image data to be prescribed treatment with, video data selected by the selecting step, the first moving image recording A determination step of determining whether the moving image data is captured by the step or the moving image data captured by the second moving image recording step; and the moving image data captured by the first moving image recording step by the determination step If the predetermined processing using a plurality of image data included in the selected moving image data is performed, the identification among the plurality of image data included in the moving image data is performed. The image data indicated by the information is processed as special image data, and when it is determined by the determining step that the moving image data is captured by the second moving image recording step, the selected moving image data is included in the selected moving image data. When performing predetermined processing using a plurality of included image data, the image data indicated by the identification information is treated as special image data. And a control step for performing processing without any problems.

According to the present invention, it is possible to selectively set one of a plurality of movie shooting modes including the first movie shooting mode and the second movie shooting mode, and the second movie shooting mode is set. If the first moving image shooting mode is set , an arbitrary timing during continuous shooting by the imaging means is instructed before and after this instruction timing. Since moving image data including a plurality of captured image data is stored and recorded together with identification information indicating image data corresponding to the instruction timing, the instruction timing is used when performing some processing on the stored moving image data. Corresponding image data can be handled as image data having a specific meaning in this processing.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a diagram showing an external configuration when a digital camera is taken as an example of an imaging apparatus according to an embodiment of the present invention. FIG. 1 (a) is mainly a front configuration, and FIG. It is a perspective view which shows the structure of a back surface.

  The digital camera 1 has a photographing lens 3, a self-timer lamp 4, an optical viewfinder window 5, a strobe light emitting unit 6, a microphone unit 7 and the like on the front surface of a substantially rectangular thin plate-like camera body 2, and the (user) For example, a power key 8 and a shutter key 9 are provided on the right end side.

  The power key 8 is a key operated every time the power is turned on / off, and the shutter key 9 is a key for instructing a photographing timing at the time of photographing.

  Also, on the back of the digital camera 1, a shooting mode (R) key 10, a playback mode (P) key 11, an optical viewfinder 12, a speaker unit 13, a macro key 14, a strobe key 15, a menu (MENU) key 16, a ring A key 17, a set (SET) key 18, a display unit 19, and the like are provided.

  The shooting mode key 10 is operated automatically from the power-off state to automatically turn on the power and shift to the still image shooting mode. On the other hand, by repeatedly operating from the power-on state, the still image mode and the moving image mode are switched. Set cyclically. The still image mode is a mode for photographing a still image. The moving image mode is a mode for shooting a moving image. This movie mode includes a “standard movie mode” for shooting standard movies, a “pasto movie mode” for shooting momentary movies, and a “short movie mode” for shooting short-term movies. These modes are appropriately switched by operating the menu key 16. The “pasted movie mode” and the “short movie mode” will be described later with reference to FIGS.

  When the playback mode key 11 is operated from the power-off state, the playback mode key 11 is automatically turned on to enter the playback mode. The optical viewfinder 12 is used for optically confirming a subject to be photographed by a user during photographing.

  The macro key 14 is operated when switching between normal shooting and macro shooting in the still image shooting mode. The strobe key 15 is operated when switching the light emission mode of the strobe light emitting unit 6. The menu key 16 is operated when selecting various menu items. The ring key 17 is integrally formed with item selection keys in the up, down, left, and right directions, and the set key 18 located in the center of the ring key 17 sets the item selected at that time. To operate.

  The display unit 19 is composed of a color liquid crystal panel with a backlight, and displays a through image on the monitor as an electronic viewfinder in the photographing mode, and reproduces and displays the selected image and the like in the reproduction mode.

  Although not shown, the digital camera 1 has a memory card slot for attaching / detaching a memory card used as a recording medium, a serial interface connector for connecting to an external personal computer, etc., for example, USB (Universal). Serial Bus) connector and the like are provided.

  FIG. 2 is a block diagram showing an electronic circuit configuration of the digital camera 1.

  In the digital camera 1, a lens optical system 22 including a focus lens and a zoom lens (not shown) constituting the photographing lens 3 is provided so as to be movable within a predetermined range in the optical axis direction by driving a motor 21. A CCD (charge coupled device) 23, which is an image sensor, is disposed behind the optical axis. The CCD 23 receives light from each part of the subject input through the photographing lens 3 and outputs an electrical signal corresponding to the intensity of the light.

  In the recording mode, which is the basic mode, the CCD 23 is scanned and driven by a timing generator (TG) 24 and a driver 25, and outputs a photoelectric conversion output corresponding to a light image formed at regular intervals for one screen. The photoelectric conversion output of the CCD 23 is appropriately gain-adjusted for each primary color component of RGB in the state of an analog value signal, sampled and held by the sample hold circuit 26, and converted into digital data by the A / D converter 27. The

  Then, in the color process circuit 28, image processing including pixel interpolation processing and γ correction processing is performed to generate a digital luminance signal Y and color difference signals U and V (Cb, Cr), and DMA (Direct Memory Access). ) Output to the controller 29.

  The DMA controller 29 once uses the luminance signal Y and the color difference signals U and V output from the color process circuit 28 by using the composite synchronization signal, the memory write enable signal, and the clock signal from the color process circuit 28 once. And the DMA transfer to the DRAM 31 used as the buffer memory via the DRAM interface (I / F) 30.

  The control unit 32 controls the entire digital camera 1 and is constituted by a microcomputer including a CPU, a ROM storing an operation program executed by the CPU, a RAM used as a work memory, and the like. . In the present embodiment, the control unit 32 includes time T1 and time T2 before and after the shutter arbitrarily set in a “short movie mode” described later, and a layout used for creating a still image in the “motion print mode”. A setting storage unit 32a for storing information La is included.

  After the DMA transfer of the luminance and color difference signals to the DRAM 31 is completed, the control unit 32 reads the luminance and color difference signals from the DRAM 31 via the DRAM interface 30 and writes them to the VRAM 34 via the VRAM controller 33.

  The digital video encoder 35 periodically reads the luminance and color difference signals from the VRAM 34 via the VRAM controller 33, generates a video signal based on these data, and outputs the video signal to the display unit 19.

  As described above, the display unit 19 functions as a monitor display unit (electronic finder) at the time of shooting. By performing display based on the video signal from the digital video encoder 35, the display unit 19 captures from the VRAM controller 33 at that time. An image based on the image information is displayed in real time.

  As described above, when the image at that time is displayed in real time as the monitor image on the display unit 19, for example, when the shutter key 9 is pressed at a timing at which still image shooting is desired, a trigger signal is generated.

  In response to the trigger signal, the control unit 32 immediately stops the path from the CCD 23 to the DRAM 31 immediately after the DMA transfer of the luminance and color difference signals for one screen captured from the CCD 23 to the DRAM 31 is completed. , Transition to the record storage state.

  In this recording and storage state, the control unit 32 outputs the luminance and color difference signals for one frame written in the DRAM 31 to 8 pixels × 8 pixels for each of Y, Cb, and Cr components via the DRAM interface 30. The data is read out in units called basic blocks and written in a JPEG (Joint Photographic Coding Experts Group) circuit 37. The JPEG circuit 37 uses an ADCT (Adaptive Discrete Cosine Transform) and an entropy coding system. Data compression is performed by processing such as conversion.

  The obtained code data is read out from the JPEG circuit 37 and written in the recording memory 38 as a data file of one image. The memory 38 includes a memory card that is detachably mounted as a recording medium in addition to an internal memory such as a flash memory built in the main body in advance. With the compression processing of the luminance and color difference signals for one frame and the completion of writing all the compressed data to the memory 38, the control unit 32 activates the path from the CCD 23 to the DRAM 31 again.

  The control unit 32 is further connected with an audio processing unit 39, a USB interface (I / F) 40, and a strobe driving unit 41.

  The sound processing unit 39 includes a sound source circuit such as a PCM sound source, digitizes a sound signal input from the microphone unit (MIC) 7 during sound recording, and performs a predetermined data file format such as MP3 (MPEG-1 audio layer). 3) Data compression is performed in accordance with the standard to create an audio data file and send it to the memory 38. On the other hand, when reproducing the audio, the audio data file read from the memory 38 is uncompressed and converted into an analog signal. The sound is output through a speaker unit (SP) 13 provided on the back side.

  The USB interface 40 performs communication control when image data and other information are transmitted / received to / from another information terminal device such as a personal computer connected by wire via a USB connector. The strobe drive unit 41 charges a strobe capacitor (not shown) at the time of shooting, and then drives the strobe light emitting unit 6 to flash based on control from the control unit 32.

  In addition to the shutter key 9 described above, the key input unit 36 includes a power key 8, a shooting mode key 10, a playback mode key 11, a macro key 14, a strobe key 15, a menu key 16, a ring key 17, and a set key. 18 and the like, and signals accompanying these key operations are sent directly to the control unit 32.

  Further, when shooting a moving image instead of a still image, when the shutter key 9 is pressed, the captured moving image is compressed by the JPEG circuit 37 using a technique such as motion-JPEG and recorded in the memory 38. . When the shutter key 9 is operated again, the recording of the moving image data is finished.

  On the other hand, in the playback mode which is the basic mode, the control unit 32 selectively reads out the image data recorded in the memory 38 and is compressed by a procedure completely opposite to the procedure of data compression in the recording mode by the JPEG circuit 37. Decompress image data. The decompressed image data is held in the DRAM 31 via the DRAM interface 30, and then the content held in the DRAM 31 is stored in the VRAM 34 via the VRAM controller 33. The image data is periodically read out from the VRAM 34. A video signal is generated and reproduced and output by the display unit 19.

  If the selected image data is not a still image but a moving image, the multiple frames of still image data that make up the moving image data are played back and displayed sequentially in chronological order, and all the still image data is played back. For example, the top still image data is displayed until the next playback instruction is given.

  Here, the “pasted movie mode” and the “short movie mode” will be described with reference to FIGS. 3 and 4.

  FIG. 3 is a diagram for explaining the “pasted movie mode” provided in the digital camera 1, and FIG. 4 is a diagram for explaining the “short movie mode” provided in the digital camera 1. In the “standard movie mode”, which is a normal moving image mode, shooting starts at the timing when the shutter key 9 is pressed, and the shot image at that time is recorded. Then, when the shutter key 9 is pressed again, shooting is finished. In contrast, the “pasted movie mode” and the “short movie mode” are characterized in that a moving image is recorded before the shutter key 9 is pressed.

  That is, as shown in FIG. 3, in the “pasto movie mode”, the buffered image is constantly updated while updating a predetermined amount of captured images (past images) before the shutter key 9 is pressed, and the shutter key 9 is pressed. When this is done, actual recording is performed from the captured image T seconds before, and then the imaging is terminated when the shutter key 9 is pressed. The value of T is preset and is, for example, 5 seconds. That is, in the “pasto movie mode”, a moving image can be recorded within the limit of the memory capacity from a captured image T seconds before the shutter key 9 is pressed. As a result, it is possible to prevent missing of the decisive moment.

  On the other hand, as shown in FIG. 4, in the “short movie mode”, when a shutter key 9 is pressed once, moving images of a few seconds before and after that are recorded. That is, in this “short movie mode”, it is not necessary to give an instruction to end shooting, and a movie can be shot for several seconds by pressing the shutter key 9 once.

  The photographing time at this time can be arbitrarily set by the user on a time setting screen 51 as shown in FIG. The time setting screen 51 is displayed by operating the menu key 16, and is configured to individually set the times T1 and T2 before and after the shutter by operating the up / down / left / right cursor keys. In the figure, 52 is a time setting unit before the shutter, and 53 is a time setting unit after the shutter. Note that the shortest time and the longest time that can be taken are determined in advance. For example, the shortest time is 2 seconds and the longest time is 8 seconds, and the times T1 and T2 before and after the shutter can be set within this range.

  At this time, the “motion print mode” can be set in advance. The “motion print mode” is a function for creating one still image that can be printed from a moving image. When this function is set to ON, each frame of the moving image data recorded in the “short movie mode” is set. One still image that can be printed using the image can be automatically created.

  Reference numeral 54 in the figure denotes a motion print setting unit. By selecting this, the “motion print mode” is set to ON. In addition, when ON is set, a layout selection screen (not shown) is displayed, and a desired one can be selected from previously prepared still image layouts (designs).

  FIGS. 6A to 6D show an example of the still image layout, and the number of frames, the size, and the arrangement of a plurality of frame images constituting the moving image are different from each other. FIG. 6A shows an example of nine frames, and a main frame image (also referred to as a highlight frame) is arranged in the center. FIG. 5B shows an example of one frame, which is composed only of the main frame image (highlight frame). In addition, layouts such as those shown in FIGS.

  FIG. 7 is an explanatory diagram showing a specific data structure of the still image layout shown in FIG. The layout data 101 includes a plurality of setting information determined for each of a plurality of data items of ID00 to ID18.

  In the illustrated data item, “layout number” of ID00 is an identification number indicating the type of layout. The “highlight frame” of ID04 and the “frame” of ID05 to 13 are arrangement regions (positions and sizes) of frame images in still images, and the “highlight frame” is a main frame having a larger size than the other frames. One frame image arrangement area Fa, “frame” is data indicating the image arrangement area Fb of other frames. Note that “highlight frame” may not exist depending on the type of layout, and the number of data of “frame” increases or decreases depending on the type of layout. Further, the “bitmap” of IDs 14 to 17 is a decoration image and data indicating its arrangement.

Next, the operation of the embodiment will be described.
Note that the processes shown in the following flowcharts are executed when the control unit 32, which is a microcomputer, reads a program.

  FIG. 8 and FIG. 9 are flowcharts showing the shooting process of the digital camera 1 in the embodiment, and shows the process when the shooting mode is set by operating the shooting mode key 10. As described above, the shooting mode includes the still image mode and the moving image mode, and the moving image mode includes “pasted movie mode” and “short movie mode” in addition to the “standard movie mode”. These modes are appropriately switched by operating the menu key 16.

  When the still image mode is set (Yes in Step A11), still image shooting processing is executed (Step A12). In this still image shooting process, image data obtained by the CCD 23 serving as an image sensor is displayed on the display unit 19 as a through image, and when the shutter key 9 is pressed, the image data is captured as a still image and is transmitted in a predetermined manner. It is compressed and recorded in the memory 38.

  On the other hand, when “standard movie mode” in the moving image mode is set (Yes in step A13), standard movie shooting processing is executed (step A14). This standard movie shooting process is the same as the normal movie shooting process. That is, when the through key is displayed and the shutter key 9 is pressed, the image data is captured as a moving image, compressed by a predetermined method, and sequentially recorded in the memory 38. When the shutter key 9 is pressed again, the photographing process (data recording operation) at that time ends.

  When the “pasted movie mode” is set (Yes in step A15), a past movie shooting process is executed (step A16). In this past movie shooting process, as described with reference to FIG. 3, a predetermined amount of shot images (past images) are temporarily stored in the buffer memory (DRAM 31 in FIG. 2) before the shutter key 9 is pressed, and the shutter key When 9 is pressed, actual recording is performed from the captured image T seconds before. Then, at the timing when the shutter key 9 is pressed again, the photographing process (data recording operation) at that time ends.

  Here, when the “short movie mode” is set (Yes in step A17), short movie shooting processing is executed, and as described with reference to FIG. A moving image is recorded for several seconds. At this time, if the “motion print mode” is set to ON, one still image that can be printed is automatically created from the moving image at that time.

  Hereinafter, the operation during moving image shooting in the “short movie mode” will be described in detail.

  As described above, in the “short movie mode”, the shooting time can be arbitrarily changed within a predetermined range. When there is an instruction to change the shooting time by a predetermined operation (Yes in Step A18), the control unit 32 displays the time setting screen 51 shown in FIG. 5 on the display unit 19 (Step A19). At this time, a live view image is displayed on the screen of the display unit 19, and a time setting screen 51 is displayed thereon.

  The control unit 32 changes the shooting time according to the time set in the time setting units 52 and 53 before the shutter on the time setting screen 51 (step A20). Note that the times T1 and T2 before and after the shutter that define the photographing time are held in the setting storage unit 32a shown in FIG. If there is no instruction to change the shooting time, the preset times T1 and T2 are applied as they are.

  During this time, the image data of the subject is acquired by the CCD 23 which is an image sensor, and the image data is displayed on the display unit 19 as a through image, while the frame image of the moving image is displayed in the buffer memory (DRAM 31 in this case). Are sequentially stored (step A21). At that time, the control unit 32 deletes the frame image of the moving image recorded before the time T1 from the buffer memory to secure a free area (step A22).

  Here, when shooting is instructed by pressing the shutter key 9 (Yes in step A23), the control unit 32 is obtained from the CCD 23 from the time when the shooting instruction is given until the time T2 elapses. The stored image data is stored in the buffer memory in the chronological order as a frame image of the moving image (step A24).

  Then, after the time T2 has elapsed (Yes in step A25), the control unit 32 creates a moving image file based on the plurality of frame images stored in the buffer memory between the times T1 and T2 (step A26). More specifically, a moving image data obtained by continually merging a plurality of frame images in time series is compressed by a predetermined method to create one moving image file, and this is stored as another moving image in a memory 38 for storing the moving image data as a short movie. Record separately from the data. At this time, a shutter flag is added as identification information indicating that to the frame image obtained at the time of the shutter operation (step A27).

  In addition to the method of adding the identification information directly to the frame image, the frame image obtained at the time of the shutter operation may be identified using, for example, a management table for managing each frame image.

  Further, after the creation of the short movie moving image, the control unit 32 determines whether or not the “motion print mode” is set to ON (step A28). As described with reference to FIG. 5, the “motion print mode” is set to ON by selecting the motion print setting unit 54 on the time setting screen 51. When the “motion print mode” is set to ON (Yes in step A28), the control unit 32 immediately executes the motion print process using the moving image file recorded in the memory 38 as a short movie moving image (step A29). . The motion print process will be described in detail later using the flowchart of FIG.

  When the end of shooting is instructed (Yes in step A30), the shooting process here ends.

  FIG. 10 is a flowchart showing the motion print process executed in step A29. As described above, if the “motion print mode” is set to ON when a short movie moving image is created, one still image data that can be printed is automatically created based on the moving image data.

  The layout of the still image is basically selected when the user sets the “motion print mode” to ON, but can be changed to another layout at an arbitrary timing.

  That is, when there is a layout change instruction by a predetermined operation (Yes in Step B11), a layout setting screen (not shown) is displayed on the display unit 19 (Step B12). When a layout desired by the user is selected from the still image layouts as shown in FIGS. 6A to 6D, the layout information La stored in the setting storage unit 32a is changed according to the selected layout. (Step B13). The layout information La is data indicating the design of a still image generated when a moving image is converted into a still image, that is, the number, size, arrangement, and the like of a plurality of frame images (frames) constituting the moving image. If there is no layout change instruction, the preset layout information La is applied as it is.

  Here, the control unit 32 acquires a moving image file to be a still image from the memory 38 (step B14), and then converts the moving image data of the moving image file into a still image at the shooting timing (shutter operation timing). Based on the moving image data, a frame image to be a main frame and other frame images are determined (step B15).

  Specifically, a frame image obtained at the time of a shutter operation, that is, a frame image with a shutter flag added is extracted as a main frame, and other frame images (subframes) before and after the frame image are determined by the number of frames determined by the layout information La. Extract. At this time, if moving image data to be converted into a still image is compressed, it is decompressed as necessary, and each frame image is extracted to create a still image.

  When the main frame and other frame images are determined in this manner, the control unit 32 extracts these frame images from the moving image data, and then divides them into the main frame and other frame images based on the layout information La. One still image that can be arranged and printed is created (step B16).

  Specifically, for example, when a layout as shown in FIG. 6A is selected, a nine-frame frame image including a main frame (a frame image to which a shutter flag is added) is used. Then, the main frame is made larger than the sub-frame which is the other frame image and arranged at the center, and the sub-frame is arranged at the top and bottom of the main frame with a small size to create one still image.

  FIG. 11 shows an example of the still image. The main frame is arranged in a different form from the other frames at the center and corresponds to the shutter scene. The size of the main frame is about four times that of other frame images (subframes).

  If the layout shown in FIG. 7B is selected, one still image is created using only the main frame.

  The still image data created in this way is compressed by a predetermined method as necessary, and is recorded in the storage memory 38 as one still image file (step B17). The still image data may be transferred to the printer without being recorded in the memory 38.

  Thus, the main frame and other frame images are determined based on the shooting timing at the time of moving image shooting, and a still image in which these frames are arranged is automatically created. Therefore, it is possible to easily obtain a still image in which each frame image including a shutter scene is appropriately arranged using the moving image data obtained at the time of moving image shooting without requiring editing work by the user.

  Note that when creating a still image in which a plurality of frame images are arranged as shown in FIG. 11, the frame images before and after the shutter operation are used as subframes, but the frame images before the shutter operation may be used as subframes. .

  In addition to the “short movie mode”, the same motion print processing as described above may be executed during moving image shooting in the “pasted movie mode”, and a still image may be created from the moving image data shot at that time. In this case, the main frame and other frame images (subframes) are determined based on the first shutter operation.

  Further, not only when shooting a moving image, the user designates a moving image file to be a still image from each moving image file already recorded in the memory 38 at an arbitrary timing. Alternatively, a single printable still image may be created using the moving image data constituting the moving image file.

(Other embodiments)
Next, as another embodiment of the present invention, a case where a motion print process is executed at the time of reproducing a moving image will be described.

  FIG. 12 is a flowchart showing the playback process of the digital camera 1 according to another embodiment of the present invention, and shows the process when the playback mode is set by operating the playback mode key 11.

  When the user selects a video file to be played back by a predetermined operation in the state where the playback mode is set (step C11), the control unit 32 firstly selects the selected video file as video data of a short movie. It is determined whether or not there is (step C12). As a result, if the video data is a short movie (Yes in Step C12), the control unit 32 searches the frame image obtained at the time of the shutter operation based on the shutter flag from each frame image constituting the video data, This is set as the current frame (step C13).

  On the other hand, if it is other than the moving image data by the short movie (No in Step C12), the first frame image in the moving image data is set as the current frame (Step C14).

  Next, the control unit 32 reproduces and displays the current frame image on the display unit 19 (step C15). In this case, if the video data is a short movie, the frame image obtained at the time of the shutter operation is initially displayed.

  When the user operates the menu key 16 to instruct the “motion print mode” that is the still image creation mode (Yes in step C16), the control unit 32 displays the current frame image that is currently displayed. Motion print processing is executed as a main frame (step C17). Since the motion print process is the same as that in the above embodiment, a detailed description thereof will be omitted here.

  If there is no instruction for “motion print mode” (No in step C16), the control unit 32 displays next in accordance with a user instruction operation such as frame advance, fast forward, and fast reverse as normal playback processing. A power frame image is selected and displayed on the screen of the display unit 19 (step C18). When there is an instruction to end reproduction (Yes in step C19), the processing here ends.

  In this way, even during moving image reproduction, a single printable still image can be easily created using the moving image data being reproduced.

  In each of the embodiments described above, the digital camera has been described as an example. However, the present invention can be applied to any electronic device having a video shooting function, such as a mobile phone with a camera or a PDA (Personal Digital Assistant). It is.

  In short, the present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying constituent elements without departing from the scope of the invention in the implementation stage. Various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the respective embodiments. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

  In addition, the method described in the above-described embodiment is a program that can be executed by a computer, such as a magnetic disk (flexible disk, hard disk, etc.), an optical disk (CD-ROM, DVD-ROM, etc.), a semiconductor memory, etc. The program can be written on a medium and applied to various apparatuses, or the program itself can be transmitted through a transmission medium such as a network and applied to various apparatuses. A computer that implements this apparatus reads a program recorded on a recording medium or a program provided via a transmission medium, and performs the above-described processing by controlling operations by this program.

FIG. 1 is a diagram showing an external configuration when a digital camera is taken as an example of an imaging apparatus according to an embodiment of the present invention. FIG. 1 (a) is mainly a front configuration, and FIG. It is a perspective view which shows the structure of a back surface. FIG. 2 is a block diagram showing an electronic circuit configuration of the digital camera in the embodiment. FIG. 3 is a diagram for explaining a “pasted movie mode” provided in the digital camera according to the embodiment. FIG. 4 is a diagram for explaining a “short movie mode” provided in the digital camera according to the embodiment. FIG. 5 is a diagram showing an example of a time setting screen for setting the shooting time of the “short movie mode” in the embodiment. FIG. 6 is a diagram showing an example of a “motion print mode” still image layout provided in the digital camera according to the embodiment. FIG. 7 is an explanatory diagram showing a specific data structure of the still image layout in the embodiment. FIG. 8 is a flowchart showing a photographing process of the digital camera in the embodiment. FIG. 9 is a flowchart showing a photographing process of the digital camera in the embodiment. FIG. 10 is a flowchart showing motion print processing of the digital camera in the embodiment. FIG. 11 is a diagram illustrating an example of a still image created by the motion print process of the digital camera in the embodiment. FIG. 12 is a flowchart showing a playback process of a digital camera according to another embodiment of the present invention.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Digital camera, 2 ... Camera body, 3 ... Shooting lens, 4 ... Self-timer lamp, 5 ... Optical finder window, 6 ... Strobe light emission part, 7 ... Microphone part, 8 ... Power key, 9 ... Shutter key, 10 ... Shooting mode key, 11 ... Playback mode key, 12 ... Optical viewfinder, 13 ... Speaker unit, 14 ... Macro key, 15 ... Strobe key, 16 ... Menu (MENU) key, 17 ... Ring key, 18 ... Set (SET) key , 19 ... Display section, 21 ... Motor, 22 ... Lens optical system, 23 ... CCD, 24 ... Timing generator (TG), 25 ... Driver, 26 ... Sample hold circuit (S / H), 27 ... A / D conversion 28 ... color process circuit, 29 ... DMA controller, 30 ... DRAM interface (I / F), 31 ... DRAM, 32 ... control unit, 32a Setting storage unit 33 ... VRAM controller 34 ... VRAM 35 ... Digital video encoder 36 ... Key input unit 37 ... JPEG circuit 38 ... Memory 39 ... Audio processing unit 40 ... USB interface (I / F) 41 ... Strobe drive unit, 51 ... Time setting screen, 52 ... Time setting unit before shutter, 53 ... Time setting unit after shutter, 54 ... Motion print setting unit.

Claims (9)

Imaging means for imaging a subject;
Mode setting means for selectively setting one of a plurality of moving image shooting modes including a first moving image shooting mode and a second moving image shooting mode;
An instruction means for instructing an arbitrary timing;
When the first moving image shooting mode is set, an operation of continuously capturing an image of the subject is started by the imaging unit, and when an arbitrary timing is instructed by the instruction unit, A plurality of image data picked up by the image pickup means during a predetermined time before and after the instruction timing is stored and recorded as moving image data, and among the plurality of image data included in the stored moving image data, First moving image recording means for adding and recording identification information for identifying image data corresponding to the instruction timing;
When the second moving image shooting mode is set, an image is picked up by the image pickup means after an arbitrary timing is first designated by the instruction means and then an arbitrary timing is designated. Second moving image recording means for storing and recording a plurality of image data as moving image data without adding the identification information;
A plurality of pieces of image data included in the moving image data are used from among a plurality of pieces of moving image data including the moving image data shot by the first moving image recording unit and the moving image data shot by the second moving image recording unit. selecting means for selecting the moving image data to be predetermined process had,
Determining means for determining whether the moving image data selected by the selecting means is moving image data shot by the first moving image recording means or moving image data shot by the second moving image recording means;
When it is determined by the determining means that the moving image data is taken by the first moving image recording means, when a predetermined process using a plurality of image data included in the selected moving image data is performed , Among the plurality of image data included in the moving image data, the image data indicated by the identification information is processed as special image data, and the moving image data photographed by the second moving image recording unit by the determination unit If it is determined that the image data indicated by the identification information is treated as special image data when performing predetermined processing using a plurality of image data included in the selected moving image data Control means for processing without
An imaging apparatus comprising: The predetermined process using the moving image data is a process of sequentially reproducing and displaying a plurality of image data included in the moving image data,
When the determining means determines that the moving image data is taken by the first moving image recording means by the determining means, among the plurality of image data included in the selected moving image data, When the image data indicated by the identification information is first reproduced and displayed, and the determination unit determines that the image data is captured by the second moving image recording unit, the selected moving image data is included in the selected moving image data. 2. The imaging apparatus according to claim 1, wherein among the plurality of pieces of image data included, the top image data is reproduced and displayed first. The predetermined process using the moving image data is a process of generating a piece of image data by arranging and synthesizing a plurality of image data included in the moving image data in a predetermined layout.
When the determining means determines that the moving image data is taken by the first moving image recording means by the determining means, among the plurality of image data included in the selected moving image data, The image pickup apparatus according to claim 1, wherein the image data indicated by the identification information is controlled to be arranged at a main position on the layout. Temporary storage means for temporarily storing a plurality of image data obtained by imaging by the imaging means;
The first moving image recording means stores image data that has already been temporarily stored in the temporary storage means at an instruction timing by the instruction means, and image data that is newly imaged by the imaging means after the instruction timing. 4. The imaging apparatus according to claim 1, wherein a plurality of image data including the image data is stored and recorded as moving image data.   Discard the image data that is not included in the moving image data stored and recorded by the first moving image recording unit among the plurality of image data temporarily stored in the temporary storage unit without saving and recording. The imaging apparatus according to claim 4, further comprising means. A plurality of images for a predetermined capacity are temporarily stored retroactively from the image last picked up by the image pickup means, and a new image is picked up by the image pickup means as a plurality of images to be subjected to the primary storage. Further comprising a primary storage control means for updating in response,
4. The first moving image recording means stores and records a plurality of images including images already stored by the primary storage control means as moving image data at an instruction timing by the instruction means. The imaging device according to any one of the above. A setting means for arbitrarily setting the predetermined time before or after the instruction timing;
The first moving image recording unit stores and records a plurality of pieces of image data captured by the imaging unit as moving image data during a predetermined time set by the setting unit before or after the instruction timing as a reference. The imaging apparatus according to claim 1. A program executed by a computer mounted on an imaging device,
The computer,
Imaging means for imaging a subject;
Mode setting means for selectively setting one of a plurality of moving image shooting modes including a first moving image shooting mode and a second moving image shooting mode;
Instruction means for instructing arbitrary timing;
When the first moving image shooting mode is set, an operation of continuously capturing an image of the subject is started by the imaging unit, and when an arbitrary timing is instructed by the instruction unit, A plurality of image data picked up by the image pickup means during a predetermined time before and after the instruction timing is stored and recorded as moving image data, and among the plurality of image data included in the stored moving image data, First moving image recording means for adding and recording identification information for identifying image data corresponding to the instruction timing;
When the second moving image shooting mode is set, an image is picked up by the image pickup means after an arbitrary timing is first designated by the instruction means and then an arbitrary timing is designated. Second moving image recording means for storing and recording a plurality of image data as moving image data without adding the identification information;
A plurality of pieces of image data included in the moving image data are used from among a plurality of pieces of moving image data including the moving image data shot by the first moving image recording unit and the moving image data shot by the second moving image recording unit. selecting means for selecting the moving image data to be predetermined process had,
Determining means for determining whether the moving image data selected by the selecting means is moving image data shot by the first moving image recording means or moving image data shot by the second moving image recording means;
When it is determined by the determining means that the moving image data is taken by the first moving image recording means, when a predetermined process using a plurality of image data included in the selected moving image data is performed , Among the plurality of image data included in the moving image data, the image data indicated by the identification information is processed as special image data, and the moving image data photographed by the second moving image recording unit by the determination unit If it is determined that the image data indicated by the identification information is treated as special image data when performing predetermined processing using a plurality of image data included in the selected moving image data Control means for processing without
A program characterized by making it function. In an image processing method used in an imaging apparatus including an imaging unit that continuously images a subject,
A mode setting step for selectively setting one of a plurality of video shooting modes including a first video shooting mode and a second video shooting mode;
An instruction step for instructing an arbitrary timing;
When the first moving image shooting mode is set, an operation of continuously capturing an image of the subject is started by the imaging unit, and thereafter, when an arbitrary timing is instructed by the instruction step, A plurality of image data picked up by the image pickup means during a predetermined time before and after the instruction timing is stored and recorded as moving image data, and among the plurality of image data included in the stored moving image data, A first moving image recording step of adding and recording identification information for identifying image data corresponding to the instruction timing;
When the second moving image shooting mode is set, an image is picked up by the image pickup means after an arbitrary timing is first specified by the instruction step and until an arbitrary timing is next specified. A second moving image recording step for storing and recording a plurality of image data as moving image data without adding the identification information;
A plurality of image data included in the moving image data is used from among a plurality of moving image data including the moving image data captured in the first moving image recording step and the moving image data captured in the second moving image recording step. a selection step of selecting a moving image data to be predetermined process had,
A determination step of determining whether the moving image data selected by the selection step is the moving image data shot by the first moving image recording step or the moving image data shot by the second moving image recording step;
When it is determined by the determination step that the moving image data is captured by the first moving image recording step, a predetermined process using a plurality of image data included in the selected moving image data is performed. , Among the plurality of image data included in the moving image data, the image data indicated by the identification information is processed as special image data, and the moving image data photographed by the second moving image recording step by the determining step If it is determined that the image data indicated by the identification information is treated as special image data when performing predetermined processing using a plurality of image data included in the selected moving image data Control steps for processing without
An image processing method comprising:

Images