JP2006165768A - Digital camera - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a digital camera for realizing reproduction of frozen moving picture data photographed at a longitudinal photographing attitude at reduced processing cost. <P>SOLUTION: The digital camera is provided with: an imaging unit; an attitude discrimination unit; an imaging control unit; a rotation conversion unit; and an image processing unit. The imaging unit images an object image. The attitude discrimination unit discriminates the photographing attitude of a longitudinal/lateral position. The imaging control unit controls the imaging unit to obtain a still picture. The rotation conversion unit applies rotation conversion to the still picture in matching with the photographing attitude. The image processing unit stores the still picture after the rotation conversion to a moving picture frame thereby creating the frozen moving picture data obtained by reproducing the still picture after the rotation conversion for a prescribed period. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a digital camera.

Conventionally, a digital camera does not rotate an image of a still image file taken in a vertical position, and adds only information on the vertical position shooting. When the reproduction software on the personal computer detects this vertical position shooting information, the image of the still image file is automatically rotated 90 degrees and displayed.
Patent Document 1 describes a technique for rotating a moving image to a vertical position during reproduction. That is, on the digital camera side, the vertical position shooting information is additionally recorded without performing any image rotation on the moving image file shot in the vertical position. When the video playback device detects this vertical shooting information, the video is rotated and displayed in the vertical position.
As described above, in the prior art, only the information on the vertical position shooting is added to the image in the camera, and the rotation conversion of the image is performed on the playback device side.
JP 2004-248171 A (Claims 1 and 2 etc.)

  The present inventor has examined a technique for easily reproducing still images taken with a digital camera even with a reproduction device dedicated to moving images. As a result, we considered converting still images into moving image data compliant with the moving image file standard in the digital camera. This moving image data becomes moving image data (freeze moving image data) for reproducing a still image for a predetermined time. On the video playback device side, simple playback of a still image can be realized by playing back the freeze video data in the same manner as normal video data.

  By the way, there is a problem when freeze video data is created from a still image shot vertically. That is, a general playback device dedicated to moving images does not support the above-described vertical position shooting information. For this reason, a general-purpose moving image playback device cannot display a moving image frame of freeze moving image data by rotating it to a vertical position, resulting in an unsightly still image reproduction in a horizontal orientation.

  Also, even if the video playback device supports vertical position shooting information, the conversion processing that rotates the video frames of freeze video data to the vertical position one frame at a time is expensive and there are concerns about problems such as dropped frames. The

  In view of the above, an object of the present invention is to realize vertical position reproduction of freeze moving image data at a low processing cost.

<< 1 >>
The digital camera of the present invention includes an imaging unit, a posture determination unit, an imaging control unit, a rotation conversion unit, and an image processing unit.
The imaging unit captures a subject image.
The posture determination unit determines the shooting posture of the vertical position / horizontal position.
The imaging control unit controls the imaging unit to obtain a still image.
The rotation conversion unit rotates and converts the still image according to the shooting posture.
The image processing unit creates freeze moving image data for reproducing the still image after rotation conversion for a predetermined period by storing the still image after rotation conversion in a moving image frame.

<< 2 >>
Preferably, the rotation conversion unit converts the resolution of the still image so that the number of pixels in the long side direction of the still image is equal to or less than the number of pixels in the short side direction of the screen when rotating the still image.

<< 3 >>
Preferably, the rotation conversion unit combines the predetermined image for aspect adjustment outside the frame of the still image screen after the rotation conversion so as to maintain the screen aspect ratio before the rotation when rotating the still image.

[1]
In the present invention, rotation conversion of a still image is performed in the digital camera in accordance with the shooting posture. The digital camera creates freeze moving image data by storing the still image after the rotation conversion in a moving image frame.
For example, in the Motion JPEG standard, a still image after rotation conversion may be duplicated and sequentially stored in a plurality of moving image frames. Also, when using inter-frame prediction differences as in the MPEG standard, the still image after rotation conversion is copied and stored in a plurality of I pictures, and inter-frame prediction differences are included in intermediate P and B pictures. Information indicating zero may be stored.
With such a moving image standard, only one rotation conversion of the still image is required. For this reason, even if the rotation conversion is performed on the digital camera side, the increase in processing cost is negligible.
Furthermore, the freeze moving image data can be reproduced in the same manner as a normal moving image on a moving image reproducing device. In particular, freeze video data shot in the vertical position can be played back and displayed in the vertical position without any special processing on the video playback device side.

[2]
In the present invention, when the still image is rotationally converted, the resolution conversion is preferably performed so that the number of pixels in the long side direction of the still image is equal to or less than the number of pixels in the short side direction of the screen.
In this case, the screen size (number of vertical and horizontal pixels) after the rotation conversion does not protrude from the screen size before the rotation conversion. Therefore, the moving image playback device can display the still image in the vertical position without protruding in the display screen in accordance with the screen size in the horizontal position without performing special processing.

[3]
In the present invention, it is preferable to maintain a horizontal screen aspect ratio by synthesizing a predetermined image for size adjustment outside the frame of the still image after rotation conversion.
In this case, the moving image playback device does not need to perform a special aspect conversion process when switching the horizontal position / vertical position, and even a vertical position image can be reproduced as a horizontal position image.

<< First Embodiment >>
[Description of Configuration of First Embodiment]
FIG. 1 is a block diagram showing the configuration of the first embodiment.
In FIG. 1, a photographic lens 12 is attached to a digital camera 11. In the image space of the photographic lens 12, the light receiving surface of the image sensor 13 is arranged. The imaging device 13 has its imaging operation controlled by the output pulse of the timing generator 22b.

The image data output from the image sensor 13 is temporarily stored in the buffer memory 17 via the A / D conversion unit 15 and the signal processing unit 16.
The buffer memory 17 is connected to the bus 18. Connected to the bus 18 are an image processing unit 19, a card interface 20, a microprocessor 22, a compression / decompression unit 23, an image display unit 24, a red-eye reduction light emitting unit 30, a flash light emitting unit 31, and an audio processing unit 32.

Among these, the card interface 20 reads / writes data from / to the removable memory card 21.
The microprocessor 22 receives signals from the switch group 22a, the release button 22c, and the attitude sensor 22d. The switch group 22a includes a menu button, a mode operation button, a multi selector button, a command dial, and the like.
Further, the image display unit 24 displays an image on a monitor screen 25 provided on the back surface of the digital camera 11.
A microphone 33 is connected to the audio processing unit 32.

[Description of Operation of First Embodiment]
The first embodiment has the following operational features.
(1) Video buffering by half-pressing the release button 22c (2) Deletion of video buffering by releasing the half-press (3) Video buffering completed by fully pressing the release button 22c (4) Freezing video data from a still image Creation (5) Image rotation processing of freeze movie data corresponding to camera posture (6) Merge processing of movie data and freeze movie data

FIG. 2 is a flowchart for explaining these operations. Hereinafter, these operations will be described along the step numbers shown in FIG.
First, when the main power supply of the digital camera 11 is turned on, the microprocessor 22 proceeds to step S1 after a predetermined initial setting.

Step S1: The microprocessor 22 first releases the memory area in the buffer memory 17. By this operation, the moving image buffering accumulated in the buffer memory 17 in the past is deleted.

Step S2: The digital camera 11 displays the captured image (moving image) on the monitor screen 25 almost in real time. In this case, in order to realize smooth moving image display, VGA images at a high frame rate (for example, 30 frames / second) are continuously read out by reducing the number of readout lines of the image sensor 13 (so-called draft mode).
The microprocessor 22 performs exposure setting in the draft mode based on the result of the photometric processing (for example, the signal level of the VGA image).

Step S3: Furthermore, the microprocessor 22 performs draft mode focus control (for example, contrast hill-climbing AF using a VGA image). Here, high-speed focus control with coarse focusing accuracy is performed so that the focus control sufficiently follows the composition change by the user.

Step S4: The microprocessor 22 sequentially drives the image sensor 13 in the draft mode via the timing generator 22b, and sequentially captures VGA images.

Step S5: The VGA image read in this way is displayed on the monitor screen 25 by the image display unit 24.

Step S6: The microprocessor 22 monitors the half-press operation of the release button 22c in parallel with the monitor display.
Here, when the half-press operation is not detected, the microprocessor 22 returns the operation to step S2.
On the other hand, when the half-press operation (input of the first start signal) is detected, the microprocessor 22 proceeds to step S7.

Step S7: In response to the shift to the half-press period, the microprocessor 22 performs high-precision focus control for still image shooting in preparation for still image shooting (release full-press).

Step S8: Further, the microprocessor 22 determines an exposure value (aperture value, charge accumulation time, imaging sensitivity) for still image shooting based on the result of the photometric processing (for example, the signal level of the VGA image).
Note that the microprocessor 22 also performs exposure settings for moving image shooting so that an exposure equivalent to the exposure value for still image shooting can be obtained. In other words, the microprocessor 22 determines the aperture value so that an exposure result equivalent to that of still image shooting can be obtained under the condition that the charge accumulation time of moving image shooting is 1/30 seconds. At this time, if the exposure is insufficient even with the wide aperture, the underexposure is compensated by increasing the imaging sensitivity setting (gain of the A / D converter 15). On the other hand, if the minimum aperture is overexposed, settings such as shortening the charge accumulation time to 1/100 second are performed.

Step S9: The microprocessor 22 sequentially drives the image sensor 13 in the draft mode via the timing generator 22b, and continues to capture the VGA image.

Step S10: After completing the AF process (Step S7) and the AE process (Step S8), the microprocessor 22 starts moving image buffering of VGA images (accumulating as moving image frames in the buffer memory 17).
When the upper limit time (for example, 3 seconds) of moving image shooting is exceeded, the microprocessor 22 deletes the old moving image frames in order. By this operation, the latest moving image frame having the upper limit time or less is held in the buffer memory 17.

Step S11: The image display unit 24 sequentially displays the VGA images on the monitor screen 25.

Step S12: When the half-press operation of the release button 22c is released during the moving image buffering (release of the first start signal), the microprocessor 22 returns the operation to step S1. In step S1, the moving image buffering in the buffer memory 17 is deleted without being recorded and saved. After the deletion of the moving image buffering, the microprocessor 22 resumes the operation before half-pressing after step S2.
On the other hand, when the half-press operation of the release button 22c is continuing, the microprocessor 22 shifts the operation to step S13.

Step S13: Here, the microprocessor 22 determines whether or not the release button 22c is fully pressed.
If the full-press operation (input of the second start signal) is detected, the microprocessor 22 shifts the operation to step S14.
On the other hand, when the full pressing operation is not detected, the microprocessor 22 returns the operation to step S9.

Step S14: The microprocessor 22 uses the exposure value for still image shooting to perform a still image exposure operation. Thus, by aligning the exposure conditions for moving image shooting (step S9) and still image shooting (step S14), it is possible to make the brightness of the moving image and still image substantially the same.
Subsequently, the microprocessor 22 sequentially drives the image sensor 13 in the all-pixel read mode via the timing generator 22b to read a high-resolution still image. The still image is digitized by the A / D converter 15 and then subjected to processing such as defective pixel correction and gradation correction in the signal processing unit 16.
Thereafter, the still image is temporarily stored in the buffer memory 17, and image processing such as color interpolation, color correction, noise removal, and edge enhancement is performed by the image processing unit 19. The compression / decompression unit 23 compresses the processed still image.
Note that the image processing unit 19 may perform signal processing for automatic red-eye reduction on the red-eye detection location. Further, the image processing unit 19 may analyze the gradation of a still image and perform gradation correction so that an image area with a small exposure amount is brightened.
As described above, various image processes are performed only on the still image, so that the still image whose image quality is likely to deteriorate is particularly improved in image quality. Further, the entire processing time can be shortened by omitting image processing for moving images.

Step S15: As shown in FIG. 3B, a still image folder for storing still images is provided in the memory card 21. The card interface 20 records the compressed still image file under the still image folder hierarchy.

Step S16: The image processing unit 19 converts the resolution of the still image in the buffer memory 17 to the VGA size.

Step S17: The microprocessor 22 detects the camera posture during still image shooting from the output of the posture sensor 22d.
Here, when the still image is taken in the horizontal position, the microprocessor 22 directly adopts the still image whose resolution has been converted to the VGA size as shown in FIG. 4A.
On the other hand, when the still image is captured in the vertical position, the image processing unit 19 rotates the image data of the VGA size “horizontal 640 pixels × vertical 480 pixels” as shown in FIG. At this time, resolution conversion is also performed so that the long side after the rotation conversion is equal to or less than the short side before the rotation conversion, and image data of “360 horizontal pixels × 480 vertical pixels” is obtained. Further, the image processing unit 19 adds a predetermined image (such as an image showing a margin) outside the frame of the image after the rotation conversion so as to maintain the aspect ratio before the rotation conversion, and the “horizontal 640 pixels × vertical 480 pixels” Get an image.

Step S18: The microprocessor 22 creates freeze moving image data for reproducing the VGA still image that has undergone the processing of step S17 as a moving image frame for 3 seconds.
For example, in the case of Motion JPEG freeze moving image data, VGA still image compressed data may be copied and sequentially stored in a plurality of moving image frames. In addition, in the case of freeze video data of the MPEG standard, VGA still image compressed data is duplicated and stored in a plurality of I pictures, and information indicating zero interframe prediction difference is stored in intermediate P pictures and B pictures. do it.

Step S19: The microprocessor 22 stores the VGA still image as information for the header of the moving image data in the buffer memory 17. This information is used for header information such as thumbnails or a so-called capture menu in moving image reproduction when the image data in the buffer is encoded into a predetermined moving image file standard such as MPEG.
Note that the moving image playback device (or playback program) also includes software that displays the first frame of the moving image as a thumbnail image. Therefore, the VGA still image may be stored in the first frame of the moving image. In this case, the VGA still image is reproduced instantaneously (for example, 1/30 second) at the time of reproducing the moving image, but there is little trouble in viewing the moving image because the time is short.
By these processes, there is an advantage that desired data can be easily searched when moving image data is handled later or when it is reproduced by a digital camera. Furthermore, there is an advantage that the association information between both data becomes unnecessary compared with the case where the still image and the moving image are recorded separately.

Step S20: The microprocessor 22 concatenates and edits the freeze moving image data created in step S18 following the final frame of the moving image data in the buffer memory 17.

Step S21: The compression / decompression unit 23 performs motion JPEG, MPEG2, MPEG4, H264 and other encoding processing on the edited moving image data in the buffer memory 17 to generate a moving image file. As shown in FIG. 3A, a folder for this moving image file is provided in the memory card 21. The card interface 20 records the encoded video file under the folder hierarchy.
As shown in FIG. 5, the microprocessor 22 may create a moving image file in which a series of edited moving image data is combined into one in the memory card 21. This moving image file is created by sequentially connecting the latest moving image file together with the date display etc. to the moving image file recorded in advance in the memory card 21.

Step S22: When the above-described recording process is completed, the microprocessor 22 returns the operation to Step S1 to prepare for the next photographing process. When the main power supply of the digital camera 11 is turned off, the operation ends after the recording process is completed.

[Effects of First Embodiment]
As described above, in the first embodiment, freeze moving image data for reproducing a still image for a predetermined period is created. With this freeze video data, even a playback device dedicated to video can be played in the same manner as a normal video.

  Furthermore, in the first embodiment, a moving image file is generated by concatenating moving image data before full release and freeze moving image data. By reproducing this moving image file, it is possible to continuously reproduce the moving image before the release is fully pressed and the still image (freeze moving image) at a time. As a result, a user-friendly digital camera is realized without the need for searching and playing back the moving image portion and the still image portion separately. In addition, since the moving image and the still image are combined into a single moving image file, the files in the memory card 21 can be easily organized.

  Moreover, since the moving image buffering is also released by releasing halfway, unnecessary moving image data can be easily discarded, and re-recording of moving images can be easily performed any number of times.

  Furthermore, in the first embodiment, moving image buffering is started after the AE operation and AF operation for still image shooting are completed. Therefore, the brightness of the moving image data and the freeze moving image data can be made uniform. As a result, when reproducing a moving image file, the brightness change does not stand out at the switching point between the moving image and the still image, and a natural impression can be given.

  In the first embodiment, the resolution of freeze video data is converted in accordance with the screen size (number of vertical and horizontal pixels) of the video data in the draft mode. By performing this resolution conversion, the display resolution does not change at the playback switching point between the moving image data and the frozen moving image data. As a result, smooth playback switching from the moving image to the frozen moving image is realized.

  In the first embodiment, freeze moving image data is created by rotating and converting a VGA still image according to the shooting posture, and copying and storing the VGA still image after the rotation conversion in a moving image frame. In this case, the rotation conversion of the VGA still image only needs to be performed once at the time of recording, and there is an advantage that the processing cost is lighter than the rotation conversion of the moving image frames one by one on the playback device side.

  In the first embodiment, adjustment to the VGA size is also performed during the rotation conversion. Therefore, on the playback device side, there is no need for special aspect conversion processing and display resolution switching when switching between horizontal position and vertical position display, and smooth display switching is possible.

  As shown in FIG. 5, in the digital camera 11, a series of moving image files can be collectively created. With this moving image file, the moving image data and the freeze moving image data can be sequentially switched and reproduced on a general-purpose moving image reproducing device. Therefore, a dedicated playback environment is unnecessary, and a highly versatile moving image file suitable for transfer to an acquaintance can be created.

Furthermore, in the series of moving image files shown in FIG. 5, a capture menu in which VGA still images are arranged as options can be displayed using a general-purpose moving image playback device. By operating the capture menu, a desired image can be immediately accessed.
Next, another embodiment will be described.

<< Second Embodiment >>
Since the structure of 2nd Embodiment is the same as 1st Embodiment (FIG. 1), description here is abbreviate | omitted.
A feature of the second embodiment is that sound and a switching effect image are added in addition to the moving image data and the freeze moving image data.
FIG. 6 is a flowchart for explaining the operation of the second embodiment. Hereinafter, these operations will be described along the step numbers shown in FIG.

Steps S120 to S131: The same processing as steps S1 to S11 of the first embodiment.

Step S132: The audio processing unit 32 acquires audio data (hereinafter referred to as “first audio data”) from the microphone 33 and stores it in the buffer memory 17 in parallel with the video buffering, and synchronizes playback sound of the video data. And

Steps S133 to S134: The same processing as steps S12 to 13 of the first embodiment.

Step S135: The voice processing unit 32 acquires voice data (hereinafter referred to as “second voice data”) from the microphone 33 for 3 seconds from the time when the release button 22c is fully pressed, and stores the voice data in the buffer memory 17.

Steps S136 to S141: The same processing as steps S14 to S19 of the first embodiment.

Step S142: The microprocessor 22 connects a predetermined switching effect image and freeze moving image data to the final frame of the moving image data in the buffer memory 17.

Step S143: The microprocessor 22 adds predetermined sound effect data and second sound data as the synchronized reproduction sound of the switching effect image and the freeze moving image data, respectively.

Steps S144 to S145: The same processing as steps S21 to S22 of the first embodiment.

[Effects of Second Embodiment, etc.]
As described above, in the second embodiment, the same effects as in the first embodiment can be obtained.
Further, in the second embodiment, the second audio data in a period including the still image capturing time is added to the freeze moving image data as the synchronized playback sound. As a result, when the freeze moving image data is reproduced, it is possible to reproduce the sound at the time of imaging, and the presence of the frozen moving image data can be further enhanced.

In the second embodiment, special effects (effect sound data and a switching effect image) are added to a switching portion between a moving image and a freeze moving image (still image). For example, in the digital camera 11, it is preferable to selectively add the following special effects.
(1) Sound that simulates shutter sound (2) Image for switching effect that simulates opening and closing of shutter (3) When still image is flashed, combustion sound of valve bulb and explosion sound (4) Flash still image When shooting, an image for switching effect imitating the smoke of a bulb

In addition, when there is no synchronized playback sound of freeze moving image data or when it is short, it is preferable to set the effect sound data longer and perform the synchronized playback with the freeze moving image data to enhance the impression of the freeze moving image data.
Due to such special effects, it is possible to effectively produce a change from moving to static at the switching point between moving image data and freeze moving image data.

Note that at the beginning and end of the audio data, it is preferable to perform a fade-in process and a fade-out process on the audio data so that the sound does not start or stop suddenly.
Furthermore, the second audio data may be shortened to about 1 second from the full-press operation without matching the playback time of the freeze moving image. In this case, no noise is recorded when the camera is immediately put in a bag after shooting.
Next, another embodiment will be described.

<< Third Embodiment >>
Since the structure of 3rd Embodiment is the same as 1st Embodiment (FIG. 1), description here is abbreviate | omitted.
A feature of the third embodiment is that a moving image file connected in the order of freeze moving image data and moving image data is generated.
FIG. 7 is a flowchart for explaining the operation of the third embodiment. Hereinafter, these operations will be described along the step numbers shown in FIG.

Step S301: The same process as step S1 of the first embodiment.

Step S <b> 302: Prior to still image shooting, the audio processing unit 32 acquires audio data (hereinafter referred to as “second audio data”) from the microphone 33 and stores it in the buffer memory 17. The voice processing unit 32 sequentially discards past voice data exceeding 3 seconds from the second voice data.

Steps S303 to S310: The same processing as steps S2 to S9 of the first embodiment.

Step S311: Same processing as step S11 of the first embodiment

Step S312: If the half-press operation of the release button 22c is released after such a half-press operation, the microprocessor 22 returns the operation to Step S302.
On the other hand, when the half-press operation of the release button 22c is continuing, the microprocessor 22 shifts the operation to step S313.

Step S313: Here, the microprocessor 22 determines whether or not the release button 22c is fully pressed.
If the full pressing operation is detected, the microprocessor 22 shifts the operation to step S314.
On the other hand, when the full pressing operation is not detected, the microprocessor 22 returns the operation to step S310.

Step S314: The same process as step S14 of the first embodiment.

Step S315: The microprocessor 22 stops the second sound data storage operation.

Step S316: The microprocessor 22 sequentially drives the image sensor 13 in the draft mode via the timing generator 22b, and accumulates the video data of VGA size for 3 seconds in the buffer memory 17. The audio processing unit 32 acquires audio data (hereinafter referred to as “first audio data”) from the microphone 33 during the video shooting period of 3 seconds, and stores the audio data in the buffer memory 17 as synchronized playback sound of the video data.

Steps S317 to S320: The same processing as steps S15 to S18 of the first embodiment.

Step S321: The microprocessor 22 concatenates and edits the predetermined switching effect image and the moving image data created in Step S316 following the final frame of the freeze moving image data in the buffer memory 17.

Step S322: The microprocessor 22 adds the second sound data and the predetermined sound effect data as the synchronized reproduction sound of the freeze moving image data and the switching effect image.

Steps S323 to S324: The same processing as Steps S21 to S22 of the first embodiment.

[Effects of Third Embodiment]
As described above, in the third embodiment, the same effects as in the first embodiment can be obtained.
Furthermore, in the third embodiment, special effects (effect sound data and switching effect image) are added to a switching portion between a freeze moving image (still image) and a moving image. For example, in the digital camera 11, it is preferable to selectively add the following special effects.
(1) “Start! (2) Image for switching effect imitating the opening and closing operation of a clapperboard in a movie (3) When a still image is flashed, the combustion sound and explosion sound of a bulb ball (4) Still sound When the image is flash-photographed, a switching effect image simulating the smoke of a bulb sphere With such a special effect, a change from static to dynamic can be effectively produced.
Next, another embodiment will be described.

<< 4th Embodiment >>
Since the structure of 4th Embodiment is the same as 1st Embodiment (FIG. 1), description here is abbreviate | omitted.
A feature of the fourth embodiment is that a plurality of freeze moving image data are connected to generate a moving image file for automatic slide reproduction.
FIG. 8 is a flowchart for explaining the operation of the fourth embodiment. Hereinafter, these operations will be described along the step numbers shown in FIG.

Steps S401 to S409: The same processing as Steps S1 to S9 of the first embodiment.

Steps S410 to S417: The same processing as steps S11 to S18 of the first embodiment.

Step S418: The microprocessor 22 adds identification information for specifying the original still image file to the freeze moving image data.

Step S419: The microprocessor 22 compares the shooting dates of the previously captured still image file with the latest still image file.
If the shooting dates of the two files are different, the microprocessor 22 determines that the shooting date has changed, and proceeds to step S420.
On the other hand, when the shooting dates of both files are the same, the microprocessor 22 shifts the operation to step S421.

Step S420: The microprocessor 22 generates an image including date information display and adds it as the first frame of the freeze moving image data.

Step S421: The microprocessor 22 concatenates and edits the latest freeze moving image data with respect to the moving image file for automatic slide reproduction in the memory card 21 (concatenated past frozen moving image data).

Step S422: The microprocessor 22 adds the VGA still image created in step S416 for use in the video file capture menu for automatic slide playback.

Step S423: When the recording process is completed, the microprocessor 22 returns the operation to Step S401 to prepare for the next photographing process. When the main power supply of the digital camera 11 is turned off, the operation ends after the recording process is completed.

[Effects of Fourth Embodiment, etc.]
As described above, in the fourth embodiment, a moving image file in which freeze moving image data is linked is created. This moving image file can be played back in the same way as a normal moving image on a playback device, so that automatic slide playback can be realized reliably and easily.

  In the fourth embodiment, a VGA still image is added for a video file capture menu. Therefore, the user can select a desired VGA still image using the chapter menu function of the playback device. As a result, it is possible to start slide automatic reproduction from desired freeze video data.

  In the fourth embodiment, only the VGA still image corresponding to the change of the shooting date may be added for the capture menu. In this case, using the chapter menu function of the playback device, automatic slide playback can be started from an image of a desired shooting date.

  Furthermore, in the fourth embodiment, a date display is inserted at the change of the shooting date of the moving image file. As a result, it is possible to confirm the location where the photographing date changes during the automatic slide reproduction by the date display.

In the fourth embodiment, identification information for specifying the creation still image file is stored for each freeze moving image data in the moving image file. Therefore, it is possible to easily realize a function such as switching to the high-definition display of the creation source still image file by tracing the identification information during automatic slide playback by using the function on the playback device side.
Next, another embodiment will be described.

<< 5th Embodiment >>
Since the structure of 5th Embodiment is the same as 1st Embodiment (FIG. 1), description here is abbreviate | omitted.
A feature of the fifth embodiment is that moving image buffering is implemented when the framing stability of the digital camera 11 is triggered.
FIG. 9 is a flowchart for explaining the operation of the fifth embodiment. Hereinafter, these operations will be described along the step numbers shown in FIG.

Steps S31 to S35: The same processing as steps S1 to S5 of the first embodiment.

Step S36: The microprocessor 22 obtains a pixel difference between frames of the VGA image, and obtains a sum of absolute values of the pixel differences.
If this sum is less than the threshold, the microprocessor 22 determines that the framing is stable (input of the first start signal), and shifts the operation to step S37.
On the other hand, if the sum is equal to or greater than the threshold, the microprocessor 22 determines that the framing is unstable and returns the operation to step S32.
Regarding the determination of framing stability, the VGA image may be divided into, for example, 255 blocks, the average luminance is obtained for each block, and the framing stability may be determined from the change in the average luminance between frames. Alternatively, when a face of a person is detected by a known face recognition technique, the framing stability may be determined from the movement of the face of the subject and the change in the size of the face.

Steps S37 to S41: The same processing as Steps S7 to S11 of the first embodiment.

Step S42: Here, the microprocessor 22 determines whether or not the release button 22c is fully pressed.
If the full pressing operation is detected, the microprocessor 22 shifts the operation to step S44.
On the other hand, when the full pressing operation is not detected, the microprocessor 22 returns the operation to step S43 and continues the video buffering.

Step S43: The microprocessor 22 continues the framing stability determination even during moving image buffering.
As a result, when the framing is stable, the microprocessor 22 returns the operation to step S39 and continues the video buffering.
On the other hand, when the framing becomes unstable (release of the first start signal), the microprocessor 22 returns the operation to step S31. In this case, the moving image buffering in the buffer memory 17 is deleted without being recorded and saved. After this deletion operation, the microprocessor 22 resumes the operations after step S32.

Steps S44 to S52: The same processing as steps S14 to S22 of the first embodiment.

[Effects of Fifth Embodiment, etc.]
As described above, in the fifth embodiment, moving image buffering is started in response to framing stability, and when framing becomes unstable, moving image buffering is deleted without being recorded. With this function, even a user who is not good at half-pressing the release button 22c can easily start and release moving image buffering.

In the fifth embodiment, moving image buffering may be performed only when the conditions “half-pressed” and “framing stability” are satisfied.
In the fifth embodiment, the capturing of a moving image is started depending on whether or not the subject has changed. For example, in the case of a digital camera with a lighting function (such as a mobile phone with a camera), You may start capturing video.
Next, another embodiment will be described.

<< 6th Embodiment >>
Since the structure of 6th Embodiment is the same as 1st Embodiment (FIG. 1), description here is abbreviate | omitted.
A feature of the sixth embodiment is that moving image buffering is performed in response to a self-timer.
FIG. 10 is a flowchart for explaining the operation of the sixth embodiment. Hereinafter, these operations will be described along the step numbers shown in FIG.

Steps S61 to S65: The same processing as Steps S1 to S5 of the first embodiment.

Step S66: The microprocessor 22 determines that the self-timer is activated when the release button 22c is pressed while the switch group 22a is set to the self-timer mode.
When the activation of the self-timer is detected in this way (input of the first start signal), the microprocessor 22 proceeds to step S67.
On the other hand, when the activation of the self-timer is not detected, the microprocessor 22 returns the operation to step S62.

Steps S67 to S71: The same processing as Steps S7 to S11 of the first embodiment.

Step S72: When the switch group 22a is set to a mode other than the self-timer mode, the microprocessor 22 determines that the self-timer has been released.
On the other hand, when the self-timer is released (release of the first start signal), the microprocessor 22 returns the operation to step S61. In this case, the moving image buffering in the buffer memory 17 is deleted without being recorded and saved. After this deletion operation, the microprocessor 22 resumes the operations after step S62.
On the other hand, when the self-timer is continuing, the microprocessor 22 proceeds to step S73.

Step S73: Here, the microprocessor 22 determines whether or not the set time of the self-timer has elapsed.
When the set time of the self-timer has elapsed (input of the second start signal), the microprocessor 22 shifts the operation to step S74.
On the other hand, if the set time of the self-timer has not elapsed, the microprocessor 22 continues moving image buffering during the self-timer period in step S69.

Steps S74 to S82: The same processing as steps S14 to S22 of the first embodiment.

[Effects of Sixth Embodiment]
As described above, in the sixth embodiment, moving image buffering is performed during the elapsed time of the self-timer. In this case, various dramas unfolded in front of the digital camera can be stored and recorded as moving images immediately before the still image shooting by the self-timer.
Further, since the moving image buffering is deleted along with the cancellation of the self-timer, it is possible to avoid a situation in which unnecessary moving images are accumulated in the memory card 21.
Next, another embodiment will be described.

<< 7th Embodiment >>
Since the structure of 7th Embodiment is the same as 1st Embodiment (FIG. 1), description here is abbreviate | omitted.
A feature of the seventh embodiment is that on-off control of moving image recording is performed according to subject luminance.
FIG. 11 is a flowchart for explaining the operation of the seventh embodiment. Hereinafter, these operations will be described along the step numbers shown in FIG.

Steps S91 to S98: The same processing as steps S1 to S8 of the first embodiment.

Step S99: The microprocessor 22 determines whether or not the brightness of the VGA image (that is, the subject brightness) is higher than the first threshold value. This first threshold value is a threshold value for determining whether or not the subject luminance is suitable for moving image shooting.
If the subject brightness is higher than the first threshold, the microprocessor 22 determines that it is suitable for moving image shooting, and moves the operation to step S101.
On the other hand, when the subject brightness is equal to or lower than the first threshold, the microprocessor 22 determines that the subject brightness is inappropriate for moving image shooting, and shifts the operation to step S100.

Step S100: The microprocessor 22 stores only the audio data acquired from the audio processing unit 32 in the buffer memory 17. After this operation, the microprocessor 22 shifts the operation to step S103.

Step S101: The microprocessor 22 sequentially drives the image sensor 13 in the draft mode via the timing generator 22b, and continues to capture the VGA image.

Step S102: The microprocessor 22 sequentially stores the VGA image and audio data in the buffer memory 17.

Step S103: The image display unit 24 sequentially displays the VGA images on the monitor screen 25.

Step S104: When the half-press operation of the release button 22c is released during such moving image buffering, the microprocessor 22 returns the operation to step S91. By returning to this step S91, the moving image buffering is deleted without being recorded and saved. After the deletion of the moving image buffering, the microprocessor 22 resumes the operations after step S92.
On the other hand, when the half-press operation of the release button 22c is continuing, the microprocessor 22 shifts the operation to step S105.

Step S105: Here, the microprocessor 22 determines whether or not the release button 22c is fully pressed.
If the full pressing operation is detected, the microprocessor 22 shifts the operation to step S106.
On the other hand, when the full pressing operation is not detected, the microprocessor 22 returns the operation to step S99.

Step S106: If there is no moving image buffering in the buffer memory 17, the microprocessor 22 proceeds to the red-eye reduction pre-flash in step S107.
On the other hand, if there is moving image buffering in the buffer memory 17, the operation proceeds to step S108 without performing red-eye reduction light emission. Usually, pre-light emission for reducing the red-eye phenomenon requires a light emission time of about 1 second. Therefore, when pre-flash is performed, the time interval between the moving image portion and the still image portion (freeze moving image data) is opened, and the pattern becomes discontinuous at the joint. Therefore, the pre-emission is omitted to prevent the joint pattern from becoming discontinuous.

Step S107: The microprocessor 22 controls the flash light emitting unit 31 to perform pre-light emission for reducing the red-eye phenomenon.

Step S108: The microprocessor 22 determines whether or not the subject brightness is higher than the second threshold value. The second threshold value is a threshold value for determining whether or not flash light emission is required for still image shooting.
If the subject brightness is higher than the second threshold value, the microprocessor 22 determines that flash emission is not necessary, and proceeds to step S110.
On the other hand, if the subject brightness is equal to or lower than the second threshold value, the microprocessor 22 determines that flash emission is necessary, and moves the operation to step S109.

Step S109: The microprocessor 22 controls the flash light emitting unit 31 to perform flash light emission in synchronization with still image shooting.

Steps S110 to S114: The same processing as steps S14 to S18 of the first embodiment.

Step S115: The microprocessor 22 determines whether or not the half-press time of the release button 22c is shorter than the third threshold value. This third threshold is a threshold for determining whether or not the release button 22c is fully pressed at once, or whether or not the half-pressing operation is an invalid operation for a moment.
Here, when the half-press time is shorter than the third threshold, the microprocessor 22 determines that the instantaneous moving image data is invalid, and shifts the operation to step S116.
On the other hand, if the half-press time is longer than the third threshold, the microprocessor 22 determines that the moving image data is valid, and proceeds to step S117.
The third threshold value is preferably set to about 0.5 seconds in accordance with the minimum reproduction time of the minimum unit GOP (group of picture) of moving image data in the moving image standard.

Step S116: The microprocessor 22 deletes the invalid video buffering in the buffer memory 17 and records the freeze video data on the memory card 21. After this operation, the operation proceeds to step S120.

Steps S117 to 120: The same processing as steps S19 to S22 of the first embodiment.

[Effects of the seventh embodiment]
As described above, in the seventh embodiment, moving image data is not stored when it is determined that the moving image buffering period is short. Therefore, it is possible to easily and rationally avoid the adverse effect that momentary and meaningless moving images are accumulated in the recording medium by pressing the release button 22c at once.

  In the seventh embodiment, moving image data is not stored even when the subject brightness is low. As a result, it is possible to easily and rationally avoid the negative effect that dark and unclear moving images accumulate in the recording medium.

  Note that the freeze moving image data is created from a bright still image with flash illumination. Conventionally, when video playback is freeze-played, a video frame that remains dark is displayed statically, resulting in an image that is too dark and difficult to see. However, in the seventh embodiment, since a bright freeze moving image with flash illumination is displayed, a bright and beautiful still image display can be realized.

  Further, at the time of reproduction, the reproduction display is switched from the moving image data in the dark state to the bright freeze moving image data subjected to the flash illumination, thereby enabling the realistic reproduction display that produces flash emission.

Furthermore, in the seventh embodiment, when the subject brightness is low, only the audio data is stored instead of the moving image data. As a result, even in a dark state that is not suitable for moving image shooting, it is possible to record a sense of realism by voice.
Next, another embodiment will be described.

<< Eighth Embodiment >>
Since the configuration of the eighth embodiment is the same as that of the first embodiment (FIG. 1), description thereof is omitted here.
A feature of the eighth embodiment is that normal moving image data is set to a relatively high compression rate with priority on data size, and freeze moving image data is set to a lower compression rate than moving image data with priority on image quality.
FIG. 12 is a flowchart for explaining the operation of the eighth embodiment. Hereinafter, these operations will be described along the step numbers shown in FIG.

Steps S151 to S170: The same processing as steps S1 to S20 of the first embodiment.

Step S171: Here, the compression / decompression unit 23 encodes the moving image data accumulated during the half-press period. For example, when compression is performed on an MPEG2 moving image file, an I picture that is the basis of an image is compressed at a first compression rate (high compression) and encoded. Since there is a motion between frames in this moving image data, there is little visual image degradation even if the compression rate is set high. In addition, the compression code amount of the moving image data is reduced.

Step S172: Subsequently, the compression / decompression unit 23 encodes the freeze moving image. For example, when compressing an MPEG2 moving image file, an I picture that is the basis of an image is compressed at a second compression rate (low compression) and encoded. As a result, visual image quality degradation is reduced for freeze video data. In the case of freeze moving image data, even if the compression code amount of the I picture is large, it is possible to reduce the information amount of the B picture or P picture indicating the image change between frames. Not so much.

Step S173: The microprocessor 22 records the compressed data that has been encoded by the compression / decompression unit 23 in the memory card 21.

Step S174: The same process as step S22 of the first embodiment.

[Effects of Eighth Embodiment]
As described above, in the eighth embodiment, the same effects as in the first embodiment can be obtained.
Furthermore, in the eighth embodiment, in image compression of moving image data and freeze moving image data, by switching the compression rate according to the characteristics of both data, the image quality deterioration is not noticeable visually, and the entire compression code amount is reduced. Suppressed image recording is realized.
Next, another embodiment will be described.

<< Ninth Embodiment >>
Since the structure of 9th Embodiment is the same as 1st Embodiment (FIG. 1), description here is abbreviate | omitted.
A feature of the ninth embodiment is that the resolution of moving image data is converted.
FIG. 13 is a flowchart for explaining the operation of the ninth embodiment. Hereinafter, these operations will be described along the step numbers shown in FIG.

Steps S181 to S189: The same processing as Steps S1 to S9 of the first embodiment.

Step S190: The image processing unit 19 enlarges the VGA image (moving image frame) by pixel interpolation, and converts the resolution to “horizontal 960 pixels, vertical 720 pixels”. The converted image has an image size suitable for screen display of “horizontal 1280 pixels, vertical 720 pixels” in the simple high-definition format.

Steps S191 to S196: The same processing as Steps S10 to S15 of the first embodiment.

Step S197: The image processing unit 19 performs resolution reduction processing based on the still image in the buffer memory 17, and uses the same “horizontal 960 pixels, vertical 720 pixels” still image as the moving image data (hereinafter referred to as a simple high-definition still image). Create).

Step S198: When the image processing unit 19 detects that the vertical position shooting is performed from the detection result of the camera posture, the image processing unit 19 performs rotation conversion, resolution conversion, and margin addition processing on the simple high-definition still image.

Step S199: The microprocessor 22 creates freeze moving image data for reproducing the simple high-definition still image that has undergone the processing of step S198 as a moving image frame for 3 seconds.

Step S200: The microprocessor 22 stores the simple high-definition still image as information for the header of the moving image data in the buffer memory 17.

Steps S201 to S205: The same processing as steps S170 to S174 of the eighth embodiment.

[Effects of Ninth Embodiment]
As described above, the ninth embodiment can obtain the same effects as those of the first embodiment.
Furthermore, in the ninth embodiment, moving image data and freeze moving image data are converted into resolutions of “960 horizontal pixels and 720 vertical pixels”, respectively, so that moving images and still images suitable for image viewing on a high-definition television or the like are displayed. The image display can be realized.
Next, another embodiment will be described.

<< 10th Embodiment >>
Since the configuration of the tenth embodiment is the same as that of the first embodiment (FIG. 1), description thereof is omitted here.
A feature of the tenth embodiment is that an image immediately before full pressing is acquired from moving image data, and freeze moving image data is created.
FIG. 14 is a flowchart for explaining the operation of the tenth embodiment. Hereinafter, these operations will be described along the step numbers shown in FIG.

Steps S211 to S225: The same processing as steps S1 to S15 of the first embodiment.

Step S226: The microprocessor 22 reads the VGA image immediately before full pressing from the moving image buffering in the buffer memory 17.

Step S227: The microprocessor 22 rotationally converts the VGA image immediately before full pressing in accordance with the camera posture obtained from the posture sensor 22d.

Step S228: The microprocessor 22 creates freeze moving image data for reproducing the VGA image that has undergone the processing of step S227 as a moving image frame for 3 seconds.

Step S229: The microprocessor 22 stores the VGA image immediately before full pressing as information for the header of the moving image data in the buffer memory 17.

Steps S230 to S232: The same processing as Steps S20 to S22 of the first embodiment.

[Effects of the tenth embodiment]
As described above, the tenth embodiment can obtain the same effects as those of the first embodiment.
Furthermore, in the tenth embodiment, freeze moving image data is created from moving image data immediately before being fully pressed. Therefore, it is not necessary to reduce the size of a high-resolution still image to create freeze moving image data, and there is an advantage that the processing load is small.
Next, a reproduction operation of the moving image file (concatenated moving image data and freeze moving image data) created in the above-described embodiment will be described.

《Example of playback screen》
FIG. 15 is a diagram showing a display screen (including a photograph of a halftone image on a display).
Such a display screen is created by the image display unit 24 in the digital camera 11 and displayed on an external monitor connected to the digital camera 11. Further, an external computer or a moving image playback apparatus may take in a file group created on the digital camera 11 side via a communication medium or a recording medium, and create and display the display screen shown in FIG.

Hereinafter, the display screen and its operation will be described.
On the display screen shown in FIG. 15A, a playback screen 100, a thumbnail 101, operation icons 102 to 104, and a shooting date 106 are displayed.
The playback screen 100 displays a main playback image. In the default state, the still image stored in the header of the moving image file is displayed.

In this state, when the user clicks the playback screen 100 or the playback icon 105 or presses the playback button of the digital camera 11, the moving image recorded during the half-press period is played back on the playback screen 100. Thereafter, the freeze video is displayed on the playback screen 100.
If the user does not perform any operation, new moving image files are played back one after another according to the order of the file name and shooting date.

On the other hand, when the playback screen 100 is in the focus selected state, when the reverse feed icon 102 or the fast forward icon 104 is clicked or a playback control button (not shown) on the digital camera 11 side is operated, the playback screen 100 is displayed. Still images switch in order of shooting date.
In the thumbnail 101, a still image of a moving image file is displayed as a thumbnail. When the thumbnail 101 is in focus and the reverse icon 102 or the fast forward icon 104 is operated, the thumbnail 101 can be scrolled left and right. In this state, by clicking and selecting the thumbnail 101, the click-selected still image is displayed on the playback screen 100.

On the other hand, FIG. 15 (2) shows a book-type display screen. On the left and right pages of the book type, a date display 206, a playback screen 200, page feed icons 202 and 204, and a playback icon 205 are displayed.
By clicking the page feed icons 202 and 204, first, a page feed animation is displayed, and new pages before and after are displayed. New still images are displayed on the new page in the order of the shooting date and time.

When the playback icon 205 is clicked in such a state, first, the moving image playback on the left page side is performed. When the video display on the left page is finished, the video playback on the right page side is continued.
When the digital camera 11 is connected to an external monitor for playback, the movie file is played by pressing the playback button of the digital camera 11 once, and the still image is played by pressing twice (double click). good.

<< Additional items of embodiment >>
In the seventh embodiment, when the buffering time of moving image data is shorter than the third threshold, moving image data is not recorded, and meaningless accumulation of moving image data for a short time is avoided (S115 in FIG. 7). , S116). It is preferable to implement this function not only in the seventh embodiment but also in the first to third embodiments and the fifth to tenth embodiments.

  In the seventh embodiment, when the moving image data being buffered is darker than the first threshold value, the moving image data is not recorded, and only the audio data for that period is recorded (see seventh S99 to S100). This function is preferably implemented not only in the seventh embodiment but also in the first to third embodiments and the fifth to tenth embodiments.

  In the ninth embodiment, a moving image read in the draft mode (decrease reading mode) is interpolated to a simple high-definition pixel size, and a still image read in the all-pixel reading mode is reduced to the simple high-definition pixel size. . This function is preferably implemented not only in the ninth embodiment but also in the first to third embodiments and the fifth to tenth embodiments.

In addition, in the first to tenth embodiments described above, it is preferable to perform the following operations.
(1) A flash is applied only to still images.
(2) Change the sensitivity for moving images and still images. The charge accumulation time is changed between a still image and a moving image. (3) The red-eye reduction lamp is not irradiated during moving image shooting.
(4) Remove noise only for still images.
(5) If the recording resolution of the still image is smaller than VGA, no moving image is created.

  As described above, the present invention is a technique that can be used for an electronic camera or the like.

It is a block diagram which shows the structure of 1st Embodiment. It is a flowchart explaining operation | movement of 1st Embodiment. It is a figure explaining the storage folder of a file. It is a figure which shows rotation conversion of the VGA still image according to the imaging | photography posture. It is a figure which shows the file structure which connected the moving image file. It is a flowchart explaining operation | movement of 2nd Embodiment. It is a flowchart explaining operation | movement of 3rd Embodiment. It is a flowchart explaining operation | movement of 4th Embodiment. It is a flowchart explaining operation | movement of 5th Embodiment. It is a flowchart explaining operation | movement of 6th Embodiment. It is a flowchart explaining operation | movement of 7th Embodiment. It is a flowchart explaining operation | movement of 8th Embodiment. It is a flowchart explaining operation | movement of 9th Embodiment. It is a flowchart explaining operation | movement of 10th Embodiment. It is a figure which shows a display screen (including the photograph of the halftone image on a display).

Explanation of symbols

11 Digital Camera 12 Shooting Lens 13 Image Sensor 15 A / D Converter 16 Signal Processing Unit 17 Buffer Memory 18 Bus 19 Image Processing Unit 20 Card Interface 21 Memory Card 22 Microprocessor 22a Switch Group 22b Timing Generator 22c Release Button 22d Attitude Sensor 23 Compression / decompression unit 24 Image display unit 25 Monitor screen 30 Red-eye reduction light emission unit 31 Flash light emission unit 32 Audio processing unit 33 Microphone 100 Playback screen

Claims (3)

An imaging unit that captures a subject image;
A posture determination unit that determines the shooting posture of the vertical position / horizontal position;
An imaging control unit for controlling the imaging unit to obtain a still image;
A rotation conversion unit that rotates and converts the still image in accordance with the shooting posture;
An image processing unit for creating freeze moving image data for reproducing the still image after rotation conversion for a predetermined period by storing the still image after rotation conversion in a moving image frame. The digital camera according to claim 1, wherein
The rotation conversion unit converts the resolution of the still image so that the number of pixels in the long side direction of the still image is equal to or less than the number of pixels in the short side direction of the screen when rotating the still image. A digital camera. The digital camera according to claim 1 or 2,
The rotation conversion unit synthesizes a predetermined image for aspect adjustment outside the frame of the still image screen after the rotation conversion so as to maintain the screen aspect ratio before the rotation when rotating the still image. A digital camera.

Images