JP5653736B2 - Camera, display device, and display method - Google Patents

Description

  The present invention relates to a camera capable of capturing a still image during moving image shooting, and a display device and a display method for the captured image.

  Various cameras have been proposed that can shoot still images during moving image shooting and that record moving images and still images in association with each other. For example, Patent Document 1 discloses a camera that displays a mark on a screen during playback of a moving image on a position corresponding to the timing at which the still image was shot on the time axis of moving image shooting. Patent Document 2 discloses a camera that displays a still image on a part of a moving image display screen when still image shooting is performed during moving image shooting.

JP 2004-31218 A JP 2006-295411 A

  In general, a still image performed during moving image shooting is managed by linking with a captured moving image. For this reason, as shown in Patent Documents 1 and 2, it is possible to separate and display a moving image and a still image during moving image shooting or moving image reproduction. However, a still image taken during conventional moving image shooting merely displays a still image, and does not display the feature of the moving image.

  The present invention has been made in view of such circumstances, and provides a camera, a display device, and a display method capable of performing effective display by combining still images taken simultaneously with a moving image. With the goal.

  In order to achieve the above object, a camera according to a first aspect of the present invention includes a still image control unit for controlling still image shooting, a moving image control unit for controlling moving image shooting, and a live view image for subject confirmation during the moving image shooting. A display control unit for displaying, and a partial image extraction unit for extracting a specific portion of a captured still image as a partial image, and the display control unit is configured to capture a still image during moving image shooting. The partial image extracted by the partial image extraction unit from the captured still image is placed at the position of the live view image where the specific portion was present when the still image was captured. Overlay the period.

In the camera according to a second aspect of the present invention, in the first aspect, the partial image extraction unit extracts, as the specific portion, a portion that is recognized as having a predetermined or more movement in the screen during the still image shooting.
According to a third aspect of the present invention, there is provided a camera according to the first aspect, further comprising a screen change determining unit that determines that the screen has changed more than a predetermined amount, and the display control unit is determined to have changed. Thereafter, the display of the partial image is stopped.

  In the camera according to a fourth aspect of the present invention, in the first aspect, the display control unit determines, as the partial image information, a position overlapping the image information indicating the partial image and the corresponding moving image screen. The position information shown is recorded.

  A display device according to a fifth aspect of the invention is an image storage unit capable of storing an image shot as a still image during shooting of a moving image, a display unit capable of reproducing and displaying the still image and the moving image, and reading from the image storage unit. During the playback of a moving image, the partial image that is a part of the still image captured during the moving image capturing is displayed at the timing when the still image is captured. And a control unit that displays the image on the display unit so as to be superimposed on the position of the moving image screen.

Sixth display device according to the present invention, in the fifth aspect, the upper Symbol control part is the partial images a predetermined time, and displays superimposed on the video.
Display device according to a seventh aspect of the present invention based on the sixth, upper Symbol control section is a period to be displayed by superimposing the partial image is played slow the video.

  According to an eighth aspect of the present invention, there is provided a display method for reading an image shot as a still image during moving image shooting, and shooting during the moving image shooting at the timing when the still image was shot during playback of the read moving image. A process of superimposing a partial image, which is a part of the still image, on the position of the moving image screen where the partial image existed when the still image was captured, Display the image on the display.

  According to the first, fifth, and eighth inventions, it is possible to provide a camera, a display device, and a display method capable of performing effective display by combining still images taken simultaneously with a moving image. .

  In addition, according to the camera of the second invention, not all the still images are superimposed, but only the moving part, that is, the part that is to be confirmed is superimposed and displayed, which may hinder the moving image monitor. Absent. According to the camera of the third aspect of the invention, when the screen changes greatly, it is possible to stop displaying the partial image and prevent an unnatural image due to the partial image remaining. According to the camera of the fourth aspect of the invention, since the position information indicating the position on the screen of the moving image corresponding to the image information indicating the partial image is stored, the partial image can be easily superimposed during reproduction. Can do.

  According to the sixth aspect of the present invention, if the partial image is displayed too long, it may be annoying, but this annoyance can be prevented. According to the seventh aspect of the invention, it is possible to display a still image portion with a more impressive impression.

It is a block diagram which mainly shows the structure of the electric circuit of the camera concerning one Embodiment of this invention. It is a figure which shows the relationship between the moving image photography, the still image photography, and the display state of reproduction | regeneration in the camera concerning one Embodiment of this invention. FIG. 6 is a diagram illustrating a display example of a still image during moving image shooting in the camera according to the embodiment of the present invention. It is a figure which shows the example of a display when there exists a screen change in the camera concerning one Embodiment of this invention. FIG. 6 is a diagram illustrating a relationship between display states of still image reproduction during moving image reproduction in the camera according to the embodiment of the present invention. FIG. 10 is a diagram illustrating a modification of the relationship of display states of still image reproduction during moving image reproduction in the camera according to the embodiment of the present invention. It is a figure which shows the example of a screen at the time of the reproduction | regeneration in the camera concerning one Embodiment of this invention. It is a flowchart which shows the operation | movement in the video recording mode in the camera concerning one Embodiment of this invention. It is a flowchart which shows the operation | movement in the video recording mode in the camera concerning one Embodiment of this invention. It is a flowchart which shows the operation | movement in the partial image superimposition process in the camera concerning one Embodiment of this invention. It is a flowchart which shows the operation | movement in the moving image reproduction mode in the camera concerning one Embodiment of this invention. It is a flowchart which shows the operation | movement in the moving image reproduction mode in the camera concerning one Embodiment of this invention.

  Hereinafter, a preferred embodiment will be described using a camera to which the present invention is applied according to the drawings. A camera according to a preferred embodiment of the present invention is a digital camera, includes an imaging unit, converts a subject image into image data by the imaging unit, and converts the subject image into a main body based on the converted image data. Live view is displayed on the display unit placed on the back of the camera. The photographer determines the composition and the photo opportunity by observing the live view display. By operating the release button, still image data is recorded on the recording medium. Also, moving image shooting is started by operating the moving image button, and moving image shooting is ended by operating the moving image button again. When the release button is operated during moving image shooting, image data of a still image is recorded simultaneously with the moving image. The moving image and still image data recorded on the recording medium can be reproduced and displayed on the display unit when the reproduction mode is selected.

  FIG. 1 is a block diagram showing a configuration of a camera 1 according to an embodiment of the present invention. A control unit (CPU: Central Processing Unit) 11 operates according to a control program stored in the program / data storage unit 12 and performs overall control of the digital camera. In the control unit 11, a display control unit 11a, a moving image control unit 11b, a still image control unit 11c, a partial image extraction unit 11d, and a screen change determination unit 11e are provided. Since 11a to 11e in the control unit 11 are a part of processing executed by the control program, they will be described as functional units included in the control unit 11.

  The display control unit 11a performs display control of the live view image for subject confirmation during still image shooting or moving image shooting. As will be described later with reference to FIGS. 3 to 7, when still image shooting is performed during moving image shooting, a partial image of the still image extracted by the later-described partial image extraction unit 11 d is used as a still image. The image is superimposed and displayed on the live view image for a predetermined period at the position where the partial image was present at the time of shooting. Further, the display control unit 11a records, together with the image data, position information indicating a position to be displayed by being superimposed on the partial image extracted by the partial image extraction unit 11d and the screen of the corresponding moving image.

  In addition, the display control unit 11a displays a partial image of the still image captured during the movie shooting and the timing when the still image was captured, and the partial image exists when the still image is captured. It is displayed superimposed on the selected position. Further, in addition to the above-described display, the display control unit 11a displays a live view image at the time of still image shooting, a REC view display, a playback display of a still image or a moving image stored in the image storage unit 24, and Displays the menu screen.

  The moving image control unit 11b performs shooting control during moving image shooting. That is, moving image shooting starts when the moving image button is operated, and moving image shooting ends when the moving image button is operated again. During this time, the moving image data output from the imaging unit 15 is processed by the image processing unit 17 and the moving image compression / decompression unit 20, and the moving image recording unit / reproducing unit 22 stores the moving image data in the image storage unit 24.

  The still image control unit 11c performs shooting control during still image shooting. In still image shooting, image data output from the imaging unit 15 is processed by the image processing unit 17 or the still image compression / decompression unit 21 at the timing when the release button is operated, and then the still image recording / reproducing unit 23 performs image processing. Store in the storage unit 24.

  The partial image extraction unit 11d extracts a specific part of the captured still image as a partial image. That is, the partial image extraction unit 11d detects a portion (specific portion) having a motion from the subject on the screen, and extracts it as a partial image of the specific portion from the photographed still image. A well-known tracking technique may be used. As a part to be extracted as the specific part, “face” or “person” may be targeted in addition to the moving part.

  The screen change determination unit 11e determines that the screen has changed more than a predetermined amount. That is, the screen change determination unit 11e compares the brightness and hue of several ranges of the screen at predetermined time intervals, and determines that there is a change in the screen if a certain change is detected. The screen change determination unit 11e also detects the amount of movement on the screen when the partial image moves on the screen, such as when the orientation of the camera changes or the screen is enlarged or reduced by zooming. . When the display control unit 11a determines that there is a change by the screen change determination unit 11e, the display control unit 11a stops displaying the partial image thereafter. When the change is small, the display of the partial image is not stopped and the partial image is displayed at a position corresponding to the movement amount on the screen.

  A program / data storage unit 12, an operation unit 13, and a bus 25 are connected to the control unit 11. The program / data storage unit 12 is a non-volatile memory, and stores a program executed in the control unit 11 and various data as described above.

  The operation unit 13 includes various operation members for the user to give instructions to the camera. The various operation members include a power button, a release button, a moving image button, a cross button, an OK button, a playback button, and the like, and output detection results of operation states of the various operation members to the control unit 11.

  In addition to the control unit 11 described above, the bus 25 includes an imaging unit 15, SDRAM 16, image processing unit 17, display driver unit 18, moving image compression / decompression unit 20, still image compression / decompression unit 21, moving image recording / reproduction unit 22, A still image recording / reproducing unit 23 is connected. The imaging unit 15 includes a photographing lens for forming a subject image, an imaging element for converting the subject image into image data, a processing circuit thereof, a diaphragm and a shutter interposed in the optical path of the photographing lens, and the like. Including. The image data generated by the imaging unit 15 is output to the bus 25.

  An SDRAM (Synchronous Dynamic Random Access Memory) is an electrically rewritable nonvolatile temporary storage memory, and is used for temporary storage of image data output from the imaging unit 15. The image processing unit 17 performs various kinds of images such as digital amplification (digital gain adjustment processing) of digital image data, white balance, color correction, gamma (γ) correction, contrast correction, live view display image generation, and moving image generation. Perform processing.

  The moving picture compression / decompression unit 20 is a circuit for compressing moving picture image data temporarily stored in the SDRAM 16 by a compression method such as MPEG and for decompression for display. The still image compression / decompression unit 21 is a circuit for compressing still image data temporarily stored in the SDRAM 16 by a compression method such as JPEG or TIFF, and decompressing the image data for display or the like. Since the moving image compression / decompression unit 20 and the still image compression / decompression unit 21 are provided separately, both image data can be processed in parallel even when a still image is shot during moving image shooting. . Note that image compression is not limited to MPEG, JPEG, and TIFF, and other compression methods may be used.

  The display driver unit 18 causes the display unit 19 to display a live view display during shooting and a playback image during playback. In particular, when still image shooting is performed during moving image shooting, the display driver unit 18 causes the display unit 19 to display a partial image of a still image in accordance with an instruction from the display control unit 11a. Similarly, a partial image of a still image is displayed in synchronization with the timing of still image shooting during playback and display of a moving image. The display unit 19 is connected to the display driver unit 18 and has a display such as a liquid crystal monitor or an organic EL arranged on the back of the main body. A predetermined image is displayed on the screen by the control of the display driver unit 18. The

  The moving image recording / reproducing unit 22 stores the image data of the moving image compressed by the moving image compression / decompression unit 20 in the image storage unit 24 and reads out the image data of the moving image stored in the image storage unit 24. The read image data is decompressed by the moving image compression / decompression unit 20, and an image is reproduced and displayed on the display unit 19 based on the decompressed image data.

  The still image recording / reproducing unit 23 stores the image data compressed by the still image compression / decompression unit 21 in the image storage unit 24 and reads out the image data of the still image stored in the image storage unit 24. The read image data is expanded by the still image compression / decompression unit 21, and an image is reproduced and displayed on the display unit 19 based on the expanded image data. Since the moving image recording / playback unit 22 and the still image recording / playback unit 23 are provided separately, even when a still image is shot during moving image shooting, the timing of still image shooting is reached during moving image playback. Even in this case, both image data can be processed in parallel.

  The image storage unit 24 is connected to the moving image recording / reproducing unit 22 and the still image recording / reproducing unit 23, and is a recording medium for image data that can be built in or loaded into the camera body. A shooting date and time is recorded in a tag (header) of the image data. In addition, when still image shooting is performed during moving image shooting and a partial image is extracted, image information indicating the partial image and position information indicating a position displayed on the screen of the corresponding moving image are superimposed, It is stored in association with the image information of the corresponding moving image.

  Next, live view display when still image shooting is performed during moving image shooting will be described with reference to FIGS. 2 and 3. FIG. 2 shows a photographing example used for the following description. In FIG. 2, the horizontal axis is a time axis, and operation shooting is started at time t1, still image A at time t2, still image B at time t3, still image C at time t4, still image D at time t5, time A still image E is photographed at t6, and a still image F is photographed at time t7.

  When the partial image is displayed on the screen, it is faded out. The right triangle shape shown in the still image A indicates the luminance change (fade out) of the partial image, the display luminance is the highest at time t2 at the time of still image shooting, and then the display luminance gradually decreases. Specifically, the display of the partial image of the still image A disappears between time t4 and time t5. Similarly, the still images B to F have the highest display luminance during still image shooting, and then gradually decrease in display luminance, and finally disappear after a lapse of a predetermined time.

  FIGS. 3B to 3F show live view displays at times t4 to t8, respectively, and FIG. 3A summarizes the movements of the partial images Ap to Fp shown in FIGS. 3B to 3F. It is the figure expressed. 3B is a live view display at time t4, and as can be seen from FIG. 2, the partial images of the still images A and B are displayed for a predetermined time like an afterimage. Therefore, at time t4, Cr1, Cr2, and Cr3 that are real images at this time are displayed, and partial images Ap and Bp extracted from the two still images A and B are displayed.

  Similarly, FIG. 3 (c) shows a live view display at time t5, in which Dr1 to Dr3 which are real images at this time are displayed and partial images Ap to extracted from three still images A to C are displayed. Cp is displayed. Note that the display brightness of the partial image Ap decreases at time t5, and the partial image Ap is displayed lightly. FIG. 3D shows a live view display at time t6, in which Er1 to Er3 which are real images at this time are displayed, and a partial image Dp extracted from the still image D is displayed. The display brightness of the partial image Dp decreases at time t6, and the partial image Dp is displayed lightly.

  Similarly, FIG. 3E shows a live view display at time t7, where Fr1 to Fr3 that are real images at this time are displayed, and partial images Dp and Ep extracted from the still images D and E are displayed. Is done. The display brightness of the partial image Dp is reduced at time t7, and the partial image Dp is displayed lightly. FIG. 3F shows a live view display at time t8, where real images Gr1 to Gr3 at this time are displayed, and partial images Ep and Fp extracted from the still images E and F are displayed. The display brightness of the partial image Ep decreases at time t8, and the partial image Ep is displayed lightly.

  In the example shown in FIGS. 2 and 3, the partial images Ap to Fp move within the same screen, but the shooting angle of view and direction do not change. On the other hand, the examples shown in FIGS. 4B to 4D are cases where the shooting angle of view and direction change. FIG. 4A shows a display corresponding to FIG. When the photographer shakes the camera to the right (panning to the right) from the state shown in FIG. 4A, the position where the partial image is to be displayed is outside the screen as shown in FIG. 4B. End up. In this state, the display control unit 11a does not display the partial images Ap and Bp in live view.

  However, if the screen changes slightly, the partial images Ap and Bp are displayed at the positions that existed when the still image was taken, as shown in FIG. That is, the display control unit 11a maintains the relative relationship between the positions of the partial images (Ap, Bp) in the screen at the time of shooting and the positions of the real images Cr1, Cr2 currently displayed. Bp is displayed.

  Note that when the screen changes greatly and the partial image at the time of still image shooting is not located in the changed screen, the partial image is not displayed in this embodiment as shown in FIG. However, as shown in FIG. 4D, the partial image may be displayed regardless of the position. In this case, the partial image at the time of still image shooting is absolutely displayed on the screen. 4B to 4C, the screen change is determined by the screen change determination unit 11e.

  The above description is the display during moving image shooting. Next, the reproduction display of the moving image will be described with reference to FIGS. Here, the display when a still image is shot during moving image shooting will be mainly described.

  FIG. 5A shows the display of a partial image of a still image in the moving image playback mode, and the same display as the live view display during moving image shooting is performed during the playback display. That is, when the reproduction of the moving image is started at time t11, the partial image Ap of the still image A taken at time t2 is displayed at time t12. In displaying the partial image Ap, the right triangle shape shows a luminance change, the display luminance is the highest at time t12, and then the display luminance gradually decreases. Finally, the partial image Ap is between time t14 and t15. Indicates that the display disappears.

  Similarly, the partial image Bp of the still image B at the time t13, the partial image Cp of the still image C at the time t14, the partial image Dp of the still image D at the time t15, the partial image Ep of the still image E at the time t16, and the time t17. The reproduction of the partial images Fp of the still image F is started. Similarly, the partial images Bp to Fp have the highest display luminance at the start of display, and then gradually decrease in display luminance and eventually disappear.

  As described above, in this embodiment, as in moving image shooting, a partial image of a still image is displayed for a predetermined time and displayed so as to fade out. During moving image shooting and playback, the partial image was displayed with the maximum luminance at the start of display and faded out. However, of course, the display may be started by fading in during moving image shooting or playback. Further, as shown in FIG. 5B, it is of course possible to display a partial image of a still image with a constant luminance to the end when reproducing a moving image.

  Furthermore, when a partial image of a still image is reproduced during moving image reproduction, the moving image may be reproduced slowly as shown in FIG. In this case, the slow playback time may be set as appropriate, but may be about 4 seconds, for example. The timing at which a still image is taken is a photo opportunity and a scene that remains in an impression, so that before and after taking a still image is slowly reproduced.

  In addition, as shown in FIG. 6B, at the timing when the still image was taken, the partial image was slowly played back for about 2 seconds, and then the entire still image including the partial image was played for about 1 second. It may be displayed and the partial image is again played back slowly for about 2 seconds. Further, as shown in FIG. 6C, the moving image reproduction is temporarily interrupted at the timing when the still image is captured, the still image is displayed for a predetermined time (for example, 1 second), and then the moving image reproduction is resumed. That is, of course, the entire still image may be displayed during moving image reproduction. The time for slow reproduction and the time for displaying the entire still image shown in FIGS. 6A to 6C may be changed as appropriate.

  FIG. 7A shows a screen at the time of reproducing and displaying a moving image and a still image on the display unit 19. A moving image display window 19a for displaying a moving image is provided from the upper part of the display screen of the display unit 19 to the center. The moving image thumbnails 19 are arranged in a horizontal row at the bottom of the display screen of the display unit 19. The moving image thumbnail 19d is a thumbnail image extracted from the entire moving image at equal time intervals (for example, 5 seconds). Since the moving image thumbnail 19d is an image at equal time intervals, the example of the moving image thumbnail 19d corresponds to the time axis.

  A cursor 19c is arranged above the moving image thumbnail 19d. The cursor 19c indicates where the moving image display window 19a is currently reproduced. Further, the cursor 19c moves from the left side to the right side according to the time from the start of playback of the movie being played back on the movie display window 19a, and reaches the right end when the movie playback ends. The user can confirm the current reproduction position by looking at the position of the cursor 19c.

  Still image thumbnails 19b are arranged in a horizontal row between the cursor 19c and the moving image display window 19a. The still image thumbnail 19 is arranged at the position of the moving image thumbnail 19d column corresponding to the timing when the still image is taken. Each thumbnail of the still image thumbnail 19b is tilted so as to rise upward. The position of the lower left corner indicates the timing of still image shooting. Of course, it may be arranged so that the left shoulder is lower than the right shoulder.

  Since the display screen is configured as described above, when the reproduction of the moving image starts, the cursor 19c moves according to the time from the start. Then, as time elapses, a moving image in which partial images of still images as shown in FIGS. 3 and 4 are superimposed is displayed on the moving image display window 19a.

  Note that the playback screen for moving images with still images is not limited to the screen shown in FIG. For example, a screen as shown in FIG. 7B may of course be used. Also in the example shown in FIG. 7B, the moving image display window 19 a is arranged from the upper part of the display screen of the display unit 19 to the center part.

  In the lower part of the display screen of the display unit 19, a time axis 19g of the moving image is arranged in a horizontal straight line. A cursor 19f is arranged on the time axis 19g. Like the cursor 19c, the cursor 19f moves from the left side to the right side according to the time from the start of moving image reproduction, and reaches the right end when the moving image reproduction ends. A still image shooting timing 19h is displayed on the time axis 19g.

  Between the time axis 19g and the moving image display window 19a, still image thumbnails 19e are arranged in a horizontal row. Strictly speaking, when the still image thumbnail 19e is photographed, the still image thumbnail 19e is displayed at the still image photographing timing 19h, and the position of the still image thumbnail 19e is arranged in the vicinity of the photographing time.

  Since the modification of the display screen of the present embodiment is configured as described above, when the reproduction of the moving image starts, the cursor 19f moves according to the time from the start. Then, as time elapses, a moving image in which partial images of still images as shown in FIGS. 3 and 4 are superimposed is displayed on the moving image display window 19a.

  Next, the operation in the present embodiment will be described with reference to the flowcharts shown in FIGS. These flowcharts are executed by the control unit 11 in accordance with a program stored in the program / data storage unit 12. In the moving image shooting flow shown in FIG. 8, first, a normal live view is displayed (S1). Here, based on the image data acquired by the imaging unit 15, normal live view display is performed on the display unit 19. In the normal live view display, the partial image of the still image as described with reference to FIGS. 2 to 4 is not displayed.

  If normal live view display is performed, it is next determined whether or not there is an instruction to start moving image shooting (S3). Here, the operation state of the moving image button which is one of the operation units 13 is determined. As a result of this determination, if there is no instruction to start moving image shooting, the process returns to step S1 to continue normal live view display.

  On the other hand, if the result of determination in step S3 is that there is an instruction to start moving image shooting, then moving image shooting is started (S5) and moving image recording is performed (S7). Here, after the image data acquired by the imaging unit 15 is processed by the image processing unit 17 and the moving image compression / decompression unit 20, the moving image recording / reproducing unit 22 records moving image data in the image storage unit 24. This moving image shooting and recording continues until a moving image shooting stop operation is performed in step S17 described later.

  When movie shooting and recording are started, it is next determined whether or not a still image shooting start instruction has been issued (S9). Here, the operation state of the release button which is one of the operation units 13 is determined. As a result of this determination, if there is an instruction to start still image shooting, partial image superimposing processing is performed (S11). In the partial image superimposing process, a moving subject is extracted from a still image as a partial image, and the partial image is superimposed on a moving image. Detailed operation of the partial image superimposing process will be described later with reference to FIG.

  If the result of determination in step S9 is that there has been no instruction to start still image shooting, it is next determined whether or not there is a partial image that is already being superimposed (S13). In this embodiment, when a partial image is displayed, fade-out is performed to gradually reduce the luminance of the display image. Therefore, in this step, it is determined whether or not there is a partial image being faded out.

  If the result of determination in step S13 is that there is no partial image being superimposed, then normal live view display is performed (S15). Here, since there is no partial image being displayed, normal live view display similar to step S1 is performed.

  If the result of determination in step S13 is that there is a partial image that is already being superimposed, then the previous screen is compared with the current screen (S21 in FIG. 9). As described with reference to FIG. 4, the camera may be shaken and the screen itself may move. Therefore, in this step, the screen change determination unit 11e compares the previous screen with the current screen in order to determine whether or not the screen has been shaken.

  Subsequently, it is determined whether or not the screen has changed significantly (S23). Here, the screen change determination unit 11e determines based on the comparison result in step S21. The screen has changed significantly as described with reference to FIG. 4B when the screen has moved to such an extent that the partial image extracted from the still image is not located within the moved screen. As a result of this determination, if the screen is determined to be large, the process proceeds to step S15, where normal live view display is performed, and no partial image is displayed.

  If the result of determination in step S23 is that the screen has not changed significantly, it is next determined whether or not the screen has changed small (S25). Here, the screen change determination unit 11e determines based on the comparison result in step S21. As described with reference to FIG. 4C, the screen has changed to a small size when the screen has moved, but the partial image extracted from the still image is located within the moved screen. say.

  If the result of determination in step S25 is that the screen has changed slightly, the partial image is then displayed at a corresponding position in accordance with the change in the screen (S27). Here, as shown in FIG. 4C, the position of the partial image is moved in accordance with the movement of the screen, and display is performed so as to maintain the relative positional relationship between the position of the partial image and the real image.

  If the partial image is displayed in step S27, or if the result of determination in step S25 is that the screen has not changed, then the accuracy of the partial image is lowered according to the elapsed time (S29). As described above, since the partial image is displayed by fading out, the display luminance is reduced with time.

  Subsequently, a series of information relating to the position / timing at which the partial image is superimposed and displayed on the moving image and the brightness to be reduced is recorded (S30). When reproducing and displaying a moving image, a series of information necessary for displaying a partial image of a still image as described in FIGS. 5 to 7 is stored in the image storage unit 24 in association with the image data of the moving image.

  If partial image superimposition processing is performed in step S11, normal live view display is performed in step S15, or a series of information is recorded in step S30, it is next determined whether or not there has been a moving image shooting stop operation. (S17 in FIG. 8). Here, it is determined whether or not the moving image button has been operated again. If the result of this determination is that a movie shooting stop operation has not been performed, processing returns to step S5 and movie shooting continues.

  If the result of determination in step S <b> 17 is that a movie shooting stop operation has been performed, it is next determined whether or not a power off operation has been performed (S <b> 19). Here, the determination is made based on whether or not a power button as one of the operation units 13 has been operated. If the result of this determination is that there has been no power-off operation, processing returns to step S1 and the processing described above is performed. On the other hand, if the power is turned off, the moving image shooting mode is terminated.

  Next, the partial image superimposing process in step S11 will be described using the flowchart shown in FIG. In the partial image superimposing process flow, first, still image shooting is performed (S31), and still image recording is performed (S33). In step S9, since there is an instruction to shoot a still image, the image data acquired by the imaging unit 15 is processed by the image processing unit 17 and the still image compression / decompression unit 21, and then the still image recording / playback unit 23, the image data of the moving image is recorded in the image storage unit 24.

  Once the still image has been shot and recorded, it is next determined whether or not the still image contains a moving subject (S35). In this step, the screen change determination unit 11e compares the screens before and after taking a still image to determine whether there is a moving part. If the result of this determination is that a moving subject is not included, normal live view display is performed as in steps S1 and S15 (S45).

  On the other hand, if the result of determination in step S35 is that a moving subject is included in the still image, then a moving subject portion is extracted from the still image as a partial image (S37). Here, the partial image extraction unit 11d compares a still image before and after shooting and extracts an image of a moving portion as a partial image.

  When the partial image is extracted in step S37, next, the relationship information between the partial image, the moving image, and the partial image is recorded (S39). Here, the image data of the partial image extracted in step S37 is stored in the image storage unit 24. In addition, related information such as the timing of still image shooting and the position of the partial image on the moving image screen at the time of still image shooting is stored in the image storage unit 24 in association with the partial image.

  Once the relationship information is recorded in step S39, a process of superimposing the extracted partial image on the corresponding position in the live view is performed (S41). Here, the display control unit 11a superimposes the partial image extracted in step S37 on the corresponding position in the live view image. Once this superposition processing is performed, a live view with partial images is then displayed (S43). Here, the display driver unit 18 displays the live view with the partial image that has been subjected to the superimposition process in step S41.

  When a live view with a partial image is displayed in step S43, or when a normal live view is displayed in step S45, the process returns to the original flow.

  Next, the motion picture reproduction operation will be described using the flowchart shown in FIG. When the flow of the video playback mode is entered, it is first determined whether or not a video playback instruction has been issued (S51). When the camera enters the playback mode by operating the playback button, thumbnails of still images and moving images are displayed. In this step, it is determined whether any of the moving image thumbnails has been selected by operating the cross button, the OK button, the touch panel, or the like. If there is no video playback instruction, it waits for a video playback instruction. Note that, when a still image thumbnail is selected, normal still image reproduction is performed, but a description thereof is omitted in this embodiment.

  If the result of determination in step S51 is that a movie playback instruction has been made, next, the partial image corresponding to the playback movie and its related information are read (S53). In step S30, the partial image and the related information are stored in the image storage unit 24. In step S53, the partial image and the related information corresponding to the reproduced image are read from the image storage unit 24.

  Subsequently, moving image reproduction is performed (S55). Here, the image data of the moving image selected in step S51 is read from the image storage unit 24 by the moving image recording / reproducing unit 22, and after the image is expanded by the moving image compression / decompression unit 20, the moving image is displayed on the display unit 19 by the display driver unit 18. Display playback. In the moving image reproduction, the image data of the moving image is sequentially read and reproduced and displayed until it is determined in step S57 described later that a moving image reproduction stop operation has been performed.

  Once the moving image has been reproduced, it is next determined whether or not there is a corresponding new partial image (S57). A new partial image appears as time elapses from the start of moving image reproduction. In the example shown in FIG. 5A, new partial images appear at times t12, t13,..., T17, and the timing at which these partial images appear is related information read in step S53. Determine based on.

  If the result of determination in step S57 is that there is a new partial image, next, the partial image is superposed on the corresponding position of the moving image (S59). Here, the display control unit 11a performs a superimposing process on the partial image read from the image storage unit 24 at the corresponding position of the moving image based on the relationship information.

  Once the superimposition process is performed in step S59, a moving image with a partial image is reproduced (S61). Here, the display driver unit 18 displays the moving image with the partial image generated in step S59 on the display unit 19.

  If the result of determination in step S57 is that there is no new partial image, it is next determined whether or not the partial image is already being displayed (S63). If a moving image with a partial image is reproduced in step S61 and this partial image has not disappeared, the determination here is Yes.

  If the partial image is not being displayed as a result of the determination in step S63, then a normal moving image is reproduced (S65). Here, the normal reproduction is performed on the moving image selected in step S51 without the partial image being superimposed and displayed.

  If the partial image is being displayed as a result of the determination in step S63, then the previous screen is compared with the current screen (S71 in FIG. 12). The screen change determination unit 11e compares the screen currently displayed in the moving image with the previous screen. This comparison is for determining a screen change performed in the following two steps.

  Subsequently, it is determined whether or not the screen has changed significantly (S73). Here, the screen change determination unit 11e determines based on the comparison result in step S71. The screen changes greatly when the moving image screen moves to such an extent that the partial image is not located within the screen, as in the case of moving image shooting. As a result of this determination, if the screen is determined to be large, the process proceeds to step S65, where normal moving image playback is performed, and as in the case of moving image shooting (see FIG. 4B), partial images are not superimposed and displayed. .

  If the result of determination in step S73 is that the screen has not changed significantly, it is next determined whether or not the screen has changed small (S75). Here, the screen change determination unit 11e determines based on the comparison result in step S71. The change in the screen to be small means that the screen has moved as in the case of moving image shooting, but the partial image is located within the moving image screen.

  If the result of determination in step S75 is that the screen has changed slightly, the partial image is then displayed at a corresponding position in accordance with the change in the screen (S77). Here, as in moving image shooting (see FIG. 4C), the position of the partial image is moved in accordance with the movement of the screen, and the relative positional relationship between the position of the partial image and the moving image screen is maintained. Display.

  If the partial image is displayed in step S77, or if the result of determination in step S75 is that the screen has not changed, then the accuracy of the partial image is lowered according to the elapsed time (S79). As in the case of live view display at the time of shooting (see FIGS. 3B to 3F), since the partial image is displayed in a fade-out manner, the display luminance is reduced with time.

  If the accuracy of the partial image is lowered in step S79, or if a moving image with a partial image is reproduced in step 61, or if normal moving image reproduction is performed in step S65, it is next determined whether or not a moving image reproduction stop operation has been performed. (S67 in FIG. 11). Here, it is determined whether or not an operation member for ending moving image reproduction in the operation unit 13 is operated.

  If the result of determination in step S67 is that there has been no video playback stop operation, processing returns to step S55 and video playback continues. On the other hand, if the result of determination in step S67 is that a video playback stop operation has been performed, it is determined whether or not a power off operation has been performed (S69). Here, the determination is made based on whether one power button in the operation unit 13 is operated. If the result of this determination is that a power-off operation has not been performed, processing returns to step S53 and the above-described operation is executed.

  As described above, in one embodiment or a modification of the present invention, the display control unit 11a performs a partial process from a captured still image when still image shooting is performed during moving image shooting (S9 → Yes). The partial image extracted by the image extracting unit 11d is displayed superimposed on the position of the live view image where the portion extracted when the still image was captured for a predetermined period after the still image was captured. (S11). For this reason, a still image can be expressed in a format that can be combined with a moving image, and a still image taken during the moving image can be used more effectively. Further, since the moving image live view is displayed at the position when the still image partial image is taken, the still image rec view can be confirmed without interrupting the moving image monitor.

  Further, in one embodiment or modification of the present invention, during playback and display, during playback of a moving image read from the image storage unit 24, a still image is captured (S57 → Yes), and the movie is being captured. A partial image, which is a partial image of a still image that was taken in, is displayed on the display unit 19 so as to be superimposed on the position of the moving picture screen where the partial image was present when the still image was taken. (S59, S61). For this reason, a moving image reproduction and a still image reproduction can be combined and displayed without being separated.

  In one embodiment of the present invention, a partial image is extracted from a still image at the time of shooting a moving image, and in step S30, a series of positions / timing at which the partial image is superimposed and displayed on the moving image, brightness to be reduced, and the like. Is stored in the image storage unit 24. Thus, by recording a series of information used at the time of reproduction, the processing load at the time of reproduction is reduced. However, since the burden on the camera at the time of shooting becomes heavy, it is of course possible to omit the series of information recording in this step S30 and to process based on the image data of the moving image at the time of reproduction. Further, the luminance is faded out when displaying the partial image. However, as the display change, the color image may be gradually changed to a monochrome image, or the contrast may be gradually reduced.

  In addition, since the control processing in the embodiment of the present invention is performed by the control unit 11 reading out and executing the operation control program stored in the program data storage unit 12, the control program relating to such software processing is performed. Is also the present invention. Furthermore, in the present embodiment, each control process has been described as a software process. However, the present invention is not limited to this, and may be a combination of a software process and a hardware process, or a process only with hardware.

  In the embodiment of the present invention, an example in which the present invention is applied to a camera has been described. However, the present invention can also be applied to a display device that stores image data of moving images and still images in an image storage unit. In this case, as the display device, a computer, a television, or the like that stores moving image and still image data in a recording medium may be employed.

  In the embodiment of the present invention, the digital camera is used as the photographing device. However, the camera may be a digital single lens reflex camera or a compact digital camera, such as a video camera or a movie camera. It may be a video camera, or it may be a camera built into a mobile phone, personal digital assistant (PDA), game device, etc.

  The present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, you may delete some components of all the components shown by embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

  DESCRIPTION OF SYMBOLS 11 ... Control part, 11a ... Display control part, 11b ... Moving image control part, 11c ... Still image control part, 11d ... Partial image extraction part, 11e ... Screen change judgment part, DESCRIPTION OF SYMBOLS 12 ... Program / data memory | storage part, 13 ... Operation part, 15 ... Imaging part, 16 ... SDRAM, 17 ... Image processing part, 18 ... Display driver part, 19 ... Display unit, 19a ... moving image display window, 19b ... still image thumbnail, 19c ... cursor, 19d ... moving image thumbnail, 19e ... still image thumbnail, 19f ... cursor, 19g ... Time axis, 19h: still image shooting timing, 20: moving image compression / expansion unit, 21 ... still image compression / expansion unit, 22 ... moving image recording / reproducing unit, 23 ... still image recording / reproducing unit Part, 24... Image storage part, 25. Bus

Claims (8)

A still image control unit for controlling still image shooting;
A video control unit for controlling video shooting;
A display control unit that displays a live view image for subject confirmation during the video shooting,
A partial image extraction unit that extracts a specific part of a captured still image as a partial image;
With
The display control unit specifies the partial image extracted by the partial image extraction unit from the captured still image at the time when the still image is captured when still image shooting is performed during moving image shooting. A camera characterized by being superimposed and displayed at a position of the live view image where the portion existed for a predetermined period after taking a still image.   2. The camera according to claim 1, wherein the partial image extraction unit extracts, as the specific portion, a portion that is recognized to have a predetermined or more movement in the screen during the still image shooting. A screen change determination unit that determines that the screen has changed more than a predetermined amount,
The camera according to claim 1, wherein the display control unit stops displaying the partial image after it is determined that the change has occurred.   The said display control part records the positional information which shows the image information which shows the said partial image, and the position overlapped on the screen of a corresponding moving image as information of the said partial image. Camera. An image storage unit capable of storing images shot as still images during movie shooting;
A display unit capable of reproducing and displaying the still and moving images;
During playback of the moving image read out from the image storage unit, the still image is captured as a partial image that is a part of the still image captured during the shooting of the moving image at the timing when the still image is captured. A control unit that superimposes on the position of the moving image screen where the partial image was present and displays it on the display unit,
A display device comprising: Upper Symbol control section, the display device according to claim 5, wherein the displaying by superimposing the partial image in a predetermined time, the moving image. Upper Symbol control section is a period to be displayed by superimposing the partial image display device according to claim 6, characterized in that the slow reproduction the video. Read images taken as still images while shooting a movie,
During playback of the read video, the partial image, which is a part of the still image shot during the video shooting, is captured at the timing when the still image is shot. Perform processing to superimpose on the position of the video screen where the partial image existed,
Displaying the image on which the above superimposition processing is performed on the display unit;
A display method characterized by that.