JP5404023B2 - Video / still image playback device, control method thereof, program, and storage medium - Google Patents

Description

  The present invention relates to a moving image / still image reproduction apparatus that reproduces and displays an image captured by a camera capable of simultaneously capturing a moving image and a still image, a control method thereof, a program, and a storage medium.

  As the mainstream shifts from cameras using silver halide films to digital cameras, and the capacity of storage media increases and image processing capabilities improve, digital cameras will not only provide still images but also movies with sufficient image quality. It is now possible to shoot time. In addition, as video cameras become more digital and higher in image quality, not only movies but also still images can be taken.

  In the digital camera, as a technique for simultaneous recording of moving images and still images, first, the shooting mode selection switch (switch) of the digital camera is set to the moving image shooting mode. Then, the external display device displays the current image in real time.

  In this state, when a recording key is pressed, recording of a moving image is started. To end movie recording, press the record key again. If the release key is pressed during movie recording, a still image is shot while movie shooting continues.

  When displaying data shot in this way, the most common is to use different dedicated software, such as playing a movie with software for displaying movies and displaying a still image with software for displaying still images. It is what is displayed.

  On the other hand, a display technique as disclosed in Patent Document 1 has been proposed. In the present display technique, an image imitating a photo album is displayed on the display control means in order to improve both the operability and the enjoyment of browsing photos and videos.

  As shown in FIG. 20, a 3D object 201 imitating an album having a book shape is used as a texture to paste the album on a display device in a pseudo manner. In a 3D object in a form in which a predetermined page is opened, each page is divided into first areas 202A /, 202c and second areas 202b, 202d, and still images 203A /, 203c and 203b, 203d are divided into the respective areas. Place. The moving images 204A /, 204c and 204b, 204d are linked and pasted to the first and second areas corresponding to the arranged still images.

  By doing this, it is possible to create an electronic album by pasting a favorite photo (still image) to an image like a real photo album. When a predetermined position of the 3D object 201 is clicked, a page can be turned, and another photograph can be pasted on the turned page.

  In addition, related photos can be linked to the photos pasted on each page, and when the photos are clicked, the linked videos are played.

  When a moving image is played back, it is played back in each of the first regions 202a and 202c and the second regions 202b and 202d, and still images and moving images are mixed in the album in which the photos are displayed. Is displayed. When displaying a moving image, it may be displayed in full screen in some cases.

  In this way, a moving image and a still image can be reproduced and displayed at the same time with one software, so that an impressive presentation can be performed for a viewer.

  Further, the recording / playback apparatus disclosed in Patent Document 2 makes it easy to understand the correspondence between a captured moving image and a still image, thereby facilitating data management.

  Specifically, link information is added to each of the captured moving image and still image, and the still image is displayed in association with the moving image.

  As shown in FIG. 21, the time “0” of the link L0 is set as the link information for starting shooting for the moving image M1. Next, “t1” of link L1 is set as link information for the photographed still image S1.

  The link information for the next moving image M2 is “t1 + t2” by adding the recording time t2 of the moving image M2 to the link information “t1” of the still image S1. Next, the link information of the still image S2 is “t1 + t2”, and the link information of the third moving image M3 is also “t1 + t2”.

  In this way, by setting link information for each data of the moving image M and the still image S, when the count value of the playback position counter that counts in time matches the link position during playback of the moving image, playback is performed. When the target is only a moving image, M1, M2, M3... Are continuously displayed.

  If only still images are to be displayed, M1, S1, M2, S2, M3... Are displayed. The display time of the still image S can be set in advance.

  When a moving image and a still image are displayed, when switching from the moving image M1 to the moving image M2, the still image S1 is continuously displayed for a desired time in another window or until the next still image S2 is displayed. It is also possible to display a high-resolution still image with a screen size larger than the screen size of the moving image.

In this way, since a moving image and a still image can be linked and displayed, the moving image and the still image can be enjoyed simultaneously.
JP 2005-072964 A JP 2000-293446 A

  As described above, the pseudo-electronic photo album can be displayed with a high level of entertainment because it can display a moving image, which is not possible with a real album.

  However, since the still image and the moving image have no relationship, it is possible to link the still image and the moving image shot in completely different situations. Then, when a moving image is played by clicking on the still image, a moving image different from the image of the still image may be displayed, and the relationship between the still image and the moving image becomes difficult to understand.

  In addition, by adding link information to an image after shooting, the video and still images are related to each other, and in the method of determining the display image from the link information during playback, a still image suddenly appears during video playback. That's why it's hard to tell when a still image was shot in a video.

  Also, when viewing a still image and a moving image at the same time, it is difficult to grasp the outline of the still image because the still image cannot be viewed unless the moving image is reproduced.

An object of the present invention is to provide a moving image / still image playback device , a control method thereof, a program, and a storage medium that can clarify the shooting situation when playing back a moving image shot by a camera capable of simultaneously recording moving images / still images. It is to provide.

In order to achieve the above object, the moving image / still image reproducing device according to claim 1 reproduces and displays an image shot by a camera capable of shooting a still image during moving image shooting processing. The moving image reproduction control means for controlling to reproduce and display the moving image on the display unit, and displaying on the display unit a timeline indicating a length of time within a predetermined range of the moving image. A thumbnail image of a still image taken during processing is displayed so that it can be identified at which timing on the timeline, and a plurality of the thumbnail images are displayed in a superimposed manner, and the reproduction of the moving image is progressed. In response, the thumbnail image of the still image captured at a position before the playback position of the moving image out of the plurality of the thumbnail images displayed in an overlapping manner, after the playback position of the moving image, Characterized by having a display control means towards the captured still image thumbnail image at a position closest to the raw position is controlled so as to update the display so that the above.

According to the present onset Akira, when you play a video shot by a camera that can simultaneously record video and still images, it is possible to clarify the shooting conditions.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a block diagram showing an internal configuration of a camera as a moving image / still image reproducing apparatus according to an embodiment of the present invention. The moving image / still image reproducing apparatus of the present invention reproduces and displays an image captured by a camera capable of capturing a still image during the moving image capturing process.

  In the camera (single-lens reflex camera) 100, a CPU (control unit) 1 controls the entire operation. The imaging unit 2 captures (captures) an image of the subject. The A / D converter 3 converts the electric signal output by photoelectrically converting the light received by the image sensor 2 into a digital signal.

  The semiconductor memory 4 is removable memory means for storing image data photographed by the image sensor 2. The built-in memory 5 is a non-removable memory that stores data relating to the operation of the camera 100.

  The image collation unit 6 collates images. A display device (display unit) 7 displays information. The battery 8 is a power source for the camera 100.

  2 is a side view showing the internal state of the camera of FIG. 1 during subject observation, and FIG. 3 is a side view showing the internal state of the camera of FIG. 1 during photographing.

  First, the operation of the camera 100 will be described with reference to these drawings.

  In FIG. 2, a main mirror 10 is arranged between the image pickup device 2 and the photographing lens 9 so that light rays from the subject coming from the photographing lens 9 are reflected upward by the main mirror 10 and guided to the viewfinder. It has become.

  Since the main mirror 10 is composed of a half mirror, a part of the light beam from the subject passes through the main mirror 10 and reaches the sub mirror 11. Since the sub mirror 11 is a total reflection mirror, the sub mirror 11 totally reflects light rays downward.

  A focus detection device 12 for detecting the focus state of the photographing lens 9 is disposed at the tip of the light beam, and information for adjusting the focus of the photographing lens 9 is calculated.

  Next, when shooting is performed by pressing the release key, as shown in FIG. 3, the main mirror 10 is flipped upward together with the sub mirror 11 to close the optical path to the viewfinder. Then open the shutter. As a result, the light beam from the photographic lens 9 is guided to the image pickup device 2 for photographing.

  When the exposure is completed, the shutter is closed and the main mirror 10 and the sub mirror 11 are lowered to return to the state shown in FIG. When shooting only ordinary still images, shooting is performed according to such a procedure.

  FIG. 4 is a diagram illustrating a schematic configuration of the imaging unit of the imaging device in FIG. 1.

  In the imaging device 2, as shown in FIG. 4, the imaging unit that captures a subject image is divided into small light receiving units called pixels. Each pixel includes an RGB color filter.

  In FIG. 4, the pixel 2mnr is R (red), the pixel 2mng, the pixel 2mng2 is a G (green) pixel, and the pixel 2mnb is a B (blue) pixel. These four pixels are regularly arranged as a set. Yes.

  Such an arrangement is called a Bayer array, and is an array often used for an image sensor using three color filters of RGB. In such a pixel arrangement, green pixels have twice as many pixels as blue and red.

  Basically, if the same number of the three colors is used, a color image can be created, but the image quality can be improved by increasing the number of green pixels having relatively high visibility.

  When a light ray is received by the image pickup unit 2 of the image pickup element 2 divided in this way, charges corresponding to the light amount of the light ray received for each pixel are discharged. When the information on the charge amount is transferred to the A / D converter 3, the A / D converter 3 converts it into digital information and digitizes it. By collecting all the numerical information of each pixel, one image data is obtained.

  FIG. 5 is a rear view of the camera of FIG.

  Next, a case where a moving image is shot using the camera 100 will be described.

  First, the shooting mode switch 13 of the camera 100 is switched to the moving image shooting mode. Then, as in still image shooting, the main mirror 10 and the sub mirror 11 are flipped upward and the shutter is opened.

  While maintaining this state, images are captured from the image sensor 2 at a constant period and are sequentially displayed on the display device 7. As a result, a real-time moving image is displayed on the display device 7, and a moving image is ready for capturing.

  At this time, since the sub mirror 11 is in the state of being flipped up, the focus cannot be detected by the focus detection device 12. Therefore, in the moving image shooting mode, focus detection by the focus detection device 12 is not performed, and a method of adjusting (detecting) the focus from the image captured by the image sensor 2 is employed.

  As a method of performing focus adjustment from an image captured by the image sensor 2, there is usually a method called a contrast detection method. In the contrast detection method, a part of or all of the image obtained from the image sensor 2 is used to investigate the contrast of the image in the evaluation area and determine the focus position.

  Since the focused image contains a lot of high frequency components, the contrast of the image increases. When images are taken in while shifting the focal position of the photographing lens 9 little by little and the contrast of each image is examined, a curve as shown in FIG. 6 is usually taken.

  In FIG. 6, the point F at which the contrast reaches a peak is in focus. When the current lens extension amount is point A, when the lens extension amount is moved to the plus side, the contrast increases monotonously and reaches the peak F point.

  However, since the contrast peak value is not known, it is possible to determine the contrast peak only after confirming that the contrast starts to decrease once passing through the peak position.

  Therefore, it is necessary to perform an operation of going back past the contrast peak. In addition, if the image is not captured by changing the lens extension amount, it is not possible to know whether the lens moves toward the F point when it is extended from the current position. Cannot be judged. Therefore, the lens may be driven in the direction opposite to the F point.

  For this reason, compared with the phase difference detection method performed in the focus detection device 12, the contrast detection method takes much time for focus detection. However, in the case of shooting a moving image, since the image is continuously taken in a short cycle and once focused, it is possible to determine the moving direction of the focus by predicting the movement of the subject. Must not.

  The moving image shooting is started by pressing the recording key 16 from the shooting preparation state. When the recording key 16 is pressed again during moving image shooting, the moving image shooting is stopped.

  In this way, still images and moving images can be taken. In order to shoot a still image during movie shooting, the release key is usually pressed in the same way as when shooting a still image.

  There are various methods for shooting a still image during moving image shooting. As a method for shooting without interrupting moving image shooting, for example, there is a method of extracting one frame of a moving image as a still image.

  A moving image is expressed by sequentially displaying still images taken at a speed of 30 frames or 60 frames per second.

  Therefore, as shown in FIG. 7, the next moving image frame closest to the time when the release key is pressed is taken out as a still image. The moving image is shot at (n-3), (n-2), (n-1) at a predetermined frame rate.

  If the release key for still image shooting is pressed while the images (n-1) and (n) are being shot, the (n) th image is shot as a still image. At that time, since moving images must be captured and processed at high speed, the resolution is usually lower than that of still images, and the image quality is not sufficient for still images. Shoots with the image quality specified in.

  If the processing capability of the CPU 1 is sufficiently high, there is no particular problem, but if the still image has a high image quality, the amount of data increases, so it is expected that processing will take a considerable amount of time. If the processing takes longer than the frame rate for moving image shooting and the next (n + 1) moving image cannot be captured, a CPU for still image processing is provided separately from the CPU 1 for processing moving images. Send data to that side for processing.

  At this time, there is no (n) image in the moving image. If a moving image is reproduced as it is, the motion will become unnatural because one frame is dropped. Further, if the still image of (n) is used as it is as the (n) image of a moving image, a high-quality image suddenly appears during moving image reproduction, resulting in an unnatural moving image.

  Therefore, the image (n) obtained by shooting the still image after moving image shooting is changed to an image quality (n ′) equivalent to the image quality of moving image shooting separately from the still image and inserted at a predetermined position. As a result, the image can be reproduced without any sense of incongruity and without interruption of the moving image. This operation may be performed in the camera 100 or may be processed by putting dedicated software in a personal computer.

  FIG. 8 is a diagram illustrating a relationship between a chapter inserted in a moving image and a still image in the camera of FIG.

  Next, marking when a still image is shot during moving image shooting will be described. When the moving image shooting is started, the name “mov001” is assigned to the file for storing the moving image. This name is a unique name so that it does not suffer from others by checking whether there is no same in the semiconductor memory 4 to be stored, and if there is the same, it is set to “mov002”. And

  A marking called “chapter” can be applied to a moving image. The chapter is a break at the time of moving image reproduction. By selecting a chapter, the reproduction start location can be jumped to the location where the chapter is inserted.

  The chapters can be hit manually during video recording at a certain time interval, hitting when a scene change is detected, or manually by the photographer operating the keys as needed. If it becomes, it is also possible to erase.

  In the camera 100 capable of simultaneously recording a moving image and a still image according to the present embodiment, when a still image is shot during moving image shooting, a chapter is added at that time using still image shooting as a trigger. This chapter has information such as the time from the start of the moving image, the number of frames, the current time, etc. that can specify the timing of still image shooting, and the name is named “s001”.

  The photographed still image is saved with the file name “s001mov001” because the file name of the moving image is “mov001”. Next, when a still image is taken, the chapter name is given as “s002” and the file name of the still image as “s002mov001”. it can.

  In addition, by naming in this way, it is easy to find out from the file name which chapter of which moving image corresponds to which chapter.

  FIG. 8A shows this in an easily understandable manner. Other than that, the file name is the same as when shooting other still images, and the name using the continuation number is used so that the movie file and the chapter name linked to the internal information of the file are given. Good.

  Here, there are two methods for how to strike chapters when still images are continuously shot. As a first method, a chapter corresponding to each still image is shot even during continuous shooting.

  In this case, the file name of the moving image is “mov001”, and the chapter names at the time of continuous shooting are “s001_1”, “s001_2”, “s001_3”,. The file names of the still images are “s001_1mov001”, “s001_2mov001”, “s001_3mov001”,.

  In this way, it is easy to see whether a still image taken just by looking at a chapter is taken as a single shot or as a single continuous shot. This is shown in FIG. 8B.

  As the second method, only the first chapter of continuous shooting is hit, and the other chapters are not hit.

  In this case, for the file name “mov001” of the moving image, the chapter name may be “s001” as in the case of single shooting, or “s001c” in order to distinguish it from single shooting. The file name of the still image is given in the form of “s001_1” or “s001c_1”. This is illustrated in FIG. 8C.

  Unlike the first one, there is only one chapter for a plurality of still images. Therefore, in the first method, chapters are hit as many as the number of continuous shots, so a large number of chapters are hit, and it takes time and effort to move chapters, but in the second method, That doesn't happen.

  As described above, the CPU 1 controls to record the marking indicating that the still image is captured in the moving image file in which the still image is captured during the moving image capturing process. Then, control is performed to record the still image with a file name including the name of the marking and the name of the moving image file.

  A method for displaying the moving images and still images shot in this way will be described.

(First embodiment)
The first embodiment is realized by processing in which the CPU 1 develops and executes a program recorded in the built-in memory 5 on a work memory (not shown). If the CPU 1 determines whether or not various operations described below have been performed, and determines that the operation has been accepted, processing (reproduction control and display control) for executing various operations described below according to the operation is performed.

  First, when the reproduction key 14 provided in the camera 100 is pressed, the photographed image is displayed on the display device 7 as shown in FIG. At this time, when the still image is displayed, only the photographed image is displayed. However, in the case of the moving image, the first frame is displayed as shown in FIG. An icon (moving image mark 71) indicating that the display image is a moving image is displayed.

  Thereby, the observer of an image can distinguish whether a display image is a moving image or a still image. In the case of a moving image, the first frame is displayed and playback is stopped. Here, the recording key 16 is also used as a key for starting reproduction.

  When the recording key 16 is pressed in the moving image display state, the reproduction of the moving image is started. Normally, only the moving image is played back, but when the DISP key 15 is pressed during playback, a timeline information window 72 is displayed in which a timeline 721 indicating the progress of the moving image as shown in FIG. 10 is displayed. .

  In the timeline information window 72, a playback position index 722 indicating the progress of the moving image and thumbnail images 723a to 723e of still images taken during moving image shooting are displayed. Under the playback position index 722, the current playback time is displayed. Further, the shooting time may be displayed as shown in FIG.

  For the still image to be displayed, the file name of the still image associated with the movie file name and the chapter name is searched, and if there is a related one, a leader line is provided from the chapter displayed on the timeline 721 and related. It is displayed so that sex can be understood.

  As shown in FIG. 10, when the number of thumbnails to be displayed is large and the images are overlapped, the thumbnails that have been taken first are displayed on the top.

  The reproduction position index 722 advances during the reproduction of the moving image, and as shown in FIG. 11, the next still image is displayed on the upper side after the position where the still image is taken. As a result, even if the number of still images is large, it can be displayed efficiently. In order to realize this, the CPU 1 determines whether or not the current playback position of the moving image exceeds the position where the still image is obtained during moving image playback. When it is determined that the current playback position exceeds the position where the still image is obtained (the above-mentioned chapter position), the overlapping order on the display of the still image obtained at the position determined to have exceeded is the lowest. Update the display to be Alternatively, the overlapping order on the display of the still images obtained at the position determined to be exceeded is obtained at the position closest to the current playback position among the still images obtained at positions where the current playback position does not exceed. The display is updated so that it is below the displayed still image.

  Further, the cursor is moved to a still image by operating the up / down / left / right directions of the cross keys 17U, 17D, 17L, and 17R, and the selected key 18 is pressed once as shown in the thumbnail image 723c of FIG. . Then, the moving image is played back from the time when the selected still image was taken.

  When the enter key 18 is pressed twice in succession, the reproduction of the moving image is paused and the selected still image is enlarged and displayed on the full screen. When the enter key 18 is pressed twice again in this state, the screen returns to the movie playback screen and playback of the movie starts again from the paused position.

(Second Embodiment)
The second embodiment is realized by processing in which the CPU 1 develops and executes a program recorded in the built-in memory 5 in a work memory (not shown). If the CPU 1 determines whether or not various operations described below have been performed, and determines that the operation has been accepted, processing (reproduction control and display control) for executing various operations described below according to the operation is performed.

  FIG. 13 shows a display example of the second embodiment. Components having the same symbols as those in the first embodiment perform the same functions.

  When a large number of still images are shot during moving image shooting, it becomes very difficult to view all the still images displayed side by side on the timeline 721.

  In such a case, one method is to divide and display the timeline display. As a division method, there are a method of equally dividing the shooting time of a moving image, a method of determining the number of divisions based on the number of still images taken and the number that can be displayed on one screen.

  FIG. 13 shows the display of FIG. 10 with a total movie shooting time of 00:12:34 divided into two and displayed from 00:00:00 to 00:06:17. At the time of display, a page feed mark 724f is displayed so that it can be recognized that there is a next page that is divided.

  By operating the up / down / left / right directions of the cross keys 17U, 17D, 17L, and 17R, when the page feed mark 724f is selected and the enter key 18 is pressed, as shown in FIG. 14, 00:06 on the divided second page. : 17 to 00:12:34 are displayed.

  In FIG. 14, a page return mark 724b indicating that there is a previous page is displayed. When the page return mark 724b is selected in the same manner and the enter key 18 is pressed, it is possible to return to the previous page.

  Three or more divisions are performed, and when there are before and after the displayed timeline 721, the page advance mark 724f and the page return mark 724b are displayed at the same time.

  When the enlargement key 19 is pressed in the divided display state of the timeline 721, the number of divisions can be increased and displayed more finely, and when the reduction key 20 is pressed, the number of divisions can be reduced and displayed more coarsely. In addition, when the shooting time of a moving image is long and the display is crowded and difficult to see when trying to fit on the screen, it is also easy to see if the display is divided in the same manner.

  Next, as another method, there is a method of partially expanding the timeline 721, which is shown in FIG.

  As shown in FIG. 15, the time line 721 of a predetermined part is displayed in an enlarged state, and the parts other than the enlarged part are displayed in a compressed state. When there is a reduced display before and after the enlarged display portion, enlarged display movement marks 725b and 725f are displayed. About the part to expand, it sets so that it may expand, for example for 5 minutes.

  Similar to the above-described page return mark 724b and page feed mark 724f, operating the cross keys 17U, 17D, 17L, and 17R to select the enlarged display movement marks 725b and 725f and pressing the enter key 18 changes the enlargement location. be able to.

  When the enlargement key 19 is pressed, the enlargement display time can be shortened from the current 5 minutes to 3 minutes or 1 minute to see details, and when the reduction key 20 is pressed, the enlargement display time is 10 minutes, 15 You will be able to get an overall grasp in minutes.

(Third embodiment)
The third embodiment is realized by a process in which the CPU 1 develops and executes a program recorded in the built-in memory 5 in a work memory (not shown). If the CPU 1 determines whether or not various operations described below have been performed, and determines that the operation has been accepted, processing (reproduction control and display control) for executing various operations described below according to the operation is performed.

  FIGS. 16 and 17 show display examples of the third embodiment. Components having the same symbols as those in the first embodiment perform the same functions.

  The method for assigning file names when still images are shot continuously during movie shooting has been described in the first embodiment. A lot of still images are taken with continuous shooting, but when all of them are displayed, it becomes very difficult to see.

  To avoid this, when there are a plurality of images taken in the continuous shooting mode, the first still image is displayed in association with the chapter as a representative. At this time, since it is not known whether it was taken in single shooting or continuously shot, the continuous shooting mark indicating that there is a continuous shot still image as shown in the thumbnail image 723f of FIG. It is displayed so that there are multiple still images at a glance.

  For easier understanding, there is also a method of displaying a number indicating the number of continuous shots as shown in the thumbnail image 723f of FIG. As a result, it is possible to recognize how many still images are continuously shot, so that it is easier to recognize the shooting situation.

  If there is a continuous shot still image, when the thumbnail image 723f is selected, the thumbnail images are displayed so as to be switched in the order of continuous shooting at a constant time interval. When the enter key 18 is pressed twice in succession, the still image is displayed on the entire screen. The images are displayed in an enlarged size, and the continuously shot still images are switched at regular intervals.

  The still image is repeatedly displayed until the enter key 18 is pressed twice again. In order to pause the switching of continuously shot still images, the enter key 18 may be pressed once. When the enter key 18 is pressed once, the still image displayed at that time is kept displayed.

  If the enter key 18 is pressed once during the stop, the still image is repeatedly displayed again. If the enter key 18 is pressed twice in succession, the display returns to the moving image display mode. Further, when the continuously shot still images are displayed all over, the reproduction of the still images may be terminated and switched to the moving image display.

  In some cases, it may be desired to check how the still images taken continuously are displayed on the timeline 721. Therefore, as shown in FIG. 18, it can be said that the continuous shooting portion is enlarged and displayed. When the continuous shooting portion is approached during moving image reproduction, a timeline 721 in which only the continuous shooting portion is taken out is displayed, and all still images on which only the first image is displayed are expanded and displayed.

  When chapters corresponding to all still images are hit during continuous shooting (FIG. 8B), the images are as shown in FIG. 18, and still images are displayed in association with the corresponding chapters.

  In the case where the chapter is set only for the first continuous shot, as shown in FIG. 19, the approximate position taken from the continuous shooting speed is displayed. At this time, in order to show that the information is not accurate, as shown in FIG. 19, the leader line is made a broken line, and the display state of the frame in which the thumbnail is displayed is changed so that it can be distinguished.

  In this case, since it cannot be used to specify the playback position of the moving image, the moving image playback position cannot be jumped twice by selecting an image with the cross key 17 and pressing the enter key 18 once. Nothing can be accepted other than pressing (enlarged display of selected still image).

  When the reproduction of the moving image passes through the continuously shot portion, the original display state as shown in FIG. 16 or FIG. 17 is restored.

  In addition, when it is difficult to display the images on the screen side by side due to the number of continuous shots, still images that can be displayed are displayed side by side. Similar to the above-described divided display, a page return mark 724b and a page advance mark 724f are displayed, and the display can be sent by selecting with the left and right keys of the cross key 17 and pressing the enter key 18. Yes.

  In the present invention, the CPU 1 as the moving image reproduction control means controls to reproduce the moving image and display it on the display unit.

  Moreover, CPU1 as a display control means displays the timeline which shows the length of the time of the predetermined range among moving images on a display part. Then, the CPU 1 controls to display the thumbnail image of the still image shot during the moving image shooting process so that it can be identified at which position on the timeline it was shot.

  Further, the CPU 1 as the recording control means records a marking indicating that the still image has been captured in the moving image file in which the still image is captured during the moving image capturing process, and the name of the marking and the moving image file. Control is performed to record the still image with a file name including the name.

  Further, the CPU 1 serving as a display control unit controls to display the timeline divided into specific ranges when there are a predetermined number or more of still images shot during the moving image shooting process.

  Further, when the CPU 1 captures a still image during moving image shooting, the CPU 1 inserts a marking indicating that the still image has been captured in the moving image. In addition, the marking includes information indicating the marking order and the marking position in the corresponding moving image file.

  Further, the CPU 1 enlarges and displays a predetermined portion of the timeline 721 on the display device 7 when there are more than a predetermined number of still images taken during moving image shooting.

  In addition, when a plurality of still images are captured in the continuous shooting mode, the CPU 1 causes the display device 7 to display any one of the captured still images as a thumbnail image 723, and is a continuous shooting image. Display that can be identified.

  In addition, when a plurality of still images are shot in the continuous shooting mode, the CPU 1 causes the display device 7 to display any one of the still images shot in the continuous shooting mode as a thumbnail image 723 and the number of continuous shots. Display that can be identified.

  In addition, when a plurality of still images are shot in the continuous shooting mode, the CPU 1 causes the display device 7 to enlarge and display the timeline 721 corresponding to the continuous shooting time when it comes close to the timing of continuous shooting during playback of the moving image. Then, the thumbnail image 723 of the still image taken continuously is displayed in an expanded manner.

  In the embodiment of the present invention, shooting of moving images and still images has been described by taking a single lens reflex camera as an example. However, if similar shooting can be performed, a video camera or a compact digital camera is used. May be.

  In addition, as a device for displaying moving images and still images, the display and operation method has been described by taking a photographed single-lens reflex camera as an example. It may be a display connected to a computer. Further, it may be a television monitor to which an editing device is connected.

  Note that the processing of the above-described embodiment may provide a system or apparatus with a storage medium that records a program code of software that embodies each function. The functions of the above-described embodiments can be realized by the computer (or CPU or MPU) of the system or apparatus reading out and executing the program code stored in the storage medium. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention. As a storage medium for supplying such a program code, for example, a floppy (registered trademark) disk, a hard disk, an optical disk, a magneto-optical disk, or the like can be used. Alternatively, a CD-ROM, CD-R, magnetic tape, nonvolatile memory card, ROM, or the like can be used.

  The functions of the above-described embodiments are not only realized by executing the program code read by the computer. Including the case where the OS (operating system) running on the computer performs part or all of the actual processing based on the instruction of the program code, and the functions of the above-described embodiments are realized by the processing. It is.

  Further, the program code read from the storage medium may be written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. After that, the CPU of the function expansion board or function expansion unit performs part or all of the actual processing based on the instruction of the program code, and the functions of the above-described embodiments are realized by the processing. Is also included.

It is a block diagram which shows the internal structure of the camera as a moving image / still image reproducing | regenerating apparatus which concerns on embodiment of this invention. It is a side view which shows the internal state of the camera of FIG. 1 at the time of a body observation. It is a side view which shows the internal state of the camera of FIG. 1 at the time of imaging | photography. It is a figure which shows schematic structure of the imaging part of the image pick-up element in FIG. It is a rear view of the camera of FIG. It is a figure which shows the relationship between the drawing amount of the imaging lens in FIG. 2, and the contrast of an image. It is a figure which shows the flow of image data when a still image is image | photographed during the video recording with the camera of FIG. It is a figure which shows the relationship between the chapter inserted in the moving image image | photographed with the camera of FIG. 1, and a still image. It is a figure showing the moving image display state of 1st Embodiment by the display apparatus in FIG. It is a figure showing the timeline display state of 1st Embodiment by the display apparatus in FIG. 1 (1). It is a figure showing the advancing state of the moving image reproduction of 1st Embodiment by the display apparatus in FIG. It is a figure showing the thumbnail selection state of 1st Embodiment by the display apparatus in FIG. It is a figure showing the 1st display state of 2nd Embodiment by the display apparatus in FIG. It is a figure showing the 2nd display state of 2nd Embodiment by the display apparatus in FIG. It is a figure showing another display state of 2nd Embodiment by the display apparatus in FIG. It is a figure showing the display state of 3rd Embodiment by the display apparatus in FIG. It is a figure showing another display state of 3rd Embodiment by the display apparatus in FIG. It is a figure showing the display state of the continuous shooting imaging | photography part of 3rd Embodiment by the display apparatus in FIG. It is a figure showing the display state of another continuous shooting imaging | photography part of 3rd Embodiment by the display apparatus in FIG. It is a figure which shows the album pseudo-expressed on the display apparatus. It is a figure which shows a mode that a moving image and a still image are displayed in correlation. It is a figure showing the timeline display state of 1st Embodiment by the display apparatus in FIG. 1 (2).

Explanation of symbols

1 CPU
2 Image sensor 3 A / D converter 4 Semiconductor memory 5 Built-in memory 6 Image collation unit 7 Display device 8 Battery 72 Timeline information window 721 Timeline 723 Thumbnail image 100 Camera

Claims (14)

In a movie / still image playback device that plays back and displays images shot with a camera that can shoot still images during movie shooting processing,
A video playback control means for controlling the video to be played and displayed on the display unit;
A timeline indicating the length of time within a predetermined range of the moving image is displayed on the display unit, and a thumbnail image of a still image shot during the shooting process of the moving image is displayed at any position on the timeline. Whether or not it was taken at the timing is displayed in an identifiable manner, and a plurality of the thumbnail images are displayed in an overlapping manner. The thumbnail image of the still image shot at the position closest to the playback position after the playback position of the moving picture is higher than the thumbnail image of the still picture shot at a position before the position. Display control means for controlling to update the display;
A moving image / still image reproducing apparatus comprising:   In the moving image file in which the still image was shot during the moving image shooting process, a marking indicating that the still image was shot is recorded, and the still image has a file name including the name of the marking and the name of the moving image file. 2. The moving image / still image reproducing apparatus according to claim 1, further comprising recording control means for controlling to record an image.   3. The moving image / still image reproducing apparatus according to claim 2, wherein the marking includes information indicating a marking order and a marking position. The display control means may control, when the moving image photographing still images captured during processing is equal to or larger than a predetermined number, to claim 1, characterized in that it controls to display by dividing the timeline for each specific range 4. The moving image / still image reproducing device according to any one of 3 above. The display control means are all the still images captured during moving image shooting when there is at least a predetermined number, according to claim 1, wherein the controller controls so as to enlarge the specific range of the timeline The moving image / still image reproducing apparatus according to claim 1. The display control means may control, when the moving image photographing still images captured during processing has been plural shot in the continuous shooting mode, the single one of the photographed the still image with displaying as the thumbnail image 5. The moving image / still image reproducing device according to claim 1, wherein the moving image / still image reproducing device is controlled so as to display a continuous shot image. The display control unit displays, as a thumbnail image, any one of the still images captured in continuous shooting mode when a plurality of still images captured during the moving image shooting processing are captured in the continuous shooting mode. 5. The moving image / still image reproduction apparatus according to claim 1, wherein the moving image / still image reproduction apparatus controls the display so that the number of continuously shot images can be specified. In the case where a plurality of still images taken during the moving image shooting process have been shot in the continuous shooting mode, the display control means is configured to record the time corresponding to the continuous shooting time when the moving image is played back when it is close to the timing of the continuous shooting. 8. The moving image / still image reproducing apparatus according to claim 7, wherein a line is enlarged and displayed, and the thumbnail image of the still image taken by the continuous shooting is expanded and displayed.   9. The display control unit according to claim 1, wherein when the thumbnail image is selected, reproduction is started from the moving image at the time when the still image on which the thumbnail image is displayed is captured. The moving image / still image reproducing apparatus according to item 1.   10. The moving image / still image reproduction device according to claim 1, wherein the timeline indicates a shooting time together with a length of time within a predetermined range of the moving image. 11. The display control means displays a plurality of the thumbnail images so that the thumbnail images of the previously captured still images are on top , and the playback position of the video is changed according to the progress of playback of the video. When the position of the thumbnail image displayed by any one of the thumbnail images displayed by the display control means is exceeded, a plurality of still image thumbnail images captured at the timing of the position are displayed in a superimposed manner. The moving image / still image reproducing apparatus according to claim 1 , wherein the thumbnail images are controlled so as to be in the lowest overlapping order among the thumbnail images . A method for controlling a video / still image playback device that plays back and displays an image shot by a camera that can shoot a still image during the video shooting process,
A video playback control step for controlling the video to be played and displayed on the display unit;
A timeline indicating the length of time within a predetermined range of the moving image is displayed on the display unit, and a thumbnail image of a still image shot during the shooting process of the moving image is displayed at any position on the timeline. Whether or not it was taken at the timing is displayed in an identifiable manner, and a plurality of the thumbnail images are displayed in an overlapping manner. The thumbnail image of the still image shot at the position closest to the playback position after the playback position of the moving picture is higher than the thumbnail image of the still picture shot at a position before the position. A display control step for controlling to update the display;
A method for controlling a moving image / still image reproducing apparatus, comprising: A program for a computer to function as each unit of the moving image, a still image reproducing apparatus according to any one of claims 1 to 11. The computer of claim 1 to 11 recorded computer-readable storage medium storing a program to function as each unit of video and still image reproducing apparatus according to any one of.